2023-07-06T19:45:47.097 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-06T19:45:47.098 DEBUG:teuthology.run:Teuthology command: teuthology --name rishabh-2023-07-06_19:33:28-fs-wip-rishabh-2023Jul5-testing-default-smithi --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --archive /home/teuthworker/archive/rishabh-2023-07-06_19:33:28-fs-wip-rishabh-2023Jul5-testing-default-smithi/7328165 --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2023-07-06_19:33:28-fs-wip-rishabh-2023Jul5-testing-default-smithi/7328165/orig.config.yaml 2023-07-06T19:45:47.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-06T19:45:47.227 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-07-06_19:33:28-fs-wip-rishabh-2023Jul5-testing-default-smithi/7328165 branch: wip-rishabh-2023Jul5 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7328165' kernel: client: sha1: distro flavor: default kdb: true sha1: 84139c18d56f518615369e8310ae4ecf07a36dcd ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-07-06_19:33:28-fs-wip-rishabh-2023Jul5-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-rishabh-2023Jul5 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 79365bb3b803780276d69efb2cc4afe5b160de9e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 79365bb3b803780276d69efb2cc4afe5b160de9e kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023Jul5 sha1: 79365bb3b803780276d69efb2cc4afe5b160de9e owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 79365bb3b803780276d69efb2cc4afe5b160de9e sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023Jul5 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_79365bb3b803780276d69efb2cc4afe5b160de9e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 79365bb3b803780276d69efb2cc4afe5b160de9e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi006.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: b53f236c1077f1d295baafb9e0ca9a4b447019d7 timestamp: 2023-07-06_19:33:28 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-06T19:45:47.227 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_79365bb3b803780276d69efb2cc4afe5b160de9e/qa; will attempt to use it 2023-07-06T19:45:47.228 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_79365bb3b803780276d69efb2cc4afe5b160de9e/qa/tasks 2023-07-06T19:45:47.228 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-06T19:45:47.230 INFO:teuthology.task.internal:Checking packages... 2023-07-06T19:45:47.257 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '79365bb3b803780276d69efb2cc4afe5b160de9e' 2023-07-06T19:45:47.257 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-06T19:45:47.258 INFO:teuthology.packaging:ref: None 2023-07-06T19:45:47.258 INFO:teuthology.packaging:tag: None 2023-07-06T19:45:47.258 INFO:teuthology.packaging:branch: wip-rishabh-2023Jul5 2023-07-06T19:45:47.258 INFO:teuthology.packaging:sha1: 79365bb3b803780276d69efb2cc4afe5b160de9e 2023-07-06T19:45:47.259 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-rishabh-2023Jul5 2023-07-06T19:45:47.471 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4742.g79365bb3 2023-07-06T19:45:47.471 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-06T19:45:47.478 INFO:teuthology.task.internal:no buildpackages task found 2023-07-06T19:45:47.478 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-06T19:45:47.519 INFO:teuthology.task.internal:Saving configuration 2023-07-06T19:45:47.534 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-06T19:45:47.544 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-06T19:45:47.572 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-06_19:33:28-fs-wip-rishabh-2023Jul5-testing-default-smithi/7328165', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 19:34:45.220970', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-06T19:45:47.598 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-06_19:33:28-fs-wip-rishabh-2023Jul5-testing-default-smithi/7328165', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 19:34:45.219863', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-06T19:45:47.598 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-06T19:45:47.604 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-07-06T19:45:47.604 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-07-06T19:45:47.605 INFO:teuthology.run_tasks:Running task console_log... 2023-07-06T19:45:47.709 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f82eb0ca280>, signals=[15]) 2023-07-06T19:45:47.711 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-06T19:45:47.718 INFO:teuthology.task.internal:Opening connections... 2023-07-06T19:45:47.719 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi006.front.sepia.ceph.com 2023-07-06T19:45:47.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T19:45:47.790 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi040.front.sepia.ceph.com 2023-07-06T19:45:47.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T19:45:47.857 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-06T19:45:47.864 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2023-07-06T19:45:47.885 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2023-07-06T19:45:47.885 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-07-06T19:45:47.944 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux" 2023-07-06T19:45:47.945 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.6 (Ootpa)" 2023-07-06T19:45:47.945 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel" 2023-07-06T19:45:47.945 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora" 2023-07-06T19:45:47.945 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.6" 2023-07-06T19:45:47.945 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2023-07-06T19:45:47.946 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-06T19:45:47.946 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-07-06T19:45:47.946 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-06T19:45:47.946 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/" 2023-07-06T19:45:47.946 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-06T19:45:47.946 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T19:45:47.946 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:45:47.946 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T19:45:47.947 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-06T19:45:47.947 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-06T19:45:47.947 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-06T19:45:47.947 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-07-06T19:45:47.976 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2023-07-06T19:45:47.997 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2023-07-06T19:45:47.998 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2023-07-06T19:45:48.058 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="Red Hat Enterprise Linux" 2023-07-06T19:45:48.058 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="8.6 (Ootpa)" 2023-07-06T19:45:48.058 INFO:teuthology.orchestra.run.smithi040.stdout:ID="rhel" 2023-07-06T19:45:48.059 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="fedora" 2023-07-06T19:45:48.059 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="8.6" 2023-07-06T19:45:48.059 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el8" 2023-07-06T19:45:48.059 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-06T19:45:48.059 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2023-07-06T19:45:48.059 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-06T19:45:48.059 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://www.redhat.com/" 2023-07-06T19:45:48.060 INFO:teuthology.orchestra.run.smithi040.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-06T19:45:48.060 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-06T19:45:48.060 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:45:48.060 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-06T19:45:48.060 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-06T19:45:48.060 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-06T19:45:48.060 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-06T19:45:48.061 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2023-07-06T19:45:48.084 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-06T19:45:48.096 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-06T19:45:48.119 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-06T19:45:48.119 DEBUG:teuthology.orchestra.run.smithi006:> test '!' -e /home/ubuntu/cephtest 2023-07-06T19:45:48.122 DEBUG:teuthology.orchestra.run.smithi040:> test '!' -e /home/ubuntu/cephtest 2023-07-06T19:45:48.141 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-06T19:45:48.147 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-06T19:45:48.147 DEBUG:teuthology.orchestra.run.smithi006:> test -z $(ls -A /var/lib/ceph) 2023-07-06T19:45:48.181 DEBUG:teuthology.orchestra.run.smithi040:> test -z $(ls -A /var/lib/ceph) 2023-07-06T19:45:48.208 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-06T19:45:48.268 INFO:teuthology.run_tasks:Running task kernel... 2023-07-06T19:45:48.284 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'} 2023-07-06T19:45:48.284 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-07-06T19:45:48.285 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-07-06T19:45:48.285 DEBUG:teuthology.orchestra.run.smithi006:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-06T19:45:48.286 DEBUG:teuthology.orchestra.run.smithi040:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-06T19:45:48.304 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T19:45:48.305 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2023-07-06T19:45:48.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T19:45:48.306 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2023-07-06T19:45:48.365 INFO:teuthology.orchestra.run.smithi006.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-06T19:45:48.365 INFO:teuthology.task.kernel:Running kernel on smithi006: 4.18.0-372.9.1.el8.x86_64 2023-07-06T19:45:48.365 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum install -y kernel 2023-07-06T19:45:48.366 INFO:teuthology.orchestra.run.smithi040.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-06T19:45:48.367 INFO:teuthology.task.kernel:Running kernel on smithi040: 4.18.0-372.9.1.el8.x86_64 2023-07-06T19:45:48.367 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum install -y kernel 2023-07-06T19:45:49.602 INFO:teuthology.orchestra.run.smithi040.stdout:Updating Subscription Management repositories. 2023-07-06T19:45:49.602 INFO:teuthology.orchestra.run.smithi040.stdout:Unable to read consumer identity 2023-07-06T19:45:49.642 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-07-06T19:45:49.642 INFO:teuthology.orchestra.run.smithi006.stdout:Unable to read consumer identity 2023-07-06T19:45:53.663 INFO:teuthology.orchestra.run.smithi006.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-06T19:45:53.743 INFO:teuthology.orchestra.run.smithi040.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-06T19:45:56.172 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 6.3 MB/s | 16 MB 00:02 2023-07-06T19:45:56.260 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 6.3 MB/s | 16 MB 00:02 2023-07-06T19:45:59.930 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 462 kB/s | 24 kB 00:00 2023-07-06T19:45:59.993 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 601 kB/s | 24 kB 00:00 2023-07-06T19:46:00.633 INFO:teuthology.orchestra.run.smithi006.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-07-06T19:46:00.646 INFO:teuthology.orchestra.run.smithi040.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-07-06T19:46:00.677 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2023-07-06T19:46:00.678 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do. 2023-07-06T19:46:00.678 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2023-07-06T19:46:00.694 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2023-07-06T19:46:00.695 INFO:teuthology.orchestra.run.smithi040.stdout:Nothing to do. 2023-07-06T19:46:00.695 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2023-07-06T19:46:00.781 DEBUG:teuthology.orchestra.run.smithi006:> echo no | sudo yum reinstall kernel || true 2023-07-06T19:46:00.850 DEBUG:teuthology.orchestra.run.smithi040:> echo no | sudo yum reinstall kernel || true 2023-07-06T19:46:01.132 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-07-06T19:46:01.132 INFO:teuthology.orchestra.run.smithi006.stdout:Unable to read consumer identity 2023-07-06T19:46:01.204 INFO:teuthology.orchestra.run.smithi040.stdout:Updating Subscription Management repositories. 2023-07-06T19:46:01.204 INFO:teuthology.orchestra.run.smithi040.stdout:Unable to read consumer identity 2023-07-06T19:46:01.403 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:00:02 ago on Thu 06 Jul 2023 07:45:59 PM UTC. 2023-07-06T19:46:01.448 INFO:teuthology.orchestra.run.smithi006.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-06T19:46:01.476 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:00:02 ago on Thu 06 Jul 2023 07:45:59 PM UTC. 2023-07-06T19:46:01.482 INFO:teuthology.orchestra.run.smithi006.stderr:Error: No packages marked for reinstall. 2023-07-06T19:46:01.521 INFO:teuthology.orchestra.run.smithi040.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-06T19:46:01.529 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum reinstall -y kernel || true 2023-07-06T19:46:01.558 INFO:teuthology.orchestra.run.smithi040.stderr:Error: No packages marked for reinstall. 2023-07-06T19:46:01.606 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum reinstall -y kernel || true 2023-07-06T19:46:01.880 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-07-06T19:46:01.880 INFO:teuthology.orchestra.run.smithi006.stdout:Unable to read consumer identity 2023-07-06T19:46:01.954 INFO:teuthology.orchestra.run.smithi040.stdout:Updating Subscription Management repositories. 2023-07-06T19:46:01.954 INFO:teuthology.orchestra.run.smithi040.stdout:Unable to read consumer identity 2023-07-06T19:46:02.144 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:00:03 ago on Thu 06 Jul 2023 07:45:59 PM UTC. 2023-07-06T19:46:02.186 INFO:teuthology.orchestra.run.smithi006.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-06T19:46:02.214 INFO:teuthology.orchestra.run.smithi006.stderr:Error: No packages marked for reinstall. 2023-07-06T19:46:02.217 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:00:03 ago on Thu 06 Jul 2023 07:45:59 PM UTC. 2023-07-06T19:46:02.258 INFO:teuthology.orchestra.run.smithi040.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-06T19:46:02.260 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q kernel | sort -rV | head -n 1 2023-07-06T19:46:02.284 INFO:teuthology.orchestra.run.smithi040.stderr:Error: No packages marked for reinstall. 2023-07-06T19:46:02.334 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q kernel | sort -rV | head -n 1 2023-07-06T19:46:02.342 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-07-06T19:46:02.343 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-07-06T19:46:02.343 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-07-06T19:46:02.343 DEBUG:teuthology.parallel:result is None 2023-07-06T19:46:02.416 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-07-06T19:46:02.417 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-07-06T19:46:02.417 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-07-06T19:46:02.417 DEBUG:teuthology.parallel:result is None 2023-07-06T19:46:02.417 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-06T19:46:02.425 INFO:teuthology.task.internal:Creating test directory... 2023-07-06T19:46:02.426 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-06T19:46:02.428 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-06T19:46:02.444 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-06T19:46:02.467 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-06T19:46:02.492 INFO:teuthology.task.internal:Creating archive directory... 2023-07-06T19:46:02.493 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-06T19:46:02.495 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-06T19:46:02.523 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-06T19:46:02.529 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-06T19:46:02.529 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-06T19:46:02.553 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-06T19:46:02.592 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-06T19:46:02.596 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-06T19:46:02.613 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-06T19:46:02.616 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-06T19:46:02.618 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-06T19:46:02.625 INFO:teuthology.task.internal:Configuring sudo... 2023-07-06T19:46:02.625 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-06T19:46:02.657 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-06T19:46:02.685 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-06T19:46:02.700 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-06T19:46:02.700 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-06T19:46:02.726 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-06T19:46:02.742 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-06T19:46:02.827 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-06T19:46:02.881 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-06T19:46:02.967 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-06T19:46:03.006 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:46:03.007 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-06T19:46:03.074 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-06T19:46:03.122 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-06T19:46:03.182 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-06T19:46:03.226 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-06T19:46:03.268 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:46:03.269 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-06T19:46:03.346 DEBUG:teuthology.orchestra.run.smithi006:> sudo service rsyslog restart 2023-07-06T19:46:03.348 DEBUG:teuthology.orchestra.run.smithi040:> sudo service rsyslog restart 2023-07-06T19:46:03.399 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-06T19:46:03.444 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-06T19:46:03.862 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-06T19:46:03.870 INFO:teuthology.task.internal:Starting timer... 2023-07-06T19:46:03.870 INFO:teuthology.run_tasks:Running task pcp... 2023-07-06T19:46:03.904 INFO:teuthology.run_tasks:Running task selinux... 2023-07-06T19:46:03.928 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-07-06T19:46:03.929 DEBUG:teuthology.orchestra.run.smithi006:> sudo service auditd rotate 2023-07-06T19:46:04.015 INFO:teuthology.orchestra.run.smithi006.stdout:Rotating logs: 2023-07-06T19:46:04.017 DEBUG:teuthology.orchestra.run.smithi040:> sudo service auditd rotate 2023-07-06T19:46:04.085 INFO:teuthology.orchestra.run.smithi040.stdout:Rotating logs: 2023-07-06T19:46:04.087 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-06T19:46:04.087 DEBUG:teuthology.orchestra.run.smithi006:> /usr/sbin/getenforce 2023-07-06T19:46:04.121 INFO:teuthology.orchestra.run.smithi006.stdout:Permissive 2023-07-06T19:46:04.122 DEBUG:teuthology.orchestra.run.smithi040:> /usr/sbin/getenforce 2023-07-06T19:46:04.140 INFO:teuthology.orchestra.run.smithi040.stdout:Permissive 2023-07-06T19:46:04.140 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi006.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi040.front.sepia.ceph.com': 'permissive'} 2023-07-06T19:46:04.141 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-06T19:46:04.189 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T19:46:04.190 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-06T19:46:04.218 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T19:46:04.219 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-06T19:46:04.219 DEBUG:teuthology.orchestra.run.smithi006:> sudo /usr/sbin/setenforce permissive 2023-07-06T19:46:04.257 DEBUG:teuthology.orchestra.run.smithi040:> sudo /usr/sbin/setenforce permissive 2023-07-06T19:46:04.287 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-06T19:46:04.296 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-07-06T19:46:04.302 INFO:teuthology.repo_utils:Fetching main from origin 2023-07-06T19:46:04.454 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-06T19:46:04.474 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-06T19:46:04.475 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi006.front.sepia.ceph.com,smithi040.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-06T19:55:11.748 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi006.front.sepia.ceph.com'), Remote(name='ubuntu@smithi040.front.sepia.ceph.com')] 2023-07-06T19:55:11.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-07-06T19:55:11.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T19:55:11.824 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-07-06T19:55:11.892 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-07-06T19:55:11.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-07-06T19:55:11.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-06T19:55:12.006 DEBUG:teuthology.orchestra.run.smithi040:> true 2023-07-06T19:55:12.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2023-07-06T19:55:12.035 INFO:teuthology.run_tasks:Running task clock... 2023-07-06T19:55:12.052 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-06T19:55:12.053 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-06T19:55:12.054 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-06T19:55:12.057 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-06T19:55:12.058 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-06T19:55:12.088 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-06T19:55:12.104 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-06T19:55:12.116 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-06T19:55:12.133 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-06T19:55:12.184 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: ntpd: command not found 2023-07-06T19:55:12.196 INFO:teuthology.orchestra.run.smithi006.stdout:506 Cannot talk to daemon 2023-07-06T19:55:12.213 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: ntpd: command not found 2023-07-06T19:55:12.214 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-06T19:55:12.225 INFO:teuthology.orchestra.run.smithi040.stdout:506 Cannot talk to daemon 2023-07-06T19:55:12.226 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-06T19:55:12.241 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-06T19:55:12.255 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-06T19:55:12.304 INFO:teuthology.orchestra.run.smithi006.stderr:bash: ntpq: command not found 2023-07-06T19:55:12.307 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-06T19:55:12.307 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2023-07-06T19:55:12.308 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-06T19:55:12.308 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-06T19:55:12.308 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-06T19:55:12.309 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-06T19:55:12.333 INFO:teuthology.orchestra.run.smithi040.stderr:bash: ntpq: command not found 2023-07-06T19:55:12.337 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-06T19:55:12.337 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2023-07-06T19:55:12.337 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-06T19:55:12.337 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-06T19:55:12.337 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-06T19:55:12.338 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-06T19:55:12.338 INFO:teuthology.run_tasks:Running task install... 2023-07-06T19:55:12.347 DEBUG:teuthology.task.install:project ceph 2023-07-06T19:55:12.347 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '79365bb3b803780276d69efb2cc4afe5b160de9e'}} 2023-07-06T19:55:12.348 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '79365bb3b803780276d69efb2cc4afe5b160de9e'} 2023-07-06T19:55:12.348 INFO:teuthology.task.install:Using flavor: default 2023-07-06T19:55:12.354 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-06T19:55:12.355 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-06T19:55:12.356 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '79365bb3b803780276d69efb2cc4afe5b160de9e', 'tag': None, 'wait_for_package': False} 2023-07-06T19:55:12.356 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=79365bb3b803780276d69efb2cc4afe5b160de9e 2023-07-06T19:55:12.359 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '79365bb3b803780276d69efb2cc4afe5b160de9e', 'tag': None, 'wait_for_package': False} 2023-07-06T19:55:12.359 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=79365bb3b803780276d69efb2cc4afe5b160de9e 2023-07-06T19:55:12.502 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul5/79365bb3b803780276d69efb2cc4afe5b160de9e/centos/8/flavors/default/ 2023-07-06T19:55:12.502 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4742.g79365bb3 2023-07-06T19:55:12.585 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul5/79365bb3b803780276d69efb2cc4afe5b160de9e/centos/8/flavors/default/ 2023-07-06T19:55:12.585 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4742.g79365bb3 2023-07-06T19:55:12.824 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul5/79365bb3b803780276d69efb2cc4afe5b160de9e/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul5/79365bb3b803780276d69efb2cc4afe5b160de9e/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul5/79365bb3b803780276d69efb2cc4afe5b160de9e/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-06T19:55:12.825 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:55:12.825 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-06T19:55:12.856 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-06T19:55:12.857 DEBUG:teuthology.orchestra.run.smithi006:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/79365bb3b803780276d69efb2cc4afe5b160de9e/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-06T19:55:12.870 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul5/79365bb3b803780276d69efb2cc4afe5b160de9e/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul5/79365bb3b803780276d69efb2cc4afe5b160de9e/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul5/79365bb3b803780276d69efb2cc4afe5b160de9e/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-06T19:55:12.871 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:55:12.871 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-06T19:55:12.904 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-06T19:55:12.904 DEBUG:teuthology.orchestra.run.smithi040:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/79365bb3b803780276d69efb2cc4afe5b160de9e/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-06T19:55:12.930 DEBUG:teuthology.orchestra.run.smithi006:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-06T19:55:12.974 DEBUG:teuthology.orchestra.run.smithi040:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-06T19:55:13.014 DEBUG:teuthology.orchestra.run.smithi006:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-06T19:55:13.054 DEBUG:teuthology.orchestra.run.smithi040:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-06T19:55:13.084 INFO:teuthology.orchestra.run.smithi006.stdout:check_obsoletes = 1 2023-07-06T19:55:13.085 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum clean all 2023-07-06T19:55:13.122 INFO:teuthology.orchestra.run.smithi040.stdout:check_obsoletes = 1 2023-07-06T19:55:13.123 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum clean all 2023-07-06T19:55:13.478 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-07-06T19:55:13.515 INFO:teuthology.orchestra.run.smithi040.stdout:Updating Subscription Management repositories. 2023-07-06T19:55:14.015 INFO:teuthology.orchestra.run.smithi006.stdout:44 files removed 2023-07-06T19:55:14.065 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-06T19:55:14.202 INFO:teuthology.orchestra.run.smithi040.stdout:44 files removed 2023-07-06T19:55:14.251 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-06T19:55:14.416 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-07-06T19:55:14.604 INFO:teuthology.orchestra.run.smithi040.stdout:Updating Subscription Management repositories. 2023-07-06T19:55:16.052 INFO:teuthology.orchestra.run.smithi006.stdout:ceph packages for x86_64 86 kB/s | 81 kB 00:00 2023-07-06T19:55:16.128 INFO:teuthology.orchestra.run.smithi040.stdout:ceph packages for x86_64 91 kB/s | 81 kB 00:00 2023-07-06T19:55:16.619 INFO:teuthology.orchestra.run.smithi006.stdout:ceph noarch packages 18 kB/s | 9.4 kB 00:00 2023-07-06T19:55:16.996 INFO:teuthology.orchestra.run.smithi040.stdout:ceph noarch packages 11 kB/s | 9.4 kB 00:00 2023-07-06T19:55:17.378 INFO:teuthology.orchestra.run.smithi006.stdout:ceph source packages 2.0 kB/s | 1.5 kB 00:00 2023-07-06T19:55:17.705 INFO:teuthology.orchestra.run.smithi040.stdout:ceph source packages 2.2 kB/s | 1.5 kB 00:00 2023-07-06T19:55:20.061 INFO:teuthology.orchestra.run.smithi006.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2023-07-06T19:55:20.230 INFO:teuthology.orchestra.run.smithi040.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-07-06T19:55:20.954 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2023-07-06T19:55:22.465 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 7.1 MB/s | 16 MB 00:02 2023-07-06T19:55:24.796 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 437 kB/s | 24 kB 00:00 2023-07-06T19:55:25.740 INFO:teuthology.orchestra.run.smithi006.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 55 MB/s | 47 MB 00:00 2023-07-06T19:55:26.156 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 434 kB/s | 24 kB 00:00 2023-07-06T19:55:27.125 INFO:teuthology.orchestra.run.smithi040.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 53 MB/s | 47 MB 00:00 2023-07-06T19:55:34.733 INFO:teuthology.orchestra.run.smithi006.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 47 MB/s | 53 MB 00:01 2023-07-06T19:55:35.666 INFO:teuthology.orchestra.run.smithi040.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 49 MB/s | 53 MB 00:01 2023-07-06T19:55:47.006 INFO:teuthology.orchestra.run.smithi006.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-06T19:55:47.007 INFO:teuthology.orchestra.run.smithi006.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-06T19:55:47.034 INFO:teuthology.orchestra.run.smithi006.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-06T19:55:47.035 INFO:teuthology.orchestra.run.smithi006.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-06T19:55:47.035 INFO:teuthology.orchestra.run.smithi006.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-06T19:55:47.035 INFO:teuthology.orchestra.run.smithi006.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-06T19:55:47.036 INFO:teuthology.orchestra.run.smithi006.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-06T19:55:47.036 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-06T19:55:47.036 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-06T19:55:47.179 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2023-07-06T19:55:47.192 INFO:teuthology.orchestra.run.smithi006.stdout:=========================================================================================================================== 2023-07-06T19:55:47.192 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2023-07-06T19:55:47.192 INFO:teuthology.orchestra.run.smithi006.stdout:=========================================================================================================================== 2023-07-06T19:55:47.192 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2023-07-06T19:55:47.192 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-06T19:55:47.193 INFO:teuthology.orchestra.run.smithi006.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-06T19:55:47.193 INFO:teuthology.orchestra.run.smithi006.stdout: ceph x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 6.4 k 2023-07-06T19:55:47.193 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 5.4 M 2023-07-06T19:55:47.193 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 847 k 2023-07-06T19:55:47.193 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 165 k 2023-07-06T19:55:47.193 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 1.5 M 2023-07-06T19:55:47.193 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 129 k 2023-07-06T19:55:47.194 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 1.7 M 2023-07-06T19:55:47.194 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 7.4 M 2023-07-06T19:55:47.194 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 47 k 2023-07-06T19:55:47.194 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 13 M 2023-07-06T19:55:47.194 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 48 M 2023-07-06T19:55:47.194 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 258 k 2023-07-06T19:55:47.194 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 166 k 2023-07-06T19:55:47.195 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 258 k 2023-07-06T19:55:47.195 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 18 k 2023-07-06T19:55:47.195 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-06T19:55:47.195 INFO:teuthology.orchestra.run.smithi006.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-06T19:55:47.195 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-06T19:55:47.195 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 31 k 2023-07-06T19:55:47.195 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2 x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 770 k 2023-07-06T19:55:47.195 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 139 k 2023-07-06T19:55:47.196 INFO:teuthology.orchestra.run.smithi006.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-06T19:55:47.196 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-06T19:55:47.196 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-06T19:55:47.196 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-06T19:55:47.196 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-06T19:55:47.201 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-06T19:55:47.201 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 197 k 2023-07-06T19:55:47.201 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 370 k 2023-07-06T19:55:47.201 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 364 k 2023-07-06T19:55:47.201 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 107 k 2023-07-06T19:55:47.201 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 94 k 2023-07-06T19:55:47.202 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 3.5 M 2023-07-06T19:55:47.202 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 179 k 2023-07-06T19:55:47.202 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-06T19:55:47.202 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrading: 2023-07-06T19:55:47.202 INFO:teuthology.orchestra.run.smithi006.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-06T19:55:47.202 INFO:teuthology.orchestra.run.smithi006.stdout: librados2 x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 3.7 M 2023-07-06T19:55:47.202 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1 x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 3.6 M 2023-07-06T19:55:47.203 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2023-07-06T19:55:47.203 INFO:teuthology.orchestra.run.smithi006.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-06T19:55:47.203 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 22 M 2023-07-06T19:55:47.203 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 23 k 2023-07-06T19:55:47.203 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 2.3 M 2023-07-06T19:55:47.203 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 240 k 2023-07-06T19:55:47.203 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 4.6 M 2023-07-06T19:55:47.204 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 18 M 2023-07-06T19:55:47.204 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 15 k 2023-07-06T19:55:47.204 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 24 k 2023-07-06T19:55:47.204 INFO:teuthology.orchestra.run.smithi006.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-06T19:55:47.204 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-06T19:55:47.204 INFO:teuthology.orchestra.run.smithi006.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-06T19:55:47.204 INFO:teuthology.orchestra.run.smithi006.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-06T19:55:47.205 INFO:teuthology.orchestra.run.smithi006.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-06T19:55:47.205 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 137 k 2023-07-06T19:55:47.205 INFO:teuthology.orchestra.run.smithi006.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-06T19:55:47.205 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-06T19:55:47.205 INFO:teuthology.orchestra.run.smithi006.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-06T19:55:47.205 INFO:teuthology.orchestra.run.smithi006.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-06T19:55:47.205 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-06T19:55:47.206 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-06T19:55:47.206 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1 x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 475 k 2023-07-06T19:55:47.206 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-06T19:55:47.206 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2 x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 6.7 M 2023-07-06T19:55:47.206 INFO:teuthology.orchestra.run.smithi006.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-06T19:55:47.206 INFO:teuthology.orchestra.run.smithi006.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-06T19:55:47.206 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-06T19:55:47.207 INFO:teuthology.orchestra.run.smithi006.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-06T19:55:47.207 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-06T19:55:47.207 INFO:teuthology.orchestra.run.smithi006.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-06T19:55:47.207 INFO:teuthology.orchestra.run.smithi006.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-06T19:55:47.207 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-06T19:55:47.207 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-06T19:55:47.207 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-06T19:55:47.208 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-06T19:55:47.208 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-06T19:55:47.208 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-06T19:55:47.209 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-06T19:55:47.209 INFO:teuthology.orchestra.run.smithi006.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-06T19:55:47.209 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-06T19:55:47.210 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 45 k 2023-07-06T19:55:47.210 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 119 k 2023-07-06T19:55:47.210 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-06T19:55:47.210 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-06T19:55:47.210 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-06T19:55:47.211 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-06T19:55:47.211 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-06T19:55:47.211 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-06T19:55:47.211 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-06T19:55:47.211 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-06T19:55:47.212 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-06T19:55:47.212 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-06T19:55:47.212 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-06T19:55:47.212 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-06T19:55:47.212 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-06T19:55:47.213 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-06T19:55:47.213 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-06T19:55:47.213 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-06T19:55:47.213 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-06T19:55:47.213 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-06T19:55:47.214 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-06T19:55:47.214 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-06T19:55:47.214 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-06T19:55:47.214 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-06T19:55:47.214 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-06T19:55:47.214 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-06T19:55:47.214 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-06T19:55:47.215 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-06T19:55:47.215 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-06T19:55:47.215 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-06T19:55:47.215 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-06T19:55:47.215 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-06T19:55:47.215 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-06T19:55:47.215 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-06T19:55:47.216 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-06T19:55:47.216 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-06T19:55:47.216 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-06T19:55:47.216 INFO:teuthology.orchestra.run.smithi006.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-06T19:55:47.216 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-06T19:55:47.217 INFO:teuthology.orchestra.run.smithi006.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-06T19:55:47.217 INFO:teuthology.orchestra.run.smithi006.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-06T19:55:47.217 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-06T19:55:47.217 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-06T19:55:47.217 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-06T19:55:47.218 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-06T19:55:47.218 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-06T19:55:47.218 INFO:teuthology.orchestra.run.smithi006.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-06T19:55:47.218 INFO:teuthology.orchestra.run.smithi006.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-06T19:55:47.218 INFO:teuthology.orchestra.run.smithi006.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-06T19:55:47.218 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-06T19:55:47.218 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-06T19:55:47.219 INFO:teuthology.orchestra.run.smithi006.stdout:Enabling module streams: 2023-07-06T19:55:47.219 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql 10 2023-07-06T19:55:47.219 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:55:47.219 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2023-07-06T19:55:47.219 INFO:teuthology.orchestra.run.smithi006.stdout:=========================================================================================================================== 2023-07-06T19:55:47.219 INFO:teuthology.orchestra.run.smithi006.stdout:Install 128 Packages 2023-07-06T19:55:47.220 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrade 3 Packages 2023-07-06T19:55:47.220 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:55:47.220 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 205 M 2023-07-06T19:55:47.221 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2023-07-06T19:55:47.558 INFO:teuthology.orchestra.run.smithi040.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-06T19:55:47.559 INFO:teuthology.orchestra.run.smithi040.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-06T19:55:47.566 INFO:teuthology.orchestra.run.smithi006.stdout:(1/131): ceph-18.0.0-4742.g79365bb3.el8.x86_64. 20 kB/s | 6.4 kB 00:00 2023-07-06T19:55:47.574 INFO:teuthology.orchestra.run.smithi040.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-06T19:55:47.575 INFO:teuthology.orchestra.run.smithi040.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-06T19:55:47.579 INFO:teuthology.orchestra.run.smithi040.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-06T19:55:47.580 INFO:teuthology.orchestra.run.smithi040.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-06T19:55:47.580 INFO:teuthology.orchestra.run.smithi040.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-06T19:55:47.586 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-06T19:55:47.586 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-06T19:55:47.727 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2023-07-06T19:55:47.740 INFO:teuthology.orchestra.run.smithi040.stdout:=========================================================================================================================== 2023-07-06T19:55:47.741 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2023-07-06T19:55:47.741 INFO:teuthology.orchestra.run.smithi040.stdout:=========================================================================================================================== 2023-07-06T19:55:47.741 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2023-07-06T19:55:47.741 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-06T19:55:47.741 INFO:teuthology.orchestra.run.smithi040.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-06T19:55:47.742 INFO:teuthology.orchestra.run.smithi040.stdout: ceph x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 6.4 k 2023-07-06T19:55:47.742 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 5.4 M 2023-07-06T19:55:47.742 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 847 k 2023-07-06T19:55:47.742 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 165 k 2023-07-06T19:55:47.742 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 1.5 M 2023-07-06T19:55:47.743 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 129 k 2023-07-06T19:55:47.743 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 1.7 M 2023-07-06T19:55:47.743 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 7.4 M 2023-07-06T19:55:47.743 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 47 k 2023-07-06T19:55:47.743 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 13 M 2023-07-06T19:55:47.743 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 48 M 2023-07-06T19:55:47.744 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 258 k 2023-07-06T19:55:47.744 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 166 k 2023-07-06T19:55:47.744 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 258 k 2023-07-06T19:55:47.744 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-top noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 18 k 2023-07-06T19:55:47.744 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-06T19:55:47.744 INFO:teuthology.orchestra.run.smithi040.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-06T19:55:47.744 INFO:teuthology.orchestra.run.smithi040.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-06T19:55:47.745 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 31 k 2023-07-06T19:55:47.745 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2 x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 770 k 2023-07-06T19:55:47.746 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 139 k 2023-07-06T19:55:47.746 INFO:teuthology.orchestra.run.smithi040.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-06T19:55:47.746 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-06T19:55:47.746 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-06T19:55:47.746 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-06T19:55:47.746 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-06T19:55:47.753 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-06T19:55:47.753 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 197 k 2023-07-06T19:55:47.768 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 370 k 2023-07-06T19:55:47.769 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 364 k 2023-07-06T19:55:47.769 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 107 k 2023-07-06T19:55:47.769 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 94 k 2023-07-06T19:55:47.769 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 3.5 M 2023-07-06T19:55:47.769 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 179 k 2023-07-06T19:55:47.769 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-06T19:55:47.769 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrading: 2023-07-06T19:55:47.770 INFO:teuthology.orchestra.run.smithi040.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-06T19:55:47.770 INFO:teuthology.orchestra.run.smithi040.stdout: librados2 x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 3.7 M 2023-07-06T19:55:47.770 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1 x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 3.6 M 2023-07-06T19:55:47.770 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2023-07-06T19:55:47.770 INFO:teuthology.orchestra.run.smithi040.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-06T19:55:47.770 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 22 M 2023-07-06T19:55:47.778 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 23 k 2023-07-06T19:55:47.779 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 2.3 M 2023-07-06T19:55:47.779 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 240 k 2023-07-06T19:55:47.779 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 4.6 M 2023-07-06T19:55:47.779 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 18 M 2023-07-06T19:55:47.779 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4742.g79365bb3.el8 ceph-noarch 15 k 2023-07-06T19:55:47.779 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 24 k 2023-07-06T19:55:47.779 INFO:teuthology.orchestra.run.smithi040.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-06T19:55:47.780 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-06T19:55:47.780 INFO:teuthology.orchestra.run.smithi040.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-06T19:55:47.780 INFO:teuthology.orchestra.run.smithi040.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-06T19:55:47.780 INFO:teuthology.orchestra.run.smithi040.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-06T19:55:47.780 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 137 k 2023-07-06T19:55:47.780 INFO:teuthology.orchestra.run.smithi040.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-06T19:55:47.780 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-06T19:55:47.781 INFO:teuthology.orchestra.run.smithi040.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-06T19:55:47.781 INFO:teuthology.orchestra.run.smithi040.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-06T19:55:47.781 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-06T19:55:47.788 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-06T19:55:47.789 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1 x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 475 k 2023-07-06T19:55:47.789 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-06T19:55:47.789 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2 x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 6.7 M 2023-07-06T19:55:47.789 INFO:teuthology.orchestra.run.smithi040.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-06T19:55:47.789 INFO:teuthology.orchestra.run.smithi040.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-06T19:55:47.790 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-06T19:55:47.790 INFO:teuthology.orchestra.run.smithi040.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-06T19:55:47.799 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-06T19:55:47.799 INFO:teuthology.orchestra.run.smithi040.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-06T19:55:47.800 INFO:teuthology.orchestra.run.smithi040.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-06T19:55:47.800 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-06T19:55:47.800 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-06T19:55:47.800 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-06T19:55:47.800 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-06T19:55:47.800 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-06T19:55:47.800 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-06T19:55:47.801 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-06T19:55:47.801 INFO:teuthology.orchestra.run.smithi040.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-06T19:55:47.801 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-06T19:55:47.801 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 45 k 2023-07-06T19:55:47.801 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common x86_64 2:18.0.0-4742.g79365bb3.el8 ceph 119 k 2023-07-06T19:55:47.801 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-06T19:55:47.801 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-06T19:55:47.801 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-06T19:55:47.806 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-06T19:55:47.806 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-06T19:55:47.806 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-06T19:55:47.807 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-06T19:55:47.807 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-06T19:55:47.807 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-06T19:55:47.807 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-06T19:55:47.807 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-06T19:55:47.807 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-06T19:55:47.807 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-06T19:55:47.808 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-06T19:55:47.808 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-06T19:55:47.808 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-06T19:55:47.808 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-06T19:55:47.808 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-06T19:55:47.808 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-06T19:55:47.808 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-06T19:55:47.809 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-06T19:55:47.809 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-06T19:55:47.811 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-06T19:55:47.811 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-06T19:55:47.812 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-06T19:55:47.812 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-06T19:55:47.812 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-06T19:55:47.812 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-06T19:55:47.812 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-06T19:55:47.812 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-06T19:55:47.812 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-06T19:55:47.813 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-06T19:55:47.813 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-06T19:55:47.815 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-06T19:55:47.815 INFO:teuthology.orchestra.run.smithi040.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-06T19:55:47.815 INFO:teuthology.orchestra.run.smithi040.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-06T19:55:47.820 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-06T19:55:47.820 INFO:teuthology.orchestra.run.smithi040.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-06T19:55:47.820 INFO:teuthology.orchestra.run.smithi040.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-06T19:55:47.820 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-06T19:55:47.820 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-06T19:55:47.821 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-06T19:55:47.821 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-06T19:55:47.821 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-06T19:55:47.821 INFO:teuthology.orchestra.run.smithi040.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-06T19:55:47.821 INFO:teuthology.orchestra.run.smithi040.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-06T19:55:47.822 INFO:teuthology.orchestra.run.smithi040.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-06T19:55:47.822 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-06T19:55:47.822 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-06T19:55:47.822 INFO:teuthology.orchestra.run.smithi040.stdout:Enabling module streams: 2023-07-06T19:55:47.822 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql 10 2023-07-06T19:55:47.822 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:55:47.822 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2023-07-06T19:55:47.823 INFO:teuthology.orchestra.run.smithi040.stdout:=========================================================================================================================== 2023-07-06T19:55:47.823 INFO:teuthology.orchestra.run.smithi040.stdout:Install 128 Packages 2023-07-06T19:55:47.823 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrade 3 Packages 2023-07-06T19:55:47.823 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:55:47.832 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 205 M 2023-07-06T19:55:47.832 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2023-07-06T19:55:48.285 INFO:teuthology.orchestra.run.smithi040.stdout:(1/131): ceph-18.0.0-4742.g79365bb3.el8.x86_64. 17 kB/s | 6.4 kB 00:00 2023-07-06T19:55:48.441 INFO:teuthology.orchestra.run.smithi006.stdout:(2/131): ceph-fuse-18.0.0-4742.g79365bb3.el8.x8 968 kB/s | 847 kB 00:00 2023-07-06T19:55:48.833 INFO:teuthology.orchestra.run.smithi006.stdout:(3/131): ceph-immutable-object-cache-18.0.0-474 422 kB/s | 165 kB 00:00 2023-07-06T19:55:49.351 INFO:teuthology.orchestra.run.smithi006.stdout:(4/131): ceph-base-18.0.0-4742.g79365bb3.el8.x8 2.5 MB/s | 5.4 MB 00:02 2023-07-06T19:55:49.642 INFO:teuthology.orchestra.run.smithi040.stdout:(2/131): ceph-fuse-18.0.0-4742.g79365bb3.el8.x8 624 kB/s | 847 kB 00:01 2023-07-06T19:55:49.787 INFO:teuthology.orchestra.run.smithi006.stdout:(5/131): ceph-mgr-18.0.0-4742.g79365bb3.el8.x86 3.6 MB/s | 1.5 MB 00:00 2023-07-06T19:55:49.875 INFO:teuthology.orchestra.run.smithi040.stdout:(3/131): ceph-immutable-object-cache-18.0.0-474 709 kB/s | 165 kB 00:00 2023-07-06T19:55:50.351 INFO:teuthology.orchestra.run.smithi040.stdout:(4/131): ceph-base-18.0.0-4742.g79365bb3.el8.x8 2.2 MB/s | 5.4 MB 00:02 2023-07-06T19:55:50.759 INFO:teuthology.orchestra.run.smithi006.stdout:(6/131): ceph-mds-18.0.0-4742.g79365bb3.el8.x86 1.2 MB/s | 2.3 MB 00:01 2023-07-06T19:55:50.835 INFO:teuthology.orchestra.run.smithi040.stdout:(5/131): ceph-mgr-18.0.0-4742.g79365bb3.el8.x86 3.2 MB/s | 1.5 MB 00:00 2023-07-06T19:55:50.984 INFO:teuthology.orchestra.run.smithi006.stdout:(7/131): ceph-mon-18.0.0-4742.g79365bb3.el8.x86 3.8 MB/s | 4.6 MB 00:01 2023-07-06T19:55:52.202 INFO:teuthology.orchestra.run.smithi040.stdout:(6/131): ceph-mon-18.0.0-4742.g79365bb3.el8.x86 3.4 MB/s | 4.6 MB 00:01 2023-07-06T19:55:52.319 INFO:teuthology.orchestra.run.smithi040.stdout:(7/131): ceph-mds-18.0.0-4742.g79365bb3.el8.x86 955 kB/s | 2.3 MB 00:02 2023-07-06T19:55:54.097 INFO:teuthology.orchestra.run.smithi040.stdout:(8/131): ceph-common-18.0.0-4742.g79365bb3.el8. 3.6 MB/s | 22 MB 00:06 2023-07-06T19:55:54.177 INFO:teuthology.orchestra.run.smithi040.stdout:(9/131): ceph-selinux-18.0.0-4742.g79365bb3.el8 293 kB/s | 24 kB 00:00 2023-07-06T19:55:54.226 INFO:teuthology.orchestra.run.smithi006.stdout:(8/131): ceph-common-18.0.0-4742.g79365bb3.el8. 3.2 MB/s | 22 MB 00:06 2023-07-06T19:55:54.318 INFO:teuthology.orchestra.run.smithi006.stdout:(9/131): ceph-selinux-18.0.0-4742.g79365bb3.el8 266 kB/s | 24 kB 00:00 2023-07-06T19:55:54.568 INFO:teuthology.orchestra.run.smithi006.stdout:(10/131): ceph-radosgw-18.0.0-4742.g79365bb3.el 3.8 MB/s | 13 MB 00:03 2023-07-06T19:55:54.743 INFO:teuthology.orchestra.run.smithi006.stdout:(11/131): cephfs-mirror-18.0.0-4742.g79365bb3.e 1.4 MB/s | 258 kB 00:00 2023-07-06T19:55:54.861 INFO:teuthology.orchestra.run.smithi006.stdout:(12/131): libcephfs-devel-18.0.0-4742.g79365bb3 265 kB/s | 31 kB 00:00 2023-07-06T19:55:55.113 INFO:teuthology.orchestra.run.smithi006.stdout:(13/131): libcephfs2-18.0.0-4742.g79365bb3.el8. 3.0 MB/s | 770 kB 00:00 2023-07-06T19:55:55.221 INFO:teuthology.orchestra.run.smithi006.stdout:(14/131): libcephsqlite-18.0.0-4742.g79365bb3.e 1.3 MB/s | 137 kB 00:00 2023-07-06T19:55:55.303 INFO:teuthology.orchestra.run.smithi006.stdout:(15/131): librados-devel-18.0.0-4742.g79365bb3. 1.6 MB/s | 139 kB 00:00 2023-07-06T19:55:55.491 INFO:teuthology.orchestra.run.smithi006.stdout:(16/131): libradosstriper1-18.0.0-4742.g79365bb 2.5 MB/s | 475 kB 00:00 2023-07-06T19:55:57.102 INFO:teuthology.orchestra.run.smithi040.stdout:(10/131): ceph-osd-18.0.0-4742.g79365bb3.el8.x8 3.6 MB/s | 18 MB 00:04 2023-07-06T19:55:57.163 INFO:teuthology.orchestra.run.smithi006.stdout:(17/131): librgw2-18.0.0-4742.g79365bb3.el8.x86 4.0 MB/s | 6.7 MB 00:01 2023-07-06T19:55:57.187 INFO:teuthology.orchestra.run.smithi040.stdout:(11/131): cephfs-mirror-18.0.0-4742.g79365bb3.e 3.0 MB/s | 258 kB 00:00 2023-07-06T19:55:57.229 INFO:teuthology.orchestra.run.smithi006.stdout:(18/131): python3-ceph-argparse-18.0.0-4742.g79 673 kB/s | 45 kB 00:00 2023-07-06T19:55:57.278 INFO:teuthology.orchestra.run.smithi040.stdout:(12/131): libcephfs-devel-18.0.0-4742.g79365bb3 338 kB/s | 31 kB 00:00 2023-07-06T19:55:57.308 INFO:teuthology.orchestra.run.smithi006.stdout:(19/131): python3-ceph-common-18.0.0-4742.g7936 1.5 MB/s | 119 kB 00:00 2023-07-06T19:55:57.389 INFO:teuthology.orchestra.run.smithi006.stdout:(20/131): python3-cephfs-18.0.0-4742.g79365bb3. 2.3 MB/s | 197 kB 00:00 2023-07-06T19:55:57.545 INFO:teuthology.orchestra.run.smithi040.stdout:(13/131): libcephfs2-18.0.0-4742.g79365bb3.el8. 2.8 MB/s | 770 kB 00:00 2023-07-06T19:55:57.553 INFO:teuthology.orchestra.run.smithi006.stdout:(21/131): python3-rados-18.0.0-4742.g79365bb3.e 2.3 MB/s | 370 kB 00:00 2023-07-06T19:55:57.620 INFO:teuthology.orchestra.run.smithi040.stdout:(14/131): libcephsqlite-18.0.0-4742.g79365bb3.e 1.8 MB/s | 137 kB 00:00 2023-07-06T19:55:57.697 INFO:teuthology.orchestra.run.smithi006.stdout:(22/131): python3-rbd-18.0.0-4742.g79365bb3.el8 2.4 MB/s | 364 kB 00:00 2023-07-06T19:55:57.721 INFO:teuthology.orchestra.run.smithi040.stdout:(15/131): librados-devel-18.0.0-4742.g79365bb3. 1.4 MB/s | 139 kB 00:00 2023-07-06T19:55:57.776 INFO:teuthology.orchestra.run.smithi006.stdout:(23/131): python3-rgw-18.0.0-4742.g79365bb3.el8 1.4 MB/s | 107 kB 00:00 2023-07-06T19:55:57.881 INFO:teuthology.orchestra.run.smithi006.stdout:(24/131): rbd-fuse-18.0.0-4742.g79365bb3.el8.x8 870 kB/s | 94 kB 00:00 2023-07-06T19:55:57.905 INFO:teuthology.orchestra.run.smithi040.stdout:(16/131): libradosstriper1-18.0.0-4742.g79365bb 2.5 MB/s | 475 kB 00:00 2023-07-06T19:55:58.957 INFO:teuthology.orchestra.run.smithi006.stdout:(25/131): rbd-mirror-18.0.0-4742.g79365bb3.el8. 3.2 MB/s | 3.5 MB 00:01 2023-07-06T19:55:59.048 INFO:teuthology.orchestra.run.smithi006.stdout:(26/131): rbd-nbd-18.0.0-4742.g79365bb3.el8.x86 1.9 MB/s | 179 kB 00:00 2023-07-06T19:55:59.131 INFO:teuthology.orchestra.run.smithi006.stdout:(27/131): ceph-grafana-dashboards-18.0.0-4742.g 277 kB/s | 23 kB 00:00 2023-07-06T19:55:59.223 INFO:teuthology.orchestra.run.smithi006.stdout:(28/131): ceph-mgr-cephadm-18.0.0-4742.g79365bb 1.4 MB/s | 129 kB 00:00 2023-07-06T19:55:59.567 INFO:teuthology.orchestra.run.smithi006.stdout:(29/131): ceph-osd-18.0.0-4742.g79365bb3.el8.x8 2.0 MB/s | 18 MB 00:08 2023-07-06T19:55:59.679 INFO:teuthology.orchestra.run.smithi040.stdout:(17/131): librgw2-18.0.0-4742.g79365bb3.el8.x86 3.8 MB/s | 6.7 MB 00:01 2023-07-06T19:55:59.788 INFO:teuthology.orchestra.run.smithi040.stdout:(18/131): python3-ceph-argparse-18.0.0-4742.g79 414 kB/s | 45 kB 00:00 2023-07-06T19:55:59.871 INFO:teuthology.orchestra.run.smithi040.stdout:(19/131): python3-ceph-common-18.0.0-4742.g7936 1.4 MB/s | 119 kB 00:00 2023-07-06T19:55:59.933 INFO:teuthology.orchestra.run.smithi006.stdout:(30/131): ceph-mgr-dashboard-18.0.0-4742.g79365 2.4 MB/s | 1.7 MB 00:00 2023-07-06T19:55:59.963 INFO:teuthology.orchestra.run.smithi040.stdout:(20/131): python3-cephfs-18.0.0-4742.g79365bb3. 2.1 MB/s | 197 kB 00:00 2023-07-06T19:56:00.026 INFO:teuthology.orchestra.run.smithi006.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4742.g79 2.6 MB/s | 240 kB 00:00 2023-07-06T19:56:00.142 INFO:teuthology.orchestra.run.smithi006.stdout:(32/131): ceph-mgr-rook-18.0.0-4742.g79365bb3.e 404 kB/s | 47 kB 00:00 2023-07-06T19:56:00.172 INFO:teuthology.orchestra.run.smithi040.stdout:(21/131): ceph-radosgw-18.0.0-4742.g79365bb3.el 1.7 MB/s | 13 MB 00:07 2023-07-06T19:56:00.197 INFO:teuthology.orchestra.run.smithi040.stdout:(22/131): python3-rados-18.0.0-4742.g79365bb3.e 1.5 MB/s | 370 kB 00:00 2023-07-06T19:56:00.211 INFO:teuthology.orchestra.run.smithi006.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4742.g7 221 kB/s | 15 kB 00:00 2023-07-06T19:56:00.306 INFO:teuthology.orchestra.run.smithi040.stdout:(23/131): python3-rgw-18.0.0-4742.g79365bb3.el8 986 kB/s | 107 kB 00:00 2023-07-06T19:56:00.339 INFO:teuthology.orchestra.run.smithi040.stdout:(24/131): python3-rbd-18.0.0-4742.g79365bb3.el8 2.1 MB/s | 364 kB 00:00 2023-07-06T19:56:00.358 INFO:teuthology.orchestra.run.smithi006.stdout:(34/131): ceph-volume-18.0.0-4742.g79365bb3.el8 1.7 MB/s | 258 kB 00:00 2023-07-06T19:56:00.398 INFO:teuthology.orchestra.run.smithi040.stdout:(25/131): rbd-fuse-18.0.0-4742.g79365bb3.el8.x8 1.0 MB/s | 94 kB 00:00 2023-07-06T19:56:00.451 INFO:teuthology.orchestra.run.smithi006.stdout:(35/131): cephadm-18.0.0-4742.g79365bb3.el8.noa 1.8 MB/s | 166 kB 00:00 2023-07-06T19:56:00.515 INFO:teuthology.orchestra.run.smithi040.stdout:(26/131): rbd-nbd-18.0.0-4742.g79365bb3.el8.x86 1.5 MB/s | 179 kB 00:00 2023-07-06T19:56:00.543 INFO:teuthology.orchestra.run.smithi006.stdout:(36/131): cephfs-top-18.0.0-4742.g79365bb3.el8. 196 kB/s | 18 kB 00:00 2023-07-06T19:56:00.619 INFO:teuthology.orchestra.run.smithi040.stdout:(27/131): ceph-grafana-dashboards-18.0.0-4742.g 230 kB/s | 23 kB 00:00 2023-07-06T19:56:00.716 INFO:teuthology.orchestra.run.smithi040.stdout:(28/131): ceph-mgr-cephadm-18.0.0-4742.g79365bb 1.3 MB/s | 129 kB 00:00 2023-07-06T19:56:00.779 INFO:teuthology.orchestra.run.smithi006.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.3 MB/s | 306 kB 00:00 2023-07-06T19:56:00.852 INFO:teuthology.orchestra.run.smithi006.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 783 kB/s | 59 kB 00:00 2023-07-06T19:56:00.929 INFO:teuthology.orchestra.run.smithi006.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.0 MB/s | 75 kB 00:00 2023-07-06T19:56:01.035 INFO:teuthology.orchestra.run.smithi006.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 4.3 MB/s | 476 kB 00:00 2023-07-06T19:56:01.086 INFO:teuthology.orchestra.run.smithi006.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 872 kB/s | 44 kB 00:00 2023-07-06T19:56:01.145 INFO:teuthology.orchestra.run.smithi006.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 3.1 MB/s | 185 kB 00:00 2023-07-06T19:56:01.204 INFO:teuthology.orchestra.run.smithi006.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 566 kB/s | 33 kB 00:00 2023-07-06T19:56:01.266 INFO:teuthology.orchestra.run.smithi040.stdout:(29/131): ceph-mgr-dashboard-18.0.0-4742.g79365 3.1 MB/s | 1.7 MB 00:00 2023-07-06T19:56:01.296 INFO:teuthology.orchestra.run.smithi006.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 178 kB/s | 16 kB 00:00 2023-07-06T19:56:01.316 INFO:teuthology.orchestra.run.smithi040.stdout:(30/131): rbd-mirror-18.0.0-4742.g79365bb3.el8. 3.5 MB/s | 3.5 MB 00:00 2023-07-06T19:56:01.387 INFO:teuthology.orchestra.run.smithi006.stdout:(45/131): ceph-mgr-diskprediction-local-18.0.0- 4.1 MB/s | 7.4 MB 00:01 2023-07-06T19:56:01.414 INFO:teuthology.orchestra.run.smithi006.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.4 MB/s | 173 kB 00:00 2023-07-06T19:56:01.425 INFO:teuthology.orchestra.run.smithi040.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4742.g79 2.2 MB/s | 240 kB 00:00 2023-07-06T19:56:01.471 INFO:teuthology.orchestra.run.smithi006.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2023-07-06T19:56:01.508 INFO:teuthology.orchestra.run.smithi040.stdout:(32/131): ceph-mgr-rook-18.0.0-4742.g79365bb3.e 569 kB/s | 47 kB 00:00 2023-07-06T19:56:01.531 INFO:teuthology.orchestra.run.smithi006.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 191 kB/s | 11 kB 00:00 2023-07-06T19:56:01.584 INFO:teuthology.orchestra.run.smithi040.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4742.g7 194 kB/s | 15 kB 00:00 2023-07-06T19:56:01.597 INFO:teuthology.orchestra.run.smithi006.stdout:(49/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.8 MB/s | 384 kB 00:00 2023-07-06T19:56:01.622 INFO:teuthology.orchestra.run.smithi006.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 191 kB/s | 18 kB 00:00 2023-07-06T19:56:01.681 INFO:teuthology.orchestra.run.smithi006.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 836 kB/s | 49 kB 00:00 2023-07-06T19:56:01.711 INFO:teuthology.orchestra.run.smithi040.stdout:(34/131): ceph-volume-18.0.0-4742.g79365bb3.el8 2.0 MB/s | 258 kB 00:00 2023-07-06T19:56:01.716 INFO:teuthology.orchestra.run.smithi006.stdout:(52/131): python3-kubernetes-11.0.0-6.el8.noarc 10 MB/s | 1.2 MB 00:00 2023-07-06T19:56:01.740 INFO:teuthology.orchestra.run.smithi006.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2023-07-06T19:56:01.765 INFO:teuthology.orchestra.run.smithi006.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-07-06T19:56:01.807 INFO:teuthology.orchestra.run.smithi006.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 4.1 MB/s | 283 kB 00:00 2023-07-06T19:56:01.832 INFO:teuthology.orchestra.run.smithi006.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2023-07-06T19:56:01.866 INFO:teuthology.orchestra.run.smithi006.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 575 kB/s | 34 kB 00:00 2023-07-06T19:56:01.867 INFO:teuthology.orchestra.run.smithi040.stdout:(35/131): cephadm-18.0.0-4742.g79365bb3.el8.noa 1.0 MB/s | 166 kB 00:00 2023-07-06T19:56:01.891 INFO:teuthology.orchestra.run.smithi006.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 3.3 MB/s | 196 kB 00:00 2023-07-06T19:56:01.917 INFO:teuthology.orchestra.run.smithi006.stdout:(59/131): python3-rsa-4.8-1.el8.noarch.rpm 1.2 MB/s | 61 kB 00:00 2023-07-06T19:56:01.958 INFO:teuthology.orchestra.run.smithi006.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 280 kB/s | 19 kB 00:00 2023-07-06T19:56:01.959 INFO:teuthology.orchestra.run.smithi040.stdout:(36/131): cephfs-top-18.0.0-4742.g79365bb3.el8. 196 kB/s | 18 kB 00:00 2023-07-06T19:56:01.984 INFO:teuthology.orchestra.run.smithi006.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 357 kB/s | 24 kB 00:00 2023-07-06T19:56:02.009 INFO:teuthology.orchestra.run.smithi006.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 582 kB/s | 29 kB 00:00 2023-07-06T19:56:02.059 INFO:teuthology.orchestra.run.smithi006.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 365 kB/s | 27 kB 00:00 2023-07-06T19:56:02.085 INFO:teuthology.orchestra.run.smithi006.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 3.3 MB/s | 255 kB 00:00 2023-07-06T19:56:02.119 INFO:teuthology.orchestra.run.smithi006.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 4.2 MB/s | 251 kB 00:00 2023-07-06T19:56:02.144 INFO:teuthology.orchestra.run.smithi006.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.0 MB/s | 61 kB 00:00 2023-07-06T19:56:02.160 INFO:teuthology.orchestra.run.smithi040.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.5 MB/s | 306 kB 00:00 2023-07-06T19:56:02.169 INFO:teuthology.orchestra.run.smithi006.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2023-07-06T19:56:02.199 INFO:teuthology.orchestra.run.smithi006.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 458 kB/s | 23 kB 00:00 2023-07-06T19:56:02.219 INFO:teuthology.orchestra.run.smithi040.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2023-07-06T19:56:02.220 INFO:teuthology.orchestra.run.smithi006.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-07-06T19:56:02.269 INFO:teuthology.orchestra.run.smithi040.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2023-07-06T19:56:02.303 INFO:teuthology.orchestra.run.smithi006.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 13 MB/s | 1.7 MB 00:00 2023-07-06T19:56:02.353 INFO:teuthology.orchestra.run.smithi040.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 5.6 MB/s | 476 kB 00:00 2023-07-06T19:56:02.420 INFO:teuthology.orchestra.run.smithi040.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 656 kB/s | 44 kB 00:00 2023-07-06T19:56:02.448 INFO:teuthology.orchestra.run.smithi006.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 777 kB/s | 110 kB 00:00 2023-07-06T19:56:02.480 INFO:teuthology.orchestra.run.smithi006.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-07-06T19:56:02.511 INFO:teuthology.orchestra.run.smithi040.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.0 MB/s | 185 kB 00:00 2023-07-06T19:56:02.529 INFO:teuthology.orchestra.run.smithi006.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.1 MB/s | 259 kB 00:00 2023-07-06T19:56:02.561 INFO:teuthology.orchestra.run.smithi040.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 664 kB/s | 33 kB 00:00 2023-07-06T19:56:02.579 INFO:teuthology.orchestra.run.smithi006.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-07-06T19:56:02.614 INFO:teuthology.orchestra.run.smithi040.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 325 kB/s | 16 kB 00:00 2023-07-06T19:56:02.630 INFO:teuthology.orchestra.run.smithi006.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 780 kB/s | 39 kB 00:00 2023-07-06T19:56:02.665 INFO:teuthology.orchestra.run.smithi040.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 3.4 MB/s | 173 kB 00:00 2023-07-06T19:56:02.688 INFO:teuthology.orchestra.run.smithi006.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-07-06T19:56:02.721 INFO:teuthology.orchestra.run.smithi040.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 6.5 MB/s | 384 kB 00:00 2023-07-06T19:56:02.830 INFO:teuthology.orchestra.run.smithi040.stdout:(47/131): ceph-mgr-diskprediction-local-18.0.0- 4.7 MB/s | 7.4 MB 00:01 2023-07-06T19:56:02.855 INFO:teuthology.orchestra.run.smithi040.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 608 kB/s | 81 kB 00:00 2023-07-06T19:56:02.880 INFO:teuthology.orchestra.run.smithi006.stdout:(77/131): python3-scipy-1.0.0-21.module+el8.5.0 21 MB/s | 14 MB 00:00 2023-07-06T19:56:02.914 INFO:teuthology.orchestra.run.smithi006.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 2.3 MB/s | 538 kB 00:00 2023-07-06T19:56:02.939 INFO:teuthology.orchestra.run.smithi006.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-07-06T19:56:02.964 INFO:teuthology.orchestra.run.smithi006.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-07-06T19:56:02.998 INFO:teuthology.orchestra.run.smithi006.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-07-06T19:56:03.059 INFO:teuthology.orchestra.run.smithi006.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 456 kB/s | 27 kB 00:00 2023-07-06T19:56:03.132 INFO:teuthology.orchestra.run.smithi006.stdout:(83/131): python3-babel-2.5.1-7.el8.noarch.rpm 29 MB/s | 4.8 MB 00:00 2023-07-06T19:56:03.191 INFO:teuthology.orchestra.run.smithi006.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 2.3 MB/s | 320 kB 00:00 2023-07-06T19:56:03.251 INFO:teuthology.orchestra.run.smithi006.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 371 kB/s | 44 kB 00:00 2023-07-06T19:56:03.314 INFO:teuthology.orchestra.run.smithi040.stdout:(49/131): ceph-test-18.0.0-4742.g79365bb3.el8.x 5.2 MB/s | 48 MB 00:09 2023-07-06T19:56:03.339 INFO:teuthology.orchestra.run.smithi040.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 22 kB/s | 11 kB 00:00 2023-07-06T19:56:03.358 INFO:teuthology.orchestra.run.smithi006.stdout:(86/131): python3-numpy-1.14.3-10.el8.x86_64.rp 22 MB/s | 3.7 MB 00:00 2023-07-06T19:56:03.364 INFO:teuthology.orchestra.run.smithi040.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 35 kB/s | 18 kB 00:00 2023-07-06T19:56:03.389 INFO:teuthology.orchestra.run.smithi040.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 970 kB/s | 49 kB 00:00 2023-07-06T19:56:03.400 INFO:teuthology.orchestra.run.smithi006.stdout:(87/131): python3-werkzeug-0.12.2-4.el8.noarch. 3.0 MB/s | 457 kB 00:00 2023-07-06T19:56:03.440 INFO:teuthology.orchestra.run.smithi040.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-07-06T19:56:03.483 INFO:teuthology.orchestra.run.smithi006.stdout:(88/131): uuid-1.6.2-43.el8.x86_64.rpm 768 kB/s | 64 kB 00:00 2023-07-06T19:56:03.500 INFO:teuthology.orchestra.run.smithi040.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 4.7 MB/s | 283 kB 00:00 2023-07-06T19:56:03.509 INFO:teuthology.orchestra.run.smithi006.stdout:(89/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.5 MB/s | 225 kB 00:00 2023-07-06T19:56:03.529 INFO:teuthology.orchestra.run.smithi040.stdout:(55/131): python3-more-itertools-7.2.0-3.el8.no 369 kB/s | 59 kB 00:00 2023-07-06T19:56:03.549 INFO:teuthology.orchestra.run.smithi040.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 311 kB/s | 16 kB 00:00 2023-07-06T19:56:03.568 INFO:teuthology.orchestra.run.smithi006.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.5 MB/s | 126 kB 00:00 2023-07-06T19:56:03.574 INFO:teuthology.orchestra.run.smithi040.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 674 kB/s | 34 kB 00:00 2023-07-06T19:56:03.593 INFO:teuthology.orchestra.run.smithi006.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 239 kB/s | 20 kB 00:00 2023-07-06T19:56:03.611 INFO:teuthology.orchestra.run.smithi040.stdout:(58/131): python3-kubernetes-11.0.0-6.el8.noarc 4.0 MB/s | 1.2 MB 00:00 2023-07-06T19:56:03.634 INFO:teuthology.orchestra.run.smithi040.stdout:(59/131): python3-rsa-4.8-1.el8.noarch.rpm 1.0 MB/s | 61 kB 00:00 2023-07-06T19:56:03.663 INFO:teuthology.orchestra.run.smithi040.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 370 kB/s | 19 kB 00:00 2023-07-06T19:56:03.687 INFO:teuthology.orchestra.run.smithi040.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 475 kB/s | 24 kB 00:00 2023-07-06T19:56:03.701 INFO:teuthology.orchestra.run.smithi006.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 774 kB/s | 103 kB 00:00 2023-07-06T19:56:03.709 INFO:teuthology.orchestra.run.smithi040.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 584 kB/s | 29 kB 00:00 2023-07-06T19:56:03.734 INFO:teuthology.orchestra.run.smithi040.stdout:(63/131): python3-routes-2.4.1-12.el8.noarch.rp 1.0 MB/s | 196 kB 00:00 2023-07-06T19:56:03.738 INFO:teuthology.orchestra.run.smithi006.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 4.8 MB/s | 709 kB 00:00 2023-07-06T19:56:03.759 INFO:teuthology.orchestra.run.smithi040.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 366 kB/s | 27 kB 00:00 2023-07-06T19:56:03.785 INFO:teuthology.orchestra.run.smithi040.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 3.3 MB/s | 255 kB 00:00 2023-07-06T19:56:03.818 INFO:teuthology.orchestra.run.smithi040.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 4.2 MB/s | 251 kB 00:00 2023-07-06T19:56:03.835 INFO:teuthology.orchestra.run.smithi040.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 812 kB/s | 61 kB 00:00 2023-07-06T19:56:03.861 INFO:teuthology.orchestra.run.smithi040.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-07-06T19:56:03.886 INFO:teuthology.orchestra.run.smithi040.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 343 kB/s | 23 kB 00:00 2023-07-06T19:56:03.888 INFO:teuthology.orchestra.run.smithi006.stdout:(94/131): openblas-threads-0.3.15-3.el8.x86_64. 26 MB/s | 4.9 MB 00:00 2023-07-06T19:56:03.911 INFO:teuthology.orchestra.run.smithi040.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-07-06T19:56:03.913 INFO:teuthology.orchestra.run.smithi006.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 1.1 MB/s | 198 kB 00:00 2023-07-06T19:56:04.020 INFO:teuthology.orchestra.run.smithi040.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 9.4 MB/s | 1.7 MB 00:00 2023-07-06T19:56:04.045 INFO:teuthology.orchestra.run.smithi040.stdout:(72/131): python3-pyasn1-modules-0.3.7-6.el8.no 881 kB/s | 110 kB 00:00 2023-07-06T19:56:04.088 INFO:teuthology.orchestra.run.smithi006.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 1.1 MB/s | 202 kB 00:00 2023-07-06T19:56:04.155 INFO:teuthology.orchestra.run.smithi006.stdout:(97/131): openblas-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-07-06T19:56:04.196 INFO:teuthology.orchestra.run.smithi040.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 309 kB/s | 54 kB 00:00 2023-07-06T19:56:04.220 INFO:teuthology.orchestra.run.smithi040.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.5 MB/s | 259 kB 00:00 2023-07-06T19:56:04.337 INFO:teuthology.orchestra.run.smithi040.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 2.2 MB/s | 323 kB 00:00 2023-07-06T19:56:04.504 INFO:teuthology.orchestra.run.smithi040.stdout:(76/131): python3-scipy-1.0.0-21.module+el8.5.0 22 MB/s | 14 MB 00:00 2023-07-06T19:56:04.529 INFO:teuthology.orchestra.run.smithi040.stdout:(77/131): python3-markupsafe-0.23-19.el8.x86_64 126 kB/s | 39 kB 00:00 2023-07-06T19:56:04.563 INFO:teuthology.orchestra.run.smithi040.stdout:(78/131): bison-3.0.4-10.el8.x86_64.rpm 3.0 MB/s | 688 kB 00:00 2023-07-06T19:56:04.597 INFO:teuthology.orchestra.run.smithi006.stdout:(98/131): ceph-test-18.0.0-4742.g79365bb3.el8.x 4.6 MB/s | 48 MB 00:10 2023-07-06T19:56:04.623 INFO:teuthology.orchestra.run.smithi040.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.7 MB/s | 157 kB 00:00 2023-07-06T19:56:04.631 INFO:teuthology.orchestra.run.smithi006.stdout:(99/131): librdkafka-0.11.4-3.el8.x86_64.rpm 653 kB/s | 354 kB 00:00 2023-07-06T19:56:04.647 INFO:teuthology.orchestra.run.smithi040.stdout:(80/131): python3-jinja2-2.10.1-3.el8.noarch.rp 3.7 MB/s | 538 kB 00:00 2023-07-06T19:56:04.739 INFO:teuthology.orchestra.run.smithi040.stdout:(81/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2023-07-06T19:56:04.773 INFO:teuthology.orchestra.run.smithi006.stdout:(100/131): postgresql-server-10.21-2.module+el8 8.2 MB/s | 5.1 MB 00:00 2023-07-06T19:56:04.781 INFO:teuthology.orchestra.run.smithi040.stdout:(82/131): automake-1.16.1-7.el8.noarch.rpm 4.4 MB/s | 713 kB 00:00 2023-07-06T19:56:04.823 INFO:teuthology.orchestra.run.smithi006.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 8.2 MB/s | 1.5 MB 00:00 2023-07-06T19:56:04.856 INFO:teuthology.orchestra.run.smithi040.stdout:(83/131): python3-jsonpatch-1.21-2.el8.noarch.r 227 kB/s | 27 kB 00:00 2023-07-06T19:56:04.890 INFO:teuthology.orchestra.run.smithi006.stdout:(102/131): postgresql-contrib-10.21-2.module+el 2.7 MB/s | 808 kB 00:00 2023-07-06T19:56:04.915 INFO:teuthology.orchestra.run.smithi006.stdout:(103/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 329 kB/s | 47 kB 00:00 2023-07-06T19:56:04.956 INFO:teuthology.orchestra.run.smithi040.stdout:(84/131): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2023-07-06T19:56:04.975 INFO:teuthology.orchestra.run.smithi006.stdout:(104/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.3 MB/s | 200 kB 00:00 2023-07-06T19:56:04.975 INFO:teuthology.orchestra.run.smithi040.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 375 kB/s | 44 kB 00:00 2023-07-06T19:56:05.007 INFO:teuthology.orchestra.run.smithi040.stdout:(86/131): flex-2.6.1-9.el8.x86_64.rpm 1.4 MB/s | 320 kB 00:00 2023-07-06T19:56:05.016 INFO:teuthology.orchestra.run.smithi006.stdout:(105/131): python3-jwt-1.6.1-2.el8.noarch.rpm 340 kB/s | 43 kB 00:00 2023-07-06T19:56:05.043 INFO:teuthology.orchestra.run.smithi006.stdout:(106/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.7 MB/s | 220 kB 00:00 2023-07-06T19:56:05.050 INFO:teuthology.orchestra.run.smithi040.stdout:(87/131): python3-werkzeug-0.12.2-4.el8.noarch. 6.0 MB/s | 457 kB 00:00 2023-07-06T19:56:05.067 INFO:teuthology.orchestra.run.smithi006.stdout:(107/131): keyutils-libs-devel-1.5.10-9.el8.x86 522 kB/s | 48 kB 00:00 2023-07-06T19:56:05.074 INFO:teuthology.orchestra.run.smithi040.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.3 MB/s | 225 kB 00:00 2023-07-06T19:56:05.093 INFO:teuthology.orchestra.run.smithi006.stdout:(108/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2023-07-06T19:56:05.117 INFO:teuthology.orchestra.run.smithi006.stdout:(109/131): python3-requests-oauthlib-1.0.0-1.el 567 kB/s | 43 kB 00:00 2023-07-06T19:56:05.149 INFO:teuthology.orchestra.run.smithi040.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 850 kB/s | 64 kB 00:00 2023-07-06T19:56:05.149 INFO:teuthology.orchestra.run.smithi006.stdout:(110/131): python3-pycparser-2.14-14.el8.noarch 1.4 MB/s | 109 kB 00:00 2023-07-06T19:56:05.176 INFO:teuthology.orchestra.run.smithi006.stdout:(111/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.7 MB/s | 229 kB 00:00 2023-07-06T19:56:05.193 INFO:teuthology.orchestra.run.smithi040.stdout:(90/131): python3-numpy-1.14.3-10.el8.x86_64.rp 16 MB/s | 3.7 MB 00:00 2023-07-06T19:56:05.209 INFO:teuthology.orchestra.run.smithi040.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 239 kB/s | 20 kB 00:00 2023-07-06T19:56:05.209 INFO:teuthology.orchestra.run.smithi006.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 279 kB/s | 19 kB 00:00 2023-07-06T19:56:05.236 INFO:teuthology.orchestra.run.smithi040.stdout:(92/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 793 kB/s | 126 kB 00:00 2023-07-06T19:56:05.268 INFO:teuthology.orchestra.run.smithi006.stdout:(113/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.6 MB/s | 560 kB 00:00 2023-07-06T19:56:05.302 INFO:teuthology.orchestra.run.smithi006.stdout:(114/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.2 MB/s | 155 kB 00:00 2023-07-06T19:56:05.318 INFO:teuthology.orchestra.run.smithi040.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 825 kB/s | 103 kB 00:00 2023-07-06T19:56:05.352 INFO:teuthology.orchestra.run.smithi006.stdout:(115/131): python3-cryptography-3.2.1-5.el8.x86 3.8 MB/s | 559 kB 00:00 2023-07-06T19:56:05.368 INFO:teuthology.orchestra.run.smithi040.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 4.4 MB/s | 709 kB 00:00 2023-07-06T19:56:05.395 INFO:teuthology.orchestra.run.smithi006.stdout:(116/131): libverto-devel-0.3.0-5.el8.x86_64.rp 143 kB/s | 18 kB 00:00 2023-07-06T19:56:05.418 INFO:teuthology.orchestra.run.smithi040.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 1.9 MB/s | 198 kB 00:00 2023-07-06T19:56:05.485 INFO:teuthology.orchestra.run.smithi040.stdout:(96/131): openblas-threads-0.3.15-3.el8.x86_64. 19 MB/s | 4.9 MB 00:00 2023-07-06T19:56:05.594 INFO:teuthology.orchestra.run.smithi040.stdout:(97/131): openblas-0.3.15-3.el8.x86_64.rpm 21 MB/s | 4.7 MB 00:00 2023-07-06T19:56:05.619 INFO:teuthology.orchestra.run.smithi040.stdout:(98/131): jq-1.6-3.el8.x86_64.rpm 1.0 MB/s | 202 kB 00:00 2023-07-06T19:56:05.644 INFO:teuthology.orchestra.run.smithi040.stdout:(99/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.2 MB/s | 354 kB 00:00 2023-07-06T19:56:05.708 INFO:teuthology.orchestra.run.smithi006.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 1.5 MB/s | 605 kB 00:00 2023-07-06T19:56:05.753 INFO:teuthology.orchestra.run.smithi040.stdout:(100/131): postgresql-contrib-10.21-2.module+el 5.9 MB/s | 808 kB 00:00 2023-07-06T19:56:05.753 INFO:teuthology.orchestra.run.smithi006.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 593 kB/s | 238 kB 00:00 2023-07-06T19:56:05.828 INFO:teuthology.orchestra.run.smithi006.stdout:(119/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 5.4 MB/s | 2.3 MB 00:00 2023-07-06T19:56:05.829 INFO:teuthology.orchestra.run.smithi040.stdout:(101/131): postgresql-server-10.21-2.module+el8 22 MB/s | 5.1 MB 00:00 2023-07-06T19:56:05.853 INFO:teuthology.orchestra.run.smithi006.stdout:(120/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 488 kB/s | 72 kB 00:00 2023-07-06T19:56:05.881 INFO:teuthology.orchestra.run.smithi040.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 6.4 MB/s | 1.5 MB 00:00 2023-07-06T19:56:05.904 INFO:teuthology.orchestra.run.smithi006.stdout:(121/131): fuse-2.9.7-15.el8.x86_64.rpm 549 kB/s | 83 kB 00:00 2023-07-06T19:56:05.912 INFO:teuthology.orchestra.run.smithi040.stdout:(103/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 295 kB/s | 47 kB 00:00 2023-07-06T19:56:05.933 INFO:teuthology.orchestra.run.smithi006.stdout:(122/131): elfutils-libelf-devel-0.186-1.el8.x8 594 kB/s | 60 kB 00:00 2023-07-06T19:56:05.962 INFO:teuthology.orchestra.run.smithi040.stdout:(104/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.5 MB/s | 200 kB 00:00 2023-07-06T19:56:06.033 INFO:teuthology.orchestra.run.smithi040.stdout:(105/131): python3-jwt-1.6.1-2.el8.noarch.rpm 283 kB/s | 43 kB 00:00 2023-07-06T19:56:06.050 INFO:teuthology.orchestra.run.smithi006.stdout:(123/131): libuuid-devel-2.32.1-35.el8.x86_64.r 500 kB/s | 98 kB 00:00 2023-07-06T19:56:06.113 INFO:teuthology.orchestra.run.smithi040.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 320 kB/s | 48 kB 00:00 2023-07-06T19:56:06.142 INFO:teuthology.orchestra.run.smithi006.stdout:(124/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 246 kB/s | 58 kB 00:00 2023-07-06T19:56:06.166 INFO:teuthology.orchestra.run.smithi040.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 651 kB/s | 87 kB 00:00 2023-07-06T19:56:06.190 INFO:teuthology.orchestra.run.smithi040.stdout:(108/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 798 kB/s | 220 kB 00:00 2023-07-06T19:56:06.214 INFO:teuthology.orchestra.run.smithi006.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 3.9 MB/s | 644 kB 00:00 2023-07-06T19:56:06.239 INFO:teuthology.orchestra.run.smithi006.stdout:(126/131): libcom_err-devel-1.45.6-4.el8.x86_64 125 kB/s | 39 kB 00:00 2023-07-06T19:56:06.247 INFO:teuthology.orchestra.run.smithi040.stdout:(109/131): python3-requests-oauthlib-1.0.0-1.el 319 kB/s | 43 kB 00:00 2023-07-06T19:56:06.264 INFO:teuthology.orchestra.run.smithi006.stdout:(127/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.3 MB/s | 171 kB 00:00 2023-07-06T19:56:06.330 INFO:teuthology.orchestra.run.smithi040.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.6 MB/s | 229 kB 00:00 2023-07-06T19:56:06.339 INFO:teuthology.orchestra.run.smithi006.stdout:(128/131): NetworkManager-initscripts-updown-1. 1.1 MB/s | 138 kB 00:00 2023-07-06T19:56:06.356 INFO:teuthology.orchestra.run.smithi040.stdout:(111/131): python3-pycparser-2.14-14.el8.noarch 567 kB/s | 109 kB 00:00 2023-07-06T19:56:06.397 INFO:teuthology.orchestra.run.smithi040.stdout:(112/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.6 MB/s | 560 kB 00:00 2023-07-06T19:56:06.458 INFO:teuthology.orchestra.run.smithi040.stdout:(113/131): libaio-devel-0.3.112-1.el8.x86_64.rp 149 kB/s | 19 kB 00:00 2023-07-06T19:56:06.481 INFO:teuthology.orchestra.run.smithi006.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 5.5 MB/s | 798 kB 00:00 2023-07-06T19:56:06.493 INFO:teuthology.orchestra.run.smithi040.stdout:(114/131): python3-oauthlib-2.1.0-1.el8.noarch. 1.1 MB/s | 155 kB 00:00 2023-07-06T19:56:06.552 INFO:teuthology.orchestra.run.smithi040.stdout:(115/131): python3-cryptography-3.2.1-5.el8.x86 3.6 MB/s | 559 kB 00:00 2023-07-06T19:56:06.624 INFO:teuthology.orchestra.run.smithi040.stdout:(116/131): libverto-devel-0.3.0-5.el8.x86_64.rp 107 kB/s | 18 kB 00:00 2023-07-06T19:56:06.666 INFO:teuthology.orchestra.run.smithi040.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.4 MB/s | 605 kB 00:00 2023-07-06T19:56:06.692 INFO:teuthology.orchestra.run.smithi040.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.6 MB/s | 238 kB 00:00 2023-07-06T19:56:06.716 INFO:teuthology.orchestra.run.smithi040.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-07-06T19:56:06.842 INFO:teuthology.orchestra.run.smithi040.stdout:(120/131): elfutils-libelf-devel-0.186-1.el8.x8 478 kB/s | 60 kB 00:00 2023-07-06T19:56:06.848 INFO:teuthology.orchestra.run.smithi006.stdout:(130/131): librados2-18.0.0-4742.g79365bb3.el8. 6.0 MB/s | 3.7 MB 00:00 2023-07-06T19:56:06.868 INFO:teuthology.orchestra.run.smithi040.stdout:(121/131): fuse-2.9.7-15.el8.x86_64.rpm 471 kB/s | 83 kB 00:00 2023-07-06T19:56:06.906 INFO:teuthology.orchestra.run.smithi006.stdout:(131/131): librbd1-18.0.0-4742.g79365bb3.el8.x8 5.5 MB/s | 3.6 MB 00:00 2023-07-06T19:56:06.910 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2023-07-06T19:56:06.911 INFO:teuthology.orchestra.run.smithi006.stdout:Total 10 MB/s | 205 MB 00:19 2023-07-06T19:56:06.992 INFO:teuthology.orchestra.run.smithi040.stdout:(122/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.3 MB/s | 2.3 MB 00:00 2023-07-06T19:56:07.209 INFO:teuthology.orchestra.run.smithi040.stdout:(123/131): libuuid-devel-2.32.1-35.el8.x86_64.r 267 kB/s | 98 kB 00:00 2023-07-06T19:56:07.227 INFO:teuthology.orchestra.run.smithi040.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 165 kB/s | 39 kB 00:00 2023-07-06T19:56:07.243 INFO:teuthology.orchestra.run.smithi040.stdout:(125/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 153 kB/s | 58 kB 00:00 2023-07-06T19:56:07.369 INFO:teuthology.orchestra.run.smithi040.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.2 MB/s | 171 kB 00:00 2023-07-06T19:56:07.402 INFO:teuthology.orchestra.run.smithi040.stdout:(127/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 3.3 MB/s | 644 kB 00:00 2023-07-06T19:56:07.452 INFO:teuthology.orchestra.run.smithi040.stdout:(128/131): NetworkManager-initscripts-updown-1. 659 kB/s | 138 kB 00:00 2023-07-06T19:56:07.636 INFO:teuthology.orchestra.run.smithi040.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 4.3 MB/s | 798 kB 00:00 2023-07-06T19:56:07.777 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2023-07-06T19:56:07.908 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2023-07-06T19:56:07.909 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2023-07-06T19:56:08.053 INFO:teuthology.orchestra.run.smithi040.stdout:(130/131): librbd1-18.0.0-4742.g79365bb3.el8.x8 5.5 MB/s | 3.6 MB 00:00 2023-07-06T19:56:08.111 INFO:teuthology.orchestra.run.smithi040.stdout:(131/131): librados2-18.0.0-4742.g79365bb3.el8. 4.9 MB/s | 3.7 MB 00:00 2023-07-06T19:56:08.114 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2023-07-06T19:56:08.115 INFO:teuthology.orchestra.run.smithi040.stdout:Total 10 MB/s | 205 MB 00:20 2023-07-06T19:56:08.990 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2023-07-06T19:56:09.092 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2023-07-06T19:56:09.096 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2023-07-06T19:56:09.122 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2023-07-06T19:56:09.122 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2023-07-06T19:56:10.311 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2023-07-06T19:56:10.316 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2023-07-06T19:56:14.370 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2023-07-06T19:56:14.589 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-06T19:56:14.771 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-06T19:56:15.009 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-07-06T19:56:15.166 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-06T19:56:15.286 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-06T19:56:15.499 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-06T19:56:15.509 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2023-07-06T19:56:15.665 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-06T19:56:15.819 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-06T19:56:15.911 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-06T19:56:16.060 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-07-06T19:56:16.201 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-06T19:56:16.333 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-06T19:56:16.366 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librados2-2:18.0.0-4742.g79365bb3.el8.x86_64 6/134 2023-07-06T19:56:16.534 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-06T19:56:16.816 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-2:18.0.0-4742.g79365bb3.el8.x86_64 6/134 2023-07-06T19:56:16.968 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-06T19:56:17.024 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librbd1-2:18.0.0-4742.g79365bb3.el8.x86_64 7/134 2023-07-06T19:56:17.153 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-2:18.0.0-4742.g79365bb3.el8.x86_64 7/134 2023-07-06T19:56:17.166 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librados2-2:18.0.0-4742.g79365bb3.el8.x86_64 6/134 2023-07-06T19:56:17.374 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs2-2:18.0.0-4742.g79365bb3.el8.x86_64 8/134 2023-07-06T19:56:17.473 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephfs2-2:18.0.0-4742.g79365bb3.el8.x86_64 8/134 2023-07-06T19:56:17.626 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:18.0.0-4742.g79365bb3.el8.x86_64 6/134 2023-07-06T19:56:17.712 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rados-2:18.0.0-4742.g79365bb3.el8.x86_64 9/134 2023-07-06T19:56:17.808 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librbd1-2:18.0.0-4742.g79365bb3.el8.x86_64 7/134 2023-07-06T19:56:17.941 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:18.0.0-4742.g79365bb3.el8.x86_64 7/134 2023-07-06T19:56:18.100 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-06T19:56:18.141 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs2-2:18.0.0-4742.g79365bb3.el8.x86_64 8/134 2023-07-06T19:56:18.286 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-06T19:56:18.371 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephfs2-2:18.0.0-4742.g79365bb3.el8.x86_64 8/134 2023-07-06T19:56:18.599 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rados-2:18.0.0-4742.g79365bb3.el8.x86_64 9/134 2023-07-06T19:56:18.735 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-06T19:56:18.862 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-06T19:56:19.057 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-06T19:56:19.103 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-06T19:56:19.317 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephsqlite-2:18.0.0-4742.g79365bb3.el8.x86_64 14/134 2023-07-06T19:56:19.426 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4742.g79365bb3.el8.x86_64 14/134 2023-07-06T19:56:19.468 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-06T19:56:19.624 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libradosstriper1-2:18.0.0-4742.g79365bb3.el8.x86 15/134 2023-07-06T19:56:19.679 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-06T19:56:19.708 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4742.g79365bb3.el8.x86 15/134 2023-07-06T19:56:19.818 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephsqlite-2:18.0.0-4742.g79365bb3.el8.x86_64 14/134 2023-07-06T19:56:19.832 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-06T19:56:19.910 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4742.g79365bb3.el8.x86_64 14/134 2023-07-06T19:56:20.009 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-06T19:56:20.061 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libradosstriper1-2:18.0.0-4742.g79365bb3.el8.x86 15/134 2023-07-06T19:56:20.122 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4742.g79365bb3.el8.x86 15/134 2023-07-06T19:56:20.140 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-06T19:56:20.282 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-06T19:56:20.410 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-06T19:56:20.541 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-06T19:56:20.781 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-06T19:56:20.933 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-06T19:56:21.205 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-06T19:56:21.349 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-06T19:56:21.563 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-06T19:56:21.731 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-07-06T19:56:22.001 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-06T19:56:22.174 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-07-06T19:56:22.579 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-07-06T19:56:22.825 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-07-06T19:56:22.903 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-07-06T19:56:23.091 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-07-06T19:56:23.184 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-07-06T19:56:23.287 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-07-06T19:56:23.400 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-07-06T19:56:23.489 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-07-06T19:56:23.604 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-07-06T19:56:23.686 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-07-06T19:56:23.799 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-07-06T19:56:23.922 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-06T19:56:23.994 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-07-06T19:56:24.072 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-common-2:18.0.0-4742.g79365bb3.el8. 26/134 2023-07-06T19:56:24.195 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-06T19:56:24.236 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-argparse-2:18.0.0-4742.g79365bb3.el 27/134 2023-07-06T19:56:24.347 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-common-2:18.0.0-4742.g79365bb3.el8. 26/134 2023-07-06T19:56:24.503 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-argparse-2:18.0.0-4742.g79365bb3.el 27/134 2023-07-06T19:56:25.207 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cephfs-2:18.0.0-4742.g79365bb3.el8.x86_6 28/134 2023-07-06T19:56:25.443 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cephfs-2:18.0.0-4742.g79365bb3.el8.x86_6 28/134 2023-07-06T19:56:25.546 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-07-06T19:56:25.731 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-07-06T19:56:25.830 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-07-06T19:56:26.014 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-07-06T19:56:26.059 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-07-06T19:56:26.264 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-06T19:56:26.273 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-07-06T19:56:26.448 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-06T19:56:28.158 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-06T19:56:28.323 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-06T19:56:28.520 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-07-06T19:56:28.620 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-07-06T19:56:28.772 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-06T19:56:28.830 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-06T19:56:28.969 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-06T19:56:29.010 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-06T19:56:29.171 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rbd-2:18.0.0-4742.g79365bb3.el8.x86_64 36/134 2023-07-06T19:56:29.180 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rbd-2:18.0.0-4742.g79365bb3.el8.x86_64 36/134 2023-07-06T19:56:29.329 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librados-devel-2:18.0.0-4742.g79365bb3.el8.x86_6 37/134 2023-07-06T19:56:29.353 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librados-devel-2:18.0.0-4742.g79365bb3.el8.x86_6 37/134 2023-07-06T19:56:29.509 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-07-06T19:56:29.514 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-07-06T19:56:29.692 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-07-06T19:56:29.696 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-07-06T19:56:29.868 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-07-06T19:56:29.904 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-07-06T19:56:30.003 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-07-06T19:56:30.044 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-07-06T19:56:30.208 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-07-06T19:56:30.251 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-07-06T19:56:30.409 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-07-06T19:56:30.476 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-07-06T19:56:30.783 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-07-06T19:56:30.876 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-07-06T19:56:31.027 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-07-06T19:56:31.194 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-07-06T19:56:31.200 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-07-06T19:56:31.384 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-07-06T19:56:31.406 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-07-06T19:56:31.644 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-07-06T19:56:31.654 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-07-06T19:56:31.865 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-07-06T19:56:31.972 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-07-06T19:56:32.187 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-07-06T19:56:32.248 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-07-06T19:56:32.449 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-07-06T19:56:32.506 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-07-06T19:56:32.657 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-07-06T19:56:32.751 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-07-06T19:56:32.809 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-07-06T19:56:32.978 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-07-06T19:56:32.999 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-07-06T19:56:33.172 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-07-06T19:56:33.270 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-07-06T19:56:33.394 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-07-06T19:56:33.648 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-07-06T19:56:33.690 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-07-06T19:56:33.865 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-07-06T19:56:33.979 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-07-06T19:56:34.057 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-07-06T19:56:34.231 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-07-06T19:56:34.333 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-07-06T19:56:34.409 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-07-06T19:56:34.547 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-07-06T19:56:34.581 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-07-06T19:56:34.624 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-07-06T19:56:34.738 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-07-06T19:56:34.832 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-07-06T19:56:34.909 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-07-06T19:56:35.070 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-07-06T19:56:35.080 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-07-06T19:56:35.138 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-07-06T19:56:35.198 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-06T19:56:35.283 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-06T19:56:35.397 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-07-06T19:56:35.489 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-07-06T19:56:35.580 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-07-06T19:56:35.650 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-07-06T19:56:35.755 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-06T19:56:35.820 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-06T19:56:35.839 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-06T19:56:35.992 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-06T19:56:36.031 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-07-06T19:56:36.200 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-07-06T19:56:36.259 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-06T19:56:36.367 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-06T19:56:36.554 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-06T19:56:36.606 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-06T19:56:36.727 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-06T19:56:36.853 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-06T19:56:36.889 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-06T19:56:37.027 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-06T19:56:37.088 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-06T19:56:37.247 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-06T19:56:37.293 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-06T19:56:37.428 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-06T19:56:37.434 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-06T19:56:37.559 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-06T19:56:37.634 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-06T19:56:37.693 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-06T19:56:37.803 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-06T19:56:37.943 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-06T19:56:37.993 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-06T19:56:38.136 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-06T19:56:38.141 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-06T19:56:38.286 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-06T19:56:38.328 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-06T19:56:38.525 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-06T19:56:38.583 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-06T19:56:38.714 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-06T19:56:38.797 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-06T19:56:38.924 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-06T19:56:38.965 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-06T19:56:39.177 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-06T19:56:39.204 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-06T19:56:39.412 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-06T19:56:39.606 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-06T19:56:39.804 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-06T19:56:40.354 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-06T19:56:40.594 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-06T19:56:40.865 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-06T19:56:40.954 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-06T19:56:41.147 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-06T19:56:41.228 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-06T19:56:41.414 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-06T19:56:41.515 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-06T19:56:41.607 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-06T19:56:41.817 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-06T19:56:42.076 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-06T19:56:42.302 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-06T19:56:42.429 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-06T19:56:42.588 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librgw2-2:18.0.0-4742.g79365bb3.el8.x86_64 92/134 2023-07-06T19:56:42.669 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librgw2-2:18.0.0-4742.g79365bb3.el8.x86_64 92/134 2023-07-06T19:56:42.863 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rgw-2:18.0.0-4742.g79365bb3.el8.x86_64 93/134 2023-07-06T19:56:43.119 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-06T19:56:43.292 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librgw2-2:18.0.0-4742.g79365bb3.el8.x86_64 92/134 2023-07-06T19:56:43.391 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librgw2-2:18.0.0-4742.g79365bb3.el8.x86_64 92/134 2023-07-06T19:56:43.571 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rgw-2:18.0.0-4742.g79365bb3.el8.x86_64 93/134 2023-07-06T19:56:46.764 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:18.0.0-4742.g79365bb3.el8.x86_64 94/134 2023-07-06T19:56:46.963 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-common-2:18.0.0-4742.g79365bb3.el8.x86_64 94/134 2023-07-06T19:56:47.523 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:18.0.0-4742.g79365bb3.el8.x86_64 94/134 2023-07-06T19:56:47.586 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:18.0.0-4742.g79365bb3.el8.x86_64 94/134 2023-07-06T19:56:47.862 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-base-2:18.0.0-4742.g79365bb3.el8.x86_64 95/134 2023-07-06T19:56:47.951 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-base-2:18.0.0-4742.g79365bb3.el8.x86_64 95/134 2023-07-06T19:56:48.071 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-common-2:18.0.0-4742.g79365bb3.el8.x86_64 94/134 2023-07-06T19:56:48.080 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-selinux-2:18.0.0-4742.g79365bb3.el8.x86_64 96/134 2023-07-06T19:56:48.712 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:18.0.0-4742.g79365bb3.el8.x86_64 94/134 2023-07-06T19:56:48.987 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-base-2:18.0.0-4742.g79365bb3.el8.x86_64 95/134 2023-07-06T19:56:49.069 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-base-2:18.0.0-4742.g79365bb3.el8.x86_64 95/134 2023-07-06T19:56:49.245 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-selinux-2:18.0.0-4742.g79365bb3.el8.x86_64 96/134 2023-07-06T19:57:07.642 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4742.g79365bb3.el8.x86_64 96/134 2023-07-06T19:57:07.643 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /sys 2023-07-06T19:57:07.643 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /proc 2023-07-06T19:57:07.643 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /dev 2023-07-06T19:57:07.643 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /run 2023-07-06T19:57:07.643 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /mnt 2023-07-06T19:57:07.643 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /var/tmp 2023-07-06T19:57:07.643 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /home 2023-07-06T19:57:07.644 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /tmp 2023-07-06T19:57:07.644 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /dev 2023-07-06T19:57:07.644 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:07.976 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-volume-2:18.0.0-4742.g79365bb3.el8.noarch 97/134 2023-07-06T19:57:08.718 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4742.g79365bb3.el8.x86_64 96/134 2023-07-06T19:57:08.718 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /sys 2023-07-06T19:57:08.719 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /proc 2023-07-06T19:57:08.719 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /dev 2023-07-06T19:57:08.719 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /run 2023-07-06T19:57:08.719 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /mnt 2023-07-06T19:57:08.720 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /var/tmp 2023-07-06T19:57:08.720 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /home 2023-07-06T19:57:08.721 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /tmp 2023-07-06T19:57:08.722 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /dev 2023-07-06T19:57:08.723 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:09.034 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-volume-2:18.0.0-4742.g79365bb3.el8.noarch 97/134 2023-07-06T19:57:09.668 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-volume-2:18.0.0-4742.g79365bb3.el8.noarch 97/134 2023-07-06T19:57:09.817 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-osd-2:18.0.0-4742.g79365bb3.el8.x86_64 98/134 2023-07-06T19:57:10.049 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-osd-2:18.0.0-4742.g79365bb3.el8.x86_64 98/134 2023-07-06T19:57:10.193 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mds-2:18.0.0-4742.g79365bb3.el8.x86_64 99/134 2023-07-06T19:57:10.684 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mds-2:18.0.0-4742.g79365bb3.el8.x86_64 99/134 2023-07-06T19:57:10.716 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-volume-2:18.0.0-4742.g79365bb3.el8.noarch 97/134 2023-07-06T19:57:10.851 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mon-2:18.0.0-4742.g79365bb3.el8.x86_64 100/134 2023-07-06T19:57:10.868 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mon-2:18.0.0-4742.g79365bb3.el8.x86_64 100/134 2023-07-06T19:57:10.894 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-osd-2:18.0.0-4742.g79365bb3.el8.x86_64 98/134 2023-07-06T19:57:11.122 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-osd-2:18.0.0-4742.g79365bb3.el8.x86_64 98/134 2023-07-06T19:57:11.268 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mds-2:18.0.0-4742.g79365bb3.el8.x86_64 99/134 2023-07-06T19:57:11.749 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mds-2:18.0.0-4742.g79365bb3.el8.x86_64 99/134 2023-07-06T19:57:11.976 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mon-2:18.0.0-4742.g79365bb3.el8.x86_64 100/134 2023-07-06T19:57:11.993 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mon-2:18.0.0-4742.g79365bb3.el8.x86_64 100/134 2023-07-06T19:57:12.742 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephadm-2:18.0.0-4742.g79365bb3.el8.noarch 101/134 2023-07-06T19:57:12.911 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephadm-2:18.0.0-4742.g79365bb3.el8.noarch 101/134 2023-07-06T19:57:13.032 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4742.g79365bb3.e 102/134 2023-07-06T19:57:13.225 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4742.g79365bb3. 103/134 2023-07-06T19:57:13.410 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4742.g79365bb3.el8.noa 104/134 2023-07-06T19:57:13.632 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4742.g79365bb3.el8.noa 104/134 2023-07-06T19:57:13.759 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephadm-2:18.0.0-4742.g79365bb3.el8.noarch 101/134 2023-07-06T19:57:13.934 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4742.g79365bb3.el8.n 105/134 2023-07-06T19:57:13.995 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephadm-2:18.0.0-4742.g79365bb3.el8.noarch 101/134 2023-07-06T19:57:14.124 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4742.g79365bb3.e 102/134 2023-07-06T19:57:14.326 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4742.g79365bb3. 103/134 2023-07-06T19:57:14.535 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4742.g79365bb3.el8.noa 104/134 2023-07-06T19:57:14.757 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4742.g79365bb3.el8.noa 104/134 2023-07-06T19:57:14.961 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4742.g79365bb3.el8.n 105/134 2023-07-06T19:57:15.035 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4742.g79365bb3.el8.n 105/134 2023-07-06T19:57:15.093 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4742.g793 106/134 2023-07-06T19:57:15.187 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4742.g793 106/134 2023-07-06T19:57:15.555 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4742.g79365bb3.el 107/134 2023-07-06T19:57:15.733 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-2:18.0.0-4742.g79365bb3.el8.x86_64 108/134 2023-07-06T19:57:15.770 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4742.g79365bb3.el8.x86_64 108/134 2023-07-06T19:57:15.925 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-rook-2:18.0.0-4742.g79365bb3.el8.noarch 109/134 2023-07-06T19:57:15.936 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4742.g79365bb3.el8.noarch 109/134 2023-07-06T19:57:16.059 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4742.g79365bb3.el8.n 105/134 2023-07-06T19:57:16.226 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4742.g793 106/134 2023-07-06T19:57:16.321 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4742.g793 106/134 2023-07-06T19:57:16.712 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4742.g79365bb3.el 107/134 2023-07-06T19:57:16.916 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-2:18.0.0-4742.g79365bb3.el8.x86_64 108/134 2023-07-06T19:57:16.953 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4742.g79365bb3.el8.x86_64 108/134 2023-07-06T19:57:17.125 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-rook-2:18.0.0-4742.g79365bb3.el8.noarch 109/134 2023-07-06T19:57:17.137 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4742.g79365bb3.el8.noarch 109/134 2023-07-06T19:57:17.305 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-2:18.0.0-4742.g79365bb3.el8.x86_64 110/134 2023-07-06T19:57:17.522 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-radosgw-2:18.0.0-4742.g79365bb3.el8.x86_64 111/134 2023-07-06T19:57:17.558 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4742.g79365bb3.el8.x86_64 111/134 2023-07-06T19:57:17.693 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4742.g79365 112/134 2023-07-06T19:57:17.739 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4742.g79365 112/134 2023-07-06T19:57:17.858 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 113/134 2023-07-06T19:57:18.228 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 113/134 2023-07-06T19:57:18.367 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 114/134 2023-07-06T19:57:18.516 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-2:18.0.0-4742.g79365bb3.el8.x86_64 110/134 2023-07-06T19:57:18.776 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-radosgw-2:18.0.0-4742.g79365bb3.el8.x86_64 111/134 2023-07-06T19:57:18.814 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4742.g79365bb3.el8.x86_64 111/134 2023-07-06T19:57:18.959 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4742.g79365 112/134 2023-07-06T19:57:19.001 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4742.g79365 112/134 2023-07-06T19:57:19.168 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 113/134 2023-07-06T19:57:19.535 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 113/134 2023-07-06T19:57:19.692 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 114/134 2023-07-06T19:57:23.209 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 114/134 2023-07-06T19:57:23.469 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-test-2:18.0.0-4742.g79365bb3.el8.x86_64 115/134 2023-07-06T19:57:23.624 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-07-06T19:57:23.832 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-07-06T19:57:24.520 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 114/134 2023-07-06T19:57:24.776 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-07-06T19:57:24.803 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-test-2:18.0.0-4742.g79365bb3.el8.x86_64 115/134 2023-07-06T19:57:24.940 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-07-06T19:57:25.085 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-07-06T19:57:25.147 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-07-06T19:57:25.261 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-fuse-2:18.0.0-4742.g79365bb3.el8.x86_64 119/134 2023-07-06T19:57:25.445 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-06T19:57:25.612 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs-devel-2:18.0.0-4742.g79365bb3.el8.x86_ 121/134 2023-07-06T19:57:25.733 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-06T19:57:26.108 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-07-06T19:57:26.452 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-07-06T19:57:26.637 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-fuse-2:18.0.0-4742.g79365bb3.el8.x86_64 119/134 2023-07-06T19:57:26.870 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-06T19:57:27.004 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs-devel-2:18.0.0-4742.g79365bb3.el8.x86_ 121/134 2023-07-06T19:57:27.193 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-06T19:57:28.140 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-06T19:57:28.367 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-06T19:57:28.385 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-06T19:57:28.541 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-top-2:18.0.0-4742.g79365bb3.el8.noarch 124/134 2023-07-06T19:57:28.841 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-fuse-2:18.0.0-4742.g79365bb3.el8.x86_64 125/134 2023-07-06T19:57:29.086 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-nbd-2:18.0.0-4742.g79365bb3.el8.x86_64 126/134 2023-07-06T19:57:29.325 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-06T19:57:29.495 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-06T19:57:29.503 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-06T19:57:29.521 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-06T19:57:29.669 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-07-06T19:57:29.790 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-06T19:57:29.809 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-06T19:57:29.856 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-07-06T19:57:29.949 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-07-06T19:57:30.041 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-top-2:18.0.0-4742.g79365bb3.el8.noarch 124/134 2023-07-06T19:57:30.156 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-07-06T19:57:30.170 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-07-06T19:57:30.171 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-06T19:57:30.284 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-fuse-2:18.0.0-4742.g79365bb3.el8.x86_64 125/134 2023-07-06T19:57:30.360 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-06T19:57:30.360 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-06T19:57:30.571 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-06T19:57:30.593 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-nbd-2:18.0.0-4742.g79365bb3.el8.x86_64 126/134 2023-07-06T19:57:30.756 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-06T19:57:30.859 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-06T19:57:31.025 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-06T19:57:31.033 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-06T19:57:31.201 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-07-06T19:57:31.322 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-06T19:57:31.322 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-2:18.0.0-4742.g79365bb3.el8.x86_64 1/134 2023-07-06T19:57:31.322 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-base-2:18.0.0-4742.g79365bb3.el8.x86_64 2/134 2023-07-06T19:57:31.322 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-common-2:18.0.0-4742.g79365bb3.el8.x86_64 3/134 2023-07-06T19:57:31.323 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-fuse-2:18.0.0-4742.g79365bb3.el8.x86_64 4/134 2023-07-06T19:57:31.323 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4742.g79365 5/134 2023-07-06T19:57:31.323 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mds-2:18.0.0-4742.g79365bb3.el8.x86_64 6/134 2023-07-06T19:57:31.323 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-2:18.0.0-4742.g79365bb3.el8.x86_64 7/134 2023-07-06T19:57:31.323 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mon-2:18.0.0-4742.g79365bb3.el8.x86_64 8/134 2023-07-06T19:57:31.323 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-osd-2:18.0.0-4742.g79365bb3.el8.x86_64 9/134 2023-07-06T19:57:31.323 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-radosgw-2:18.0.0-4742.g79365bb3.el8.x86_64 10/134 2023-07-06T19:57:31.324 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-selinux-2:18.0.0-4742.g79365bb3.el8.x86_64 11/134 2023-07-06T19:57:31.324 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-test-2:18.0.0-4742.g79365bb3.el8.x86_64 12/134 2023-07-06T19:57:31.325 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 13/134 2023-07-06T19:57:31.325 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs-devel-2:18.0.0-4742.g79365bb3.el8.x86_ 14/134 2023-07-06T19:57:31.325 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs2-2:18.0.0-4742.g79365bb3.el8.x86_64 15/134 2023-07-06T19:57:31.325 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephsqlite-2:18.0.0-4742.g79365bb3.el8.x86_64 16/134 2023-07-06T19:57:31.326 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados-devel-2:18.0.0-4742.g79365bb3.el8.x86_6 17/134 2023-07-06T19:57:31.326 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libradosstriper1-2:18.0.0-4742.g79365bb3.el8.x86 18/134 2023-07-06T19:57:31.326 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librgw2-2:18.0.0-4742.g79365bb3.el8.x86_64 19/134 2023-07-06T19:57:31.326 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4742.g79365bb3.el 20/134 2023-07-06T19:57:31.326 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-common-2:18.0.0-4742.g79365bb3.el8. 21/134 2023-07-06T19:57:31.326 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cephfs-2:18.0.0-4742.g79365bb3.el8.x86_6 22/134 2023-07-06T19:57:31.326 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rados-2:18.0.0-4742.g79365bb3.el8.x86_64 23/134 2023-07-06T19:57:31.327 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rbd-2:18.0.0-4742.g79365bb3.el8.x86_64 24/134 2023-07-06T19:57:31.327 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rgw-2:18.0.0-4742.g79365bb3.el8.x86_64 25/134 2023-07-06T19:57:31.327 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-fuse-2:18.0.0-4742.g79365bb3.el8.x86_64 26/134 2023-07-06T19:57:31.327 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 27/134 2023-07-06T19:57:31.327 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-nbd-2:18.0.0-4742.g79365bb3.el8.x86_64 28/134 2023-07-06T19:57:31.327 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4742.g79365bb3. 29/134 2023-07-06T19:57:31.334 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4742.g79365bb3.el8.noa 30/134 2023-07-06T19:57:31.334 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4742.g79365bb3.el8.n 31/134 2023-07-06T19:57:31.334 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4742.g793 32/134 2023-07-06T19:57:31.335 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4742.g79365bb3.el 33/134 2023-07-06T19:57:31.335 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4742.g79365bb3.el8.noarch 34/134 2023-07-06T19:57:31.335 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4742.g79365bb3.e 35/134 2023-07-06T19:57:31.335 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-volume-2:18.0.0-4742.g79365bb3.el8.noarch 36/134 2023-07-06T19:57:31.335 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephadm-2:18.0.0-4742.g79365bb3.el8.noarch 37/134 2023-07-06T19:57:31.335 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-top-2:18.0.0-4742.g79365bb3.el8.noarch 38/134 2023-07-06T19:57:31.335 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-06T19:57:31.336 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-06T19:57:31.336 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-06T19:57:31.336 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-06T19:57:31.336 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-06T19:57:31.336 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-06T19:57:31.336 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-06T19:57:31.337 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-06T19:57:31.337 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-06T19:57:31.338 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-06T19:57:31.338 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-06T19:57:31.338 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-06T19:57:31.338 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-06T19:57:31.338 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-06T19:57:31.338 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-06T19:57:31.338 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-06T19:57:31.338 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-06T19:57:31.339 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-06T19:57:31.339 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-06T19:57:31.339 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-06T19:57:31.339 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-06T19:57:31.339 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-06T19:57:31.339 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-06T19:57:31.339 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-06T19:57:31.339 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-06T19:57:31.340 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-06T19:57:31.340 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-06T19:57:31.342 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-06T19:57:31.342 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-06T19:57:31.343 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-06T19:57:31.343 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-06T19:57:31.343 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-06T19:57:31.343 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-06T19:57:31.343 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-07-06T19:57:31.344 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-07-06T19:57:31.344 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-07-06T19:57:31.346 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-07-06T19:57:31.346 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-07-06T19:57:31.347 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-07-06T19:57:31.347 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-07-06T19:57:31.347 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-07-06T19:57:31.347 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-07-06T19:57:31.348 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-07-06T19:57:31.348 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-07-06T19:57:31.349 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-07-06T19:57:31.349 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-07-06T19:57:31.349 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-07-06T19:57:31.350 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-07-06T19:57:31.350 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-07-06T19:57:31.350 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-07-06T19:57:31.353 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-07-06T19:57:31.353 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-07-06T19:57:31.364 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-07-06T19:57:31.364 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-07-06T19:57:31.364 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-07-06T19:57:31.364 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-07-06T19:57:31.364 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-07-06T19:57:31.364 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-07-06T19:57:31.365 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-07-06T19:57:31.365 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-07-06T19:57:31.365 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-07-06T19:57:31.365 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-07-06T19:57:31.365 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-07-06T19:57:31.365 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-07-06T19:57:31.365 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-07-06T19:57:31.366 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-07-06T19:57:31.366 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-07-06T19:57:31.366 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-07-06T19:57:31.366 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-07-06T19:57:31.366 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-07-06T19:57:31.366 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-07-06T19:57:31.366 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-07-06T19:57:31.366 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-07-06T19:57:31.367 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-07-06T19:57:31.367 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-07-06T19:57:31.367 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-07-06T19:57:31.367 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-07-06T19:57:31.367 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-07-06T19:57:31.367 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-07-06T19:57:31.367 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-07-06T19:57:31.368 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-07-06T19:57:31.368 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-06T19:57:31.368 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-07-06T19:57:31.368 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-06T19:57:31.368 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-07-06T19:57:31.368 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-07-06T19:57:31.368 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-07-06T19:57:31.368 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-07-06T19:57:31.369 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-07-06T19:57:31.369 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-06T19:57:31.369 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:18.0.0-4742.g79365bb3.el8.x86_64 129/134 2023-07-06T19:57:31.369 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-06T19:57:31.369 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:18.0.0-4742.g79365bb3.el8.x86_64 131/134 2023-07-06T19:57:31.369 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-06T19:57:31.369 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-06T19:57:31.424 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-07-06T19:57:31.520 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-07-06T19:57:31.740 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-07-06T19:57:31.754 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-07-06T19:57:31.754 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-06T19:57:31.944 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-06T19:57:31.944 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-06T19:57:32.231 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-06T19:57:32.390 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-06T19:57:32.921 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-06T19:57:32.921 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-2:18.0.0-4742.g79365bb3.el8.x86_64 1/134 2023-07-06T19:57:32.921 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-base-2:18.0.0-4742.g79365bb3.el8.x86_64 2/134 2023-07-06T19:57:32.922 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-common-2:18.0.0-4742.g79365bb3.el8.x86_64 3/134 2023-07-06T19:57:32.922 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-fuse-2:18.0.0-4742.g79365bb3.el8.x86_64 4/134 2023-07-06T19:57:32.922 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4742.g79365 5/134 2023-07-06T19:57:32.922 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mds-2:18.0.0-4742.g79365bb3.el8.x86_64 6/134 2023-07-06T19:57:32.922 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-2:18.0.0-4742.g79365bb3.el8.x86_64 7/134 2023-07-06T19:57:32.922 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mon-2:18.0.0-4742.g79365bb3.el8.x86_64 8/134 2023-07-06T19:57:32.922 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-osd-2:18.0.0-4742.g79365bb3.el8.x86_64 9/134 2023-07-06T19:57:32.922 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-radosgw-2:18.0.0-4742.g79365bb3.el8.x86_64 10/134 2023-07-06T19:57:32.923 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-selinux-2:18.0.0-4742.g79365bb3.el8.x86_64 11/134 2023-07-06T19:57:32.923 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-test-2:18.0.0-4742.g79365bb3.el8.x86_64 12/134 2023-07-06T19:57:32.923 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 13/134 2023-07-06T19:57:32.923 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs-devel-2:18.0.0-4742.g79365bb3.el8.x86_ 14/134 2023-07-06T19:57:32.923 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs2-2:18.0.0-4742.g79365bb3.el8.x86_64 15/134 2023-07-06T19:57:32.923 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephsqlite-2:18.0.0-4742.g79365bb3.el8.x86_64 16/134 2023-07-06T19:57:32.923 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados-devel-2:18.0.0-4742.g79365bb3.el8.x86_6 17/134 2023-07-06T19:57:32.924 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libradosstriper1-2:18.0.0-4742.g79365bb3.el8.x86 18/134 2023-07-06T19:57:32.924 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librgw2-2:18.0.0-4742.g79365bb3.el8.x86_64 19/134 2023-07-06T19:57:32.924 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4742.g79365bb3.el 20/134 2023-07-06T19:57:32.933 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-common-2:18.0.0-4742.g79365bb3.el8. 21/134 2023-07-06T19:57:32.934 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cephfs-2:18.0.0-4742.g79365bb3.el8.x86_6 22/134 2023-07-06T19:57:32.934 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rados-2:18.0.0-4742.g79365bb3.el8.x86_64 23/134 2023-07-06T19:57:32.934 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rbd-2:18.0.0-4742.g79365bb3.el8.x86_64 24/134 2023-07-06T19:57:32.934 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rgw-2:18.0.0-4742.g79365bb3.el8.x86_64 25/134 2023-07-06T19:57:32.934 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-fuse-2:18.0.0-4742.g79365bb3.el8.x86_64 26/134 2023-07-06T19:57:32.934 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 27/134 2023-07-06T19:57:32.934 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-nbd-2:18.0.0-4742.g79365bb3.el8.x86_64 28/134 2023-07-06T19:57:32.934 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4742.g79365bb3. 29/134 2023-07-06T19:57:32.935 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4742.g79365bb3.el8.noa 30/134 2023-07-06T19:57:32.957 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4742.g79365bb3.el8.n 31/134 2023-07-06T19:57:32.957 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4742.g793 32/134 2023-07-06T19:57:32.957 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4742.g79365bb3.el 33/134 2023-07-06T19:57:32.957 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4742.g79365bb3.el8.noarch 34/134 2023-07-06T19:57:32.957 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4742.g79365bb3.e 35/134 2023-07-06T19:57:32.958 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-volume-2:18.0.0-4742.g79365bb3.el8.noarch 36/134 2023-07-06T19:57:32.958 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephadm-2:18.0.0-4742.g79365bb3.el8.noarch 37/134 2023-07-06T19:57:32.958 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-top-2:18.0.0-4742.g79365bb3.el8.noarch 38/134 2023-07-06T19:57:32.958 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-06T19:57:32.958 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-06T19:57:32.958 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-06T19:57:32.958 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-06T19:57:32.958 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-06T19:57:32.959 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-06T19:57:32.959 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-06T19:57:32.959 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-06T19:57:32.959 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-06T19:57:32.959 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-06T19:57:32.959 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-06T19:57:32.959 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-06T19:57:32.960 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-06T19:57:32.960 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-06T19:57:32.960 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-06T19:57:32.960 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-06T19:57:32.960 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-06T19:57:32.960 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-06T19:57:32.960 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-06T19:57:32.961 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-06T19:57:32.961 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-06T19:57:32.961 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-06T19:57:32.961 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-06T19:57:32.961 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-06T19:57:32.961 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-06T19:57:32.961 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-06T19:57:32.961 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-06T19:57:32.962 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-06T19:57:32.962 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-06T19:57:32.962 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-06T19:57:32.962 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-06T19:57:32.962 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-06T19:57:32.962 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-06T19:57:32.962 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-07-06T19:57:32.962 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-07-06T19:57:32.963 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-07-06T19:57:32.963 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-07-06T19:57:32.963 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-07-06T19:57:32.963 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-07-06T19:57:32.963 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-07-06T19:57:32.963 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-07-06T19:57:32.963 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-07-06T19:57:32.964 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-07-06T19:57:32.964 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-07-06T19:57:32.964 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-07-06T19:57:32.964 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-07-06T19:57:32.964 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-07-06T19:57:32.964 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-07-06T19:57:32.964 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-07-06T19:57:32.964 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-07-06T19:57:32.965 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-07-06T19:57:32.965 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-07-06T19:57:32.965 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-07-06T19:57:32.965 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-07-06T19:57:32.965 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-07-06T19:57:32.965 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-07-06T19:57:32.966 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-07-06T19:57:32.967 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-07-06T19:57:32.967 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-07-06T19:57:32.967 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-07-06T19:57:32.967 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-07-06T19:57:32.967 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-07-06T19:57:32.967 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-07-06T19:57:32.967 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-07-06T19:57:32.968 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-07-06T19:57:32.968 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-07-06T19:57:32.968 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-07-06T19:57:32.968 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-07-06T19:57:32.968 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-07-06T19:57:32.968 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-07-06T19:57:32.968 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-07-06T19:57:32.969 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-07-06T19:57:32.969 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-07-06T19:57:32.969 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-07-06T19:57:32.969 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-07-06T19:57:32.969 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-07-06T19:57:32.969 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-07-06T19:57:32.969 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-07-06T19:57:32.969 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-07-06T19:57:32.970 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-07-06T19:57:32.970 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-07-06T19:57:32.970 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-06T19:57:32.970 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-07-06T19:57:32.970 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-06T19:57:32.970 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-07-06T19:57:32.970 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-07-06T19:57:32.971 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-07-06T19:57:32.971 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-07-06T19:57:32.971 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-07-06T19:57:32.971 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-06T19:57:32.971 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-2:18.0.0-4742.g79365bb3.el8.x86_64 129/134 2023-07-06T19:57:32.971 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-06T19:57:32.971 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-2:18.0.0-4742.g79365bb3.el8.x86_64 131/134 2023-07-06T19:57:32.971 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-06T19:57:32.972 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-06T19:57:33.942 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-06T19:57:33.942 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:01:58 ago on Thu 06 Jul 2023 07:55:35 PM UTC. 2023-07-06T19:57:35.699 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-06T19:57:35.699 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:02:01 ago on Thu 06 Jul 2023 07:55:34 PM UTC. 2023-07-06T19:57:44.439 INFO:teuthology.orchestra.run.smithi040.stdout:Installed products updated. 2023-07-06T19:57:44.676 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:44.677 INFO:teuthology.orchestra.run.smithi040.stdout:Upgraded: 2023-07-06T19:57:44.677 INFO:teuthology.orchestra.run.smithi040.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-06T19:57:44.677 INFO:teuthology.orchestra.run.smithi040.stdout: librados2-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.677 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.677 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2023-07-06T19:57:44.677 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-06T19:57:44.678 INFO:teuthology.orchestra.run.smithi040.stdout: automake-1.16.1-7.el8.noarch 2023-07-06T19:57:44.678 INFO:teuthology.orchestra.run.smithi040.stdout: bison-3.0.4-10.el8.x86_64 2023-07-06T19:57:44.678 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.678 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.678 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.678 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.678 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T19:57:44.679 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.679 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.679 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.679 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T19:57:44.679 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T19:57:44.679 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T19:57:44.679 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T19:57:44.679 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T19:57:44.680 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.680 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.680 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T19:57:44.680 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.680 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.680 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.680 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T19:57:44.681 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T19:57:44.681 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.681 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-top-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T19:57:44.681 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-06T19:57:44.681 INFO:teuthology.orchestra.run.smithi040.stdout: flex-2.6.1-9.el8.x86_64 2023-07-06T19:57:44.681 INFO:teuthology.orchestra.run.smithi040.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-06T19:57:44.681 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-06T19:57:44.681 INFO:teuthology.orchestra.run.smithi040.stdout: jq-1.6-3.el8.x86_64 2023-07-06T19:57:44.682 INFO:teuthology.orchestra.run.smithi040.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-06T19:57:44.682 INFO:teuthology.orchestra.run.smithi040.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-06T19:57:44.682 INFO:teuthology.orchestra.run.smithi040.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-06T19:57:44.682 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.682 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.682 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.682 INFO:teuthology.orchestra.run.smithi040.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-06T19:57:44.682 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-06T19:57:44.683 INFO:teuthology.orchestra.run.smithi040.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-06T19:57:44.683 INFO:teuthology.orchestra.run.smithi040.stdout: libpq-13.5-1.el8.x86_64 2023-07-06T19:57:44.683 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-06T19:57:44.683 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-06T19:57:44.683 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.684 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.685 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-06T19:57:44.685 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.685 INFO:teuthology.orchestra.run.smithi040.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-06T19:57:44.685 INFO:teuthology.orchestra.run.smithi040.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-06T19:57:44.685 INFO:teuthology.orchestra.run.smithi040.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-06T19:57:44.685 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-06T19:57:44.685 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-06T19:57:44.686 INFO:teuthology.orchestra.run.smithi040.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-06T19:57:44.686 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-06T19:57:44.686 INFO:teuthology.orchestra.run.smithi040.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-06T19:57:44.686 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-06T19:57:44.686 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-06T19:57:44.686 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-06T19:57:44.686 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-06T19:57:44.687 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-06T19:57:44.687 INFO:teuthology.orchestra.run.smithi040.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-06T19:57:44.687 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-06T19:57:44.687 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-06T19:57:44.687 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-06T19:57:44.687 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-06T19:57:44.687 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-06T19:57:44.688 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-06T19:57:44.688 INFO:teuthology.orchestra.run.smithi040.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-06T19:57:44.688 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-06T19:57:44.688 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.688 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.688 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.689 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-06T19:57:44.689 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-06T19:57:44.689 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-06T19:57:44.689 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-06T19:57:44.689 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-06T19:57:44.689 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-06T19:57:44.693 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-06T19:57:44.694 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-06T19:57:44.694 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-06T19:57:44.694 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-06T19:57:44.694 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-06T19:57:44.694 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-06T19:57:44.694 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-06T19:57:44.694 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-06T19:57:44.695 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-06T19:57:44.695 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-06T19:57:44.695 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-06T19:57:44.695 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-06T19:57:44.695 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-06T19:57:44.695 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-06T19:57:44.695 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-06T19:57:44.696 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-06T19:57:44.696 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend-2.6-1.el8.noarch 2023-07-06T19:57:44.696 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-06T19:57:44.696 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-06T19:57:44.697 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-06T19:57:44.698 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-06T19:57:44.698 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-06T19:57:44.698 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-06T19:57:44.698 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.698 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.698 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-06T19:57:44.698 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-06T19:57:44.699 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.699 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-06T19:57:44.699 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-06T19:57:44.699 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-06T19:57:44.699 INFO:teuthology.orchestra.run.smithi040.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-06T19:57:44.699 INFO:teuthology.orchestra.run.smithi040.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-06T19:57:44.699 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-06T19:57:44.699 INFO:teuthology.orchestra.run.smithi040.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-06T19:57:44.700 INFO:teuthology.orchestra.run.smithi040.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-06T19:57:44.700 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-06T19:57:44.700 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-06T19:57:44.700 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-06T19:57:44.701 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-06T19:57:44.702 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-06T19:57:44.702 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.702 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.702 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:44.702 INFO:teuthology.orchestra.run.smithi040.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-06T19:57:44.702 INFO:teuthology.orchestra.run.smithi040.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-06T19:57:44.702 INFO:teuthology.orchestra.run.smithi040.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-06T19:57:44.703 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-06T19:57:44.703 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-06T19:57:44.703 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-06T19:57:44.703 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:44.703 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2023-07-06T19:57:44.865 DEBUG:teuthology.parallel:result is None 2023-07-06T19:57:46.696 INFO:teuthology.orchestra.run.smithi006.stdout:Installed products updated. 2023-07-06T19:57:46.937 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:46.938 INFO:teuthology.orchestra.run.smithi006.stdout:Upgraded: 2023-07-06T19:57:46.938 INFO:teuthology.orchestra.run.smithi006.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-06T19:57:46.938 INFO:teuthology.orchestra.run.smithi006.stdout: librados2-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.939 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.939 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2023-07-06T19:57:46.939 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-06T19:57:46.939 INFO:teuthology.orchestra.run.smithi006.stdout: automake-1.16.1-7.el8.noarch 2023-07-06T19:57:46.940 INFO:teuthology.orchestra.run.smithi006.stdout: bison-3.0.4-10.el8.x86_64 2023-07-06T19:57:46.940 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.940 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.944 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.944 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.944 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T19:57:46.945 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.945 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.945 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.946 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T19:57:46.946 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T19:57:46.946 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T19:57:46.946 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T19:57:46.947 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T19:57:46.947 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.947 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.947 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T19:57:46.948 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.948 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.948 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.949 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T19:57:46.949 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T19:57:46.950 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.950 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top-2:18.0.0-4742.g79365bb3.el8.noarch 2023-07-06T19:57:46.950 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-06T19:57:46.951 INFO:teuthology.orchestra.run.smithi006.stdout: flex-2.6.1-9.el8.x86_64 2023-07-06T19:57:46.951 INFO:teuthology.orchestra.run.smithi006.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-06T19:57:46.951 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-06T19:57:46.951 INFO:teuthology.orchestra.run.smithi006.stdout: jq-1.6-3.el8.x86_64 2023-07-06T19:57:46.951 INFO:teuthology.orchestra.run.smithi006.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-06T19:57:46.953 INFO:teuthology.orchestra.run.smithi006.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-06T19:57:46.953 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-06T19:57:46.953 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.954 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.959 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.964 INFO:teuthology.orchestra.run.smithi006.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-06T19:57:46.965 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-06T19:57:46.965 INFO:teuthology.orchestra.run.smithi006.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-06T19:57:46.965 INFO:teuthology.orchestra.run.smithi006.stdout: libpq-13.5-1.el8.x86_64 2023-07-06T19:57:46.965 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-06T19:57:46.965 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-06T19:57:46.965 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.966 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.966 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-06T19:57:46.966 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.966 INFO:teuthology.orchestra.run.smithi006.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-06T19:57:46.966 INFO:teuthology.orchestra.run.smithi006.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-06T19:57:46.966 INFO:teuthology.orchestra.run.smithi006.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-06T19:57:46.966 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-06T19:57:46.967 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-06T19:57:46.967 INFO:teuthology.orchestra.run.smithi006.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-06T19:57:46.967 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-06T19:57:46.967 INFO:teuthology.orchestra.run.smithi006.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-06T19:57:46.967 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-06T19:57:46.967 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-06T19:57:46.967 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-06T19:57:46.968 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-06T19:57:46.968 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-06T19:57:46.968 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-06T19:57:46.975 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-06T19:57:46.975 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-06T19:57:46.975 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-06T19:57:46.975 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-06T19:57:46.975 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-06T19:57:46.975 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-06T19:57:46.976 INFO:teuthology.orchestra.run.smithi006.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-06T19:57:46.976 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-06T19:57:46.976 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.976 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.976 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.976 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-06T19:57:46.976 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-06T19:57:46.977 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-06T19:57:46.977 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-06T19:57:46.977 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-06T19:57:46.978 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-06T19:57:46.978 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-06T19:57:46.978 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-06T19:57:46.978 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-06T19:57:46.978 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-06T19:57:46.979 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-06T19:57:46.979 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-06T19:57:46.979 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-06T19:57:46.979 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-06T19:57:46.979 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-06T19:57:46.979 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-06T19:57:46.979 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-06T19:57:46.980 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-06T19:57:46.980 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-06T19:57:46.980 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-06T19:57:46.985 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-06T19:57:46.985 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-06T19:57:46.985 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend-2.6-1.el8.noarch 2023-07-06T19:57:46.986 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-06T19:57:46.986 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-06T19:57:46.986 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-06T19:57:46.986 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-06T19:57:46.986 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-06T19:57:46.986 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-06T19:57:46.986 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.987 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.987 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-06T19:57:46.987 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-06T19:57:46.987 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.987 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-06T19:57:46.987 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-06T19:57:46.987 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-06T19:57:46.988 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-06T19:57:46.988 INFO:teuthology.orchestra.run.smithi006.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-06T19:57:46.988 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-06T19:57:46.988 INFO:teuthology.orchestra.run.smithi006.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-06T19:57:46.988 INFO:teuthology.orchestra.run.smithi006.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-06T19:57:46.988 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-06T19:57:46.989 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-06T19:57:46.989 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-06T19:57:46.989 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-06T19:57:46.991 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-06T19:57:46.991 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.991 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.991 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd-2:18.0.0-4742.g79365bb3.el8.x86_64 2023-07-06T19:57:46.991 INFO:teuthology.orchestra.run.smithi006.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-06T19:57:46.991 INFO:teuthology.orchestra.run.smithi006.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-06T19:57:46.991 INFO:teuthology.orchestra.run.smithi006.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-06T19:57:46.992 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-06T19:57:46.992 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-06T19:57:46.992 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-06T19:57:46.992 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:46.992 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2023-07-06T19:57:47.225 DEBUG:teuthology.parallel:result is None 2023-07-06T19:57:47.229 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=79365bb3b803780276d69efb2cc4afe5b160de9e 2023-07-06T19:57:47.411 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-06T19:57:47.442 INFO:teuthology.orchestra.run.smithi006.stdout:18.0.0-4742.g79365bb3.el8 2023-07-06T19:57:47.443 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4742.g79365bb3.el8 2023-07-06T19:57:47.444 INFO:teuthology.task.install:The correct ceph version 18.0.0-4742.g79365bb3 is installed. 2023-07-06T19:57:47.445 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=79365bb3b803780276d69efb2cc4afe5b160de9e 2023-07-06T19:57:47.673 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-06T19:57:47.704 INFO:teuthology.orchestra.run.smithi040.stdout:18.0.0-4742.g79365bb3.el8 2023-07-06T19:57:47.705 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4742.g79365bb3.el8 2023-07-06T19:57:47.705 INFO:teuthology.task.install:The correct ceph version 18.0.0-4742.g79365bb3 is installed. 2023-07-06T19:57:47.706 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-06T19:57:47.707 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:57:47.707 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-06T19:57:47.757 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:57:47.758 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-06T19:57:47.809 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-06T19:57:47.810 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:57:47.810 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/daemon-helper 2023-07-06T19:57:47.845 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-06T19:57:47.918 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:57:47.919 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/daemon-helper 2023-07-06T19:57:47.957 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-06T19:57:48.028 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-06T19:57:48.029 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:57:48.029 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-06T19:57:48.059 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-06T19:57:48.128 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:57:48.128 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-06T19:57:48.160 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-06T19:57:48.234 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-06T19:57:48.235 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:57:48.235 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/stdin-killer 2023-07-06T19:57:48.265 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-06T19:57:48.336 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:57:48.337 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/stdin-killer 2023-07-06T19:57:48.370 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-06T19:57:48.443 INFO:teuthology.run_tasks:Running task ceph... 2023-07-06T19:57:48.644 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-06T19:57:48.645 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 777 /var/log/ceph 2023-07-06T19:57:48.654 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 777 /var/log/ceph 2023-07-06T19:57:48.701 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-06T19:57:48.701 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-06T19:57:48.720 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-06T19:57:48.777 INFO:tasks.ceph:Creating extra log directories... 2023-07-06T19:57:48.778 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-06T19:57:48.796 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-06T19:57:48.873 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-06T19:57:48.877 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-06T19:57:48.877 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-06T19:57:48.877 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:57:48.878 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-06T19:57:48.902 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-06T19:57:49.061 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-06T19:57:49.092 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:57:49.092 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-06T19:57:49.118 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-06T19:57:49.467 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-06T19:57:49.538 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-06T19:57:49.539 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-06T19:57:49.539 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-07-06_19:33:28-fs-wip-rishabh-2023Jul5-testing-default-smithi/7328165', 'branch': 'wip-rishabh-2023Jul5', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7328165', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-07-06_19:33:28-fs-wip-rishabh-2023Jul5-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-2023Jul5'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '79365bb3b803780276d69efb2cc4afe5b160de9e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '79365bb3b803780276d69efb2cc4afe5b160de9e'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-2023Jul5', 'sha1': '79365bb3b803780276d69efb2cc4afe5b160de9e'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '79365bb3b803780276d69efb2cc4afe5b160de9e', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-2023Jul5', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_79365bb3b803780276d69efb2cc4afe5b160de9e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '79365bb3b803780276d69efb2cc4afe5b160de9e', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi006.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi040.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '79365bb3b803780276d69efb2cc4afe5b160de9e'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b53f236c1077f1d295baafb9e0ca9a4b447019d7', 'timestamp': '2023-07-06_19:33:28', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-06T19:57:49.540 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-06T19:57:49.546 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-06T19:57:49.567 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/run/ceph 2023-07-06T19:57:49.604 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/run/ceph 2023-07-06T19:57:49.642 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:57:49.642 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/scratch_devs of=/dev/stdout 2023-07-06T19:57:49.706 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-06T19:57:49.706 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_1 2023-07-06T19:57:49.766 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-06T19:57:49.767 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-06T19:57:49.778 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 379154 Links: 1 2023-07-06T19:57:49.778 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T19:57:49.778 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-07-06T19:57:49.779 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-07-06 19:57:32.609176888 +0000 2023-07-06T19:57:49.784 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-07-06 19:54:35.141473574 +0000 2023-07-06T19:57:49.785 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-07-06 19:54:35.141473574 +0000 2023-07-06T19:57:49.785 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-07-06T19:57:49.786 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-06T19:57:49.836 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-07-06T19:57:49.837 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-07-06T19:57:49.837 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000234778 s, 2.2 MB/s 2023-07-06T19:57:49.839 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-06T19:57:49.899 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_2 2023-07-06T19:57:49.958 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-06T19:57:49.959 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-06T19:57:49.959 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 381503 Links: 1 2023-07-06T19:57:49.959 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T19:57:49.959 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-07-06T19:57:49.959 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-07-06 19:57:32.609176888 +0000 2023-07-06T19:57:49.959 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-07-06 19:54:35.788467300 +0000 2023-07-06T19:57:49.960 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-07-06 19:54:35.788467300 +0000 2023-07-06T19:57:49.960 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-07-06T19:57:49.960 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-06T19:57:50.029 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-07-06T19:57:50.029 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-07-06T19:57:50.029 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.00022045 s, 2.3 MB/s 2023-07-06T19:57:50.031 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-06T19:57:50.092 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_3 2023-07-06T19:57:50.153 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-06T19:57:50.153 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-06T19:57:50.153 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 380450 Links: 1 2023-07-06T19:57:50.153 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T19:57:50.154 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-07-06T19:57:50.154 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-07-06 19:57:32.609176888 +0000 2023-07-06T19:57:50.154 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-07-06 19:54:36.409461278 +0000 2023-07-06T19:57:50.154 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-07-06 19:54:36.409461278 +0000 2023-07-06T19:57:50.154 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-07-06T19:57:50.154 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-06T19:57:50.225 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-07-06T19:57:50.225 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-07-06T19:57:50.225 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000212342 s, 2.4 MB/s 2023-07-06T19:57:50.226 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-06T19:57:50.286 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_4 2023-07-06T19:57:50.346 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-06T19:57:50.346 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-06T19:57:50.347 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 381691 Links: 1 2023-07-06T19:57:50.347 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T19:57:50.347 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-07-06T19:57:50.347 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-07-06 19:57:32.609176888 +0000 2023-07-06T19:57:50.348 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-07-06 19:54:37.046455100 +0000 2023-07-06T19:57:50.351 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-07-06 19:54:37.046455100 +0000 2023-07-06T19:57:50.352 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-07-06T19:57:50.352 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-06T19:57:50.414 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-07-06T19:57:50.414 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-07-06T19:57:50.415 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000231583 s, 2.2 MB/s 2023-07-06T19:57:50.416 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-06T19:57:50.481 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-06T19:57:50.482 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:57:50.482 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/scratch_devs of=/dev/stdout 2023-07-06T19:57:50.505 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-06T19:57:50.505 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_1 2023-07-06T19:57:50.566 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-06T19:57:50.567 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-06T19:57:50.567 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 372507 Links: 1 2023-07-06T19:57:50.567 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T19:57:50.567 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-07-06T19:57:50.572 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-07-06 19:57:31.002281348 +0000 2023-07-06T19:57:50.572 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-07-06 19:54:36.982158217 +0000 2023-07-06T19:57:50.572 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-07-06 19:54:36.982158217 +0000 2023-07-06T19:57:50.572 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2023-07-06T19:57:50.572 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-06T19:57:50.643 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-07-06T19:57:50.643 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-07-06T19:57:50.644 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000340015 s, 1.5 MB/s 2023-07-06T19:57:50.645 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-06T19:57:50.709 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_2 2023-07-06T19:57:50.775 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-06T19:57:50.776 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-06T19:57:50.776 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 380216 Links: 1 2023-07-06T19:57:50.777 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T19:57:50.777 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-07-06T19:57:50.777 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-07-06 19:57:31.002281348 +0000 2023-07-06T19:57:50.781 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-07-06 19:54:37.537151575 +0000 2023-07-06T19:57:50.781 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-07-06 19:54:37.537151575 +0000 2023-07-06T19:57:50.782 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2023-07-06T19:57:50.782 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-06T19:57:50.848 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-07-06T19:57:50.849 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-07-06T19:57:50.849 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000234215 s, 2.2 MB/s 2023-07-06T19:57:50.850 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-06T19:57:50.916 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_3 2023-07-06T19:57:50.977 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-06T19:57:50.977 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-06T19:57:50.977 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 375133 Links: 1 2023-07-06T19:57:50.977 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T19:57:50.977 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-07-06T19:57:50.978 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-07-06 19:57:31.002281348 +0000 2023-07-06T19:57:50.978 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-07-06 19:54:38.076145125 +0000 2023-07-06T19:57:50.978 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-07-06 19:54:38.076145125 +0000 2023-07-06T19:57:50.978 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2023-07-06T19:57:50.978 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-06T19:57:51.048 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-07-06T19:57:51.048 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-07-06T19:57:51.049 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000262575 s, 1.9 MB/s 2023-07-06T19:57:51.049 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-06T19:57:51.110 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_4 2023-07-06T19:57:51.184 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-06T19:57:51.184 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-06T19:57:51.184 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 6h/6d Inode: 378845 Links: 1 2023-07-06T19:57:51.184 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-06T19:57:51.185 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2023-07-06T19:57:51.188 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2023-07-06 19:57:31.002281348 +0000 2023-07-06T19:57:51.189 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2023-07-06 19:54:38.661138123 +0000 2023-07-06T19:57:51.189 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2023-07-06 19:54:38.661138123 +0000 2023-07-06T19:57:51.189 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: - 2023-07-06T19:57:51.189 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-06T19:57:51.253 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2023-07-06T19:57:51.253 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2023-07-06T19:57:51.253 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000225305 s, 2.3 MB/s 2023-07-06T19:57:51.255 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-06T19:57:51.315 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-06T19:57:51.315 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-06T19:57:51.315 INFO:tasks.ceph:Generating config... 2023-07-06T19:57:51.318 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-06T19:57:51.318 INFO:tasks.ceph:[client] debug client = 20 2023-07-06T19:57:51.318 INFO:tasks.ceph:[client] debug ms = 1 2023-07-06T19:57:51.319 INFO:tasks.ceph:[client] pid file = 2023-07-06T19:57:51.320 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-06T19:57:51.324 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-06T19:57:51.324 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-07-06T19:57:51.324 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-06T19:57:51.325 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-06T19:57:51.330 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-06T19:57:51.330 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-06T19:57:51.330 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-06T19:57:51.330 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-06T19:57:51.331 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-06T19:57:51.331 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-06T19:57:51.331 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-06T19:57:51.331 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-06T19:57:51.331 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-06T19:57:51.332 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-06T19:57:51.332 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-06T19:57:51.332 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-06T19:57:51.332 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-06T19:57:51.332 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-06T19:57:51.333 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-06T19:57:51.333 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-06T19:57:51.333 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-07-06T19:57:51.333 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-07-06T19:57:51.333 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-06T19:57:51.334 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-06T19:57:51.334 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-07-06T19:57:51.334 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-06T19:57:51.334 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-06T19:57:51.334 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-06T19:57:51.335 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-06T19:57:51.335 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-06T19:57:51.335 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-06T19:57:51.335 INFO:tasks.ceph:Setting up mon.a... 2023-07-06T19:57:51.336 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-06T19:57:51.397 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.keyring 2023-07-06T19:57:51.398 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-06T19:57:51.450 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-06T19:57:51.530 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.6'), ('mon.b', '172.21.15.40'), ('mon.c', '[v2:172.21.15.40:3301,v1:172.21.15.40:6790]')] 2023-07-06T19:57:51.531 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.6,172.21.15.40,[v2:172.21.15.40:3301,v1:172.21.15.40:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-06T19:57:51.532 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:57:51.533 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-06T19:57:51.592 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.6 --add b 172.21.15.40 --addv c '[v2:172.21.15.40:3301,v1:172.21.15.40:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-06T19:57:51.690 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-06T19:57:51.690 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: generated fsid 59b158c6-5d9d-4877-b4e7-a584e294fb2e 2023-07-06T19:57:51.690 INFO:teuthology.orchestra.run.smithi006.stdout:setting min_mon_release = pacific 2023-07-06T19:57:51.691 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 0 2023-07-06T19:57:51.693 INFO:teuthology.orchestra.run.smithi006.stdout:fsid 59b158c6-5d9d-4877-b4e7-a584e294fb2e 2023-07-06T19:57:51.693 INFO:teuthology.orchestra.run.smithi006.stdout:last_changed 2023-07-06T19:57:51.689274+0000 2023-07-06T19:57:51.693 INFO:teuthology.orchestra.run.smithi006.stdout:created 2023-07-06T19:57:51.689274+0000 2023-07-06T19:57:51.702 INFO:teuthology.orchestra.run.smithi006.stdout:min_mon_release 16 (pacific) 2023-07-06T19:57:51.702 INFO:teuthology.orchestra.run.smithi006.stdout:election_strategy: 1 2023-07-06T19:57:51.703 INFO:teuthology.orchestra.run.smithi006.stdout:0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2023-07-06T19:57:51.703 INFO:teuthology.orchestra.run.smithi006.stdout:1: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.b 2023-07-06T19:57:51.703 INFO:teuthology.orchestra.run.smithi006.stdout:2: [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] mon.c 2023-07-06T19:57:51.703 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-06T19:57:51.704 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-06T19:57:51.732 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 59b158c6-5d9d-4877-b4e7-a584e294fb2e... 2023-07-06T19:57:51.733 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-06T19:57:51.774 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-06T19:57:51.820 INFO:teuthology.orchestra.run.smithi006.stdout:[global] 2023-07-06T19:57:51.821 INFO:teuthology.orchestra.run.smithi006.stdout: chdir = "" 2023-07-06T19:57:51.821 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-06T19:57:51.821 INFO:teuthology.orchestra.run.smithi006.stdout: auth supported = cephx 2023-07-06T19:57:51.821 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.821 INFO:teuthology.orchestra.run.smithi006.stdout: filestore xattr use omap = true 2023-07-06T19:57:51.822 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.822 INFO:teuthology.orchestra.run.smithi006.stdout: mon clock drift allowed = 1.000 2023-07-06T19:57:51.822 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.822 INFO:teuthology.orchestra.run.smithi006.stdout: osd crush chooseleaf type = 0 2023-07-06T19:57:51.822 INFO:teuthology.orchestra.run.smithi006.stdout: auth debug = true 2023-07-06T19:57:51.822 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.822 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on old message = true 2023-07-06T19:57:51.823 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on bug = true 2023-07-06T19:57:51.823 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.823 INFO:teuthology.orchestra.run.smithi006.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-06T19:57:51.823 INFO:teuthology.orchestra.run.smithi006.stdout: mon pg warn max object skew = 0 2023-07-06T19:57:51.823 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.823 INFO:teuthology.orchestra.run.smithi006.stdout: # disable pg_autoscaler by default for new pools 2023-07-06T19:57:51.823 INFO:teuthology.orchestra.run.smithi006.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-06T19:57:51.823 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.824 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default size = 2 2023-07-06T19:57:51.824 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.838 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow primary affinity = true 2023-07-06T19:57:51.839 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow pg remap = true 2023-07-06T19:57:51.839 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on legacy crush tunables = false 2023-07-06T19:57:51.839 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on crush straw calc version zero = false 2023-07-06T19:57:51.840 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on no sortbitwise = false 2023-07-06T19:57:51.840 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on osd down out interval zero = false 2023-07-06T19:57:51.840 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on too few osds = false 2023-07-06T19:57:51.840 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-06T19:57:51.843 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-06T19:57:51.844 INFO:teuthology.orchestra.run.smithi006.stdout: mon_allow_pool_size_one = true 2023-07-06T19:57:51.844 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.844 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-06T19:57:51.845 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.845 INFO:teuthology.orchestra.run.smithi006.stdout: osd default data pool replay window = 5 2023-07-06T19:57:51.845 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.846 INFO:teuthology.orchestra.run.smithi006.stdout: mon allow pool delete = true 2023-07-06T19:57:51.846 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.846 INFO:teuthology.orchestra.run.smithi006.stdout: mon cluster log file level = debug 2023-07-06T19:57:51.846 INFO:teuthology.orchestra.run.smithi006.stdout: debug asserts on shutdown = true 2023-07-06T19:57:51.847 INFO:teuthology.orchestra.run.smithi006.stdout: mon health detail to clog = false 2023-07-06T19:57:51.847 INFO:teuthology.orchestra.run.smithi006.stdout: mon host = "172.21.15.6,172.21.15.40,[v2:172.21.15.40:3301,v1:172.21.15.40:6790]" 2023-07-06T19:57:51.847 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on skipped message = False 2023-07-06T19:57:51.847 INFO:teuthology.orchestra.run.smithi006.stdout: fsid = 59b158c6-5d9d-4877-b4e7-a584e294fb2e 2023-07-06T19:57:51.848 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.848 INFO:teuthology.orchestra.run.smithi006.stdout:[osd] 2023-07-06T19:57:51.848 INFO:teuthology.orchestra.run.smithi006.stdout: osd journal size = 100 2023-07-06T19:57:51.849 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.849 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub load threshold = 5.0 2023-07-06T19:57:51.849 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub max interval = 600 2023-07-06T19:57:51.849 INFO:teuthology.orchestra.run.smithi006.stdout: osd mclock profile = high_recovery_ops 2023-07-06T19:57:51.849 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.849 INFO:teuthology.orchestra.run.smithi006.stdout: osd recover clone overlap = true 2023-07-06T19:57:51.850 INFO:teuthology.orchestra.run.smithi006.stdout: osd recovery max chunk = 1048576 2023-07-06T19:57:51.850 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.850 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug shutdown = true 2023-07-06T19:57:51.850 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug op order = true 2023-07-06T19:57:51.851 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug verify stray on activate = true 2023-07-06T19:57:51.853 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.853 INFO:teuthology.orchestra.run.smithi006.stdout: osd open classes on start = true 2023-07-06T19:57:51.853 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug pg log writeout = true 2023-07-06T19:57:51.853 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.854 INFO:teuthology.orchestra.run.smithi006.stdout: osd deep scrub update digest min age = 30 2023-07-06T19:57:51.854 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.854 INFO:teuthology.orchestra.run.smithi006.stdout: osd map max advance = 10 2023-07-06T19:57:51.854 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.854 INFO:teuthology.orchestra.run.smithi006.stdout: journal zero on create = true 2023-07-06T19:57:51.854 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.855 INFO:teuthology.orchestra.run.smithi006.stdout: filestore ondisk finisher threads = 3 2023-07-06T19:57:51.855 INFO:teuthology.orchestra.run.smithi006.stdout: filestore apply finisher threads = 3 2023-07-06T19:57:51.855 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.856 INFO:teuthology.orchestra.run.smithi006.stdout: bdev debug aio = true 2023-07-06T19:57:51.856 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug misdirected ops = true 2023-07-06T19:57:51.856 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore block size = 96636764160 2023-07-06T19:57:51.856 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore fsck on mount = True 2023-07-06T19:57:51.856 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluefs = 20 2023-07-06T19:57:51.856 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluestore = 20 2023-07-06T19:57:51.856 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-07-06T19:57:51.857 INFO:teuthology.orchestra.run.smithi006.stdout: debug osd = 20 2023-07-06T19:57:51.857 INFO:teuthology.orchestra.run.smithi006.stdout: debug rocksdb = 10 2023-07-06T19:57:51.857 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd backfillfull_ratio = 0.85 2023-07-06T19:57:51.857 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd full ratio = 0.9 2023-07-06T19:57:51.857 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd nearfull ratio = 0.8 2023-07-06T19:57:51.857 INFO:teuthology.orchestra.run.smithi006.stdout: osd failsafe full ratio = 0.95 2023-07-06T19:57:51.857 INFO:teuthology.orchestra.run.smithi006.stdout: osd objectstore = bluestore 2023-07-06T19:57:51.857 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2023-07-06T19:57:51.858 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.858 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr] 2023-07-06T19:57:51.858 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-07-06T19:57:51.858 INFO:teuthology.orchestra.run.smithi006.stdout: debug mgr = 20 2023-07-06T19:57:51.858 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2023-07-06T19:57:51.858 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2023-07-06T19:57:51.858 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2023-07-06T19:57:51.859 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2023-07-06T19:57:51.859 INFO:teuthology.orchestra.run.smithi006.stdout: mgr/telemetry/nag = false 2023-07-06T19:57:51.859 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.859 INFO:teuthology.orchestra.run.smithi006.stdout:[mon] 2023-07-06T19:57:51.859 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-07-06T19:57:51.859 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2023-07-06T19:57:51.859 INFO:teuthology.orchestra.run.smithi006.stdout: debug paxos = 20 2023-07-06T19:57:51.859 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2023-07-06T19:57:51.860 INFO:teuthology.orchestra.run.smithi006.stdout: mon data avail warn = 5 2023-07-06T19:57:51.860 INFO:teuthology.orchestra.run.smithi006.stdout: mon mgr mkfs grace = 240 2023-07-06T19:57:51.860 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2023-07-06T19:57:51.860 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd reporter subtree level = osd 2023-07-06T19:57:51.860 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd prime pg temp = true 2023-07-06T19:57:51.860 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2023-07-06T19:57:51.861 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.861 INFO:teuthology.orchestra.run.smithi006.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-06T19:57:51.861 INFO:teuthology.orchestra.run.smithi006.stdout: auth mon ticket ttl = 660 # 11m 2023-07-06T19:57:51.861 INFO:teuthology.orchestra.run.smithi006.stdout: auth service ticket ttl = 240 # 4m 2023-07-06T19:57:51.862 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.862 INFO:teuthology.orchestra.run.smithi006.stdout: # don't complain about insecure global_id in the test suite 2023-07-06T19:57:51.862 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-06T19:57:51.862 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-06T19:57:51.862 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.862 INFO:teuthology.orchestra.run.smithi006.stdout: # 1m isn't quite enough 2023-07-06T19:57:51.863 INFO:teuthology.orchestra.run.smithi006.stdout: mon_down_mkfs_grace = 2m 2023-07-06T19:57:51.863 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.863 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_filestore_osds = false 2023-07-06T19:57:51.865 INFO:teuthology.orchestra.run.smithi006.stdout: mon op complaint time = 120 2023-07-06T19:57:51.865 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:57:51.866 INFO:teuthology.orchestra.run.smithi006.stdout:[client] 2023-07-06T19:57:51.866 INFO:teuthology.orchestra.run.smithi006.stdout: rgw cache enabled = true 2023-07-06T19:57:51.866 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable ops log = true 2023-07-06T19:57:51.866 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable usage log = true 2023-07-06T19:57:51.866 INFO:teuthology.orchestra.run.smithi006.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-06T19:57:51.866 INFO:teuthology.orchestra.run.smithi006.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-06T19:57:51.867 INFO:teuthology.orchestra.run.smithi006.stdout: client mount timeout = 600 2023-07-06T19:57:51.867 INFO:teuthology.orchestra.run.smithi006.stdout: debug client = 20 2023-07-06T19:57:51.867 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-07-06T19:57:51.867 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = "" 2023-07-06T19:57:51.867 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 900 2023-07-06T19:57:51.867 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 900 2023-07-06T19:57:51.867 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.a] 2023-07-06T19:57:51.867 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.b] 2023-07-06T19:57:51.868 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.c] 2023-07-06T19:57:51.868 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2023-07-06T19:57:51.868 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2023-07-06T19:57:51.868 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2023-07-06T19:57:51.868 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d] 2023-07-06T19:57:51.868 INFO:teuthology.orchestra.run.smithi006.stdout:[mds] 2023-07-06T19:57:51.869 INFO:teuthology.orchestra.run.smithi006.stdout: debug mds = 20 2023-07-06T19:57:51.869 INFO:teuthology.orchestra.run.smithi006.stdout: debug mds balancer = 20 2023-07-06T19:57:51.869 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2023-07-06T19:57:51.869 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug frag = True 2023-07-06T19:57:51.869 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug scatterstat = True 2023-07-06T19:57:51.869 INFO:teuthology.orchestra.run.smithi006.stdout: mds op complaint time = 180 2023-07-06T19:57:51.869 INFO:teuthology.orchestra.run.smithi006.stdout: mds verify scatter = True 2023-07-06T19:57:51.869 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2023-07-06T19:57:51.870 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 900 2023-07-06T19:57:51.870 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 900 2023-07-06T19:57:51.872 INFO:teuthology.orchestra.run.smithi040.stdout:[global] 2023-07-06T19:57:51.872 INFO:teuthology.orchestra.run.smithi040.stdout: chdir = "" 2023-07-06T19:57:51.872 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-06T19:57:51.872 INFO:teuthology.orchestra.run.smithi040.stdout: auth supported = cephx 2023-07-06T19:57:51.873 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.873 INFO:teuthology.orchestra.run.smithi040.stdout: filestore xattr use omap = true 2023-07-06T19:57:51.873 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.873 INFO:teuthology.orchestra.run.smithi040.stdout: mon clock drift allowed = 1.000 2023-07-06T19:57:51.875 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.876 INFO:teuthology.orchestra.run.smithi040.stdout: osd crush chooseleaf type = 0 2023-07-06T19:57:51.876 INFO:teuthology.orchestra.run.smithi040.stdout: auth debug = true 2023-07-06T19:57:51.876 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.877 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on old message = true 2023-07-06T19:57:51.877 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on bug = true 2023-07-06T19:57:51.877 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.877 INFO:teuthology.orchestra.run.smithi040.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-06T19:57:51.878 INFO:teuthology.orchestra.run.smithi040.stdout: mon pg warn max object skew = 0 2023-07-06T19:57:51.878 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.878 INFO:teuthology.orchestra.run.smithi040.stdout: # disable pg_autoscaler by default for new pools 2023-07-06T19:57:51.878 INFO:teuthology.orchestra.run.smithi040.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-06T19:57:51.879 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.880 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default size = 2 2023-07-06T19:57:51.881 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.881 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow primary affinity = true 2023-07-06T19:57:51.882 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow pg remap = true 2023-07-06T19:57:51.882 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on legacy crush tunables = false 2023-07-06T19:57:51.882 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on crush straw calc version zero = false 2023-07-06T19:57:51.883 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on no sortbitwise = false 2023-07-06T19:57:51.883 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on osd down out interval zero = false 2023-07-06T19:57:51.883 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on too few osds = false 2023-07-06T19:57:51.884 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-06T19:57:51.884 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-06T19:57:51.884 INFO:teuthology.orchestra.run.smithi040.stdout: mon_allow_pool_size_one = true 2023-07-06T19:57:51.884 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.885 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-06T19:57:51.886 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.886 INFO:teuthology.orchestra.run.smithi040.stdout: osd default data pool replay window = 5 2023-07-06T19:57:51.886 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.886 INFO:teuthology.orchestra.run.smithi040.stdout: mon allow pool delete = true 2023-07-06T19:57:51.887 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.887 INFO:teuthology.orchestra.run.smithi040.stdout: mon cluster log file level = debug 2023-07-06T19:57:51.888 INFO:teuthology.orchestra.run.smithi040.stdout: debug asserts on shutdown = true 2023-07-06T19:57:51.888 INFO:teuthology.orchestra.run.smithi040.stdout: mon health detail to clog = false 2023-07-06T19:57:51.888 INFO:teuthology.orchestra.run.smithi040.stdout: mon host = "172.21.15.6,172.21.15.40,[v2:172.21.15.40:3301,v1:172.21.15.40:6790]" 2023-07-06T19:57:51.888 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on skipped message = False 2023-07-06T19:57:51.889 INFO:teuthology.orchestra.run.smithi040.stdout: fsid = 59b158c6-5d9d-4877-b4e7-a584e294fb2e 2023-07-06T19:57:51.889 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.892 INFO:teuthology.orchestra.run.smithi040.stdout:[osd] 2023-07-06T19:57:51.893 INFO:teuthology.orchestra.run.smithi040.stdout: osd journal size = 100 2023-07-06T19:57:51.893 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.893 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub load threshold = 5.0 2023-07-06T19:57:51.893 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub max interval = 600 2023-07-06T19:57:51.893 INFO:teuthology.orchestra.run.smithi040.stdout: osd mclock profile = high_recovery_ops 2023-07-06T19:57:51.894 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.894 INFO:teuthology.orchestra.run.smithi040.stdout: osd recover clone overlap = true 2023-07-06T19:57:51.894 INFO:teuthology.orchestra.run.smithi040.stdout: osd recovery max chunk = 1048576 2023-07-06T19:57:51.894 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.894 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug shutdown = true 2023-07-06T19:57:51.894 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug op order = true 2023-07-06T19:57:51.895 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug verify stray on activate = true 2023-07-06T19:57:51.895 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.895 INFO:teuthology.orchestra.run.smithi040.stdout: osd open classes on start = true 2023-07-06T19:57:51.895 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug pg log writeout = true 2023-07-06T19:57:51.895 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.895 INFO:teuthology.orchestra.run.smithi040.stdout: osd deep scrub update digest min age = 30 2023-07-06T19:57:51.896 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.896 INFO:teuthology.orchestra.run.smithi040.stdout: osd map max advance = 10 2023-07-06T19:57:51.896 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.897 INFO:teuthology.orchestra.run.smithi040.stdout: journal zero on create = true 2023-07-06T19:57:51.897 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.897 INFO:teuthology.orchestra.run.smithi040.stdout: filestore ondisk finisher threads = 3 2023-07-06T19:57:51.897 INFO:teuthology.orchestra.run.smithi040.stdout: filestore apply finisher threads = 3 2023-07-06T19:57:51.897 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.897 INFO:teuthology.orchestra.run.smithi040.stdout: bdev debug aio = true 2023-07-06T19:57:51.898 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug misdirected ops = true 2023-07-06T19:57:51.898 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore block size = 96636764160 2023-07-06T19:57:51.898 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore fsck on mount = True 2023-07-06T19:57:51.898 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluefs = 20 2023-07-06T19:57:51.898 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluestore = 20 2023-07-06T19:57:51.898 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-07-06T19:57:51.898 INFO:teuthology.orchestra.run.smithi040.stdout: debug osd = 20 2023-07-06T19:57:51.898 INFO:teuthology.orchestra.run.smithi040.stdout: debug rocksdb = 10 2023-07-06T19:57:51.899 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd backfillfull_ratio = 0.85 2023-07-06T19:57:51.899 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd full ratio = 0.9 2023-07-06T19:57:51.899 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd nearfull ratio = 0.8 2023-07-06T19:57:51.899 INFO:teuthology.orchestra.run.smithi040.stdout: osd failsafe full ratio = 0.95 2023-07-06T19:57:51.899 INFO:teuthology.orchestra.run.smithi040.stdout: osd objectstore = bluestore 2023-07-06T19:57:51.899 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2023-07-06T19:57:51.899 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.899 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr] 2023-07-06T19:57:51.900 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-07-06T19:57:51.900 INFO:teuthology.orchestra.run.smithi040.stdout: debug mgr = 20 2023-07-06T19:57:51.901 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2023-07-06T19:57:51.901 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2023-07-06T19:57:51.901 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2023-07-06T19:57:51.902 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2023-07-06T19:57:51.902 INFO:teuthology.orchestra.run.smithi040.stdout: mgr/telemetry/nag = false 2023-07-06T19:57:51.902 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.903 INFO:teuthology.orchestra.run.smithi040.stdout:[mon] 2023-07-06T19:57:51.903 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-07-06T19:57:51.903 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2023-07-06T19:57:51.903 INFO:teuthology.orchestra.run.smithi040.stdout: debug paxos = 20 2023-07-06T19:57:51.903 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2023-07-06T19:57:51.903 INFO:teuthology.orchestra.run.smithi040.stdout: mon data avail warn = 5 2023-07-06T19:57:51.903 INFO:teuthology.orchestra.run.smithi040.stdout: mon mgr mkfs grace = 240 2023-07-06T19:57:51.904 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2023-07-06T19:57:51.904 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd reporter subtree level = osd 2023-07-06T19:57:51.904 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd prime pg temp = true 2023-07-06T19:57:51.904 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2023-07-06T19:57:51.904 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.904 INFO:teuthology.orchestra.run.smithi040.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-06T19:57:51.904 INFO:teuthology.orchestra.run.smithi040.stdout: auth mon ticket ttl = 660 # 11m 2023-07-06T19:57:51.904 INFO:teuthology.orchestra.run.smithi040.stdout: auth service ticket ttl = 240 # 4m 2023-07-06T19:57:51.905 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.905 INFO:teuthology.orchestra.run.smithi040.stdout: # don't complain about insecure global_id in the test suite 2023-07-06T19:57:51.905 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-06T19:57:51.905 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-06T19:57:51.905 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.905 INFO:teuthology.orchestra.run.smithi040.stdout: # 1m isn't quite enough 2023-07-06T19:57:51.905 INFO:teuthology.orchestra.run.smithi040.stdout: mon_down_mkfs_grace = 2m 2023-07-06T19:57:51.905 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.906 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_filestore_osds = false 2023-07-06T19:57:51.906 INFO:teuthology.orchestra.run.smithi040.stdout: mon op complaint time = 120 2023-07-06T19:57:51.906 INFO:teuthology.orchestra.run.smithi040.stdout: 2023-07-06T19:57:51.906 INFO:teuthology.orchestra.run.smithi040.stdout:[client] 2023-07-06T19:57:51.906 INFO:teuthology.orchestra.run.smithi040.stdout: rgw cache enabled = true 2023-07-06T19:57:51.906 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable ops log = true 2023-07-06T19:57:51.907 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable usage log = true 2023-07-06T19:57:51.908 INFO:teuthology.orchestra.run.smithi040.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-06T19:57:51.908 INFO:teuthology.orchestra.run.smithi040.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-06T19:57:51.908 INFO:teuthology.orchestra.run.smithi040.stdout: client mount timeout = 600 2023-07-06T19:57:51.908 INFO:teuthology.orchestra.run.smithi040.stdout: debug client = 20 2023-07-06T19:57:51.909 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-07-06T19:57:51.909 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = "" 2023-07-06T19:57:51.910 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2023-07-06T19:57:51.910 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2023-07-06T19:57:51.910 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.a] 2023-07-06T19:57:51.910 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.b] 2023-07-06T19:57:51.910 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.c] 2023-07-06T19:57:51.910 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2023-07-06T19:57:51.911 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2023-07-06T19:57:51.911 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2023-07-06T19:57:51.911 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2023-07-06T19:57:51.911 INFO:teuthology.orchestra.run.smithi040.stdout:[mds] 2023-07-06T19:57:51.911 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds = 20 2023-07-06T19:57:51.911 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds balancer = 20 2023-07-06T19:57:51.911 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2023-07-06T19:57:51.911 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug frag = True 2023-07-06T19:57:51.912 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug scatterstat = True 2023-07-06T19:57:51.924 INFO:teuthology.orchestra.run.smithi040.stdout: mds op complaint time = 180 2023-07-06T19:57:51.925 INFO:teuthology.orchestra.run.smithi040.stdout: mds verify scatter = True 2023-07-06T19:57:51.925 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2023-07-06T19:57:51.925 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2023-07-06T19:57:51.926 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2023-07-06T19:57:51.926 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-06T19:57:51.926 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-06T19:57:51.993 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-06T19:57:51.993 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:57:51.994 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-06T19:57:52.013 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:57:52.014 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-06T19:57:52.073 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi006.front.sepia.ceph.com 2023-07-06T19:57:52.074 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:57:52.074 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-06T19:57:52.074 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-06T19:57:52.155 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:57:52.155 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-06T19:57:52.214 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi040.front.sepia.ceph.com 2023-07-06T19:57:52.215 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:57:52.215 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-06T19:57:52.216 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-06T19:57:52.278 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:57:52.279 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-06T19:57:52.345 INFO:tasks.ceph:Setting up mon nodes... 2023-07-06T19:57:52.346 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-06T19:57:52.346 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-06T19:57:52.410 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-06T19:57:52.410 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-06T19:57:52.488 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-06T19:57:52.496 INFO:tasks.ceph:Setting up mds nodes... 2023-07-06T19:57:52.510 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-06T19:57:52.566 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-06T19:57:52.577 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-06T19:57:52.607 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-06T19:57:52.704 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-06T19:57:52.710 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-06T19:57:52.742 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-06T19:57:52.809 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-06T19:57:52.812 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-06T19:57:52.841 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-06T19:57:52.942 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-06T19:57:52.945 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-06T19:57:52.974 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-06T19:57:52.975 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-06T19:57:53.024 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-06T19:57:53.039 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-07-06T19:57:53.088 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-07-06T19:57:53.099 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-07-06T19:57:53.151 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-07-06T19:57:53.160 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-07-06T19:57:53.244 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-07-06T19:57:53.258 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-06T19:57:53.258 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-06T19:57:53.258 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-06T19:57:53.293 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-06T19:57:53.294 INFO:tasks.ceph:role: osd.0 2023-07-06T19:57:53.294 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com 2023-07-06T19:57:53.294 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-06T19:57:53.369 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-06T19:57:53.370 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-06T19:57:53.370 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-06T19:57:53.370 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-06T19:57:53.370 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-06T19:57:53.370 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-07-06T19:57:53.370 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-06T19:57:53.371 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-06T19:57:53.371 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-06T19:57:53.371 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-06T19:57:53.811 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-07-06T19:57:53.814 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-07-06T19:57:53.814 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-06T19:57:53.998 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-06T19:57:54.041 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-06T19:57:54.112 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-06T19:57:54.112 INFO:tasks.ceph:role: osd.1 2023-07-06T19:57:54.113 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com 2023-07-06T19:57:54.114 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-06T19:57:54.200 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-06T19:57:54.201 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-06T19:57:54.201 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-06T19:57:54.201 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-06T19:57:54.201 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-06T19:57:54.202 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-07-06T19:57:54.202 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-06T19:57:54.202 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-06T19:57:54.202 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-06T19:57:54.203 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-06T19:57:54.603 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-07-06T19:57:54.605 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-07-06T19:57:54.606 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-06T19:57:54.719 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-06T19:57:54.755 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-06T19:57:54.823 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-06T19:57:54.824 INFO:tasks.ceph:role: osd.2 2023-07-06T19:57:54.826 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com 2023-07-06T19:57:54.827 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-06T19:57:54.899 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-06T19:57:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-06T19:57:54.899 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-06T19:57:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-06T19:57:54.900 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-06T19:57:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-07-06T19:57:54.900 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-06T19:57:54.900 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-06T19:57:54.900 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-06T19:57:54.900 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-06T19:57:55.349 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-07-06T19:57:55.351 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-07-06T19:57:55.352 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-06T19:57:55.520 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-06T19:57:55.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-06T19:57:55.631 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-06T19:57:55.631 INFO:tasks.ceph:role: osd.3 2023-07-06T19:57:55.631 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com 2023-07-06T19:57:55.632 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-06T19:57:55.713 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-06T19:57:55.713 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-06T19:57:55.713 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-06T19:57:55.714 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-06T19:57:55.714 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-06T19:57:55.714 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2023-07-06T19:57:55.714 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-06T19:57:55.714 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-06T19:57:55.714 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-06T19:57:55.714 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-06T19:57:56.134 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2023-07-06T19:57:56.137 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2023-07-06T19:57:56.138 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-06T19:57:56.305 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-06T19:57:56.344 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-06T19:57:56.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:57:56.446+0000 7f65e359c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-06T19:57:56.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:57:56.446+0000 7f65e359c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-06T19:57:56.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:57:56.446+0000 7f65e359c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-06T19:57:56.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:57:56.446+0000 7f65e359c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-06T19:57:56.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:57:56.446+0000 7f65e359c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-06T19:57:56.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:57:56.446+0000 7f65e359c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-06T19:57:59.319 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-06T19:57:59.355 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-06T19:57:59.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:57:59.448+0000 7f27e0473640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-06T19:57:59.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:57:59.448+0000 7f27e0473640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-06T19:57:59.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:57:59.448+0000 7f27e0473640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-06T19:57:59.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:57:59.448+0000 7f27e0473640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-06T19:57:59.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:57:59.448+0000 7f27e0473640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-06T19:57:59.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:57:59.448+0000 7f27e0473640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-06T19:58:02.314 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-06T19:58:02.353 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-06T19:58:02.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:02.449+0000 7f27ecc75640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-06T19:58:02.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:02.449+0000 7f27ecc75640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-06T19:58:02.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:02.449+0000 7f27ecc75640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-06T19:58:02.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:02.449+0000 7f27ecc75640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-06T19:58:02.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:02.449+0000 7f27ecc75640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-06T19:58:02.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:02.449+0000 7f27ecc75640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-06T19:58:05.319 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-06T19:58:05.361 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-06T19:58:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:05.453+0000 7f5822634640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-06T19:58:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:05.453+0000 7f5822634640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-06T19:58:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:05.453+0000 7f5822634640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-06T19:58:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:05.453+0000 7f5822634640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-06T19:58:05.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:05.453+0000 7f5822634640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-06T19:58:05.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:05.454+0000 7f5822634640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-06T19:58:08.318 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-06T19:58:08.351 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-06T19:58:08.390 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-06T19:58:08.390 INFO:tasks.ceph:role: osd.4 2023-07-06T19:58:08.391 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com 2023-07-06T19:58:08.392 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-06T19:58:08.475 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-06T19:58:08.475 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-06T19:58:08.475 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-06T19:58:08.475 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-06T19:58:08.476 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-06T19:58:08.476 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-07-06T19:58:08.476 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-06T19:58:08.476 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-06T19:58:08.476 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-06T19:58:08.476 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-06T19:58:08.905 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-07-06T19:58:08.911 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-07-06T19:58:08.912 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-06T19:58:09.105 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-06T19:58:09.145 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-06T19:58:09.226 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-06T19:58:09.226 INFO:tasks.ceph:role: osd.5 2023-07-06T19:58:09.227 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com 2023-07-06T19:58:09.227 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-06T19:58:09.311 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-06T19:58:09.311 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-06T19:58:09.311 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-06T19:58:09.311 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-06T19:58:09.311 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-06T19:58:09.312 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-07-06T19:58:09.312 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-06T19:58:09.312 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-06T19:58:09.312 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-06T19:58:09.312 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-06T19:58:09.719 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-07-06T19:58:09.719 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-07-06T19:58:09.720 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-06T19:58:09.848 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-06T19:58:09.891 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-06T19:58:09.962 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-06T19:58:09.962 INFO:tasks.ceph:role: osd.6 2023-07-06T19:58:09.963 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com 2023-07-06T19:58:09.963 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-06T19:58:10.051 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-06T19:58:10.052 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-06T19:58:10.053 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-06T19:58:10.053 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-06T19:58:10.054 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-06T19:58:10.054 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-07-06T19:58:10.054 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-06T19:58:10.054 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-06T19:58:10.054 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-06T19:58:10.054 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-06T19:58:10.493 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-07-06T19:58:10.494 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-07-06T19:58:10.494 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-06T19:58:10.673 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-06T19:58:10.721 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-06T19:58:10.793 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-06T19:58:10.794 INFO:tasks.ceph:role: osd.7 2023-07-06T19:58:10.794 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com 2023-07-06T19:58:10.794 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-06T19:58:10.873 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-06T19:58:10.873 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-06T19:58:10.873 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-06T19:58:10.873 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-06T19:58:10.874 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-06T19:58:10.874 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2023-07-06T19:58:10.874 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-06T19:58:10.874 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-06T19:58:10.874 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-06T19:58:10.874 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-06T19:58:11.307 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2023-07-06T19:58:11.309 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2023-07-06T19:58:11.309 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-06T19:58:11.456 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-06T19:58:11.496 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-06T19:58:11.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:11.599+0000 7f427915f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-06T19:58:11.602 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:11.600+0000 7f427915f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-06T19:58:11.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:11.600+0000 7f427915f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-06T19:58:11.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:11.600+0000 7f427915f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-06T19:58:11.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:11.600+0000 7f427915f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-06T19:58:11.604 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:11.600+0000 7f427915f640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-06T19:58:14.477 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-06T19:58:14.512 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-06T19:58:14.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:14.604+0000 7fe2cba2b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-06T19:58:14.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:14.604+0000 7fe2cba2b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-06T19:58:14.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:14.604+0000 7fe2cba2b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-06T19:58:14.613 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:14.604+0000 7fe2cba2b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-06T19:58:14.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:14.604+0000 7fe2cba2b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-06T19:58:14.614 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:14.605+0000 7fe2cba2b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-06T19:58:17.474 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-06T19:58:17.518 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-06T19:58:17.620 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:17.616+0000 7f58e2f75640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-06T19:58:17.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:17.616+0000 7f58e2f75640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-06T19:58:17.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:17.616+0000 7f58e2f75640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-06T19:58:17.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:17.616+0000 7f58e2f75640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-06T19:58:17.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:17.616+0000 7f58e2f75640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-06T19:58:17.621 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:17.616+0000 7f58e2f75640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-06T19:58:19.545 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T19:58:19.559 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T19:58:20.485 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-06T19:58:20.518 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-06T19:58:20.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:20.612+0000 7fa4eaf9d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-06T19:58:20.615 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:20.613+0000 7fa4eaf9d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-06T19:58:20.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:20.613+0000 7fa4eaf9d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-06T19:58:20.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:20.613+0000 7fa4eaf9d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-06T19:58:20.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:20.613+0000 7fa4eaf9d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-06T19:58:20.616 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:20.613+0000 7fa4eaf9d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-06T19:58:23.486 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-06T19:58:23.523 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-06T19:58:23.523 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:58:23.523 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-06T19:58:23.558 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:58:23.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-06T19:58:23.630 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:58:23.630 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-06T19:58:23.701 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:58:23.701 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-06T19:58:23.770 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:58:23.771 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-06T19:58:23.845 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:58:23.845 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-06T19:58:23.918 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:58:23.918 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-06T19:58:23.993 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:58:23.998 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-06T19:58:24.035 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:58:24.036 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-06T19:58:24.109 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:58:24.110 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-06T19:58:24.184 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:58:24.185 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-06T19:58:24.254 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:58:24.255 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-06T19:58:24.324 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:58:24.325 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-06T19:58:24.394 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:58:24.395 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-06T19:58:24.465 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:58:24.465 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-06T19:58:24.486 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:58:24.487 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-07-06T19:58:24.548 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:58:24.549 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-07-06T19:58:24.574 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:58:24.575 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-07-06T19:58:24.634 INFO:tasks.ceph:Adding keys to all mons... 2023-07-06T19:58:24.634 DEBUG:teuthology.orchestra.run.smithi006:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-06T19:58:24.637 DEBUG:teuthology.orchestra.run.smithi040:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-06T19:58:24.678 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.y] 2023-07-06T19:58:24.679 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDAHKdk+3U0GBAAPM2LAiDbSVzWfPSd8vGgKQ== 2023-07-06T19:58:24.679 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2023-07-06T19:58:24.679 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDAHKdksmW6IRAA1wpPcBfPPnSPVrOGM8phDw== 2023-07-06T19:58:24.679 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2023-07-06T19:58:24.679 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDAHKdkWXHyKRAA3zOwSTVGKmxpJOCHRHAMDA== 2023-07-06T19:58:24.679 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.0] 2023-07-06T19:58:24.680 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDEHKdk1SWpGhAAKPRMRysEPLCV7tO8xaOI4Q== 2023-07-06T19:58:24.680 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.1] 2023-07-06T19:58:24.680 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDHHKdkGDnHGhAAoDBqJ7rzR/dxt0jiKrTdtA== 2023-07-06T19:58:24.680 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.2] 2023-07-06T19:58:24.680 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDKHKdkoqPWGhAARxj6y09apY8nGbqXccrmWQ== 2023-07-06T19:58:24.680 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.3] 2023-07-06T19:58:24.680 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDNHKdkBlIaGxAA0sbdgcKC/BGyGLawfFRONA== 2023-07-06T19:58:24.681 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.x] 2023-07-06T19:58:24.681 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDAHKdkMUMNHRAAdLYbojZBse//EvXWHTdnYw== 2023-07-06T19:58:24.681 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2023-07-06T19:58:24.681 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDAHKdkQl02MBAADc2npiCo5orpGdCLgMUPtQ== 2023-07-06T19:58:24.681 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d] 2023-07-06T19:58:24.681 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDAHKdk/4EhOBAAHJKIMjc5xn/tQ92FJtZ1eA== 2023-07-06T19:58:24.681 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.4] 2023-07-06T19:58:24.682 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDTHKdk2vXWIxAADeugUMANdLamwYvIJrkwpQ== 2023-07-06T19:58:24.682 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.5] 2023-07-06T19:58:24.682 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDWHKdkP74dJBAANpSaeygPL+DdajPYDJ363g== 2023-07-06T19:58:24.682 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.6] 2023-07-06T19:58:24.684 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDZHKdkIAjPJBAAxxOF8OFO2XJ7BC2UTmvIaw== 2023-07-06T19:58:24.685 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.7] 2023-07-06T19:58:24.685 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDcHKdk8FydJBAAQsy28Viyo3sJCz9IlFzJ3w== 2023-07-06T19:58:24.685 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-07-06T19:58:24.685 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDBHKdk4UdrARAA1/eBBdDGSoFnlxWcwFTAdQ== 2023-07-06T19:58:24.685 INFO:teuthology.orchestra.run.smithi006.stdout:[client.2] 2023-07-06T19:58:24.685 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDBHKdk7QgEBRAAGHbS9wFnBD0lUMZcuSDA4A== 2023-07-06T19:58:24.686 INFO:teuthology.orchestra.run.smithi006.stdout:[client.1] 2023-07-06T19:58:24.687 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDBHKdkHUetCBAAuCz5Qk36bN1LhUpNlmQ/Yg== 2023-07-06T19:58:24.689 INFO:teuthology.orchestra.run.smithi006.stdout:[client.3] 2023-07-06T19:58:24.689 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDBHKdk4VWLDhAAmbWoeVhV7XpS9uVlYOFOlw== 2023-07-06T19:58:24.702 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.y] 2023-07-06T19:58:24.702 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDAHKdk+3U0GBAAPM2LAiDbSVzWfPSd8vGgKQ== 2023-07-06T19:58:24.702 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2023-07-06T19:58:24.703 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDAHKdksmW6IRAA1wpPcBfPPnSPVrOGM8phDw== 2023-07-06T19:58:24.703 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2023-07-06T19:58:24.703 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDAHKdkWXHyKRAA3zOwSTVGKmxpJOCHRHAMDA== 2023-07-06T19:58:24.703 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.0] 2023-07-06T19:58:24.703 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDEHKdk1SWpGhAAKPRMRysEPLCV7tO8xaOI4Q== 2023-07-06T19:58:24.703 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.1] 2023-07-06T19:58:24.703 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDHHKdkGDnHGhAAoDBqJ7rzR/dxt0jiKrTdtA== 2023-07-06T19:58:24.703 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.2] 2023-07-06T19:58:24.704 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDKHKdkoqPWGhAARxj6y09apY8nGbqXccrmWQ== 2023-07-06T19:58:24.704 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.3] 2023-07-06T19:58:24.704 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDNHKdkBlIaGxAA0sbdgcKC/BGyGLawfFRONA== 2023-07-06T19:58:24.704 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.x] 2023-07-06T19:58:24.704 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDAHKdkMUMNHRAAdLYbojZBse//EvXWHTdnYw== 2023-07-06T19:58:24.704 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2023-07-06T19:58:24.704 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDAHKdkQl02MBAADc2npiCo5orpGdCLgMUPtQ== 2023-07-06T19:58:24.705 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2023-07-06T19:58:24.705 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDAHKdk/4EhOBAAHJKIMjc5xn/tQ92FJtZ1eA== 2023-07-06T19:58:24.705 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.4] 2023-07-06T19:58:24.705 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDTHKdk2vXWIxAADeugUMANdLamwYvIJrkwpQ== 2023-07-06T19:58:24.716 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.5] 2023-07-06T19:58:24.716 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDWHKdkP74dJBAANpSaeygPL+DdajPYDJ363g== 2023-07-06T19:58:24.716 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.6] 2023-07-06T19:58:24.717 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDZHKdkIAjPJBAAxxOF8OFO2XJ7BC2UTmvIaw== 2023-07-06T19:58:24.717 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.7] 2023-07-06T19:58:24.717 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDcHKdk8FydJBAAQsy28Viyo3sJCz9IlFzJ3w== 2023-07-06T19:58:24.717 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2023-07-06T19:58:24.717 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDBHKdk4UdrARAA1/eBBdDGSoFnlxWcwFTAdQ== 2023-07-06T19:58:24.717 INFO:teuthology.orchestra.run.smithi040.stdout:[client.2] 2023-07-06T19:58:24.718 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDBHKdk7QgEBRAAGHbS9wFnBD0lUMZcuSDA4A== 2023-07-06T19:58:24.718 INFO:teuthology.orchestra.run.smithi040.stdout:[client.1] 2023-07-06T19:58:24.718 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDBHKdkHUetCBAAuCz5Qk36bN1LhUpNlmQ/Yg== 2023-07-06T19:58:24.719 INFO:teuthology.orchestra.run.smithi040.stdout:[client.3] 2023-07-06T19:58:24.719 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQDBHKdk4VWLDhAAmbWoeVhV7XpS9uVlYOFOlw== 2023-07-06T19:58:24.721 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-06T19:58:24.738 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-06T19:58:24.818 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-06T19:58:24.821 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-06T19:58:24.883 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-06T19:58:24.889 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-06T19:58:24.946 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T19:58:24.961 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T19:58:25.020 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T19:58:25.027 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T19:58:25.083 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T19:58:25.088 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T19:58:25.146 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T19:58:25.152 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T19:58:25.206 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-06T19:58:25.210 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-06T19:58:25.269 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-06T19:58:25.272 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-06T19:58:25.333 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-06T19:58:25.355 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-06T19:58:25.414 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T19:58:25.417 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T19:58:25.478 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T19:58:25.485 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T19:58:25.552 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T19:58:25.555 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T19:58:25.613 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T19:58:25.617 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-06T19:58:25.711 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-06T19:58:25.721 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-06T19:58:25.779 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-06T19:58:25.783 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-06T19:58:25.842 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-06T19:58:25.849 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-06T19:58:25.909 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-06T19:58:25.922 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-06T19:58:25.988 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-06T19:58:25.993 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-06T19:58:26.022 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-06T19:58:26.123 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-06T19:58:26.165 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-06T19:58:26.202 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-06T19:58:26.302 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-06T19:58:26.330 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-06T19:58:26.399 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-06T19:58:26.501 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-06T19:58:26.529 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-06T19:58:26.532 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-06T19:58:26.591 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-06T19:58:26.592 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-06T19:58:26.593 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-06T19:58:26.599 INFO:tasks.ceph.mon.a:Started 2023-07-06T19:58:26.600 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-06T19:58:26.600 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-06T19:58:26.637 INFO:tasks.ceph.mon.b:Started 2023-07-06T19:58:26.637 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-06T19:58:26.638 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-06T19:58:26.641 INFO:tasks.ceph.mon.c:Started 2023-07-06T19:58:26.641 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-06T19:58:26.641 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-06T19:58:26.642 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-06T19:58:26.644 INFO:tasks.ceph.mgr.y:Started 2023-07-06T19:58:26.645 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-06T19:58:26.646 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-06T19:58:26.654 INFO:tasks.ceph.mgr.x:Started 2023-07-06T19:58:26.654 INFO:tasks.ceph:Setting crush tunables to default 2023-07-06T19:58:26.654 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd crush tunables default 2023-07-06T19:58:26.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.780+0000 7f2cb8c7e700 1 Processor -- start 2023-07-06T19:58:26.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.780+0000 7f2cb8c7e700 1 -- start start 2023-07-06T19:58:26.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.781+0000 7f2cb8c7e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cb40aef10 0x7f2cb415b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:26.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.781+0000 7f2cb8c7e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2cb4071da0 0x7f2cb415e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:26.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.781+0000 7f2cb8c7e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb415e890 con 0x7f2cb415de10 2023-07-06T19:58:26.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.781+0000 7f2cb8c7e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb4151750 con 0x7f2cb4071da0 2023-07-06T19:58:26.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.781+0000 7f2cb8c7e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb415eb70 con 0x7f2cb40aef10 2023-07-06T19:58:26.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.781+0000 7f2cb1d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2cb415de10 0x7f2cb4071690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58876/0 (socket says 172.21.15.6:58876) 2023-07-06T19:58:26.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.781+0000 7f2cb1d9b700 1 -- 172.21.15.6:0/620756139 learned_addr learned my addr 172.21.15.6:0/620756139 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:58:26.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.781+0000 7f2cb259c700 1 --2- 172.21.15.6:0/620756139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cb40aef10 0x7f2cb415b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:26.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.781+0000 7f2cb2d9d700 1 --2- 172.21.15.6:0/620756139 >> v2:172.21.15.40:3300/0 conn(0x7f2cb4071da0 0x7f2cb415e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:26.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.782+0000 7f2cb259c700 1 -- 172.21.15.6:0/620756139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cb40aef10 msgr2=0x7f2cb415b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-06T19:58:26.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.782+0000 7f2cb259c700 1 -- 172.21.15.6:0/620756139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cb40aef10 msgr2=0x7f2cb415b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-06T19:58:26.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.782+0000 7f2cb259c700 1 --2- 172.21.15.6:0/620756139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cb40aef10 0x7f2cb415b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-06T19:58:26.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.782+0000 7f2cb259c700 1 --2- 172.21.15.6:0/620756139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cb40aef10 0x7f2cb415b370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T19:58:26.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.782+0000 7f2cb2d9d700 1 -- 172.21.15.6:0/620756139 >> v2:172.21.15.40:3300/0 conn(0x7f2cb4071da0 msgr2=0x7f2cb415e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-06T19:58:26.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.782+0000 7f2cb2d9d700 1 -- 172.21.15.6:0/620756139 >> v2:172.21.15.40:3300/0 conn(0x7f2cb4071da0 msgr2=0x7f2cb415e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-06T19:58:26.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.782+0000 7f2cb2d9d700 1 --2- 172.21.15.6:0/620756139 >> v2:172.21.15.40:3300/0 conn(0x7f2cb4071da0 0x7f2cb415e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-06T19:58:26.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.782+0000 7f2cb2d9d700 1 --2- 172.21.15.6:0/620756139 >> v2:172.21.15.40:3300/0 conn(0x7f2cb4071da0 0x7f2cb415e280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-06T19:58:26.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.958+0000 7f2cb159a700 1 -- 172.21.15.6:0/620756139 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1769920184 0 0) 0x7f2cb415e890 con 0x7f2cb415de10 2023-07-06T19:58:26.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.958+0000 7f2cb159a700 1 -- 172.21.15.6:0/620756139 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ca00035b0 con 0x7f2cb415de10 2023-07-06T19:58:26.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.959+0000 7f2cb159a700 1 -- 172.21.15.6:0/620756139 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3189092729 0 0) 0x7f2ca00035b0 con 0x7f2cb415de10 2023-07-06T19:58:26.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.959+0000 7f2cb159a700 1 -- 172.21.15.6:0/620756139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cb40aef10 msgr2=0x7f2cb415b370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-06T19:58:26.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.959+0000 7f2cb159a700 1 --2- 172.21.15.6:0/620756139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cb40aef10 0x7f2cb415b370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:26.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.959+0000 7f2cb159a700 1 -- 172.21.15.6:0/620756139 >> v2:172.21.15.40:3300/0 conn(0x7f2cb4071da0 msgr2=0x7f2cb415e280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-06T19:58:26.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.959+0000 7f2cb159a700 1 --2- 172.21.15.6:0/620756139 >> v2:172.21.15.40:3300/0 conn(0x7f2cb4071da0 0x7f2cb415e280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:26.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.959+0000 7f2cb159a700 1 -- 172.21.15.6:0/620756139 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb415ab70 con 0x7f2cb415de10 2023-07-06T19:58:26.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.959+0000 7f2cb159a700 1 -- 172.21.15.6:0/620756139 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f2c9c001670 con 0x7f2cb415de10 2023-07-06T19:58:26.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.959+0000 7f2cb159a700 1 -- 172.21.15.6:0/620756139 >> v1:172.21.15.6:6789/0 conn(0x7f2cb415de10 legacy=0x7f2cb4071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:26.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.959+0000 7f2cb159a700 1 --2- 172.21.15.6:0/620756139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ca0003a00 0x7f2ca0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:26.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.959+0000 7f2cb159a700 1 --2- 172.21.15.6:0/620756139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cb40aef10 0x7f2ca0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:26.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.959+0000 7f2cb159a700 1 --2- 172.21.15.6:0/620756139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ca0004d90 0x7f2ca0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:26.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.959+0000 7f2cb159a700 1 -- 172.21.15.6:0/620756139 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb4151750 con 0x7f2ca0003a00 2023-07-06T19:58:26.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.959+0000 7f2cb159a700 1 -- 172.21.15.6:0/620756139 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb415eb70 con 0x7f2ca0004d90 2023-07-06T19:58:26.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.959+0000 7f2cb159a700 1 -- 172.21.15.6:0/620756139 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca000fed0 con 0x7f2cb40aef10 2023-07-06T19:58:26.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.959+0000 7f2cb259c700 1 --2- 172.21.15.6:0/620756139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ca0003a00 0x7f2ca0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:26.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.960+0000 7f2cb2d9d700 1 --2- 172.21.15.6:0/620756139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ca0004d90 0x7f2ca0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:26.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.960+0000 7f2cb1d9b700 1 --2- 172.21.15.6:0/620756139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cb40aef10 0x7f2ca0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:26.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.960+0000 7f2cb259c700 1 -- 172.21.15.6:0/620756139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cb40aef10 msgr2=0x7f2ca0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:26.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.960+0000 7f2cb259c700 1 --2- 172.21.15.6:0/620756139 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2cb40aef10 0x7f2ca0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:26.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.960+0000 7f2cb259c700 1 -- 172.21.15.6:0/620756139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ca0004d90 msgr2=0x7f2ca0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:26.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.960+0000 7f2cb259c700 1 --2- 172.21.15.6:0/620756139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ca0004d90 0x7f2ca0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:26.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.960+0000 7f2cb259c700 1 -- 172.21.15.6:0/620756139 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca00035b0 con 0x7f2ca0003a00 2023-07-06T19:58:26.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.960+0000 7f2cb2d9d700 1 --2- 172.21.15.6:0/620756139 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2ca0004d90 0x7f2ca0005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:58:26.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.960+0000 7f2cb259c700 1 --2- 172.21.15.6:0/620756139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ca0003a00 0x7f2ca0003e10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4009fd0 tx=0x7f2ca0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403f22c4e10be2cc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:26.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.960+0000 7f2cb159a700 1 -- 172.21.15.6:0/620756139 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4007e20 con 0x7f2ca0003a00 2023-07-06T19:58:26.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.960+0000 7f2cb159a700 1 -- 172.21.15.6:0/620756139 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca4003a20 con 0x7f2ca0003a00 2023-07-06T19:58:26.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.960+0000 7f2cb159a700 1 -- 172.21.15.6:0/620756139 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4003dd0 con 0x7f2ca0003a00 2023-07-06T19:58:26.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.961+0000 7f2cb8c7e700 1 -- 172.21.15.6:0/620756139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ca0003a00 msgr2=0x7f2ca0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:26.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.961+0000 7f2cb8c7e700 1 --2- 172.21.15.6:0/620756139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ca0003a00 0x7f2ca0003e10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4009fd0 tx=0x7f2ca0005880 comp rx=0 tx=0).stop 2023-07-06T19:58:26.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.961+0000 7f2cb2d9d700 1 -- 172.21.15.6:0/620756139 reap_dead start 2023-07-06T19:58:26.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.961+0000 7f2cb8c7e700 1 -- 172.21.15.6:0/620756139 shutdown_connections 2023-07-06T19:58:26.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.961+0000 7f2cb8c7e700 1 -- 172.21.15.6:0/620756139 >> 172.21.15.6:0/620756139 conn(0x7f2cb40cf960 msgr2=0x7f2cb40cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:26.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.961+0000 7f2cb8c7e700 1 -- 172.21.15.6:0/620756139 shutdown_connections 2023-07-06T19:58:26.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.962+0000 7f2cb8c7e700 1 -- 172.21.15.6:0/620756139 wait complete. 2023-07-06T19:58:26.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.963+0000 7f2cb8c7e700 1 Processor -- start 2023-07-06T19:58:26.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.963+0000 7f2cb8c7e700 1 -- start start 2023-07-06T19:58:26.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.964+0000 7f2cb8c7e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ca0003a00 0x7f2cb40c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:26.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.964+0000 7f2cb8c7e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb414b8d0 0x7f2cb414b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:26.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.964+0000 7f2cb8c7e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cb415bc10 0x7f2cb414f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:26.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.964+0000 7f2cb8c7e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb415b7f0 con 0x7f2cb414b8d0 2023-07-06T19:58:26.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.964+0000 7f2cb8c7e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb40c8420 con 0x7f2cb415bc10 2023-07-06T19:58:27.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.964+0000 7f2cb8c7e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb414b610 con 0x7f2ca0003a00 2023-07-06T19:58:27.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.964+0000 7f2cb1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb414b8d0 0x7f2cb414b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:27.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.965+0000 7f2cb1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb414b8d0 0x7f2cb414b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57698/0 (socket says 172.21.15.6:57698) 2023-07-06T19:58:27.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.965+0000 7f2cb2d9d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cb415bc10 0x7f2cb414f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:27.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.965+0000 7f2cb1d9b700 1 -- 172.21.15.6:0/1841653229 learned_addr learned my addr 172.21.15.6:0/1841653229 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:27.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.965+0000 7f2cb259c700 1 --2- 172.21.15.6:0/1841653229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ca0003a00 0x7f2cb40c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:27.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.965+0000 7f2cb1d9b700 1 -- 172.21.15.6:0/1841653229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ca0003a00 msgr2=0x7f2cb40c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:27.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.965+0000 7f2cb1d9b700 1 --2- 172.21.15.6:0/1841653229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ca0003a00 0x7f2cb40c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:27.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.965+0000 7f2cb1d9b700 1 -- 172.21.15.6:0/1841653229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cb415bc10 msgr2=0x7f2cb414f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:27.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.965+0000 7f2cb1d9b700 1 --2- 172.21.15.6:0/1841653229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cb415bc10 0x7f2cb414f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:27.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.965+0000 7f2cb1d9b700 1 -- 172.21.15.6:0/1841653229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb40c86f0 con 0x7f2cb414b8d0 2023-07-06T19:58:27.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.965+0000 7f2cb2d9d700 1 --2- 172.21.15.6:0/1841653229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cb415bc10 0x7f2cb414f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:58:27.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.965+0000 7f2cb1d9b700 1 --2- 172.21.15.6:0/1841653229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb414b8d0 0x7f2cb414b0d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c0072c0 tx=0x7f2c9c0075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:27.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.965+0000 7f2caaffd700 1 -- 172.21.15.6:0/1841653229 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c00f660 con 0x7f2cb414b8d0 2023-07-06T19:58:27.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.965+0000 7f2caaffd700 1 -- 172.21.15.6:0/1841653229 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9c00f7c0 con 0x7f2cb414b8d0 2023-07-06T19:58:27.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.965+0000 7f2caaffd700 1 -- 172.21.15.6:0/1841653229 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c00fb70 con 0x7f2cb414b8d0 2023-07-06T19:58:27.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.965+0000 7f2cb8c7e700 1 -- 172.21.15.6:0/1841653229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb40c89d0 con 0x7f2cb414b8d0 2023-07-06T19:58:27.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.965+0000 7f2cb8c7e700 1 -- 172.21.15.6:0/1841653229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb415b410 con 0x7f2cb414b8d0 2023-07-06T19:58:27.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.966+0000 7f2caaffd700 1 -- 172.21.15.6:0/1841653229 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2c9c01d460 con 0x7f2cb414b8d0 2023-07-06T19:58:27.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.966+0000 7f2caaffd700 1 -- 172.21.15.6:0/1841653229 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2c9c0135f0 con 0x7f2cb414b8d0 2023-07-06T19:58:27.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.966+0000 7f2cb8c7e700 1 -- 172.21.15.6:0/1841653229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb415b930 con 0x7f2cb414b8d0 2023-07-06T19:58:27.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:26.969+0000 7f2caaffd700 1 -- 172.21.15.6:0/1841653229 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f2cb415b930 con 0x7f2cb414b8d0 2023-07-06T19:58:27.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:27.046+0000 7f2cb8c7e700 1 -- 172.21.15.6:0/1841653229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f2cb404eb90 con 0x7f2cb414b8d0 2023-07-06T19:58:27.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:27.048+0000 7f2caaffd700 1 -- 172.21.15.6:0/1841653229 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2c9c01d950 con 0x7f2cb414b8d0 2023-07-06T19:58:27.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:27.049+0000 7f2cb8c7e700 1 -- 172.21.15.6:0/1841653229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb414b8d0 msgr2=0x7f2cb414b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:27.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:27.049+0000 7f2cb8c7e700 1 --2- 172.21.15.6:0/1841653229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb414b8d0 0x7f2cb414b0d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c0072c0 tx=0x7f2c9c0075d0 comp rx=0 tx=0).stop 2023-07-06T19:58:27.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:27.049+0000 7f2cb8c7e700 1 -- 172.21.15.6:0/1841653229 shutdown_connections 2023-07-06T19:58:27.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:27.049+0000 7f2cb8c7e700 1 --2- 172.21.15.6:0/1841653229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cb415bc10 0x7f2cb414f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:27.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:27.049+0000 7f2cb8c7e700 1 --2- 172.21.15.6:0/1841653229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2ca0003a00 0x7f2cb40c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:27.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:27.049+0000 7f2cb8c7e700 1 --2- 172.21.15.6:0/1841653229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb414b8d0 0x7f2cb414b0d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:27.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:27.049+0000 7f2cb8c7e700 1 -- 172.21.15.6:0/1841653229 >> 172.21.15.6:0/1841653229 conn(0x7f2cb40cf960 msgr2=0x7f2cb406aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:27.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:27.049+0000 7f2cb8c7e700 1 -- 172.21.15.6:0/1841653229 shutdown_connections 2023-07-06T19:58:27.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:27.049+0000 7f2cb8c7e700 1 -- 172.21.15.6:0/1841653229 wait complete. 2023-07-06T19:58:27.053 INFO:teuthology.orchestra.run.smithi006.stderr:adjusted tunables profile to default 2023-07-06T19:58:27.064 INFO:tasks.ceph:check_enable_crimson: False 2023-07-06T19:58:27.064 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-06T19:58:27.065 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:58:27.065 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-06T19:58:27.081 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:27.079+0000 7f6e0fdcf200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T19:58:27.085 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:27.082+0000 7f462dfcc200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-06T19:58:27.098 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:58:27.098 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-06T19:58:27.152 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:27.148+0000 7f6e0fdcf200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T19:58:27.154 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:27.152+0000 7f462dfcc200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-06T19:58:27.168 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:58:27.168 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-06T19:58:27.232 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:27.228+0000 7f6e0fdcf200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T19:58:27.235 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:27.233+0000 7f462dfcc200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-06T19:58:27.237 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:58:27.237 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-06T19:58:27.305 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:58:27.306 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-06T19:58:27.315 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:27.312+0000 7f6e0fdcf200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T19:58:27.319 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:27.317+0000 7f462dfcc200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-06T19:58:27.333 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:58:27.334 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-06T19:58:27.409 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:58:27.410 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-06T19:58:27.466 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:27.463+0000 7f6e0fdcf200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T19:58:27.472 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:27.467+0000 7f462dfcc200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-06T19:58:27.485 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:58:27.486 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-06T19:58:27.555 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 67717d32-4b3a-4503-a994-31e663c1c7cf 0 2023-07-06T19:58:27.722 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.716+0000 7fbdf69a3700 1 Processor -- start 2023-07-06T19:58:27.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.717+0000 7fbdf69a3700 1 -- start start 2023-07-06T19:58:27.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.717+0000 7fbdf69a3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdf00cd630 0x7fbdf00ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:27.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.717+0000 7fbdf69a3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf00c9d70 con 0x7fbdf006c040 2023-07-06T19:58:27.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.717+0000 7fbdf69a3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf006bdf0 con 0x7fbdf00cefe0 2023-07-06T19:58:27.723 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.717+0000 7fbdf69a3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00c9810 con 0x7fbdf00cd630 2023-07-06T19:58:27.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.717+0000 7fbdef7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdf00cd630 0x7fbdf00ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:27.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.718+0000 7fbdef7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdf00cd630 0x7fbdf00ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41358/0 (socket says 172.21.15.40:41358) 2023-07-06T19:58:27.724 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.718+0000 7fbdef7fe700 1 -- 172.21.15.40:0/550765301 learned_addr learned my addr 172.21.15.40:0/550765301 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-07-06T19:58:27.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.718+0000 7fbdeeffd700 1 -- 172.21.15.40:0/550765301 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 262081002 0 0) 0x7fbdf006bdf0 con 0x7fbdf00cefe0 2023-07-06T19:58:27.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.718+0000 7fbdeeffd700 1 -- 172.21.15.40:0/550765301 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdd80035b0 con 0x7fbdf00cefe0 2023-07-06T19:58:27.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.718+0000 7fbdef7fe700 1 -- 172.21.15.40:0/550765301 >> v1:172.21.15.40:6789/0 conn(0x7fbdf00cefe0 legacy=0x7fbdf00cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:27.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.718+0000 7fbdef7fe700 1 -- 172.21.15.40:0/550765301 >> v1:172.21.15.6:6789/0 conn(0x7fbdf006c040 legacy=0x7fbdf00ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:27.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.718+0000 7fbdef7fe700 1 -- 172.21.15.40:0/550765301 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf006b830 con 0x7fbdf00cd630 2023-07-06T19:58:27.726 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.718+0000 7fbdef7fe700 1 --2- 172.21.15.40:0/550765301 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdf00cd630 0x7fbdf00ca200 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbde400bbc0 tx=0x7fbde400bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67999b398cd90ae server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:27.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.718+0000 7fbdeeffd700 1 -- 172.21.15.40:0/550765301 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde400dd30 con 0x7fbdf00cd630 2023-07-06T19:58:27.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.718+0000 7fbdeeffd700 1 -- 172.21.15.40:0/550765301 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde400de90 con 0x7fbdf00cd630 2023-07-06T19:58:27.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.718+0000 7fbdeeffd700 1 -- 172.21.15.40:0/550765301 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde4010690 con 0x7fbdf00cd630 2023-07-06T19:58:27.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.719+0000 7fbdf69a3700 1 -- 172.21.15.40:0/550765301 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdf00cd630 msgr2=0x7fbdf00ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:27.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.719+0000 7fbdf69a3700 1 --2- 172.21.15.40:0/550765301 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdf00cd630 0x7fbdf00ca200 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbde400bbc0 tx=0x7fbde400bed0 comp rx=0 tx=0).stop 2023-07-06T19:58:27.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.719+0000 7fbdf69a3700 1 -- 172.21.15.40:0/550765301 shutdown_connections 2023-07-06T19:58:27.727 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.719+0000 7fbdf69a3700 1 --2- 172.21.15.40:0/550765301 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdf00cd630 0x7fbdf00ca200 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:27.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.719+0000 7fbdf69a3700 1 -- 172.21.15.40:0/550765301 >> 172.21.15.40:0/550765301 conn(0x7fbdf00b0b60 msgr2=0x7fbdf00b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:27.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.719+0000 7fbdf69a3700 1 -- 172.21.15.40:0/550765301 shutdown_connections 2023-07-06T19:58:27.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.719+0000 7fbdf69a3700 1 -- 172.21.15.40:0/550765301 wait complete. 2023-07-06T19:58:27.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.720+0000 7fbdf69a3700 1 Processor -- start 2023-07-06T19:58:27.728 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.720+0000 7fbdf69a3700 1 -- start start 2023-07-06T19:58:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.721+0000 7fbdf69a3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdf006c040 0x7fbdf00c1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.721+0000 7fbdf69a3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdf00cd630 0x7fbdf00c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.721+0000 7fbdf69a3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf00cefe0 0x7fbdf01460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:27.744 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.721+0000 7fbdf69a3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00c2990 con 0x7fbdf00cefe0 2023-07-06T19:58:27.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.721+0000 7fbdf69a3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00c2c70 con 0x7fbdf00cd630 2023-07-06T19:58:27.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.721+0000 7fbdf69a3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00c2f50 con 0x7fbdf006c040 2023-07-06T19:58:27.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.721+0000 7fbdeffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdf006c040 0x7fbdf00c1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:27.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.721+0000 7fbdef7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdf00cd630 0x7fbdf00c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:27.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.721+0000 7fbdeffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdf006c040 0x7fbdf00c1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41362/0 (socket says 172.21.15.40:41362) 2023-07-06T19:58:27.748 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.721+0000 7fbdef7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdf00cd630 0x7fbdf00c4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52654/0 (socket says 172.21.15.40:52654) 2023-07-06T19:58:27.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.721+0000 7fbdeffff700 1 -- 172.21.15.40:0/439673252 learned_addr learned my addr 172.21.15.40:0/439673252 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-07-06T19:58:27.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.721+0000 7fbdf4f40700 1 --2- 172.21.15.40:0/439673252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf00cefe0 0x7fbdf01460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:27.752 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.721+0000 7fbdeffff700 1 -- 172.21.15.40:0/439673252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdf00cd630 msgr2=0x7fbdf00c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:27.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.721+0000 7fbdeffff700 1 --2- 172.21.15.40:0/439673252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdf00cd630 0x7fbdf00c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:27.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.721+0000 7fbdeffff700 1 -- 172.21.15.40:0/439673252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf00cefe0 msgr2=0x7fbdf01460a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:27.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.721+0000 7fbdeffff700 1 --2- 172.21.15.40:0/439673252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf00cefe0 0x7fbdf01460a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:27.760 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.721+0000 7fbdeffff700 1 -- 172.21.15.40:0/439673252 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde400b7f0 con 0x7fbdf006c040 2023-07-06T19:58:27.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.721+0000 7fbdeffff700 1 --2- 172.21.15.40:0/439673252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdf006c040 0x7fbdf00c1eb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbde000c520 tx=0x7fbde000c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:27.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.722+0000 7fbdecff9700 1 -- 172.21.15.40:0/439673252 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde00052d0 con 0x7fbdf006c040 2023-07-06T19:58:27.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.722+0000 7fbdecff9700 1 -- 172.21.15.40:0/439673252 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde0005430 con 0x7fbdf006c040 2023-07-06T19:58:27.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.722+0000 7fbdecff9700 1 -- 172.21.15.40:0/439673252 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde00038c0 con 0x7fbdf006c040 2023-07-06T19:58:27.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.722+0000 7fbdf69a3700 1 -- 172.21.15.40:0/439673252 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf00c3230 con 0x7fbdf006c040 2023-07-06T19:58:27.761 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.722+0000 7fbdf69a3700 1 -- 172.21.15.40:0/439673252 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf00c4f90 con 0x7fbdf006c040 2023-07-06T19:58:27.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.722+0000 7fbdecff9700 1 -- 172.21.15.40:0/439673252 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbde0003d20 con 0x7fbdf006c040 2023-07-06T19:58:27.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.722+0000 7fbdecff9700 1 -- 172.21.15.40:0/439673252 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fbde001c780 con 0x7fbdf006c040 2023-07-06T19:58:27.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.723+0000 7fbdf69a3700 1 -- 172.21.15.40:0/439673252 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdf00c2db0 con 0x7fbdf006c040 2023-07-06T19:58:27.762 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.725+0000 7fbdecff9700 1 -- 172.21.15.40:0/439673252 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fbdf00c2db0 con 0x7fbdf006c040 2023-07-06T19:58:27.812 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.810+0000 7fbdf69a3700 1 -- 172.21.15.40:0/439673252 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd new", "uuid": "67717d32-4b3a-4503-a994-31e663c1c7cf", "id": 0} v 0) v1 -- 0x7fbdf004eb90 con 0x7fbdf006c040 2023-07-06T19:58:27.815 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.813+0000 7fbdecff9700 1 -- 172.21.15.40:0/439673252 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "67717d32-4b3a-4503-a994-31e663c1c7cf", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbde0017070 con 0x7fbdf006c040 2023-07-06T19:58:27.816 INFO:teuthology.orchestra.run.smithi040.stdout:0 2023-07-06T19:58:27.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.814+0000 7fbdf69a3700 1 -- 172.21.15.40:0/439673252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdf006c040 msgr2=0x7fbdf00c1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:27.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.814+0000 7fbdf69a3700 1 --2- 172.21.15.40:0/439673252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdf006c040 0x7fbdf00c1eb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbde000c520 tx=0x7fbde000c830 comp rx=0 tx=0).stop 2023-07-06T19:58:27.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.814+0000 7fbdf69a3700 1 -- 172.21.15.40:0/439673252 shutdown_connections 2023-07-06T19:58:27.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.814+0000 7fbdf69a3700 1 --2- 172.21.15.40:0/439673252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf00cefe0 0x7fbdf01460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:27.817 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.814+0000 7fbdf69a3700 1 --2- 172.21.15.40:0/439673252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdf006c040 0x7fbdf00c1eb0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:27.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.814+0000 7fbdf69a3700 1 --2- 172.21.15.40:0/439673252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdf00cd630 0x7fbdf00c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:27.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.814+0000 7fbdf69a3700 1 -- 172.21.15.40:0/439673252 >> 172.21.15.40:0/439673252 conn(0x7fbdf00b0b60 msgr2=0x7fbdf00cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:27.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.814+0000 7fbdf69a3700 1 -- 172.21.15.40:0/439673252 shutdown_connections 2023-07-06T19:58:27.818 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.814+0000 7fbdf69a3700 1 -- 172.21.15.40:0/439673252 wait complete. 2023-07-06T19:58:27.821 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:27.818+0000 7f462dfcc200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T19:58:27.827 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:27.825+0000 7f6e0fdcf200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-06T19:58:27.833 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 8044cb19-a7d5-4fd6-9a90-17d7522d13d1 1 2023-07-06T19:58:27.899 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:27.897+0000 7f462dfcc200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T19:58:27.913 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:27.906+0000 7f6e0fdcf200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-06T19:58:27.962 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.960+0000 7fbcc9324700 1 Processor -- start 2023-07-06T19:58:27.963 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.960+0000 7fbcc9324700 1 -- start start 2023-07-06T19:58:27.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.961+0000 7fbcc9324700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcc41592b0 0x7fbcc4071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:27.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.961+0000 7fbcc9324700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbcc415cd40 0x7fbcc4071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:27.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.961+0000 7fbcc9324700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcc40cc160 con 0x7fbcc40cd950 2023-07-06T19:58:27.974 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.961+0000 7fbcc9324700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc4159680 con 0x7fbcc415cd40 2023-07-06T19:58:27.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.961+0000 7fbcc9324700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc415d2b0 con 0x7fbcc41592b0 2023-07-06T19:58:27.979 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.961+0000 7fbcc2ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcc41592b0 0x7fbcc4071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:27.986 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.961+0000 7fbcc27fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbcc415cd40 0x7fbcc4071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:27.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.961+0000 7fbcc37fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbcc40cd950 0x7fbcc406d8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52890/0 (socket says 172.21.15.40:52890) 2023-07-06T19:58:27.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.961+0000 7fbcc37fe700 1 -- 172.21.15.40:0/2424173207 learned_addr learned my addr 172.21.15.40:0/2424173207 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-07-06T19:58:27.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.961+0000 7fbcc2ffd700 1 -- 172.21.15.40:0/2424173207 >> v2:172.21.15.40:3300/0 conn(0x7fbcc415cd40 msgr2=0x7fbcc4071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:27.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.961+0000 7fbcc2ffd700 1 --2- 172.21.15.40:0/2424173207 >> v2:172.21.15.40:3300/0 conn(0x7fbcc415cd40 0x7fbcc4071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:27.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.961+0000 7fbcc2ffd700 1 -- 172.21.15.40:0/2424173207 >> v1:172.21.15.40:6789/0 conn(0x7fbcc40cd950 legacy=0x7fbcc406d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:27.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.961+0000 7fbcc2ffd700 1 -- 172.21.15.40:0/2424173207 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc415d590 con 0x7fbcc41592b0 2023-07-06T19:58:27.987 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.961+0000 7fbcc27fc700 1 --2- 172.21.15.40:0/2424173207 >> v2:172.21.15.40:3300/0 conn(0x7fbcc415cd40 0x7fbcc4071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:58:27.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.962+0000 7fbcc2ffd700 1 --2- 172.21.15.40:0/2424173207 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcc41592b0 0x7fbcc4071690 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400bae0 tx=0x7fbcb400bdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a89576cf3727691 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:27.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.962+0000 7fbcc1ffb700 1 -- 172.21.15.40:0/2424173207 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb400dc70 con 0x7fbcc41592b0 2023-07-06T19:58:27.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.962+0000 7fbcc1ffb700 1 -- 172.21.15.40:0/2424173207 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb400ddd0 con 0x7fbcc41592b0 2023-07-06T19:58:27.988 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.962+0000 7fbcc1ffb700 1 -- 172.21.15.40:0/2424173207 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4010690 con 0x7fbcc41592b0 2023-07-06T19:58:27.989 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.962+0000 7fbcc9324700 1 -- 172.21.15.40:0/2424173207 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcc41592b0 msgr2=0x7fbcc4071690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:27.994 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.962+0000 7fbcc9324700 1 --2- 172.21.15.40:0/2424173207 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcc41592b0 0x7fbcc4071690 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400bae0 tx=0x7fbcb400bdf0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.002 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.962+0000 7fbcc9324700 1 -- 172.21.15.40:0/2424173207 shutdown_connections 2023-07-06T19:58:28.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.962+0000 7fbcc9324700 1 --2- 172.21.15.40:0/2424173207 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcc41592b0 0x7fbcc4071690 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.962+0000 7fbcc9324700 1 --2- 172.21.15.40:0/2424173207 >> v2:172.21.15.40:3300/0 conn(0x7fbcc415cd40 0x7fbcc4071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.962+0000 7fbcc9324700 1 -- 172.21.15.40:0/2424173207 >> 172.21.15.40:0/2424173207 conn(0x7fbcc40cf960 msgr2=0x7fbcc40cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:28.024 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.962+0000 7fbcc9324700 1 -- 172.21.15.40:0/2424173207 shutdown_connections 2023-07-06T19:58:28.025 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.962+0000 7fbcc9324700 1 -- 172.21.15.40:0/2424173207 wait complete. 2023-07-06T19:58:28.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.964+0000 7fbcc9324700 1 Processor -- start 2023-07-06T19:58:28.028 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.964+0000 7fbcc9324700 1 -- start start 2023-07-06T19:58:28.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.965+0000 7fbcc9324700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcc40cd950 0x7fbcc40b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:28.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.965+0000 7fbcc9324700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcc41592b0 0x7fbcc40cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:28.029 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.965+0000 7fbcc9324700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcc415cd40 0x7fbcc40cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:28.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.965+0000 7fbcc9324700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc40b3230 con 0x7fbcc41592b0 2023-07-06T19:58:28.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.965+0000 7fbcc9324700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc40b3510 con 0x7fbcc40cd950 2023-07-06T19:58:28.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.965+0000 7fbcc9324700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc40b37f0 con 0x7fbcc415cd40 2023-07-06T19:58:28.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.965+0000 7fbcc2ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcc40cd950 0x7fbcc40b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:28.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.965+0000 7fbcc37fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcc415cd40 0x7fbcc40cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:28.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.965+0000 7fbcc2ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcc40cd950 0x7fbcc40b2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52664/0 (socket says 172.21.15.40:52664) 2023-07-06T19:58:28.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.965+0000 7fbcc2ffd700 1 -- 172.21.15.40:0/3335745341 learned_addr learned my addr 172.21.15.40:0/3335745341 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-07-06T19:58:28.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.965+0000 7fbcc27fc700 1 --2- 172.21.15.40:0/3335745341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcc41592b0 0x7fbcc40cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:28.041 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.965+0000 7fbcc37fe700 1 -- 172.21.15.40:0/3335745341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcc40cd950 msgr2=0x7fbcc40b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:28.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.965+0000 7fbcc37fe700 1 --2- 172.21.15.40:0/3335745341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcc40cd950 0x7fbcc40b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.049 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.965+0000 7fbcc37fe700 1 -- 172.21.15.40:0/3335745341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcc41592b0 msgr2=0x7fbcc40cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:28.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.965+0000 7fbcc37fe700 1 --2- 172.21.15.40:0/3335745341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcc41592b0 0x7fbcc40cb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.965+0000 7fbcc37fe700 1 -- 172.21.15.40:0/3335745341 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb80094a0 con 0x7fbcc415cd40 2023-07-06T19:58:28.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.965+0000 7fbcc37fe700 1 --2- 172.21.15.40:0/3335745341 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcc415cd40 0x7fbcc40cb7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00caa0 tx=0x7fbcbc00cdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:28.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.965+0000 7fbcab7fe700 1 -- 172.21.15.40:0/3335745341 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc00a9e0 con 0x7fbcc415cd40 2023-07-06T19:58:28.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.965+0000 7fbcab7fe700 1 -- 172.21.15.40:0/3335745341 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcbc00ab40 con 0x7fbcc415cd40 2023-07-06T19:58:28.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.965+0000 7fbcc9324700 1 -- 172.21.15.40:0/3335745341 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb400b740 con 0x7fbcc415cd40 2023-07-06T19:58:28.050 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.965+0000 7fbcab7fe700 1 -- 172.21.15.40:0/3335745341 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcbc012400 con 0x7fbcc415cd40 2023-07-06T19:58:28.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.965+0000 7fbcc9324700 1 -- 172.21.15.40:0/3335745341 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc40b3db0 con 0x7fbcc415cd40 2023-07-06T19:58:28.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.966+0000 7fbcab7fe700 1 -- 172.21.15.40:0/3335745341 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbcbc012560 con 0x7fbcc415cd40 2023-07-06T19:58:28.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.966+0000 7fbcab7fe700 1 -- 172.21.15.40:0/3335745341 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fbcbc01c880 con 0x7fbcc415cd40 2023-07-06T19:58:28.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.966+0000 7fbcc9324700 1 -- 172.21.15.40:0/3335745341 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc40b3fa0 con 0x7fbcc415cd40 2023-07-06T19:58:28.051 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:27.968+0000 7fbcab7fe700 1 -- 172.21.15.40:0/3335745341 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fbcbc021060 con 0x7fbcc415cd40 2023-07-06T19:58:28.054 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:28.044+0000 7f6e0fdcf200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T19:58:28.054 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:28.034+0000 7f462dfcc200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-06T19:58:28.069 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.055+0000 7fbcc9324700 1 -- 172.21.15.40:0/3335745341 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8044cb19-a7d5-4fd6-9a90-17d7522d13d1", "id": 1} v 0) v1 -- 0x7fbcc404eb90 con 0x7fbcc415cd40 2023-07-06T19:58:28.070 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.062+0000 7fbcab7fe700 1 -- 172.21.15.40:0/3335745341 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8044cb19-a7d5-4fd6-9a90-17d7522d13d1", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbcbc017070 con 0x7fbcc415cd40 2023-07-06T19:58:28.070 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-07-06T19:58:28.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.063+0000 7fbcc9324700 1 -- 172.21.15.40:0/3335745341 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcc415cd40 msgr2=0x7fbcc40cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:28.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.063+0000 7fbcc9324700 1 --2- 172.21.15.40:0/3335745341 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcc415cd40 0x7fbcc40cb7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc00caa0 tx=0x7fbcbc00cdb0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.071 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.063+0000 7fbcc9324700 1 -- 172.21.15.40:0/3335745341 shutdown_connections 2023-07-06T19:58:28.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.063+0000 7fbcc9324700 1 --2- 172.21.15.40:0/3335745341 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbcc415cd40 0x7fbcc40cb7c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.063+0000 7fbcc9324700 1 --2- 172.21.15.40:0/3335745341 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbcc40cd950 0x7fbcc40b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.063+0000 7fbcc9324700 1 --2- 172.21.15.40:0/3335745341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbcc41592b0 0x7fbcc40cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.063+0000 7fbcc9324700 1 -- 172.21.15.40:0/3335745341 >> 172.21.15.40:0/3335745341 conn(0x7fbcc40cf960 msgr2=0x7fbcc406c270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:28.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.063+0000 7fbcc9324700 1 -- 172.21.15.40:0/3335745341 shutdown_connections 2023-07-06T19:58:28.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.063+0000 7fbcc9324700 1 -- 172.21.15.40:0/3335745341 wait complete. 2023-07-06T19:58:28.082 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 47578e23-99c3-42d1-b7a7-f04670ee7e18 2 2023-07-06T19:58:28.122 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:28.119+0000 7f462dfcc200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T19:58:28.147 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:28.135+0000 7f6e0fdcf200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-06T19:58:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.216+0000 7f9957d5f700 1 Processor -- start 2023-07-06T19:58:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.216+0000 7f9957d5f700 1 -- start start 2023-07-06T19:58:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.217+0000 7f9957d5f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f99500ca850 0x7f995015bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:28.221 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.217+0000 7f9957d5f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99500cb310 con 0x7f9950071900 2023-07-06T19:58:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.217+0000 7f9957d5f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99500af070 con 0x7f9950071cd0 2023-07-06T19:58:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.217+0000 7f9957d5f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99500cdbf0 con 0x7f99500ca850 2023-07-06T19:58:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.217+0000 7f99552fa700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f99500ca850 0x7f995015bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.217+0000 7f99562fc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9950071cd0 0x7f99500ce010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52904/0 (socket says 172.21.15.40:52904) 2023-07-06T19:58:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.217+0000 7f99562fc700 1 -- 172.21.15.40:0/2641501731 learned_addr learned my addr 172.21.15.40:0/2641501731 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-07-06T19:58:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.217+0000 7f99552fa700 1 -- 172.21.15.40:0/2641501731 >> v1:172.21.15.40:6789/0 conn(0x7f9950071cd0 legacy=0x7f99500ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:28.222 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.217+0000 7f99552fa700 1 -- 172.21.15.40:0/2641501731 >> v1:172.21.15.6:6789/0 conn(0x7f9950071900 legacy=0x7f99500ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:28.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.217+0000 7f99552fa700 1 -- 172.21.15.40:0/2641501731 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99500cad50 con 0x7f99500ca850 2023-07-06T19:58:28.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.218+0000 7f99552fa700 1 --2- 172.21.15.40:0/2641501731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99500ca850 0x7f995015bf50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f995006a790 tx=0x7f9940009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24710cb1e22d287c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:28.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.218+0000 7f9954af9700 1 -- 172.21.15.40:0/2641501731 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9940004020 con 0x7f99500ca850 2023-07-06T19:58:28.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.218+0000 7f9954af9700 1 -- 172.21.15.40:0/2641501731 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9940004180 con 0x7f99500ca850 2023-07-06T19:58:28.223 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.218+0000 7f9954af9700 1 -- 172.21.15.40:0/2641501731 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9940004530 con 0x7f99500ca850 2023-07-06T19:58:28.227 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.218+0000 7f9957d5f700 1 -- 172.21.15.40:0/2641501731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99500ca850 msgr2=0x7f995015bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.218+0000 7f9957d5f700 1 --2- 172.21.15.40:0/2641501731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99500ca850 0x7f995015bf50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f995006a790 tx=0x7f9940009b20 comp rx=0 tx=0).stop 2023-07-06T19:58:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.218+0000 7f9957d5f700 1 -- 172.21.15.40:0/2641501731 shutdown_connections 2023-07-06T19:58:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.218+0000 7f9957d5f700 1 --2- 172.21.15.40:0/2641501731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99500ca850 0x7f995015bf50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.229 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.218+0000 7f9957d5f700 1 -- 172.21.15.40:0/2641501731 >> 172.21.15.40:0/2641501731 conn(0x7f99500cf960 msgr2=0x7f99500cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:28.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.218+0000 7f9957d5f700 1 -- 172.21.15.40:0/2641501731 shutdown_connections 2023-07-06T19:58:28.231 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.219+0000 7f9957d5f700 1 -- 172.21.15.40:0/2641501731 wait complete. 2023-07-06T19:58:28.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.220+0000 7f9957d5f700 1 Processor -- start 2023-07-06T19:58:28.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.220+0000 7f9957d5f700 1 -- start start 2023-07-06T19:58:28.242 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.222+0000 7f9957d5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9950071900 0x7f9950151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:28.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.222+0000 7f9957d5f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9950071cd0 0x7f9950152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:28.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.222+0000 7f9957d5f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99500ca850 0x7f9950155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:28.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.222+0000 7f9957d5f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9950153590 con 0x7f9950071900 2023-07-06T19:58:28.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.222+0000 7f9957d5f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9950153870 con 0x7f9950071cd0 2023-07-06T19:58:28.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.222+0000 7f9957d5f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9950153b50 con 0x7f99500ca850 2023-07-06T19:58:28.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.222+0000 7f99552fa700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9950071cd0 0x7f9950152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:28.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.222+0000 7f99562fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99500ca850 0x7f9950155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:28.243 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.222+0000 7f9955afb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9950071900 0x7f9950151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:28.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.222+0000 7f99562fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99500ca850 0x7f9950155130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41390/0 (socket says 172.21.15.40:41390) 2023-07-06T19:58:28.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.222+0000 7f99552fa700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9950071cd0 0x7f9950152cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52678/0 (socket says 172.21.15.40:52678) 2023-07-06T19:58:28.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.222+0000 7f99562fc700 1 -- 172.21.15.40:0/422867797 learned_addr learned my addr 172.21.15.40:0/422867797 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-07-06T19:58:28.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.222+0000 7f9955afb700 1 -- 172.21.15.40:0/422867797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99500ca850 msgr2=0x7f9950155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:28.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.222+0000 7f9955afb700 1 --2- 172.21.15.40:0/422867797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99500ca850 0x7f9950155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.222+0000 7f9955afb700 1 -- 172.21.15.40:0/422867797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9950071cd0 msgr2=0x7f9950152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:28.244 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.222+0000 7f9955afb700 1 --2- 172.21.15.40:0/422867797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9950071cd0 0x7f9950152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.222+0000 7f9955afb700 1 -- 172.21.15.40:0/422867797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99400094a0 con 0x7f9950071900 2023-07-06T19:58:28.245 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.222+0000 7f99562fc700 1 --2- 172.21.15.40:0/422867797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99500ca850 0x7f9950155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:58:28.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.222+0000 7f99552fa700 1 --2- 172.21.15.40:0/422867797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9950071cd0 0x7f9950152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:58:28.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.222+0000 7f9955afb700 1 --2- 172.21.15.40:0/422867797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9950071900 0x7f9950151fb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f994c000f60 tx=0x7f994c00c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:28.268 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.223+0000 7f99467fc700 1 -- 172.21.15.40:0/422867797 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c0052d0 con 0x7f9950071900 2023-07-06T19:58:28.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.223+0000 7f99467fc700 1 -- 172.21.15.40:0/422867797 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994c005430 con 0x7f9950071900 2023-07-06T19:58:28.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.223+0000 7f99467fc700 1 -- 172.21.15.40:0/422867797 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994c0038c0 con 0x7f9950071900 2023-07-06T19:58:28.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.223+0000 7f9957d5f700 1 -- 172.21.15.40:0/422867797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9950153e30 con 0x7f9950071900 2023-07-06T19:58:28.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.223+0000 7f9957d5f700 1 -- 172.21.15.40:0/422867797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99501524f0 con 0x7f9950071900 2023-07-06T19:58:28.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.223+0000 7f99467fc700 1 -- 172.21.15.40:0/422867797 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f994c01c440 con 0x7f9950071900 2023-07-06T19:58:28.269 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.223+0000 7f99467fc700 1 -- 172.21.15.40:0/422867797 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f994c01cb10 con 0x7f9950071900 2023-07-06T19:58:28.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.224+0000 7f9957d5f700 1 -- 172.21.15.40:0/422867797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9950154350 con 0x7f9950071900 2023-07-06T19:58:28.270 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.226+0000 7f99467fc700 1 -- 172.21.15.40:0/422867797 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9950154350 con 0x7f9950071900 2023-07-06T19:58:28.314 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.311+0000 7f9957d5f700 1 -- 172.21.15.40:0/422867797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd new", "uuid": "47578e23-99c3-42d1-b7a7-f04670ee7e18", "id": 2} v 0) v1 -- 0x7f995015bf30 con 0x7f9950071900 2023-07-06T19:58:28.320 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.317+0000 7f99467fc700 1 -- 172.21.15.40:0/422867797 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "47578e23-99c3-42d1-b7a7-f04670ee7e18", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f994c017070 con 0x7f9950071900 2023-07-06T19:58:28.321 INFO:teuthology.orchestra.run.smithi040.stdout:2 2023-07-06T19:58:28.321 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.318+0000 7f9957d5f700 1 -- 172.21.15.40:0/422867797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9950071900 msgr2=0x7f9950151fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:28.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.318+0000 7f9957d5f700 1 --2- 172.21.15.40:0/422867797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9950071900 0x7f9950151fb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f994c000f60 tx=0x7f994c00c6e0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.318+0000 7f9957d5f700 1 -- 172.21.15.40:0/422867797 shutdown_connections 2023-07-06T19:58:28.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.318+0000 7f9957d5f700 1 --2- 172.21.15.40:0/422867797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9950071900 0x7f9950151fb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.318+0000 7f9957d5f700 1 --2- 172.21.15.40:0/422867797 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99500ca850 0x7f9950155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.328 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.318+0000 7f9957d5f700 1 --2- 172.21.15.40:0/422867797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9950071cd0 0x7f9950152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.318+0000 7f9957d5f700 1 -- 172.21.15.40:0/422867797 >> 172.21.15.40:0/422867797 conn(0x7f99500cf960 msgr2=0x7f99500c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:28.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.319+0000 7f9957d5f700 1 -- 172.21.15.40:0/422867797 shutdown_connections 2023-07-06T19:58:28.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.319+0000 7f9957d5f700 1 -- 172.21.15.40:0/422867797 wait complete. 2023-07-06T19:58:28.333 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 029a1b80-b306-47fe-9a7d-39935854bf7f 3 2023-07-06T19:58:28.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.455+0000 7f06a8d78700 1 Processor -- start 2023-07-06T19:58:28.467 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.455+0000 7f06a8d78700 1 -- start start 2023-07-06T19:58:28.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.456+0000 7f06a8d78700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f06a4071da0 0x7f06a40ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:28.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.456+0000 7f06a8d78700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a415e890 con 0x7f06a415b370 2023-07-06T19:58:28.468 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.456+0000 7f06a8d78700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a415eb70 con 0x7f06a40aef10 2023-07-06T19:58:28.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.456+0000 7f06a8d78700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a4151750 con 0x7f06a4071da0 2023-07-06T19:58:28.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.456+0000 7f06a259c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f06a40aef10 0x7f06a415de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52912/0 (socket says 172.21.15.40:52912) 2023-07-06T19:58:28.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.456+0000 7f06a259c700 1 -- 172.21.15.40:0/1661707952 learned_addr learned my addr 172.21.15.40:0/1661707952 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-07-06T19:58:28.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.456+0000 7f06a2d9d700 1 --2- 172.21.15.40:0/1661707952 >> v2:172.21.15.6:3300/0 conn(0x7f06a4071da0 0x7f06a40ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:28.472 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.456+0000 7f06a159a700 1 -- 172.21.15.40:0/1661707952 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 62005078 0 0) 0x7f06a415eb70 con 0x7f06a40aef10 2023-07-06T19:58:28.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.456+0000 7f06a159a700 1 -- 172.21.15.40:0/1661707952 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06900035b0 con 0x7f06a40aef10 2023-07-06T19:58:28.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.456+0000 7f06a159a700 1 -- 172.21.15.40:0/1661707952 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501158112 0 0) 0x7f06a415e890 con 0x7f06a415b370 2023-07-06T19:58:28.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.456+0000 7f06a159a700 1 -- 172.21.15.40:0/1661707952 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06a415eb70 con 0x7f06a415b370 2023-07-06T19:58:28.473 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.456+0000 7f06a159a700 1 -- 172.21.15.40:0/1661707952 <== mon.1 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1813981461 0 0) 0x7f06900035b0 con 0x7f06a40aef10 2023-07-06T19:58:28.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.456+0000 7f06a159a700 1 -- 172.21.15.40:0/1661707952 >> v2:172.21.15.6:3300/0 conn(0x7f06a4071da0 msgr2=0x7f06a40ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:28.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.456+0000 7f06a159a700 1 --2- 172.21.15.40:0/1661707952 >> v2:172.21.15.6:3300/0 conn(0x7f06a4071da0 0x7f06a40ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.456+0000 7f06a159a700 1 -- 172.21.15.40:0/1661707952 >> v1:172.21.15.6:6789/0 conn(0x7f06a415b370 legacy=0x7f06a4071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:28.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.456+0000 7f06a159a700 1 -- 172.21.15.40:0/1661707952 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a415ab70 con 0x7f06a40aef10 2023-07-06T19:58:28.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.456+0000 7f06a159a700 1 -- 172.21.15.40:0/1661707952 <== mon.1 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f069c0019f0 con 0x7f06a40aef10 2023-07-06T19:58:28.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.456+0000 7f06a2d9d700 1 --2- 172.21.15.40:0/1661707952 >> v2:172.21.15.6:3300/0 conn(0x7f06a4071da0 0x7f06a40ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:58:28.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.457+0000 7f06a159a700 1 -- 172.21.15.40:0/1661707952 >> v1:172.21.15.40:6789/0 conn(0x7f06a40aef10 legacy=0x7f06a415de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:28.474 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.457+0000 7f06a159a700 1 --2- 172.21.15.40:0/1661707952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0690003be0 0x7f0690003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:28.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.457+0000 7f06a159a700 1 --2- 172.21.15.40:0/1661707952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0690004850 0x7f0690004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:28.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.457+0000 7f06a159a700 1 --2- 172.21.15.40:0/1661707952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0690005200 0x7f069000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:28.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.457+0000 7f06a159a700 1 -- 172.21.15.40:0/1661707952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a4151750 con 0x7f0690005200 2023-07-06T19:58:28.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.457+0000 7f06a159a700 1 -- 172.21.15.40:0/1661707952 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069000c0e0 con 0x7f0690004850 2023-07-06T19:58:28.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.457+0000 7f06a159a700 1 -- 172.21.15.40:0/1661707952 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069000c270 con 0x7f0690003be0 2023-07-06T19:58:28.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.457+0000 7f06a259c700 1 --2- 172.21.15.40:0/1661707952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0690003be0 0x7f0690003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:28.475 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.457+0000 7f06a1d9b700 1 --2- 172.21.15.40:0/1661707952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0690004850 0x7f0690004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:28.476 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.457+0000 7f06a2d9d700 1 --2- 172.21.15.40:0/1661707952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0690005200 0x7f069000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:28.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.457+0000 7f06a1d9b700 1 -- 172.21.15.40:0/1661707952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0690003be0 msgr2=0x7f0690003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:28.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.457+0000 7f06a1d9b700 1 --2- 172.21.15.40:0/1661707952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0690003be0 0x7f0690003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.457+0000 7f06a1d9b700 1 -- 172.21.15.40:0/1661707952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0690005200 msgr2=0x7f069000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:28.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.457+0000 7f06a1d9b700 1 --2- 172.21.15.40:0/1661707952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0690005200 0x7f069000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.488 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.457+0000 7f06a2d9d700 1 -- 172.21.15.40:0/1661707952 reap_dead start 2023-07-06T19:58:28.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.457+0000 7f06a1d9b700 1 -- 172.21.15.40:0/1661707952 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06900035b0 con 0x7f0690004850 2023-07-06T19:58:28.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.457+0000 7f06a1d9b700 1 --2- 172.21.15.40:0/1661707952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0690004850 0x7f0690004cc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f068c007fd0 tx=0x7f0690005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f39b76aaf8ad9a72 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:28.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.457+0000 7f06a159a700 1 -- 172.21.15.40:0/1661707952 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c001430 con 0x7f0690004850 2023-07-06T19:58:28.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.457+0000 7f06a159a700 1 -- 172.21.15.40:0/1661707952 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068c0052f0 con 0x7f0690004850 2023-07-06T19:58:28.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.457+0000 7f06a159a700 1 -- 172.21.15.40:0/1661707952 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c001d40 con 0x7f0690004850 2023-07-06T19:58:28.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.458+0000 7f06a8d78700 1 -- 172.21.15.40:0/1661707952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0690004850 msgr2=0x7f0690004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:28.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.458+0000 7f06a8d78700 1 --2- 172.21.15.40:0/1661707952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0690004850 0x7f0690004cc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f068c007fd0 tx=0x7f0690005880 comp rx=0 tx=0).stop 2023-07-06T19:58:28.489 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.458+0000 7f06a8d78700 1 -- 172.21.15.40:0/1661707952 shutdown_connections 2023-07-06T19:58:28.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.458+0000 7f06a8d78700 1 --2- 172.21.15.40:0/1661707952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0690004850 0x7f0690004cc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.458+0000 7f06a8d78700 1 -- 172.21.15.40:0/1661707952 >> 172.21.15.40:0/1661707952 conn(0x7f06a40cf960 msgr2=0x7f06a40cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:28.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.458+0000 7f06a8d78700 1 -- 172.21.15.40:0/1661707952 shutdown_connections 2023-07-06T19:58:28.490 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.458+0000 7f06a8d78700 1 -- 172.21.15.40:0/1661707952 wait complete. 2023-07-06T19:58:28.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.460+0000 7f06a8d78700 1 Processor -- start 2023-07-06T19:58:28.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.460+0000 7f06a8d78700 1 -- start start 2023-07-06T19:58:28.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.461+0000 7f06a8d78700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0690004850 0x7f06a40af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:28.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.461+0000 7f06a8d78700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06a40c5050 0x7f06a40c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:28.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.461+0000 7f06a8d78700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06a4153870 0x7f06a4153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:28.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.461+0000 7f06a8d78700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a4152b40 con 0x7f06a40c5050 2023-07-06T19:58:28.491 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.461+0000 7f06a8d78700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a41533e0 con 0x7f0690004850 2023-07-06T19:58:28.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.461+0000 7f06a8d78700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a40c5b10 con 0x7f06a4153870 2023-07-06T19:58:28.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.461+0000 7f06a259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0690004850 0x7f06a40af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:28.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.461+0000 7f06a2d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06a4153870 0x7f06a4153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:28.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.461+0000 7f06a2d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06a4153870 0x7f06a4153ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41408/0 (socket says 172.21.15.40:41408) 2023-07-06T19:58:28.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.461+0000 7f06a259c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0690004850 0x7f06a40af2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52694/0 (socket says 172.21.15.40:52694) 2023-07-06T19:58:28.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.461+0000 7f06a1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06a40c5050 0x7f06a40c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:28.492 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.461+0000 7f06a2d9d700 1 -- 172.21.15.40:0/2048265975 learned_addr learned my addr 172.21.15.40:0/2048265975 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-07-06T19:58:28.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.462+0000 7f06a259c700 1 -- 172.21.15.40:0/2048265975 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06a4153870 msgr2=0x7f06a4153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:28.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.462+0000 7f06a259c700 1 --2- 172.21.15.40:0/2048265975 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06a4153870 0x7f06a4153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.462+0000 7f06a259c700 1 -- 172.21.15.40:0/2048265975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06a40c5050 msgr2=0x7f06a40c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:28.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.462+0000 7f06a259c700 1 --2- 172.21.15.40:0/2048265975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06a40c5050 0x7f06a40c54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.462+0000 7f06a259c700 1 -- 172.21.15.40:0/2048265975 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a4152d90 con 0x7f0690004850 2023-07-06T19:58:28.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.462+0000 7f06a1d9b700 1 --2- 172.21.15.40:0/2048265975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06a40c5050 0x7f06a40c54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:58:28.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.462+0000 7f06a2d9d700 1 --2- 172.21.15.40:0/2048265975 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06a4153870 0x7f06a4153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:58:28.493 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.462+0000 7f06a259c700 1 --2- 172.21.15.40:0/2048265975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0690004850 0x7f06a40af2e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f06a4069350 tx=0x7f069c00a510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:28.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.462+0000 7f069affd700 1 -- 172.21.15.40:0/2048265975 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c00ac30 con 0x7f0690004850 2023-07-06T19:58:28.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.462+0000 7f069affd700 1 -- 172.21.15.40:0/2048265975 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069c00adb0 con 0x7f0690004850 2023-07-06T19:58:28.494 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.462+0000 7f06a8d78700 1 -- 172.21.15.40:0/2048265975 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a4153070 con 0x7f0690004850 2023-07-06T19:58:28.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.462+0000 7f069affd700 1 -- 172.21.15.40:0/2048265975 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c013630 con 0x7f0690004850 2023-07-06T19:58:28.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.462+0000 7f06a8d78700 1 -- 172.21.15.40:0/2048265975 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a4154220 con 0x7f0690004850 2023-07-06T19:58:28.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.462+0000 7f069affd700 1 -- 172.21.15.40:0/2048265975 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f069c013790 con 0x7f0690004850 2023-07-06T19:58:28.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.462+0000 7f069affd700 1 -- 172.21.15.40:0/2048265975 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f069c01b770 con 0x7f0690004850 2023-07-06T19:58:28.501 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.463+0000 7f06a8d78700 1 -- 172.21.15.40:0/2048265975 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a41536c0 con 0x7f0690004850 2023-07-06T19:58:28.507 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.465+0000 7f069affd700 1 -- 172.21.15.40:0/2048265975 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f069c03bb00 con 0x7f0690004850 2023-07-06T19:58:28.569 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:28.567+0000 7f462dfcc200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T19:58:28.577 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.571+0000 7f06a8d78700 1 -- 172.21.15.40:0/2048265975 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd new", "uuid": "029a1b80-b306-47fe-9a7d-39935854bf7f", "id": 3} v 0) v1 -- 0x7f06a404eb90 con 0x7f0690004850 2023-07-06T19:58:28.583 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.578+0000 7f069affd700 1 -- 172.21.15.40:0/2048265975 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "029a1b80-b306-47fe-9a7d-39935854bf7f", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f069c02a030 con 0x7f0690004850 2023-07-06T19:58:28.584 INFO:teuthology.orchestra.run.smithi040.stdout:3 2023-07-06T19:58:28.584 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.579+0000 7f06a8d78700 1 -- 172.21.15.40:0/2048265975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0690004850 msgr2=0x7f06a40af2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:28.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.579+0000 7f06a8d78700 1 --2- 172.21.15.40:0/2048265975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0690004850 0x7f06a40af2e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f06a4069350 tx=0x7f069c00a510 comp rx=0 tx=0).stop 2023-07-06T19:58:28.585 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.579+0000 7f06a8d78700 1 -- 172.21.15.40:0/2048265975 shutdown_connections 2023-07-06T19:58:28.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.579+0000 7f06a8d78700 1 --2- 172.21.15.40:0/2048265975 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06a4153870 0x7f06a4153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.579+0000 7f06a8d78700 1 --2- 172.21.15.40:0/2048265975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0690004850 0x7f06a40af2e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.579+0000 7f06a8d78700 1 --2- 172.21.15.40:0/2048265975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06a40c5050 0x7f06a40c54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.579+0000 7f06a8d78700 1 -- 172.21.15.40:0/2048265975 >> 172.21.15.40:0/2048265975 conn(0x7f06a40cf960 msgr2=0x7f06a40b4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:28.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.579+0000 7f06a8d78700 1 -- 172.21.15.40:0/2048265975 shutdown_connections 2023-07-06T19:58:28.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.579+0000 7f06a8d78700 1 -- 172.21.15.40:0/2048265975 wait complete. 2023-07-06T19:58:28.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 07ca1701-14b7-4e9a-979f-81da9da5d661 4 2023-07-06T19:58:28.632 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:28.630+0000 7f6e0fdcf200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-06T19:58:28.732 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.730+0000 7f725c9ac700 1 Processor -- start 2023-07-06T19:58:28.733 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.730+0000 7f725c9ac700 1 -- start start 2023-07-06T19:58:28.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.731+0000 7f725c9ac700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72580d15e0 0x7f725806e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:28.734 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.731+0000 7f725c9ac700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72580cd300 con 0x7f72580ce860 2023-07-06T19:58:28.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.731+0000 7f725c9ac700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72580b0290 con 0x7f725815a520 2023-07-06T19:58:28.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.731+0000 7f725c9ac700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72580ccd80 con 0x7f72580d15e0 2023-07-06T19:58:28.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.732+0000 7f725659c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f725815a520 0x7f725806dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52930/0 (socket says 172.21.15.40:52930) 2023-07-06T19:58:28.735 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.732+0000 7f725659c700 1 -- 172.21.15.40:0/3870557616 learned_addr learned my addr 172.21.15.40:0/3870557616 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-07-06T19:58:28.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.732+0000 7f7255d9b700 1 --2- 172.21.15.40:0/3870557616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72580d15e0 0x7f725806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:28.741 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.732+0000 7f725559a700 1 -- 172.21.15.40:0/3870557616 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 661921365 0 0) 0x7f72580b0290 con 0x7f725815a520 2023-07-06T19:58:28.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.732+0000 7f725559a700 1 -- 172.21.15.40:0/3870557616 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72400035b0 con 0x7f725815a520 2023-07-06T19:58:28.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.732+0000 7f7255d9b700 1 -- 172.21.15.40:0/3870557616 >> v1:172.21.15.40:6789/0 conn(0x7f725815a520 legacy=0x7f725806dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:28.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.732+0000 7f7255d9b700 1 -- 172.21.15.40:0/3870557616 >> v1:172.21.15.6:6789/0 conn(0x7f72580ce860 legacy=0x7f72580cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:28.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.732+0000 7f7255d9b700 1 -- 172.21.15.40:0/3870557616 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72580cd020 con 0x7f72580d15e0 2023-07-06T19:58:28.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.732+0000 7f7255d9b700 1 --2- 172.21.15.40:0/3870557616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72580d15e0 0x7f725806e320 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f724c009870 tx=0x7f724c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11e115e759461f69 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:28.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.732+0000 7f725559a700 1 -- 172.21.15.40:0/3870557616 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c004230 con 0x7f72580d15e0 2023-07-06T19:58:28.742 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.732+0000 7f725559a700 1 -- 172.21.15.40:0/3870557616 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724c004390 con 0x7f72580d15e0 2023-07-06T19:58:28.743 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.732+0000 7f725559a700 1 -- 172.21.15.40:0/3870557616 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c0036a0 con 0x7f72580d15e0 2023-07-06T19:58:28.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.733+0000 7f725c9ac700 1 -- 172.21.15.40:0/3870557616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72580d15e0 msgr2=0x7f725806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:28.745 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.733+0000 7f725c9ac700 1 --2- 172.21.15.40:0/3870557616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72580d15e0 0x7f725806e320 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f724c009870 tx=0x7f724c009b80 comp rx=0 tx=0).stop 2023-07-06T19:58:28.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.733+0000 7f725c9ac700 1 -- 172.21.15.40:0/3870557616 shutdown_connections 2023-07-06T19:58:28.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.733+0000 7f725c9ac700 1 --2- 172.21.15.40:0/3870557616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72580d15e0 0x7f725806e320 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.733+0000 7f725c9ac700 1 -- 172.21.15.40:0/3870557616 >> 172.21.15.40:0/3870557616 conn(0x7f72580ce120 msgr2=0x7f72580d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:28.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.733+0000 7f725c9ac700 1 -- 172.21.15.40:0/3870557616 shutdown_connections 2023-07-06T19:58:28.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.733+0000 7f725c9ac700 1 -- 172.21.15.40:0/3870557616 wait complete. 2023-07-06T19:58:28.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.735+0000 7f725c9ac700 1 Processor -- start 2023-07-06T19:58:28.746 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.735+0000 7f725c9ac700 1 -- start start 2023-07-06T19:58:28.747 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.736+0000 7f725c9ac700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72580ce860 0x7f72580b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:28.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.736+0000 7f725c9ac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72580d15e0 0x7f72580c9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:28.754 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.736+0000 7f725c9ac700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f725815a520 0x7f7258144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:28.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.736+0000 7f725c9ac700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72580c9590 con 0x7f72580d15e0 2023-07-06T19:58:28.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.736+0000 7f725c9ac700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72580c7fb0 con 0x7f72580ce860 2023-07-06T19:58:28.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.736+0000 7f725c9ac700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72580c8290 con 0x7f725815a520 2023-07-06T19:58:28.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.736+0000 7f725659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72580ce860 0x7f72580b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:28.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.736+0000 7f725659c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72580ce860 0x7f72580b2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52706/0 (socket says 172.21.15.40:52706) 2023-07-06T19:58:28.755 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.736+0000 7f725659c700 1 -- 172.21.15.40:0/2004987767 learned_addr learned my addr 172.21.15.40:0/2004987767 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-07-06T19:58:28.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.736+0000 7f7255d9b700 1 --2- 172.21.15.40:0/2004987767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72580d15e0 0x7f72580c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:28.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.736+0000 7f7256d9d700 1 --2- 172.21.15.40:0/2004987767 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f725815a520 0x7f7258144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:28.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.736+0000 7f725659c700 1 -- 172.21.15.40:0/2004987767 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f725815a520 msgr2=0x7f7258144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:28.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.736+0000 7f725659c700 1 --2- 172.21.15.40:0/2004987767 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f725815a520 0x7f7258144b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.736+0000 7f725659c700 1 -- 172.21.15.40:0/2004987767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72580d15e0 msgr2=0x7f72580c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:28.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.736+0000 7f725659c700 1 --2- 172.21.15.40:0/2004987767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72580d15e0 0x7f72580c9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.736+0000 7f725659c700 1 -- 172.21.15.40:0/2004987767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f724c0094a0 con 0x7f72580ce860 2023-07-06T19:58:28.756 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.736+0000 7f7255d9b700 1 --2- 172.21.15.40:0/2004987767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72580d15e0 0x7f72580c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:58:28.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.736+0000 7f725659c700 1 --2- 172.21.15.40:0/2004987767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72580ce860 0x7f72580b2520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f724800c730 tx=0x7f724800ca40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:28.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.737+0000 7f7246ffd700 1 -- 172.21.15.40:0/2004987767 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248005d70 con 0x7f72580ce860 2023-07-06T19:58:28.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.737+0000 7f7246ffd700 1 -- 172.21.15.40:0/2004987767 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72480070d0 con 0x7f72580ce860 2023-07-06T19:58:28.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.737+0000 7f725c9ac700 1 -- 172.21.15.40:0/2004987767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72580c8570 con 0x7f72580ce860 2023-07-06T19:58:28.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.737+0000 7f7246ffd700 1 -- 172.21.15.40:0/2004987767 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248007440 con 0x7f72580ce860 2023-07-06T19:58:28.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.737+0000 7f725c9ac700 1 -- 172.21.15.40:0/2004987767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72580c8b30 con 0x7f72580ce860 2023-07-06T19:58:28.757 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.737+0000 7f7246ffd700 1 -- 172.21.15.40:0/2004987767 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f724801c440 con 0x7f72580ce860 2023-07-06T19:58:28.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.737+0000 7f7246ffd700 1 -- 172.21.15.40:0/2004987767 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f7248012910 con 0x7f72580ce860 2023-07-06T19:58:28.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.738+0000 7f725c9ac700 1 -- 172.21.15.40:0/2004987767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f725804eb90 con 0x7f72580ce860 2023-07-06T19:58:28.758 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.740+0000 7f7246ffd700 1 -- 172.21.15.40:0/2004987767 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f7248021060 con 0x7f72580ce860 2023-07-06T19:58:28.827 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.825+0000 7f725c9ac700 1 -- 172.21.15.40:0/2004987767 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd new", "uuid": "07ca1701-14b7-4e9a-979f-81da9da5d661", "id": 4} v 0) v1 -- 0x7f7258159220 con 0x7f72580ce860 2023-07-06T19:58:28.837 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.833+0000 7f7246ffd700 1 -- 172.21.15.40:0/2004987767 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "07ca1701-14b7-4e9a-979f-81da9da5d661", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7248017070 con 0x7f72580ce860 2023-07-06T19:58:28.837 INFO:teuthology.orchestra.run.smithi040.stdout:4 2023-07-06T19:58:28.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.834+0000 7f725c9ac700 1 -- 172.21.15.40:0/2004987767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72580ce860 msgr2=0x7f72580b2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:28.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.834+0000 7f725c9ac700 1 --2- 172.21.15.40:0/2004987767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72580ce860 0x7f72580b2520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f724800c730 tx=0x7f724800ca40 comp rx=0 tx=0).stop 2023-07-06T19:58:28.838 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.834+0000 7f725c9ac700 1 -- 172.21.15.40:0/2004987767 shutdown_connections 2023-07-06T19:58:28.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.834+0000 7f725c9ac700 1 --2- 172.21.15.40:0/2004987767 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f725815a520 0x7f7258144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.834+0000 7f725c9ac700 1 --2- 172.21.15.40:0/2004987767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72580ce860 0x7f72580b2520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.834+0000 7f725c9ac700 1 --2- 172.21.15.40:0/2004987767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72580d15e0 0x7f72580c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:28.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.834+0000 7f725c9ac700 1 -- 172.21.15.40:0/2004987767 >> 172.21.15.40:0/2004987767 conn(0x7f72580ce120 msgr2=0x7f7258159440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:28.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.834+0000 7f725c9ac700 1 -- 172.21.15.40:0/2004987767 shutdown_connections 2023-07-06T19:58:28.839 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:28.834+0000 7f725c9ac700 1 -- 172.21.15.40:0/2004987767 wait complete. 2023-07-06T19:58:28.848 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 93eea16b-8153-4f84-9b3c-b4f6c7a592e5 5 2023-07-06T19:58:29.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.024+0000 7f8c63e69700 1 Processor -- start 2023-07-06T19:58:29.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.024+0000 7f8c63e69700 1 -- start start 2023-07-06T19:58:29.030 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.025+0000 7f8c63e69700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c5c15c660 0x7f8c5c167420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:29.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.025+0000 7f8c63e69700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c5c0cb310 con 0x7f8c5c0ca850 2023-07-06T19:58:29.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.025+0000 7f8c63e69700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c5c0af070 con 0x7f8c5c071900 2023-07-06T19:58:29.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.025+0000 7f8c63e69700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c5c0cdbf0 con 0x7f8c5c15c660 2023-07-06T19:58:29.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.025+0000 7f8c61c05700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8c5c071900 0x7f8c5c0ca140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52942/0 (socket says 172.21.15.40:52942) 2023-07-06T19:58:29.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.025+0000 7f8c61c05700 1 -- 172.21.15.40:0/1908808281 learned_addr learned my addr 172.21.15.40:0/1908808281 (peer_addr_for_me v1:172.21.15.40:0/0) 2023-07-06T19:58:29.031 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.025+0000 7f8c62406700 1 --2- 172.21.15.40:0/1908808281 >> v2:172.21.15.6:3300/0 conn(0x7f8c5c15c660 0x7f8c5c167420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:29.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.026+0000 7f8c60c03700 1 -- 172.21.15.40:0/1908808281 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033684447 0 0) 0x7f8c5c0af070 con 0x7f8c5c071900 2023-07-06T19:58:29.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.026+0000 7f8c60c03700 1 -- 172.21.15.40:0/1908808281 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c480035b0 con 0x7f8c5c071900 2023-07-06T19:58:29.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.026+0000 7f8c60c03700 1 -- 172.21.15.40:0/1908808281 <== mon.1 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 933657395 0 0) 0x7f8c480035b0 con 0x7f8c5c071900 2023-07-06T19:58:29.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.026+0000 7f8c60c03700 1 -- 172.21.15.40:0/1908808281 >> v2:172.21.15.6:3300/0 conn(0x7f8c5c15c660 msgr2=0x7f8c5c167420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:29.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.026+0000 7f8c60c03700 1 --2- 172.21.15.40:0/1908808281 >> v2:172.21.15.6:3300/0 conn(0x7f8c5c15c660 0x7f8c5c167420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.026+0000 7f8c60c03700 1 -- 172.21.15.40:0/1908808281 >> v1:172.21.15.6:6789/0 conn(0x7f8c5c0ca850 legacy=0x7f8c5c15bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:29.032 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.026+0000 7f8c60c03700 1 -- 172.21.15.40:0/1908808281 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c0cad50 con 0x7f8c5c071900 2023-07-06T19:58:29.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.026+0000 7f8c60c03700 1 -- 172.21.15.40:0/1908808281 <== mon.1 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f8c58001670 con 0x7f8c5c071900 2023-07-06T19:58:29.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.026+0000 7f8c60c03700 1 -- 172.21.15.40:0/1908808281 >> v1:172.21.15.40:6789/0 conn(0x7f8c5c071900 legacy=0x7f8c5c0ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:29.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.026+0000 7f8c60c03700 1 --2- 172.21.15.40:0/1908808281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c48003a00 0x7f8c48003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:29.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.026+0000 7f8c60c03700 1 --2- 172.21.15.40:0/1908808281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c48004850 0x7f8c48004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:29.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.026+0000 7f8c60c03700 1 --2- 172.21.15.40:0/1908808281 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c48005270 0x7f8c4800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:29.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.026+0000 7f8c60c03700 1 -- 172.21.15.40:0/1908808281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c0cdbf0 con 0x7f8c48004850 2023-07-06T19:58:29.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.026+0000 7f8c60c03700 1 -- 172.21.15.40:0/1908808281 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4800c1b0 con 0x7f8c48003a00 2023-07-06T19:58:29.033 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.026+0000 7f8c60c03700 1 -- 172.21.15.40:0/1908808281 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4800c370 con 0x7f8c48005270 2023-07-06T19:58:29.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.026+0000 7f8c61c05700 1 --2- 172.21.15.40:0/1908808281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c48003a00 0x7f8c48003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:29.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.026+0000 7f8c62406700 1 --2- 172.21.15.40:0/1908808281 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c48005270 0x7f8c4800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:29.034 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.026+0000 7f8c61c05700 1 -- 172.21.15.40:0/1908808281 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c48005270 msgr2=0x7f8c4800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:29.072 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.026+0000 7f8c61c05700 1 --2- 172.21.15.40:0/1908808281 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c48005270 0x7f8c4800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.026+0000 7f8c61c05700 1 -- 172.21.15.40:0/1908808281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c48004850 msgr2=0x7f8c48004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:29.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.026+0000 7f8c61c05700 1 --2- 172.21.15.40:0/1908808281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c48004850 0x7f8c48004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.027+0000 7f8c61c05700 1 -- 172.21.15.40:0/1908808281 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c480035b0 con 0x7f8c48003a00 2023-07-06T19:58:29.073 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.027+0000 7f8c62406700 1 --2- 172.21.15.40:0/1908808281 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c48005270 0x7f8c4800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:58:29.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.027+0000 7f8c62406700 1 -- 172.21.15.40:0/1908808281 reap_dead start 2023-07-06T19:58:29.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.027+0000 7f8c61c05700 1 --2- 172.21.15.40:0/1908808281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c48003a00 0x7f8c48003df0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800c2f0 tx=0x7f8c48005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da3c2e286107818d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:29.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.027+0000 7f8c60c03700 1 -- 172.21.15.40:0/1908808281 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5800cd70 con 0x7f8c48003a00 2023-07-06T19:58:29.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.027+0000 7f8c60c03700 1 -- 172.21.15.40:0/1908808281 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c58005960 con 0x7f8c48003a00 2023-07-06T19:58:29.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.027+0000 7f8c60c03700 1 -- 172.21.15.40:0/1908808281 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c58005cf0 con 0x7f8c48003a00 2023-07-06T19:58:29.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.027+0000 7f8c63e69700 1 -- 172.21.15.40:0/1908808281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c48003a00 msgr2=0x7f8c48003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:29.074 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.027+0000 7f8c63e69700 1 --2- 172.21.15.40:0/1908808281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c48003a00 0x7f8c48003df0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800c2f0 tx=0x7f8c48005880 comp rx=0 tx=0).stop 2023-07-06T19:58:29.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.027+0000 7f8c63e69700 1 -- 172.21.15.40:0/1908808281 shutdown_connections 2023-07-06T19:58:29.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.027+0000 7f8c63e69700 1 --2- 172.21.15.40:0/1908808281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c48003a00 0x7f8c48003df0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.027+0000 7f8c63e69700 1 -- 172.21.15.40:0/1908808281 >> 172.21.15.40:0/1908808281 conn(0x7f8c5c0cf960 msgr2=0x7f8c5c0cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:29.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.028+0000 7f8c63e69700 1 -- 172.21.15.40:0/1908808281 shutdown_connections 2023-07-06T19:58:29.075 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.028+0000 7f8c63e69700 1 -- 172.21.15.40:0/1908808281 wait complete. 2023-07-06T19:58:29.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.029+0000 7f8c63e69700 1 Processor -- start 2023-07-06T19:58:29.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.029+0000 7f8c63e69700 1 -- start start 2023-07-06T19:58:29.078 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.030+0000 7f8c63e69700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c48003a00 0x7f8c5c0c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:29.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.030+0000 7f8c63e69700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c144c70 0x7f8c5c1450e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:29.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.030+0000 7f8c63e69700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c5c1515b0 0x7f8c5c151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:29.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.030+0000 7f8c63e69700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c145620 con 0x7f8c5c144c70 2023-07-06T19:58:29.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.030+0000 7f8c63e69700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c0ad450 con 0x7f8c5c1515b0 2023-07-06T19:58:29.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.030+0000 7f8c63e69700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c0ad730 con 0x7f8c48003a00 2023-07-06T19:58:29.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.030+0000 7f8c61c05700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c48003a00 0x7f8c5c0c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:29.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.030+0000 7f8c61c05700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c48003a00 0x7f8c5c0c6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41434/0 (socket says 172.21.15.40:41434) 2023-07-06T19:58:29.079 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.030+0000 7f8c62406700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c5c1515b0 0x7f8c5c151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:29.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.030+0000 7f8c61c05700 1 -- 172.21.15.40:0/1802753877 learned_addr learned my addr 172.21.15.40:0/1802753877 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-07-06T19:58:29.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.030+0000 7f8c62406700 1 -- 172.21.15.40:0/1802753877 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c48003a00 msgr2=0x7f8c5c0c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:29.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.030+0000 7f8c62406700 1 --2- 172.21.15.40:0/1802753877 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c48003a00 0x7f8c5c0c6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.030+0000 7f8c62406700 1 -- 172.21.15.40:0/1802753877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c144c70 msgr2=0x7f8c5c1450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:29.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.030+0000 7f8c62406700 1 --2- 172.21.15.40:0/1802753877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c144c70 0x7f8c5c1450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.030+0000 7f8c62406700 1 -- 172.21.15.40:0/1802753877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c0ada10 con 0x7f8c5c1515b0 2023-07-06T19:58:29.080 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.030+0000 7f8c61c05700 1 --2- 172.21.15.40:0/1802753877 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c48003a00 0x7f8c5c0c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:58:29.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.030+0000 7f8c62406700 1 --2- 172.21.15.40:0/1802753877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c5c1515b0 0x7f8c5c151a20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c15ca30 tx=0x7f8c5400f490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:29.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.030+0000 7f8c527fc700 1 -- 172.21.15.40:0/1802753877 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5401c070 con 0x7f8c5c1515b0 2023-07-06T19:58:29.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.030+0000 7f8c527fc700 1 -- 172.21.15.40:0/1802753877 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5400f040 con 0x7f8c5c1515b0 2023-07-06T19:58:29.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.030+0000 7f8c527fc700 1 -- 172.21.15.40:0/1802753877 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5400e040 con 0x7f8c5c1515b0 2023-07-06T19:58:29.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.030+0000 7f8c63e69700 1 -- 172.21.15.40:0/1802753877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c5c0adcf0 con 0x7f8c5c1515b0 2023-07-06T19:58:29.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.030+0000 7f8c63e69700 1 -- 172.21.15.40:0/1802753877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c5c151f60 con 0x7f8c5c1515b0 2023-07-06T19:58:29.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.031+0000 7f8c527fc700 1 -- 172.21.15.40:0/1802753877 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8c54003d20 con 0x7f8c5c1515b0 2023-07-06T19:58:29.081 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.031+0000 7f8c527fc700 1 -- 172.21.15.40:0/1802753877 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f8c54004700 con 0x7f8c5c1515b0 2023-07-06T19:58:29.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.031+0000 7f8c63e69700 1 -- 172.21.15.40:0/1802753877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c5c0ae210 con 0x7f8c5c1515b0 2023-07-06T19:58:29.082 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.033+0000 7f8c527fc700 1 -- 172.21.15.40:0/1802753877 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f8c5c0ae210 con 0x7f8c5c1515b0 2023-07-06T19:58:29.167 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:29.165+0000 7f462dfcc200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-06T19:58:29.179 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.176+0000 7f8c63e69700 1 -- 172.21.15.40:0/1802753877 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd new", "uuid": "93eea16b-8153-4f84-9b3c-b4f6c7a592e5", "id": 5} v 0) v1 -- 0x7f8c5c04eb90 con 0x7f8c5c1515b0 2023-07-06T19:58:29.187 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.184+0000 7f8c527fc700 1 -- 172.21.15.40:0/1802753877 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "93eea16b-8153-4f84-9b3c-b4f6c7a592e5", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8c5402f0b0 con 0x7f8c5c1515b0 2023-07-06T19:58:29.187 INFO:teuthology.orchestra.run.smithi040.stdout:5 2023-07-06T19:58:29.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.185+0000 7f8c63e69700 1 -- 172.21.15.40:0/1802753877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c5c1515b0 msgr2=0x7f8c5c151a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:29.188 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.185+0000 7f8c63e69700 1 --2- 172.21.15.40:0/1802753877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c5c1515b0 0x7f8c5c151a20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c15ca30 tx=0x7f8c5400f490 comp rx=0 tx=0).stop 2023-07-06T19:58:29.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.185+0000 7f8c63e69700 1 -- 172.21.15.40:0/1802753877 shutdown_connections 2023-07-06T19:58:29.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.185+0000 7f8c63e69700 1 --2- 172.21.15.40:0/1802753877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c5c1515b0 0x7f8c5c151a20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.185+0000 7f8c63e69700 1 --2- 172.21.15.40:0/1802753877 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c48003a00 0x7f8c5c0c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.185+0000 7f8c63e69700 1 --2- 172.21.15.40:0/1802753877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c144c70 0x7f8c5c1450e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.185+0000 7f8c63e69700 1 -- 172.21.15.40:0/1802753877 >> 172.21.15.40:0/1802753877 conn(0x7f8c5c0cf960 msgr2=0x7f8c5c15eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:29.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.186+0000 7f8c63e69700 1 -- 172.21.15.40:0/1802753877 shutdown_connections 2023-07-06T19:58:29.189 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.186+0000 7f8c63e69700 1 -- 172.21.15.40:0/1802753877 wait complete. 2023-07-06T19:58:29.200 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new a299a0dc-d67d-4d1e-9e3b-fa3cfb242573 6 2023-07-06T19:58:29.257 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:29.252+0000 7f6e0fdcf200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-06T19:58:29.329 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:29.326+0000 7f462dfcc200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T19:58:29.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.326+0000 7f37d2ee8700 1 Processor -- start 2023-07-06T19:58:29.329 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.326+0000 7f37d2ee8700 1 -- start start 2023-07-06T19:58:29.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.327+0000 7f37d2ee8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37cc0c9c40 0x7f37cc0cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:29.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.327+0000 7f37d2ee8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f37cc0cf6f0 0x7f37cc0cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:29.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.327+0000 7f37d2ee8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f37cc15cae0 0x7f37cc15cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:29.331 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.327+0000 7f37d2ee8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37cc0ca010 con 0x7f37cc15cae0 2023-07-06T19:58:29.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.327+0000 7f37d2ee8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37cc0cf260 con 0x7f37cc0cf6f0 2023-07-06T19:58:29.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.327+0000 7f37d2ee8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc15d8a0 con 0x7f37cc0c9c40 2023-07-06T19:58:29.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.327+0000 7f37cbfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f37cc0cf6f0 0x7f37cc0cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:29.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.327+0000 7f37d0c84700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37cc0c9c40 0x7f37cc0cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:29.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.327+0000 7f37d0c84700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37cc0c9c40 0x7f37cc0cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41440/0 (socket says 172.21.15.40:41440) 2023-07-06T19:58:29.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.327+0000 7f37cbfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f37cc0cf6f0 0x7f37cc0cbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52730/0 (socket says 172.21.15.40:52730) 2023-07-06T19:58:29.332 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.327+0000 7f37d0c84700 1 -- 172.21.15.40:0/39788025 learned_addr learned my addr 172.21.15.40:0/39788025 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-07-06T19:58:29.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.328+0000 7f37d1485700 1 --2- 172.21.15.40:0/39788025 >> v2:172.21.15.6:3300/0 conn(0x7f37cc15cae0 0x7f37cc15cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:29.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.328+0000 7f37d0c84700 1 -- 172.21.15.40:0/39788025 >> v2:172.21.15.40:3300/0 conn(0x7f37cc0cf6f0 msgr2=0x7f37cc0cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:29.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.328+0000 7f37d0c84700 1 --2- 172.21.15.40:0/39788025 >> v2:172.21.15.40:3300/0 conn(0x7f37cc0cf6f0 0x7f37cc0cbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.328+0000 7f37d0c84700 1 -- 172.21.15.40:0/39788025 >> v2:172.21.15.6:3300/0 conn(0x7f37cc15cae0 msgr2=0x7f37cc15cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:29.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.328+0000 7f37d0c84700 1 --2- 172.21.15.40:0/39788025 >> v2:172.21.15.6:3300/0 conn(0x7f37cc15cae0 0x7f37cc15cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.328+0000 7f37d0c84700 1 -- 172.21.15.40:0/39788025 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37cc0ce930 con 0x7f37cc0c9c40 2023-07-06T19:58:29.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.328+0000 7f37cbfff700 1 --2- 172.21.15.40:0/39788025 >> v2:172.21.15.40:3300/0 conn(0x7f37cc0cf6f0 0x7f37cc0cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:58:29.333 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.328+0000 7f37d0c84700 1 --2- 172.21.15.40:0/39788025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37cc0c9c40 0x7f37cc0cba60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f37cc0b1ad0 tx=0x7f37c0009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a950bceec207634e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:29.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.328+0000 7f37cb7fe700 1 -- 172.21.15.40:0/39788025 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c0011830 con 0x7f37cc0c9c40 2023-07-06T19:58:29.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.328+0000 7f37cb7fe700 1 -- 172.21.15.40:0/39788025 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c0011990 con 0x7f37cc0c9c40 2023-07-06T19:58:29.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.328+0000 7f37cb7fe700 1 -- 172.21.15.40:0/39788025 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c0011d20 con 0x7f37cc0c9c40 2023-07-06T19:58:29.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.329+0000 7f37d2ee8700 1 -- 172.21.15.40:0/39788025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37cc0c9c40 msgr2=0x7f37cc0cba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:29.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.329+0000 7f37d2ee8700 1 --2- 172.21.15.40:0/39788025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37cc0c9c40 0x7f37cc0cba60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f37cc0b1ad0 tx=0x7f37c0009bd0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.334 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.329+0000 7f37d2ee8700 1 -- 172.21.15.40:0/39788025 shutdown_connections 2023-07-06T19:58:29.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.329+0000 7f37d2ee8700 1 --2- 172.21.15.40:0/39788025 >> v2:172.21.15.6:3300/0 conn(0x7f37cc15cae0 0x7f37cc15cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.329+0000 7f37d2ee8700 1 --2- 172.21.15.40:0/39788025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37cc0c9c40 0x7f37cc0cba60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.329+0000 7f37d2ee8700 1 --2- 172.21.15.40:0/39788025 >> v2:172.21.15.40:3300/0 conn(0x7f37cc0cf6f0 0x7f37cc0cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.329+0000 7f37d2ee8700 1 -- 172.21.15.40:0/39788025 >> 172.21.15.40:0/39788025 conn(0x7f37cc0b0b60 msgr2=0x7f37cc0b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:29.344 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.329+0000 7f37d2ee8700 1 -- 172.21.15.40:0/39788025 shutdown_connections 2023-07-06T19:58:29.345 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.329+0000 7f37d2ee8700 1 -- 172.21.15.40:0/39788025 wait complete. 2023-07-06T19:58:29.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.330+0000 7f37d2ee8700 1 Processor -- start 2023-07-06T19:58:29.347 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.330+0000 7f37d2ee8700 1 -- start start 2023-07-06T19:58:29.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.331+0000 7f37d2ee8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37cc0c9c40 0x7f37cc0ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:29.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.331+0000 7f37d2ee8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37cc0cf6f0 0x7f37cc1556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:29.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.331+0000 7f37d2ee8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37cc15cae0 0x7f37cc0c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:29.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.331+0000 7f37d2ee8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc0c78c0 con 0x7f37cc0c9c40 2023-07-06T19:58:29.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.331+0000 7f37d2ee8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc155c00 con 0x7f37cc0cf6f0 2023-07-06T19:58:29.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.331+0000 7f37d2ee8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37cc0abd50 con 0x7f37cc15cae0 2023-07-06T19:58:29.348 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.331+0000 7f37d1485700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37cc15cae0 0x7f37cc0c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:29.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.331+0000 7f37cbfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37cc0cf6f0 0x7f37cc1556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:29.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.331+0000 7f37cbfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37cc0cf6f0 0x7f37cc1556c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52734/0 (socket says 172.21.15.40:52734) 2023-07-06T19:58:29.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.331+0000 7f37d1485700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37cc15cae0 0x7f37cc0c26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41448/0 (socket says 172.21.15.40:41448) 2023-07-06T19:58:29.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.331+0000 7f37cbfff700 1 -- 172.21.15.40:0/1490404593 learned_addr learned my addr 172.21.15.40:0/1490404593 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-07-06T19:58:29.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.331+0000 7f37d0c84700 1 --2- 172.21.15.40:0/1490404593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37cc0c9c40 0x7f37cc0ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:29.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.332+0000 7f37d0c84700 1 -- 172.21.15.40:0/1490404593 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37cc15cae0 msgr2=0x7f37cc0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:29.349 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.332+0000 7f37d0c84700 1 --2- 172.21.15.40:0/1490404593 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37cc15cae0 0x7f37cc0c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.332+0000 7f37d0c84700 1 -- 172.21.15.40:0/1490404593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37cc0cf6f0 msgr2=0x7f37cc1556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:29.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.332+0000 7f37d0c84700 1 --2- 172.21.15.40:0/1490404593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37cc0cf6f0 0x7f37cc1556c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.332+0000 7f37d0c84700 1 -- 172.21.15.40:0/1490404593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b80094a0 con 0x7f37cc0c9c40 2023-07-06T19:58:29.350 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.332+0000 7f37d1485700 1 --2- 172.21.15.40:0/1490404593 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37cc15cae0 0x7f37cc0c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:58:29.351 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.332+0000 7f37cbfff700 1 --2- 172.21.15.40:0/1490404593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37cc0cf6f0 0x7f37cc1556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:58:29.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.332+0000 7f37d0c84700 1 --2- 172.21.15.40:0/1490404593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37cc0c9c40 0x7f37cc0ae210 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f37c0016000 tx=0x7f37c0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:29.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.332+0000 7f37c97fa700 1 -- 172.21.15.40:0/1490404593 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c0004450 con 0x7f37cc0c9c40 2023-07-06T19:58:29.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.332+0000 7f37c97fa700 1 -- 172.21.15.40:0/1490404593 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c001e070 con 0x7f37cc0c9c40 2023-07-06T19:58:29.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.332+0000 7f37d2ee8700 1 -- 172.21.15.40:0/1490404593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c0009550 con 0x7f37cc0c9c40 2023-07-06T19:58:29.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.332+0000 7f37c97fa700 1 -- 172.21.15.40:0/1490404593 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c00038e0 con 0x7f37cc0c9c40 2023-07-06T19:58:29.352 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.332+0000 7f37d2ee8700 1 -- 172.21.15.40:0/1490404593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37cc0c7df0 con 0x7f37cc0c9c40 2023-07-06T19:58:29.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.332+0000 7f37c97fa700 1 -- 172.21.15.40:0/1490404593 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f37c0003d40 con 0x7f37cc0c9c40 2023-07-06T19:58:29.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.332+0000 7f37c97fa700 1 -- 172.21.15.40:0/1490404593 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f37c002da90 con 0x7f37cc0c9c40 2023-07-06T19:58:29.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.333+0000 7f37d2ee8700 1 -- 172.21.15.40:0/1490404593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37cc04eb90 con 0x7f37cc0c9c40 2023-07-06T19:58:29.353 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.335+0000 7f37c97fa700 1 -- 172.21.15.40:0/1490404593 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f37c0044b00 con 0x7f37cc0c9c40 2023-07-06T19:58:29.419 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:29.416+0000 7f6e0fdcf200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-06T19:58:29.427 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.422+0000 7f37d2ee8700 1 -- 172.21.15.40:0/1490404593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a299a0dc-d67d-4d1e-9e3b-fa3cfb242573", "id": 6} v 0) v1 -- 0x7f37cc071dc0 con 0x7f37cc0c9c40 2023-07-06T19:58:29.437 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.429+0000 7f37c97fa700 1 -- 172.21.15.40:0/1490404593 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a299a0dc-d67d-4d1e-9e3b-fa3cfb242573", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f37c0033070 con 0x7f37cc0c9c40 2023-07-06T19:58:29.437 INFO:teuthology.orchestra.run.smithi040.stdout:6 2023-07-06T19:58:29.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.430+0000 7f37d2ee8700 1 -- 172.21.15.40:0/1490404593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37cc0c9c40 msgr2=0x7f37cc0ae210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:29.438 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.430+0000 7f37d2ee8700 1 --2- 172.21.15.40:0/1490404593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37cc0c9c40 0x7f37cc0ae210 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f37c0016000 tx=0x7f37c0004750 comp rx=0 tx=0).stop 2023-07-06T19:58:29.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.430+0000 7f37d2ee8700 1 -- 172.21.15.40:0/1490404593 shutdown_connections 2023-07-06T19:58:29.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.430+0000 7f37d2ee8700 1 --2- 172.21.15.40:0/1490404593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37cc0c9c40 0x7f37cc0ae210 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.430+0000 7f37d2ee8700 1 --2- 172.21.15.40:0/1490404593 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f37cc15cae0 0x7f37cc0c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.430+0000 7f37d2ee8700 1 --2- 172.21.15.40:0/1490404593 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f37cc0cf6f0 0x7f37cc1556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.439 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.430+0000 7f37d2ee8700 1 -- 172.21.15.40:0/1490404593 >> 172.21.15.40:0/1490404593 conn(0x7f37cc0b0b60 msgr2=0x7f37cc06b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:29.442 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.430+0000 7f37d2ee8700 1 -- 172.21.15.40:0/1490404593 shutdown_connections 2023-07-06T19:58:29.443 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.430+0000 7f37d2ee8700 1 -- 172.21.15.40:0/1490404593 wait complete. 2023-07-06T19:58:29.445 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd new 29025007-fca2-41ed-91f2-2f6dfe833897 7 2023-07-06T19:58:29.572 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.567+0000 7fcfa9c28700 1 Processor -- start 2023-07-06T19:58:29.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.567+0000 7fcfa9c28700 1 -- start start 2023-07-06T19:58:29.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.568+0000 7fcfa9c28700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcfa41592b0 0x7fcfa4071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:29.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.568+0000 7fcfa9c28700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcfa415cd40 0x7fcfa4071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:29.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.568+0000 7fcfa9c28700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfa40cd950 0x7fcfa406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:29.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.568+0000 7fcfa9c28700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa4159680 con 0x7fcfa415cd40 2023-07-06T19:58:29.573 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.568+0000 7fcfa9c28700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa415d2b0 con 0x7fcfa41592b0 2023-07-06T19:58:29.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.568+0000 7fcfa9c28700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa415d590 con 0x7fcfa40cd950 2023-07-06T19:58:29.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.569+0000 7fcfa37fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcfa41592b0 0x7fcfa4071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:29.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.569+0000 7fcfa3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfa40cd950 0x7fcfa406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:29.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.569+0000 7fcfa37fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcfa41592b0 0x7fcfa4071690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52740/0 (socket says 172.21.15.40:52740) 2023-07-06T19:58:29.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.569+0000 7fcfa37fe700 1 -- 172.21.15.40:0/2660607749 learned_addr learned my addr 172.21.15.40:0/2660607749 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-07-06T19:58:29.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.569+0000 7fcfa2ffd700 1 --2- 172.21.15.40:0/2660607749 >> v2:172.21.15.6:3300/0 conn(0x7fcfa415cd40 0x7fcfa4071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:29.574 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.569+0000 7fcfa37fe700 1 -- 172.21.15.40:0/2660607749 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfa40cd950 msgr2=0x7fcfa406d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:29.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.569+0000 7fcfa37fe700 1 --2- 172.21.15.40:0/2660607749 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfa40cd950 0x7fcfa406d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.569+0000 7fcfa37fe700 1 -- 172.21.15.40:0/2660607749 >> v2:172.21.15.6:3300/0 conn(0x7fcfa415cd40 msgr2=0x7fcfa4071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:29.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.569+0000 7fcfa37fe700 1 --2- 172.21.15.40:0/2660607749 >> v2:172.21.15.6:3300/0 conn(0x7fcfa415cd40 0x7fcfa4071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.569+0000 7fcfa37fe700 1 -- 172.21.15.40:0/2660607749 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa415d870 con 0x7fcfa41592b0 2023-07-06T19:58:29.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.569+0000 7fcfa3fff700 1 --2- 172.21.15.40:0/2660607749 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfa40cd950 0x7fcfa406d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:58:29.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.569+0000 7fcfa37fe700 1 --2- 172.21.15.40:0/2660607749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfa41592b0 0x7fcfa4071690 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcfa406a800 tx=0x7fcf9400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=134126c367ab946a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:29.575 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.569+0000 7fcfa27fc700 1 -- 172.21.15.40:0/2660607749 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9400e070 con 0x7fcfa41592b0 2023-07-06T19:58:29.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.569+0000 7fcfa27fc700 1 -- 172.21.15.40:0/2660607749 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9400b910 con 0x7fcfa41592b0 2023-07-06T19:58:29.586 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.569+0000 7fcfa27fc700 1 -- 172.21.15.40:0/2660607749 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9400bcc0 con 0x7fcfa41592b0 2023-07-06T19:58:29.592 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.570+0000 7fcfa9c28700 1 -- 172.21.15.40:0/2660607749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfa41592b0 msgr2=0x7fcfa4071690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:29.593 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.570+0000 7fcfa9c28700 1 --2- 172.21.15.40:0/2660607749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfa41592b0 0x7fcfa4071690 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcfa406a800 tx=0x7fcf9400b330 comp rx=0 tx=0).stop 2023-07-06T19:58:29.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.570+0000 7fcfa9c28700 1 -- 172.21.15.40:0/2660607749 shutdown_connections 2023-07-06T19:58:29.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.570+0000 7fcfa9c28700 1 --2- 172.21.15.40:0/2660607749 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfa40cd950 0x7fcfa406d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.570+0000 7fcfa9c28700 1 --2- 172.21.15.40:0/2660607749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfa41592b0 0x7fcfa4071690 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.570+0000 7fcfa9c28700 1 --2- 172.21.15.40:0/2660607749 >> v2:172.21.15.6:3300/0 conn(0x7fcfa415cd40 0x7fcfa4071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.570+0000 7fcfa9c28700 1 -- 172.21.15.40:0/2660607749 >> 172.21.15.40:0/2660607749 conn(0x7fcfa40cf960 msgr2=0x7fcfa40cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:29.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.570+0000 7fcfa9c28700 1 -- 172.21.15.40:0/2660607749 shutdown_connections 2023-07-06T19:58:29.594 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.570+0000 7fcfa9c28700 1 -- 172.21.15.40:0/2660607749 wait complete. 2023-07-06T19:58:29.598 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.571+0000 7fcfa9c28700 1 Processor -- start 2023-07-06T19:58:29.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.571+0000 7fcfa9c28700 1 -- start start 2023-07-06T19:58:29.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.572+0000 7fcfa9c28700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfa40cd950 0x7fcfa40c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:29.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.572+0000 7fcfa9c28700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa41592b0 0x7fcfa40af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:29.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.572+0000 7fcfa9c28700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfa415cd40 0x7fcfa40af900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:29.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.572+0000 7fcfa9c28700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa415b180 con 0x7fcfa41592b0 2023-07-06T19:58:29.599 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.572+0000 7fcfa9c28700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa415a2d0 con 0x7fcfa40cd950 2023-07-06T19:58:29.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.572+0000 7fcfa9c28700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa40b2790 con 0x7fcfa415cd40 2023-07-06T19:58:29.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.572+0000 7fcfa3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfa415cd40 0x7fcfa40af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:29.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.572+0000 7fcfa37fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfa40cd950 0x7fcfa40c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:29.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.572+0000 7fcfa3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfa415cd40 0x7fcfa40af900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.40:41460/0 (socket says 172.21.15.40:41460) 2023-07-06T19:58:29.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.572+0000 7fcfa3fff700 1 -- 172.21.15.40:0/3949807806 learned_addr learned my addr 172.21.15.40:0/3949807806 (peer_addr_for_me v2:172.21.15.40:0/0) 2023-07-06T19:58:29.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.572+0000 7fcfa2ffd700 1 --2- 172.21.15.40:0/3949807806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa41592b0 0x7fcfa40af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:29.600 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.572+0000 7fcfa37fe700 1 -- 172.21.15.40:0/3949807806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfa415cd40 msgr2=0x7fcfa40af900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:29.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.572+0000 7fcfa37fe700 1 --2- 172.21.15.40:0/3949807806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfa415cd40 0x7fcfa40af900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.572+0000 7fcfa37fe700 1 -- 172.21.15.40:0/3949807806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa41592b0 msgr2=0x7fcfa40af3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:29.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.572+0000 7fcfa37fe700 1 --2- 172.21.15.40:0/3949807806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa41592b0 0x7fcfa40af3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.572+0000 7fcfa37fe700 1 -- 172.21.15.40:0/3949807806 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c0094a0 con 0x7fcfa40cd950 2023-07-06T19:58:29.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.573+0000 7fcfa37fe700 1 --2- 172.21.15.40:0/3949807806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfa40cd950 0x7fcfa40c55a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcf94015000 tx=0x7fcf94004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:29.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.573+0000 7fcf9bfff700 1 -- 172.21.15.40:0/3949807806 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf940099b0 con 0x7fcfa40cd950 2023-07-06T19:58:29.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.573+0000 7fcf9bfff700 1 -- 172.21.15.40:0/3949807806 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9400cea0 con 0x7fcfa40cd950 2023-07-06T19:58:29.601 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.573+0000 7fcfa9c28700 1 -- 172.21.15.40:0/3949807806 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf94009b30 con 0x7fcfa40cd950 2023-07-06T19:58:29.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.573+0000 7fcf9bfff700 1 -- 172.21.15.40:0/3949807806 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf94004470 con 0x7fcfa40cd950 2023-07-06T19:58:29.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.573+0000 7fcfa9c28700 1 -- 172.21.15.40:0/3949807806 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa415a7e0 con 0x7fcfa40cd950 2023-07-06T19:58:29.603 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.573+0000 7fcf9bfff700 1 -- 172.21.15.40:0/3949807806 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcf9401b430 con 0x7fcfa40cd950 2023-07-06T19:58:29.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.573+0000 7fcf9bfff700 1 -- 172.21.15.40:0/3949807806 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fcf9401bd40 con 0x7fcfa40cd950 2023-07-06T19:58:29.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.574+0000 7fcfa9c28700 1 -- 172.21.15.40:0/3949807806 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa404eb90 con 0x7fcfa40cd950 2023-07-06T19:58:29.605 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.576+0000 7fcf9bfff700 1 -- 172.21.15.40:0/3949807806 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fcf9401f030 con 0x7fcfa40cd950 2023-07-06T19:58:29.664 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.662+0000 7fcfa9c28700 1 -- 172.21.15.40:0/3949807806 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd new", "uuid": "29025007-fca2-41ed-91f2-2f6dfe833897", "id": 7} v 0) v1 -- 0x7fcfa4150220 con 0x7fcfa40cd950 2023-07-06T19:58:29.674 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.672+0000 7fcf9bfff700 1 -- 172.21.15.40:0/3949807806 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "29025007-fca2-41ed-91f2-2f6dfe833897", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcf9401b860 con 0x7fcfa40cd950 2023-07-06T19:58:29.674 INFO:teuthology.orchestra.run.smithi040.stdout:7 2023-07-06T19:58:29.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.673+0000 7fcfa9c28700 1 -- 172.21.15.40:0/3949807806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfa40cd950 msgr2=0x7fcfa40c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:29.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.673+0000 7fcfa9c28700 1 --2- 172.21.15.40:0/3949807806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfa40cd950 0x7fcfa40c55a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcf94015000 tx=0x7fcf94004ad0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.673+0000 7fcfa9c28700 1 -- 172.21.15.40:0/3949807806 shutdown_connections 2023-07-06T19:58:29.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.673+0000 7fcfa9c28700 1 --2- 172.21.15.40:0/3949807806 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfa415cd40 0x7fcfa40af900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.673+0000 7fcfa9c28700 1 --2- 172.21.15.40:0/3949807806 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfa40cd950 0x7fcfa40c55a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.676 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.673+0000 7fcfa9c28700 1 --2- 172.21.15.40:0/3949807806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfa41592b0 0x7fcfa40af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.673+0000 7fcfa9c28700 1 -- 172.21.15.40:0/3949807806 >> 172.21.15.40:0/3949807806 conn(0x7fcfa40cf960 msgr2=0x7fcfa40cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:29.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.673+0000 7fcfa9c28700 1 -- 172.21.15.40:0/3949807806 shutdown_connections 2023-07-06T19:58:29.677 INFO:teuthology.orchestra.run.smithi040.stderr:2023-07-06T19:58:29.673+0000 7fcfa9c28700 1 -- 172.21.15.40:0/3949807806 wait complete. 2023-07-06T19:58:29.687 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-06T19:58:29.687 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-06T19:58:29.691 INFO:tasks.ceph.osd.0:Started 2023-07-06T19:58:29.691 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-06T19:58:29.696 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-06T19:58:29.701 INFO:tasks.ceph.osd.1:Started 2023-07-06T19:58:29.702 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-06T19:58:29.702 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-06T19:58:29.719 INFO:tasks.ceph.osd.2:Started 2023-07-06T19:58:29.720 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-06T19:58:29.720 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-06T19:58:29.729 INFO:tasks.ceph.osd.3:Started 2023-07-06T19:58:29.730 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-06T19:58:29.730 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-06T19:58:29.733 INFO:tasks.ceph.osd.4:Started 2023-07-06T19:58:29.734 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-06T19:58:29.734 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-06T19:58:29.737 INFO:tasks.ceph.osd.5:Started 2023-07-06T19:58:29.738 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-06T19:58:29.738 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-06T19:58:29.756 INFO:tasks.ceph.osd.6:Started 2023-07-06T19:58:29.756 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-06T19:58:29.756 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-06T19:58:29.770 INFO:tasks.ceph.osd.7:Started 2023-07-06T19:58:29.771 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T19:58:29.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.908+0000 7f7589a83700 1 Processor -- start 2023-07-06T19:58:29.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.908+0000 7f7589a83700 1 -- start start 2023-07-06T19:58:29.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.909+0000 7f7589a83700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f75840ceab0 0x7f75840caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:29.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.909+0000 7f7589a83700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7584160ff0 con 0x7f75840cee80 2023-07-06T19:58:29.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.909+0000 7f7589a83700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75840ca100 con 0x7f7584071dd0 2023-07-06T19:58:29.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.909+0000 7f7589a83700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75840cb400 con 0x7f75840ceab0 2023-07-06T19:58:29.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.909+0000 7f75837fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f75840ceab0 0x7f75840caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:29.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.909+0000 7f7582ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f75840cee80 0x7f75840716c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58934/0 (socket says 172.21.15.6:58934) 2023-07-06T19:58:29.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.909+0000 7f7582ffd700 1 -- 172.21.15.6:0/1225421363 learned_addr learned my addr 172.21.15.6:0/1225421363 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:58:29.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.910+0000 7f75837fe700 1 -- 172.21.15.6:0/1225421363 >> v1:172.21.15.40:6789/0 conn(0x7f7584071dd0 legacy=0x7f75841602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:29.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.910+0000 7f75837fe700 1 -- 172.21.15.6:0/1225421363 >> v1:172.21.15.6:6789/0 conn(0x7f75840cee80 legacy=0x7f75840716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:29.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.910+0000 7f75827fc700 1 -- 172.21.15.6:0/1225421363 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2947394218 0 0) 0x7f75840ca100 con 0x7f7584071dd0 2023-07-06T19:58:29.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.910+0000 7f75837fe700 1 -- 172.21.15.6:0/1225421363 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75840ca3e0 con 0x7f75840ceab0 2023-07-06T19:58:29.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.910+0000 7f75837fe700 1 --2- 172.21.15.6:0/1225421363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75840ceab0 0x7f75840caec0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7574009840 tx=0x7f7574009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54bdf28db239612 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:29.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.910+0000 7f75827fc700 1 -- 172.21.15.6:0/1225421363 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574011830 con 0x7f75840ceab0 2023-07-06T19:58:29.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.910+0000 7f75827fc700 1 -- 172.21.15.6:0/1225421363 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7574011990 con 0x7f75840ceab0 2023-07-06T19:58:29.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.910+0000 7f75827fc700 1 -- 172.21.15.6:0/1225421363 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574011d20 con 0x7f75840ceab0 2023-07-06T19:58:29.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.910+0000 7f7589a83700 1 -- 172.21.15.6:0/1225421363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75840ceab0 msgr2=0x7f75840caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:29.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.910+0000 7f7589a83700 1 --2- 172.21.15.6:0/1225421363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75840ceab0 0x7f75840caec0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7574009840 tx=0x7f7574009b50 comp rx=0 tx=0).stop 2023-07-06T19:58:29.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.910+0000 7f7589a83700 1 -- 172.21.15.6:0/1225421363 shutdown_connections 2023-07-06T19:58:29.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.910+0000 7f7589a83700 1 --2- 172.21.15.6:0/1225421363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75840ceab0 0x7f75840caec0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.911+0000 7f7589a83700 1 -- 172.21.15.6:0/1225421363 >> 172.21.15.6:0/1225421363 conn(0x7f75840cc420 msgr2=0x7f75840cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:29.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.911+0000 7f7589a83700 1 -- 172.21.15.6:0/1225421363 shutdown_connections 2023-07-06T19:58:29.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.911+0000 7f7589a83700 1 -- 172.21.15.6:0/1225421363 wait complete. 2023-07-06T19:58:29.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.912+0000 7f7589a83700 1 Processor -- start 2023-07-06T19:58:29.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.912+0000 7f7589a83700 1 -- start start 2023-07-06T19:58:29.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.913+0000 7f7589a83700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7584071dd0 0x7f7584151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:29.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.913+0000 7f7589a83700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75840ceab0 0x7f75841e8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:29.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.913+0000 7f7589a83700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75840cee80 0x7f75841e8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:29.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.913+0000 7f7589a83700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758406bab0 con 0x7f75840ceab0 2023-07-06T19:58:29.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.913+0000 7f7589a83700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758406bd90 con 0x7f7584071dd0 2023-07-06T19:58:29.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.913+0000 7f7589a83700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758406c070 con 0x7f75840cee80 2023-07-06T19:58:29.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.913+0000 7f7582ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75840ceab0 0x7f75841e8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:29.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.913+0000 7f75837fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7584071dd0 0x7f7584151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:29.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.913+0000 7f7582ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75840ceab0 0x7f75841e8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57734/0 (socket says 172.21.15.6:57734) 2023-07-06T19:58:29.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.913+0000 7f7582ffd700 1 -- 172.21.15.6:0/2225362491 learned_addr learned my addr 172.21.15.6:0/2225362491 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:29.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.913+0000 7f7583fff700 1 --2- 172.21.15.6:0/2225362491 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75840cee80 0x7f75841e8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:29.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.913+0000 7f75837fe700 1 -- 172.21.15.6:0/2225362491 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75840cee80 msgr2=0x7f75841e8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:29.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.913+0000 7f75837fe700 1 --2- 172.21.15.6:0/2225362491 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75840cee80 0x7f75841e8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.913+0000 7f75837fe700 1 -- 172.21.15.6:0/2225362491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75840ceab0 msgr2=0x7f75841e8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:29.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.913+0000 7f75837fe700 1 --2- 172.21.15.6:0/2225362491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75840ceab0 0x7f75841e8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.913+0000 7f75837fe700 1 -- 172.21.15.6:0/2225362491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75740094a0 con 0x7f7584071dd0 2023-07-06T19:58:29.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.913+0000 7f7582ffd700 1 --2- 172.21.15.6:0/2225362491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75840ceab0 0x7f75841e8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:58:29.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.913+0000 7f75837fe700 1 --2- 172.21.15.6:0/2225362491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7584071dd0 0x7f7584151430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7574016000 tx=0x7f7574004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:29.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.913+0000 7f756bfff700 1 -- 172.21.15.6:0/2225362491 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757401a7e0 con 0x7f7584071dd0 2023-07-06T19:58:29.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.914+0000 7f756bfff700 1 -- 172.21.15.6:0/2225362491 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757401a940 con 0x7f7584071dd0 2023-07-06T19:58:29.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.914+0000 7f7589a83700 1 -- 172.21.15.6:0/2225362491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758406c350 con 0x7f7584071dd0 2023-07-06T19:58:29.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.914+0000 7f756bfff700 1 -- 172.21.15.6:0/2225362491 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757401acb0 con 0x7f7584071dd0 2023-07-06T19:58:29.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.914+0000 7f7589a83700 1 -- 172.21.15.6:0/2225362491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f758406b710 con 0x7f7584071dd0 2023-07-06T19:58:29.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.914+0000 7f756bfff700 1 -- 172.21.15.6:0/2225362491 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7574022070 con 0x7f7584071dd0 2023-07-06T19:58:29.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.914+0000 7f756bfff700 1 -- 172.21.15.6:0/2225362491 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f7574024af0 con 0x7f7584071dd0 2023-07-06T19:58:29.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.914+0000 7f7589a83700 1 -- 172.21.15.6:0/2225362491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75841e5f20 con 0x7f7584071dd0 2023-07-06T19:58:29.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.917+0000 7f756bfff700 1 -- 172.21.15.6:0/2225362491 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f7574029070 con 0x7f7584071dd0 2023-07-06T19:58:29.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.988+0000 7f7589a83700 1 -- 172.21.15.6:0/2225362491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f758406bed0 con 0x7f7584071dd0 2023-07-06T19:58:29.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.989+0000 7f756bfff700 1 -- 172.21.15.6:0/2225362491 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f758406bed0 con 0x7f7584071dd0 2023-07-06T19:58:29.991 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:58:29.991 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":10,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:58:29.664297+0000","last_up_change":"0.000000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:58:29.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.990+0000 7f7589a83700 1 -- 172.21.15.6:0/2225362491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7584071dd0 msgr2=0x7f7584151430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:29.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.990+0000 7f7589a83700 1 --2- 172.21.15.6:0/2225362491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7584071dd0 0x7f7584151430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7574016000 tx=0x7f7574004750 comp rx=0 tx=0).stop 2023-07-06T19:58:29.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.990+0000 7f7589a83700 1 -- 172.21.15.6:0/2225362491 shutdown_connections 2023-07-06T19:58:29.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.990+0000 7f7589a83700 1 --2- 172.21.15.6:0/2225362491 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75840cee80 0x7f75841e8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.990+0000 7f7589a83700 1 --2- 172.21.15.6:0/2225362491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7584071dd0 0x7f7584151430 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.990+0000 7f7589a83700 1 --2- 172.21.15.6:0/2225362491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75840ceab0 0x7f75841e8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:29.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.990+0000 7f7589a83700 1 -- 172.21.15.6:0/2225362491 >> 172.21.15.6:0/2225362491 conn(0x7f75840cc420 msgr2=0x7f75840cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:29.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.990+0000 7f7589a83700 1 -- 172.21.15.6:0/2225362491 shutdown_connections 2023-07-06T19:58:29.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:29.990+0000 7f7589a83700 1 -- 172.21.15.6:0/2225362491 wait complete. 2023-07-06T19:58:30.019 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-06T19:58:30.020 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-06T19:58:30.084 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:30.080+0000 7f462dfcc200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T19:58:30.172 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:30.167+0000 7f6e0fdcf200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-06T19:58:30.173 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:30.162+0000 7f462dfcc200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T19:58:30.250 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:30.248+0000 7f6e0fdcf200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-06T19:58:30.308 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:30.307+0000 7f462dfcc200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T19:58:30.321 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-06T19:58:30.318+0000 7fb5aef26640 -1 Falling back to public interface 2023-07-06T19:58:30.322 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-06T19:58:30.319+0000 7fad40c5f640 -1 Falling back to public interface 2023-07-06T19:58:30.329 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-06T19:58:30.327+0000 7faba0b6b640 -1 Falling back to public interface 2023-07-06T19:58:30.338 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-06T19:58:30.335+0000 7fb9c83c9640 -1 Falling back to public interface 2023-07-06T19:58:30.349 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T19:58:30.346+0000 7fec54bbc640 -1 Falling back to public interface 2023-07-06T19:58:30.352 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-06T19:58:30.348+0000 7fc1829f3640 -1 Falling back to public interface 2023-07-06T19:58:30.361 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-06T19:58:30.356+0000 7fec79fe0640 -1 Falling back to public interface 2023-07-06T19:58:30.395 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-06T19:58:30.393+0000 7ff73ef7b640 -1 Falling back to public interface 2023-07-06T19:58:30.400 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:30.395+0000 7f6e0fdcf200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-06T19:58:30.561 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:30.557+0000 7f462dfcc200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-06T19:58:30.638 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:30.636+0000 7f462dfcc200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T19:58:30.646 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:30.643+0000 7f6e0fdcf200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-06T19:58:30.724 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:30.721+0000 7f6e0fdcf200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-06T19:58:30.844 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-06T19:58:30.924 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:30.921+0000 7f462dfcc200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T19:58:30.960 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.958+0000 7f85cbaf8700 1 Processor -- start 2023-07-06T19:58:30.961 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.959+0000 7f85cbaf8700 1 -- start start 2023-07-06T19:58:30.962 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.959+0000 7f85cbaf8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85c4072130 0x7f85c406f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:30.962 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.959+0000 7f85cbaf8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f85c40cd580 0x7f85c406f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:30.962 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.960+0000 7f85cbaf8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c40cdf20 con 0x7f85c4159300 2023-07-06T19:58:30.962 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.960+0000 7f85cbaf8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c40ce4e0 con 0x7f85c40cd580 2023-07-06T19:58:30.962 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.960+0000 7f85cbaf8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c415da10 con 0x7f85c4072130 2023-07-06T19:58:30.962 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.960+0000 7f85c9894700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f85c4159300 0x7f85c40ce970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:48818/0 (socket says 172.21.15.6:48818) 2023-07-06T19:58:30.963 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.960+0000 7f85c9894700 1 -- 172.21.15.6:0/4165634940 learned_addr learned my addr 172.21.15.6:0/4165634940 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:58:30.963 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.960+0000 7f85c9093700 1 --2- 172.21.15.6:0/4165634940 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85c4072130 0x7f85c406f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:30.963 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.960+0000 7f85ca095700 1 --2- 172.21.15.6:0/4165634940 >> v2:172.21.15.6:3300/0 conn(0x7f85c40cd580 0x7f85c406f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:30.963 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.960+0000 7f85c9093700 1 -- 172.21.15.6:0/4165634940 >> v2:172.21.15.6:3300/0 conn(0x7f85c40cd580 msgr2=0x7f85c406f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:30.963 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.960+0000 7f85c9093700 1 --2- 172.21.15.6:0/4165634940 >> v2:172.21.15.6:3300/0 conn(0x7f85c40cd580 0x7f85c406f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:30.963 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.960+0000 7f85c9093700 1 -- 172.21.15.6:0/4165634940 >> v1:172.21.15.40:6789/0 conn(0x7f85c4159300 legacy=0x7f85c40ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:30.963 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.960+0000 7f85c9093700 1 -- 172.21.15.6:0/4165634940 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c415dcd0 con 0x7f85c4072130 2023-07-06T19:58:30.964 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.960+0000 7f85c9093700 1 --2- 172.21.15.6:0/4165634940 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85c4072130 0x7f85c406f400 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009840 tx=0x7f85b4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba16a7c562695ba9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:30.965 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.964+0000 7f85c8892700 1 -- 172.21.15.6:0/4165634940 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b4011830 con 0x7f85c4072130 2023-07-06T19:58:30.966 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.964+0000 7f85c8892700 1 -- 172.21.15.6:0/4165634940 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b4011990 con 0x7f85c4072130 2023-07-06T19:58:30.966 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.964+0000 7f85c8892700 1 -- 172.21.15.6:0/4165634940 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b4011d20 con 0x7f85c4072130 2023-07-06T19:58:30.966 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.964+0000 7f85cbaf8700 1 -- 172.21.15.6:0/4165634940 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85c4072130 msgr2=0x7f85c406f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:30.967 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.964+0000 7f85cbaf8700 1 --2- 172.21.15.6:0/4165634940 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85c4072130 0x7f85c406f400 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009840 tx=0x7f85b4009b50 comp rx=0 tx=0).stop 2023-07-06T19:58:30.967 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.964+0000 7f85cbaf8700 1 -- 172.21.15.6:0/4165634940 shutdown_connections 2023-07-06T19:58:30.967 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.964+0000 7f85cbaf8700 1 --2- 172.21.15.6:0/4165634940 >> v2:172.21.15.6:3300/0 conn(0x7f85c40cd580 0x7f85c406f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:30.967 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.964+0000 7f85cbaf8700 1 --2- 172.21.15.6:0/4165634940 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85c4072130 0x7f85c406f400 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:30.967 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.964+0000 7f85cbaf8700 1 -- 172.21.15.6:0/4165634940 >> 172.21.15.6:0/4165634940 conn(0x7f85c406d740 msgr2=0x7f85c406db10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:30.968 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.964+0000 7f85cbaf8700 1 -- 172.21.15.6:0/4165634940 shutdown_connections 2023-07-06T19:58:30.968 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.964+0000 7f85cbaf8700 1 -- 172.21.15.6:0/4165634940 wait complete. 2023-07-06T19:58:30.976 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.966+0000 7f85cbaf8700 1 Processor -- start 2023-07-06T19:58:30.976 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.966+0000 7f85cbaf8700 1 -- start start 2023-07-06T19:58:30.976 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.966+0000 7f85cbaf8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85c4072130 0x7f85c414fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:30.977 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.966+0000 7f85cbaf8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85c40cd580 0x7f85c40c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:30.977 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.966+0000 7f85cbaf8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85c4159300 0x7f85c40c3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:30.977 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.966+0000 7f85cbaf8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c4150320 con 0x7f85c4072130 2023-07-06T19:58:30.977 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.966+0000 7f85cbaf8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c40c48d0 con 0x7f85c40cd580 2023-07-06T19:58:30.984 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.966+0000 7f85cbaf8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c40b0840 con 0x7f85c4159300 2023-07-06T19:58:30.984 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.966+0000 7f85c9894700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85c4072130 0x7f85c414fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:30.984 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.966+0000 7f85c9894700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85c4072130 0x7f85c414fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57744/0 (socket says 172.21.15.6:57744) 2023-07-06T19:58:30.984 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.967+0000 7f85c9894700 1 -- 172.21.15.6:0/3546586582 learned_addr learned my addr 172.21.15.6:0/3546586582 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:30.985 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.967+0000 7f85c9093700 1 --2- 172.21.15.6:0/3546586582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85c40cd580 0x7f85c40c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:30.985 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.967+0000 7f85ca095700 1 --2- 172.21.15.6:0/3546586582 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85c4159300 0x7f85c40c3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:30.985 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.967+0000 7f85c9894700 1 -- 172.21.15.6:0/3546586582 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85c4159300 msgr2=0x7f85c40c3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:30.985 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.967+0000 7f85c9894700 1 --2- 172.21.15.6:0/3546586582 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85c4159300 0x7f85c40c3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:30.985 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.967+0000 7f85c9894700 1 -- 172.21.15.6:0/3546586582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85c40cd580 msgr2=0x7f85c40c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:30.985 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.967+0000 7f85c9894700 1 --2- 172.21.15.6:0/3546586582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85c40cd580 0x7f85c40c7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:30.985 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.967+0000 7f85c9894700 1 -- 172.21.15.6:0/3546586582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b40094a0 con 0x7f85c4072130 2023-07-06T19:58:30.986 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.967+0000 7f85c9894700 1 --2- 172.21.15.6:0/3546586582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85c4072130 0x7f85c414fde0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f85c000c480 tx=0x7f85c000c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:30.986 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.967+0000 7f85ba7fc700 1 -- 172.21.15.6:0/3546586582 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c0005d70 con 0x7f85c4072130 2023-07-06T19:58:30.986 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.967+0000 7f85ba7fc700 1 -- 172.21.15.6:0/3546586582 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c000ce90 con 0x7f85c4072130 2023-07-06T19:58:30.987 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.967+0000 7f85cbaf8700 1 -- 172.21.15.6:0/3546586582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c40b0b20 con 0x7f85c4072130 2023-07-06T19:58:30.988 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.967+0000 7f85ba7fc700 1 -- 172.21.15.6:0/3546586582 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c00072d0 con 0x7f85c4072130 2023-07-06T19:58:30.988 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.967+0000 7f85cbaf8700 1 -- 172.21.15.6:0/3546586582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c40b10e0 con 0x7f85c4072130 2023-07-06T19:58:30.988 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.968+0000 7f85ba7fc700 1 -- 172.21.15.6:0/3546586582 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f85c001c440 con 0x7f85c4072130 2023-07-06T19:58:30.988 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.968+0000 7f85cbaf8700 1 -- 172.21.15.6:0/3546586582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c4070190 con 0x7f85c4072130 2023-07-06T19:58:30.989 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.968+0000 7f85ba7fc700 1 -- 172.21.15.6:0/3546586582 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f85c0007730 con 0x7f85c4072130 2023-07-06T19:58:30.989 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:30.971+0000 7f85ba7fc700 1 -- 172.21.15.6:0/3546586582 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f85c0021060 con 0x7f85c4072130 2023-07-06T19:58:31.007 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:31.005+0000 7f6e0fdcf200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-06T19:58:31.044 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:31.042+0000 7f85cbaf8700 1 -- 172.21.15.6:0/3546586582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85c404eb90 con 0x7f85c4072130 2023-07-06T19:58:31.045 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:31.042+0000 7f85ba7fc700 1 -- 172.21.15.6:0/3546586582 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f85c0017070 con 0x7f85c4072130 2023-07-06T19:58:31.045 INFO:teuthology.misc.health.smithi006.stdout: 2023-07-06T19:58:31.045 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":10,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:58:29.664297+0000","last_up_change":"0.000000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:58:31.046 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:31.043+0000 7f85cbaf8700 1 -- 172.21.15.6:0/3546586582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85c4072130 msgr2=0x7f85c414fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:31.046 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:31.043+0000 7f85cbaf8700 1 --2- 172.21.15.6:0/3546586582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85c4072130 0x7f85c414fde0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f85c000c480 tx=0x7f85c000c790 comp rx=0 tx=0).stop 2023-07-06T19:58:31.047 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:31.043+0000 7f85cbaf8700 1 -- 172.21.15.6:0/3546586582 shutdown_connections 2023-07-06T19:58:31.047 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:31.043+0000 7f85cbaf8700 1 --2- 172.21.15.6:0/3546586582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85c4072130 0x7f85c414fde0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:31.047 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:31.043+0000 7f85cbaf8700 1 --2- 172.21.15.6:0/3546586582 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f85c4159300 0x7f85c40c3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:31.047 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:31.043+0000 7f85cbaf8700 1 --2- 172.21.15.6:0/3546586582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85c40cd580 0x7f85c40c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:31.047 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:31.043+0000 7f85cbaf8700 1 -- 172.21.15.6:0/3546586582 >> 172.21.15.6:0/3546586582 conn(0x7f85c406d740 msgr2=0x7f85c40ae740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:31.047 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:31.043+0000 7f85cbaf8700 1 -- 172.21.15.6:0/3546586582 shutdown_connections 2023-07-06T19:58:31.047 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:31.043+0000 7f85cbaf8700 1 -- 172.21.15.6:0/3546586582 wait complete. 2023-07-06T19:58:31.057 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-06T19:58:31.154 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:31.152+0000 7f462dfcc200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T19:58:31.236 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:31.233+0000 7f6e0fdcf200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-06T19:58:31.316 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:31.314+0000 7f462dfcc200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T19:58:31.397 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:31.395+0000 7f6e0fdcf200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-06T19:58:31.437 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:31.435+0000 7f462dfcc200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T19:58:31.520 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:31.516+0000 7f6e0fdcf200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-06T19:58:31.593 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:31.591+0000 7f462dfcc200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T19:58:31.673 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:31.671+0000 7f6e0fdcf200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-06T19:58:31.878 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:31.877+0000 7f462dfcc200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T19:58:31.963 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:31.958+0000 7f6e0fdcf200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-06T19:58:32.073 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:32.070+0000 7f462dfcc200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T19:58:32.154 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:32.151+0000 7f6e0fdcf200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-06T19:58:32.692 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:32.690+0000 7f462dfcc200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T19:58:32.775 INFO:tasks.ceph.mgr.x.smithi040.stderr:2023-07-06T19:58:32.773+0000 7f6e0fdcf200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-06T19:58:33.715 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:33.713+0000 7f45e6233700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-06T19:58:33.717 INFO:tasks.ceph.mgr.y.smithi006.stderr:2023-07-06T19:58:33.716+0000 7f45e6233700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-06T19:58:33.816 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-06T19:58:33.814+0000 7fad40c5f640 -1 osd.0 0 log_to_monitors true 2023-07-06T19:58:33.817 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-06T19:58:33.815+0000 7fb5aef26640 -1 osd.1 0 log_to_monitors true 2023-07-06T19:58:33.846 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-06T19:58:33.844+0000 7faba0b6b640 -1 osd.2 0 log_to_monitors true 2023-07-06T19:58:33.861 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-06T19:58:33.858+0000 7fc1829f3640 -1 osd.5 0 log_to_monitors true 2023-07-06T19:58:33.861 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-06T19:58:33.858+0000 7fb9c83c9640 -1 osd.4 0 log_to_monitors true 2023-07-06T19:58:33.873 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-06T19:58:33.867+0000 7fec79fe0640 -1 osd.6 0 log_to_monitors true 2023-07-06T19:58:33.874 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T19:58:33.866+0000 7fec54bbc640 -1 osd.3 0 log_to_monitors true 2023-07-06T19:58:33.904 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-06T19:58:33.902+0000 7ff73ef7b640 -1 osd.7 0 log_to_monitors true 2023-07-06T19:58:37.632 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-06T19:58:37.630+0000 7fb5a32de700 -1 osd.1 0 waiting for initial osdmap 2023-07-06T19:58:37.655 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-06T19:58:37.653+0000 7fb59aeb8700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-06T19:58:37.675 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-06T19:58:37.673+0000 7fab94f23700 -1 osd.2 0 waiting for initial osdmap 2023-07-06T19:58:37.703 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-06T19:58:37.701+0000 7fab8cafd700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-06T19:58:37.715 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-06T19:58:37.712+0000 7fec6eb99700 -1 osd.6 0 waiting for initial osdmap 2023-07-06T19:58:37.720 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T19:58:37.718+0000 7fec48f74700 -1 osd.3 0 waiting for initial osdmap 2023-07-06T19:58:37.728 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-06T19:58:37.723+0000 7ff733333700 -1 osd.7 0 waiting for initial osdmap 2023-07-06T19:58:37.731 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-06T19:58:37.729+0000 7fec65f72700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-06T19:58:37.732 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T19:58:37.730+0000 7fec40b4e700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-06T19:58:37.738 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-06T19:58:37.735+0000 7ff72af0d700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-06T19:58:37.742 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-06T19:58:37.739+0000 7fad35017700 -1 osd.0 0 waiting for initial osdmap 2023-07-06T19:58:37.749 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-06T19:58:37.745+0000 7fc176dab700 -1 osd.5 0 waiting for initial osdmap 2023-07-06T19:58:37.756 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-06T19:58:37.755+0000 7fad2cbf1700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-06T19:58:37.763 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-06T19:58:37.761+0000 7fc16e985700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-06T19:58:37.770 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-06T19:58:37.768+0000 7fb9bc781700 -1 osd.4 0 waiting for initial osdmap 2023-07-06T19:58:37.790 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-06T19:58:37.788+0000 7fb9b435b700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-06T19:58:37.869 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-06T19:58:37.993 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.985+0000 7fadc6bcb700 1 Processor -- start 2023-07-06T19:58:37.993 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.985+0000 7fadc6bcb700 1 -- start start 2023-07-06T19:58:37.994 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.986+0000 7fadc6bcb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fadc015ca80 0x7fadc00ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:37.994 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.986+0000 7fadc6bcb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc00cf8c0 0x7fadc006a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:37.994 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.986+0000 7fadc6bcb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fadc006a5a0 0x7fadc0071760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:37.994 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.986+0000 7fadc6bcb700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc006aa40 con 0x7fadc006a5a0 2023-07-06T19:58:37.994 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.986+0000 7fadc6bcb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc00c9fb0 con 0x7fadc015ca80 2023-07-06T19:58:37.994 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.986+0000 7fadc6bcb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00cfdf0 con 0x7fadc00cf8c0 2023-07-06T19:58:37.994 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.986+0000 7fadc5168700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fadc006a5a0 0x7fadc0071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:37.994 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.986+0000 7fadc5168700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fadc006a5a0 0x7fadc0071760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57852/0 (socket says 172.21.15.6:57852) 2023-07-06T19:58:37.995 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.986+0000 7fadc5168700 1 -- 172.21.15.6:0/3221795800 learned_addr learned my addr 172.21.15.6:0/3221795800 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:37.995 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.986+0000 7fadc4967700 1 --2- 172.21.15.6:0/3221795800 >> v2:172.21.15.40:3300/0 conn(0x7fadc015ca80 0x7fadc00ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:37.995 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.986+0000 7fadbffff700 1 --2- 172.21.15.6:0/3221795800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc00cf8c0 0x7fadc006a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:37.995 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.986+0000 7fadc5168700 1 -- 172.21.15.6:0/3221795800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc00cf8c0 msgr2=0x7fadc006a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:37.995 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.986+0000 7fadc5168700 1 --2- 172.21.15.6:0/3221795800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc00cf8c0 0x7fadc006a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:37.995 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.986+0000 7fadc5168700 1 -- 172.21.15.6:0/3221795800 >> v2:172.21.15.40:3300/0 conn(0x7fadc015ca80 msgr2=0x7fadc00ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:37.995 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.986+0000 7fadc5168700 1 --2- 172.21.15.6:0/3221795800 >> v2:172.21.15.40:3300/0 conn(0x7fadc015ca80 0x7fadc00ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:37.996 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.986+0000 7fadc5168700 1 -- 172.21.15.6:0/3221795800 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc00d00d0 con 0x7fadc006a5a0 2023-07-06T19:58:37.996 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.987+0000 7fadc5168700 1 --2- 172.21.15.6:0/3221795800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadc006a5a0 0x7fadc0071760 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fadc00727e0 tx=0x7fadb0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe4dbfd6cbe244b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:37.997 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.987+0000 7fadbf7fe700 1 -- 172.21.15.6:0/3221795800 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb000b870 con 0x7fadc006a5a0 2023-07-06T19:58:37.998 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.987+0000 7fadbf7fe700 1 -- 172.21.15.6:0/3221795800 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb000b9d0 con 0x7fadc006a5a0 2023-07-06T19:58:37.998 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.987+0000 7fadbf7fe700 1 -- 172.21.15.6:0/3221795800 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb000bd60 con 0x7fadc006a5a0 2023-07-06T19:58:37.998 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.987+0000 7fadc6bcb700 1 -- 172.21.15.6:0/3221795800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadc006a5a0 msgr2=0x7fadc0071760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:38.021 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.987+0000 7fadc6bcb700 1 --2- 172.21.15.6:0/3221795800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadc006a5a0 0x7fadc0071760 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fadc00727e0 tx=0x7fadb0009bd0 comp rx=0 tx=0).stop 2023-07-06T19:58:38.022 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.987+0000 7fadc6bcb700 1 -- 172.21.15.6:0/3221795800 shutdown_connections 2023-07-06T19:58:38.022 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.987+0000 7fadc6bcb700 1 --2- 172.21.15.6:0/3221795800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadc006a5a0 0x7fadc0071760 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:38.022 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.987+0000 7fadc6bcb700 1 --2- 172.21.15.6:0/3221795800 >> v2:172.21.15.40:3300/0 conn(0x7fadc015ca80 0x7fadc00ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:38.022 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.987+0000 7fadc6bcb700 1 --2- 172.21.15.6:0/3221795800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc00cf8c0 0x7fadc006a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:38.022 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.987+0000 7fadc6bcb700 1 -- 172.21.15.6:0/3221795800 >> 172.21.15.6:0/3221795800 conn(0x7fadc006e450 msgr2=0x7fadc00b1490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:38.023 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.987+0000 7fadc6bcb700 1 -- 172.21.15.6:0/3221795800 shutdown_connections 2023-07-06T19:58:38.023 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.987+0000 7fadc6bcb700 1 -- 172.21.15.6:0/3221795800 wait complete. 2023-07-06T19:58:38.023 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.989+0000 7fadc6bcb700 1 Processor -- start 2023-07-06T19:58:38.023 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.989+0000 7fadc6bcb700 1 -- start start 2023-07-06T19:58:38.023 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.989+0000 7fadc6bcb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc006a5a0 0x7fadc00ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:38.023 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.989+0000 7fadc6bcb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadc00cf8c0 0x7fadc00ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:38.023 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.989+0000 7fadc6bcb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc015ca80 0x7fadc015d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:38.024 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.989+0000 7fadc6bcb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00ae7e0 con 0x7fadc00cf8c0 2023-07-06T19:58:38.024 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.989+0000 7fadc6bcb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00c6ca0 con 0x7fadc015ca80 2023-07-06T19:58:38.024 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.989+0000 7fadc6bcb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00adf80 con 0x7fadc006a5a0 2023-07-06T19:58:38.024 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.990+0000 7fadbffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadc00cf8c0 0x7fadc00ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:38.025 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.990+0000 7fadbffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadc00cf8c0 0x7fadc00ca9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57856/0 (socket says 172.21.15.6:57856) 2023-07-06T19:58:38.025 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.990+0000 7fadbffff700 1 -- 172.21.15.6:0/3136963062 learned_addr learned my addr 172.21.15.6:0/3136963062 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:38.025 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.990+0000 7fadc4967700 1 --2- 172.21.15.6:0/3136963062 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc006a5a0 0x7fadc00ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:38.025 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.990+0000 7fadc5168700 1 --2- 172.21.15.6:0/3136963062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc015ca80 0x7fadc015d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:38.025 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.990+0000 7fadbffff700 1 -- 172.21.15.6:0/3136963062 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc006a5a0 msgr2=0x7fadc00ab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:38.025 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.990+0000 7fadbffff700 1 --2- 172.21.15.6:0/3136963062 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc006a5a0 0x7fadc00ab8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:38.025 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.990+0000 7fadbffff700 1 -- 172.21.15.6:0/3136963062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc015ca80 msgr2=0x7fadc015d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:38.026 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.990+0000 7fadbffff700 1 --2- 172.21.15.6:0/3136963062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc015ca80 0x7fadc015d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:38.026 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.990+0000 7fadbffff700 1 -- 172.21.15.6:0/3136963062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb0009550 con 0x7fadc00cf8c0 2023-07-06T19:58:38.026 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.990+0000 7fadbffff700 1 --2- 172.21.15.6:0/3136963062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadc00cf8c0 0x7fadc00ca9a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fada800e810 tx=0x7fada800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:38.026 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.990+0000 7fadbd7fa700 1 -- 172.21.15.6:0/3136963062 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada800c070 con 0x7fadc00cf8c0 2023-07-06T19:58:38.026 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.990+0000 7fadbd7fa700 1 -- 172.21.15.6:0/3136963062 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada8013610 con 0x7fadc00cf8c0 2023-07-06T19:58:38.026 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.990+0000 7fadc6bcb700 1 -- 172.21.15.6:0/3136963062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc00ae220 con 0x7fadc00cf8c0 2023-07-06T19:58:38.036 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.990+0000 7fadbd7fa700 1 -- 172.21.15.6:0/3136963062 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada80139a0 con 0x7fadc00cf8c0 2023-07-06T19:58:38.040 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.990+0000 7fadc6bcb700 1 -- 172.21.15.6:0/3136963062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc00abe00 con 0x7fadc00cf8c0 2023-07-06T19:58:38.040 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.991+0000 7fadc6bcb700 1 -- 172.21.15.6:0/3136963062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc00cd380 con 0x7fadc00cf8c0 2023-07-06T19:58:38.040 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.992+0000 7fadbd7fa700 1 -- 172.21.15.6:0/3136963062 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fada8013b00 con 0x7fadc00cf8c0 2023-07-06T19:58:38.041 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.992+0000 7fadbd7fa700 1 --2- 172.21.15.6:0/3136963062 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fada006ac50 0x7fada006d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:38.041 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.992+0000 7fadc4967700 1 --2- 172.21.15.6:0/3136963062 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fada006ac50 0x7fada006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:38.041 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.992+0000 7fadbd7fa700 1 -- 172.21.15.6:0/3136963062 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fada8088070 con 0x7fadc00cf8c0 2023-07-06T19:58:38.044 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.992+0000 7fadc4967700 1 --2- 172.21.15.6:0/3136963062 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fada006ac50 0x7fada006d100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fadb8003b30 tx=0x7fadb8009830 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:38.044 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:37.997+0000 7fadbd7fa700 1 -- 172.21.15.6:0/3136963062 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fada8054180 con 0x7fadc00cf8c0 2023-07-06T19:58:38.200 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:38.196+0000 7fadc6bcb700 1 -- 172.21.15.6:0/3136963062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fadc00d0360 con 0x7fadc00cf8c0 2023-07-06T19:58:38.201 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:38.196+0000 7fadbd7fa700 1 -- 172.21.15.6:0/3136963062 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fada8013db0 con 0x7fadc00cf8c0 2023-07-06T19:58:38.201 INFO:teuthology.misc.health.smithi006.stdout: 2023-07-06T19:58:38.202 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":12,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:58:35.718057+0000","last_up_change":"0.000000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:58:38.202 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:38.198+0000 7fadc6bcb700 1 -- 172.21.15.6:0/3136963062 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fada006ac50 msgr2=0x7fada006d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:38.203 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:38.198+0000 7fadc6bcb700 1 --2- 172.21.15.6:0/3136963062 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fada006ac50 0x7fada006d100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fadb8003b30 tx=0x7fadb8009830 comp rx=0 tx=0).stop 2023-07-06T19:58:38.203 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:38.198+0000 7fadc6bcb700 1 -- 172.21.15.6:0/3136963062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadc00cf8c0 msgr2=0x7fadc00ca9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:38.203 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:38.198+0000 7fadc6bcb700 1 --2- 172.21.15.6:0/3136963062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadc00cf8c0 0x7fadc00ca9a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fada800e810 tx=0x7fada800eb20 comp rx=0 tx=0).stop 2023-07-06T19:58:38.203 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:38.198+0000 7fadc6bcb700 1 -- 172.21.15.6:0/3136963062 shutdown_connections 2023-07-06T19:58:38.203 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:38.198+0000 7fadc6bcb700 1 --2- 172.21.15.6:0/3136963062 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fada006ac50 0x7fada006d100 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:38.203 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:38.198+0000 7fadc6bcb700 1 --2- 172.21.15.6:0/3136963062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadc015ca80 0x7fadc015d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:38.203 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:38.198+0000 7fadc6bcb700 1 --2- 172.21.15.6:0/3136963062 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadc006a5a0 0x7fadc00ab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:38.204 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:38.198+0000 7fadc6bcb700 1 --2- 172.21.15.6:0/3136963062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadc00cf8c0 0x7fadc00ca9a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:38.204 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:38.198+0000 7fadc6bcb700 1 -- 172.21.15.6:0/3136963062 >> 172.21.15.6:0/3136963062 conn(0x7fadc006e450 msgr2=0x7fadc015ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:38.205 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:38.198+0000 7fadc6bcb700 1 -- 172.21.15.6:0/3136963062 shutdown_connections 2023-07-06T19:58:38.205 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:38.198+0000 7fadc6bcb700 1 -- 172.21.15.6:0/3136963062 wait complete. 2023-07-06T19:58:38.216 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-06T19:58:45.037 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-06T19:58:45.165 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.163+0000 7f98b16ec700 1 Processor -- start 2023-07-06T19:58:45.176 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.163+0000 7f98b16ec700 1 -- start start 2023-07-06T19:58:45.176 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.164+0000 7f98b16ec700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f98ac0ce7e0 0x7f98ac160c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:45.176 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.164+0000 7f98b16ec700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f98ac0cebb0 0x7f98ac15cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:45.176 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.164+0000 7f98b16ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98ac15d0b0 0x7f98ac0cb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:45.176 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.164+0000 7f98b16ec700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ac1607b0 con 0x7f98ac0cebb0 2023-07-06T19:58:45.177 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.164+0000 7f98b16ec700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ac15d4f0 con 0x7f98ac0ce7e0 2023-07-06T19:58:45.177 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.164+0000 7f98b16ec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0b3510 con 0x7f98ac15d0b0 2023-07-06T19:58:45.177 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.164+0000 7f98aa7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f98ac0cebb0 0x7f98ac15cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:45.177 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.164+0000 7f98aa7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f98ac0cebb0 0x7f98ac15cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58078/0 (socket says 172.21.15.6:58078) 2023-07-06T19:58:45.177 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.164+0000 7f98aa7fc700 1 -- 172.21.15.6:0/2681255102 learned_addr learned my addr 172.21.15.6:0/2681255102 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:45.177 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.165+0000 7f98aaffd700 1 --2- 172.21.15.6:0/2681255102 >> v2:172.21.15.40:3300/0 conn(0x7f98ac0ce7e0 0x7f98ac160c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:45.177 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.165+0000 7f98ab7fe700 1 --2- 172.21.15.6:0/2681255102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98ac15d0b0 0x7f98ac0cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:45.178 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.165+0000 7f98aa7fc700 1 -- 172.21.15.6:0/2681255102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98ac15d0b0 msgr2=0x7f98ac0cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:45.178 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.165+0000 7f98aa7fc700 1 --2- 172.21.15.6:0/2681255102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98ac15d0b0 0x7f98ac0cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:45.178 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.165+0000 7f98aa7fc700 1 -- 172.21.15.6:0/2681255102 >> v2:172.21.15.40:3300/0 conn(0x7f98ac0ce7e0 msgr2=0x7f98ac160c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:45.178 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.165+0000 7f98aa7fc700 1 --2- 172.21.15.6:0/2681255102 >> v2:172.21.15.40:3300/0 conn(0x7f98ac0ce7e0 0x7f98ac160c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:45.178 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.165+0000 7f98aa7fc700 1 -- 172.21.15.6:0/2681255102 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac15d750 con 0x7f98ac0cebb0 2023-07-06T19:58:45.178 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.165+0000 7f98aa7fc700 1 --2- 172.21.15.6:0/2681255102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ac0cebb0 0x7f98ac15cb70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0ce790 tx=0x7f989c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d518f443601964 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:45.178 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.165+0000 7f98a9ffb700 1 -- 172.21.15.6:0/2681255102 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c00b870 con 0x7f98ac0cebb0 2023-07-06T19:58:45.179 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.165+0000 7f98a9ffb700 1 -- 172.21.15.6:0/2681255102 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989c00b9d0 con 0x7f98ac0cebb0 2023-07-06T19:58:45.179 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.165+0000 7f98a9ffb700 1 -- 172.21.15.6:0/2681255102 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c00bd60 con 0x7f98ac0cebb0 2023-07-06T19:58:45.179 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.166+0000 7f98b16ec700 1 -- 172.21.15.6:0/2681255102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ac0cebb0 msgr2=0x7f98ac15cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:45.179 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.166+0000 7f98b16ec700 1 --2- 172.21.15.6:0/2681255102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ac0cebb0 0x7f98ac15cb70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0ce790 tx=0x7f989c009bd0 comp rx=0 tx=0).stop 2023-07-06T19:58:45.179 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.166+0000 7f98b16ec700 1 -- 172.21.15.6:0/2681255102 shutdown_connections 2023-07-06T19:58:45.179 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.166+0000 7f98b16ec700 1 --2- 172.21.15.6:0/2681255102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98ac15d0b0 0x7f98ac0cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:45.179 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.166+0000 7f98b16ec700 1 --2- 172.21.15.6:0/2681255102 >> v2:172.21.15.40:3300/0 conn(0x7f98ac0ce7e0 0x7f98ac160c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:45.179 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.166+0000 7f98b16ec700 1 --2- 172.21.15.6:0/2681255102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ac0cebb0 0x7f98ac15cb70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:45.180 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.166+0000 7f98b16ec700 1 -- 172.21.15.6:0/2681255102 >> 172.21.15.6:0/2681255102 conn(0x7f98ac06a060 msgr2=0x7f98ac06a430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:45.180 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.166+0000 7f98b16ec700 1 -- 172.21.15.6:0/2681255102 shutdown_connections 2023-07-06T19:58:45.180 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.166+0000 7f98b16ec700 1 -- 172.21.15.6:0/2681255102 wait complete. 2023-07-06T19:58:45.180 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.167+0000 7f98b16ec700 1 Processor -- start 2023-07-06T19:58:45.180 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.167+0000 7f98b16ec700 1 -- start start 2023-07-06T19:58:45.180 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.168+0000 7f98b16ec700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98ac0ce7e0 0x7f98ac157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:45.181 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.168+0000 7f98b16ec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ac0cebb0 0x7f98ac15b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:45.181 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.168+0000 7f98b16ec700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98ac15d0b0 0x7f98ac15be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:45.181 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.168+0000 7f98b16ec700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0af300 con 0x7f98ac0cebb0 2023-07-06T19:58:45.181 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.168+0000 7f98b16ec700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac157650 con 0x7f98ac0ce7e0 2023-07-06T19:58:45.181 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.168+0000 7f98b16ec700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0ae9d0 con 0x7f98ac15d0b0 2023-07-06T19:58:45.181 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.168+0000 7f98aa7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ac0cebb0 0x7f98ac15b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:45.182 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.168+0000 7f98aa7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ac0cebb0 0x7f98ac15b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58086/0 (socket says 172.21.15.6:58086) 2023-07-06T19:58:45.182 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.168+0000 7f98aa7fc700 1 -- 172.21.15.6:0/4079589401 learned_addr learned my addr 172.21.15.6:0/4079589401 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:45.182 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.168+0000 7f98aaffd700 1 --2- 172.21.15.6:0/4079589401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98ac0ce7e0 0x7f98ac157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:45.182 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.168+0000 7f98ab7fe700 1 --2- 172.21.15.6:0/4079589401 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98ac15d0b0 0x7f98ac15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:45.182 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.168+0000 7f98aa7fc700 1 -- 172.21.15.6:0/4079589401 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98ac15d0b0 msgr2=0x7f98ac15be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:45.182 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.168+0000 7f98aa7fc700 1 --2- 172.21.15.6:0/4079589401 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98ac15d0b0 0x7f98ac15be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:45.182 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.168+0000 7f98aa7fc700 1 -- 172.21.15.6:0/4079589401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98ac0ce7e0 msgr2=0x7f98ac157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:45.183 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.168+0000 7f98aa7fc700 1 --2- 172.21.15.6:0/4079589401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98ac0ce7e0 0x7f98ac157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:45.183 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.168+0000 7f98aa7fc700 1 -- 172.21.15.6:0/4079589401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c009550 con 0x7f98ac0cebb0 2023-07-06T19:58:45.183 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.168+0000 7f98aa7fc700 1 --2- 172.21.15.6:0/4079589401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ac0cebb0 0x7f98ac15b8c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f989c000c00 tx=0x7f989c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:45.183 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.169+0000 7f98937fe700 1 -- 172.21.15.6:0/4079589401 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c004480 con 0x7f98ac0cebb0 2023-07-06T19:58:45.184 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.169+0000 7f98937fe700 1 -- 172.21.15.6:0/4079589401 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989c0045e0 con 0x7f98ac0cebb0 2023-07-06T19:58:45.184 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.169+0000 7f98937fe700 1 -- 172.21.15.6:0/4079589401 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c0038e0 con 0x7f98ac0cebb0 2023-07-06T19:58:45.184 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.169+0000 7f98b16ec700 1 -- 172.21.15.6:0/4079589401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98ac0aecb0 con 0x7f98ac0cebb0 2023-07-06T19:58:45.184 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.169+0000 7f98b16ec700 1 -- 172.21.15.6:0/4079589401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ac0ad170 con 0x7f98ac0cebb0 2023-07-06T19:58:45.184 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.170+0000 7f98b16ec700 1 -- 172.21.15.6:0/4079589401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98ac0af470 con 0x7f98ac0cebb0 2023-07-06T19:58:45.184 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.170+0000 7f98937fe700 1 -- 172.21.15.6:0/4079589401 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f989c021070 con 0x7f98ac0cebb0 2023-07-06T19:58:45.184 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.171+0000 7f98937fe700 1 --2- 172.21.15.6:0/4079589401 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f989806ace0 0x7f989806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:45.185 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.171+0000 7f98937fe700 1 -- 172.21.15.6:0/4079589401 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f989c08a570 con 0x7f98ac0cebb0 2023-07-06T19:58:45.185 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.171+0000 7f98aaffd700 1 --2- 172.21.15.6:0/4079589401 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f989806ace0 0x7f989806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:45.185 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.171+0000 7f98aaffd700 1 --2- 172.21.15.6:0/4079589401 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f989806ace0 0x7f989806d190 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f98ac15f8f0 tx=0x7f98a0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:45.185 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.176+0000 7f98937fe700 1 -- 172.21.15.6:0/4079589401 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f989c055b60 con 0x7f98ac0cebb0 2023-07-06T19:58:45.382 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.377+0000 7f98b16ec700 1 -- 172.21.15.6:0/4079589401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98ac04eb90 con 0x7f98ac0cebb0 2023-07-06T19:58:45.383 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.378+0000 7f98937fe700 1 -- 172.21.15.6:0/4079589401 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12694 (secure 0 0 0) 0x7f989c059180 con 0x7f98ac0cebb0 2023-07-06T19:58:45.383 INFO:teuthology.misc.health.smithi006.stdout: 2023-07-06T19:58:45.384 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":16,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:58:41.665263+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:58:45.384 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.380+0000 7f98b16ec700 1 -- 172.21.15.6:0/4079589401 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f989806ace0 msgr2=0x7f989806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:45.385 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.380+0000 7f98b16ec700 1 --2- 172.21.15.6:0/4079589401 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f989806ace0 0x7f989806d190 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f98ac15f8f0 tx=0x7f98a0008040 comp rx=0 tx=0).stop 2023-07-06T19:58:45.385 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.380+0000 7f98b16ec700 1 -- 172.21.15.6:0/4079589401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ac0cebb0 msgr2=0x7f98ac15b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:45.385 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.380+0000 7f98b16ec700 1 --2- 172.21.15.6:0/4079589401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ac0cebb0 0x7f98ac15b8c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f989c000c00 tx=0x7f989c004750 comp rx=0 tx=0).stop 2023-07-06T19:58:45.385 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.380+0000 7f98b16ec700 1 -- 172.21.15.6:0/4079589401 shutdown_connections 2023-07-06T19:58:45.385 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.380+0000 7f98b16ec700 1 --2- 172.21.15.6:0/4079589401 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f989806ace0 0x7f989806d190 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:45.385 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.380+0000 7f98b16ec700 1 --2- 172.21.15.6:0/4079589401 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98ac15d0b0 0x7f98ac15be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:45.386 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.380+0000 7f98b16ec700 1 --2- 172.21.15.6:0/4079589401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98ac0ce7e0 0x7f98ac157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:45.386 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.380+0000 7f98b16ec700 1 --2- 172.21.15.6:0/4079589401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98ac0cebb0 0x7f98ac15b8c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:45.386 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.380+0000 7f98b16ec700 1 -- 172.21.15.6:0/4079589401 >> 172.21.15.6:0/4079589401 conn(0x7f98ac06a060 msgr2=0x7f98ac157d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:45.386 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.380+0000 7f98b16ec700 1 -- 172.21.15.6:0/4079589401 shutdown_connections 2023-07-06T19:58:45.386 INFO:teuthology.misc.health.smithi006.stderr:2023-07-06T19:58:45.380+0000 7f98b16ec700 1 -- 172.21.15.6:0/4079589401 wait complete. 2023-07-06T19:58:45.395 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-06T19:58:45.396 INFO:tasks.ceph:Creating RBD pool 2023-07-06T19:58:45.396 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-06T19:58:45.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.518+0000 7f615bfff700 1 Processor -- start 2023-07-06T19:58:45.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.518+0000 7f615bfff700 1 -- start start 2023-07-06T19:58:45.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.519+0000 7f615bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f615c0b22d0 0x7f615c0b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:45.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.519+0000 7f615bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f615c0d02b0 0x7f615c0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:45.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.519+0000 7f615bfff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615c0b1c30 con 0x7f615c15a330 2023-07-06T19:58:45.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.519+0000 7f615bfff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f615c0cae70 con 0x7f615c0b22d0 2023-07-06T19:58:45.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.519+0000 7f615bfff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615c0cca70 con 0x7f615c0d02b0 2023-07-06T19:58:45.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.519+0000 7f615affd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f615c0b22d0 0x7f615c0b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:45.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.519+0000 7f615b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f615c0d02b0 0x7f615c0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:45.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.519+0000 7f615b7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f615c0d02b0 0x7f615c0cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:50740/0 (socket says 172.21.15.6:50740) 2023-07-06T19:58:45.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.519+0000 7f615b7fe700 1 -- 172.21.15.6:0/3311974422 learned_addr learned my addr 172.21.15.6:0/3311974422 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:45.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.519+0000 7f615affd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f615c0b22d0 0x7f615c0b16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:37128/0 (socket says 172.21.15.6:37128) 2023-07-06T19:58:45.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.519+0000 7f615b7fe700 1 -- 172.21.15.6:0/3311974422 >> v2:172.21.15.40:3300/0 conn(0x7f615c0b22d0 msgr2=0x7f615c0b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:45.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.519+0000 7f615b7fe700 1 --2- 172.21.15.6:0/3311974422 >> v2:172.21.15.40:3300/0 conn(0x7f615c0b22d0 0x7f615c0b16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:45.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.519+0000 7f615b7fe700 1 -- 172.21.15.6:0/3311974422 >> v1:172.21.15.40:6789/0 conn(0x7f615c15a330 legacy=0x7f615c0b26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.519+0000 7f615b7fe700 1 -- 172.21.15.6:0/3311974422 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c0cb050 con 0x7f615c0d02b0 2023-07-06T19:58:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.519+0000 7f615affd700 1 --2- 172.21.15.6:0/3311974422 >> v2:172.21.15.40:3300/0 conn(0x7f615c0b22d0 0x7f615c0b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:58:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.520+0000 7f615b7fe700 1 --2- 172.21.15.6:0/3311974422 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f615c0d02b0 0x7f615c0cf070 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6154009e50 tx=0x7f615400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd4de11e52b921cf server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:45.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.520+0000 7f6159ffb700 1 -- 172.21.15.6:0/3311974422 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615400e070 con 0x7f615c0d02b0 2023-07-06T19:58:45.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.520+0000 7f6159ffb700 1 -- 172.21.15.6:0/3311974422 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615400b910 con 0x7f615c0d02b0 2023-07-06T19:58:45.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.520+0000 7f6159ffb700 1 -- 172.21.15.6:0/3311974422 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615400bcc0 con 0x7f615c0d02b0 2023-07-06T19:58:45.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.520+0000 7f615bfff700 1 -- 172.21.15.6:0/3311974422 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f615c0d02b0 msgr2=0x7f615c0cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:45.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.520+0000 7f615bfff700 1 --2- 172.21.15.6:0/3311974422 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f615c0d02b0 0x7f615c0cf070 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6154009e50 tx=0x7f615400b330 comp rx=0 tx=0).stop 2023-07-06T19:58:45.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.520+0000 7f615bfff700 1 -- 172.21.15.6:0/3311974422 shutdown_connections 2023-07-06T19:58:45.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.520+0000 7f615bfff700 1 --2- 172.21.15.6:0/3311974422 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f615c0d02b0 0x7f615c0cf070 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:45.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.520+0000 7f615bfff700 1 --2- 172.21.15.6:0/3311974422 >> v2:172.21.15.40:3300/0 conn(0x7f615c0b22d0 0x7f615c0b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:45.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.520+0000 7f615bfff700 1 -- 172.21.15.6:0/3311974422 >> 172.21.15.6:0/3311974422 conn(0x7f615c0cd2a0 msgr2=0x7f615c0cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:45.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.520+0000 7f615bfff700 1 -- 172.21.15.6:0/3311974422 shutdown_connections 2023-07-06T19:58:45.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.520+0000 7f615bfff700 1 -- 172.21.15.6:0/3311974422 wait complete. 2023-07-06T19:58:45.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.522+0000 7f615bfff700 1 Processor -- start 2023-07-06T19:58:45.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.522+0000 7f615bfff700 1 -- start start 2023-07-06T19:58:45.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.523+0000 7f615bfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f615c0b22d0 0x7f615c153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:45.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.523+0000 7f615bfff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f615c0d02b0 0x7f615c06c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:45.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.523+0000 7f615bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f615c15a330 0x7f615c0c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:45.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.523+0000 7f615bfff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c06c950 con 0x7f615c15a330 2023-07-06T19:58:45.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.523+0000 7f615bfff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c0c9b00 con 0x7f615c0d02b0 2023-07-06T19:58:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.523+0000 7f615bfff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615c0c9f90 con 0x7f615c0b22d0 2023-07-06T19:58:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.523+0000 7f615b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f615c15a330 0x7f615c0c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.523+0000 7f615b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f615c15a330 0x7f615c0c53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58102/0 (socket says 172.21.15.6:58102) 2023-07-06T19:58:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.523+0000 7f615b7fe700 1 -- 172.21.15.6:0/1462362757 learned_addr learned my addr 172.21.15.6:0/1462362757 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.523+0000 7f615affd700 1 --2- 172.21.15.6:0/1462362757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f615c0b22d0 0x7f615c153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.523+0000 7f615a7fc700 1 --2- 172.21.15.6:0/1462362757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f615c0d02b0 0x7f615c06c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.523+0000 7f615b7fe700 1 -- 172.21.15.6:0/1462362757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f615c0b22d0 msgr2=0x7f615c153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:45.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.523+0000 7f615b7fe700 1 --2- 172.21.15.6:0/1462362757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f615c0b22d0 0x7f615c153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:45.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.523+0000 7f615b7fe700 1 -- 172.21.15.6:0/1462362757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f615c0d02b0 msgr2=0x7f615c06c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:45.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.523+0000 7f615b7fe700 1 --2- 172.21.15.6:0/1462362757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f615c0d02b0 0x7f615c06c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:45.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.523+0000 7f615b7fe700 1 -- 172.21.15.6:0/1462362757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61500094a0 con 0x7f615c15a330 2023-07-06T19:58:45.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.523+0000 7f615b7fe700 1 --2- 172.21.15.6:0/1462362757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f615c15a330 0x7f615c0c53c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f615400b370 tx=0x7f6154004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:45.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.523+0000 7f6143fff700 1 -- 172.21.15.6:0/1462362757 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154004880 con 0x7f615c15a330 2023-07-06T19:58:45.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.524+0000 7f6143fff700 1 -- 172.21.15.6:0/1462362757 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61540092e0 con 0x7f615c15a330 2023-07-06T19:58:45.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.524+0000 7f615bfff700 1 -- 172.21.15.6:0/1462362757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6154009b30 con 0x7f615c15a330 2023-07-06T19:58:45.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.524+0000 7f6143fff700 1 -- 172.21.15.6:0/1462362757 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615401c680 con 0x7f615c15a330 2023-07-06T19:58:45.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.524+0000 7f615bfff700 1 -- 172.21.15.6:0/1462362757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615c0c91d0 con 0x7f615c15a330 2023-07-06T19:58:45.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.525+0000 7f615bfff700 1 -- 172.21.15.6:0/1462362757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615c04eb90 con 0x7f615c15a330 2023-07-06T19:58:45.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.525+0000 7f6143fff700 1 -- 172.21.15.6:0/1462362757 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f615401c7e0 con 0x7f615c15a330 2023-07-06T19:58:45.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.525+0000 7f6143fff700 1 --2- 172.21.15.6:0/1462362757 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f614806ad10 0x7f614806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:45.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.525+0000 7f6143fff700 1 -- 172.21.15.6:0/1462362757 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f615408a800 con 0x7f615c15a330 2023-07-06T19:58:45.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.525+0000 7f615affd700 1 --2- 172.21.15.6:0/1462362757 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f614806ad10 0x7f614806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:45.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.526+0000 7f615affd700 1 --2- 172.21.15.6:0/1462362757 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f614806ad10 0x7f614806d1c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6150009d70 tx=0x7f6150009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:45.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.530+0000 7f6143fff700 1 -- 172.21.15.6:0/1462362757 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6154055df0 con 0x7f615c15a330 2023-07-06T19:58:45.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:45.729+0000 7f615bfff700 1 -- 172.21.15.6:0/1462362757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f615c0b2030 con 0x7f615c15a330 2023-07-06T19:58:46.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.694+0000 7f6143fff700 1 -- 172.21.15.6:0/1462362757 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f6154059410 con 0x7f615c15a330 2023-07-06T19:58:46.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.698+0000 7f615bfff700 1 -- 172.21.15.6:0/1462362757 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f614806ad10 msgr2=0x7f614806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:46.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.698+0000 7f615bfff700 1 --2- 172.21.15.6:0/1462362757 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f614806ad10 0x7f614806d1c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6150009d70 tx=0x7f6150009210 comp rx=0 tx=0).stop 2023-07-06T19:58:46.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.698+0000 7f615bfff700 1 -- 172.21.15.6:0/1462362757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f615c15a330 msgr2=0x7f615c0c53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:46.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.698+0000 7f615bfff700 1 --2- 172.21.15.6:0/1462362757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f615c15a330 0x7f615c0c53c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f615400b370 tx=0x7f6154004b20 comp rx=0 tx=0).stop 2023-07-06T19:58:46.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.698+0000 7f615bfff700 1 -- 172.21.15.6:0/1462362757 shutdown_connections 2023-07-06T19:58:46.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.698+0000 7f615bfff700 1 --2- 172.21.15.6:0/1462362757 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f614806ad10 0x7f614806d1c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:46.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.698+0000 7f615bfff700 1 --2- 172.21.15.6:0/1462362757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f615c15a330 0x7f615c0c53c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:46.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.698+0000 7f615bfff700 1 --2- 172.21.15.6:0/1462362757 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f615c0b22d0 0x7f615c153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:46.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.698+0000 7f615bfff700 1 --2- 172.21.15.6:0/1462362757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f615c0d02b0 0x7f615c06c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:46.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.698+0000 7f615bfff700 1 -- 172.21.15.6:0/1462362757 >> 172.21.15.6:0/1462362757 conn(0x7f615c0cd2a0 msgr2=0x7f615c0afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:46.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.699+0000 7f615bfff700 1 -- 172.21.15.6:0/1462362757 shutdown_connections 2023-07-06T19:58:46.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.699+0000 7f615bfff700 1 -- 172.21.15.6:0/1462362757 wait complete. 2023-07-06T19:58:46.709 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'rbd' created 2023-07-06T19:58:46.721 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-06T19:58:46.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.854+0000 7fcda9e73700 1 Processor -- start 2023-07-06T19:58:46.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.854+0000 7fcda9e73700 1 -- start start 2023-07-06T19:58:46.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.855+0000 7fcda9e73700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcda415c2c0 0x7fcda40aee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:46.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.855+0000 7fcda9e73700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcda406ad40 0x7fcda415ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:46.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.855+0000 7fcda9e73700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda4160660 con 0x7fcda4071690 2023-07-06T19:58:46.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.855+0000 7fcda9e73700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda4160940 con 0x7fcda415c2c0 2023-07-06T19:58:46.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.855+0000 7fcda9e73700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda4160c20 con 0x7fcda406ad40 2023-07-06T19:58:46.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.855+0000 7fcda37fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcda415c2c0 0x7fcda40aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:46.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.855+0000 7fcda3fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcda4071690 0x7fcda4071a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59318/0 (socket says 172.21.15.6:59318) 2023-07-06T19:58:46.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.855+0000 7fcda3fff700 1 -- 172.21.15.6:0/3506850920 learned_addr learned my addr 172.21.15.6:0/3506850920 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:58:46.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.855+0000 7fcda2ffd700 1 --2- 172.21.15.6:0/3506850920 >> v2:172.21.15.40:3300/0 conn(0x7fcda406ad40 0x7fcda415ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:46.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.855+0000 7fcda37fe700 1 -- 172.21.15.6:0/3506850920 >> v2:172.21.15.40:3300/0 conn(0x7fcda406ad40 msgr2=0x7fcda415ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.855+0000 7fcda37fe700 1 --2- 172.21.15.6:0/3506850920 >> v2:172.21.15.40:3300/0 conn(0x7fcda406ad40 0x7fcda415ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.855+0000 7fcda37fe700 1 -- 172.21.15.6:0/3506850920 >> v1:172.21.15.6:6789/0 conn(0x7fcda4071690 legacy=0x7fcda4071a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.855+0000 7fcda37fe700 1 -- 172.21.15.6:0/3506850920 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda40cdca0 con 0x7fcda415c2c0 2023-07-06T19:58:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.855+0000 7fcda27fc700 1 -- 172.21.15.6:0/3506850920 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3772374778 0 0) 0x7fcda4160660 con 0x7fcda4071690 2023-07-06T19:58:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.855+0000 7fcda37fe700 1 --2- 172.21.15.6:0/3506850920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda415c2c0 0x7fcda40aee50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcda40c9f20 tx=0x7fcd94009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34284401aebeda server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.855+0000 7fcda27fc700 1 -- 172.21.15.6:0/3506850920 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94011830 con 0x7fcda415c2c0 2023-07-06T19:58:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.855+0000 7fcda27fc700 1 -- 172.21.15.6:0/3506850920 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd94011990 con 0x7fcda415c2c0 2023-07-06T19:58:46.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.855+0000 7fcda27fc700 1 -- 172.21.15.6:0/3506850920 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94011d20 con 0x7fcda415c2c0 2023-07-06T19:58:46.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.856+0000 7fcda9e73700 1 -- 172.21.15.6:0/3506850920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda415c2c0 msgr2=0x7fcda40aee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:46.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.856+0000 7fcda9e73700 1 --2- 172.21.15.6:0/3506850920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda415c2c0 0x7fcda40aee50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcda40c9f20 tx=0x7fcd94009b20 comp rx=0 tx=0).stop 2023-07-06T19:58:46.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.856+0000 7fcda9e73700 1 -- 172.21.15.6:0/3506850920 shutdown_connections 2023-07-06T19:58:46.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.856+0000 7fcda9e73700 1 --2- 172.21.15.6:0/3506850920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda415c2c0 0x7fcda40aee50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:46.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.856+0000 7fcda9e73700 1 --2- 172.21.15.6:0/3506850920 >> v2:172.21.15.40:3300/0 conn(0x7fcda406ad40 0x7fcda415ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:46.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.856+0000 7fcda9e73700 1 -- 172.21.15.6:0/3506850920 >> 172.21.15.6:0/3506850920 conn(0x7fcda40cf940 msgr2=0x7fcda40cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:46.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.856+0000 7fcda9e73700 1 -- 172.21.15.6:0/3506850920 shutdown_connections 2023-07-06T19:58:46.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.856+0000 7fcda9e73700 1 -- 172.21.15.6:0/3506850920 wait complete. 2023-07-06T19:58:46.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.857+0000 7fcda9e73700 1 Processor -- start 2023-07-06T19:58:46.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.857+0000 7fcda9e73700 1 -- start start 2023-07-06T19:58:46.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.858+0000 7fcda9e73700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcda406ad40 0x7fcda415a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:46.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.858+0000 7fcda9e73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda4071690 0x7fcda406bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:46.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.858+0000 7fcda9e73700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcda415c2c0 0x7fcda4155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.858+0000 7fcda9e73700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda41f5c90 con 0x7fcda4071690 2023-07-06T19:58:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.858+0000 7fcda9e73700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda41f67d0 con 0x7fcda406ad40 2023-07-06T19:58:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.858+0000 7fcda9e73700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda41f5ea0 con 0x7fcda415c2c0 2023-07-06T19:58:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.858+0000 7fcda2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda4071690 0x7fcda406bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.858+0000 7fcda2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda4071690 0x7fcda406bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58116/0 (socket says 172.21.15.6:58116) 2023-07-06T19:58:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.858+0000 7fcda2ffd700 1 -- 172.21.15.6:0/63850555 learned_addr learned my addr 172.21.15.6:0/63850555 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.858+0000 7fcda37fe700 1 --2- 172.21.15.6:0/63850555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcda406ad40 0x7fcda415a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:46.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.858+0000 7fcda3fff700 1 --2- 172.21.15.6:0/63850555 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcda415c2c0 0x7fcda4155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:46.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.858+0000 7fcda2ffd700 1 -- 172.21.15.6:0/63850555 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcda415c2c0 msgr2=0x7fcda4155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:46.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.859+0000 7fcda2ffd700 1 --2- 172.21.15.6:0/63850555 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcda415c2c0 0x7fcda4155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:46.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.859+0000 7fcda2ffd700 1 -- 172.21.15.6:0/63850555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcda406ad40 msgr2=0x7fcda415a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:46.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.859+0000 7fcda2ffd700 1 --2- 172.21.15.6:0/63850555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcda406ad40 0x7fcda415a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:46.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.859+0000 7fcda2ffd700 1 -- 172.21.15.6:0/63850555 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd940094a0 con 0x7fcda4071690 2023-07-06T19:58:46.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.859+0000 7fcda37fe700 1 --2- 172.21.15.6:0/63850555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcda406ad40 0x7fcda415a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:58:46.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.859+0000 7fcda2ffd700 1 --2- 172.21.15.6:0/63850555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda4071690 0x7fcda406bf10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800e810 tx=0x7fcd9800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:46.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.859+0000 7fcd8bfff700 1 -- 172.21.15.6:0/63850555 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd98013610 con 0x7fcda4071690 2023-07-06T19:58:46.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.859+0000 7fcd8bfff700 1 -- 172.21.15.6:0/63850555 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd98013770 con 0x7fcda4071690 2023-07-06T19:58:46.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.859+0000 7fcda9e73700 1 -- 172.21.15.6:0/63850555 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda41f6180 con 0x7fcda4071690 2023-07-06T19:58:46.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.859+0000 7fcd8bfff700 1 -- 172.21.15.6:0/63850555 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd98013b20 con 0x7fcda4071690 2023-07-06T19:58:46.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.859+0000 7fcda9e73700 1 -- 172.21.15.6:0/63850555 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda415acf0 con 0x7fcda4071690 2023-07-06T19:58:46.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.860+0000 7fcda9e73700 1 -- 172.21.15.6:0/63850555 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda41f6980 con 0x7fcda4071690 2023-07-06T19:58:46.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.860+0000 7fcd8bfff700 1 -- 172.21.15.6:0/63850555 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcd98013c80 con 0x7fcda4071690 2023-07-06T19:58:46.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.861+0000 7fcd8bfff700 1 --2- 172.21.15.6:0/63850555 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcd9006ace0 0x7fcd9006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:46.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.861+0000 7fcd8bfff700 1 -- 172.21.15.6:0/63850555 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7fcd98088d60 con 0x7fcda4071690 2023-07-06T19:58:46.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.861+0000 7fcda37fe700 1 --2- 172.21.15.6:0/63850555 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcd9006ace0 0x7fcd9006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:46.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.861+0000 7fcda37fe700 1 --2- 172.21.15.6:0/63850555 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcd9006ace0 0x7fcd9006d190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcd940090b0 tx=0x7fcd94008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:46.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:46.865+0000 7fcd8bfff700 1 -- 172.21.15.6:0/63850555 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcda41f6980 con 0x7fcda4071690 2023-07-06T19:58:47.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.067+0000 7fcda9e73700 1 -- 172.21.15.6:0/63850555 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcda41f6b60 con 0x7fcda4071690 2023-07-06T19:58:47.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.699+0000 7fcd8bfff700 1 -- 172.21.15.6:0/63850555 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7fcda41f6b60 con 0x7fcda4071690 2023-07-06T19:58:47.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.703+0000 7fcda9e73700 1 -- 172.21.15.6:0/63850555 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcd9006ace0 msgr2=0x7fcd9006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:47.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.703+0000 7fcda9e73700 1 --2- 172.21.15.6:0/63850555 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcd9006ace0 0x7fcd9006d190 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcd940090b0 tx=0x7fcd94008030 comp rx=0 tx=0).stop 2023-07-06T19:58:47.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.703+0000 7fcda9e73700 1 -- 172.21.15.6:0/63850555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda4071690 msgr2=0x7fcda406bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:47.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.703+0000 7fcda9e73700 1 --2- 172.21.15.6:0/63850555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda4071690 0x7fcda406bf10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800e810 tx=0x7fcd9800ebd0 comp rx=0 tx=0).stop 2023-07-06T19:58:47.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.703+0000 7fcda9e73700 1 -- 172.21.15.6:0/63850555 shutdown_connections 2023-07-06T19:58:47.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.703+0000 7fcda9e73700 1 --2- 172.21.15.6:0/63850555 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcd9006ace0 0x7fcd9006d190 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:47.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.703+0000 7fcda9e73700 1 --2- 172.21.15.6:0/63850555 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcda415c2c0 0x7fcda4155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:47.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.703+0000 7fcda9e73700 1 --2- 172.21.15.6:0/63850555 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcda406ad40 0x7fcda415a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:47.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.703+0000 7fcda9e73700 1 --2- 172.21.15.6:0/63850555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda4071690 0x7fcda406bf10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:47.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.703+0000 7fcda9e73700 1 -- 172.21.15.6:0/63850555 >> 172.21.15.6:0/63850555 conn(0x7fcda40cf940 msgr2=0x7fcda40cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:47.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.703+0000 7fcda9e73700 1 -- 172.21.15.6:0/63850555 shutdown_connections 2023-07-06T19:58:47.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.704+0000 7fcda9e73700 1 -- 172.21.15.6:0/63850555 wait complete. 2023-07-06T19:58:47.711 INFO:teuthology.orchestra.run.smithi006.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-06T19:58:47.725 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-06T19:58:47.726 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-06T19:58:47.726 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-06T19:58:47.730 INFO:tasks.ceph.mds.a:Started 2023-07-06T19:58:47.730 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-06T19:58:47.730 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-06T19:58:47.736 INFO:tasks.ceph.mds.c:Started 2023-07-06T19:58:47.737 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-06T19:58:47.737 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-06T19:58:47.743 INFO:tasks.ceph.mds.b:Started 2023-07-06T19:58:47.743 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-06T19:58:47.744 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-06T19:58:47.746 INFO:tasks.ceph.mds.d:Started 2023-07-06T19:58:47.747 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-06T19:58:47.747 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T19:58:47.818 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-07-06T19:58:47.824 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-07-06T19:58:47.835 INFO:tasks.ceph.mds.b.smithi040.stdout:starting mds.b at 2023-07-06T19:58:47.836 INFO:tasks.ceph.mds.d.smithi040.stdout:starting mds.d at 2023-07-06T19:58:47.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.884+0000 7f4b35c87700 1 Processor -- start 2023-07-06T19:58:47.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.884+0000 7f4b35c87700 1 -- start start 2023-07-06T19:58:47.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.884+0000 7f4b35c87700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b300cee80 0x7f4b301609d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:47.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.884+0000 7f4b35c87700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b30160ff0 con 0x7f4b30071dd0 2023-07-06T19:58:47.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.884+0000 7f4b35c87700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b300ca100 con 0x7f4b300ceab0 2023-07-06T19:58:47.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.884+0000 7f4b35c87700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b300ca3e0 con 0x7f4b300cee80 2023-07-06T19:58:47.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.885+0000 7f4b2effd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4b30071dd0 0x7f4b301602c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59356/0 (socket says 172.21.15.6:59356) 2023-07-06T19:58:47.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.885+0000 7f4b2effd700 1 -- 172.21.15.6:0/299050956 learned_addr learned my addr 172.21.15.6:0/299050956 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:58:47.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.885+0000 7f4b2ffff700 1 --2- 172.21.15.6:0/299050956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b300cee80 0x7f4b301609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:47.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.885+0000 7f4b2e7fc700 1 -- 172.21.15.6:0/299050956 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 453646275 0 0) 0x7f4b30160ff0 con 0x7f4b30071dd0 2023-07-06T19:58:47.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.885+0000 7f4b2e7fc700 1 -- 172.21.15.6:0/299050956 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b180035b0 con 0x7f4b30071dd0 2023-07-06T19:58:47.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.885+0000 7f4b2e7fc700 1 -- 172.21.15.6:0/299050956 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2672386616 0 0) 0x7f4b180035b0 con 0x7f4b30071dd0 2023-07-06T19:58:47.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.885+0000 7f4b2e7fc700 1 -- 172.21.15.6:0/299050956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b300cee80 msgr2=0x7f4b301609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:47.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.885+0000 7f4b2e7fc700 1 --2- 172.21.15.6:0/299050956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b300cee80 0x7f4b301609d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:47.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.885+0000 7f4b2e7fc700 1 -- 172.21.15.6:0/299050956 >> v1:172.21.15.40:6789/0 conn(0x7f4b300ceab0 legacy=0x7f4b300716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:47.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.885+0000 7f4b2e7fc700 1 -- 172.21.15.6:0/299050956 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b300ca6c0 con 0x7f4b30071dd0 2023-07-06T19:58:47.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.885+0000 7f4b2e7fc700 1 -- 172.21.15.6:0/299050956 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f4b24001670 con 0x7f4b30071dd0 2023-07-06T19:58:47.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.885+0000 7f4b2e7fc700 1 -- 172.21.15.6:0/299050956 >> v1:172.21.15.6:6789/0 conn(0x7f4b30071dd0 legacy=0x7f4b301602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:47.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.885+0000 7f4b2e7fc700 1 --2- 172.21.15.6:0/299050956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b300cee80 0x7f4b18003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:47.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.885+0000 7f4b2e7fc700 1 --2- 172.21.15.6:0/299050956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b18003fe0 0x7f4b18004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:47.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.885+0000 7f4b2e7fc700 1 --2- 172.21.15.6:0/299050956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b18004d90 0x7f4b18005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:47.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.885+0000 7f4b2e7fc700 1 -- 172.21.15.6:0/299050956 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b300ca3e0 con 0x7f4b18003fe0 2023-07-06T19:58:47.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.885+0000 7f4b2e7fc700 1 -- 172.21.15.6:0/299050956 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1800bac0 con 0x7f4b18004d90 2023-07-06T19:58:47.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.885+0000 7f4b2e7fc700 1 -- 172.21.15.6:0/299050956 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1800bc80 con 0x7f4b300cee80 2023-07-06T19:58:47.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.885+0000 7f4b2effd700 1 --2- 172.21.15.6:0/299050956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b18003fe0 0x7f4b18004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:47.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.885+0000 7f4b2f7fe700 1 --2- 172.21.15.6:0/299050956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b300cee80 0x7f4b18003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:47.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.885+0000 7f4b2ffff700 1 --2- 172.21.15.6:0/299050956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b18004d90 0x7f4b18005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:47.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.886+0000 7f4b2effd700 1 -- 172.21.15.6:0/299050956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b300cee80 msgr2=0x7f4b18003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:47.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.886+0000 7f4b2effd700 1 --2- 172.21.15.6:0/299050956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b300cee80 0x7f4b18003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:47.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.886+0000 7f4b2effd700 1 -- 172.21.15.6:0/299050956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b18004d90 msgr2=0x7f4b18005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:47.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.886+0000 7f4b2effd700 1 --2- 172.21.15.6:0/299050956 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b18004d90 0x7f4b18005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:47.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.886+0000 7f4b2effd700 1 -- 172.21.15.6:0/299050956 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b180035b0 con 0x7f4b18003fe0 2023-07-06T19:58:47.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.886+0000 7f4b2effd700 1 --2- 172.21.15.6:0/299050956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b18003fe0 0x7f4b18004850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4b3006eab0 tx=0x7f4b18005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149ba9ad1cd2e9cc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:47.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.886+0000 7f4b2e7fc700 1 -- 172.21.15.6:0/299050956 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2400cd50 con 0x7f4b18003fe0 2023-07-06T19:58:47.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.886+0000 7f4b2e7fc700 1 -- 172.21.15.6:0/299050956 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b24007ba0 con 0x7f4b18003fe0 2023-07-06T19:58:47.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.886+0000 7f4b2e7fc700 1 -- 172.21.15.6:0/299050956 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b24005ba0 con 0x7f4b18003fe0 2023-07-06T19:58:47.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.886+0000 7f4b35c87700 1 -- 172.21.15.6:0/299050956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b18003fe0 msgr2=0x7f4b18004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:47.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.886+0000 7f4b35c87700 1 --2- 172.21.15.6:0/299050956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b18003fe0 0x7f4b18004850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4b3006eab0 tx=0x7f4b18005880 comp rx=0 tx=0).stop 2023-07-06T19:58:47.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.886+0000 7f4b2ffff700 1 -- 172.21.15.6:0/299050956 reap_dead start 2023-07-06T19:58:47.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.886+0000 7f4b35c87700 1 -- 172.21.15.6:0/299050956 shutdown_connections 2023-07-06T19:58:47.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.886+0000 7f4b35c87700 1 -- 172.21.15.6:0/299050956 >> 172.21.15.6:0/299050956 conn(0x7f4b300cc420 msgr2=0x7f4b300cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:47.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.886+0000 7f4b35c87700 1 -- 172.21.15.6:0/299050956 shutdown_connections 2023-07-06T19:58:47.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.887+0000 7f4b35c87700 1 -- 172.21.15.6:0/299050956 wait complete. 2023-07-06T19:58:47.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.888+0000 7f4b35c87700 1 Processor -- start 2023-07-06T19:58:47.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.888+0000 7f4b35c87700 1 -- start start 2023-07-06T19:58:47.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.889+0000 7f4b35c87700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b18003fe0 0x7f4b300c5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:47.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.889+0000 7f4b35c87700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b301f5650 0x7f4b301f5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:47.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.889+0000 7f4b35c87700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b3006b080 0x7f4b3006b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:47.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.889+0000 7f4b35c87700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3006c9b0 con 0x7f4b301f5650 2023-07-06T19:58:47.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.889+0000 7f4b35c87700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b300c5980 con 0x7f4b18003fe0 2023-07-06T19:58:47.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.889+0000 7f4b35c87700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b301f6000 con 0x7f4b3006b080 2023-07-06T19:58:47.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.889+0000 7f4b2effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b301f5650 0x7f4b301f5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:47.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.889+0000 7f4b2effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b301f5650 0x7f4b301f5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58160/0 (socket says 172.21.15.6:58160) 2023-07-06T19:58:47.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.889+0000 7f4b2effd700 1 -- 172.21.15.6:0/3171800607 learned_addr learned my addr 172.21.15.6:0/3171800607 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:47.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.889+0000 7f4b2f7fe700 1 --2- 172.21.15.6:0/3171800607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b18003fe0 0x7f4b300c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:47.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.889+0000 7f4b2ffff700 1 --2- 172.21.15.6:0/3171800607 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b3006b080 0x7f4b3006b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:47.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.889+0000 7f4b2effd700 1 -- 172.21.15.6:0/3171800607 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b3006b080 msgr2=0x7f4b3006b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:47.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.889+0000 7f4b2effd700 1 --2- 172.21.15.6:0/3171800607 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b3006b080 0x7f4b3006b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:47.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.889+0000 7f4b2effd700 1 -- 172.21.15.6:0/3171800607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b18003fe0 msgr2=0x7f4b300c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:47.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.889+0000 7f4b2effd700 1 --2- 172.21.15.6:0/3171800607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b18003fe0 0x7f4b300c5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:47.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.889+0000 7f4b2effd700 1 -- 172.21.15.6:0/3171800607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3006be30 con 0x7f4b301f5650 2023-07-06T19:58:47.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.889+0000 7f4b2effd700 1 --2- 172.21.15.6:0/3171800607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b301f5650 0x7f4b301f5ac0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4b180047d0 tx=0x7f4b300cf2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:47.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.889+0000 7f4b17fff700 1 -- 172.21.15.6:0/3171800607 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b240072d0 con 0x7f4b301f5650 2023-07-06T19:58:47.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.889+0000 7f4b17fff700 1 -- 172.21.15.6:0/3171800607 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b24007450 con 0x7f4b301f5650 2023-07-06T19:58:47.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.889+0000 7f4b35c87700 1 -- 172.21.15.6:0/3171800607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b3006c110 con 0x7f4b301f5650 2023-07-06T19:58:47.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.889+0000 7f4b17fff700 1 -- 172.21.15.6:0/3171800607 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b24007800 con 0x7f4b301f5650 2023-07-06T19:58:47.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.889+0000 7f4b35c87700 1 -- 172.21.15.6:0/3171800607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b3006c6d0 con 0x7f4b301f5650 2023-07-06T19:58:47.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.890+0000 7f4b35c87700 1 -- 172.21.15.6:0/3171800607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b300c3700 con 0x7f4b301f5650 2023-07-06T19:58:47.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.891+0000 7f4b17fff700 1 -- 172.21.15.6:0/3171800607 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4b24019030 con 0x7f4b301f5650 2023-07-06T19:58:47.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.891+0000 7f4b17fff700 1 --2- 172.21.15.6:0/3171800607 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4b1c06ace0 0x7f4b1c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:47.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.891+0000 7f4b17fff700 1 -- 172.21.15.6:0/3171800607 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4b2408a4c0 con 0x7f4b301f5650 2023-07-06T19:58:47.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.891+0000 7f4b2f7fe700 1 --2- 172.21.15.6:0/3171800607 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4b1c06ace0 0x7f4b1c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:47.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.892+0000 7f4b2f7fe700 1 --2- 172.21.15.6:0/3171800607 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4b1c06ace0 0x7f4b1c06d190 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4b20007fd0 tx=0x7f4b20009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:47.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:47.896+0000 7f4b17fff700 1 -- 172.21.15.6:0/3171800607 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4b24055b30 con 0x7f4b301f5650 2023-07-06T19:58:48.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.097+0000 7f4b35c87700 1 -- 172.21.15.6:0/3171800607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b300c34d0 con 0x7f4b301f5650 2023-07-06T19:58:48.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.098+0000 7f4b17fff700 1 -- 172.21.15.6:0/3171800607 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14493 (secure 0 0 0) 0x7f4b24059150 con 0x7f4b301f5650 2023-07-06T19:58:48.100 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:58:48.100 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:58:47.693405+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:58:48.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.100+0000 7f4b35c87700 1 -- 172.21.15.6:0/3171800607 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4b1c06ace0 msgr2=0x7f4b1c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:48.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.100+0000 7f4b35c87700 1 --2- 172.21.15.6:0/3171800607 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4b1c06ace0 0x7f4b1c06d190 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4b20007fd0 tx=0x7f4b20009040 comp rx=0 tx=0).stop 2023-07-06T19:58:48.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.100+0000 7f4b35c87700 1 -- 172.21.15.6:0/3171800607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b301f5650 msgr2=0x7f4b301f5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:48.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.100+0000 7f4b35c87700 1 --2- 172.21.15.6:0/3171800607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b301f5650 0x7f4b301f5ac0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4b180047d0 tx=0x7f4b300cf2e0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.100+0000 7f4b35c87700 1 -- 172.21.15.6:0/3171800607 shutdown_connections 2023-07-06T19:58:48.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.100+0000 7f4b35c87700 1 --2- 172.21.15.6:0/3171800607 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4b1c06ace0 0x7f4b1c06d190 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.100+0000 7f4b35c87700 1 --2- 172.21.15.6:0/3171800607 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4b3006b080 0x7f4b3006b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.100+0000 7f4b35c87700 1 --2- 172.21.15.6:0/3171800607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4b18003fe0 0x7f4b300c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.100+0000 7f4b35c87700 1 --2- 172.21.15.6:0/3171800607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b301f5650 0x7f4b301f5ac0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.100+0000 7f4b35c87700 1 -- 172.21.15.6:0/3171800607 >> 172.21.15.6:0/3171800607 conn(0x7f4b300cc420 msgr2=0x7f4b3015f370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:48.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.100+0000 7f4b35c87700 1 -- 172.21.15.6:0/3171800607 shutdown_connections 2023-07-06T19:58:48.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.100+0000 7f4b35c87700 1 -- 172.21.15.6:0/3171800607 wait complete. 2023-07-06T19:58:48.115 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T19:58:38.767727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T19:58:45.759808+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T19:58:48.125 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T19:58:48.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.252+0000 7fd6da067700 1 Processor -- start 2023-07-06T19:58:48.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.252+0000 7fd6da067700 1 -- start start 2023-07-06T19:58:48.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.253+0000 7fd6da067700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd6d40ca850 0x7fd6d415bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:48.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.253+0000 7fd6da067700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6d4071cd0 0x7fd6d415c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:48.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.253+0000 7fd6da067700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d40cb310 con 0x7fd6d4071900 2023-07-06T19:58:48.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.253+0000 7fd6da067700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d40cdbf0 con 0x7fd6d40ca850 2023-07-06T19:58:48.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.253+0000 7fd6da067700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d415c9d0 con 0x7fd6d4071cd0 2023-07-06T19:58:48.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.253+0000 7fd6d3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6d4071cd0 0x7fd6d415c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:48.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.254+0000 7fd6d2ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd6d40ca850 0x7fd6d415bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:48.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.254+0000 7fd6d3fff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6d4071cd0 0x7fd6d415c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:50810/0 (socket says 172.21.15.6:50810) 2023-07-06T19:58:48.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.254+0000 7fd6d2ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd6d40ca850 0x7fd6d415bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:37202/0 (socket says 172.21.15.6:37202) 2023-07-06T19:58:48.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.254+0000 7fd6d3fff700 1 -- 172.21.15.6:0/150830906 learned_addr learned my addr 172.21.15.6:0/150830906 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:48.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.254+0000 7fd6d3fff700 1 -- 172.21.15.6:0/150830906 >> v2:172.21.15.40:3300/0 conn(0x7fd6d40ca850 msgr2=0x7fd6d415bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:48.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.254+0000 7fd6d3fff700 1 --2- 172.21.15.6:0/150830906 >> v2:172.21.15.40:3300/0 conn(0x7fd6d40ca850 0x7fd6d415bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.254+0000 7fd6d3fff700 1 -- 172.21.15.6:0/150830906 >> v1:172.21.15.40:6789/0 conn(0x7fd6d4071900 legacy=0x7fd6d40ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:48.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.254+0000 7fd6d3fff700 1 -- 172.21.15.6:0/150830906 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d40af070 con 0x7fd6d4071cd0 2023-07-06T19:58:48.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.254+0000 7fd6d2ffd700 1 --2- 172.21.15.6:0/150830906 >> v2:172.21.15.40:3300/0 conn(0x7fd6d40ca850 0x7fd6d415bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:58:48.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.254+0000 7fd6d3fff700 1 --2- 172.21.15.6:0/150830906 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6d4071cd0 0x7fd6d415c490 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc009e50 tx=0x7fd6cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fbbe61d53140c6b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:48.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.254+0000 7fd6d27fc700 1 -- 172.21.15.6:0/150830906 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc00e070 con 0x7fd6d4071cd0 2023-07-06T19:58:48.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.254+0000 7fd6d27fc700 1 -- 172.21.15.6:0/150830906 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc00b910 con 0x7fd6d4071cd0 2023-07-06T19:58:48.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.254+0000 7fd6d27fc700 1 -- 172.21.15.6:0/150830906 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc00bcc0 con 0x7fd6d4071cd0 2023-07-06T19:58:48.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.255+0000 7fd6da067700 1 -- 172.21.15.6:0/150830906 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6d4071cd0 msgr2=0x7fd6d415c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:48.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.255+0000 7fd6da067700 1 --2- 172.21.15.6:0/150830906 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6d4071cd0 0x7fd6d415c490 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc009e50 tx=0x7fd6cc00b330 comp rx=0 tx=0).stop 2023-07-06T19:58:48.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.255+0000 7fd6da067700 1 -- 172.21.15.6:0/150830906 shutdown_connections 2023-07-06T19:58:48.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.255+0000 7fd6da067700 1 --2- 172.21.15.6:0/150830906 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6d4071cd0 0x7fd6d415c490 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.255+0000 7fd6da067700 1 --2- 172.21.15.6:0/150830906 >> v2:172.21.15.40:3300/0 conn(0x7fd6d40ca850 0x7fd6d415bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.255+0000 7fd6da067700 1 -- 172.21.15.6:0/150830906 >> 172.21.15.6:0/150830906 conn(0x7fd6d40cf960 msgr2=0x7fd6d40cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:48.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.255+0000 7fd6da067700 1 -- 172.21.15.6:0/150830906 shutdown_connections 2023-07-06T19:58:48.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.255+0000 7fd6da067700 1 -- 172.21.15.6:0/150830906 wait complete. 2023-07-06T19:58:48.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.256+0000 7fd6da067700 1 Processor -- start 2023-07-06T19:58:48.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.256+0000 7fd6da067700 1 -- start start 2023-07-06T19:58:48.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.257+0000 7fd6da067700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6d4071900 0x7fd6d414ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:48.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.257+0000 7fd6da067700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d4071cd0 0x7fd6d40c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:48.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.257+0000 7fd6da067700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6d40ca850 0x7fd6d40c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:48.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.257+0000 7fd6da067700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d40c8210 con 0x7fd6d4071900 2023-07-06T19:58:48.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.257+0000 7fd6da067700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d40c73f0 con 0x7fd6d4071cd0 2023-07-06T19:58:48.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.257+0000 7fd6da067700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d40c7690 con 0x7fd6d40ca850 2023-07-06T19:58:48.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.257+0000 7fd6d37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6d4071900 0x7fd6d414ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:48.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.257+0000 7fd6d37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6d4071900 0x7fd6d414ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58170/0 (socket says 172.21.15.6:58170) 2023-07-06T19:58:48.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.257+0000 7fd6d37fe700 1 -- 172.21.15.6:0/1126679168 learned_addr learned my addr 172.21.15.6:0/1126679168 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:48.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.257+0000 7fd6d2ffd700 1 --2- 172.21.15.6:0/1126679168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d4071cd0 0x7fd6d40c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:48.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.257+0000 7fd6d3fff700 1 --2- 172.21.15.6:0/1126679168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6d40ca850 0x7fd6d40c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:48.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.257+0000 7fd6d37fe700 1 -- 172.21.15.6:0/1126679168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6d40ca850 msgr2=0x7fd6d40c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:48.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.257+0000 7fd6d37fe700 1 --2- 172.21.15.6:0/1126679168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6d40ca850 0x7fd6d40c8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.257+0000 7fd6d37fe700 1 -- 172.21.15.6:0/1126679168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d4071cd0 msgr2=0x7fd6d40c9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:48.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.257+0000 7fd6d37fe700 1 --2- 172.21.15.6:0/1126679168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d4071cd0 0x7fd6d40c9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.257+0000 7fd6d37fe700 1 -- 172.21.15.6:0/1126679168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c40094a0 con 0x7fd6d4071900 2023-07-06T19:58:48.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.257+0000 7fd6d2ffd700 1 --2- 172.21.15.6:0/1126679168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d4071cd0 0x7fd6d40c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:58:48.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.258+0000 7fd6d37fe700 1 --2- 172.21.15.6:0/1126679168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6d4071900 0x7fd6d414ec30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc00c450 tx=0x7fd6bc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:48.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.258+0000 7fd6cbfff700 1 -- 172.21.15.6:0/1126679168 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc0052d0 con 0x7fd6d4071900 2023-07-06T19:58:48.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.258+0000 7fd6cbfff700 1 -- 172.21.15.6:0/1126679168 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6bc005430 con 0x7fd6d4071900 2023-07-06T19:58:48.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.258+0000 7fd6da067700 1 -- 172.21.15.6:0/1126679168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6cc009b30 con 0x7fd6d4071900 2023-07-06T19:58:48.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.258+0000 7fd6cbfff700 1 -- 172.21.15.6:0/1126679168 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc0038c0 con 0x7fd6d4071900 2023-07-06T19:58:48.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.258+0000 7fd6da067700 1 -- 172.21.15.6:0/1126679168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d40c7c50 con 0x7fd6d4071900 2023-07-06T19:58:48.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.259+0000 7fd6da067700 1 -- 172.21.15.6:0/1126679168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d40b2aa0 con 0x7fd6d4071900 2023-07-06T19:58:48.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.259+0000 7fd6cbfff700 1 -- 172.21.15.6:0/1126679168 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd6bc003a20 con 0x7fd6d4071900 2023-07-06T19:58:48.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.259+0000 7fd6cbfff700 1 --2- 172.21.15.6:0/1126679168 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd6b406ace0 0x7fd6b406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:48.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.260+0000 7fd6d2ffd700 1 --2- 172.21.15.6:0/1126679168 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd6b406ace0 0x7fd6b406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:48.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.260+0000 7fd6cbfff700 1 -- 172.21.15.6:0/1126679168 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd6bc0884d0 con 0x7fd6d4071900 2023-07-06T19:58:48.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.260+0000 7fd6d2ffd700 1 --2- 172.21.15.6:0/1126679168 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd6b406ace0 0x7fd6b406d190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40ca390 tx=0x7fd6c4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:48.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.264+0000 7fd6cbfff700 1 -- 172.21.15.6:0/1126679168 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd6bc0538d0 con 0x7fd6d4071900 2023-07-06T19:58:48.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.461+0000 7fd6da067700 1 -- 172.21.15.6:0/1126679168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd6d404eb90 con 0x7fd6d4071900 2023-07-06T19:58:48.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.461+0000 7fd6cbfff700 1 -- 172.21.15.6:0/1126679168 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd6bc056ef0 con 0x7fd6d4071900 2023-07-06T19:58:48.463 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-06T19:58:48.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.463+0000 7fd6da067700 1 -- 172.21.15.6:0/1126679168 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd6b406ace0 msgr2=0x7fd6b406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:48.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.463+0000 7fd6da067700 1 --2- 172.21.15.6:0/1126679168 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd6b406ace0 0x7fd6b406d190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40ca390 tx=0x7fd6c4008040 comp rx=0 tx=0).stop 2023-07-06T19:58:48.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.463+0000 7fd6da067700 1 -- 172.21.15.6:0/1126679168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6d4071900 msgr2=0x7fd6d414ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:48.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.463+0000 7fd6da067700 1 --2- 172.21.15.6:0/1126679168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6d4071900 0x7fd6d414ec30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc00c450 tx=0x7fd6bc00c810 comp rx=0 tx=0).stop 2023-07-06T19:58:48.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.463+0000 7fd6da067700 1 -- 172.21.15.6:0/1126679168 shutdown_connections 2023-07-06T19:58:48.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.463+0000 7fd6da067700 1 --2- 172.21.15.6:0/1126679168 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd6b406ace0 0x7fd6b406d190 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.463+0000 7fd6da067700 1 --2- 172.21.15.6:0/1126679168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6d4071900 0x7fd6d414ec30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.463+0000 7fd6da067700 1 --2- 172.21.15.6:0/1126679168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6d40ca850 0x7fd6d40c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.463+0000 7fd6da067700 1 --2- 172.21.15.6:0/1126679168 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6d4071cd0 0x7fd6d40c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.463+0000 7fd6da067700 1 -- 172.21.15.6:0/1126679168 >> 172.21.15.6:0/1126679168 conn(0x7fd6d40cf960 msgr2=0x7fd6d406b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:48.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.463+0000 7fd6da067700 1 -- 172.21.15.6:0/1126679168 shutdown_connections 2023-07-06T19:58:48.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.463+0000 7fd6da067700 1 -- 172.21.15.6:0/1126679168 wait complete. 2023-07-06T19:58:48.485 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T19:58:48.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.611+0000 7fa547f43700 1 Processor -- start 2023-07-06T19:58:48.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.611+0000 7fa547f43700 1 -- start start 2023-07-06T19:58:48.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.612+0000 7fa547f43700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa540071da0 0x7fa5400cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:48.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.612+0000 7fa547f43700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa54015cd40 0x7fa5400cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:48.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.612+0000 7fa547f43700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54015d2b0 con 0x7fa5401592b0 2023-07-06T19:58:48.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.612+0000 7fa547f43700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa540159680 con 0x7fa54015cd40 2023-07-06T19:58:48.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.612+0000 7fa547f43700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa54015d590 con 0x7fa540071da0 2023-07-06T19:58:48.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.612+0000 7fa5464e0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa54015cd40 0x7fa5400cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:48.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.612+0000 7fa5464e0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa54015cd40 0x7fa5400cb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58182/0 (socket says 172.21.15.6:58182) 2023-07-06T19:58:48.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.612+0000 7fa5464e0700 1 -- 172.21.15.6:0/2422699091 learned_addr learned my addr 172.21.15.6:0/2422699091 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:48.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.613+0000 7fa5464e0700 1 -- 172.21.15.6:0/2422699091 >> v2:172.21.15.40:3300/0 conn(0x7fa540071da0 msgr2=0x7fa5400cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:48.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.613+0000 7fa5454de700 1 --2- 172.21.15.6:0/2422699091 >> v2:172.21.15.40:3300/0 conn(0x7fa540071da0 0x7fa5400cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:48.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.613+0000 7fa5464e0700 1 --2- 172.21.15.6:0/2422699091 >> v2:172.21.15.40:3300/0 conn(0x7fa540071da0 0x7fa5400cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.613+0000 7fa5464e0700 1 -- 172.21.15.6:0/2422699091 >> v1:172.21.15.40:6789/0 conn(0x7fa5401592b0 legacy=0x7fa540071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:48.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.613+0000 7fa5464e0700 1 -- 172.21.15.6:0/2422699091 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54015d870 con 0x7fa54015cd40 2023-07-06T19:58:48.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.613+0000 7fa5454de700 1 --2- 172.21.15.6:0/2422699091 >> v2:172.21.15.40:3300/0 conn(0x7fa540071da0 0x7fa5400cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:58:48.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.613+0000 7fa5464e0700 1 --2- 172.21.15.6:0/2422699091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa54015cd40 0x7fa5400cb690 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa540071190 tx=0x7fa53800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c9e19932cd3798 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:48.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.613+0000 7fa544cdd700 1 -- 172.21.15.6:0/2422699091 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53800e070 con 0x7fa54015cd40 2023-07-06T19:58:48.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.613+0000 7fa544cdd700 1 -- 172.21.15.6:0/2422699091 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa538003a20 con 0x7fa54015cd40 2023-07-06T19:58:48.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.613+0000 7fa544cdd700 1 -- 172.21.15.6:0/2422699091 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa538003dd0 con 0x7fa54015cd40 2023-07-06T19:58:48.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.613+0000 7fa547f43700 1 -- 172.21.15.6:0/2422699091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa54015cd40 msgr2=0x7fa5400cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:48.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.613+0000 7fa547f43700 1 --2- 172.21.15.6:0/2422699091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa54015cd40 0x7fa5400cb690 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa540071190 tx=0x7fa53800b330 comp rx=0 tx=0).stop 2023-07-06T19:58:48.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.613+0000 7fa547f43700 1 -- 172.21.15.6:0/2422699091 shutdown_connections 2023-07-06T19:58:48.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.613+0000 7fa547f43700 1 --2- 172.21.15.6:0/2422699091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa54015cd40 0x7fa5400cb690 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.613+0000 7fa547f43700 1 --2- 172.21.15.6:0/2422699091 >> v2:172.21.15.40:3300/0 conn(0x7fa540071da0 0x7fa5400cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.613+0000 7fa547f43700 1 -- 172.21.15.6:0/2422699091 >> 172.21.15.6:0/2422699091 conn(0x7fa5400cf960 msgr2=0x7fa5400cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:48.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.614+0000 7fa547f43700 1 -- 172.21.15.6:0/2422699091 shutdown_connections 2023-07-06T19:58:48.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.614+0000 7fa547f43700 1 -- 172.21.15.6:0/2422699091 wait complete. 2023-07-06T19:58:48.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.615+0000 7fa547f43700 1 Processor -- start 2023-07-06T19:58:48.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.615+0000 7fa547f43700 1 -- start start 2023-07-06T19:58:48.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.616+0000 7fa547f43700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa540071da0 0x7fa5400c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:48.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.616+0000 7fa547f43700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5401592b0 0x7fa5400c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:48.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.616+0000 7fa547f43700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa54015cd40 0x7fa54014f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:48.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.616+0000 7fa547f43700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5400b5120 con 0x7fa54015cd40 2023-07-06T19:58:48.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.616+0000 7fa547f43700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5400c58f0 con 0x7fa5401592b0 2023-07-06T19:58:48.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.616+0000 7fa547f43700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5400b4e40 con 0x7fa540071da0 2023-07-06T19:58:48.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.616+0000 7fa5464e0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa54015cd40 0x7fa54014f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:48.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.616+0000 7fa5464e0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa54015cd40 0x7fa54014f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58188/0 (socket says 172.21.15.6:58188) 2023-07-06T19:58:48.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.616+0000 7fa5464e0700 1 -- 172.21.15.6:0/3609095183 learned_addr learned my addr 172.21.15.6:0/3609095183 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:48.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.616+0000 7fa5454de700 1 --2- 172.21.15.6:0/3609095183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5401592b0 0x7fa5400c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:48.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.616+0000 7fa545cdf700 1 --2- 172.21.15.6:0/3609095183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa540071da0 0x7fa5400c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:48.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.617+0000 7fa5464e0700 1 -- 172.21.15.6:0/3609095183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa540071da0 msgr2=0x7fa5400c3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:48.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.617+0000 7fa5464e0700 1 --2- 172.21.15.6:0/3609095183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa540071da0 0x7fa5400c3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.617+0000 7fa5464e0700 1 -- 172.21.15.6:0/3609095183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5401592b0 msgr2=0x7fa5400c53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:48.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.617+0000 7fa5464e0700 1 --2- 172.21.15.6:0/3609095183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5401592b0 0x7fa5400c53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.617+0000 7fa5464e0700 1 -- 172.21.15.6:0/3609095183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa538009b30 con 0x7fa54015cd40 2023-07-06T19:58:48.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.617+0000 7fa5454de700 1 --2- 172.21.15.6:0/3609095183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5401592b0 0x7fa5400c53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:58:48.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.617+0000 7fa545cdf700 1 --2- 172.21.15.6:0/3609095183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa540071da0 0x7fa5400c3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:58:48.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.617+0000 7fa5464e0700 1 --2- 172.21.15.6:0/3609095183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa54015cd40 0x7fa54014f150 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa54006e990 tx=0x7fa538004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:48.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.617+0000 7fa5367fc700 1 -- 172.21.15.6:0/3609095183 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa538004440 con 0x7fa54015cd40 2023-07-06T19:58:48.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.617+0000 7fa5367fc700 1 -- 172.21.15.6:0/3609095183 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5380045a0 con 0x7fa54015cd40 2023-07-06T19:58:48.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.617+0000 7fa547f43700 1 -- 172.21.15.6:0/3609095183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5400c3460 con 0x7fa54015cd40 2023-07-06T19:58:48.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.617+0000 7fa5367fc700 1 -- 172.21.15.6:0/3609095183 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa538004950 con 0x7fa54015cd40 2023-07-06T19:58:48.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.617+0000 7fa547f43700 1 -- 172.21.15.6:0/3609095183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5400c3a20 con 0x7fa54015cd40 2023-07-06T19:58:48.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.618+0000 7fa547f43700 1 -- 172.21.15.6:0/3609095183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5400c32c0 con 0x7fa54015cd40 2023-07-06T19:58:48.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.618+0000 7fa5367fc700 1 -- 172.21.15.6:0/3609095183 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa53801c440 con 0x7fa54015cd40 2023-07-06T19:58:48.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.619+0000 7fa5367fc700 1 --2- 172.21.15.6:0/3609095183 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa52406ace0 0x7fa52406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:48.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.619+0000 7fa545cdf700 1 --2- 172.21.15.6:0/3609095183 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa52406ace0 0x7fa52406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:48.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.619+0000 7fa5367fc700 1 -- 172.21.15.6:0/3609095183 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa53808a5a0 con 0x7fa54015cd40 2023-07-06T19:58:48.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.619+0000 7fa545cdf700 1 --2- 172.21.15.6:0/3609095183 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa52406ace0 0x7fa52406d190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa5400b49b0 tx=0x7fa530009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:48.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.623+0000 7fa5367fc700 1 -- 172.21.15.6:0/3609095183 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa5400c32c0 con 0x7fa54015cd40 2023-07-06T19:58:48.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.825+0000 7fa547f43700 1 -- 172.21.15.6:0/3609095183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa5400c32c0 con 0x7fa54015cd40 2023-07-06T19:58:48.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.825+0000 7fa5367fc700 1 -- 172.21.15.6:0/3609095183 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa5400c32c0 con 0x7fa54015cd40 2023-07-06T19:58:48.827 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-06T19:58:48.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.827+0000 7fa547f43700 1 -- 172.21.15.6:0/3609095183 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa52406ace0 msgr2=0x7fa52406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:48.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.827+0000 7fa547f43700 1 --2- 172.21.15.6:0/3609095183 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa52406ace0 0x7fa52406d190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa5400b49b0 tx=0x7fa530009040 comp rx=0 tx=0).stop 2023-07-06T19:58:48.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.827+0000 7fa547f43700 1 -- 172.21.15.6:0/3609095183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa54015cd40 msgr2=0x7fa54014f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:48.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.827+0000 7fa547f43700 1 --2- 172.21.15.6:0/3609095183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa54015cd40 0x7fa54014f150 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa54006e990 tx=0x7fa538004ad0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.827+0000 7fa547f43700 1 -- 172.21.15.6:0/3609095183 shutdown_connections 2023-07-06T19:58:48.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.827+0000 7fa547f43700 1 --2- 172.21.15.6:0/3609095183 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa52406ace0 0x7fa52406d190 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.827+0000 7fa547f43700 1 --2- 172.21.15.6:0/3609095183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa54015cd40 0x7fa54014f150 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.827+0000 7fa547f43700 1 --2- 172.21.15.6:0/3609095183 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa540071da0 0x7fa5400c3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.827+0000 7fa547f43700 1 --2- 172.21.15.6:0/3609095183 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5401592b0 0x7fa5400c53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.827+0000 7fa547f43700 1 -- 172.21.15.6:0/3609095183 >> 172.21.15.6:0/3609095183 conn(0x7fa5400cf960 msgr2=0x7fa54006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:48.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.827+0000 7fa547f43700 1 -- 172.21.15.6:0/3609095183 shutdown_connections 2023-07-06T19:58:48.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.827+0000 7fa547f43700 1 -- 172.21.15.6:0/3609095183 wait complete. 2023-07-06T19:58:48.841 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T19:58:48.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.964+0000 7f2a41d41700 1 Processor -- start 2023-07-06T19:58:48.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.964+0000 7f2a41d41700 1 -- start start 2023-07-06T19:58:48.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.965+0000 7f2a41d41700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a3c071dd0 0x7f2a3c0caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:48.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.965+0000 7f2a41d41700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a3c0cee80 0x7f2a3c1602c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:48.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.965+0000 7f2a41d41700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a3c160ff0 con 0x7f2a3c0ceab0 2023-07-06T19:58:48.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.965+0000 7f2a41d41700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a3c0cb400 con 0x7f2a3c0cee80 2023-07-06T19:58:48.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.965+0000 7f2a41d41700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0ca100 con 0x7f2a3c071dd0 2023-07-06T19:58:48.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.965+0000 7f2a3bfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2a3c0cee80 0x7f2a3c1602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:48.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.965+0000 7f2a3affd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a3c071dd0 0x7f2a3c0caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:48.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.965+0000 7f2a3b7fe700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2a3c0ceab0 0x7f2a3c0716c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:49274/0 (socket says 172.21.15.6:49274) 2023-07-06T19:58:48.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.965+0000 7f2a3b7fe700 1 -- 172.21.15.6:0/3458893854 learned_addr learned my addr 172.21.15.6:0/3458893854 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:58:48.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.966+0000 7f2a3affd700 1 -- 172.21.15.6:0/3458893854 >> v2:172.21.15.40:3300/0 conn(0x7f2a3c0cee80 msgr2=0x7f2a3c1602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:48.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.966+0000 7f2a3affd700 1 --2- 172.21.15.6:0/3458893854 >> v2:172.21.15.40:3300/0 conn(0x7f2a3c0cee80 0x7f2a3c1602c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.966+0000 7f2a3affd700 1 -- 172.21.15.6:0/3458893854 >> v1:172.21.15.40:6789/0 conn(0x7f2a3c0ceab0 legacy=0x7f2a3c0716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:48.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.966+0000 7f2a3affd700 1 -- 172.21.15.6:0/3458893854 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c0ca3e0 con 0x7f2a3c071dd0 2023-07-06T19:58:48.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.966+0000 7f2a3bfff700 1 --2- 172.21.15.6:0/3458893854 >> v2:172.21.15.40:3300/0 conn(0x7f2a3c0cee80 0x7f2a3c1602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:58:48.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.966+0000 7f2a3affd700 1 --2- 172.21.15.6:0/3458893854 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a3c071dd0 0x7f2a3c0caec0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009840 tx=0x7f2a30009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ed518f87561c934 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:48.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.966+0000 7f2a3a7fc700 1 -- 172.21.15.6:0/3458893854 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a30011830 con 0x7f2a3c071dd0 2023-07-06T19:58:48.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.966+0000 7f2a3a7fc700 1 -- 172.21.15.6:0/3458893854 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a30011990 con 0x7f2a3c071dd0 2023-07-06T19:58:48.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.966+0000 7f2a3a7fc700 1 -- 172.21.15.6:0/3458893854 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a30011d20 con 0x7f2a3c071dd0 2023-07-06T19:58:48.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.967+0000 7f2a41d41700 1 -- 172.21.15.6:0/3458893854 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a3c071dd0 msgr2=0x7f2a3c0caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:48.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.967+0000 7f2a41d41700 1 --2- 172.21.15.6:0/3458893854 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a3c071dd0 0x7f2a3c0caec0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009840 tx=0x7f2a30009b50 comp rx=0 tx=0).stop 2023-07-06T19:58:48.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.967+0000 7f2a41d41700 1 -- 172.21.15.6:0/3458893854 shutdown_connections 2023-07-06T19:58:48.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.967+0000 7f2a41d41700 1 --2- 172.21.15.6:0/3458893854 >> v2:172.21.15.40:3300/0 conn(0x7f2a3c0cee80 0x7f2a3c1602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.967+0000 7f2a41d41700 1 --2- 172.21.15.6:0/3458893854 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a3c071dd0 0x7f2a3c0caec0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.967+0000 7f2a41d41700 1 -- 172.21.15.6:0/3458893854 >> 172.21.15.6:0/3458893854 conn(0x7f2a3c0cc420 msgr2=0x7f2a3c0cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:48.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.967+0000 7f2a41d41700 1 -- 172.21.15.6:0/3458893854 shutdown_connections 2023-07-06T19:58:48.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.967+0000 7f2a41d41700 1 -- 172.21.15.6:0/3458893854 wait complete. 2023-07-06T19:58:48.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.968+0000 7f2a41d41700 1 Processor -- start 2023-07-06T19:58:48.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.968+0000 7f2a41d41700 1 -- start start 2023-07-06T19:58:48.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.969+0000 7f2a41d41700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a3c071dd0 0x7f2a3c150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:48.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.969+0000 7f2a41d41700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a3c0ceab0 0x7f2a3c15b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:48.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.969+0000 7f2a41d41700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a3c0cee80 0x7f2a3c0c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:48.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.969+0000 7f2a41d41700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0c6e50 con 0x7f2a3c0cee80 2023-07-06T19:58:48.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.969+0000 7f2a41d41700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0c7130 con 0x7f2a3c071dd0 2023-07-06T19:58:48.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.969+0000 7f2a41d41700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3c0c7410 con 0x7f2a3c0ceab0 2023-07-06T19:58:48.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.970+0000 7f2a3bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a3c0cee80 0x7f2a3c0c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:48.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.970+0000 7f2a3bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a3c0cee80 0x7f2a3c0c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58204/0 (socket says 172.21.15.6:58204) 2023-07-06T19:58:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.970+0000 7f2a3bfff700 1 -- 172.21.15.6:0/4081088800 learned_addr learned my addr 172.21.15.6:0/4081088800 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.970+0000 7f2a3b7fe700 1 --2- 172.21.15.6:0/4081088800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a3c071dd0 0x7f2a3c150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.970+0000 7f2a3affd700 1 --2- 172.21.15.6:0/4081088800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a3c0ceab0 0x7f2a3c15b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.970+0000 7f2a3bfff700 1 -- 172.21.15.6:0/4081088800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a3c0ceab0 msgr2=0x7f2a3c15b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.970+0000 7f2a3bfff700 1 --2- 172.21.15.6:0/4081088800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a3c0ceab0 0x7f2a3c15b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.970+0000 7f2a3bfff700 1 -- 172.21.15.6:0/4081088800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a3c071dd0 msgr2=0x7f2a3c150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:48.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.970+0000 7f2a3bfff700 1 --2- 172.21.15.6:0/4081088800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a3c071dd0 0x7f2a3c150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:48.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.970+0000 7f2a3bfff700 1 -- 172.21.15.6:0/4081088800 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a34009a70 con 0x7f2a3c0cee80 2023-07-06T19:58:48.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.970+0000 7f2a3bfff700 1 --2- 172.21.15.6:0/4081088800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a3c0cee80 0x7f2a3c0c8c90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400efc0 tx=0x7f2a3400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:48.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.970+0000 7f2a23fff700 1 -- 172.21.15.6:0/4081088800 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3400ca90 con 0x7f2a3c0cee80 2023-07-06T19:58:48.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.970+0000 7f2a23fff700 1 -- 172.21.15.6:0/4081088800 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3400f040 con 0x7f2a3c0cee80 2023-07-06T19:58:48.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.970+0000 7f2a23fff700 1 -- 172.21.15.6:0/4081088800 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3400ce10 con 0x7f2a3c0cee80 2023-07-06T19:58:48.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.970+0000 7f2a41d41700 1 -- 172.21.15.6:0/4081088800 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a300094a0 con 0x7f2a3c0cee80 2023-07-06T19:58:48.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.970+0000 7f2a41d41700 1 -- 172.21.15.6:0/4081088800 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a3c0c76f0 con 0x7f2a3c0cee80 2023-07-06T19:58:48.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.971+0000 7f2a41d41700 1 -- 172.21.15.6:0/4081088800 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a3c0c7880 con 0x7f2a3c0cee80 2023-07-06T19:58:48.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.972+0000 7f2a23fff700 1 -- 172.21.15.6:0/4081088800 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2a34014480 con 0x7f2a3c0cee80 2023-07-06T19:58:48.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.972+0000 7f2a23fff700 1 --2- 172.21.15.6:0/4081088800 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2a2806ace0 0x7f2a2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:48.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.973+0000 7f2a3b7fe700 1 --2- 172.21.15.6:0/4081088800 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2a2806ace0 0x7f2a2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:48.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.973+0000 7f2a23fff700 1 -- 172.21.15.6:0/4081088800 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2a340896e0 con 0x7f2a3c0cee80 2023-07-06T19:58:48.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.973+0000 7f2a3b7fe700 1 --2- 172.21.15.6:0/4081088800 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2a2806ace0 0x7f2a2806d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c005910 tx=0x7f2a2c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:48.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:48.977+0000 7f2a23fff700 1 -- 172.21.15.6:0/4081088800 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2a34058600 con 0x7f2a3c0cee80 2023-07-06T19:58:49.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.215+0000 7f2a41d41700 1 -- 172.21.15.6:0/4081088800 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a3c1607d0 con 0x7f2a3c0cee80 2023-07-06T19:58:49.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.215+0000 7f2a23fff700 1 -- 172.21.15.6:0/4081088800 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3509 (secure 0 0 0) 0x7f2a34018dd0 con 0x7f2a3c0cee80 2023-07-06T19:58:49.218 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:58:49.218 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3695014381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3695014381},{"type":"v1","addr":"172.21.15.6:6835","nonce":3695014381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/849399781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":849399781},{"type":"v1","addr":"172.21.15.40:6833","nonce":849399781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/512806705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":512806705},{"type":"v1","addr":"172.21.15.40:6835","nonce":512806705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/368324315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":368324315},{"type":"v1","addr":"172.21.15.6:6837","nonce":368324315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-06T19:58:49.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.217+0000 7f2a41d41700 1 -- 172.21.15.6:0/4081088800 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2a2806ace0 msgr2=0x7f2a2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.217+0000 7f2a41d41700 1 --2- 172.21.15.6:0/4081088800 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2a2806ace0 0x7f2a2806d190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c005910 tx=0x7f2a2c009040 comp rx=0 tx=0).stop 2023-07-06T19:58:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.217+0000 7f2a41d41700 1 -- 172.21.15.6:0/4081088800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a3c0cee80 msgr2=0x7f2a3c0c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.217+0000 7f2a41d41700 1 --2- 172.21.15.6:0/4081088800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a3c0cee80 0x7f2a3c0c8c90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400efc0 tx=0x7f2a3400c3a0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.217+0000 7f2a41d41700 1 -- 172.21.15.6:0/4081088800 shutdown_connections 2023-07-06T19:58:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.217+0000 7f2a41d41700 1 --2- 172.21.15.6:0/4081088800 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2a2806ace0 0x7f2a2806d190 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.217+0000 7f2a41d41700 1 --2- 172.21.15.6:0/4081088800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a3c0cee80 0x7f2a3c0c8c90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.217+0000 7f2a41d41700 1 --2- 172.21.15.6:0/4081088800 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a3c071dd0 0x7f2a3c150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.217+0000 7f2a41d41700 1 --2- 172.21.15.6:0/4081088800 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2a3c0ceab0 0x7f2a3c15b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.217+0000 7f2a41d41700 1 -- 172.21.15.6:0/4081088800 >> 172.21.15.6:0/4081088800 conn(0x7f2a3c0cc420 msgr2=0x7f2a3c15e270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:49.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.218+0000 7f2a41d41700 1 -- 172.21.15.6:0/4081088800 shutdown_connections 2023-07-06T19:58:49.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.218+0000 7f2a41d41700 1 -- 172.21.15.6:0/4081088800 wait complete. 2023-07-06T19:58:49.222 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 3 2023-07-06T19:58:49.232 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T19:58:49.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.355+0000 7f43c622d700 1 Processor -- start 2023-07-06T19:58:49.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.355+0000 7f43c622d700 1 -- start start 2023-07-06T19:58:49.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.356+0000 7f43c622d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f43c0159410 0x7f43c00716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:49.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.356+0000 7f43c622d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43c0071c00 0x7f43c006c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:49.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.356+0000 7f43c622d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c0072060 con 0x7f43c0159040 2023-07-06T19:58:49.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.356+0000 7f43c622d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c006d490 con 0x7f43c0071c00 2023-07-06T19:58:49.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.356+0000 7f43c622d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c00cac20 con 0x7f43c0159410 2023-07-06T19:58:49.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.356+0000 7f43bffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43c0071c00 0x7f43c006c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:49.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.356+0000 7f43bffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f43c0071c00 0x7f43c006c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58212/0 (socket says 172.21.15.6:58212) 2023-07-06T19:58:49.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.356+0000 7f43bffff700 1 -- 172.21.15.6:0/2115559851 learned_addr learned my addr 172.21.15.6:0/2115559851 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:49.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.356+0000 7f43beffd700 1 --2- 172.21.15.6:0/2115559851 >> v2:172.21.15.40:3300/0 conn(0x7f43c0159410 0x7f43c00716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:49.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.356+0000 7f43bffff700 1 -- 172.21.15.6:0/2115559851 >> v2:172.21.15.40:3300/0 conn(0x7f43c0159410 msgr2=0x7f43c00716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:49.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.356+0000 7f43bffff700 1 --2- 172.21.15.6:0/2115559851 >> v2:172.21.15.40:3300/0 conn(0x7f43c0159410 0x7f43c00716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.356+0000 7f43bffff700 1 -- 172.21.15.6:0/2115559851 >> v1:172.21.15.40:6789/0 conn(0x7f43c0159040 legacy=0x7f43c00cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:49.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.356+0000 7f43bffff700 1 -- 172.21.15.6:0/2115559851 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c006ced0 con 0x7f43c0071c00 2023-07-06T19:58:49.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.356+0000 7f43bffff700 1 --2- 172.21.15.6:0/2115559851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c0071c00 0x7f43c006c160 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f43c00c3470 tx=0x7f43b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dfbf7559a67e7dd server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:49.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.357+0000 7f43be7fc700 1 -- 172.21.15.6:0/2115559851 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b800e070 con 0x7f43c0071c00 2023-07-06T19:58:49.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.357+0000 7f43be7fc700 1 -- 172.21.15.6:0/2115559851 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b800b9c0 con 0x7f43c0071c00 2023-07-06T19:58:49.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.357+0000 7f43be7fc700 1 -- 172.21.15.6:0/2115559851 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b800bd70 con 0x7f43c0071c00 2023-07-06T19:58:49.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.357+0000 7f43c622d700 1 -- 172.21.15.6:0/2115559851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c0071c00 msgr2=0x7f43c006c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:49.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.357+0000 7f43c622d700 1 --2- 172.21.15.6:0/2115559851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c0071c00 0x7f43c006c160 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f43c00c3470 tx=0x7f43b800b330 comp rx=0 tx=0).stop 2023-07-06T19:58:49.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.357+0000 7f43c622d700 1 -- 172.21.15.6:0/2115559851 shutdown_connections 2023-07-06T19:58:49.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.357+0000 7f43c622d700 1 --2- 172.21.15.6:0/2115559851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c0071c00 0x7f43c006c160 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.357+0000 7f43c622d700 1 --2- 172.21.15.6:0/2115559851 >> v2:172.21.15.40:3300/0 conn(0x7f43c0159410 0x7f43c00716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.357+0000 7f43c622d700 1 -- 172.21.15.6:0/2115559851 >> 172.21.15.6:0/2115559851 conn(0x7f43c00cc420 msgr2=0x7f43c00cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:49.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.357+0000 7f43c622d700 1 -- 172.21.15.6:0/2115559851 shutdown_connections 2023-07-06T19:58:49.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.357+0000 7f43c622d700 1 -- 172.21.15.6:0/2115559851 wait complete. 2023-07-06T19:58:49.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.359+0000 7f43c622d700 1 Processor -- start 2023-07-06T19:58:49.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.359+0000 7f43c622d700 1 -- start start 2023-07-06T19:58:49.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.360+0000 7f43c622d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c0071c00 0x7f43c014d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:49.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.360+0000 7f43c622d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43c0159040 0x7f43c006b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:49.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.360+0000 7f43c622d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43c0159410 0x7f43c01f3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:49.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.360+0000 7f43c622d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c0157ee0 con 0x7f43c0071c00 2023-07-06T19:58:49.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.360+0000 7f43c622d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c01f38b0 con 0x7f43c0159410 2023-07-06T19:58:49.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.360+0000 7f43c622d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c014e930 con 0x7f43c0159040 2023-07-06T19:58:49.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.360+0000 7f43bf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c0071c00 0x7f43c014d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:49.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.360+0000 7f43bf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c0071c00 0x7f43c014d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58214/0 (socket says 172.21.15.6:58214) 2023-07-06T19:58:49.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.360+0000 7f43bf7fe700 1 -- 172.21.15.6:0/3277216697 learned_addr learned my addr 172.21.15.6:0/3277216697 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:49.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.360+0000 7f43bffff700 1 --2- 172.21.15.6:0/3277216697 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43c0159410 0x7f43c01f3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:49.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.360+0000 7f43beffd700 1 --2- 172.21.15.6:0/3277216697 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43c0159040 0x7f43c006b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:49.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.360+0000 7f43bf7fe700 1 -- 172.21.15.6:0/3277216697 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43c0159040 msgr2=0x7f43c006b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:49.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.360+0000 7f43bf7fe700 1 --2- 172.21.15.6:0/3277216697 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43c0159040 0x7f43c006b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.360+0000 7f43bf7fe700 1 -- 172.21.15.6:0/3277216697 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43c0159410 msgr2=0x7f43c01f3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:49.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.360+0000 7f43bf7fe700 1 --2- 172.21.15.6:0/3277216697 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43c0159410 0x7f43c01f3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.360+0000 7f43bf7fe700 1 -- 172.21.15.6:0/3277216697 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b8009b30 con 0x7f43c0071c00 2023-07-06T19:58:49.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.360+0000 7f43beffd700 1 --2- 172.21.15.6:0/3277216697 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43c0159040 0x7f43c006b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:58:49.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.361+0000 7f43bf7fe700 1 --2- 172.21.15.6:0/3277216697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c0071c00 0x7f43c014d7d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f43a800c4e0 tx=0x7f43a800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:49.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.361+0000 7f43b7fff700 1 -- 172.21.15.6:0/3277216697 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a80052d0 con 0x7f43c0071c00 2023-07-06T19:58:49.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.361+0000 7f43b7fff700 1 -- 172.21.15.6:0/3277216697 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a8005430 con 0x7f43c0071c00 2023-07-06T19:58:49.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.361+0000 7f43c622d700 1 -- 172.21.15.6:0/3277216697 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c014ddb0 con 0x7f43c0071c00 2023-07-06T19:58:49.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.361+0000 7f43b7fff700 1 -- 172.21.15.6:0/3277216697 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a80038c0 con 0x7f43c0071c00 2023-07-06T19:58:49.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.361+0000 7f43c622d700 1 -- 172.21.15.6:0/3277216697 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c014e370 con 0x7f43c0071c00 2023-07-06T19:58:49.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.362+0000 7f43c622d700 1 -- 172.21.15.6:0/3277216697 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c006bd80 con 0x7f43c0071c00 2023-07-06T19:58:49.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.362+0000 7f43b7fff700 1 -- 172.21.15.6:0/3277216697 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f43a8003a20 con 0x7f43c0071c00 2023-07-06T19:58:49.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.363+0000 7f43b7fff700 1 --2- 172.21.15.6:0/3277216697 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f43a006ace0 0x7f43a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:49.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.363+0000 7f43b7fff700 1 -- 172.21.15.6:0/3277216697 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f43a8088610 con 0x7f43c0071c00 2023-07-06T19:58:49.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.363+0000 7f43beffd700 1 --2- 172.21.15.6:0/3277216697 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f43a006ace0 0x7f43a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:49.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.363+0000 7f43beffd700 1 --2- 172.21.15.6:0/3277216697 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f43a006ace0 0x7f43a006d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f43c00b58f0 tx=0x7f43b0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:49.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.367+0000 7f43b7fff700 1 -- 172.21.15.6:0/3277216697 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f43a8053a10 con 0x7f43c0071c00 2023-07-06T19:58:49.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.567+0000 7f43c622d700 1 -- 172.21.15.6:0/3277216697 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43c00cff90 con 0x7f43c0071c00 2023-07-06T19:58:49.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.568+0000 7f43b7fff700 1 -- 172.21.15.6:0/3277216697 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14480 (secure 0 0 0) 0x7f43a8057030 con 0x7f43c0071c00 2023-07-06T19:58:49.570 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:58:49.570 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":19,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:58:48.698673+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:58:49.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.570+0000 7f43c622d700 1 -- 172.21.15.6:0/3277216697 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f43a006ace0 msgr2=0x7f43a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:49.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.570+0000 7f43c622d700 1 --2- 172.21.15.6:0/3277216697 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f43a006ace0 0x7f43a006d190 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f43c00b58f0 tx=0x7f43b0008040 comp rx=0 tx=0).stop 2023-07-06T19:58:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.570+0000 7f43c622d700 1 -- 172.21.15.6:0/3277216697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c0071c00 msgr2=0x7f43c014d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.570+0000 7f43c622d700 1 --2- 172.21.15.6:0/3277216697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c0071c00 0x7f43c014d7d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f43a800c4e0 tx=0x7f43a800c8a0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.570+0000 7f43c622d700 1 -- 172.21.15.6:0/3277216697 shutdown_connections 2023-07-06T19:58:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.570+0000 7f43c622d700 1 --2- 172.21.15.6:0/3277216697 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f43a006ace0 0x7f43a006d190 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.570+0000 7f43c622d700 1 --2- 172.21.15.6:0/3277216697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c0071c00 0x7f43c014d7d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.570+0000 7f43c622d700 1 --2- 172.21.15.6:0/3277216697 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43c0159410 0x7f43c01f3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.570+0000 7f43c622d700 1 --2- 172.21.15.6:0/3277216697 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43c0159040 0x7f43c006b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.570+0000 7f43c622d700 1 -- 172.21.15.6:0/3277216697 >> 172.21.15.6:0/3277216697 conn(0x7f43c00cc420 msgr2=0x7f43c014bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:49.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.570+0000 7f43c622d700 1 -- 172.21.15.6:0/3277216697 shutdown_connections 2023-07-06T19:58:49.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.570+0000 7f43c622d700 1 -- 172.21.15.6:0/3277216697 wait complete. 2023-07-06T19:58:49.584 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T19:58:38.767727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T19:58:45.759808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T19:58:49.585 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T19:58:49.629 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T19:58:49.634 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T19:58:49.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.712+0000 7f106e2a0700 1 Processor -- start 2023-07-06T19:58:49.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.712+0000 7f106e2a0700 1 -- start start 2023-07-06T19:58:49.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.713+0000 7f106e2a0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f10680ca850 0x7f106815bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:49.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.713+0000 7f106e2a0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1068071cd0 0x7f106815c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:49.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.713+0000 7f106e2a0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10680cb310 con 0x7f1068071900 2023-07-06T19:58:49.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.713+0000 7f106e2a0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10680cdbf0 con 0x7f1068071cd0 2023-07-06T19:58:49.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.713+0000 7f106e2a0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106815c9d0 con 0x7f10680ca850 2023-07-06T19:58:49.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.713+0000 7f106c83d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1068071cd0 0x7f106815c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:49.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.713+0000 7f1067fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1068071900 0x7f10680ca140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59430/0 (socket says 172.21.15.6:59430) 2023-07-06T19:58:49.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.713+0000 7f1067fff700 1 -- 172.21.15.6:0/3860161590 learned_addr learned my addr 172.21.15.6:0/3860161590 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:58:49.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.714+0000 7f106c83d700 1 -- 172.21.15.6:0/3860161590 >> v2:172.21.15.40:3300/0 conn(0x7f10680ca850 msgr2=0x7f106815bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:49.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.714+0000 7f10677fe700 1 --2- 172.21.15.6:0/3860161590 >> v2:172.21.15.40:3300/0 conn(0x7f10680ca850 0x7f106815bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:49.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.714+0000 7f106c83d700 1 --2- 172.21.15.6:0/3860161590 >> v2:172.21.15.40:3300/0 conn(0x7f10680ca850 0x7f106815bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.714+0000 7f106c83d700 1 -- 172.21.15.6:0/3860161590 >> v1:172.21.15.6:6789/0 conn(0x7f1068071900 legacy=0x7f10680ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:49.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.714+0000 7f1066ffd700 1 -- 172.21.15.6:0/3860161590 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994175510 0 0) 0x7f10680cb310 con 0x7f1068071900 2023-07-06T19:58:49.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.714+0000 7f106c83d700 1 -- 172.21.15.6:0/3860161590 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10680af070 con 0x7f1068071cd0 2023-07-06T19:58:49.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.714+0000 7f10677fe700 1 --2- 172.21.15.6:0/3860161590 >> v2:172.21.15.40:3300/0 conn(0x7f10680ca850 0x7f106815bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:58:49.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.714+0000 7f106c83d700 1 --2- 172.21.15.6:0/3860161590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1068071cd0 0x7f106815c490 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f106806e9b0 tx=0x7f106000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825ef7e2484e9e99 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:49.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.714+0000 7f1066ffd700 1 -- 172.21.15.6:0/3860161590 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106000e070 con 0x7f1068071cd0 2023-07-06T19:58:49.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.714+0000 7f1066ffd700 1 -- 172.21.15.6:0/3860161590 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106000bbd0 con 0x7f1068071cd0 2023-07-06T19:58:49.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.714+0000 7f1066ffd700 1 -- 172.21.15.6:0/3860161590 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1060012430 con 0x7f1068071cd0 2023-07-06T19:58:49.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.715+0000 7f106e2a0700 1 -- 172.21.15.6:0/3860161590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1068071cd0 msgr2=0x7f106815c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:49.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.715+0000 7f106e2a0700 1 --2- 172.21.15.6:0/3860161590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1068071cd0 0x7f106815c490 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f106806e9b0 tx=0x7f106000b330 comp rx=0 tx=0).stop 2023-07-06T19:58:49.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.715+0000 7f106e2a0700 1 -- 172.21.15.6:0/3860161590 shutdown_connections 2023-07-06T19:58:49.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.715+0000 7f106e2a0700 1 --2- 172.21.15.6:0/3860161590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1068071cd0 0x7f106815c490 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.715+0000 7f106e2a0700 1 --2- 172.21.15.6:0/3860161590 >> v2:172.21.15.40:3300/0 conn(0x7f10680ca850 0x7f106815bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.715+0000 7f106e2a0700 1 -- 172.21.15.6:0/3860161590 >> 172.21.15.6:0/3860161590 conn(0x7f10680cf960 msgr2=0x7f10680cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:49.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.715+0000 7f106e2a0700 1 -- 172.21.15.6:0/3860161590 shutdown_connections 2023-07-06T19:58:49.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.715+0000 7f106e2a0700 1 -- 172.21.15.6:0/3860161590 wait complete. 2023-07-06T19:58:49.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.716+0000 7f106e2a0700 1 Processor -- start 2023-07-06T19:58:49.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.717+0000 7f106e2a0700 1 -- start start 2023-07-06T19:58:49.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.717+0000 7f106e2a0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1068071900 0x7f10681f4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:49.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.717+0000 7f106e2a0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1068071cd0 0x7f106815ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:49.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.717+0000 7f106e2a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10680ca850 0x7f106815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:49.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.717+0000 7f106e2a0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10681f5310 con 0x7f10680ca850 2023-07-06T19:58:49.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.717+0000 7f106e2a0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106815db60 con 0x7f1068071cd0 2023-07-06T19:58:49.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.717+0000 7f106e2a0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106815e400 con 0x7f1068071900 2023-07-06T19:58:49.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.717+0000 7f106c83d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10680ca850 0x7f106815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:49.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.717+0000 7f106c83d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10680ca850 0x7f106815f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58230/0 (socket says 172.21.15.6:58230) 2023-07-06T19:58:49.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.717+0000 7f106c83d700 1 -- 172.21.15.6:0/3490054370 learned_addr learned my addr 172.21.15.6:0/3490054370 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:49.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.718+0000 7f10677fe700 1 --2- 172.21.15.6:0/3490054370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1068071cd0 0x7f106815ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:49.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.718+0000 7f1067fff700 1 --2- 172.21.15.6:0/3490054370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1068071900 0x7f10681f4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:49.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.718+0000 7f106c83d700 1 -- 172.21.15.6:0/3490054370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1068071900 msgr2=0x7f10681f4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:49.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.718+0000 7f106c83d700 1 --2- 172.21.15.6:0/3490054370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1068071900 0x7f10681f4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.718+0000 7f106c83d700 1 -- 172.21.15.6:0/3490054370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1068071cd0 msgr2=0x7f106815ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:49.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.718+0000 7f106c83d700 1 --2- 172.21.15.6:0/3490054370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1068071cd0 0x7f106815ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.718+0000 7f106c83d700 1 -- 172.21.15.6:0/3490054370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1060009a70 con 0x7f10680ca850 2023-07-06T19:58:49.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.718+0000 7f10677fe700 1 --2- 172.21.15.6:0/3490054370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1068071cd0 0x7f106815ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:58:49.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.718+0000 7f106c83d700 1 --2- 172.21.15.6:0/3490054370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10680ca850 0x7f106815f1a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f106000b730 tx=0x7f1060004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:49.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.718+0000 7f1064ff9700 1 -- 172.21.15.6:0/3490054370 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1060012430 con 0x7f10680ca850 2023-07-06T19:58:49.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.718+0000 7f1064ff9700 1 -- 172.21.15.6:0/3490054370 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1060020070 con 0x7f10680ca850 2023-07-06T19:58:49.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.718+0000 7f106e2a0700 1 -- 172.21.15.6:0/3490054370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106815f7d0 con 0x7f10680ca850 2023-07-06T19:58:49.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.718+0000 7f1064ff9700 1 -- 172.21.15.6:0/3490054370 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1060004260 con 0x7f10680ca850 2023-07-06T19:58:49.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.718+0000 7f106e2a0700 1 -- 172.21.15.6:0/3490054370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106815e090 con 0x7f10680ca850 2023-07-06T19:58:49.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.719+0000 7f106e2a0700 1 -- 172.21.15.6:0/3490054370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f106815e250 con 0x7f10680ca850 2023-07-06T19:58:49.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.719+0000 7f1064ff9700 1 -- 172.21.15.6:0/3490054370 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f10600043c0 con 0x7f10680ca850 2023-07-06T19:58:49.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.720+0000 7f1064ff9700 1 --2- 172.21.15.6:0/3490054370 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f105406ace0 0x7f105406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:49.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.720+0000 7f1067fff700 1 --2- 172.21.15.6:0/3490054370 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f105406ace0 0x7f105406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:49.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.720+0000 7f1064ff9700 1 -- 172.21.15.6:0/3490054370 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1060022070 con 0x7f10680ca850 2023-07-06T19:58:49.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.720+0000 7f1067fff700 1 --2- 172.21.15.6:0/3490054370 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f105406ace0 0x7f105406d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1058000f60 tx=0x7f1058009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:49.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.725+0000 7f1064ff9700 1 -- 172.21.15.6:0/3490054370 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1060056810 con 0x7f10680ca850 2023-07-06T19:58:49.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.918+0000 7f106e2a0700 1 -- 172.21.15.6:0/3490054370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f106804eb90 con 0x7f10680ca850 2023-07-06T19:58:49.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.919+0000 7f1064ff9700 1 -- 172.21.15.6:0/3490054370 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1060059e30 con 0x7f10680ca850 2023-07-06T19:58:49.923 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-06T19:58:49.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.921+0000 7f106e2a0700 1 -- 172.21.15.6:0/3490054370 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f105406ace0 msgr2=0x7f105406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:49.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.921+0000 7f106e2a0700 1 --2- 172.21.15.6:0/3490054370 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f105406ace0 0x7f105406d190 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1058000f60 tx=0x7f1058009040 comp rx=0 tx=0).stop 2023-07-06T19:58:49.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.921+0000 7f106e2a0700 1 -- 172.21.15.6:0/3490054370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10680ca850 msgr2=0x7f106815f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:49.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.921+0000 7f106e2a0700 1 --2- 172.21.15.6:0/3490054370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10680ca850 0x7f106815f1a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f106000b730 tx=0x7f1060004ad0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.921+0000 7f106e2a0700 1 -- 172.21.15.6:0/3490054370 shutdown_connections 2023-07-06T19:58:49.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.921+0000 7f106e2a0700 1 --2- 172.21.15.6:0/3490054370 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f105406ace0 0x7f105406d190 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.921+0000 7f106e2a0700 1 --2- 172.21.15.6:0/3490054370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10680ca850 0x7f106815f1a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.921+0000 7f106e2a0700 1 --2- 172.21.15.6:0/3490054370 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1068071900 0x7f10681f4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.921+0000 7f106e2a0700 1 --2- 172.21.15.6:0/3490054370 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1068071cd0 0x7f106815ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:49.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.921+0000 7f106e2a0700 1 -- 172.21.15.6:0/3490054370 >> 172.21.15.6:0/3490054370 conn(0x7f10680cf960 msgr2=0x7f10680ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:49.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.921+0000 7f106e2a0700 1 -- 172.21.15.6:0/3490054370 shutdown_connections 2023-07-06T19:58:49.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:49.921+0000 7f106e2a0700 1 -- 172.21.15.6:0/3490054370 wait complete. 2023-07-06T19:58:49.937 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T19:58:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.106+0000 7fe3ae01a700 1 Processor -- start 2023-07-06T19:58:50.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.106+0000 7fe3ae01a700 1 -- start start 2023-07-06T19:58:50.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.107+0000 7fe3ae01a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe3a81592b0 0x7fe3a8071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:50.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.107+0000 7fe3ae01a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a806e700 con 0x7fe3a80cd950 2023-07-06T19:58:50.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.107+0000 7fe3ae01a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a80cc160 con 0x7fe3a815cd40 2023-07-06T19:58:50.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.107+0000 7fe3ae01a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a8159680 con 0x7fe3a81592b0 2023-07-06T19:58:50.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.107+0000 7fe3a77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe3a81592b0 0x7fe3a8071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:50.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.107+0000 7fe3a7fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe3a80cd950 0x7fe3a806dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59446/0 (socket says 172.21.15.6:59446) 2023-07-06T19:58:50.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.107+0000 7fe3a7fff700 1 -- 172.21.15.6:0/2946761555 learned_addr learned my addr 172.21.15.6:0/2946761555 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:58:50.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.107+0000 7fe3a67fc700 1 -- 172.21.15.6:0/2946761555 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538633879 0 0) 0x7fe3a806e700 con 0x7fe3a80cd950 2023-07-06T19:58:50.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.107+0000 7fe3a67fc700 1 -- 172.21.15.6:0/2946761555 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3900035b0 con 0x7fe3a80cd950 2023-07-06T19:58:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.107+0000 7fe3a77fe700 1 -- 172.21.15.6:0/2946761555 >> v1:172.21.15.40:6789/0 conn(0x7fe3a815cd40 legacy=0x7fe3a806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.107+0000 7fe3a77fe700 1 -- 172.21.15.6:0/2946761555 >> v1:172.21.15.6:6789/0 conn(0x7fe3a80cd950 legacy=0x7fe3a806dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.107+0000 7fe3a77fe700 1 -- 172.21.15.6:0/2946761555 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a815d2b0 con 0x7fe3a81592b0 2023-07-06T19:58:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.108+0000 7fe3a77fe700 1 --2- 172.21.15.6:0/2946761555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3a81592b0 0x7fe3a8071690 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe398009840 tx=0x7fe398009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e24c6c208575c4c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.108+0000 7fe3a67fc700 1 -- 172.21.15.6:0/2946761555 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe398004230 con 0x7fe3a81592b0 2023-07-06T19:58:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.108+0000 7fe3a67fc700 1 -- 172.21.15.6:0/2946761555 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe398004390 con 0x7fe3a81592b0 2023-07-06T19:58:50.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.108+0000 7fe3a67fc700 1 -- 172.21.15.6:0/2946761555 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3980036c0 con 0x7fe3a81592b0 2023-07-06T19:58:50.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.108+0000 7fe3ae01a700 1 -- 172.21.15.6:0/2946761555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3a81592b0 msgr2=0x7fe3a8071690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:50.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.108+0000 7fe3ae01a700 1 --2- 172.21.15.6:0/2946761555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3a81592b0 0x7fe3a8071690 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe398009840 tx=0x7fe398009b50 comp rx=0 tx=0).stop 2023-07-06T19:58:50.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.108+0000 7fe3ae01a700 1 -- 172.21.15.6:0/2946761555 shutdown_connections 2023-07-06T19:58:50.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.108+0000 7fe3ae01a700 1 --2- 172.21.15.6:0/2946761555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3a81592b0 0x7fe3a8071690 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:50.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.108+0000 7fe3ae01a700 1 -- 172.21.15.6:0/2946761555 >> 172.21.15.6:0/2946761555 conn(0x7fe3a80cf960 msgr2=0x7fe3a80cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:50.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.108+0000 7fe3ae01a700 1 -- 172.21.15.6:0/2946761555 shutdown_connections 2023-07-06T19:58:50.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.108+0000 7fe3ae01a700 1 -- 172.21.15.6:0/2946761555 wait complete. 2023-07-06T19:58:50.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.109+0000 7fe3ae01a700 1 Processor -- start 2023-07-06T19:58:50.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.110+0000 7fe3ae01a700 1 -- start start 2023-07-06T19:58:50.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.110+0000 7fe3ae01a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3a80cd950 0x7fe3a8155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:50.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.110+0000 7fe3ae01a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3a81592b0 0x7fe3a814ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:50.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.110+0000 7fe3ae01a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3a815cd40 0x7fe3a815b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:50.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.110+0000 7fe3ae01a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a8156920 con 0x7fe3a81592b0 2023-07-06T19:58:50.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.110+0000 7fe3ae01a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a80c7f60 con 0x7fe3a815cd40 2023-07-06T19:58:50.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.110+0000 7fe3ae01a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a81f0000 con 0x7fe3a80cd950 2023-07-06T19:58:50.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.110+0000 7fe3a6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3a81592b0 0x7fe3a814ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:50.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.110+0000 7fe3a6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3a81592b0 0x7fe3a814ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58242/0 (socket says 172.21.15.6:58242) 2023-07-06T19:58:50.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.110+0000 7fe3a6ffd700 1 -- 172.21.15.6:0/4098418583 learned_addr learned my addr 172.21.15.6:0/4098418583 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:50.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.111+0000 7fe3a7fff700 1 --2- 172.21.15.6:0/4098418583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3a815cd40 0x7fe3a815b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:50.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.111+0000 7fe3a6ffd700 1 -- 172.21.15.6:0/4098418583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3a80cd950 msgr2=0x7fe3a8155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:50.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.111+0000 7fe3a77fe700 1 --2- 172.21.15.6:0/4098418583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3a80cd950 0x7fe3a8155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:50.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.111+0000 7fe3a6ffd700 1 --2- 172.21.15.6:0/4098418583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3a80cd950 0x7fe3a8155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:50.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.111+0000 7fe3a6ffd700 1 -- 172.21.15.6:0/4098418583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3a815cd40 msgr2=0x7fe3a815b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:50.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.111+0000 7fe3a6ffd700 1 --2- 172.21.15.6:0/4098418583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3a815cd40 0x7fe3a815b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:50.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.111+0000 7fe3a6ffd700 1 -- 172.21.15.6:0/4098418583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3980094a0 con 0x7fe3a81592b0 2023-07-06T19:58:50.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.111+0000 7fe3a6ffd700 1 --2- 172.21.15.6:0/4098418583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3a81592b0 0x7fe3a814ab40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00b480 tx=0x7fe39c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:50.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.111+0000 7fe38ffff700 1 -- 172.21.15.6:0/4098418583 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c011830 con 0x7fe3a81592b0 2023-07-06T19:58:50.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.111+0000 7fe38ffff700 1 -- 172.21.15.6:0/4098418583 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39c011990 con 0x7fe3a81592b0 2023-07-06T19:58:50.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.111+0000 7fe3ae01a700 1 -- 172.21.15.6:0/4098418583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a8156080 con 0x7fe3a81592b0 2023-07-06T19:58:50.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.111+0000 7fe38ffff700 1 -- 172.21.15.6:0/4098418583 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39c011d40 con 0x7fe3a81592b0 2023-07-06T19:58:50.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.111+0000 7fe3ae01a700 1 -- 172.21.15.6:0/4098418583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a8156640 con 0x7fe3a81592b0 2023-07-06T19:58:50.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.112+0000 7fe3ae01a700 1 -- 172.21.15.6:0/4098418583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a80d0830 con 0x7fe3a81592b0 2023-07-06T19:58:50.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.112+0000 7fe38ffff700 1 -- 172.21.15.6:0/4098418583 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe39c01a400 con 0x7fe3a81592b0 2023-07-06T19:58:50.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.113+0000 7fe38ffff700 1 --2- 172.21.15.6:0/4098418583 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe39406ace0 0x7fe39406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:50.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.113+0000 7fe38ffff700 1 -- 172.21.15.6:0/4098418583 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe39c088cd0 con 0x7fe3a81592b0 2023-07-06T19:58:50.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.113+0000 7fe3a77fe700 1 --2- 172.21.15.6:0/4098418583 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe39406ace0 0x7fe39406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:50.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.113+0000 7fe3a77fe700 1 --2- 172.21.15.6:0/4098418583 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe39406ace0 0x7fe39406d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe398000c00 tx=0x7fe398010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:50.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.117+0000 7fe38ffff700 1 -- 172.21.15.6:0/4098418583 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe39c054210 con 0x7fe3a81592b0 2023-07-06T19:58:50.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.313+0000 7fe3ae01a700 1 -- 172.21.15.6:0/4098418583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe3a804eb90 con 0x7fe3a81592b0 2023-07-06T19:58:50.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.314+0000 7fe38ffff700 1 -- 172.21.15.6:0/4098418583 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe39c0150a0 con 0x7fe3a81592b0 2023-07-06T19:58:50.316 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-06T19:58:50.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.316+0000 7fe3ae01a700 1 -- 172.21.15.6:0/4098418583 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe39406ace0 msgr2=0x7fe39406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:50.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.316+0000 7fe3ae01a700 1 --2- 172.21.15.6:0/4098418583 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe39406ace0 0x7fe39406d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe398000c00 tx=0x7fe398010000 comp rx=0 tx=0).stop 2023-07-06T19:58:50.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.316+0000 7fe3ae01a700 1 -- 172.21.15.6:0/4098418583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3a81592b0 msgr2=0x7fe3a814ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:50.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.316+0000 7fe3ae01a700 1 --2- 172.21.15.6:0/4098418583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3a81592b0 0x7fe3a814ab40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00b480 tx=0x7fe39c00b840 comp rx=0 tx=0).stop 2023-07-06T19:58:50.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.316+0000 7fe3ae01a700 1 -- 172.21.15.6:0/4098418583 shutdown_connections 2023-07-06T19:58:50.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.316+0000 7fe3ae01a700 1 --2- 172.21.15.6:0/4098418583 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe39406ace0 0x7fe39406d190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:50.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.316+0000 7fe3ae01a700 1 --2- 172.21.15.6:0/4098418583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3a815cd40 0x7fe3a815b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:50.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.316+0000 7fe3ae01a700 1 --2- 172.21.15.6:0/4098418583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3a80cd950 0x7fe3a8155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:50.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.316+0000 7fe3ae01a700 1 --2- 172.21.15.6:0/4098418583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3a81592b0 0x7fe3a814ab40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:50.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.316+0000 7fe3ae01a700 1 -- 172.21.15.6:0/4098418583 >> 172.21.15.6:0/4098418583 conn(0x7fe3a80cf960 msgr2=0x7fe3a806abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:50.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.316+0000 7fe3ae01a700 1 -- 172.21.15.6:0/4098418583 shutdown_connections 2023-07-06T19:58:50.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.316+0000 7fe3ae01a700 1 -- 172.21.15.6:0/4098418583 wait complete. 2023-07-06T19:58:50.333 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-06T19:58:50.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.456+0000 7f07e79d0700 1 Processor -- start 2023-07-06T19:58:50.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.456+0000 7f07e79d0700 1 -- start start 2023-07-06T19:58:50.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.457+0000 7f07e79d0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e0157ed0 0x7f07e006f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:50.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.457+0000 7f07e79d0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f07e015e4c0 0x7f07e00ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:50.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.457+0000 7f07e79d0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e006e6c0 con 0x7f07e00ccbe0 2023-07-06T19:58:50.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.457+0000 7f07e79d0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e006f6a0 con 0x7f07e015e4c0 2023-07-06T19:58:50.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.457+0000 7f07e79d0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e00cb080 con 0x7f07e0157ed0 2023-07-06T19:58:50.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.457+0000 7f07e4f6b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f07e00ccbe0 0x7f07e015ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59456/0 (socket says 172.21.15.6:59456) 2023-07-06T19:58:50.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.457+0000 7f07e4f6b700 1 -- 172.21.15.6:0/606680187 learned_addr learned my addr 172.21.15.6:0/606680187 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:58:50.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.457+0000 7f07e5f6d700 1 --2- 172.21.15.6:0/606680187 >> v2:172.21.15.40:3300/0 conn(0x7f07e015e4c0 0x7f07e00ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:50.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.457+0000 7f07e576c700 1 --2- 172.21.15.6:0/606680187 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e0157ed0 0x7f07e006f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:50.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.458+0000 7f07d7fff700 1 -- 172.21.15.6:0/606680187 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169095334 0 0) 0x7f07e006e6c0 con 0x7f07e00ccbe0 2023-07-06T19:58:50.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.458+0000 7f07d7fff700 1 -- 172.21.15.6:0/606680187 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07cc0035b0 con 0x7f07e00ccbe0 2023-07-06T19:58:50.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.458+0000 7f07d7fff700 1 -- 172.21.15.6:0/606680187 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 861508897 0 0) 0x7f07cc0035b0 con 0x7f07e00ccbe0 2023-07-06T19:58:50.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.458+0000 7f07d7fff700 1 -- 172.21.15.6:0/606680187 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e0157ed0 msgr2=0x7f07e006f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:50.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.458+0000 7f07d7fff700 1 --2- 172.21.15.6:0/606680187 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e0157ed0 0x7f07e006f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:50.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.458+0000 7f07d7fff700 1 -- 172.21.15.6:0/606680187 >> v2:172.21.15.40:3300/0 conn(0x7f07e015e4c0 msgr2=0x7f07e00ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:50.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.458+0000 7f07d7fff700 1 --2- 172.21.15.6:0/606680187 >> v2:172.21.15.40:3300/0 conn(0x7f07e015e4c0 0x7f07e00ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:50.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.458+0000 7f07d7fff700 1 -- 172.21.15.6:0/606680187 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e00cb360 con 0x7f07e00ccbe0 2023-07-06T19:58:50.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.458+0000 7f07d7fff700 1 -- 172.21.15.6:0/606680187 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f07dc001670 con 0x7f07e00ccbe0 2023-07-06T19:58:50.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.458+0000 7f07d7fff700 1 -- 172.21.15.6:0/606680187 >> v1:172.21.15.6:6789/0 conn(0x7f07e00ccbe0 legacy=0x7f07e015ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:50.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.458+0000 7f07d7fff700 1 --2- 172.21.15.6:0/606680187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07cc003a70 0x7f07cc003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:50.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.458+0000 7f07d7fff700 1 --2- 172.21.15.6:0/606680187 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e0157ed0 0x7f07cc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:50.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.458+0000 7f07d7fff700 1 --2- 172.21.15.6:0/606680187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07cc004d90 0x7f07cc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:50.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.458+0000 7f07d7fff700 1 -- 172.21.15.6:0/606680187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e006f6a0 con 0x7f07cc004d90 2023-07-06T19:58:50.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.458+0000 7f07d7fff700 1 -- 172.21.15.6:0/606680187 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e00cb080 con 0x7f07cc003a70 2023-07-06T19:58:50.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.458+0000 7f07d7fff700 1 -- 172.21.15.6:0/606680187 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc00ba10 con 0x7f07e0157ed0 2023-07-06T19:58:50.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.458+0000 7f07e576c700 1 --2- 172.21.15.6:0/606680187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07cc003a70 0x7f07cc003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:50.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.458+0000 7f07e5f6d700 1 --2- 172.21.15.6:0/606680187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07cc004d90 0x7f07cc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:50.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.458+0000 7f07e4f6b700 1 --2- 172.21.15.6:0/606680187 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e0157ed0 0x7f07cc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:50.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.458+0000 7f07e5f6d700 1 -- 172.21.15.6:0/606680187 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e0157ed0 msgr2=0x7f07cc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:50.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.458+0000 7f07e5f6d700 1 --2- 172.21.15.6:0/606680187 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e0157ed0 0x7f07cc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:50.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.458+0000 7f07e5f6d700 1 -- 172.21.15.6:0/606680187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07cc003a70 msgr2=0x7f07cc003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:50.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.458+0000 7f07e5f6d700 1 --2- 172.21.15.6:0/606680187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07cc003a70 0x7f07cc003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:50.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.458+0000 7f07e5f6d700 1 -- 172.21.15.6:0/606680187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07cc0035b0 con 0x7f07cc004d90 2023-07-06T19:58:50.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.459+0000 7f07e5f6d700 1 --2- 172.21.15.6:0/606680187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07cc004d90 0x7f07cc005200 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009fc0 tx=0x7f07cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6326c4517fdf6bc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:50.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.459+0000 7f07d7fff700 1 -- 172.21.15.6:0/606680187 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d800ebd0 con 0x7f07cc004d90 2023-07-06T19:58:50.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.459+0000 7f07d7fff700 1 -- 172.21.15.6:0/606680187 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d800f040 con 0x7f07cc004d90 2023-07-06T19:58:50.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.459+0000 7f07d7fff700 1 -- 172.21.15.6:0/606680187 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8014480 con 0x7f07cc004d90 2023-07-06T19:58:50.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.459+0000 7f07e79d0700 1 -- 172.21.15.6:0/606680187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07cc004d90 msgr2=0x7f07cc005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:50.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.459+0000 7f07e79d0700 1 --2- 172.21.15.6:0/606680187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07cc004d90 0x7f07cc005200 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009fc0 tx=0x7f07cc005880 comp rx=0 tx=0).stop 2023-07-06T19:58:50.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.459+0000 7f07e5f6d700 1 -- 172.21.15.6:0/606680187 reap_dead start 2023-07-06T19:58:50.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.459+0000 7f07e79d0700 1 -- 172.21.15.6:0/606680187 shutdown_connections 2023-07-06T19:58:50.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.459+0000 7f07e79d0700 1 -- 172.21.15.6:0/606680187 >> 172.21.15.6:0/606680187 conn(0x7f07e00d0a30 msgr2=0x7f07e00d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:50.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.459+0000 7f07e79d0700 1 -- 172.21.15.6:0/606680187 shutdown_connections 2023-07-06T19:58:50.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.460+0000 7f07e79d0700 1 -- 172.21.15.6:0/606680187 wait complete. 2023-07-06T19:58:50.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.461+0000 7f07e79d0700 1 Processor -- start 2023-07-06T19:58:50.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.461+0000 7f07e79d0700 1 -- start start 2023-07-06T19:58:50.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.461+0000 7f07e79d0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e00b63a0 0x7f07e01f30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:50.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.461+0000 7f07e79d0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e0153ca0 0x7f07e0154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:50.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.462+0000 7f07e79d0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07e01f5c40 0x7f07e01f60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:50.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.462+0000 7f07e79d0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e01529c0 con 0x7f07e0153ca0 2023-07-06T19:58:50.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.462+0000 7f07e79d0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e0154650 con 0x7f07e01f5c40 2023-07-06T19:58:50.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.462+0000 7f07e79d0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e01f3610 con 0x7f07e00b63a0 2023-07-06T19:58:50.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.462+0000 7f07e4f6b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e0153ca0 0x7f07e0154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:50.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.462+0000 7f07e4f6b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e0153ca0 0x7f07e0154110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58262/0 (socket says 172.21.15.6:58262) 2023-07-06T19:58:50.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.462+0000 7f07e4f6b700 1 -- 172.21.15.6:0/3153061001 learned_addr learned my addr 172.21.15.6:0/3153061001 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:50.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.462+0000 7f07e576c700 1 --2- 172.21.15.6:0/3153061001 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e00b63a0 0x7f07e01f30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:50.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.462+0000 7f07e5f6d700 1 --2- 172.21.15.6:0/3153061001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07e01f5c40 0x7f07e01f60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:50.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.462+0000 7f07e4f6b700 1 -- 172.21.15.6:0/3153061001 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e00b63a0 msgr2=0x7f07e01f30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:50.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.462+0000 7f07e4f6b700 1 --2- 172.21.15.6:0/3153061001 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e00b63a0 0x7f07e01f30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:50.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.462+0000 7f07e4f6b700 1 -- 172.21.15.6:0/3153061001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07e01f5c40 msgr2=0x7f07e01f60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:50.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.462+0000 7f07e4f6b700 1 --2- 172.21.15.6:0/3153061001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07e01f5c40 0x7f07e01f60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:50.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.462+0000 7f07e4f6b700 1 -- 172.21.15.6:0/3153061001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e006ba00 con 0x7f07e0153ca0 2023-07-06T19:58:50.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.462+0000 7f07e4f6b700 1 --2- 172.21.15.6:0/3153061001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e0153ca0 0x7f07e0154110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f07dc007310 tx=0x7f07dc0076d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:50.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.462+0000 7f07d5ffb700 1 -- 172.21.15.6:0/3153061001 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc00f8d0 con 0x7f07e0153ca0 2023-07-06T19:58:50.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.462+0000 7f07d5ffb700 1 -- 172.21.15.6:0/3153061001 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07dc00fa70 con 0x7f07e0153ca0 2023-07-06T19:58:50.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.462+0000 7f07e79d0700 1 -- 172.21.15.6:0/3153061001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e006bca0 con 0x7f07e0153ca0 2023-07-06T19:58:50.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.462+0000 7f07d5ffb700 1 -- 172.21.15.6:0/3153061001 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc00fe20 con 0x7f07e0153ca0 2023-07-06T19:58:50.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.462+0000 7f07e79d0700 1 -- 172.21.15.6:0/3153061001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e006c260 con 0x7f07e0153ca0 2023-07-06T19:58:50.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.464+0000 7f07e79d0700 1 -- 172.21.15.6:0/3153061001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e006c870 con 0x7f07e0153ca0 2023-07-06T19:58:50.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.464+0000 7f07d5ffb700 1 -- 172.21.15.6:0/3153061001 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f07dc01d460 con 0x7f07e0153ca0 2023-07-06T19:58:50.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.464+0000 7f07d5ffb700 1 --2- 172.21.15.6:0/3153061001 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f07c406ace0 0x7f07c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:50.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.464+0000 7f07d5ffb700 1 -- 172.21.15.6:0/3153061001 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f07dc089280 con 0x7f07e0153ca0 2023-07-06T19:58:50.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.464+0000 7f07e576c700 1 --2- 172.21.15.6:0/3153061001 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f07c406ace0 0x7f07c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:50.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.465+0000 7f07e576c700 1 --2- 172.21.15.6:0/3153061001 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f07c406ace0 0x7f07c406d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f07d0009b20 tx=0x7f07d0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:50.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.469+0000 7f07d5ffb700 1 -- 172.21.15.6:0/3153061001 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f07dc054710 con 0x7f07e0153ca0 2023-07-06T19:58:50.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.671+0000 7f07e79d0700 1 -- 172.21.15.6:0/3153061001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f07e00b3b10 con 0x7f07e0153ca0 2023-07-06T19:58:50.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.671+0000 7f07d5ffb700 1 -- 172.21.15.6:0/3153061001 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7f07dc057d30 con 0x7f07e0153ca0 2023-07-06T19:58:50.676 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:58:50.676 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-06T19:58:50.676 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T19:58:50.676 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-07-06T19:58:50.677 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-07-06T19:58:50.677 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T19:58:50.677 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T19:58:50.677 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-07-06T19:58:50.677 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-07-06T19:58:50.677 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T19:58:50.677 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-06T19:58:50.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.673+0000 7f07e79d0700 1 -- 172.21.15.6:0/3153061001 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f07c406ace0 msgr2=0x7f07c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:50.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.673+0000 7f07e79d0700 1 --2- 172.21.15.6:0/3153061001 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f07c406ace0 0x7f07c406d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f07d0009b20 tx=0x7f07d0008040 comp rx=0 tx=0).stop 2023-07-06T19:58:50.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.673+0000 7f07e79d0700 1 -- 172.21.15.6:0/3153061001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e0153ca0 msgr2=0x7f07e0154110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:50.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.673+0000 7f07e79d0700 1 --2- 172.21.15.6:0/3153061001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e0153ca0 0x7f07e0154110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f07dc007310 tx=0x7f07dc0076d0 comp rx=0 tx=0).stop 2023-07-06T19:58:50.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.673+0000 7f07e79d0700 1 -- 172.21.15.6:0/3153061001 shutdown_connections 2023-07-06T19:58:50.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.673+0000 7f07e79d0700 1 --2- 172.21.15.6:0/3153061001 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f07c406ace0 0x7f07c406d190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:50.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.673+0000 7f07e79d0700 1 --2- 172.21.15.6:0/3153061001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07e01f5c40 0x7f07e01f60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:50.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.673+0000 7f07e79d0700 1 --2- 172.21.15.6:0/3153061001 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f07e00b63a0 0x7f07e01f30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:50.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.673+0000 7f07e79d0700 1 --2- 172.21.15.6:0/3153061001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07e0153ca0 0x7f07e0154110 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:50.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.673+0000 7f07e79d0700 1 -- 172.21.15.6:0/3153061001 >> 172.21.15.6:0/3153061001 conn(0x7f07e00d0a30 msgr2=0x7f07e015b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:50.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.673+0000 7f07e79d0700 1 -- 172.21.15.6:0/3153061001 shutdown_connections 2023-07-06T19:58:50.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.673+0000 7f07e79d0700 1 -- 172.21.15.6:0/3153061001 wait complete. 2023-07-06T19:58:50.689 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-06T19:58:50.690 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-06T19:58:50.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.821+0000 7f7dce3cb700 1 Processor -- start 2023-07-06T19:58:50.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.821+0000 7f7dce3cb700 1 -- start start 2023-07-06T19:58:50.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.822+0000 7f7dce3cb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dc806b7a0 0x7f7dc806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:50.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.822+0000 7f7dce3cb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7dc806e140 0x7f7dc806e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:50.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.822+0000 7f7dce3cb700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dc80caca0 con 0x7f7dc8159090 2023-07-06T19:58:50.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.822+0000 7f7dce3cb700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc806eb00 con 0x7f7dc806e140 2023-07-06T19:58:50.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.822+0000 7f7dce3cb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc80caf80 con 0x7f7dc806b7a0 2023-07-06T19:58:50.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.822+0000 7f7dcc968700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7dc806e140 0x7f7dc806e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:50.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.822+0000 7f7dcc968700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7dc806e140 0x7f7dc806e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58272/0 (socket says 172.21.15.6:58272) 2023-07-06T19:58:50.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.822+0000 7f7dcc968700 1 -- 172.21.15.6:0/1184880490 learned_addr learned my addr 172.21.15.6:0/1184880490 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:50.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.822+0000 7f7dc77fe700 1 --2- 172.21.15.6:0/1184880490 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dc806b7a0 0x7f7dc806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:50.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.822+0000 7f7dcc968700 1 -- 172.21.15.6:0/1184880490 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dc806b7a0 msgr2=0x7f7dc806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:50.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.822+0000 7f7dcc968700 1 --2- 172.21.15.6:0/1184880490 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dc806b7a0 0x7f7dc806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:50.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.822+0000 7f7dcc968700 1 -- 172.21.15.6:0/1184880490 >> v1:172.21.15.40:6789/0 conn(0x7f7dc8159090 legacy=0x7f7dc80ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:50.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.822+0000 7f7dcc968700 1 -- 172.21.15.6:0/1184880490 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc806afa0 con 0x7f7dc806e140 2023-07-06T19:58:50.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.822+0000 7f7dc77fe700 1 --2- 172.21.15.6:0/1184880490 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dc806b7a0 0x7f7dc806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:58:50.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.823+0000 7f7dcc968700 1 --2- 172.21.15.6:0/1184880490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc806e140 0x7f7dc806e5c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7dc000d150 tx=0x7f7dc000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a25ea9b7605cd1c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:50.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.823+0000 7f7dc6ffd700 1 -- 172.21.15.6:0/1184880490 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0010070 con 0x7f7dc806e140 2023-07-06T19:58:50.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.823+0000 7f7dc6ffd700 1 -- 172.21.15.6:0/1184880490 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc000dd80 con 0x7f7dc806e140 2023-07-06T19:58:50.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.823+0000 7f7dc6ffd700 1 -- 172.21.15.6:0/1184880490 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc000b310 con 0x7f7dc806e140 2023-07-06T19:58:50.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.823+0000 7f7dce3cb700 1 -- 172.21.15.6:0/1184880490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc806e140 msgr2=0x7f7dc806e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:50.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.823+0000 7f7dce3cb700 1 --2- 172.21.15.6:0/1184880490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc806e140 0x7f7dc806e5c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7dc000d150 tx=0x7f7dc000d460 comp rx=0 tx=0).stop 2023-07-06T19:58:50.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.823+0000 7f7dce3cb700 1 -- 172.21.15.6:0/1184880490 shutdown_connections 2023-07-06T19:58:50.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.823+0000 7f7dce3cb700 1 --2- 172.21.15.6:0/1184880490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc806e140 0x7f7dc806e5c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:50.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.823+0000 7f7dce3cb700 1 --2- 172.21.15.6:0/1184880490 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dc806b7a0 0x7f7dc806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:50.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.823+0000 7f7dce3cb700 1 -- 172.21.15.6:0/1184880490 >> 172.21.15.6:0/1184880490 conn(0x7f7dc80cf050 msgr2=0x7f7dc80cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.823+0000 7f7dce3cb700 1 -- 172.21.15.6:0/1184880490 shutdown_connections 2023-07-06T19:58:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.823+0000 7f7dce3cb700 1 -- 172.21.15.6:0/1184880490 wait complete. 2023-07-06T19:58:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.825+0000 7f7dce3cb700 1 Processor -- start 2023-07-06T19:58:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.825+0000 7f7dce3cb700 1 -- start start 2023-07-06T19:58:50.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.825+0000 7f7dce3cb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7dc806b7a0 0x7f7dc814d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:50.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.825+0000 7f7dce3cb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dc806e140 0x7f7dc8154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:50.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.825+0000 7f7dce3cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc8159090 0x7f7dc815aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:50.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.825+0000 7f7dce3cb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc81534c0 con 0x7f7dc8159090 2023-07-06T19:58:50.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.825+0000 7f7dce3cb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc815aa80 con 0x7f7dc806b7a0 2023-07-06T19:58:50.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.825+0000 7f7dce3cb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc815a200 con 0x7f7dc806e140 2023-07-06T19:58:50.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.826+0000 7f7dcc968700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc8159090 0x7f7dc815aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:50.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.826+0000 7f7dcc968700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc8159090 0x7f7dc815aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58278/0 (socket says 172.21.15.6:58278) 2023-07-06T19:58:50.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.826+0000 7f7dcc968700 1 -- 172.21.15.6:0/1270251049 learned_addr learned my addr 172.21.15.6:0/1270251049 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:50.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.826+0000 7f7dc77fe700 1 --2- 172.21.15.6:0/1270251049 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dc806e140 0x7f7dc8154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:50.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.826+0000 7f7dc7fff700 1 --2- 172.21.15.6:0/1270251049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7dc806b7a0 0x7f7dc814d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:50.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.826+0000 7f7dcc968700 1 -- 172.21.15.6:0/1270251049 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dc806e140 msgr2=0x7f7dc8154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:50.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.826+0000 7f7dcc968700 1 --2- 172.21.15.6:0/1270251049 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dc806e140 0x7f7dc8154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:50.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.826+0000 7f7dcc968700 1 -- 172.21.15.6:0/1270251049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7dc806b7a0 msgr2=0x7f7dc814d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:50.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.826+0000 7f7dcc968700 1 --2- 172.21.15.6:0/1270251049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7dc806b7a0 0x7f7dc814d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:50.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.826+0000 7f7dcc968700 1 -- 172.21.15.6:0/1270251049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc000bd40 con 0x7f7dc8159090 2023-07-06T19:58:50.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.826+0000 7f7dcc968700 1 --2- 172.21.15.6:0/1270251049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc8159090 0x7f7dc815aed0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7dc000d860 tx=0x7f7dc0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:50.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.826+0000 7f7dc4ff9700 1 -- 172.21.15.6:0/1270251049 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc000ab20 con 0x7f7dc8159090 2023-07-06T19:58:50.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.826+0000 7f7dc4ff9700 1 -- 172.21.15.6:0/1270251049 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc000ac80 con 0x7f7dc8159090 2023-07-06T19:58:50.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.826+0000 7f7dce3cb700 1 -- 172.21.15.6:0/1270251049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc8159960 con 0x7f7dc8159090 2023-07-06T19:58:50.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.826+0000 7f7dc4ff9700 1 -- 172.21.15.6:0/1270251049 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0004030 con 0x7f7dc8159090 2023-07-06T19:58:50.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.826+0000 7f7dce3cb700 1 -- 172.21.15.6:0/1270251049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc8159f20 con 0x7f7dc8159090 2023-07-06T19:58:50.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.827+0000 7f7dce3cb700 1 -- 172.21.15.6:0/1270251049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc815a850 con 0x7f7dc8159090 2023-07-06T19:58:50.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.827+0000 7f7dc4ff9700 1 -- 172.21.15.6:0/1270251049 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7dc0004190 con 0x7f7dc8159090 2023-07-06T19:58:50.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.828+0000 7f7dc4ff9700 1 --2- 172.21.15.6:0/1270251049 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7da806ace0 0x7f7da806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:50.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.828+0000 7f7dc4ff9700 1 -- 172.21.15.6:0/1270251049 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7dc008cc70 con 0x7f7dc8159090 2023-07-06T19:58:50.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.828+0000 7f7dc7fff700 1 --2- 172.21.15.6:0/1270251049 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7da806ace0 0x7f7da806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:50.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.828+0000 7f7dc7fff700 1 --2- 172.21.15.6:0/1270251049 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7da806ace0 0x7f7da806d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7db0009870 tx=0x7f7db0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:50.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:50.832+0000 7f7dc4ff9700 1 -- 172.21.15.6:0/1270251049 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7dc815a850 con 0x7f7dc8159090 2023-07-06T19:58:51.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.032+0000 7f7dce3cb700 1 -- 172.21.15.6:0/1270251049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7dc815abf0 con 0x7f7dc8159090 2023-07-06T19:58:51.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.723+0000 7f7dc4ff9700 1 -- 172.21.15.6:0/1270251049 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7dc815abf0 con 0x7f7dc8159090 2023-07-06T19:58:51.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.727+0000 7f7dce3cb700 1 -- 172.21.15.6:0/1270251049 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7da806ace0 msgr2=0x7f7da806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:51.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.727+0000 7f7dce3cb700 1 --2- 172.21.15.6:0/1270251049 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7da806ace0 0x7f7da806d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7db0009870 tx=0x7f7db0008040 comp rx=0 tx=0).stop 2023-07-06T19:58:51.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.727+0000 7f7dce3cb700 1 -- 172.21.15.6:0/1270251049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc8159090 msgr2=0x7f7dc815aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:51.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.727+0000 7f7dce3cb700 1 --2- 172.21.15.6:0/1270251049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc8159090 0x7f7dc815aed0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7dc000d860 tx=0x7f7dc0004ad0 comp rx=0 tx=0).stop 2023-07-06T19:58:51.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.727+0000 7f7dce3cb700 1 -- 172.21.15.6:0/1270251049 shutdown_connections 2023-07-06T19:58:51.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.728+0000 7f7dce3cb700 1 --2- 172.21.15.6:0/1270251049 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7da806ace0 0x7f7da806d190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:51.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.728+0000 7f7dce3cb700 1 --2- 172.21.15.6:0/1270251049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7dc8159090 0x7f7dc815aed0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:51.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.728+0000 7f7dce3cb700 1 --2- 172.21.15.6:0/1270251049 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7dc806b7a0 0x7f7dc814d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:51.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.728+0000 7f7dce3cb700 1 --2- 172.21.15.6:0/1270251049 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7dc806e140 0x7f7dc8154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:51.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.728+0000 7f7dce3cb700 1 -- 172.21.15.6:0/1270251049 >> 172.21.15.6:0/1270251049 conn(0x7f7dc80cf050 msgr2=0x7f7dc80cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:51.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.728+0000 7f7dce3cb700 1 -- 172.21.15.6:0/1270251049 shutdown_connections 2023-07-06T19:58:51.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.728+0000 7f7dce3cb700 1 -- 172.21.15.6:0/1270251049 wait complete. 2023-07-06T19:58:51.732 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-07-06T19:58:51.744 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-07-06T19:58:51.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.888+0000 7f5b2f384700 1 Processor -- start 2023-07-06T19:58:51.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.888+0000 7f5b2f384700 1 -- start start 2023-07-06T19:58:51.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.889+0000 7f5b2f384700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b280ca850 0x7f5b2815bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:51.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.889+0000 7f5b2f384700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b280cb310 con 0x7f5b28071cd0 2023-07-06T19:58:51.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.889+0000 7f5b2f384700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b280af070 con 0x7f5b28071900 2023-07-06T19:58:51.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.889+0000 7f5b2f384700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b280cdbf0 con 0x7f5b280ca850 2023-07-06T19:58:51.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.889+0000 7f5b2d921700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5b28071cd0 0x7f5b280ce010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59494/0 (socket says 172.21.15.6:59494) 2023-07-06T19:58:51.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.889+0000 7f5b2d921700 1 -- 172.21.15.6:0/2397989384 learned_addr learned my addr 172.21.15.6:0/2397989384 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:58:51.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.889+0000 7f5b2c91f700 1 --2- 172.21.15.6:0/2397989384 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b280ca850 0x7f5b2815bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:51.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.889+0000 7f5b1ffff700 1 -- 172.21.15.6:0/2397989384 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517300603 0 0) 0x7f5b280cb310 con 0x7f5b28071cd0 2023-07-06T19:58:51.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.889+0000 7f5b1ffff700 1 -- 172.21.15.6:0/2397989384 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b140035b0 con 0x7f5b28071cd0 2023-07-06T19:58:51.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.889+0000 7f5b1ffff700 1 -- 172.21.15.6:0/2397989384 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998790306 0 0) 0x7f5b280af070 con 0x7f5b28071900 2023-07-06T19:58:51.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.889+0000 7f5b1ffff700 1 -- 172.21.15.6:0/2397989384 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b280cb310 con 0x7f5b28071900 2023-07-06T19:58:51.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.889+0000 7f5b2c91f700 1 -- 172.21.15.6:0/2397989384 >> v1:172.21.15.40:6789/0 conn(0x7f5b28071900 legacy=0x7f5b280ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:51.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.889+0000 7f5b2c91f700 1 -- 172.21.15.6:0/2397989384 >> v1:172.21.15.6:6789/0 conn(0x7f5b28071cd0 legacy=0x7f5b280ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:51.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.889+0000 7f5b1ffff700 1 -- 172.21.15.6:0/2397989384 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1183257925 0 0) 0x7f5b140035b0 con 0x7f5b28071cd0 2023-07-06T19:58:51.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.889+0000 7f5b2c91f700 1 -- 172.21.15.6:0/2397989384 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b280cad50 con 0x7f5b280ca850 2023-07-06T19:58:51.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.890+0000 7f5b2c91f700 1 --2- 172.21.15.6:0/2397989384 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b280ca850 0x7f5b2815bf50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009870 tx=0x7f5b24009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ffc90847cf80373 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:51.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.890+0000 7f5b1ffff700 1 -- 172.21.15.6:0/2397989384 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b200019f0 con 0x7f5b280ca850 2023-07-06T19:58:51.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.890+0000 7f5b1ffff700 1 -- 172.21.15.6:0/2397989384 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b24004030 con 0x7f5b280ca850 2023-07-06T19:58:51.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.890+0000 7f5b1ffff700 1 -- 172.21.15.6:0/2397989384 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b240043a0 con 0x7f5b280ca850 2023-07-06T19:58:51.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.890+0000 7f5b2f384700 1 -- 172.21.15.6:0/2397989384 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b280ca850 msgr2=0x7f5b2815bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:51.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.890+0000 7f5b2f384700 1 --2- 172.21.15.6:0/2397989384 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b280ca850 0x7f5b2815bf50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009870 tx=0x7f5b24009b80 comp rx=0 tx=0).stop 2023-07-06T19:58:51.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.890+0000 7f5b2f384700 1 -- 172.21.15.6:0/2397989384 shutdown_connections 2023-07-06T19:58:51.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.890+0000 7f5b2f384700 1 --2- 172.21.15.6:0/2397989384 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b280ca850 0x7f5b2815bf50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:51.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.890+0000 7f5b2f384700 1 -- 172.21.15.6:0/2397989384 >> 172.21.15.6:0/2397989384 conn(0x7f5b280cf960 msgr2=0x7f5b280cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:51.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.890+0000 7f5b2f384700 1 -- 172.21.15.6:0/2397989384 shutdown_connections 2023-07-06T19:58:51.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.890+0000 7f5b2f384700 1 -- 172.21.15.6:0/2397989384 wait complete. 2023-07-06T19:58:51.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.892+0000 7f5b2f384700 1 Processor -- start 2023-07-06T19:58:51.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.892+0000 7f5b2f384700 1 -- start start 2023-07-06T19:58:51.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.892+0000 7f5b2f384700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b28071900 0x7f5b2814bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:51.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.892+0000 7f5b2f384700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b28071cd0 0x7f5b280c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:51.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.892+0000 7f5b2f384700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b280ca850 0x7f5b280c4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:51.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.892+0000 7f5b2f384700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b280c5c90 con 0x7f5b28071900 2023-07-06T19:58:51.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.892+0000 7f5b2f384700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2815dab0 con 0x7f5b280ca850 2023-07-06T19:58:51.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.892+0000 7f5b2f384700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b280c5010 con 0x7f5b28071cd0 2023-07-06T19:58:51.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.893+0000 7f5b2d120700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b28071900 0x7f5b2814bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:51.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.893+0000 7f5b2d120700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b28071900 0x7f5b2814bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58288/0 (socket says 172.21.15.6:58288) 2023-07-06T19:58:51.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.893+0000 7f5b2d120700 1 -- 172.21.15.6:0/59923615 learned_addr learned my addr 172.21.15.6:0/59923615 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:51.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.893+0000 7f5b2c91f700 1 --2- 172.21.15.6:0/59923615 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b28071cd0 0x7f5b280c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:51.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.893+0000 7f5b2d921700 1 --2- 172.21.15.6:0/59923615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b280ca850 0x7f5b280c4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:51.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.893+0000 7f5b2d120700 1 -- 172.21.15.6:0/59923615 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b28071cd0 msgr2=0x7f5b280c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:51.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.893+0000 7f5b2d120700 1 --2- 172.21.15.6:0/59923615 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b28071cd0 0x7f5b280c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:51.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.893+0000 7f5b2d120700 1 -- 172.21.15.6:0/59923615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b280ca850 msgr2=0x7f5b280c4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:51.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.893+0000 7f5b2d120700 1 --2- 172.21.15.6:0/59923615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b280ca850 0x7f5b280c4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:51.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.893+0000 7f5b2d120700 1 -- 172.21.15.6:0/59923615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b240094a0 con 0x7f5b28071900 2023-07-06T19:58:51.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.893+0000 7f5b2d120700 1 --2- 172.21.15.6:0/59923615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b28071900 0x7f5b2814bc90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5b1800c500 tx=0x7f5b1800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:51.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.893+0000 7f5b1dffb700 1 -- 172.21.15.6:0/59923615 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b180052d0 con 0x7f5b28071900 2023-07-06T19:58:51.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.893+0000 7f5b1dffb700 1 -- 172.21.15.6:0/59923615 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b18005450 con 0x7f5b28071900 2023-07-06T19:58:51.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.893+0000 7f5b1dffb700 1 -- 172.21.15.6:0/59923615 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b180038c0 con 0x7f5b28071900 2023-07-06T19:58:51.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.893+0000 7f5b2f384700 1 -- 172.21.15.6:0/59923615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b280c52f0 con 0x7f5b28071900 2023-07-06T19:58:51.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.893+0000 7f5b2f384700 1 -- 172.21.15.6:0/59923615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b280c58b0 con 0x7f5b28071900 2023-07-06T19:58:51.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.894+0000 7f5b2f384700 1 -- 172.21.15.6:0/59923615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2804eb90 con 0x7f5b28071900 2023-07-06T19:58:51.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.895+0000 7f5b1dffb700 1 -- 172.21.15.6:0/59923615 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5b18003a20 con 0x7f5b28071900 2023-07-06T19:58:51.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.895+0000 7f5b1dffb700 1 --2- 172.21.15.6:0/59923615 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f5b0c06ace0 0x7f5b0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:51.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.895+0000 7f5b1dffb700 1 -- 172.21.15.6:0/59923615 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f5b18088810 con 0x7f5b28071900 2023-07-06T19:58:51.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.895+0000 7f5b2c91f700 1 --2- 172.21.15.6:0/59923615 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f5b0c06ace0 0x7f5b0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:51.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.896+0000 7f5b2c91f700 1 --2- 172.21.15.6:0/59923615 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f5b0c06ace0 0x7f5b0c06d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5b280cac80 tx=0x7f5b24013040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:51.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:51.900+0000 7f5b1dffb700 1 -- 172.21.15.6:0/59923615 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5b18053a20 con 0x7f5b28071900 2023-07-06T19:58:52.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.099+0000 7f5b2f384700 1 -- 172.21.15.6:0/59923615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f5b280b58e0 con 0x7f5b28071900 2023-07-06T19:58:52.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.731+0000 7f5b1dffb700 1 -- 172.21.15.6:0/59923615 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) v1 ==== 171+0+0 (secure 0 0 0) 0x7f5b18057040 con 0x7f5b28071900 2023-07-06T19:58:52.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.738+0000 7f5b2f384700 1 -- 172.21.15.6:0/59923615 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f5b0c06ace0 msgr2=0x7f5b0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:52.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.738+0000 7f5b2f384700 1 --2- 172.21.15.6:0/59923615 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f5b0c06ace0 0x7f5b0c06d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5b280cac80 tx=0x7f5b24013040 comp rx=0 tx=0).stop 2023-07-06T19:58:52.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.738+0000 7f5b2f384700 1 -- 172.21.15.6:0/59923615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b28071900 msgr2=0x7f5b2814bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:52.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.738+0000 7f5b2f384700 1 --2- 172.21.15.6:0/59923615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b28071900 0x7f5b2814bc90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5b1800c500 tx=0x7f5b1800c8c0 comp rx=0 tx=0).stop 2023-07-06T19:58:52.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.739+0000 7f5b2f384700 1 -- 172.21.15.6:0/59923615 shutdown_connections 2023-07-06T19:58:52.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.739+0000 7f5b2f384700 1 --2- 172.21.15.6:0/59923615 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f5b0c06ace0 0x7f5b0c06d190 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:52.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.739+0000 7f5b2f384700 1 --2- 172.21.15.6:0/59923615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b28071900 0x7f5b2814bc90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:52.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.739+0000 7f5b2f384700 1 --2- 172.21.15.6:0/59923615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b280ca850 0x7f5b280c4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:52.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.739+0000 7f5b2f384700 1 --2- 172.21.15.6:0/59923615 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b28071cd0 0x7f5b280c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:52.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.739+0000 7f5b2f384700 1 -- 172.21.15.6:0/59923615 >> 172.21.15.6:0/59923615 conn(0x7f5b280cf960 msgr2=0x7f5b2814e070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:52.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.746+0000 7f5b2f384700 1 -- 172.21.15.6:0/59923615 shutdown_connections 2023-07-06T19:58:52.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.746+0000 7f5b2f384700 1 -- 172.21.15.6:0/59923615 wait complete. 2023-07-06T19:58:52.753 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-07-06T19:58:52.768 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-06T19:58:52.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.901+0000 7f75974d3700 1 Processor -- start 2023-07-06T19:58:52.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.902+0000 7f75974d3700 1 -- start start 2023-07-06T19:58:52.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.902+0000 7f75974d3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f75900d15e0 0x7f759006e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:52.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.902+0000 7f75974d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75900ce860 0x7f75900cece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:52.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.902+0000 7f75974d3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75900cd300 con 0x7f759015a520 2023-07-06T19:58:52.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.902+0000 7f75974d3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75900b0290 con 0x7f75900d15e0 2023-07-06T19:58:52.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.902+0000 7f75974d3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75900ccd80 con 0x7f75900ce860 2023-07-06T19:58:52.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.903+0000 7f7594a6e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f75900d15e0 0x7f759006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:52.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.903+0000 7f7594a6e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f75900d15e0 0x7f759006e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58298/0 (socket says 172.21.15.6:58298) 2023-07-06T19:58:52.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.903+0000 7f7594a6e700 1 -- 172.21.15.6:0/2196877466 learned_addr learned my addr 172.21.15.6:0/2196877466 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:52.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.903+0000 7f7595a70700 1 --2- 172.21.15.6:0/2196877466 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75900ce860 0x7f75900cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:52.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.903+0000 7f7594a6e700 1 -- 172.21.15.6:0/2196877466 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75900ce860 msgr2=0x7f75900cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:52.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.903+0000 7f7594a6e700 1 --2- 172.21.15.6:0/2196877466 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75900ce860 0x7f75900cece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:52.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.903+0000 7f7594a6e700 1 -- 172.21.15.6:0/2196877466 >> v1:172.21.15.40:6789/0 conn(0x7f759015a520 legacy=0x7f759006dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:52.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.903+0000 7f7594a6e700 1 -- 172.21.15.6:0/2196877466 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75900cd020 con 0x7f75900d15e0 2023-07-06T19:58:52.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.903+0000 7f7594a6e700 1 --2- 172.21.15.6:0/2196877466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75900d15e0 0x7f759006e320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f758c0098f0 tx=0x7f758c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=554dd11ffa833159 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:52.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.903+0000 7f7583fff700 1 -- 172.21.15.6:0/2196877466 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c004230 con 0x7f75900d15e0 2023-07-06T19:58:52.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.903+0000 7f7583fff700 1 -- 172.21.15.6:0/2196877466 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c004390 con 0x7f75900d15e0 2023-07-06T19:58:52.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.903+0000 7f7583fff700 1 -- 172.21.15.6:0/2196877466 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c0036a0 con 0x7f75900d15e0 2023-07-06T19:58:52.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.904+0000 7f75974d3700 1 -- 172.21.15.6:0/2196877466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75900d15e0 msgr2=0x7f759006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:52.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.904+0000 7f75974d3700 1 --2- 172.21.15.6:0/2196877466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75900d15e0 0x7f759006e320 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f758c0098f0 tx=0x7f758c009c00 comp rx=0 tx=0).stop 2023-07-06T19:58:52.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.904+0000 7f75974d3700 1 -- 172.21.15.6:0/2196877466 shutdown_connections 2023-07-06T19:58:52.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.904+0000 7f75974d3700 1 --2- 172.21.15.6:0/2196877466 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75900ce860 0x7f75900cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:52.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.904+0000 7f75974d3700 1 --2- 172.21.15.6:0/2196877466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75900d15e0 0x7f759006e320 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:52.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.904+0000 7f75974d3700 1 -- 172.21.15.6:0/2196877466 >> 172.21.15.6:0/2196877466 conn(0x7f75900ce120 msgr2=0x7f75900d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:52.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.904+0000 7f75974d3700 1 -- 172.21.15.6:0/2196877466 shutdown_connections 2023-07-06T19:58:52.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.904+0000 7f75974d3700 1 -- 172.21.15.6:0/2196877466 wait complete. 2023-07-06T19:58:52.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.905+0000 7f75974d3700 1 Processor -- start 2023-07-06T19:58:52.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.905+0000 7f75974d3700 1 -- start start 2023-07-06T19:58:52.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.906+0000 7f75974d3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75900ce860 0x7f7590151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:52.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.906+0000 7f75974d3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75900d15e0 0x7f75900b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:52.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.906+0000 7f75974d3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f759015a520 0x7f75900c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:52.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.906+0000 7f75974d3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75900b19d0 con 0x7f75900ce860 2023-07-06T19:58:52.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.906+0000 7f75974d3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75900ca430 con 0x7f759015a520 2023-07-06T19:58:52.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.906+0000 7f75974d3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7590152440 con 0x7f75900d15e0 2023-07-06T19:58:52.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.906+0000 7f759526f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75900ce860 0x7f7590151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:52.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.906+0000 7f759526f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75900ce860 0x7f7590151f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58302/0 (socket says 172.21.15.6:58302) 2023-07-06T19:58:52.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.906+0000 7f759526f700 1 -- 172.21.15.6:0/4169261428 learned_addr learned my addr 172.21.15.6:0/4169261428 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:52.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.906+0000 7f7594a6e700 1 --2- 172.21.15.6:0/4169261428 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75900d15e0 0x7f75900b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:52.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.906+0000 7f7595a70700 1 --2- 172.21.15.6:0/4169261428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f759015a520 0x7f75900c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:52.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.906+0000 7f759526f700 1 -- 172.21.15.6:0/4169261428 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75900d15e0 msgr2=0x7f75900b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:52.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.906+0000 7f759526f700 1 --2- 172.21.15.6:0/4169261428 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75900d15e0 0x7f75900b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:52.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.906+0000 7f759526f700 1 -- 172.21.15.6:0/4169261428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f759015a520 msgr2=0x7f75900c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:52.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.906+0000 7f759526f700 1 --2- 172.21.15.6:0/4169261428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f759015a520 0x7f75900c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:52.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.906+0000 7f759526f700 1 -- 172.21.15.6:0/4169261428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c009550 con 0x7f75900ce860 2023-07-06T19:58:52.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.906+0000 7f759526f700 1 --2- 172.21.15.6:0/4169261428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75900ce860 0x7f7590151f00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f758400b4a0 tx=0x7f758400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:52.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.906+0000 7f7581ffb700 1 -- 172.21.15.6:0/4169261428 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7584011830 con 0x7f75900ce860 2023-07-06T19:58:52.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.907+0000 7f7581ffb700 1 -- 172.21.15.6:0/4169261428 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7584011990 con 0x7f75900ce860 2023-07-06T19:58:52.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.907+0000 7f7581ffb700 1 -- 172.21.15.6:0/4169261428 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7584011d40 con 0x7f75900ce860 2023-07-06T19:58:52.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.907+0000 7f75974d3700 1 -- 172.21.15.6:0/4169261428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75900b1120 con 0x7f75900ce860 2023-07-06T19:58:52.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.907+0000 7f75974d3700 1 -- 172.21.15.6:0/4169261428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75900b1660 con 0x7f75900ce860 2023-07-06T19:58:52.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.908+0000 7f75974d3700 1 -- 172.21.15.6:0/4169261428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f759004eb90 con 0x7f75900ce860 2023-07-06T19:58:52.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.908+0000 7f7581ffb700 1 -- 172.21.15.6:0/4169261428 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f758401a400 con 0x7f75900ce860 2023-07-06T19:58:52.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.908+0000 7f7581ffb700 1 --2- 172.21.15.6:0/4169261428 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f757406ace0 0x7f757406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:52.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.909+0000 7f7581ffb700 1 -- 172.21.15.6:0/4169261428 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f7584088fc0 con 0x7f75900ce860 2023-07-06T19:58:52.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.909+0000 7f7594a6e700 1 --2- 172.21.15.6:0/4169261428 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f757406ace0 0x7f757406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:52.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.909+0000 7f7594a6e700 1 --2- 172.21.15.6:0/4169261428 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f757406ace0 0x7f757406d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f758c009130 tx=0x7f758c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:52.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:52.913+0000 7f7581ffb700 1 -- 172.21.15.6:0/4169261428 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f75840bb310 con 0x7f75900ce860 2023-07-06T19:58:53.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.157+0000 7f75974d3700 1 -- 172.21.15.6:0/4169261428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7590152600 con 0x7f75900ce860 2023-07-06T19:58:53.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.730+0000 7f7581ffb700 1 -- 172.21.15.6:0/4169261428 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f75840150c0 con 0x7f75900ce860 2023-07-06T19:58:53.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.738+0000 7f75974d3700 1 -- 172.21.15.6:0/4169261428 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f757406ace0 msgr2=0x7f757406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:53.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.738+0000 7f75974d3700 1 --2- 172.21.15.6:0/4169261428 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f757406ace0 0x7f757406d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f758c009130 tx=0x7f758c008030 comp rx=0 tx=0).stop 2023-07-06T19:58:53.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.738+0000 7f75974d3700 1 -- 172.21.15.6:0/4169261428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75900ce860 msgr2=0x7f7590151f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:53.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.738+0000 7f75974d3700 1 --2- 172.21.15.6:0/4169261428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75900ce860 0x7f7590151f00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f758400b4a0 tx=0x7f758400b7b0 comp rx=0 tx=0).stop 2023-07-06T19:58:53.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.738+0000 7f75974d3700 1 -- 172.21.15.6:0/4169261428 shutdown_connections 2023-07-06T19:58:53.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.738+0000 7f75974d3700 1 --2- 172.21.15.6:0/4169261428 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f757406ace0 0x7f757406d190 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f758c009130 tx=0x7f758c008030 comp rx=0 tx=0).stop 2023-07-06T19:58:53.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.738+0000 7f75974d3700 1 --2- 172.21.15.6:0/4169261428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75900ce860 0x7f7590151f00 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f758400b4a0 tx=0x7f758400b7b0 comp rx=0 tx=0).stop 2023-07-06T19:58:53.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.738+0000 7f75974d3700 1 --2- 172.21.15.6:0/4169261428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f759015a520 0x7f75900c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:53.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.738+0000 7f75974d3700 1 --2- 172.21.15.6:0/4169261428 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f75900d15e0 0x7f75900b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:53.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.738+0000 7f75974d3700 1 -- 172.21.15.6:0/4169261428 >> 172.21.15.6:0/4169261428 conn(0x7f75900ce120 msgr2=0x7f75901532e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:53.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.747+0000 7f75974d3700 1 -- 172.21.15.6:0/4169261428 shutdown_connections 2023-07-06T19:58:53.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.747+0000 7f75974d3700 1 -- 172.21.15.6:0/4169261428 wait complete. 2023-07-06T19:58:53.758 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 3 and data pool 4 2023-07-06T19:58:53.773 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-07-06T19:58:53.773 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-07-06T19:58:53.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.908+0000 7f42b1820700 1 Processor -- start 2023-07-06T19:58:53.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.908+0000 7f42b1820700 1 -- start start 2023-07-06T19:58:53.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.909+0000 7f42b1820700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42ac0cd240 0x7f42ac0cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:53.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.909+0000 7f42b1820700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f42ac0d0b70 0x7f42ac0d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:53.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.909+0000 7f42b1820700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42ac0cdbd0 con 0x7f42ac15c670 2023-07-06T19:58:53.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.909+0000 7f42b1820700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42ac06aa30 con 0x7f42ac0d0b70 2023-07-06T19:58:53.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.909+0000 7f42b1820700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac15ca40 con 0x7f42ac0cd240 2023-07-06T19:58:53.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.909+0000 7f42ab7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f42ac0d0b70 0x7f42ac0d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:53.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.909+0000 7f42ab7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f42ac0d0b70 0x7f42ac0d0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58326/0 (socket says 172.21.15.6:58326) 2023-07-06T19:58:53.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.909+0000 7f42ab7fe700 1 -- 172.21.15.6:0/657131244 learned_addr learned my addr 172.21.15.6:0/657131244 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:53.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.909+0000 7f42aa7fc700 1 --2- 172.21.15.6:0/657131244 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42ac0cd240 0x7f42ac0cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:53.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.909+0000 7f42ab7fe700 1 -- 172.21.15.6:0/657131244 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42ac0cd240 msgr2=0x7f42ac0cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:53.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.909+0000 7f42ab7fe700 1 --2- 172.21.15.6:0/657131244 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42ac0cd240 0x7f42ac0cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:53.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.909+0000 7f42ab7fe700 1 -- 172.21.15.6:0/657131244 >> v1:172.21.15.40:6789/0 conn(0x7f42ac15c670 legacy=0x7f42ac06bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:53.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.909+0000 7f42ab7fe700 1 -- 172.21.15.6:0/657131244 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ac06c950 con 0x7f42ac0d0b70 2023-07-06T19:58:53.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.909+0000 7f42aa7fc700 1 --2- 172.21.15.6:0/657131244 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42ac0cd240 0x7f42ac0cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:58:53.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.909+0000 7f42ab7fe700 1 --2- 172.21.15.6:0/657131244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42ac0d0b70 0x7f42ac0d0ff0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f42a4009e50 tx=0x7f42a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397f5865490c3c1e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:53.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.909+0000 7f42a9ffb700 1 -- 172.21.15.6:0/657131244 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a400e070 con 0x7f42ac0d0b70 2023-07-06T19:58:53.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.909+0000 7f42a9ffb700 1 -- 172.21.15.6:0/657131244 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a400b9c0 con 0x7f42ac0d0b70 2023-07-06T19:58:53.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.909+0000 7f42a9ffb700 1 -- 172.21.15.6:0/657131244 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a400bd70 con 0x7f42ac0d0b70 2023-07-06T19:58:53.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.910+0000 7f42b1820700 1 -- 172.21.15.6:0/657131244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42ac0d0b70 msgr2=0x7f42ac0d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:53.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.910+0000 7f42b1820700 1 --2- 172.21.15.6:0/657131244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42ac0d0b70 0x7f42ac0d0ff0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f42a4009e50 tx=0x7f42a400b330 comp rx=0 tx=0).stop 2023-07-06T19:58:53.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.910+0000 7f42b1820700 1 -- 172.21.15.6:0/657131244 shutdown_connections 2023-07-06T19:58:53.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.910+0000 7f42b1820700 1 --2- 172.21.15.6:0/657131244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42ac0d0b70 0x7f42ac0d0ff0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:53.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.910+0000 7f42b1820700 1 --2- 172.21.15.6:0/657131244 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42ac0cd240 0x7f42ac0cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:53.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.910+0000 7f42b1820700 1 -- 172.21.15.6:0/657131244 >> 172.21.15.6:0/657131244 conn(0x7f42ac0d2bf0 msgr2=0x7f42ac0d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:53.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.910+0000 7f42b1820700 1 -- 172.21.15.6:0/657131244 shutdown_connections 2023-07-06T19:58:53.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.910+0000 7f42b1820700 1 -- 172.21.15.6:0/657131244 wait complete. 2023-07-06T19:58:53.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.911+0000 7f42b1820700 1 Processor -- start 2023-07-06T19:58:53.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.911+0000 7f42b1820700 1 -- start start 2023-07-06T19:58:53.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.912+0000 7f42b1820700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42ac0cd240 0x7f42ac157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:53.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.912+0000 7f42b1820700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42ac0d0b70 0x7f42ac15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:53.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.912+0000 7f42b1820700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42ac15c670 0x7f42ac156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:53.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.912+0000 7f42b1820700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac159260 con 0x7f42ac0cd240 2023-07-06T19:58:53.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.912+0000 7f42b1820700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac157db0 con 0x7f42ac0d0b70 2023-07-06T19:58:53.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.912+0000 7f42b1820700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ac158930 con 0x7f42ac15c670 2023-07-06T19:58:53.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.912+0000 7f42aaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42ac0cd240 0x7f42ac157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:53.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.912+0000 7f42aaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42ac0cd240 0x7f42ac157510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58328/0 (socket says 172.21.15.6:58328) 2023-07-06T19:58:53.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.912+0000 7f42aaffd700 1 -- 172.21.15.6:0/1196423310 learned_addr learned my addr 172.21.15.6:0/1196423310 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:53.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.912+0000 7f42ab7fe700 1 --2- 172.21.15.6:0/1196423310 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42ac15c670 0x7f42ac156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:53.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.912+0000 7f42aa7fc700 1 --2- 172.21.15.6:0/1196423310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42ac0d0b70 0x7f42ac15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:53.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.913+0000 7f42aaffd700 1 -- 172.21.15.6:0/1196423310 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42ac15c670 msgr2=0x7f42ac156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:53.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.913+0000 7f42aaffd700 1 --2- 172.21.15.6:0/1196423310 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42ac15c670 0x7f42ac156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:53.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.913+0000 7f42aaffd700 1 -- 172.21.15.6:0/1196423310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42ac0d0b70 msgr2=0x7f42ac15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:53.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.913+0000 7f42aaffd700 1 --2- 172.21.15.6:0/1196423310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42ac0d0b70 0x7f42ac15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:53.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.913+0000 7f42aaffd700 1 -- 172.21.15.6:0/1196423310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a4009b30 con 0x7f42ac0cd240 2023-07-06T19:58:53.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.913+0000 7f42aaffd700 1 --2- 172.21.15.6:0/1196423310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42ac0cd240 0x7f42ac157510 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f42a000c450 tx=0x7f42a000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:53.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.913+0000 7f4293fff700 1 -- 172.21.15.6:0/1196423310 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a00052d0 con 0x7f42ac0cd240 2023-07-06T19:58:53.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.913+0000 7f4293fff700 1 -- 172.21.15.6:0/1196423310 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a0005430 con 0x7f42ac0cd240 2023-07-06T19:58:53.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.913+0000 7f4293fff700 1 -- 172.21.15.6:0/1196423310 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a00038c0 con 0x7f42ac0cd240 2023-07-06T19:58:53.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.913+0000 7f42b1820700 1 -- 172.21.15.6:0/1196423310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42ac158c10 con 0x7f42ac0cd240 2023-07-06T19:58:53.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.913+0000 7f42b1820700 1 -- 172.21.15.6:0/1196423310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42ac15ace0 con 0x7f42ac0cd240 2023-07-06T19:58:53.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.914+0000 7f42b1820700 1 -- 172.21.15.6:0/1196423310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42ac074200 con 0x7f42ac0cd240 2023-07-06T19:58:53.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.914+0000 7f4293fff700 1 -- 172.21.15.6:0/1196423310 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f42a0003a20 con 0x7f42ac0cd240 2023-07-06T19:58:53.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.915+0000 7f4293fff700 1 --2- 172.21.15.6:0/1196423310 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f429806ace0 0x7f429806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:53.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.915+0000 7f4293fff700 1 -- 172.21.15.6:0/1196423310 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f42a0088600 con 0x7f42ac0cd240 2023-07-06T19:58:53.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.915+0000 7f42aa7fc700 1 --2- 172.21.15.6:0/1196423310 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f429806ace0 0x7f429806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:53.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.915+0000 7f42aa7fc700 1 --2- 172.21.15.6:0/1196423310 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f429806ace0 0x7f429806d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f42ac1f56a0 tx=0x7f429c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:53.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:53.919+0000 7f4293fff700 1 -- 172.21.15.6:0/1196423310 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f42a00536b0 con 0x7f42ac0cd240 2023-07-06T19:58:54.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.129+0000 7f42b1820700 1 -- 172.21.15.6:0/1196423310 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f42ac06cec0 con 0x7f42ac0cd240 2023-07-06T19:58:54.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.747+0000 7f4293fff700 1 -- 172.21.15.6:0/1196423310 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 157+0+0 (secure 0 0 0) 0x7f42a000ce60 con 0x7f42ac0cd240 2023-07-06T19:58:54.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.750+0000 7f42b1820700 1 -- 172.21.15.6:0/1196423310 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f429806ace0 msgr2=0x7f429806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:54.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.750+0000 7f42b1820700 1 --2- 172.21.15.6:0/1196423310 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f429806ace0 0x7f429806d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f42ac1f56a0 tx=0x7f429c008040 comp rx=0 tx=0).stop 2023-07-06T19:58:54.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.750+0000 7f42b1820700 1 -- 172.21.15.6:0/1196423310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42ac0cd240 msgr2=0x7f42ac157510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:54.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.750+0000 7f42b1820700 1 --2- 172.21.15.6:0/1196423310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42ac0cd240 0x7f42ac157510 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f42a000c450 tx=0x7f42a000c760 comp rx=0 tx=0).stop 2023-07-06T19:58:54.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.751+0000 7f42b1820700 1 -- 172.21.15.6:0/1196423310 shutdown_connections 2023-07-06T19:58:54.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.751+0000 7f42b1820700 1 --2- 172.21.15.6:0/1196423310 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f429806ace0 0x7f429806d190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:54.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.751+0000 7f42b1820700 1 --2- 172.21.15.6:0/1196423310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42ac0cd240 0x7f42ac157510 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:54.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.751+0000 7f42b1820700 1 --2- 172.21.15.6:0/1196423310 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f42ac15c670 0x7f42ac156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:54.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.751+0000 7f42b1820700 1 --2- 172.21.15.6:0/1196423310 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42ac0d0b70 0x7f42ac15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:54.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.751+0000 7f42b1820700 1 -- 172.21.15.6:0/1196423310 >> 172.21.15.6:0/1196423310 conn(0x7f42ac0d2bf0 msgr2=0x7f42ac15d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:54.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.751+0000 7f42b1820700 1 -- 172.21.15.6:0/1196423310 shutdown_connections 2023-07-06T19:58:54.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.751+0000 7f42b1820700 1 -- 172.21.15.6:0/1196423310 wait complete. 2023-07-06T19:58:54.769 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-07-06T19:58:54.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.909+0000 7efd7ebcc700 1 Processor -- start 2023-07-06T19:58:54.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.909+0000 7efd7ebcc700 1 -- start start 2023-07-06T19:58:54.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.910+0000 7efd7ebcc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efd78159f50 0x7efd78160b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:54.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.910+0000 7efd7ebcc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd780cf710 0x7efd7815cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:54.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.910+0000 7efd7ebcc700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd780ced30 con 0x7efd7815ca70 2023-07-06T19:58:54.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.910+0000 7efd7ebcc700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7815d430 con 0x7efd78159f50 2023-07-06T19:58:54.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.910+0000 7efd7ebcc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd7815d650 con 0x7efd780cf710 2023-07-06T19:58:54.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.910+0000 7efd7c968700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efd78159f50 0x7efd78160b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:54.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.910+0000 7efd7d169700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd780cf710 0x7efd7815cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:54.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.910+0000 7efd7d169700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd780cf710 0x7efd7815cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:50984/0 (socket says 172.21.15.6:50984) 2023-07-06T19:58:54.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.910+0000 7efd7c968700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efd78159f50 0x7efd78160b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:37372/0 (socket says 172.21.15.6:37372) 2023-07-06T19:58:54.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.910+0000 7efd7d169700 1 -- 172.21.15.6:0/3536506156 learned_addr learned my addr 172.21.15.6:0/3536506156 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:54.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.910+0000 7efd77fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7efd7815ca70 0x7efd780cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:49418/0 (socket says 172.21.15.6:49418) 2023-07-06T19:58:54.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.911+0000 7efd7c968700 1 -- 172.21.15.6:0/3536506156 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd780cf710 msgr2=0x7efd7815cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.911+0000 7efd7c968700 1 --2- 172.21.15.6:0/3536506156 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd780cf710 0x7efd7815cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.911+0000 7efd7c968700 1 -- 172.21.15.6:0/3536506156 >> v1:172.21.15.40:6789/0 conn(0x7efd7815ca70 legacy=0x7efd780cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.911+0000 7efd7c968700 1 -- 172.21.15.6:0/3536506156 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd7815d930 con 0x7efd78159f50 2023-07-06T19:58:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.911+0000 7efd7d169700 1 --2- 172.21.15.6:0/3536506156 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd780cf710 0x7efd7815cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:58:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.911+0000 7efd7c968700 1 --2- 172.21.15.6:0/3536506156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd78159f50 0x7efd78160b40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009840 tx=0x7efd6c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32001a87019b769c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:54.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.911+0000 7efd777fe700 1 -- 172.21.15.6:0/3536506156 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c011830 con 0x7efd78159f50 2023-07-06T19:58:54.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.911+0000 7efd777fe700 1 -- 172.21.15.6:0/3536506156 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd6c011990 con 0x7efd78159f50 2023-07-06T19:58:54.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.911+0000 7efd777fe700 1 -- 172.21.15.6:0/3536506156 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c011d20 con 0x7efd78159f50 2023-07-06T19:58:54.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.912+0000 7efd7ebcc700 1 -- 172.21.15.6:0/3536506156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd78159f50 msgr2=0x7efd78160b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:54.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.912+0000 7efd7ebcc700 1 --2- 172.21.15.6:0/3536506156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd78159f50 0x7efd78160b40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009840 tx=0x7efd6c009b50 comp rx=0 tx=0).stop 2023-07-06T19:58:54.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.912+0000 7efd7ebcc700 1 -- 172.21.15.6:0/3536506156 shutdown_connections 2023-07-06T19:58:54.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.912+0000 7efd7ebcc700 1 --2- 172.21.15.6:0/3536506156 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd780cf710 0x7efd7815cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:54.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.912+0000 7efd7ebcc700 1 --2- 172.21.15.6:0/3536506156 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd78159f50 0x7efd78160b40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:54.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.912+0000 7efd7ebcc700 1 -- 172.21.15.6:0/3536506156 >> 172.21.15.6:0/3536506156 conn(0x7efd780b0c40 msgr2=0x7efd780b1010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:54.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.912+0000 7efd7ebcc700 1 -- 172.21.15.6:0/3536506156 shutdown_connections 2023-07-06T19:58:54.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.912+0000 7efd7ebcc700 1 -- 172.21.15.6:0/3536506156 wait complete. 2023-07-06T19:58:54.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.913+0000 7efd7ebcc700 1 Processor -- start 2023-07-06T19:58:54.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.913+0000 7efd7ebcc700 1 -- start start 2023-07-06T19:58:54.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.914+0000 7efd7ebcc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd780cf710 0x7efd78150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:54.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.914+0000 7efd7ebcc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd78159f50 0x7efd780c4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:54.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.914+0000 7efd7ebcc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd7815ca70 0x7efd7815e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:54.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.914+0000 7efd7ebcc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd780c9550 con 0x7efd78159f50 2023-07-06T19:58:54.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.914+0000 7efd7ebcc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd780b2070 con 0x7efd7815ca70 2023-07-06T19:58:54.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.914+0000 7efd7ebcc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd780b2310 con 0x7efd780cf710 2023-07-06T19:58:54.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.914+0000 7efd77fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd78159f50 0x7efd780c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:54.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.914+0000 7efd77fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd78159f50 0x7efd780c4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58344/0 (socket says 172.21.15.6:58344) 2023-07-06T19:58:54.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.914+0000 7efd77fff700 1 -- 172.21.15.6:0/916282220 learned_addr learned my addr 172.21.15.6:0/916282220 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:54.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.914+0000 7efd7d169700 1 --2- 172.21.15.6:0/916282220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd7815ca70 0x7efd7815e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:54.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.914+0000 7efd7c968700 1 --2- 172.21.15.6:0/916282220 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd780cf710 0x7efd78150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:54.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.914+0000 7efd77fff700 1 -- 172.21.15.6:0/916282220 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd780cf710 msgr2=0x7efd78150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:54.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.914+0000 7efd77fff700 1 --2- 172.21.15.6:0/916282220 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd780cf710 0x7efd78150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:54.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.914+0000 7efd77fff700 1 -- 172.21.15.6:0/916282220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd7815ca70 msgr2=0x7efd7815e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:54.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.914+0000 7efd77fff700 1 --2- 172.21.15.6:0/916282220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd7815ca70 0x7efd7815e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:54.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.914+0000 7efd77fff700 1 -- 172.21.15.6:0/916282220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd70009b30 con 0x7efd78159f50 2023-07-06T19:58:54.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.914+0000 7efd77fff700 1 --2- 172.21.15.6:0/916282220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd78159f50 0x7efd780c4770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efd6400c430 tx=0x7efd6400c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:54.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.915+0000 7efd757fa700 1 -- 172.21.15.6:0/916282220 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd64005ab0 con 0x7efd78159f50 2023-07-06T19:58:54.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.915+0000 7efd757fa700 1 -- 172.21.15.6:0/916282220 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd64005c10 con 0x7efd78159f50 2023-07-06T19:58:54.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.915+0000 7efd7ebcc700 1 -- 172.21.15.6:0/916282220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6c0094a0 con 0x7efd78159f50 2023-07-06T19:58:54.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.915+0000 7efd757fa700 1 -- 172.21.15.6:0/916282220 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd640070d0 con 0x7efd78159f50 2023-07-06T19:58:54.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.915+0000 7efd7ebcc700 1 -- 172.21.15.6:0/916282220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd780b28d0 con 0x7efd78159f50 2023-07-06T19:58:54.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.916+0000 7efd7ebcc700 1 -- 172.21.15.6:0/916282220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd780cb630 con 0x7efd78159f50 2023-07-06T19:58:54.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.916+0000 7efd757fa700 1 -- 172.21.15.6:0/916282220 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efd64007230 con 0x7efd78159f50 2023-07-06T19:58:54.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.917+0000 7efd757fa700 1 --2- 172.21.15.6:0/916282220 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efd5c06ace0 0x7efd5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:54.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.917+0000 7efd757fa700 1 -- 172.21.15.6:0/916282220 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6288+0+0 (secure 0 0 0) 0x7efd640886a0 con 0x7efd78159f50 2023-07-06T19:58:54.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.917+0000 7efd7c968700 1 --2- 172.21.15.6:0/916282220 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efd5c06ace0 0x7efd5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:54.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.917+0000 7efd7c968700 1 --2- 172.21.15.6:0/916282220 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efd5c06ace0 0x7efd5c06d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efd6c000c00 tx=0x7efd6c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:54.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:54.922+0000 7efd757fa700 1 -- 172.21.15.6:0/916282220 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efd640537b0 con 0x7efd78159f50 2023-07-06T19:58:55.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:55.120+0000 7efd7ebcc700 1 -- 172.21.15.6:0/916282220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efd780ceaf0 con 0x7efd78159f50 2023-07-06T19:58:56.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.762+0000 7efd757fa700 1 -- 172.21.15.6:0/916282220 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) v1 ==== 228+0+0 (secure 0 0 0) 0x7efd64056dd0 con 0x7efd78159f50 2023-07-06T19:58:56.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.769+0000 7efd7ebcc700 1 -- 172.21.15.6:0/916282220 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efd5c06ace0 msgr2=0x7efd5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:56.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.769+0000 7efd7ebcc700 1 --2- 172.21.15.6:0/916282220 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efd5c06ace0 0x7efd5c06d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efd6c000c00 tx=0x7efd6c008030 comp rx=0 tx=0).stop 2023-07-06T19:58:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.769+0000 7efd7ebcc700 1 -- 172.21.15.6:0/916282220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd78159f50 msgr2=0x7efd780c4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.769+0000 7efd7ebcc700 1 --2- 172.21.15.6:0/916282220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd78159f50 0x7efd780c4770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efd6400c430 tx=0x7efd6400c740 comp rx=0 tx=0).stop 2023-07-06T19:58:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.770+0000 7efd7ebcc700 1 -- 172.21.15.6:0/916282220 shutdown_connections 2023-07-06T19:58:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.770+0000 7efd7ebcc700 1 --2- 172.21.15.6:0/916282220 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efd5c06ace0 0x7efd5c06d190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:56.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.770+0000 7efd7ebcc700 1 --2- 172.21.15.6:0/916282220 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efd7815ca70 0x7efd7815e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:56.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.770+0000 7efd7ebcc700 1 --2- 172.21.15.6:0/916282220 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efd780cf710 0x7efd78150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:56.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.770+0000 7efd7ebcc700 1 --2- 172.21.15.6:0/916282220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd78159f50 0x7efd780c4770 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:56.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.770+0000 7efd7ebcc700 1 -- 172.21.15.6:0/916282220 >> 172.21.15.6:0/916282220 conn(0x7efd780b0c40 msgr2=0x7efd781594b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:56.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.771+0000 7efd7ebcc700 1 -- 172.21.15.6:0/916282220 shutdown_connections 2023-07-06T19:58:56.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.771+0000 7efd7ebcc700 1 -- 172.21.15.6:0/916282220 wait complete. 2023-07-06T19:58:56.776 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data_ec' created 2023-07-06T19:58:56.790 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-07-06T19:58:56.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.926+0000 7f538f468700 1 Processor -- start 2023-07-06T19:58:56.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.926+0000 7f538f468700 1 -- start start 2023-07-06T19:58:56.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.927+0000 7f538f468700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5388071da0 0x7f53880aee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:56.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.927+0000 7f538f468700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f538806ad40 0x7f538815ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:56.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.927+0000 7f538f468700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5388160660 con 0x7f538815c2c0 2023-07-06T19:58:56.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.927+0000 7f538f468700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5388160940 con 0x7f5388071da0 2023-07-06T19:58:56.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.927+0000 7f538f468700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5388160c20 con 0x7f538806ad40 2023-07-06T19:58:56.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.927+0000 7f538ca03700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5388071da0 0x7f53880aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:56.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.927+0000 7f538ca03700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5388071da0 0x7f53880aee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:37388/0 (socket says 172.21.15.6:37388) 2023-07-06T19:58:56.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.927+0000 7f538ca03700 1 -- 172.21.15.6:0/897503923 learned_addr learned my addr 172.21.15.6:0/897503923 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:56.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.927+0000 7f538da05700 1 --2- 172.21.15.6:0/897503923 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f538806ad40 0x7f538815ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:56.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.928+0000 7f537ffff700 1 -- 172.21.15.6:0/897503923 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078262449 0 0) 0x7f5388160660 con 0x7f538815c2c0 2023-07-06T19:58:56.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.928+0000 7f537ffff700 1 -- 172.21.15.6:0/897503923 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53740035b0 con 0x7f538815c2c0 2023-07-06T19:58:56.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.928+0000 7f538ca03700 1 -- 172.21.15.6:0/897503923 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f538806ad40 msgr2=0x7f538815ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:56.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.928+0000 7f538ca03700 1 --2- 172.21.15.6:0/897503923 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f538806ad40 0x7f538815ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:56.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.928+0000 7f538ca03700 1 -- 172.21.15.6:0/897503923 >> v1:172.21.15.40:6789/0 conn(0x7f538815c2c0 legacy=0x7f5388071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:56.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.928+0000 7f538ca03700 1 -- 172.21.15.6:0/897503923 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53880cdca0 con 0x7f5388071da0 2023-07-06T19:58:56.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.928+0000 7f538da05700 1 --2- 172.21.15.6:0/897503923 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f538806ad40 0x7f538815ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:58:56.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.928+0000 7f538ca03700 1 --2- 172.21.15.6:0/897503923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5388071da0 0x7f53880aee50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f53840098f0 tx=0x7f5384009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa20360328f5e190 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:56.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.928+0000 7f537ffff700 1 -- 172.21.15.6:0/897503923 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5384011830 con 0x7f5388071da0 2023-07-06T19:58:56.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.928+0000 7f537ffff700 1 -- 172.21.15.6:0/897503923 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5384011990 con 0x7f5388071da0 2023-07-06T19:58:56.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.928+0000 7f537ffff700 1 -- 172.21.15.6:0/897503923 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5384011d20 con 0x7f5388071da0 2023-07-06T19:58:56.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.929+0000 7f538f468700 1 -- 172.21.15.6:0/897503923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5388071da0 msgr2=0x7f53880aee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:56.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.929+0000 7f538f468700 1 --2- 172.21.15.6:0/897503923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5388071da0 0x7f53880aee50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f53840098f0 tx=0x7f5384009c00 comp rx=0 tx=0).stop 2023-07-06T19:58:56.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.929+0000 7f538f468700 1 -- 172.21.15.6:0/897503923 shutdown_connections 2023-07-06T19:58:56.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.929+0000 7f538f468700 1 --2- 172.21.15.6:0/897503923 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f538806ad40 0x7f538815ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:56.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.929+0000 7f538f468700 1 --2- 172.21.15.6:0/897503923 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5388071da0 0x7f53880aee50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:56.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.929+0000 7f538f468700 1 -- 172.21.15.6:0/897503923 >> 172.21.15.6:0/897503923 conn(0x7f53880cf940 msgr2=0x7f53880cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:56.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.929+0000 7f538f468700 1 -- 172.21.15.6:0/897503923 shutdown_connections 2023-07-06T19:58:56.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.929+0000 7f538f468700 1 -- 172.21.15.6:0/897503923 wait complete. 2023-07-06T19:58:56.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.930+0000 7f538f468700 1 Processor -- start 2023-07-06T19:58:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.930+0000 7f538f468700 1 -- start start 2023-07-06T19:58:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.931+0000 7f538f468700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f538806ad40 0x7f538815b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.931+0000 7f538f468700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5388071da0 0x7f53881e6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.931+0000 7f538f468700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f538815c2c0 0x7f538815e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.931+0000 7f538f468700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53881e7000 con 0x7f5388071da0 2023-07-06T19:58:56.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.931+0000 7f538f468700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53881e72e0 con 0x7f538815c2c0 2023-07-06T19:58:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.931+0000 7f538f468700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53881e75c0 con 0x7f538806ad40 2023-07-06T19:58:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.931+0000 7f538ca03700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5388071da0 0x7f53881e6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.931+0000 7f538ca03700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5388071da0 0x7f53881e6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58358/0 (socket says 172.21.15.6:58358) 2023-07-06T19:58:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.931+0000 7f538ca03700 1 -- 172.21.15.6:0/330961527 learned_addr learned my addr 172.21.15.6:0/330961527 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:56.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.931+0000 7f538d204700 1 --2- 172.21.15.6:0/330961527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f538806ad40 0x7f538815b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:56.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.931+0000 7f538da05700 1 --2- 172.21.15.6:0/330961527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f538815c2c0 0x7f538815e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:56.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.931+0000 7f538ca03700 1 -- 172.21.15.6:0/330961527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f538806ad40 msgr2=0x7f538815b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:56.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.931+0000 7f538ca03700 1 --2- 172.21.15.6:0/330961527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f538806ad40 0x7f538815b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:56.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.931+0000 7f538ca03700 1 -- 172.21.15.6:0/330961527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f538815c2c0 msgr2=0x7f538815e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:56.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.931+0000 7f538ca03700 1 --2- 172.21.15.6:0/330961527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f538815c2c0 0x7f538815e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:56.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.931+0000 7f538ca03700 1 -- 172.21.15.6:0/330961527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5380009a70 con 0x7f5388071da0 2023-07-06T19:58:56.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.931+0000 7f538ca03700 1 --2- 172.21.15.6:0/330961527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5388071da0 0x7f53881e6780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5384000c00 tx=0x7f5384004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:56.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.932+0000 7f537dffb700 1 -- 172.21.15.6:0/330961527 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53840042c0 con 0x7f5388071da0 2023-07-06T19:58:56.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.932+0000 7f537dffb700 1 -- 172.21.15.6:0/330961527 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538401f070 con 0x7f5388071da0 2023-07-06T19:58:56.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.932+0000 7f538f468700 1 -- 172.21.15.6:0/330961527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5384009550 con 0x7f5388071da0 2023-07-06T19:58:56.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.932+0000 7f537dffb700 1 -- 172.21.15.6:0/330961527 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53840036a0 con 0x7f5388071da0 2023-07-06T19:58:56.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.932+0000 7f538f468700 1 -- 172.21.15.6:0/330961527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53880c7570 con 0x7f5388071da0 2023-07-06T19:58:56.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.933+0000 7f538f468700 1 -- 172.21.15.6:0/330961527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5388074200 con 0x7f5388071da0 2023-07-06T19:58:56.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.934+0000 7f537dffb700 1 -- 172.21.15.6:0/330961527 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5384021030 con 0x7f5388071da0 2023-07-06T19:58:56.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.934+0000 7f537dffb700 1 --2- 172.21.15.6:0/330961527 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f536c06ace0 0x7f536c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:56.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.934+0000 7f537dffb700 1 -- 172.21.15.6:0/330961527 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f538408a9d0 con 0x7f5388071da0 2023-07-06T19:58:56.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.934+0000 7f538d204700 1 --2- 172.21.15.6:0/330961527 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f536c06ace0 0x7f536c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:56.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.934+0000 7f538d204700 1 --2- 172.21.15.6:0/330961527 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f536c06ace0 0x7f536c06d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f53780011e0 tx=0x7f5378009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:56.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:56.939+0000 7f537dffb700 1 -- 172.21.15.6:0/330961527 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5384055960 con 0x7f5388071da0 2023-07-06T19:58:57.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.138+0000 7f538f468700 1 -- 172.21.15.6:0/330961527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f53880cd900 con 0x7f5388071da0 2023-07-06T19:58:57.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.766+0000 7f537dffb700 1 -- 172.21.15.6:0/330961527 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5384058f80 con 0x7f5388071da0 2023-07-06T19:58:57.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.777+0000 7f538f468700 1 -- 172.21.15.6:0/330961527 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f536c06ace0 msgr2=0x7f536c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:57.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.777+0000 7f538f468700 1 --2- 172.21.15.6:0/330961527 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f536c06ace0 0x7f536c06d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f53780011e0 tx=0x7f5378009040 comp rx=0 tx=0).stop 2023-07-06T19:58:57.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.777+0000 7f538f468700 1 -- 172.21.15.6:0/330961527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5388071da0 msgr2=0x7f53881e6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:57.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.777+0000 7f538f468700 1 --2- 172.21.15.6:0/330961527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5388071da0 0x7f53881e6780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5384000c00 tx=0x7f5384004750 comp rx=0 tx=0).stop 2023-07-06T19:58:57.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.787+0000 7f538f468700 1 -- 172.21.15.6:0/330961527 shutdown_connections 2023-07-06T19:58:57.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.787+0000 7f538f468700 1 --2- 172.21.15.6:0/330961527 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f536c06ace0 0x7f536c06d190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:57.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.787+0000 7f538f468700 1 --2- 172.21.15.6:0/330961527 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f538815c2c0 0x7f538815e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:57.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.787+0000 7f538f468700 1 --2- 172.21.15.6:0/330961527 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f538806ad40 0x7f538815b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:57.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.787+0000 7f538f468700 1 --2- 172.21.15.6:0/330961527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5388071da0 0x7f53881e6780 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:57.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.787+0000 7f538f468700 1 -- 172.21.15.6:0/330961527 >> 172.21.15.6:0/330961527 conn(0x7f53880cf940 msgr2=0x7f53880b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:57.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.791+0000 7f538f468700 1 -- 172.21.15.6:0/330961527 shutdown_connections 2023-07-06T19:58:57.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.791+0000 7f538f468700 1 -- 172.21.15.6:0/330961527 wait complete. 2023-07-06T19:58:57.797 INFO:teuthology.orchestra.run.smithi006.stderr:set pool 5 allow_ec_overwrites to true 2023-07-06T19:58:57.811 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-07-06T19:58:57.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.942+0000 7fa4df8f9700 1 Processor -- start 2023-07-06T19:58:57.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.942+0000 7fa4df8f9700 1 -- start start 2023-07-06T19:58:57.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.943+0000 7fa4df8f9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa4d80b0040 0x7fa4d806f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:57.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.943+0000 7fa4df8f9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4d815def0 0x7fa4d815e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:57.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.943+0000 7fa4df8f9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa4d80b38a0 0x7fa4d80b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:57.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.943+0000 7fa4df8f9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d815e8a0 con 0x7fa4d80b0040 2023-07-06T19:58:57.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.943+0000 7fa4df8f9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d815a830 con 0x7fa4d80b38a0 2023-07-06T19:58:57.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.943+0000 7fa4df8f9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d806e620 con 0x7fa4d815def0 2023-07-06T19:58:57.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.943+0000 7fa4dd695700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa4d80b0040 0x7fa4d806f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:57.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.943+0000 7fa4dd695700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa4d80b0040 0x7fa4d806f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58364/0 (socket says 172.21.15.6:58364) 2023-07-06T19:58:57.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.943+0000 7fa4dd695700 1 -- 172.21.15.6:0/2473206659 learned_addr learned my addr 172.21.15.6:0/2473206659 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.944+0000 7fa4dde96700 1 --2- 172.21.15.6:0/2473206659 >> v2:172.21.15.40:3300/0 conn(0x7fa4d80b38a0 0x7fa4d80b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.944+0000 7fa4dce94700 1 --2- 172.21.15.6:0/2473206659 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4d815def0 0x7fa4d815e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.944+0000 7fa4dd695700 1 -- 172.21.15.6:0/2473206659 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4d815def0 msgr2=0x7fa4d815e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.944+0000 7fa4dd695700 1 --2- 172.21.15.6:0/2473206659 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4d815def0 0x7fa4d815e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.944+0000 7fa4dd695700 1 -- 172.21.15.6:0/2473206659 >> v2:172.21.15.40:3300/0 conn(0x7fa4d80b38a0 msgr2=0x7fa4d80b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:58:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.944+0000 7fa4dd695700 1 --2- 172.21.15.6:0/2473206659 >> v2:172.21.15.40:3300/0 conn(0x7fa4d80b38a0 0x7fa4d80b3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.944+0000 7fa4dd695700 1 -- 172.21.15.6:0/2473206659 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d80cb3f0 con 0x7fa4d80b0040 2023-07-06T19:58:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.944+0000 7fa4dde96700 1 --2- 172.21.15.6:0/2473206659 >> v2:172.21.15.40:3300/0 conn(0x7fa4d80b38a0 0x7fa4d80b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:58:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.944+0000 7fa4dce94700 1 --2- 172.21.15.6:0/2473206659 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4d815def0 0x7fa4d815e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:58:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.944+0000 7fa4dd695700 1 --2- 172.21.15.6:0/2473206659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d80b0040 0x7fa4d806f070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa4d815de30 tx=0x7fa4c8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f36a8755e3366e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.944+0000 7fa4cffff700 1 -- 172.21.15.6:0/2473206659 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c800b870 con 0x7fa4d80b0040 2023-07-06T19:58:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.944+0000 7fa4cffff700 1 -- 172.21.15.6:0/2473206659 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c800b9d0 con 0x7fa4d80b0040 2023-07-06T19:58:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.944+0000 7fa4cffff700 1 -- 172.21.15.6:0/2473206659 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c800bd60 con 0x7fa4d80b0040 2023-07-06T19:58:57.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.944+0000 7fa4df8f9700 1 -- 172.21.15.6:0/2473206659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d80b0040 msgr2=0x7fa4d806f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:57.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.944+0000 7fa4df8f9700 1 --2- 172.21.15.6:0/2473206659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d80b0040 0x7fa4d806f070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa4d815de30 tx=0x7fa4c8009bd0 comp rx=0 tx=0).stop 2023-07-06T19:58:57.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.945+0000 7fa4df8f9700 1 -- 172.21.15.6:0/2473206659 shutdown_connections 2023-07-06T19:58:57.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.945+0000 7fa4df8f9700 1 --2- 172.21.15.6:0/2473206659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d80b0040 0x7fa4d806f070 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:57.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.945+0000 7fa4df8f9700 1 --2- 172.21.15.6:0/2473206659 >> v2:172.21.15.40:3300/0 conn(0x7fa4d80b38a0 0x7fa4d80b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:57.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.945+0000 7fa4df8f9700 1 --2- 172.21.15.6:0/2473206659 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4d815def0 0x7fa4d815e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:57.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.945+0000 7fa4df8f9700 1 -- 172.21.15.6:0/2473206659 >> 172.21.15.6:0/2473206659 conn(0x7fa4d80ce160 msgr2=0x7fa4d80d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:57.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.945+0000 7fa4df8f9700 1 -- 172.21.15.6:0/2473206659 shutdown_connections 2023-07-06T19:58:57.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.945+0000 7fa4df8f9700 1 -- 172.21.15.6:0/2473206659 wait complete. 2023-07-06T19:58:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.946+0000 7fa4df8f9700 1 Processor -- start 2023-07-06T19:58:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.946+0000 7fa4df8f9700 1 -- start start 2023-07-06T19:58:57.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.947+0000 7fa4df8f9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4d80b0040 0x7fa4d815a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:57.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.947+0000 7fa4df8f9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d80b38a0 0x7fa4d815d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:57.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.947+0000 7fa4df8f9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4d815def0 0x7fa4d81f3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:57.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.947+0000 7fa4df8f9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d815bea0 con 0x7fa4d80b38a0 2023-07-06T19:58:57.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.947+0000 7fa4df8f9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d815b220 con 0x7fa4d815def0 2023-07-06T19:58:57.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.947+0000 7fa4df8f9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d815b500 con 0x7fa4d80b0040 2023-07-06T19:58:57.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.947+0000 7fa4dce94700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d80b38a0 0x7fa4d815d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:57.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.947+0000 7fa4dce94700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d80b38a0 0x7fa4d815d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58372/0 (socket says 172.21.15.6:58372) 2023-07-06T19:58:57.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.947+0000 7fa4dce94700 1 -- 172.21.15.6:0/4117555152 learned_addr learned my addr 172.21.15.6:0/4117555152 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:57.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.947+0000 7fa4dde96700 1 --2- 172.21.15.6:0/4117555152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4d815def0 0x7fa4d81f3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:57.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.947+0000 7fa4dd695700 1 --2- 172.21.15.6:0/4117555152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4d80b0040 0x7fa4d815a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:57.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.947+0000 7fa4dce94700 1 -- 172.21.15.6:0/4117555152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4d80b0040 msgr2=0x7fa4d815a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:57.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.947+0000 7fa4dce94700 1 --2- 172.21.15.6:0/4117555152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4d80b0040 0x7fa4d815a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:57.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.947+0000 7fa4dce94700 1 -- 172.21.15.6:0/4117555152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4d815def0 msgr2=0x7fa4d81f3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:57.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.947+0000 7fa4dce94700 1 --2- 172.21.15.6:0/4117555152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4d815def0 0x7fa4d81f3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:57.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.947+0000 7fa4dce94700 1 -- 172.21.15.6:0/4117555152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c8009550 con 0x7fa4d80b38a0 2023-07-06T19:58:57.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.947+0000 7fa4dde96700 1 --2- 172.21.15.6:0/4117555152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4d815def0 0x7fa4d81f3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:58:57.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.947+0000 7fa4dd695700 1 --2- 172.21.15.6:0/4117555152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4d80b0040 0x7fa4d815a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:58:57.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.947+0000 7fa4dce94700 1 --2- 172.21.15.6:0/4117555152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d80b38a0 0x7fa4d815d0c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400c7f0 tx=0x7fa4d400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:57.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.947+0000 7fa4cdffb700 1 -- 172.21.15.6:0/4117555152 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d4011800 con 0x7fa4d80b38a0 2023-07-06T19:58:57.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.947+0000 7fa4cdffb700 1 -- 172.21.15.6:0/4117555152 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d4011960 con 0x7fa4d80b38a0 2023-07-06T19:58:57.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.947+0000 7fa4cdffb700 1 -- 172.21.15.6:0/4117555152 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d4011d10 con 0x7fa4d80b38a0 2023-07-06T19:58:57.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.947+0000 7fa4df8f9700 1 -- 172.21.15.6:0/4117555152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d815b7e0 con 0x7fa4d80b38a0 2023-07-06T19:58:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.948+0000 7fa4df8f9700 1 -- 172.21.15.6:0/4117555152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d815af10 con 0x7fa4d80b38a0 2023-07-06T19:58:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.948+0000 7fa4df8f9700 1 -- 172.21.15.6:0/4117555152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d806e850 con 0x7fa4d80b38a0 2023-07-06T19:58:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.949+0000 7fa4cdffb700 1 -- 172.21.15.6:0/4117555152 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa4d4018360 con 0x7fa4d80b38a0 2023-07-06T19:58:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.949+0000 7fa4cdffb700 1 --2- 172.21.15.6:0/4117555152 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa4bc06ace0 0x7fa4bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.949+0000 7fa4cdffb700 1 -- 172.21.15.6:0/4117555152 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fa4d40896a0 con 0x7fa4d80b38a0 2023-07-06T19:58:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.949+0000 7fa4dd695700 1 --2- 172.21.15.6:0/4117555152 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa4bc06ace0 0x7fa4bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.950+0000 7fa4dd695700 1 --2- 172.21.15.6:0/4117555152 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa4bc06ace0 0x7fa4bc06d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009130 tx=0x7fa4c8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:57.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:57.954+0000 7fa4cdffb700 1 -- 172.21.15.6:0/4117555152 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa4d806e850 con 0x7fa4d80b38a0 2023-07-06T19:58:58.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.200+0000 7fa4df8f9700 1 -- 172.21.15.6:0/4117555152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fa4d815bfe0 con 0x7fa4d80b38a0 2023-07-06T19:58:58.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.785+0000 7fa4cdffb700 1 -- 172.21.15.6:0/4117555152 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fa4d815bfe0 con 0x7fa4d80b38a0 2023-07-06T19:58:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.788+0000 7fa4df8f9700 1 -- 172.21.15.6:0/4117555152 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa4bc06ace0 msgr2=0x7fa4bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.788+0000 7fa4df8f9700 1 --2- 172.21.15.6:0/4117555152 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa4bc06ace0 0x7fa4bc06d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009130 tx=0x7fa4c8008030 comp rx=0 tx=0).stop 2023-07-06T19:58:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.788+0000 7fa4df8f9700 1 -- 172.21.15.6:0/4117555152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d80b38a0 msgr2=0x7fa4d815d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.788+0000 7fa4df8f9700 1 --2- 172.21.15.6:0/4117555152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d80b38a0 0x7fa4d815d0c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa4d400c7f0 tx=0x7fa4d400cbb0 comp rx=0 tx=0).stop 2023-07-06T19:58:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.789+0000 7fa4df8f9700 1 -- 172.21.15.6:0/4117555152 shutdown_connections 2023-07-06T19:58:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.789+0000 7fa4df8f9700 1 --2- 172.21.15.6:0/4117555152 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa4bc06ace0 0x7fa4bc06d190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.789+0000 7fa4df8f9700 1 --2- 172.21.15.6:0/4117555152 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4d815def0 0x7fa4d81f3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.789+0000 7fa4df8f9700 1 --2- 172.21.15.6:0/4117555152 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa4d80b0040 0x7fa4d815a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.789+0000 7fa4df8f9700 1 --2- 172.21.15.6:0/4117555152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4d80b38a0 0x7fa4d815d0c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.789+0000 7fa4df8f9700 1 -- 172.21.15.6:0/4117555152 >> 172.21.15.6:0/4117555152 conn(0x7fa4d80ce160 msgr2=0x7fa4d80b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.789+0000 7fa4df8f9700 1 -- 172.21.15.6:0/4117555152 shutdown_connections 2023-07-06T19:58:58.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.789+0000 7fa4df8f9700 1 -- 172.21.15.6:0/4117555152 wait complete. 2023-07-06T19:58:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:added data pool 5 to fsmap 2023-07-06T19:58:58.806 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T19:58:58.845 INFO:tasks.ceph.mds.c.smithi006.stderr:2023-07-06T19:58:58.843+0000 7fab31c33700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-06T19:58:58.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.938+0000 7f64d045a700 1 Processor -- start 2023-07-06T19:58:58.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.938+0000 7f64d045a700 1 -- start start 2023-07-06T19:58:58.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.938+0000 7f64d045a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f64c80cd270 0x7f64c80cf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:58.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.939+0000 7f64d045a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c80cd6f0 con 0x7f64c80d2060 2023-07-06T19:58:58.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.939+0000 7f64d045a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c80cd950 con 0x7f64c806bdb0 2023-07-06T19:58:58.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.939+0000 7f64d045a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c80d12a0 con 0x7f64c80cd270 2023-07-06T19:58:58.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.939+0000 7f64ce9f7700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f64c80d2060 0x7f64c80b5a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59590/0 (socket says 172.21.15.6:59590) 2023-07-06T19:58:58.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.939+0000 7f64ce9f7700 1 -- 172.21.15.6:0/1259596604 learned_addr learned my addr 172.21.15.6:0/1259596604 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:58:58.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.939+0000 7f64cd9f5700 1 --2- 172.21.15.6:0/1259596604 >> v2:172.21.15.40:3300/0 conn(0x7f64c80cd270 0x7f64c80cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:58.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.939+0000 7f64cd1f4700 1 -- 172.21.15.6:0/1259596604 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399478286 0 0) 0x7f64c80cd6f0 con 0x7f64c80d2060 2023-07-06T19:58:58.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.939+0000 7f64cd1f4700 1 -- 172.21.15.6:0/1259596604 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64b40035b0 con 0x7f64c80d2060 2023-07-06T19:58:58.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.939+0000 7f64cd9f5700 1 -- 172.21.15.6:0/1259596604 >> v1:172.21.15.40:6789/0 conn(0x7f64c806bdb0 legacy=0x7f64c806c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:58.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.939+0000 7f64cd9f5700 1 -- 172.21.15.6:0/1259596604 >> v1:172.21.15.6:6789/0 conn(0x7f64c80d2060 legacy=0x7f64c80b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:58.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.939+0000 7f64cd9f5700 1 -- 172.21.15.6:0/1259596604 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c80d1580 con 0x7f64c80cd270 2023-07-06T19:58:58.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.939+0000 7f64cd9f5700 1 --2- 172.21.15.6:0/1259596604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64c80cd270 0x7f64c80cf050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009840 tx=0x7f64b8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46cf022ae5f3f0a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:58.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.940+0000 7f64cd1f4700 1 -- 172.21.15.6:0/1259596604 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8011830 con 0x7f64c80cd270 2023-07-06T19:58:58.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.940+0000 7f64cd1f4700 1 -- 172.21.15.6:0/1259596604 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b8011990 con 0x7f64c80cd270 2023-07-06T19:58:58.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.940+0000 7f64cd1f4700 1 -- 172.21.15.6:0/1259596604 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b8011d00 con 0x7f64c80cd270 2023-07-06T19:58:58.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.940+0000 7f64d045a700 1 -- 172.21.15.6:0/1259596604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64c80cd270 msgr2=0x7f64c80cf050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:58.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.940+0000 7f64d045a700 1 --2- 172.21.15.6:0/1259596604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64c80cd270 0x7f64c80cf050 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f64b8009840 tx=0x7f64b8009b50 comp rx=0 tx=0).stop 2023-07-06T19:58:58.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.940+0000 7f64d045a700 1 -- 172.21.15.6:0/1259596604 shutdown_connections 2023-07-06T19:58:58.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.940+0000 7f64d045a700 1 --2- 172.21.15.6:0/1259596604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64c80cd270 0x7f64c80cf050 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:58.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.940+0000 7f64d045a700 1 -- 172.21.15.6:0/1259596604 >> 172.21.15.6:0/1259596604 conn(0x7f64c80d2c20 msgr2=0x7f64c80d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:58.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.940+0000 7f64d045a700 1 -- 172.21.15.6:0/1259596604 shutdown_connections 2023-07-06T19:58:58.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.940+0000 7f64d045a700 1 -- 172.21.15.6:0/1259596604 wait complete. 2023-07-06T19:58:58.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.941+0000 7f64d045a700 1 Processor -- start 2023-07-06T19:58:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.941+0000 7f64d045a700 1 -- start start 2023-07-06T19:58:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.942+0000 7f64d045a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64c806bdb0 0x7f64c8156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.942+0000 7f64d045a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f64c80cd270 0x7f64c80b6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.942+0000 7f64d045a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64c80d2060 0x7f64c80b7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.942+0000 7f64d045a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c8157580 con 0x7f64c80d2060 2023-07-06T19:58:58.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.942+0000 7f64d045a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c80cbef0 con 0x7f64c806bdb0 2023-07-06T19:58:58.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.942+0000 7f64d045a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c80c9e90 con 0x7f64c80cd270 2023-07-06T19:58:58.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.942+0000 7f64ce9f7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64c80d2060 0x7f64c80b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:58.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.942+0000 7f64ce9f7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64c80d2060 0x7f64c80b7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58388/0 (socket says 172.21.15.6:58388) 2023-07-06T19:58:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.942+0000 7f64ce9f7700 1 -- 172.21.15.6:0/526426538 learned_addr learned my addr 172.21.15.6:0/526426538 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.943+0000 7f64ce1f6700 1 --2- 172.21.15.6:0/526426538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64c806bdb0 0x7f64c8156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.943+0000 7f64cd9f5700 1 --2- 172.21.15.6:0/526426538 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f64c80cd270 0x7f64c80b6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.943+0000 7f64ce9f7700 1 -- 172.21.15.6:0/526426538 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f64c80cd270 msgr2=0x7f64c80b6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:58.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.943+0000 7f64ce9f7700 1 --2- 172.21.15.6:0/526426538 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f64c80cd270 0x7f64c80b6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:58.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.943+0000 7f64ce9f7700 1 -- 172.21.15.6:0/526426538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64c806bdb0 msgr2=0x7f64c8156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:58.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.943+0000 7f64ce9f7700 1 --2- 172.21.15.6:0/526426538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64c806bdb0 0x7f64c8156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:58.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.943+0000 7f64ce9f7700 1 -- 172.21.15.6:0/526426538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b80094a0 con 0x7f64c80d2060 2023-07-06T19:58:58.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.943+0000 7f64ce9f7700 1 --2- 172.21.15.6:0/526426538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64c80d2060 0x7f64c80b7460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f64c000caa0 tx=0x7f64c000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:58.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.943+0000 7f64beffd700 1 -- 172.21.15.6:0/526426538 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c000aa80 con 0x7f64c80d2060 2023-07-06T19:58:58.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.943+0000 7f64beffd700 1 -- 172.21.15.6:0/526426538 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c000abe0 con 0x7f64c80d2060 2023-07-06T19:58:58.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.943+0000 7f64d045a700 1 -- 172.21.15.6:0/526426538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c80ca170 con 0x7f64c80d2060 2023-07-06T19:58:58.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.943+0000 7f64beffd700 1 -- 172.21.15.6:0/526426538 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c0012400 con 0x7f64c80d2060 2023-07-06T19:58:58.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.943+0000 7f64d045a700 1 -- 172.21.15.6:0/526426538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c80ca730 con 0x7f64c80d2060 2023-07-06T19:58:58.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.944+0000 7f64d045a700 1 -- 172.21.15.6:0/526426538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c806c570 con 0x7f64c80d2060 2023-07-06T19:58:58.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.944+0000 7f64beffd700 1 -- 172.21.15.6:0/526426538 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f64c001b3b0 con 0x7f64c80d2060 2023-07-06T19:58:58.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.945+0000 7f64beffd700 1 --2- 172.21.15.6:0/526426538 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f64ac06ace0 0x7f64ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:58.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.945+0000 7f64beffd700 1 -- 172.21.15.6:0/526426538 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f64c00894b0 con 0x7f64c80d2060 2023-07-06T19:58:58.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.945+0000 7f64ce1f6700 1 --2- 172.21.15.6:0/526426538 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f64ac06ace0 0x7f64ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:58.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.945+0000 7f64ce1f6700 1 --2- 172.21.15.6:0/526426538 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f64ac06ace0 0x7f64ac06d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f64c4000f60 tx=0x7f64c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:58.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:58.949+0000 7f64beffd700 1 -- 172.21.15.6:0/526426538 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f64c0054300 con 0x7f64c80d2060 2023-07-06T19:58:59.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.194+0000 7f64d045a700 1 -- 172.21.15.6:0/526426538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64c806c290 con 0x7f64c80d2060 2023-07-06T19:58:59.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.194+0000 7f64beffd700 1 -- 172.21.15.6:0/526426538 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4652 (secure 0 0 0) 0x7f64c0057920 con 0x7f64c80d2060 2023-07-06T19:58:59.197 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:58:59.197 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3695014381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3695014381},{"type":"v1","addr":"172.21.15.6:6835","nonce":3695014381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/849399781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":849399781},{"type":"v1","addr":"172.21.15.40:6833","nonce":849399781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/512806705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":512806705},{"type":"v1","addr":"172.21.15.40:6835","nonce":512806705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T19:58:53.158966+0000","modified":"2023-07-06T19:58:58.778273+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/368324315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":368324315},{"type":"v1","addr":"172.21.15.6:6837","nonce":368324315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-06T19:58:59.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.197+0000 7f64d045a700 1 -- 172.21.15.6:0/526426538 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f64ac06ace0 msgr2=0x7f64ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:59.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.197+0000 7f64d045a700 1 --2- 172.21.15.6:0/526426538 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f64ac06ace0 0x7f64ac06d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f64c4000f60 tx=0x7f64c4009040 comp rx=0 tx=0).stop 2023-07-06T19:58:59.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.197+0000 7f64d045a700 1 -- 172.21.15.6:0/526426538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64c80d2060 msgr2=0x7f64c80b7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:59.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.197+0000 7f64d045a700 1 --2- 172.21.15.6:0/526426538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64c80d2060 0x7f64c80b7460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f64c000caa0 tx=0x7f64c000ce60 comp rx=0 tx=0).stop 2023-07-06T19:58:59.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.197+0000 7f64d045a700 1 -- 172.21.15.6:0/526426538 shutdown_connections 2023-07-06T19:58:59.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.197+0000 7f64d045a700 1 --2- 172.21.15.6:0/526426538 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f64ac06ace0 0x7f64ac06d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:59.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.197+0000 7f64d045a700 1 --2- 172.21.15.6:0/526426538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64c80d2060 0x7f64c80b7460 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:59.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.197+0000 7f64d045a700 1 --2- 172.21.15.6:0/526426538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f64c806bdb0 0x7f64c8156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:59.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.197+0000 7f64d045a700 1 --2- 172.21.15.6:0/526426538 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f64c80cd270 0x7f64c80b6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:59.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.197+0000 7f64d045a700 1 -- 172.21.15.6:0/526426538 >> 172.21.15.6:0/526426538 conn(0x7f64c80d2c20 msgr2=0x7f64c815c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:59.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.197+0000 7f64d045a700 1 -- 172.21.15.6:0/526426538 shutdown_connections 2023-07-06T19:58:59.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.197+0000 7f64d045a700 1 -- 172.21.15.6:0/526426538 wait complete. 2023-07-06T19:58:59.201 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 7 2023-07-06T19:58:59.213 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T19:58:59.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.377+0000 7f8c622d5700 1 Processor -- start 2023-07-06T19:58:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.377+0000 7f8c622d5700 1 -- start start 2023-07-06T19:58:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.379+0000 7f8c622d5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c5c13f3f0 0x7f8c5c0cab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.379+0000 7f8c622d5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c5c143c90 con 0x7f8c5c0cb9a0 2023-07-06T19:58:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.379+0000 7f8c622d5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c5c13fc80 con 0x7f8c5c13f7c0 2023-07-06T19:58:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.379+0000 7f8c622d5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c5c13ff60 con 0x7f8c5c13f3f0 2023-07-06T19:58:59.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.379+0000 7f8c5bfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8c5c13f3f0 0x7f8c5c0cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:59.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.379+0000 7f8c60872700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8c5c0cb9a0 0x7f8c5c0cd170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59604/0 (socket says 172.21.15.6:59604) 2023-07-06T19:58:59.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.379+0000 7f8c60872700 1 -- 172.21.15.6:0/273537979 learned_addr learned my addr 172.21.15.6:0/273537979 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:58:59.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.379+0000 7f8c5bfff700 1 -- 172.21.15.6:0/273537979 >> v1:172.21.15.40:6789/0 conn(0x7f8c5c13f7c0 legacy=0x7f8c5c0cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:59.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.379+0000 7f8c5bfff700 1 -- 172.21.15.6:0/273537979 >> v1:172.21.15.6:6789/0 conn(0x7f8c5c0cb9a0 legacy=0x7f8c5c0cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:59.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.379+0000 7f8c5affd700 1 -- 172.21.15.6:0/273537979 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231189535 0 0) 0x7f8c5c143c90 con 0x7f8c5c0cb9a0 2023-07-06T19:58:59.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.379+0000 7f8c5bfff700 1 -- 172.21.15.6:0/273537979 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c140240 con 0x7f8c5c13f3f0 2023-07-06T19:58:59.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.379+0000 7f8c5bfff700 1 --2- 172.21.15.6:0/273537979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c13f3f0 0x7f8c5c0cab30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c009840 tx=0x7f8c4c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0e7c74fbe01565f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:59.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.379+0000 7f8c5affd700 1 -- 172.21.15.6:0/273537979 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c011830 con 0x7f8c5c13f3f0 2023-07-06T19:58:59.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.379+0000 7f8c5affd700 1 -- 172.21.15.6:0/273537979 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4c011990 con 0x7f8c5c13f3f0 2023-07-06T19:58:59.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.380+0000 7f8c5affd700 1 -- 172.21.15.6:0/273537979 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4c011d20 con 0x7f8c5c13f3f0 2023-07-06T19:58:59.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.380+0000 7f8c622d5700 1 -- 172.21.15.6:0/273537979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c13f3f0 msgr2=0x7f8c5c0cab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:59.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.380+0000 7f8c622d5700 1 --2- 172.21.15.6:0/273537979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c13f3f0 0x7f8c5c0cab30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c009840 tx=0x7f8c4c009b50 comp rx=0 tx=0).stop 2023-07-06T19:58:59.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.380+0000 7f8c622d5700 1 -- 172.21.15.6:0/273537979 shutdown_connections 2023-07-06T19:58:59.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.380+0000 7f8c622d5700 1 --2- 172.21.15.6:0/273537979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c13f3f0 0x7f8c5c0cab30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:59.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.380+0000 7f8c622d5700 1 -- 172.21.15.6:0/273537979 >> 172.21.15.6:0/273537979 conn(0x7f8c5c0b05b0 msgr2=0x7f8c5c0b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:59.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.380+0000 7f8c622d5700 1 -- 172.21.15.6:0/273537979 shutdown_connections 2023-07-06T19:58:59.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.380+0000 7f8c622d5700 1 -- 172.21.15.6:0/273537979 wait complete. 2023-07-06T19:58:59.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.381+0000 7f8c622d5700 1 Processor -- start 2023-07-06T19:58:59.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.382+0000 7f8c622d5700 1 -- start start 2023-07-06T19:58:59.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.382+0000 7f8c622d5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c5c0cb9a0 0x7f8c5c153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:59.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.382+0000 7f8c622d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c13f3f0 0x7f8c5c154040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:59.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.382+0000 7f8c622d5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c5c13f7c0 0x7f8c5c06d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:59.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.382+0000 7f8c622d5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c15a830 con 0x7f8c5c13f3f0 2023-07-06T19:58:59.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.382+0000 7f8c622d5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c15ab10 con 0x7f8c5c13f7c0 2023-07-06T19:58:59.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.382+0000 7f8c622d5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5c15adf0 con 0x7f8c5c0cb9a0 2023-07-06T19:58:59.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.382+0000 7f8c5b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c13f3f0 0x7f8c5c154040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:59.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.382+0000 7f8c5b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c13f3f0 0x7f8c5c154040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58400/0 (socket says 172.21.15.6:58400) 2023-07-06T19:58:59.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.382+0000 7f8c5b7fe700 1 -- 172.21.15.6:0/378813384 learned_addr learned my addr 172.21.15.6:0/378813384 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:59.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.383+0000 7f8c60872700 1 --2- 172.21.15.6:0/378813384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c5c13f7c0 0x7f8c5c06d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:59.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.383+0000 7f8c5b7fe700 1 -- 172.21.15.6:0/378813384 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c5c0cb9a0 msgr2=0x7f8c5c153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:59.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.383+0000 7f8c5b7fe700 1 --2- 172.21.15.6:0/378813384 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c5c0cb9a0 0x7f8c5c153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:59.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.383+0000 7f8c5b7fe700 1 -- 172.21.15.6:0/378813384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c5c13f7c0 msgr2=0x7f8c5c06d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:59.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.383+0000 7f8c5b7fe700 1 --2- 172.21.15.6:0/378813384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c5c13f7c0 0x7f8c5c06d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:59.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.383+0000 7f8c5b7fe700 1 -- 172.21.15.6:0/378813384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4c0094a0 con 0x7f8c5c13f3f0 2023-07-06T19:58:59.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.383+0000 7f8c60872700 1 --2- 172.21.15.6:0/378813384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c5c13f7c0 0x7f8c5c06d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:58:59.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.383+0000 7f8c5b7fe700 1 --2- 172.21.15.6:0/378813384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c13f3f0 0x7f8c5c154040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400cba0 tx=0x7f8c5400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:59.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.383+0000 7f8c58ff9700 1 -- 172.21.15.6:0/378813384 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c54003c00 con 0x7f8c5c13f3f0 2023-07-06T19:58:59.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.383+0000 7f8c58ff9700 1 -- 172.21.15.6:0/378813384 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c54003d60 con 0x7f8c5c13f3f0 2023-07-06T19:58:59.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.383+0000 7f8c622d5700 1 -- 172.21.15.6:0/378813384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c5c15b0d0 con 0x7f8c5c13f3f0 2023-07-06T19:58:59.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.383+0000 7f8c58ff9700 1 -- 172.21.15.6:0/378813384 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5400abc0 con 0x7f8c5c13f3f0 2023-07-06T19:58:59.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.383+0000 7f8c622d5700 1 -- 172.21.15.6:0/378813384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c5c159f30 con 0x7f8c5c13f3f0 2023-07-06T19:58:59.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.384+0000 7f8c622d5700 1 -- 172.21.15.6:0/378813384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c5c15c140 con 0x7f8c5c13f3f0 2023-07-06T19:58:59.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.385+0000 7f8c58ff9700 1 -- 172.21.15.6:0/378813384 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8c5400ad20 con 0x7f8c5c13f3f0 2023-07-06T19:58:59.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.385+0000 7f8c58ff9700 1 --2- 172.21.15.6:0/378813384 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f8c3c06ace0 0x7f8c3c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:59.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.385+0000 7f8c58ff9700 1 -- 172.21.15.6:0/378813384 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8c54089830 con 0x7f8c5c13f3f0 2023-07-06T19:58:59.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.385+0000 7f8c5bfff700 1 --2- 172.21.15.6:0/378813384 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f8c3c06ace0 0x7f8c3c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:59.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.385+0000 7f8c5bfff700 1 --2- 172.21.15.6:0/378813384 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f8c3c06ace0 0x7f8c3c06d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c0cacb0 tx=0x7f8c4c010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:59.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.390+0000 7f8c58ff9700 1 -- 172.21.15.6:0/378813384 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8c540545f0 con 0x7f8c5c13f3f0 2023-07-06T19:58:59.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.588+0000 7f8c622d5700 1 -- 172.21.15.6:0/378813384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c5c0cb5d0 con 0x7f8c5c13f3f0 2023-07-06T19:58:59.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.590+0000 7f8c58ff9700 1 -- 172.21.15.6:0/378813384 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19964 (secure 0 0 0) 0x7f8c54057c10 con 0x7f8c5c13f3f0 2023-07-06T19:58:59.592 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:58:59.592 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:58:58.202291+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T19:58:51.062712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T19:58:52.130350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T19:58:55.785128+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:58:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.592+0000 7f8c622d5700 1 -- 172.21.15.6:0/378813384 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f8c3c06ace0 msgr2=0x7f8c3c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:59.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.592+0000 7f8c622d5700 1 --2- 172.21.15.6:0/378813384 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f8c3c06ace0 0x7f8c3c06d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c0cacb0 tx=0x7f8c4c010000 comp rx=0 tx=0).stop 2023-07-06T19:58:59.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.592+0000 7f8c622d5700 1 -- 172.21.15.6:0/378813384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c13f3f0 msgr2=0x7f8c5c154040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:59.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.592+0000 7f8c622d5700 1 --2- 172.21.15.6:0/378813384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c13f3f0 0x7f8c5c154040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8c5400cba0 tx=0x7f8c5400cf60 comp rx=0 tx=0).stop 2023-07-06T19:58:59.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.592+0000 7f8c622d5700 1 -- 172.21.15.6:0/378813384 shutdown_connections 2023-07-06T19:58:59.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.592+0000 7f8c622d5700 1 --2- 172.21.15.6:0/378813384 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f8c3c06ace0 0x7f8c3c06d190 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:59.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.592+0000 7f8c622d5700 1 --2- 172.21.15.6:0/378813384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c5c13f7c0 0x7f8c5c06d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:59.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.592+0000 7f8c622d5700 1 --2- 172.21.15.6:0/378813384 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8c5c0cb9a0 0x7f8c5c153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:59.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.592+0000 7f8c622d5700 1 --2- 172.21.15.6:0/378813384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c5c13f3f0 0x7f8c5c154040 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:59.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.592+0000 7f8c622d5700 1 -- 172.21.15.6:0/378813384 >> 172.21.15.6:0/378813384 conn(0x7f8c5c0b05b0 msgr2=0x7f8c5c0aefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:59.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.592+0000 7f8c622d5700 1 -- 172.21.15.6:0/378813384 shutdown_connections 2023-07-06T19:58:59.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.592+0000 7f8c622d5700 1 -- 172.21.15.6:0/378813384 wait complete. 2023-07-06T19:58:59.610 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T19:58:59.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.733+0000 7f60ed744700 1 Processor -- start 2023-07-06T19:58:59.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.733+0000 7f60ed744700 1 -- start start 2023-07-06T19:58:59.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.734+0000 7f60ed744700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f60e8071dd0 0x7f60e80caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:59.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.734+0000 7f60ed744700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e8160ff0 con 0x7f60e80ceab0 2023-07-06T19:58:59.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.734+0000 7f60ed744700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e80ca100 con 0x7f60e80cee80 2023-07-06T19:58:59.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.734+0000 7f60ed744700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e80cb400 con 0x7f60e8071dd0 2023-07-06T19:58:59.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.734+0000 7f60e6ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f60e80ceab0 0x7f60e80716c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59614/0 (socket says 172.21.15.6:59614) 2023-07-06T19:58:59.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.734+0000 7f60e6ffd700 1 -- 172.21.15.6:0/2909298977 learned_addr learned my addr 172.21.15.6:0/2909298977 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:58:59.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.734+0000 7f60e67fc700 1 --2- 172.21.15.6:0/2909298977 >> v2:172.21.15.40:3300/0 conn(0x7f60e8071dd0 0x7f60e80caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:59.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.735+0000 7f60e5ffb700 1 -- 172.21.15.6:0/2909298977 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674588576 0 0) 0x7f60e8160ff0 con 0x7f60e80ceab0 2023-07-06T19:58:59.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.735+0000 7f60e5ffb700 1 -- 172.21.15.6:0/2909298977 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60d00035b0 con 0x7f60e80ceab0 2023-07-06T19:58:59.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.735+0000 7f60e67fc700 1 -- 172.21.15.6:0/2909298977 >> v1:172.21.15.40:6789/0 conn(0x7f60e80cee80 legacy=0x7f60e81602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:59.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.735+0000 7f60e67fc700 1 -- 172.21.15.6:0/2909298977 >> v1:172.21.15.6:6789/0 conn(0x7f60e80ceab0 legacy=0x7f60e80716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:59.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.735+0000 7f60e67fc700 1 -- 172.21.15.6:0/2909298977 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e80ca3e0 con 0x7f60e8071dd0 2023-07-06T19:58:59.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.735+0000 7f60e67fc700 1 --2- 172.21.15.6:0/2909298977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60e8071dd0 0x7f60e80caec0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009840 tx=0x7f60d8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc132016a6f5d9c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:59.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.735+0000 7f60e5ffb700 1 -- 172.21.15.6:0/2909298977 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d8011830 con 0x7f60e8071dd0 2023-07-06T19:58:59.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.735+0000 7f60e5ffb700 1 -- 172.21.15.6:0/2909298977 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60d8011990 con 0x7f60e8071dd0 2023-07-06T19:58:59.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.735+0000 7f60e5ffb700 1 -- 172.21.15.6:0/2909298977 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d8011d20 con 0x7f60e8071dd0 2023-07-06T19:58:59.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.736+0000 7f60ed744700 1 -- 172.21.15.6:0/2909298977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60e8071dd0 msgr2=0x7f60e80caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:59.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.736+0000 7f60ed744700 1 --2- 172.21.15.6:0/2909298977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60e8071dd0 0x7f60e80caec0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009840 tx=0x7f60d8009b50 comp rx=0 tx=0).stop 2023-07-06T19:58:59.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.736+0000 7f60ed744700 1 -- 172.21.15.6:0/2909298977 shutdown_connections 2023-07-06T19:58:59.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.736+0000 7f60ed744700 1 --2- 172.21.15.6:0/2909298977 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60e8071dd0 0x7f60e80caec0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:59.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.736+0000 7f60ed744700 1 -- 172.21.15.6:0/2909298977 >> 172.21.15.6:0/2909298977 conn(0x7f60e80cc420 msgr2=0x7f60e80cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:59.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.736+0000 7f60ed744700 1 -- 172.21.15.6:0/2909298977 shutdown_connections 2023-07-06T19:58:59.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.736+0000 7f60ed744700 1 -- 172.21.15.6:0/2909298977 wait complete. 2023-07-06T19:58:59.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.737+0000 7f60ed744700 1 Processor -- start 2023-07-06T19:58:59.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.737+0000 7f60ed744700 1 -- start start 2023-07-06T19:58:59.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.738+0000 7f60ed744700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e8071dd0 0x7f60e8156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:59.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.738+0000 7f60ed744700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60e80ceab0 0x7f60e81e5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:59.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.738+0000 7f60ed744700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60e80cee80 0x7f60e8144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:59.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.738+0000 7f60ed744700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e81e6620 con 0x7f60e8071dd0 2023-07-06T19:58:59.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.738+0000 7f60ed744700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e81e8e10 con 0x7f60e80cee80 2023-07-06T19:58:59.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.738+0000 7f60ed744700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e81451a0 con 0x7f60e80ceab0 2023-07-06T19:58:59.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.738+0000 7f60e6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e8071dd0 0x7f60e8156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:59.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.739+0000 7f60e6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e8071dd0 0x7f60e8156600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58412/0 (socket says 172.21.15.6:58412) 2023-07-06T19:58:59.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.739+0000 7f60e6ffd700 1 -- 172.21.15.6:0/3315039874 learned_addr learned my addr 172.21.15.6:0/3315039874 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:58:59.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.739+0000 7f60e67fc700 1 --2- 172.21.15.6:0/3315039874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60e80ceab0 0x7f60e81e5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:59.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.739+0000 7f60e77fe700 1 --2- 172.21.15.6:0/3315039874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60e80cee80 0x7f60e8144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:59.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.739+0000 7f60e6ffd700 1 -- 172.21.15.6:0/3315039874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60e80ceab0 msgr2=0x7f60e81e5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:59.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.739+0000 7f60e6ffd700 1 --2- 172.21.15.6:0/3315039874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60e80ceab0 0x7f60e81e5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:59.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.739+0000 7f60e6ffd700 1 -- 172.21.15.6:0/3315039874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60e80cee80 msgr2=0x7f60e8144c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:59.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.739+0000 7f60e6ffd700 1 --2- 172.21.15.6:0/3315039874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60e80cee80 0x7f60e8144c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:59.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.739+0000 7f60e6ffd700 1 -- 172.21.15.6:0/3315039874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d80094a0 con 0x7f60e8071dd0 2023-07-06T19:58:59.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.739+0000 7f60e67fc700 1 --2- 172.21.15.6:0/3315039874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60e80ceab0 0x7f60e81e5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:58:59.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.739+0000 7f60e6ffd700 1 --2- 172.21.15.6:0/3315039874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e8071dd0 0x7f60e8156600 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00c700 tx=0x7f60dc00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:59.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.739+0000 7f60cf7fe700 1 -- 172.21.15.6:0/3315039874 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc005d70 con 0x7f60e8071dd0 2023-07-06T19:58:59.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.739+0000 7f60cf7fe700 1 -- 172.21.15.6:0/3315039874 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc0070d0 con 0x7f60e8071dd0 2023-07-06T19:58:59.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.739+0000 7f60ed744700 1 -- 172.21.15.6:0/3315039874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e81e8850 con 0x7f60e8071dd0 2023-07-06T19:58:59.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.739+0000 7f60cf7fe700 1 -- 172.21.15.6:0/3315039874 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc007460 con 0x7f60e8071dd0 2023-07-06T19:58:59.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.739+0000 7f60ed744700 1 -- 172.21.15.6:0/3315039874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e81e7a10 con 0x7f60e8071dd0 2023-07-06T19:58:59.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.740+0000 7f60ed744700 1 -- 172.21.15.6:0/3315039874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e8153c50 con 0x7f60e8071dd0 2023-07-06T19:58:59.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.740+0000 7f60cf7fe700 1 -- 172.21.15.6:0/3315039874 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f60dc0075c0 con 0x7f60e8071dd0 2023-07-06T19:58:59.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.741+0000 7f60cf7fe700 1 --2- 172.21.15.6:0/3315039874 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f60d406ace0 0x7f60d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:58:59.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.741+0000 7f60cf7fe700 1 -- 172.21.15.6:0/3315039874 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f60dc088d80 con 0x7f60e8071dd0 2023-07-06T19:58:59.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.741+0000 7f60e67fc700 1 --2- 172.21.15.6:0/3315039874 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f60d406ace0 0x7f60d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:58:59.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.741+0000 7f60e67fc700 1 --2- 172.21.15.6:0/3315039874 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f60d406ace0 0x7f60d406d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009840 tx=0x7f60d801c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:58:59.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.745+0000 7f60cf7fe700 1 -- 172.21.15.6:0/3315039874 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f60e8153c50 con 0x7f60e8071dd0 2023-07-06T19:58:59.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.948+0000 7f60ed744700 1 -- 172.21.15.6:0/3315039874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60e8153c50 con 0x7f60e8071dd0 2023-07-06T19:58:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.949+0000 7f60cf7fe700 1 -- 172.21.15.6:0/3315039874 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19964 (secure 0 0 0) 0x7f60e8153c50 con 0x7f60e8071dd0 2023-07-06T19:58:59.953 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:58:59.954 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:58:58.202291+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T19:58:51.062712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T19:58:52.130350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T19:58:55.785128+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:58:59.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.951+0000 7f60ed744700 1 -- 172.21.15.6:0/3315039874 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f60d406ace0 msgr2=0x7f60d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:59.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.951+0000 7f60ed744700 1 --2- 172.21.15.6:0/3315039874 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f60d406ace0 0x7f60d406d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009840 tx=0x7f60d801c040 comp rx=0 tx=0).stop 2023-07-06T19:58:59.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.951+0000 7f60ed744700 1 -- 172.21.15.6:0/3315039874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e8071dd0 msgr2=0x7f60e8156600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:58:59.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.951+0000 7f60ed744700 1 --2- 172.21.15.6:0/3315039874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e8071dd0 0x7f60e8156600 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f60dc00c700 tx=0x7f60dc00cac0 comp rx=0 tx=0).stop 2023-07-06T19:58:59.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.951+0000 7f60ed744700 1 -- 172.21.15.6:0/3315039874 shutdown_connections 2023-07-06T19:58:59.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.951+0000 7f60ed744700 1 --2- 172.21.15.6:0/3315039874 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f60d406ace0 0x7f60d406d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:59.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.951+0000 7f60ed744700 1 --2- 172.21.15.6:0/3315039874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60e8071dd0 0x7f60e8156600 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:59.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.951+0000 7f60ed744700 1 --2- 172.21.15.6:0/3315039874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f60e80cee80 0x7f60e8144c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:59.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.951+0000 7f60ed744700 1 --2- 172.21.15.6:0/3315039874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f60e80ceab0 0x7f60e81e5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:58:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.951+0000 7f60ed744700 1 -- 172.21.15.6:0/3315039874 >> 172.21.15.6:0/3315039874 conn(0x7f60e80cc420 msgr2=0x7f60e80cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:58:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.951+0000 7f60ed744700 1 -- 172.21.15.6:0/3315039874 shutdown_connections 2023-07-06T19:58:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:58:59.951+0000 7f60ed744700 1 -- 172.21.15.6:0/3315039874 wait complete. 2023-07-06T19:59:00.001 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T19:59:00.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.126+0000 7f589e24c700 1 Processor -- start 2023-07-06T19:59:00.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.127+0000 7f589e24c700 1 -- start start 2023-07-06T19:59:00.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.127+0000 7f589e24c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5898071dd0 0x7f58980caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:00.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.127+0000 7f589e24c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5898160ff0 con 0x7f58980cee80 2023-07-06T19:59:00.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.127+0000 7f589e24c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58980ca100 con 0x7f58980ceab0 2023-07-06T19:59:00.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.127+0000 7f589e24c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58980cb400 con 0x7f5898071dd0 2023-07-06T19:59:00.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.127+0000 7f5897fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f58980cee80 0x7f58981602c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59632/0 (socket says 172.21.15.6:59632) 2023-07-06T19:59:00.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.128+0000 7f5897fff700 1 -- 172.21.15.6:0/1411055986 learned_addr learned my addr 172.21.15.6:0/1411055986 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:00.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.128+0000 7f5896ffd700 1 --2- 172.21.15.6:0/1411055986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5898071dd0 0x7f58980caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:00.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.128+0000 7f58967fc700 1 -- 172.21.15.6:0/1411055986 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8448502 0 0) 0x7f5898160ff0 con 0x7f58980cee80 2023-07-06T19:59:00.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.128+0000 7f58967fc700 1 -- 172.21.15.6:0/1411055986 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58840035b0 con 0x7f58980cee80 2023-07-06T19:59:00.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.128+0000 7f58967fc700 1 -- 172.21.15.6:0/1411055986 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1002340314 0 0) 0x7f58840035b0 con 0x7f58980cee80 2023-07-06T19:59:00.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.128+0000 7f58967fc700 1 -- 172.21.15.6:0/1411055986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5898071dd0 msgr2=0x7f58980caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:00.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.128+0000 7f58967fc700 1 --2- 172.21.15.6:0/1411055986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5898071dd0 0x7f58980caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:00.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.128+0000 7f58967fc700 1 -- 172.21.15.6:0/1411055986 >> v1:172.21.15.40:6789/0 conn(0x7f58980ceab0 legacy=0x7f58980716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:00.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.128+0000 7f58967fc700 1 -- 172.21.15.6:0/1411055986 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58980ca3e0 con 0x7f58980cee80 2023-07-06T19:59:00.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.128+0000 7f58967fc700 1 -- 172.21.15.6:0/1411055986 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f58900019f0 con 0x7f58980cee80 2023-07-06T19:59:00.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.128+0000 7f58967fc700 1 -- 172.21.15.6:0/1411055986 >> v1:172.21.15.6:6789/0 conn(0x7f58980cee80 legacy=0x7f58981602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:00.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.128+0000 7f58967fc700 1 --2- 172.21.15.6:0/1411055986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5898071dd0 0x7f5884003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:00.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.128+0000 7f58967fc700 1 --2- 172.21.15.6:0/1411055986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5884003fe0 0x7f5884004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:00.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.128+0000 7f58967fc700 1 --2- 172.21.15.6:0/1411055986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5884004d90 0x7f5884005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:00.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.128+0000 7f58967fc700 1 -- 172.21.15.6:0/1411055986 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58980cb400 con 0x7f5884004d90 2023-07-06T19:59:00.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.128+0000 7f58967fc700 1 -- 172.21.15.6:0/1411055986 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588400bba0 con 0x7f5884003fe0 2023-07-06T19:59:00.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.128+0000 7f58967fc700 1 -- 172.21.15.6:0/1411055986 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588400bd30 con 0x7f5898071dd0 2023-07-06T19:59:00.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.128+0000 7f5897fff700 1 --2- 172.21.15.6:0/1411055986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5884004d90 0x7f5884005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:00.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.128+0000 7f58977fe700 1 --2- 172.21.15.6:0/1411055986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5898071dd0 0x7f5884003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:00.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.128+0000 7f5896ffd700 1 --2- 172.21.15.6:0/1411055986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5884003fe0 0x7f5884004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:00.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.128+0000 7f5897fff700 1 -- 172.21.15.6:0/1411055986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5898071dd0 msgr2=0x7f5884003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:00.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.129+0000 7f5897fff700 1 --2- 172.21.15.6:0/1411055986 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5898071dd0 0x7f5884003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:00.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.129+0000 7f5897fff700 1 -- 172.21.15.6:0/1411055986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5884003fe0 msgr2=0x7f5884004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:00.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.129+0000 7f5897fff700 1 --2- 172.21.15.6:0/1411055986 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5884003fe0 0x7f5884004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:00.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.129+0000 7f5897fff700 1 -- 172.21.15.6:0/1411055986 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58840035b0 con 0x7f5884004d90 2023-07-06T19:59:00.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.129+0000 7f5897fff700 1 --2- 172.21.15.6:0/1411055986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5884004d90 0x7f5884005200 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f589000a7d0 tx=0x7f5884005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e128b5846aaabd3f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:00.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.129+0000 7f58967fc700 1 -- 172.21.15.6:0/1411055986 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5890012600 con 0x7f5884004d90 2023-07-06T19:59:00.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.129+0000 7f58967fc700 1 -- 172.21.15.6:0/1411055986 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5890012780 con 0x7f5884004d90 2023-07-06T19:59:00.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.129+0000 7f58967fc700 1 -- 172.21.15.6:0/1411055986 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5890012b30 con 0x7f5884004d90 2023-07-06T19:59:00.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.129+0000 7f589e24c700 1 -- 172.21.15.6:0/1411055986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5884004d90 msgr2=0x7f5884005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:00.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.129+0000 7f589e24c700 1 --2- 172.21.15.6:0/1411055986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5884004d90 0x7f5884005200 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f589000a7d0 tx=0x7f5884005880 comp rx=0 tx=0).stop 2023-07-06T19:59:00.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.129+0000 7f5897fff700 1 -- 172.21.15.6:0/1411055986 reap_dead start 2023-07-06T19:59:00.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.129+0000 7f589e24c700 1 -- 172.21.15.6:0/1411055986 shutdown_connections 2023-07-06T19:59:00.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.129+0000 7f589e24c700 1 -- 172.21.15.6:0/1411055986 >> 172.21.15.6:0/1411055986 conn(0x7f58980cc420 msgr2=0x7f58980cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:00.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.129+0000 7f589e24c700 1 -- 172.21.15.6:0/1411055986 shutdown_connections 2023-07-06T19:59:00.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.130+0000 7f589e24c700 1 -- 172.21.15.6:0/1411055986 wait complete. 2023-07-06T19:59:00.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.131+0000 7f589e24c700 1 Processor -- start 2023-07-06T19:59:00.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.131+0000 7f589e24c700 1 -- start start 2023-07-06T19:59:00.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.132+0000 7f589e24c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5884004d90 0x7f58980b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:00.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.132+0000 7f589e24c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f589806c360 0x7f5898144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:00.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.132+0000 7f589e24c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58981450d0 0x7f5898145570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:00.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.132+0000 7f589e24c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58980c3920 con 0x7f5884004d90 2023-07-06T19:59:00.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.132+0000 7f589e24c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589806b880 con 0x7f58981450d0 2023-07-06T19:59:00.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.132+0000 7f589e24c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589806bb60 con 0x7f589806c360 2023-07-06T19:59:00.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.132+0000 7f58977fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5884004d90 0x7f58980b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:00.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.132+0000 7f58977fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5884004d90 0x7f58980b5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58432/0 (socket says 172.21.15.6:58432) 2023-07-06T19:59:00.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.132+0000 7f58977fe700 1 -- 172.21.15.6:0/2916896512 learned_addr learned my addr 172.21.15.6:0/2916896512 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:00.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.133+0000 7f58977fe700 1 -- 172.21.15.6:0/2916896512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f589806c360 msgr2=0x7f5898144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:00.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.133+0000 7f58977fe700 1 --2- 172.21.15.6:0/2916896512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f589806c360 0x7f5898144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:00.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.133+0000 7f58977fe700 1 -- 172.21.15.6:0/2916896512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58981450d0 msgr2=0x7f5898145570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:00.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.133+0000 7f58977fe700 1 --2- 172.21.15.6:0/2916896512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58981450d0 0x7f5898145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.133+0000 7f58977fe700 1 -- 172.21.15.6:0/2916896512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589806be40 con 0x7f5884004d90 2023-07-06T19:59:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.133+0000 7f58977fe700 1 --2- 172.21.15.6:0/2916896512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5884004d90 0x7f58980b5060 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f588800f840 tx=0x7f588800fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.133+0000 7f588ffff700 1 -- 172.21.15.6:0/2916896512 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888005320 con 0x7f5884004d90 2023-07-06T19:59:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.133+0000 7f588ffff700 1 -- 172.21.15.6:0/2916896512 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58880054a0 con 0x7f5884004d90 2023-07-06T19:59:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.133+0000 7f589e24c700 1 -- 172.21.15.6:0/2916896512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58980c3c00 con 0x7f5884004d90 2023-07-06T19:59:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.133+0000 7f588ffff700 1 -- 172.21.15.6:0/2916896512 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5888006aa0 con 0x7f5884004d90 2023-07-06T19:59:00.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.133+0000 7f589e24c700 1 -- 172.21.15.6:0/2916896512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5898147900 con 0x7f5884004d90 2023-07-06T19:59:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.134+0000 7f589e24c700 1 -- 172.21.15.6:0/2916896512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58980b5920 con 0x7f5884004d90 2023-07-06T19:59:00.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.134+0000 7f588ffff700 1 -- 172.21.15.6:0/2916896512 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5888006c00 con 0x7f5884004d90 2023-07-06T19:59:00.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.135+0000 7f588ffff700 1 --2- 172.21.15.6:0/2916896512 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f587806ace0 0x7f587806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:00.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.135+0000 7f588ffff700 1 -- 172.21.15.6:0/2916896512 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5888089060 con 0x7f5884004d90 2023-07-06T19:59:00.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.135+0000 7f5896ffd700 1 --2- 172.21.15.6:0/2916896512 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f587806ace0 0x7f587806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:00.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.135+0000 7f5896ffd700 1 --2- 172.21.15.6:0/2916896512 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f587806ace0 0x7f587806d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5898071770 tx=0x7f5880009670 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:00.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.139+0000 7f588ffff700 1 -- 172.21.15.6:0/2916896512 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f58880bb310 con 0x7f5884004d90 2023-07-06T19:59:00.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.380+0000 7f589e24c700 1 -- 172.21.15.6:0/2916896512 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58981600e0 con 0x7f5884004d90 2023-07-06T19:59:00.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.380+0000 7f588ffff700 1 -- 172.21.15.6:0/2916896512 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4652 (secure 0 0 0) 0x7f5888053e10 con 0x7f5884004d90 2023-07-06T19:59:00.385 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:00.385 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3695014381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3695014381},{"type":"v1","addr":"172.21.15.6:6835","nonce":3695014381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/849399781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":849399781},{"type":"v1","addr":"172.21.15.40:6833","nonce":849399781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/512806705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":512806705},{"type":"v1","addr":"172.21.15.40:6835","nonce":512806705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T19:58:53.158966+0000","modified":"2023-07-06T19:58:58.778273+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/368324315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":368324315},{"type":"v1","addr":"172.21.15.6:6837","nonce":368324315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-06T19:59:00.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.382+0000 7f589e24c700 1 -- 172.21.15.6:0/2916896512 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f587806ace0 msgr2=0x7f587806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:00.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.382+0000 7f589e24c700 1 --2- 172.21.15.6:0/2916896512 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f587806ace0 0x7f587806d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5898071770 tx=0x7f5880009670 comp rx=0 tx=0).stop 2023-07-06T19:59:00.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.382+0000 7f589e24c700 1 -- 172.21.15.6:0/2916896512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5884004d90 msgr2=0x7f58980b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:00.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.382+0000 7f589e24c700 1 --2- 172.21.15.6:0/2916896512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5884004d90 0x7f58980b5060 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f588800f840 tx=0x7f588800fc00 comp rx=0 tx=0).stop 2023-07-06T19:59:00.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.382+0000 7f589e24c700 1 -- 172.21.15.6:0/2916896512 shutdown_connections 2023-07-06T19:59:00.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.382+0000 7f589e24c700 1 --2- 172.21.15.6:0/2916896512 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f587806ace0 0x7f587806d190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:00.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.382+0000 7f589e24c700 1 --2- 172.21.15.6:0/2916896512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5884004d90 0x7f58980b5060 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:00.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.382+0000 7f589e24c700 1 --2- 172.21.15.6:0/2916896512 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58981450d0 0x7f5898145570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:00.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.382+0000 7f589e24c700 1 --2- 172.21.15.6:0/2916896512 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f589806c360 0x7f5898144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:00.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.382+0000 7f589e24c700 1 -- 172.21.15.6:0/2916896512 >> 172.21.15.6:0/2916896512 conn(0x7f58980cc420 msgr2=0x7f5898152a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:00.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.382+0000 7f589e24c700 1 -- 172.21.15.6:0/2916896512 shutdown_connections 2023-07-06T19:59:00.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.382+0000 7f589e24c700 1 -- 172.21.15.6:0/2916896512 wait complete. 2023-07-06T19:59:00.390 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 7 2023-07-06T19:59:00.396 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T19:59:00.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.519+0000 7f7ebff0d700 1 Processor -- start 2023-07-06T19:59:00.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.520+0000 7f7ebff0d700 1 -- start start 2023-07-06T19:59:00.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.520+0000 7f7ebff0d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7eb8157ed0 0x7f7eb806f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:00.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.520+0000 7f7ebff0d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb806e6c0 con 0x7f7eb80ccbe0 2023-07-06T19:59:00.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.520+0000 7f7ebff0d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb80cb080 con 0x7f7eb815e4c0 2023-07-06T19:59:00.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.520+0000 7f7ebff0d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb806f6a0 con 0x7f7eb8157ed0 2023-07-06T19:59:00.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.521+0000 7f7ebd4a8700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7eb80ccbe0 0x7f7eb815ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59650/0 (socket says 172.21.15.6:59650) 2023-07-06T19:59:00.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.521+0000 7f7ebd4a8700 1 -- 172.21.15.6:0/3241704408 learned_addr learned my addr 172.21.15.6:0/3241704408 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:00.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.521+0000 7f7ebdca9700 1 --2- 172.21.15.6:0/3241704408 >> v2:172.21.15.40:3300/0 conn(0x7f7eb8157ed0 0x7f7eb806f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:00.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.521+0000 7f7ebcca7700 1 -- 172.21.15.6:0/3241704408 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512562294 0 0) 0x7f7eb806e6c0 con 0x7f7eb80ccbe0 2023-07-06T19:59:00.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.521+0000 7f7ebcca7700 1 -- 172.21.15.6:0/3241704408 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ea40035b0 con 0x7f7eb80ccbe0 2023-07-06T19:59:00.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.521+0000 7f7ebcca7700 1 -- 172.21.15.6:0/3241704408 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2732318380 0 0) 0x7f7ea40035b0 con 0x7f7eb80ccbe0 2023-07-06T19:59:00.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.521+0000 7f7ebdca9700 1 -- 172.21.15.6:0/3241704408 >> v1:172.21.15.40:6789/0 conn(0x7f7eb815e4c0 legacy=0x7f7eb80ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:00.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.521+0000 7f7ebdca9700 1 -- 172.21.15.6:0/3241704408 >> v1:172.21.15.6:6789/0 conn(0x7f7eb80ccbe0 legacy=0x7f7eb815ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:00.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.521+0000 7f7ebdca9700 1 -- 172.21.15.6:0/3241704408 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb80cb360 con 0x7f7eb8157ed0 2023-07-06T19:59:00.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.521+0000 7f7ebdca9700 1 --2- 172.21.15.6:0/3241704408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7eb8157ed0 0x7f7eb806f160 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4009840 tx=0x7f7eb4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=508aaa47bd392861 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:00.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.521+0000 7f7ebcca7700 1 -- 172.21.15.6:0/3241704408 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea8001670 con 0x7f7eb8157ed0 2023-07-06T19:59:00.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.521+0000 7f7ebcca7700 1 -- 172.21.15.6:0/3241704408 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb4004030 con 0x7f7eb8157ed0 2023-07-06T19:59:00.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.521+0000 7f7ebcca7700 1 -- 172.21.15.6:0/3241704408 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb40043c0 con 0x7f7eb8157ed0 2023-07-06T19:59:00.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.522+0000 7f7ebff0d700 1 -- 172.21.15.6:0/3241704408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7eb8157ed0 msgr2=0x7f7eb806f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:00.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.522+0000 7f7ebff0d700 1 --2- 172.21.15.6:0/3241704408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7eb8157ed0 0x7f7eb806f160 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4009840 tx=0x7f7eb4009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:00.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.522+0000 7f7ebff0d700 1 -- 172.21.15.6:0/3241704408 shutdown_connections 2023-07-06T19:59:00.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.522+0000 7f7ebff0d700 1 --2- 172.21.15.6:0/3241704408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7eb8157ed0 0x7f7eb806f160 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:00.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.522+0000 7f7ebff0d700 1 -- 172.21.15.6:0/3241704408 >> 172.21.15.6:0/3241704408 conn(0x7f7eb80d0a30 msgr2=0x7f7eb80d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:00.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.522+0000 7f7ebff0d700 1 -- 172.21.15.6:0/3241704408 shutdown_connections 2023-07-06T19:59:00.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.522+0000 7f7ebff0d700 1 -- 172.21.15.6:0/3241704408 wait complete. 2023-07-06T19:59:00.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.523+0000 7f7ebff0d700 1 Processor -- start 2023-07-06T19:59:00.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.523+0000 7f7ebff0d700 1 -- start start 2023-07-06T19:59:00.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.524+0000 7f7ebff0d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7eb80ccbe0 0x7f7eb80c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:00.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.524+0000 7f7ebff0d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7eb8157ed0 0x7f7eb81ef440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:00.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.524+0000 7f7ebff0d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7eb815e4c0 0x7f7eb815cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:00.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.524+0000 7f7ebff0d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb81f0af0 con 0x7f7eb8157ed0 2023-07-06T19:59:00.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.524+0000 7f7ebff0d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb81efe70 con 0x7f7eb815e4c0 2023-07-06T19:59:00.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.524+0000 7f7ebff0d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb81f0150 con 0x7f7eb80ccbe0 2023-07-06T19:59:00.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.524+0000 7f7ebd4a8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7eb8157ed0 0x7f7eb81ef440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:00.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.524+0000 7f7ebd4a8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7eb8157ed0 0x7f7eb81ef440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58448/0 (socket says 172.21.15.6:58448) 2023-07-06T19:59:00.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.524+0000 7f7ebd4a8700 1 -- 172.21.15.6:0/813170880 learned_addr learned my addr 172.21.15.6:0/813170880 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:00.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.524+0000 7f7ebdca9700 1 --2- 172.21.15.6:0/813170880 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7eb80ccbe0 0x7f7eb80c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:00.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.524+0000 7f7ebe4aa700 1 --2- 172.21.15.6:0/813170880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7eb815e4c0 0x7f7eb815cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:00.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.524+0000 7f7ebd4a8700 1 -- 172.21.15.6:0/813170880 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7eb80ccbe0 msgr2=0x7f7eb80c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:00.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.524+0000 7f7ebd4a8700 1 --2- 172.21.15.6:0/813170880 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7eb80ccbe0 0x7f7eb80c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:00.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.524+0000 7f7ebd4a8700 1 -- 172.21.15.6:0/813170880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7eb815e4c0 msgr2=0x7f7eb815cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:00.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.524+0000 7f7ebd4a8700 1 --2- 172.21.15.6:0/813170880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7eb815e4c0 0x7f7eb815cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:00.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.524+0000 7f7ebd4a8700 1 -- 172.21.15.6:0/813170880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb40094a0 con 0x7f7eb8157ed0 2023-07-06T19:59:00.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.524+0000 7f7ebe4aa700 1 --2- 172.21.15.6:0/813170880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7eb815e4c0 0x7f7eb815cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:00.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.525+0000 7f7ebd4a8700 1 --2- 172.21.15.6:0/813170880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7eb8157ed0 0x7f7eb81ef440 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7ea800c6a0 tx=0x7f7ea800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:00.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.525+0000 7f7eae7fc700 1 -- 172.21.15.6:0/813170880 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea8005d70 con 0x7f7eb8157ed0 2023-07-06T19:59:00.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.525+0000 7f7eae7fc700 1 -- 172.21.15.6:0/813170880 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea80070d0 con 0x7f7eb8157ed0 2023-07-06T19:59:00.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.525+0000 7f7ebff0d700 1 -- 172.21.15.6:0/813170880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb81f0430 con 0x7f7eb8157ed0 2023-07-06T19:59:00.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.525+0000 7f7eae7fc700 1 -- 172.21.15.6:0/813170880 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea8007480 con 0x7f7eb8157ed0 2023-07-06T19:59:00.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.525+0000 7f7ebff0d700 1 -- 172.21.15.6:0/813170880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb81ef980 con 0x7f7eb8157ed0 2023-07-06T19:59:00.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.526+0000 7f7ebff0d700 1 -- 172.21.15.6:0/813170880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb81efc00 con 0x7f7eb8157ed0 2023-07-06T19:59:00.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.526+0000 7f7eae7fc700 1 -- 172.21.15.6:0/813170880 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7ea80075e0 con 0x7f7eb8157ed0 2023-07-06T19:59:00.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.527+0000 7f7eae7fc700 1 --2- 172.21.15.6:0/813170880 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7e9c06ace0 0x7f7e9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:00.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.527+0000 7f7eae7fc700 1 -- 172.21.15.6:0/813170880 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7ea8088ba0 con 0x7f7eb8157ed0 2023-07-06T19:59:00.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.527+0000 7f7ebdca9700 1 --2- 172.21.15.6:0/813170880 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7e9c06ace0 0x7f7e9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:00.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.527+0000 7f7ebdca9700 1 --2- 172.21.15.6:0/813170880 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7e9c06ace0 0x7f7e9c06d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4009b90 tx=0x7f7eb4008000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:00.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.531+0000 7f7eae7fc700 1 -- 172.21.15.6:0/813170880 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7ea8053aa0 con 0x7f7eb8157ed0 2023-07-06T19:59:00.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.729+0000 7f7ebff0d700 1 -- 172.21.15.6:0/813170880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7eb806e0d0 con 0x7f7eb8157ed0 2023-07-06T19:59:00.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.730+0000 7f7eae7fc700 1 -- 172.21.15.6:0/813170880 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19964 (secure 0 0 0) 0x7f7ea8017090 con 0x7f7eb8157ed0 2023-07-06T19:59:00.733 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:00.734 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:58:58.202291+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T19:58:51.062712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T19:58:52.130350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T19:58:55.785128+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:59:00.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.732+0000 7f7ebff0d700 1 -- 172.21.15.6:0/813170880 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7e9c06ace0 msgr2=0x7f7e9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:00.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.732+0000 7f7ebff0d700 1 --2- 172.21.15.6:0/813170880 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7e9c06ace0 0x7f7e9c06d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4009b90 tx=0x7f7eb4008000 comp rx=0 tx=0).stop 2023-07-06T19:59:00.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.732+0000 7f7ebff0d700 1 -- 172.21.15.6:0/813170880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7eb8157ed0 msgr2=0x7f7eb81ef440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:00.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.732+0000 7f7ebff0d700 1 --2- 172.21.15.6:0/813170880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7eb8157ed0 0x7f7eb81ef440 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7ea800c6a0 tx=0x7f7ea800c9b0 comp rx=0 tx=0).stop 2023-07-06T19:59:00.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.732+0000 7f7ebff0d700 1 -- 172.21.15.6:0/813170880 shutdown_connections 2023-07-06T19:59:00.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.732+0000 7f7ebff0d700 1 --2- 172.21.15.6:0/813170880 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7e9c06ace0 0x7f7e9c06d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:00.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.732+0000 7f7ebff0d700 1 --2- 172.21.15.6:0/813170880 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7eb815e4c0 0x7f7eb815cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:00.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.732+0000 7f7ebff0d700 1 --2- 172.21.15.6:0/813170880 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7eb80ccbe0 0x7f7eb80c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:00.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.732+0000 7f7ebff0d700 1 --2- 172.21.15.6:0/813170880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7eb8157ed0 0x7f7eb81ef440 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:00.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.732+0000 7f7ebff0d700 1 -- 172.21.15.6:0/813170880 >> 172.21.15.6:0/813170880 conn(0x7f7eb80d0a30 msgr2=0x7f7eb80d0070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:00.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.732+0000 7f7ebff0d700 1 -- 172.21.15.6:0/813170880 shutdown_connections 2023-07-06T19:59:00.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:00.732+0000 7f7ebff0d700 1 -- 172.21.15.6:0/813170880 wait complete. 2023-07-06T19:59:01.151 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-06T19:58:53.158966+0000', 'modified': '2023-07-06T19:58:58.778273+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6837/368324315', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6836', 'nonce': 368324315}, {'type': 'v1', 'addr': '172.21.15.6:6837', 'nonce': 368324315}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-07-06T19:59:01.152 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-06T19:59:01.152 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-06T19:59:01.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.281+0000 7f3b5da6d700 1 Processor -- start 2023-07-06T19:59:01.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.281+0000 7f3b5da6d700 1 -- start start 2023-07-06T19:59:01.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.281+0000 7f3b5da6d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3b5806c040 0x7f3b580ca910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.282+0000 7f3b5da6d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b580c9d70 con 0x7f3b580cd630 2023-07-06T19:59:01.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.282+0000 7f3b5da6d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5806bdf0 con 0x7f3b580cefe0 2023-07-06T19:59:01.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.282+0000 7f3b5da6d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b580c9810 con 0x7f3b5806c040 2023-07-06T19:59:01.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.282+0000 7f3b56ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3b580cd630 0x7f3b580ca200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59662/0 (socket says 172.21.15.6:59662) 2023-07-06T19:59:01.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.282+0000 7f3b56ffd700 1 -- 172.21.15.6:0/3332365720 learned_addr learned my addr 172.21.15.6:0/3332365720 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:01.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.282+0000 7f3b57fff700 1 --2- 172.21.15.6:0/3332365720 >> v2:172.21.15.6:3300/0 conn(0x7f3b5806c040 0x7f3b580ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.282+0000 7f3b567fc700 1 -- 172.21.15.6:0/3332365720 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824345554 0 0) 0x7f3b580c9d70 con 0x7f3b580cd630 2023-07-06T19:59:01.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.282+0000 7f3b567fc700 1 -- 172.21.15.6:0/3332365720 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b400035b0 con 0x7f3b580cd630 2023-07-06T19:59:01.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.282+0000 7f3b57fff700 1 -- 172.21.15.6:0/3332365720 >> v1:172.21.15.40:6789/0 conn(0x7f3b580cefe0 legacy=0x7f3b580cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:01.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.282+0000 7f3b567fc700 1 -- 172.21.15.6:0/3332365720 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485617149 0 0) 0x7f3b5806bdf0 con 0x7f3b580cefe0 2023-07-06T19:59:01.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.282+0000 7f3b57fff700 1 -- 172.21.15.6:0/3332365720 >> v1:172.21.15.6:6789/0 conn(0x7f3b580cd630 legacy=0x7f3b580ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:01.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.282+0000 7f3b57fff700 1 -- 172.21.15.6:0/3332365720 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5806b830 con 0x7f3b5806c040 2023-07-06T19:59:01.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.282+0000 7f3b57fff700 1 --2- 172.21.15.6:0/3332365720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b5806c040 0x7f3b580ca910 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3b50009d90 tx=0x7f3b5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417fd865dab1c79f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:01.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.282+0000 7f3b567fc700 1 -- 172.21.15.6:0/3332365720 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5000e070 con 0x7f3b5806c040 2023-07-06T19:59:01.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.282+0000 7f3b567fc700 1 -- 172.21.15.6:0/3332365720 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5000bb20 con 0x7f3b5806c040 2023-07-06T19:59:01.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.282+0000 7f3b567fc700 1 -- 172.21.15.6:0/3332365720 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5000bed0 con 0x7f3b5806c040 2023-07-06T19:59:01.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.283+0000 7f3b5da6d700 1 -- 172.21.15.6:0/3332365720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b5806c040 msgr2=0x7f3b580ca910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:01.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.283+0000 7f3b5da6d700 1 --2- 172.21.15.6:0/3332365720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b5806c040 0x7f3b580ca910 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3b50009d90 tx=0x7f3b5000b330 comp rx=0 tx=0).stop 2023-07-06T19:59:01.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.283+0000 7f3b5da6d700 1 -- 172.21.15.6:0/3332365720 shutdown_connections 2023-07-06T19:59:01.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.283+0000 7f3b5da6d700 1 --2- 172.21.15.6:0/3332365720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b5806c040 0x7f3b580ca910 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.283+0000 7f3b5da6d700 1 -- 172.21.15.6:0/3332365720 >> 172.21.15.6:0/3332365720 conn(0x7f3b580b0b60 msgr2=0x7f3b580b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:01.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.283+0000 7f3b5da6d700 1 -- 172.21.15.6:0/3332365720 shutdown_connections 2023-07-06T19:59:01.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.283+0000 7f3b5da6d700 1 -- 172.21.15.6:0/3332365720 wait complete. 2023-07-06T19:59:01.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.284+0000 7f3b5da6d700 1 Processor -- start 2023-07-06T19:59:01.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.285+0000 7f3b5da6d700 1 -- start start 2023-07-06T19:59:01.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.286+0000 7f3b5da6d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b5806c040 0x7f3b580c5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.286+0000 7f3b5da6d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b580cd630 0x7f3b5814d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.286+0000 7f3b5da6d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b580cefe0 0x7f3b580c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.286+0000 7f3b5da6d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580c6bd0 con 0x7f3b580cefe0 2023-07-06T19:59:01.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.286+0000 7f3b5da6d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580c6eb0 con 0x7f3b580cd630 2023-07-06T19:59:01.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.286+0000 7f3b5da6d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580c7190 con 0x7f3b5806c040 2023-07-06T19:59:01.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.286+0000 7f3b57fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b580cefe0 0x7f3b580c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.286+0000 7f3b57fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b580cefe0 0x7f3b580c34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58464/0 (socket says 172.21.15.6:58464) 2023-07-06T19:59:01.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.286+0000 7f3b57fff700 1 -- 172.21.15.6:0/4243923025 learned_addr learned my addr 172.21.15.6:0/4243923025 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:01.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.286+0000 7f3b56ffd700 1 --2- 172.21.15.6:0/4243923025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b580cd630 0x7f3b5814d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.286+0000 7f3b577fe700 1 --2- 172.21.15.6:0/4243923025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b5806c040 0x7f3b580c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.286+0000 7f3b57fff700 1 -- 172.21.15.6:0/4243923025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b5806c040 msgr2=0x7f3b580c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:01.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.286+0000 7f3b57fff700 1 --2- 172.21.15.6:0/4243923025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b5806c040 0x7f3b580c5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.286+0000 7f3b57fff700 1 -- 172.21.15.6:0/4243923025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b580cd630 msgr2=0x7f3b5814d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:01.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.286+0000 7f3b57fff700 1 --2- 172.21.15.6:0/4243923025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b580cd630 0x7f3b5814d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.286+0000 7f3b57fff700 1 -- 172.21.15.6:0/4243923025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b50009a70 con 0x7f3b580cefe0 2023-07-06T19:59:01.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.286+0000 7f3b56ffd700 1 --2- 172.21.15.6:0/4243923025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b580cd630 0x7f3b5814d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:01.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.286+0000 7f3b577fe700 1 --2- 172.21.15.6:0/4243923025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b5806c040 0x7f3b580c5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:01.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.286+0000 7f3b57fff700 1 --2- 172.21.15.6:0/4243923025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b580cefe0 0x7f3b580c34b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3b580ccbd0 tx=0x7f3b50004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:01.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.286+0000 7f3b3ffff700 1 -- 172.21.15.6:0/4243923025 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5001b810 con 0x7f3b580cefe0 2023-07-06T19:59:01.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.286+0000 7f3b3ffff700 1 -- 172.21.15.6:0/4243923025 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b50020070 con 0x7f3b580cefe0 2023-07-06T19:59:01.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.286+0000 7f3b5da6d700 1 -- 172.21.15.6:0/4243923025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b580c7470 con 0x7f3b580cefe0 2023-07-06T19:59:01.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.286+0000 7f3b3ffff700 1 -- 172.21.15.6:0/4243923025 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5001bbb0 con 0x7f3b580cefe0 2023-07-06T19:59:01.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.287+0000 7f3b5da6d700 1 -- 172.21.15.6:0/4243923025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b580c9330 con 0x7f3b580cefe0 2023-07-06T19:59:01.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.288+0000 7f3b3ffff700 1 -- 172.21.15.6:0/4243923025 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3b5001bd10 con 0x7f3b580cefe0 2023-07-06T19:59:01.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.288+0000 7f3b3ffff700 1 --2- 172.21.15.6:0/4243923025 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3b4406ace0 0x7f3b4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.288+0000 7f3b577fe700 1 --2- 172.21.15.6:0/4243923025 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3b4406ace0 0x7f3b4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.288+0000 7f3b3ffff700 1 -- 172.21.15.6:0/4243923025 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3b50022070 con 0x7f3b580cefe0 2023-07-06T19:59:01.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.289+0000 7f3b577fe700 1 --2- 172.21.15.6:0/4243923025 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3b4406ace0 0x7f3b4406d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3b48000f60 tx=0x7f3b48009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:01.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.290+0000 7f3b69bf2b80 1 Processor -- start 2023-07-06T19:59:01.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.290+0000 7f3b69bf2b80 1 -- start start 2023-07-06T19:59:01.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.291+0000 7f3b69bf2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740590b5a0 0x55740590b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.291+0000 7f3b69bf2b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55740592a670 0x5574058e3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.291+0000 7f3b69bf2b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55740592aae0 0x5574058e44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.291+0000 7f3b69bf2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574057e8c60 con 0x55740590b5a0 2023-07-06T19:59:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.291+0000 7f3b69bf2b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55740583b9f0 con 0x55740592a670 2023-07-06T19:59:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.291+0000 7f3b69bf2b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x557405834e80 con 0x55740592aae0 2023-07-06T19:59:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.291+0000 7f3b577fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740590b5a0 0x55740590b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.291+0000 7f3b577fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740590b5a0 0x55740590b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58468/0 (socket says 172.21.15.6:58468) 2023-07-06T19:59:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.291+0000 7f3b577fe700 1 -- 172.21.15.6:0/1524572111 learned_addr learned my addr 172.21.15.6:0/1524572111 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.291+0000 7f3b57fff700 1 --2- 172.21.15.6:0/1524572111 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55740592aae0 0x5574058e44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.291+0000 7f3b56ffd700 1 --2- 172.21.15.6:0/1524572111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55740592a670 0x5574058e3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.292+0000 7f3b577fe700 1 -- 172.21.15.6:0/1524572111 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55740592aae0 msgr2=0x5574058e44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:01.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.292+0000 7f3b577fe700 1 --2- 172.21.15.6:0/1524572111 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55740592aae0 0x5574058e44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.292+0000 7f3b577fe700 1 -- 172.21.15.6:0/1524572111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55740592a670 msgr2=0x5574058e3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:01.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.292+0000 7f3b577fe700 1 --2- 172.21.15.6:0/1524572111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55740592a670 0x5574058e3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.292+0000 7f3b577fe700 1 -- 172.21.15.6:0/1524572111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557405662d90 con 0x55740590b5a0 2023-07-06T19:59:01.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.292+0000 7f3b577fe700 1 --2- 172.21.15.6:0/1524572111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740590b5a0 0x55740590b970 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3b48005310 tx=0x7f3b48010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610042372bfa4a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:01.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.292+0000 7f3b3d7fa700 1 -- 172.21.15.6:0/1524572111 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4800d650 con 0x55740590b5a0 2023-07-06T19:59:01.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.292+0000 7f3b3d7fa700 1 -- 172.21.15.6:0/1524572111 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4800d7b0 con 0x55740590b5a0 2023-07-06T19:59:01.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.292+0000 7f3b3d7fa700 1 -- 172.21.15.6:0/1524572111 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4800db20 con 0x55740590b5a0 2023-07-06T19:59:01.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.292+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/1524572111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740590b5a0 msgr2=0x55740590b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.293+0000 7f3b69bf2b80 1 --2- 172.21.15.6:0/1524572111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740590b5a0 0x55740590b970 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3b48005310 tx=0x7f3b48010000 comp rx=0 tx=0).stop 2023-07-06T19:59:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.293+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/1524572111 shutdown_connections 2023-07-06T19:59:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.293+0000 7f3b69bf2b80 1 --2- 172.21.15.6:0/1524572111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740590b5a0 0x55740590b970 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.293+0000 7f3b69bf2b80 1 --2- 172.21.15.6:0/1524572111 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55740592aae0 0x5574058e44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.293+0000 7f3b69bf2b80 1 --2- 172.21.15.6:0/1524572111 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55740592a670 0x5574058e3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.293+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/1524572111 >> 172.21.15.6:0/1524572111 conn(0x5574058d8e80 msgr2=0x5574059291f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:01.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.293+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/1524572111 shutdown_connections 2023-07-06T19:59:01.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.293+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/1524572111 wait complete. 2023-07-06T19:59:01.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.293+0000 7f3b69bf2b80 1 -- start start 2023-07-06T19:59:01.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.293+0000 7f3b69bf2b80 1 Processor -- start 2023-07-06T19:59:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.294+0000 7f3b69bf2b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55740590b5a0 0x557405905c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.294+0000 7f3b69bf2b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55740592a670 0x55740590c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.294+0000 7f3b69bf2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740592aae0 0x5574059291f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.294+0000 7f3b69bf2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574057d4a70 con 0x55740592aae0 2023-07-06T19:59:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.294+0000 7f3b69bf2b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574057d4770 con 0x55740590b5a0 2023-07-06T19:59:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.294+0000 7f3b69bf2b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x5574056b88d0 con 0x55740592a670 2023-07-06T19:59:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.294+0000 7f3b69bf2b80 10 client.0 _ll_register_callbacks cb 0x5574057d2710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T19:59:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.294+0000 7f3b57fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740592aae0 0x5574059291f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.294+0000 7f3b57fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740592aae0 0x5574059291f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58478/0 (socket says 172.21.15.6:58478) 2023-07-06T19:59:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.294+0000 7f3b57fff700 1 -- 172.21.15.6:0/1830686229 learned_addr learned my addr 172.21.15.6:0/1830686229 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.294+0000 7f3b577fe700 1 --2- 172.21.15.6:0/1830686229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55740590b5a0 0x557405905c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.294+0000 7f3b56ffd700 1 --2- 172.21.15.6:0/1830686229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55740592a670 0x55740590c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.295+0000 7f3b57fff700 1 -- 172.21.15.6:0/1830686229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55740592a670 msgr2=0x55740590c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.295+0000 7f3b57fff700 1 --2- 172.21.15.6:0/1830686229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55740592a670 0x55740590c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.295+0000 7f3b57fff700 1 -- 172.21.15.6:0/1830686229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55740590b5a0 msgr2=0x557405905c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:01.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.295+0000 7f3b57fff700 1 --2- 172.21.15.6:0/1830686229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55740590b5a0 0x557405905c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.295+0000 7f3b57fff700 1 -- 172.21.15.6:0/1830686229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b480050d0 con 0x55740592aae0 2023-07-06T19:59:01.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.295+0000 7f3b57fff700 1 --2- 172.21.15.6:0/1830686229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740592aae0 0x5574059291f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b5008a150 tx=0x7f3b5005a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a606af7f69bfb0d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:01.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.295+0000 7f3b367fc700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-06T19:59:01.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.295+0000 7f3b367fc700 1 -- 172.21.15.6:0/1830686229 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b500722d0 con 0x55740592aae0 2023-07-06T19:59:01.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.295+0000 7f3b367fc700 1 -- 172.21.15.6:0/1830686229 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3b500568e0 con 0x55740592aae0 2023-07-06T19:59:01.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.295+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/1830686229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5574058d6490 con 0x55740592aae0 2023-07-06T19:59:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.295+0000 7f3b367fc700 1 -- 172.21.15.6:0/1830686229 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b50058cf0 con 0x55740592aae0 2023-07-06T19:59:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.295+0000 7f3b69bf2b80 10 client.4431 fetch_fsmap learned FSMap version 7 2023-07-06T19:59:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.295+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/1830686229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55740564bc10 con 0x55740592aae0 2023-07-06T19:59:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.295+0000 7f3b367fc700 1 -- 172.21.15.6:0/1830686229 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5574058d6490 con 0x55740592aae0 2023-07-06T19:59:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.295+0000 7f3b367fc700 1 -- 172.21.15.6:0/1830686229 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f3b50056aa0 con 0x55740592aae0 2023-07-06T19:59:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.295+0000 7f3b69bf2b80 10 client.4431 fetch_fsmap finished waiting for FSMap version 7 2023-07-06T19:59:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.295+0000 7f3b69bf2b80 10 client.4431 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-06T19:59:01.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.295+0000 7f3b69bf2b80 20 client.4431 populate_metadata read hostname 'smithi006' 2023-07-06T19:59:01.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.295+0000 7f3b69bf2b80 1 --2- 172.21.15.6:0/1830686229 >> [v2:172.21.15.6:6836/368324315,v1:172.21.15.6:6837/368324315] conn(0x55740590ed10 0x5574059099a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.295+0000 7f3b69bf2b80 4 client.4431 mds_command: new command op to 4284 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-06T19:59:01.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.295+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/1830686229 --> [v2:172.21.15.6:6836/368324315,v1:172.21.15.6:6837/368324315] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55740582de60 con 0x55740590ed10 2023-07-06T19:59:01.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.295+0000 7f3b577fe700 1 --2- 172.21.15.6:0/1830686229 >> [v2:172.21.15.6:6836/368324315,v1:172.21.15.6:6837/368324315] conn(0x55740590ed10 0x5574059099a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.296+0000 7f3b367fc700 10 client.4431 ms_handle_connect on v2:172.21.15.6:6836/368324315 2023-07-06T19:59:01.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.296+0000 7f3b577fe700 1 --2- 172.21.15.6:0/1830686229 >> [v2:172.21.15.6:6836/368324315,v1:172.21.15.6:6837/368324315] conn(0x55740590ed10 0x5574059099a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa35b81fb0c21363 server_cookie=d9d58b0a3de40078 in_seq=0 out_seq=0 2023-07-06T19:59:01.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.296+0000 7f3b367fc700 1 -- 172.21.15.6:0/1830686229 <== mds.0 v2:172.21.15.6:6836/368324315 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55740582de60 con 0x55740590ed10 2023-07-06T19:59:01.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.296+0000 7f3b367fc700 10 client.4431 handle_command_reply: tid=0 2023-07-06T19:59:01.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.296+0000 7f3b69bf2b80 1 client.4431 shutdown 2023-07-06T19:59:01.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.296+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/1830686229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740592aae0 msgr2=0x5574059291f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:01.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.296+0000 7f3b69bf2b80 1 --2- 172.21.15.6:0/1830686229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740592aae0 0x5574059291f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b5008a150 tx=0x7f3b5005a2c0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.296+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/1830686229 shutdown_connections 2023-07-06T19:59:01.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.296+0000 7f3b69bf2b80 1 --2- 172.21.15.6:0/1830686229 >> [v2:172.21.15.6:6836/368324315,v1:172.21.15.6:6837/368324315] conn(0x55740590ed10 0x5574059099a0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.296+0000 7f3b69bf2b80 1 --2- 172.21.15.6:0/1830686229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740592aae0 0x5574059291f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.296+0000 7f3b367fc700 0 client.4431 ms_handle_reset on v2:172.21.15.6:6836/368324315 2023-07-06T19:59:01.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.296+0000 7f3b69bf2b80 1 --2- 172.21.15.6:0/1830686229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55740590b5a0 0x557405905c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.296+0000 7f3b69bf2b80 1 --2- 172.21.15.6:0/1830686229 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55740592a670 0x55740590c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.296+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/1830686229 >> 172.21.15.6:0/1830686229 conn(0x5574058d8e80 msgr2=0x557405908af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:01.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.297+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/1830686229 shutdown_connections 2023-07-06T19:59:01.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.297+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/1830686229 wait complete. 2023-07-06T19:59:01.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.297+0000 7f3b69bf2b80 20 client.4431 trim_cache size 0 max 16384 2023-07-06T19:59:01.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.314+0000 7f3b69bf2b80 1 Processor -- start 2023-07-06T19:59:01.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.314+0000 7f3b69bf2b80 1 -- start start 2023-07-06T19:59:01.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.315+0000 7f3b69bf2b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55740590b5a0 0x5574058da590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.315+0000 7f3b69bf2b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55740592a670 0x55740594f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.315+0000 7f3b69bf2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740592aae0 0x5574058e04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.315+0000 7f3b69bf2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55740593fdf0 con 0x55740592aae0 2023-07-06T19:59:01.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.315+0000 7f3b69bf2b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55740590eb80 con 0x55740592a670 2023-07-06T19:59:01.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.315+0000 7f3b69bf2b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x557405910940 con 0x55740590b5a0 2023-07-06T19:59:01.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.315+0000 7f3b57fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740592aae0 0x5574058e04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.315+0000 7f3b57fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740592aae0 0x5574058e04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58486/0 (socket says 172.21.15.6:58486) 2023-07-06T19:59:01.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.315+0000 7f3b57fff700 1 -- 172.21.15.6:0/838258941 learned_addr learned my addr 172.21.15.6:0/838258941 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:01.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.316+0000 7f3b577fe700 1 --2- 172.21.15.6:0/838258941 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55740590b5a0 0x5574058da590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.316+0000 7f3b56ffd700 1 --2- 172.21.15.6:0/838258941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55740592a670 0x55740594f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.316+0000 7f3b57fff700 1 -- 172.21.15.6:0/838258941 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55740590b5a0 msgr2=0x5574058da590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:01.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.316+0000 7f3b57fff700 1 --2- 172.21.15.6:0/838258941 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55740590b5a0 0x5574058da590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.316+0000 7f3b57fff700 1 -- 172.21.15.6:0/838258941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55740592a670 msgr2=0x55740594f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:01.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.316+0000 7f3b57fff700 1 --2- 172.21.15.6:0/838258941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55740592a670 0x55740594f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.316+0000 7f3b57fff700 1 -- 172.21.15.6:0/838258941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557405689200 con 0x55740592aae0 2023-07-06T19:59:01.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.316+0000 7f3b56ffd700 1 --2- 172.21.15.6:0/838258941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55740592a670 0x55740594f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.316+0000 7f3b57fff700 1 --2- 172.21.15.6:0/838258941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740592aae0 0x5574058e04b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3b5008a1a0 tx=0x7f3b5005d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5524d6cf7693a46a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.316+0000 7f3b3dffb700 1 -- 172.21.15.6:0/838258941 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b500722d0 con 0x55740592aae0 2023-07-06T19:59:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.316+0000 7f3b3dffb700 1 -- 172.21.15.6:0/838258941 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b50058cf0 con 0x55740592aae0 2023-07-06T19:59:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.316+0000 7f3b3dffb700 1 -- 172.21.15.6:0/838258941 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b50056ae0 con 0x55740592aae0 2023-07-06T19:59:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.316+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/838258941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740592aae0 msgr2=0x5574058e04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.316+0000 7f3b69bf2b80 1 --2- 172.21.15.6:0/838258941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740592aae0 0x5574058e04b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3b5008a1a0 tx=0x7f3b5005d000 comp rx=0 tx=0).stop 2023-07-06T19:59:01.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.317+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/838258941 shutdown_connections 2023-07-06T19:59:01.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.317+0000 7f3b69bf2b80 1 --2- 172.21.15.6:0/838258941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740592aae0 0x5574058e04b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.317+0000 7f3b69bf2b80 1 --2- 172.21.15.6:0/838258941 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55740590b5a0 0x5574058da590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.317+0000 7f3b69bf2b80 1 --2- 172.21.15.6:0/838258941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55740592a670 0x55740594f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.317+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/838258941 >> 172.21.15.6:0/838258941 conn(0x5574058d8e80 msgr2=0x55740590fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:01.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.317+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/838258941 shutdown_connections 2023-07-06T19:59:01.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.317+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/838258941 wait complete. 2023-07-06T19:59:01.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.317+0000 7f3b69bf2b80 1 -- start start 2023-07-06T19:59:01.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.317+0000 7f3b69bf2b80 1 Processor -- start 2023-07-06T19:59:01.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.318+0000 7f3b69bf2b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55740590b5a0 0x557405994900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.318+0000 7f3b69bf2b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55740592a670 0x557405904cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.318+0000 7f3b69bf2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740592aae0 0x557405905210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.318+0000 7f3b69bf2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574059964c0 con 0x55740592aae0 2023-07-06T19:59:01.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.318+0000 7f3b69bf2b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574058e1ca0 con 0x55740590b5a0 2023-07-06T19:59:01.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.318+0000 7f3b69bf2b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x5574058e21d0 con 0x55740592a670 2023-07-06T19:59:01.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.318+0000 7f3b69bf2b80 10 client.0 _ll_register_callbacks cb 0x7f3b50062e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T19:59:01.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.318+0000 7f3b57fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740592aae0 0x557405905210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.318+0000 7f3b57fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740592aae0 0x557405905210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58492/0 (socket says 172.21.15.6:58492) 2023-07-06T19:59:01.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.318+0000 7f3b57fff700 1 -- 172.21.15.6:0/3620575191 learned_addr learned my addr 172.21.15.6:0/3620575191 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:01.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.318+0000 7f3b56ffd700 1 --2- 172.21.15.6:0/3620575191 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55740592a670 0x557405904cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.318+0000 7f3b577fe700 1 --2- 172.21.15.6:0/3620575191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55740590b5a0 0x557405994900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.318+0000 7f3b57fff700 1 -- 172.21.15.6:0/3620575191 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55740592a670 msgr2=0x557405904cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:01.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.318+0000 7f3b57fff700 1 --2- 172.21.15.6:0/3620575191 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55740592a670 0x557405904cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.318+0000 7f3b57fff700 1 -- 172.21.15.6:0/3620575191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55740590b5a0 msgr2=0x557405994900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:01.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.318+0000 7f3b57fff700 1 --2- 172.21.15.6:0/3620575191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55740590b5a0 0x557405994900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.318+0000 7f3b57fff700 1 -- 172.21.15.6:0/3620575191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55740564bc10 con 0x55740592aae0 2023-07-06T19:59:01.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.319+0000 7f3b57fff700 1 --2- 172.21.15.6:0/3620575191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740592aae0 0x557405905210 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3b5005a4d0 tx=0x7f3b5008a020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a4f1c3b7652f51d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:01.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.319+0000 7f3b367fc700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-06T19:59:01.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.319+0000 7f3b367fc700 1 -- 172.21.15.6:0/3620575191 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b50056ae0 con 0x55740592aae0 2023-07-06T19:59:01.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.319+0000 7f3b367fc700 1 -- 172.21.15.6:0/3620575191 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3b50059a50 con 0x55740592aae0 2023-07-06T19:59:01.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.319+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/3620575191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5574057f0000 con 0x55740592aae0 2023-07-06T19:59:01.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.319+0000 7f3b367fc700 1 -- 172.21.15.6:0/3620575191 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b500840b0 con 0x55740592aae0 2023-07-06T19:59:01.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.319+0000 7f3b69bf2b80 10 client.4437 fetch_fsmap learned FSMap version 7 2023-07-06T19:59:01.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.319+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/3620575191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x557405661260 con 0x55740592aae0 2023-07-06T19:59:01.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.319+0000 7f3b367fc700 1 -- 172.21.15.6:0/3620575191 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5574057f0000 con 0x55740592aae0 2023-07-06T19:59:01.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.319+0000 7f3b367fc700 1 -- 172.21.15.6:0/3620575191 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f3b50059c30 con 0x55740592aae0 2023-07-06T19:59:01.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.319+0000 7f3b69bf2b80 10 client.4437 fetch_fsmap finished waiting for FSMap version 7 2023-07-06T19:59:01.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.319+0000 7f3b69bf2b80 10 client.4437 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-06T19:59:01.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.319+0000 7f3b69bf2b80 20 client.4437 populate_metadata read hostname 'smithi006' 2023-07-06T19:59:01.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.319+0000 7f3b69bf2b80 1 --2- 172.21.15.6:0/3620575191 >> [v2:172.21.15.6:6836/368324315,v1:172.21.15.6:6837/368324315] conn(0x5574058deb70 0x557405946110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.319+0000 7f3b69bf2b80 4 client.4437 mds_command: new command op to 4284 tid=0[{"prefix": "status"}] 2023-07-06T19:59:01.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.319+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/3620575191 --> [v2:172.21.15.6:6836/368324315,v1:172.21.15.6:6837/368324315] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557405683f20 con 0x5574058deb70 2023-07-06T19:59:01.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.319+0000 7f3b577fe700 1 --2- 172.21.15.6:0/3620575191 >> [v2:172.21.15.6:6836/368324315,v1:172.21.15.6:6837/368324315] conn(0x5574058deb70 0x557405946110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.320+0000 7f3b577fe700 1 --2- 172.21.15.6:0/3620575191 >> [v2:172.21.15.6:6836/368324315,v1:172.21.15.6:6837/368324315] conn(0x5574058deb70 0x557405946110 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90dff4717ad51d75 server_cookie=3c1e87e4005db4df in_seq=0 out_seq=0 2023-07-06T19:59:01.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.320+0000 7f3b367fc700 10 client.4437 ms_handle_connect on v2:172.21.15.6:6836/368324315 2023-07-06T19:59:01.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.320+0000 7f3b367fc700 1 -- 172.21.15.6:0/3620575191 <== mds.0 v2:172.21.15.6:6836/368324315 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x557405683f20 con 0x5574058deb70 2023-07-06T19:59:01.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.320+0000 7f3b367fc700 10 client.4437 handle_command_reply: tid=0 2023-07-06T19:59:01.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.320+0000 7f3b69bf2b80 1 client.4437 shutdown 2023-07-06T19:59:01.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.320+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/3620575191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740592aae0 msgr2=0x557405905210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:01.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.320+0000 7f3b69bf2b80 1 --2- 172.21.15.6:0/3620575191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740592aae0 0x557405905210 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3b5005a4d0 tx=0x7f3b5008a020 comp rx=0 tx=0).stop 2023-07-06T19:59:01.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.320+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/3620575191 shutdown_connections 2023-07-06T19:59:01.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.320+0000 7f3b69bf2b80 1 --2- 172.21.15.6:0/3620575191 >> [v2:172.21.15.6:6836/368324315,v1:172.21.15.6:6837/368324315] conn(0x5574058deb70 0x557405946110 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.320+0000 7f3b69bf2b80 1 --2- 172.21.15.6:0/3620575191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55740592aae0 0x557405905210 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.320+0000 7f3b69bf2b80 1 --2- 172.21.15.6:0/3620575191 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55740590b5a0 0x557405994900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.320+0000 7f3b69bf2b80 1 --2- 172.21.15.6:0/3620575191 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55740592a670 0x557405904cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.320+0000 7f3b367fc700 0 client.4437 ms_handle_reset on v2:172.21.15.6:6836/368324315 2023-07-06T19:59:01.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.320+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/3620575191 >> 172.21.15.6:0/3620575191 conn(0x5574058d8e80 msgr2=0x5574058e07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:01.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.320+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/3620575191 shutdown_connections 2023-07-06T19:59:01.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.320+0000 7f3b69bf2b80 1 -- 172.21.15.6:0/3620575191 wait complete. 2023-07-06T19:59:01.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.320+0000 7f3b69bf2b80 20 client.4437 trim_cache size 0 max 16384 2023-07-06T19:59:01.366 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-06T19:59:01.367 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "59b158c6-5d9d-4877-b4e7-a584e294fb2e", 2023-07-06T19:59:01.367 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-07-06T19:59:01.367 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4284, 2023-07-06T19:59:01.367 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-07-06T19:59:01.367 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-07-06T19:59:01.367 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-07-06T19:59:01.367 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 7.5936994179999999, 2023-07-06T19:59:01.368 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 7, 2023-07-06T19:59:01.368 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 27, 2023-07-06T19:59:01.368 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 27, 2023-07-06T19:59:01.368 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 13.497926943 2023-07-06T19:59:01.368 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-06T19:59:01.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.321+0000 7f3b5da6d700 1 -- 172.21.15.6:0/4243923025 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3b4406ace0 msgr2=0x7f3b4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:01.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.321+0000 7f3b5da6d700 1 --2- 172.21.15.6:0/4243923025 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3b4406ace0 0x7f3b4406d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3b48000f60 tx=0x7f3b48009040 comp rx=0 tx=0).stop 2023-07-06T19:59:01.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.321+0000 7f3b5da6d700 1 -- 172.21.15.6:0/4243923025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b580cefe0 msgr2=0x7f3b580c34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:01.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.321+0000 7f3b5da6d700 1 --2- 172.21.15.6:0/4243923025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b580cefe0 0x7f3b580c34b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3b580ccbd0 tx=0x7f3b50004ad0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.321+0000 7f3b5da6d700 1 -- 172.21.15.6:0/4243923025 shutdown_connections 2023-07-06T19:59:01.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.321+0000 7f3b5da6d700 1 --2- 172.21.15.6:0/4243923025 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3b4406ace0 0x7f3b4406d190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.321+0000 7f3b5da6d700 1 --2- 172.21.15.6:0/4243923025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b580cefe0 0x7f3b580c34b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.321+0000 7f3b5da6d700 1 --2- 172.21.15.6:0/4243923025 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b5806c040 0x7f3b580c5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.321+0000 7f3b5da6d700 1 --2- 172.21.15.6:0/4243923025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b580cd630 0x7f3b5814d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.321+0000 7f3b5da6d700 1 -- 172.21.15.6:0/4243923025 >> 172.21.15.6:0/4243923025 conn(0x7f3b580b0b60 msgr2=0x7f3b580ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:01.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.321+0000 7f3b5da6d700 1 -- 172.21.15.6:0/4243923025 shutdown_connections 2023-07-06T19:59:01.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.321+0000 7f3b5da6d700 1 -- 172.21.15.6:0/4243923025 wait complete. 2023-07-06T19:59:01.372 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-06T19:59:01.373 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-06T19:59:01.373 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T19:59:01.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.498+0000 7f9dcfda5700 1 Processor -- start 2023-07-06T19:59:01.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.498+0000 7f9dcfda5700 1 -- start start 2023-07-06T19:59:01.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.499+0000 7f9dcfda5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9dc806e170 0x7f9dc80caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.499+0000 7f9dcfda5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dc80cb3f0 0x7f9dc815aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.499+0000 7f9dcfda5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc815ebd0 con 0x7f9dc80b47e0 2023-07-06T19:59:01.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.499+0000 7f9dcfda5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc806e5f0 con 0x7f9dc806e170 2023-07-06T19:59:01.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.499+0000 7f9dcfda5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc80cb870 con 0x7f9dc80cb3f0 2023-07-06T19:59:01.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.499+0000 7f9dce342700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dc80cb3f0 0x7f9dc815aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.499+0000 7f9dcd340700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9dc806e170 0x7f9dc80caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.499+0000 7f9dce342700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dc80cb3f0 0x7f9dc815aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:51142/0 (socket says 172.21.15.6:51142) 2023-07-06T19:59:01.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.499+0000 7f9dcdb41700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9dc80b47e0 0x7f9dc806a060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:49576/0 (socket says 172.21.15.6:49576) 2023-07-06T19:59:01.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.499+0000 7f9dce342700 1 -- 172.21.15.6:0/929295308 learned_addr learned my addr 172.21.15.6:0/929295308 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:01.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.500+0000 7f9dce342700 1 -- 172.21.15.6:0/929295308 >> v2:172.21.15.40:3300/0 conn(0x7f9dc806e170 msgr2=0x7f9dc80caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:01.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.500+0000 7f9dce342700 1 --2- 172.21.15.6:0/929295308 >> v2:172.21.15.40:3300/0 conn(0x7f9dc806e170 0x7f9dc80caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.500+0000 7f9dce342700 1 -- 172.21.15.6:0/929295308 >> v1:172.21.15.40:6789/0 conn(0x7f9dc80b47e0 legacy=0x7f9dc806a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:01.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.500+0000 7f9dce342700 1 -- 172.21.15.6:0/929295308 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc815dfc0 con 0x7f9dc80cb3f0 2023-07-06T19:59:01.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.500+0000 7f9dcd340700 1 --2- 172.21.15.6:0/929295308 >> v2:172.21.15.40:3300/0 conn(0x7f9dc806e170 0x7f9dc80caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:59:01.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.500+0000 7f9dce342700 1 --2- 172.21.15.6:0/929295308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dc80cb3f0 0x7f9dc815aa50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0009e50 tx=0x7f9dc000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de036632ea4b17f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:01.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.500+0000 7f9dccb3f700 1 -- 172.21.15.6:0/929295308 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc000e070 con 0x7f9dc80cb3f0 2023-07-06T19:59:01.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.500+0000 7f9dccb3f700 1 -- 172.21.15.6:0/929295308 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc000b910 con 0x7f9dc80cb3f0 2023-07-06T19:59:01.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.500+0000 7f9dccb3f700 1 -- 172.21.15.6:0/929295308 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc000bcc0 con 0x7f9dc80cb3f0 2023-07-06T19:59:01.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.500+0000 7f9dcfda5700 1 -- 172.21.15.6:0/929295308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dc80cb3f0 msgr2=0x7f9dc815aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:01.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.500+0000 7f9dcfda5700 1 --2- 172.21.15.6:0/929295308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dc80cb3f0 0x7f9dc815aa50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0009e50 tx=0x7f9dc000b330 comp rx=0 tx=0).stop 2023-07-06T19:59:01.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.500+0000 7f9dcfda5700 1 -- 172.21.15.6:0/929295308 shutdown_connections 2023-07-06T19:59:01.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.500+0000 7f9dcfda5700 1 --2- 172.21.15.6:0/929295308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dc80cb3f0 0x7f9dc815aa50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.500+0000 7f9dcfda5700 1 --2- 172.21.15.6:0/929295308 >> v2:172.21.15.40:3300/0 conn(0x7f9dc806e170 0x7f9dc80caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.500+0000 7f9dcfda5700 1 -- 172.21.15.6:0/929295308 >> 172.21.15.6:0/929295308 conn(0x7f9dc80cf0f0 msgr2=0x7f9dc80cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:01.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.501+0000 7f9dcfda5700 1 -- 172.21.15.6:0/929295308 shutdown_connections 2023-07-06T19:59:01.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.501+0000 7f9dcfda5700 1 -- 172.21.15.6:0/929295308 wait complete. 2023-07-06T19:59:01.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.502+0000 7f9dcfda5700 1 Processor -- start 2023-07-06T19:59:01.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.502+0000 7f9dcfda5700 1 -- start start 2023-07-06T19:59:01.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.502+0000 7f9dcfda5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dc806e170 0x7f9dc8152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.502+0000 7f9dcfda5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dc80b47e0 0x7f9dc8151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.502+0000 7f9dcfda5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dc80cb3f0 0x7f9dc815a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.502+0000 7f9dcfda5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc80c3ef0 con 0x7f9dc80b47e0 2023-07-06T19:59:01.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.502+0000 7f9dcfda5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc815b380 con 0x7f9dc806e170 2023-07-06T19:59:01.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.502+0000 7f9dcfda5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc815b660 con 0x7f9dc80cb3f0 2023-07-06T19:59:01.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.503+0000 7f9dcd340700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dc80b47e0 0x7f9dc8151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.503+0000 7f9dcd340700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dc80b47e0 0x7f9dc8151b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58502/0 (socket says 172.21.15.6:58502) 2023-07-06T19:59:01.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.503+0000 7f9dcd340700 1 -- 172.21.15.6:0/2800348951 learned_addr learned my addr 172.21.15.6:0/2800348951 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:01.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.503+0000 7f9dcdb41700 1 --2- 172.21.15.6:0/2800348951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dc806e170 0x7f9dc8152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.503+0000 7f9dce342700 1 --2- 172.21.15.6:0/2800348951 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dc80cb3f0 0x7f9dc815a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.503+0000 7f9dcd340700 1 -- 172.21.15.6:0/2800348951 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dc80cb3f0 msgr2=0x7f9dc815a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:01.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.503+0000 7f9dcd340700 1 --2- 172.21.15.6:0/2800348951 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dc80cb3f0 0x7f9dc815a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.503+0000 7f9dcd340700 1 -- 172.21.15.6:0/2800348951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dc806e170 msgr2=0x7f9dc8152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:01.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.503+0000 7f9dcd340700 1 --2- 172.21.15.6:0/2800348951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dc806e170 0x7f9dc8152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.503+0000 7f9dcd340700 1 -- 172.21.15.6:0/2800348951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc40094a0 con 0x7f9dc80b47e0 2023-07-06T19:59:01.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.503+0000 7f9dcd340700 1 --2- 172.21.15.6:0/2800348951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dc80b47e0 0x7f9dc8151b90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400ebe0 tx=0x7f9dc400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:01.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.503+0000 7f9dbe7fc700 1 -- 172.21.15.6:0/2800348951 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4009760 con 0x7f9dc80b47e0 2023-07-06T19:59:01.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.503+0000 7f9dbe7fc700 1 -- 172.21.15.6:0/2800348951 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc400c850 con 0x7f9dc80b47e0 2023-07-06T19:59:01.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.503+0000 7f9dcfda5700 1 -- 172.21.15.6:0/2800348951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc0009b30 con 0x7f9dc80b47e0 2023-07-06T19:59:01.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.503+0000 7f9dbe7fc700 1 -- 172.21.15.6:0/2800348951 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc400cbe0 con 0x7f9dc80b47e0 2023-07-06T19:59:01.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.503+0000 7f9dcfda5700 1 -- 172.21.15.6:0/2800348951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc81520d0 con 0x7f9dc80b47e0 2023-07-06T19:59:01.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.504+0000 7f9dcfda5700 1 -- 172.21.15.6:0/2800348951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc80c4160 con 0x7f9dc80b47e0 2023-07-06T19:59:01.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.505+0000 7f9dbe7fc700 1 -- 172.21.15.6:0/2800348951 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9dc400cd40 con 0x7f9dc80b47e0 2023-07-06T19:59:01.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.505+0000 7f9dbe7fc700 1 --2- 172.21.15.6:0/2800348951 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f9dac06ace0 0x7f9dac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:01.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.505+0000 7f9dbe7fc700 1 -- 172.21.15.6:0/2800348951 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9dc4089720 con 0x7f9dc80b47e0 2023-07-06T19:59:01.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.505+0000 7f9dcdb41700 1 --2- 172.21.15.6:0/2800348951 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f9dac06ace0 0x7f9dac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:01.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.506+0000 7f9dcdb41700 1 --2- 172.21.15.6:0/2800348951 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f9dac06ace0 0x7f9dac06d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9db8000f60 tx=0x7f9db8007ed0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:01.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.510+0000 7f9dbe7fc700 1 -- 172.21.15.6:0/2800348951 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9dc4054570 con 0x7f9dc80b47e0 2023-07-06T19:59:01.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.751+0000 7f9dcfda5700 1 -- 172.21.15.6:0/2800348951 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9dc8074200 con 0x7f9dc80b47e0 2023-07-06T19:59:01.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.751+0000 7f9dbe7fc700 1 -- 172.21.15.6:0/2800348951 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9dc4057b90 con 0x7f9dc80b47e0 2023-07-06T19:59:01.754 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-06T19:59:01.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.754+0000 7f9dcfda5700 1 -- 172.21.15.6:0/2800348951 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f9dac06ace0 msgr2=0x7f9dac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:01.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.754+0000 7f9dcfda5700 1 --2- 172.21.15.6:0/2800348951 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f9dac06ace0 0x7f9dac06d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9db8000f60 tx=0x7f9db8007ed0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.754+0000 7f9dcfda5700 1 -- 172.21.15.6:0/2800348951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dc80b47e0 msgr2=0x7f9dc8151b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:01.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.754+0000 7f9dcfda5700 1 --2- 172.21.15.6:0/2800348951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dc80b47e0 0x7f9dc8151b90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400ebe0 tx=0x7f9dc400eef0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.754+0000 7f9dcfda5700 1 -- 172.21.15.6:0/2800348951 shutdown_connections 2023-07-06T19:59:01.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.754+0000 7f9dcfda5700 1 --2- 172.21.15.6:0/2800348951 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f9dac06ace0 0x7f9dac06d190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.754+0000 7f9dcfda5700 1 --2- 172.21.15.6:0/2800348951 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9dc80cb3f0 0x7f9dc815a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.754+0000 7f9dcfda5700 1 --2- 172.21.15.6:0/2800348951 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dc806e170 0x7f9dc8152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.754+0000 7f9dcfda5700 1 --2- 172.21.15.6:0/2800348951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9dc80b47e0 0x7f9dc8151b90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:01.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.754+0000 7f9dcfda5700 1 -- 172.21.15.6:0/2800348951 >> 172.21.15.6:0/2800348951 conn(0x7f9dc80cf0f0 msgr2=0x7f9dc80cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:01.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.754+0000 7f9dcfda5700 1 -- 172.21.15.6:0/2800348951 shutdown_connections 2023-07-06T19:59:01.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:01.754+0000 7f9dcfda5700 1 -- 172.21.15.6:0/2800348951 wait complete. 2023-07-06T19:59:01.770 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-06T19:59:01.770 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T19:59:01.770 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-07-06T19:59:01.771 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-07-06T19:59:01.771 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-06T19:59:01.771 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-06T19:59:01.771 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-06T19:59:01.771 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T19:59:01.772 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-07-06T19:59:01.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:01.779 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-07-06T19:59:01.799 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T19:59:01.799 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T19:59:01.799 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T19:59:01.799 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:01.799 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-07-06T19:59:01.800 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:01.800 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T19:59:01.800 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-07-06T19:59:01.801 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T19:59:01.801 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-07-06T19:59:01.801 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T19:59:01.801 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-07-06T19:59:01.802 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-06T19:59:01.802 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42245sec preferred_lft 42245sec 2023-07-06T19:59:01.802 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-07-06T19:59:01.802 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:01.802 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T19:59:01.802 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-07-06T19:59:01.803 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-06T19:59:01.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:01.803 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-06T19:59:01.804 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-06T19:59:01.804 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add name ceph-brx type bridge 2023-07-06T19:59:01.804 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr flush dev ceph-brx 2023-07-06T19:59:01.812 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set ceph-brx up 2023-07-06T19:59:01.813 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-06T19:59:01.815 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-06T19:59:01.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:01.979 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T19:59:02.014 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-07-06T19:59:02.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:02.020 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-07-06T19:59:02.119 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-07-06T19:59:02.120 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T19:59:02.120 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-06T19:59:02.120 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-06T19:59:02.120 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T19:59:02.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:02.121 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-06T19:59:02.122 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-06T19:59:02.122 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-06T19:59:02.122 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-06T19:59:02.123 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-06T19:59:02.123 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-06T19:59:02.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:02.338 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-06T19:59:02.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:02.357 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2023-07-06T19:59:02.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:02.414 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-06T19:59:02.415 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-06T19:59:02.415 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-06T19:59:02.415 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-07-06T19:59:02.416 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-06T19:59:02.509 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-07-06T19:59:02.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:02.510 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-06T19:59:02.510 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-06T19:59:02.511 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-07-06T19:59:02.511 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-06T19:59:02.511 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-07-06T19:59:02.512 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-07-06T19:59:02.512 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-07-06T19:59:02.521 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-06T19:59:02.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:02.734 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-06T19:59:02.735 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-06T19:59:02.735 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-07-06T19:59:02.735 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.0 master ceph-brx 2023-07-06T19:59:02.736 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-06T19:59:02.845 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-07-06T19:59:02.845 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T19:59:02.846 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-07-06T19:59:02.869 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-07-06T19:59:02.869 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T19:59:02.870 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-07-06T19:59:02.929 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-07-06T19:59:02.997 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-06T19:59:02.998 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-06T19:59:03.067 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-06T19:59:03.068 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-06T19:59:03.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:03.073 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-07-06T19:59:03.130 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-06T19:59:03.131 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-07-06T19:59:03.173 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2023-07-06T19:59:03.201 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-06T19:59:03.202 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-06T19:59:03.272 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi006.stderr:2023-07-06T19:59:03.266+0000 7f3bc93475c0 -1 init, newargv = 0x558bca75f8e0 newargc=15 2023-07-06T19:59:03.273 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi006.stderr:ceph-fuse[109101]: starting ceph client 2023-07-06T19:59:03.273 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-06T19:59:03.274 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-06T19:59:03.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:03.275 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2023-07-06T19:59:03.275 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi006.stderr:ceph-fuse[109101]: starting fuse 2023-07-06T19:59:03.338 INFO:teuthology.orchestra.run.smithi006.stdout:47 2023-07-06T19:59:03.339 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-07-06T19:59:03.339 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-06T19:59:03.340 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2023-07-06T19:59:03.340 DEBUG:teuthology.orchestra.run.smithi006:> import re 2023-07-06T19:59:03.340 DEBUG:teuthology.orchestra.run.smithi006:> import os 2023-07-06T19:59:03.341 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2023-07-06T19:59:03.341 DEBUG:teuthology.orchestra.run.smithi006:> 2023-07-06T19:59:03.343 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2023-07-06T19:59:03.353 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-07-06T19:59:03.354 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2023-07-06T19:59:03.354 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-07-06T19:59:03.355 DEBUG:teuthology.orchestra.run.smithi006:> 2023-07-06T19:59:03.355 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2023-07-06T19:59:03.355 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2023-07-06T19:59:03.355 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2023-07-06T19:59:03.356 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2023-07-06T19:59:03.356 DEBUG:teuthology.orchestra.run.smithi006:> 2023-07-06T19:59:03.357 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2023-07-06T19:59:03.357 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-06T19:59:03.357 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-06T19:59:03.360 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-06T19:59:03.360 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2023-07-06T19:59:03.360 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2023-07-06T19:59:03.361 DEBUG:teuthology.orchestra.run.smithi006:> return f 2023-07-06T19:59:03.365 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-06T19:59:03.366 DEBUG:teuthology.orchestra.run.smithi006:> 2023-07-06T19:59:03.366 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.admin")) 2023-07-06T19:59:03.366 DEBUG:teuthology.orchestra.run.smithi006:> ' 2023-07-06T19:59:03.471 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.admin.109101.asok 2023-07-06T19:59:03.648 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.109101.asok 2023-07-06T19:59:03.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:03.649 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.109101.asok status 2023-07-06T19:59:03.815 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-06T19:59:03.816 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2023-07-06T19:59:03.816 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "79365bb3b803780276d69efb2cc4afe5b160de9e", 2023-07-06T19:59:03.816 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 18.0.0-4742-g79365bb3 (79365bb3b803780276d69efb2cc4afe5b160de9e) reef (dev)", 2023-07-06T19:59:03.816 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "admin", 2023-07-06T19:59:03.816 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2023-07-06T19:59:03.816 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-07-06T19:59:03.817 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "109101", 2023-07-06T19:59:03.817 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2023-07-06T19:59:03.817 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T19:59:03.817 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2023-07-06T19:59:03.817 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2023-07-06T19:59:03.817 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4449, 2023-07-06T19:59:03.820 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2023-07-06T19:59:03.821 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2023-07-06T19:59:03.821 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2023-07-06T19:59:03.821 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 4449 2023-07-06T19:59:03.821 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T19:59:03.821 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-07-06T19:59:03.822 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-07-06T19:59:03.824 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-07-06T19:59:03.824 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 670744184 2023-07-06T19:59:03.824 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T19:59:03.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T19:59:03.824 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2023-07-06T19:59:03.825 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-07-06T19:59:03.825 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2023-07-06T19:59:03.825 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 670744184 2023-07-06T19:59:03.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T19:59:03.825 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.4449 192.168.0.1:0/670744184", 2023-07-06T19:59:03.826 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/670744184", 2023-07-06T19:59:03.826 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2023-07-06T19:59:03.826 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 7, 2023-07-06T19:59:03.826 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 27, 2023-07-06T19:59:03.826 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2023-07-06T19:59:03.826 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2023-07-06T19:59:03.826 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2023-07-06T19:59:03.827 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-06T19:59:03.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:03.829 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2023-07-06T19:59:03.829 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-07-06T19:59:03.848 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2023-07-06T19:59:03.848 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-07-06T19:59:03.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:03.849 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-07-06T19:59:03.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:03.920 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-07-06T19:59:04.032 INFO:teuthology.orchestra.run.smithi006.stdout:# file: . 2023-07-06T19:59:04.032 INFO:teuthology.orchestra.run.smithi006.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-07-06T19:59:04.032 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:04.033 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:59:04.033 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T19:59:04.051 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T19:59:04.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.212+0000 7f549d572700 1 Processor -- start 2023-07-06T19:59:04.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.212+0000 7f549d572700 1 -- start start 2023-07-06T19:59:04.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.213+0000 7f549d572700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5498159ae0 0x7f5498158860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:04.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.213+0000 7f549d572700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f54980b2330 0x7f54980b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:04.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.213+0000 7f549d572700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f549806d260 0x7f549806d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:04.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.213+0000 7f549d572700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5498158da0 con 0x7f54980b2330 2023-07-06T19:59:04.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.213+0000 7f549d572700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54980b2d80 con 0x7f549806d260 2023-07-06T19:59:04.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.213+0000 7f549d572700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5498159000 con 0x7f5498159ae0 2023-07-06T19:59:04.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.213+0000 7f54967fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f54980b2330 0x7f54980b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:04.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.213+0000 7f54967fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f54980b2330 0x7f54980b27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58528/0 (socket says 172.21.15.6:58528) 2023-07-06T19:59:04.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.213+0000 7f54967fc700 1 -- 172.21.15.6:0/1181685519 learned_addr learned my addr 172.21.15.6:0/1181685519 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:04.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.214+0000 7f5496ffd700 1 --2- 172.21.15.6:0/1181685519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5498159ae0 0x7f5498158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:04.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.214+0000 7f54977fe700 1 --2- 172.21.15.6:0/1181685519 >> v2:172.21.15.40:3300/0 conn(0x7f549806d260 0x7f549806d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:04.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.214+0000 7f54967fc700 1 -- 172.21.15.6:0/1181685519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5498159ae0 msgr2=0x7f5498158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:04.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.214+0000 7f54967fc700 1 --2- 172.21.15.6:0/1181685519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5498159ae0 0x7f5498158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.214+0000 7f54967fc700 1 -- 172.21.15.6:0/1181685519 >> v2:172.21.15.40:3300/0 conn(0x7f549806d260 msgr2=0x7f549806d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:04.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.214+0000 7f54967fc700 1 --2- 172.21.15.6:0/1181685519 >> v2:172.21.15.40:3300/0 conn(0x7f549806d260 0x7f549806d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.214+0000 7f54967fc700 1 -- 172.21.15.6:0/1181685519 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54981592e0 con 0x7f54980b2330 2023-07-06T19:59:04.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.214+0000 7f5496ffd700 1 --2- 172.21.15.6:0/1181685519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5498159ae0 0x7f5498158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:04.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.214+0000 7f54977fe700 1 --2- 172.21.15.6:0/1181685519 >> v2:172.21.15.40:3300/0 conn(0x7f549806d260 0x7f549806d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.214+0000 7f54967fc700 1 --2- 172.21.15.6:0/1181685519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54980b2330 0x7f54980b27a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f549806cac0 tx=0x7f5480009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98fa0e662da90597 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.214+0000 7f5495ffb700 1 -- 172.21.15.6:0/1181685519 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548000b870 con 0x7f54980b2330 2023-07-06T19:59:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.214+0000 7f5495ffb700 1 -- 172.21.15.6:0/1181685519 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548000b9d0 con 0x7f54980b2330 2023-07-06T19:59:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.214+0000 7f5495ffb700 1 -- 172.21.15.6:0/1181685519 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548000bd60 con 0x7f54980b2330 2023-07-06T19:59:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.214+0000 7f549d572700 1 -- 172.21.15.6:0/1181685519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54980b2330 msgr2=0x7f54980b27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.214+0000 7f549d572700 1 --2- 172.21.15.6:0/1181685519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54980b2330 0x7f54980b27a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f549806cac0 tx=0x7f5480009bd0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.215+0000 7f549d572700 1 -- 172.21.15.6:0/1181685519 shutdown_connections 2023-07-06T19:59:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.215+0000 7f549d572700 1 --2- 172.21.15.6:0/1181685519 >> v2:172.21.15.40:3300/0 conn(0x7f549806d260 0x7f549806d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.215+0000 7f549d572700 1 --2- 172.21.15.6:0/1181685519 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5498159ae0 0x7f5498158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.215+0000 7f549d572700 1 --2- 172.21.15.6:0/1181685519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54980b2330 0x7f54980b27a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.215+0000 7f549d572700 1 -- 172.21.15.6:0/1181685519 >> 172.21.15.6:0/1181685519 conn(0x7f54980b05b0 msgr2=0x7f54980b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.215+0000 7f549d572700 1 -- 172.21.15.6:0/1181685519 shutdown_connections 2023-07-06T19:59:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.215+0000 7f549d572700 1 -- 172.21.15.6:0/1181685519 wait complete. 2023-07-06T19:59:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.216+0000 7f549d572700 1 Processor -- start 2023-07-06T19:59:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.216+0000 7f549d572700 1 -- start start 2023-07-06T19:59:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.217+0000 7f549d572700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549806d260 0x7f5498147070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:04.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.217+0000 7f549d572700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54980b2330 0x7f5498143970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:04.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.217+0000 7f549d572700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5498159ae0 0x7f54981479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:04.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.217+0000 7f549d572700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54981475b0 con 0x7f549806d260 2023-07-06T19:59:04.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.217+0000 7f549d572700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5498145ff0 con 0x7f54980b2330 2023-07-06T19:59:04.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.217+0000 7f549d572700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54981462b0 con 0x7f5498159ae0 2023-07-06T19:59:04.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.217+0000 7f5496ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549806d260 0x7f5498147070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:04.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.217+0000 7f5496ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549806d260 0x7f5498147070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58534/0 (socket says 172.21.15.6:58534) 2023-07-06T19:59:04.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.217+0000 7f5496ffd700 1 -- 172.21.15.6:0/2159383960 learned_addr learned my addr 172.21.15.6:0/2159383960 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:04.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.217+0000 7f54967fc700 1 --2- 172.21.15.6:0/2159383960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54980b2330 0x7f5498143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:04.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.217+0000 7f54977fe700 1 --2- 172.21.15.6:0/2159383960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5498159ae0 0x7f54981479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:04.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.217+0000 7f5496ffd700 1 -- 172.21.15.6:0/2159383960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5498159ae0 msgr2=0x7f54981479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:04.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.217+0000 7f5496ffd700 1 --2- 172.21.15.6:0/2159383960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5498159ae0 0x7f54981479e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.217+0000 7f5496ffd700 1 -- 172.21.15.6:0/2159383960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54980b2330 msgr2=0x7f5498143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:04.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.217+0000 7f5496ffd700 1 --2- 172.21.15.6:0/2159383960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54980b2330 0x7f5498143970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.217+0000 7f5496ffd700 1 -- 172.21.15.6:0/2159383960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5480009550 con 0x7f549806d260 2023-07-06T19:59:04.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.217+0000 7f5496ffd700 1 --2- 172.21.15.6:0/2159383960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549806d260 0x7f5498147070 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f548800c7f0 tx=0x7f548800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:04.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.217+0000 7f548f7fe700 1 -- 172.21.15.6:0/2159383960 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5488011800 con 0x7f549806d260 2023-07-06T19:59:04.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.218+0000 7f548f7fe700 1 -- 172.21.15.6:0/2159383960 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5488011960 con 0x7f549806d260 2023-07-06T19:59:04.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.218+0000 7f549d572700 1 -- 172.21.15.6:0/2159383960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5498146590 con 0x7f549806d260 2023-07-06T19:59:04.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.218+0000 7f548f7fe700 1 -- 172.21.15.6:0/2159383960 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5488011cf0 con 0x7f549806d260 2023-07-06T19:59:04.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.218+0000 7f549d572700 1 -- 172.21.15.6:0/2159383960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5498146b50 con 0x7f549806d260 2023-07-06T19:59:04.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.218+0000 7f549d572700 1 -- 172.21.15.6:0/2159383960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5498146ec0 con 0x7f549806d260 2023-07-06T19:59:04.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.219+0000 7f548f7fe700 1 -- 172.21.15.6:0/2159383960 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5488018360 con 0x7f549806d260 2023-07-06T19:59:04.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.219+0000 7f548f7fe700 1 --2- 172.21.15.6:0/2159383960 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f547806ace0 0x7f547806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:04.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.219+0000 7f548f7fe700 1 -- 172.21.15.6:0/2159383960 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5488089590 con 0x7f549806d260 2023-07-06T19:59:04.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.219+0000 7f54967fc700 1 --2- 172.21.15.6:0/2159383960 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f547806ace0 0x7f547806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:04.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.220+0000 7f54967fc700 1 --2- 172.21.15.6:0/2159383960 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f547806ace0 0x7f547806d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5480000c00 tx=0x7f5480008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:04.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.224+0000 7f548f7fe700 1 -- 172.21.15.6:0/2159383960 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5488054350 con 0x7f549806d260 2023-07-06T19:59:04.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.425+0000 7f549d572700 1 -- 172.21.15.6:0/2159383960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5498074200 con 0x7f549806d260 2023-07-06T19:59:04.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.426+0000 7f548f7fe700 1 -- 172.21.15.6:0/2159383960 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19964 (secure 0 0 0) 0x7f5488057970 con 0x7f549806d260 2023-07-06T19:59:04.430 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:04.430 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:58:58.202291+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T19:58:51.062712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T19:58:52.130350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T19:58:55.785128+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:59:04.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.428+0000 7f549d572700 1 -- 172.21.15.6:0/2159383960 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f547806ace0 msgr2=0x7f547806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:04.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.428+0000 7f549d572700 1 --2- 172.21.15.6:0/2159383960 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f547806ace0 0x7f547806d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5480000c00 tx=0x7f5480008030 comp rx=0 tx=0).stop 2023-07-06T19:59:04.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.428+0000 7f549d572700 1 -- 172.21.15.6:0/2159383960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549806d260 msgr2=0x7f5498147070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:04.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.428+0000 7f549d572700 1 --2- 172.21.15.6:0/2159383960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549806d260 0x7f5498147070 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f548800c7f0 tx=0x7f548800cb00 comp rx=0 tx=0).stop 2023-07-06T19:59:04.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.428+0000 7f549d572700 1 -- 172.21.15.6:0/2159383960 shutdown_connections 2023-07-06T19:59:04.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.428+0000 7f549d572700 1 --2- 172.21.15.6:0/2159383960 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f547806ace0 0x7f547806d190 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.428+0000 7f549d572700 1 --2- 172.21.15.6:0/2159383960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549806d260 0x7f5498147070 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.428+0000 7f549d572700 1 --2- 172.21.15.6:0/2159383960 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5498159ae0 0x7f54981479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.428+0000 7f549d572700 1 --2- 172.21.15.6:0/2159383960 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54980b2330 0x7f5498143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.428+0000 7f549d572700 1 -- 172.21.15.6:0/2159383960 >> 172.21.15.6:0/2159383960 conn(0x7f54980b05b0 msgr2=0x7f54980705c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:04.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.428+0000 7f549d572700 1 -- 172.21.15.6:0/2159383960 shutdown_connections 2023-07-06T19:59:04.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.428+0000 7f549d572700 1 -- 172.21.15.6:0/2159383960 wait complete. 2023-07-06T19:59:04.442 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T19:58:38.767727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T19:58:45.759808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T19:58:51.062712+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T19:58:52.130350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T19:58:55.785128+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T19:59:04.443 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T19:59:04.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.585+0000 7fd6101ea700 1 Processor -- start 2023-07-06T19:59:04.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.585+0000 7fd6101ea700 1 -- start start 2023-07-06T19:59:04.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.586+0000 7fd6101ea700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd608071900 0x7fd6080ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:04.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.586+0000 7fd6101ea700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd608071cd0 0x7fd6080ca680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:04.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.586+0000 7fd6101ea700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6080cb310 con 0x7fd60815bf50 2023-07-06T19:59:04.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.586+0000 7fd6101ea700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6080cdbf0 con 0x7fd608071900 2023-07-06T19:59:04.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.586+0000 7fd6101ea700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6080af070 con 0x7fd608071cd0 2023-07-06T19:59:04.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.586+0000 7fd60df86700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd608071900 0x7fd6080ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:04.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.586+0000 7fd60df86700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd608071900 0x7fd6080ca140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58542/0 (socket says 172.21.15.6:58542) 2023-07-06T19:59:04.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.586+0000 7fd60df86700 1 -- 172.21.15.6:0/2193936894 learned_addr learned my addr 172.21.15.6:0/2193936894 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:04.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.586+0000 7fd60d785700 1 --2- 172.21.15.6:0/2193936894 >> v2:172.21.15.40:3300/0 conn(0x7fd608071cd0 0x7fd6080ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:04.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.586+0000 7fd60df86700 1 -- 172.21.15.6:0/2193936894 >> v2:172.21.15.40:3300/0 conn(0x7fd608071cd0 msgr2=0x7fd6080ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:04.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.586+0000 7fd60df86700 1 --2- 172.21.15.6:0/2193936894 >> v2:172.21.15.40:3300/0 conn(0x7fd608071cd0 0x7fd6080ca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.586+0000 7fd60df86700 1 -- 172.21.15.6:0/2193936894 >> v1:172.21.15.40:6789/0 conn(0x7fd60815bf50 legacy=0x7fd60815c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:04.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.586+0000 7fd60df86700 1 -- 172.21.15.6:0/2193936894 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6080cad50 con 0x7fd608071900 2023-07-06T19:59:04.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.587+0000 7fd60df86700 1 --2- 172.21.15.6:0/2193936894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd608071900 0x7fd6080ca140 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd60806e9b0 tx=0x7fd5f8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791cf41dd34baf26 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:04.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.587+0000 7fd60cf84700 1 -- 172.21.15.6:0/2193936894 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8004230 con 0x7fd608071900 2023-07-06T19:59:04.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.587+0000 7fd60cf84700 1 -- 172.21.15.6:0/2193936894 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f8004390 con 0x7fd608071900 2023-07-06T19:59:04.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.587+0000 7fd60cf84700 1 -- 172.21.15.6:0/2193936894 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f80036a0 con 0x7fd608071900 2023-07-06T19:59:04.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.587+0000 7fd6101ea700 1 -- 172.21.15.6:0/2193936894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd608071900 msgr2=0x7fd6080ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:04.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.587+0000 7fd6101ea700 1 --2- 172.21.15.6:0/2193936894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd608071900 0x7fd6080ca140 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd60806e9b0 tx=0x7fd5f8009bd0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.587+0000 7fd6101ea700 1 -- 172.21.15.6:0/2193936894 shutdown_connections 2023-07-06T19:59:04.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.587+0000 7fd6101ea700 1 --2- 172.21.15.6:0/2193936894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd608071900 0x7fd6080ca140 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.587+0000 7fd6101ea700 1 --2- 172.21.15.6:0/2193936894 >> v2:172.21.15.40:3300/0 conn(0x7fd608071cd0 0x7fd6080ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.587+0000 7fd6101ea700 1 -- 172.21.15.6:0/2193936894 >> 172.21.15.6:0/2193936894 conn(0x7fd6080cf960 msgr2=0x7fd6080cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:04.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.587+0000 7fd6101ea700 1 -- 172.21.15.6:0/2193936894 shutdown_connections 2023-07-06T19:59:04.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.587+0000 7fd6101ea700 1 -- 172.21.15.6:0/2193936894 wait complete. 2023-07-06T19:59:04.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.589+0000 7fd6101ea700 1 Processor -- start 2023-07-06T19:59:04.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.589+0000 7fd6101ea700 1 -- start start 2023-07-06T19:59:04.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.589+0000 7fd6101ea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd608071900 0x7fd60814bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:04.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.589+0000 7fd6101ea700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd608071cd0 0x7fd60814f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:04.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.589+0000 7fd6101ea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd60815bf50 0x7fd60806ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:04.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.589+0000 7fd6101ea700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6080c44c0 con 0x7fd608071900 2023-07-06T19:59:04.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.589+0000 7fd6101ea700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6080c47a0 con 0x7fd608071cd0 2023-07-06T19:59:04.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.589+0000 7fd6101ea700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6080c4a80 con 0x7fd60815bf50 2023-07-06T19:59:04.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.590+0000 7fd60df86700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd608071900 0x7fd60814bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:04.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.590+0000 7fd60df86700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd608071900 0x7fd60814bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58548/0 (socket says 172.21.15.6:58548) 2023-07-06T19:59:04.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.590+0000 7fd60df86700 1 -- 172.21.15.6:0/3005670727 learned_addr learned my addr 172.21.15.6:0/3005670727 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:04.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.590+0000 7fd60d785700 1 --2- 172.21.15.6:0/3005670727 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd608071cd0 0x7fd60814f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:04.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.590+0000 7fd60e787700 1 --2- 172.21.15.6:0/3005670727 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd60815bf50 0x7fd60806ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:04.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.590+0000 7fd60df86700 1 -- 172.21.15.6:0/3005670727 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd60815bf50 msgr2=0x7fd60806ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:04.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.590+0000 7fd60df86700 1 --2- 172.21.15.6:0/3005670727 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd60815bf50 0x7fd60806ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.590+0000 7fd60df86700 1 -- 172.21.15.6:0/3005670727 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd608071cd0 msgr2=0x7fd60814f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:04.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.590+0000 7fd60df86700 1 --2- 172.21.15.6:0/3005670727 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd608071cd0 0x7fd60814f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.590+0000 7fd60df86700 1 -- 172.21.15.6:0/3005670727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f8009550 con 0x7fd608071900 2023-07-06T19:59:04.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.590+0000 7fd60df86700 1 --2- 172.21.15.6:0/3005670727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd608071900 0x7fd60814bdc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8009130 tx=0x7fd5f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:04.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.590+0000 7fd5fe7fc700 1 -- 172.21.15.6:0/3005670727 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8011630 con 0x7fd608071900 2023-07-06T19:59:04.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.590+0000 7fd5fe7fc700 1 -- 172.21.15.6:0/3005670727 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f8011790 con 0x7fd608071900 2023-07-06T19:59:04.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.590+0000 7fd6101ea700 1 -- 172.21.15.6:0/3005670727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6080c4d60 con 0x7fd608071900 2023-07-06T19:59:04.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.590+0000 7fd5fe7fc700 1 -- 172.21.15.6:0/3005670727 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8011b40 con 0x7fd608071900 2023-07-06T19:59:04.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.590+0000 7fd6101ea700 1 -- 172.21.15.6:0/3005670727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60814c300 con 0x7fd608071900 2023-07-06T19:59:04.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.591+0000 7fd6101ea700 1 -- 172.21.15.6:0/3005670727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd60804eb90 con 0x7fd608071900 2023-07-06T19:59:04.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.592+0000 7fd5fe7fc700 1 -- 172.21.15.6:0/3005670727 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd5f8011ca0 con 0x7fd608071900 2023-07-06T19:59:04.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.592+0000 7fd5fe7fc700 1 --2- 172.21.15.6:0/3005670727 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd5ec06ace0 0x7fd5ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:04.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.592+0000 7fd5fe7fc700 1 -- 172.21.15.6:0/3005670727 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd5f808ad70 con 0x7fd608071900 2023-07-06T19:59:04.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.592+0000 7fd60d785700 1 --2- 172.21.15.6:0/3005670727 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd5ec06ace0 0x7fd5ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:04.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.593+0000 7fd60d785700 1 --2- 172.21.15.6:0/3005670727 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd5ec06ace0 0x7fd5ec06d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd6080aff60 tx=0x7fd604008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:04.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.597+0000 7fd5fe7fc700 1 -- 172.21.15.6:0/3005670727 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd5f8055bd0 con 0x7fd608071900 2023-07-06T19:59:04.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.794+0000 7fd6101ea700 1 -- 172.21.15.6:0/3005670727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd6080b58e0 con 0x7fd608071900 2023-07-06T19:59:04.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.794+0000 7fd5fe7fc700 1 -- 172.21.15.6:0/3005670727 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd5f80591f0 con 0x7fd608071900 2023-07-06T19:59:04.798 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-06T19:59:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.796+0000 7fd6101ea700 1 -- 172.21.15.6:0/3005670727 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd5ec06ace0 msgr2=0x7fd5ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.796+0000 7fd6101ea700 1 --2- 172.21.15.6:0/3005670727 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd5ec06ace0 0x7fd5ec06d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd6080aff60 tx=0x7fd604008040 comp rx=0 tx=0).stop 2023-07-06T19:59:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.796+0000 7fd6101ea700 1 -- 172.21.15.6:0/3005670727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd608071900 msgr2=0x7fd60814bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.796+0000 7fd6101ea700 1 --2- 172.21.15.6:0/3005670727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd608071900 0x7fd60814bdc0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8009130 tx=0x7fd5f8004750 comp rx=0 tx=0).stop 2023-07-06T19:59:04.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.796+0000 7fd6101ea700 1 -- 172.21.15.6:0/3005670727 shutdown_connections 2023-07-06T19:59:04.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.796+0000 7fd6101ea700 1 --2- 172.21.15.6:0/3005670727 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd5ec06ace0 0x7fd5ec06d190 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.796+0000 7fd6101ea700 1 --2- 172.21.15.6:0/3005670727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd608071900 0x7fd60814bdc0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.796+0000 7fd6101ea700 1 --2- 172.21.15.6:0/3005670727 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd60815bf50 0x7fd60806ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.796+0000 7fd6101ea700 1 --2- 172.21.15.6:0/3005670727 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd608071cd0 0x7fd60814f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.797+0000 7fd6101ea700 1 -- 172.21.15.6:0/3005670727 >> 172.21.15.6:0/3005670727 conn(0x7fd6080cf960 msgr2=0x7fd60815f270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:04.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.797+0000 7fd6101ea700 1 -- 172.21.15.6:0/3005670727 shutdown_connections 2023-07-06T19:59:04.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.797+0000 7fd6101ea700 1 -- 172.21.15.6:0/3005670727 wait complete. 2023-07-06T19:59:04.825 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T19:59:04.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.955+0000 7f165e9d1700 1 Processor -- start 2023-07-06T19:59:04.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.955+0000 7f165e9d1700 1 -- start start 2023-07-06T19:59:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.956+0000 7f165e9d1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16580ca850 0x7f165815bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.956+0000 7f165e9d1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1658071cd0 0x7f165815c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.956+0000 7f165e9d1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16580cb310 con 0x7f1658071900 2023-07-06T19:59:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.956+0000 7f165e9d1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16580cdbf0 con 0x7f1658071cd0 2023-07-06T19:59:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.956+0000 7f165e9d1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165815c9d0 con 0x7f16580ca850 2023-07-06T19:59:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.956+0000 7f16577fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16580ca850 0x7f165815bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.956+0000 7f165cf6e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1658071cd0 0x7f165815c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.956+0000 7f1657fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1658071900 0x7f16580ca140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:49636/0 (socket says 172.21.15.6:49636) 2023-07-06T19:59:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.956+0000 7f16577fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16580ca850 0x7f165815bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:51202/0 (socket says 172.21.15.6:51202) 2023-07-06T19:59:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.956+0000 7f165cf6e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1658071cd0 0x7f165815c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:37596/0 (socket says 172.21.15.6:37596) 2023-07-06T19:59:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.956+0000 7f1657fff700 1 -- 172.21.15.6:0/1549671615 learned_addr learned my addr 172.21.15.6:0/1549671615 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.957+0000 7f16577fe700 1 -- 172.21.15.6:0/1549671615 >> v2:172.21.15.40:3300/0 conn(0x7f1658071cd0 msgr2=0x7f165815c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.957+0000 7f16577fe700 1 --2- 172.21.15.6:0/1549671615 >> v2:172.21.15.40:3300/0 conn(0x7f1658071cd0 0x7f165815c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.957+0000 7f16577fe700 1 -- 172.21.15.6:0/1549671615 >> v1:172.21.15.40:6789/0 conn(0x7f1658071900 legacy=0x7f16580ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.957+0000 7f1656ffd700 1 -- 172.21.15.6:0/1549671615 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2537141109 0 0) 0x7f16580cb310 con 0x7f1658071900 2023-07-06T19:59:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.957+0000 7f16577fe700 1 -- 172.21.15.6:0/1549671615 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16580af070 con 0x7f16580ca850 2023-07-06T19:59:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.957+0000 7f165cf6e700 1 --2- 172.21.15.6:0/1549671615 >> v2:172.21.15.40:3300/0 conn(0x7f1658071cd0 0x7f165815c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:59:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.957+0000 7f16577fe700 1 --2- 172.21.15.6:0/1549671615 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16580ca850 0x7f165815bf50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1640009840 tx=0x7f1640009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7e9080ac87c6bf5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.957+0000 7f1656ffd700 1 -- 172.21.15.6:0/1549671615 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640011830 con 0x7f16580ca850 2023-07-06T19:59:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.957+0000 7f1656ffd700 1 -- 172.21.15.6:0/1549671615 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1640011990 con 0x7f16580ca850 2023-07-06T19:59:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.957+0000 7f1656ffd700 1 -- 172.21.15.6:0/1549671615 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640011d20 con 0x7f16580ca850 2023-07-06T19:59:04.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.958+0000 7f165e9d1700 1 -- 172.21.15.6:0/1549671615 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16580ca850 msgr2=0x7f165815bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:04.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.958+0000 7f165e9d1700 1 --2- 172.21.15.6:0/1549671615 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16580ca850 0x7f165815bf50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1640009840 tx=0x7f1640009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:04.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.958+0000 7f165e9d1700 1 -- 172.21.15.6:0/1549671615 shutdown_connections 2023-07-06T19:59:04.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.958+0000 7f165e9d1700 1 --2- 172.21.15.6:0/1549671615 >> v2:172.21.15.40:3300/0 conn(0x7f1658071cd0 0x7f165815c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.958+0000 7f165e9d1700 1 --2- 172.21.15.6:0/1549671615 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f16580ca850 0x7f165815bf50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.958+0000 7f165e9d1700 1 -- 172.21.15.6:0/1549671615 >> 172.21.15.6:0/1549671615 conn(0x7f16580cf960 msgr2=0x7f16580cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.958+0000 7f165e9d1700 1 -- 172.21.15.6:0/1549671615 shutdown_connections 2023-07-06T19:59:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.958+0000 7f165e9d1700 1 -- 172.21.15.6:0/1549671615 wait complete. 2023-07-06T19:59:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.959+0000 7f165e9d1700 1 Processor -- start 2023-07-06T19:59:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.959+0000 7f165e9d1700 1 -- start start 2023-07-06T19:59:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.960+0000 7f165e9d1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1658071900 0x7f165814c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.960+0000 7f165e9d1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1658071cd0 0x7f16580c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.960+0000 7f165e9d1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16580ca850 0x7f165806bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.960+0000 7f165e9d1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16580ab8c0 con 0x7f1658071900 2023-07-06T19:59:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.960+0000 7f165e9d1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165814c590 con 0x7f16580ca850 2023-07-06T19:59:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.960+0000 7f165e9d1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16580c5730 con 0x7f1658071cd0 2023-07-06T19:59:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.960+0000 7f1657fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1658071900 0x7f165814c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.960+0000 7f1657fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1658071900 0x7f165814c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58562/0 (socket says 172.21.15.6:58562) 2023-07-06T19:59:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.960+0000 7f1657fff700 1 -- 172.21.15.6:0/3038561706 learned_addr learned my addr 172.21.15.6:0/3038561706 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.960+0000 7f16577fe700 1 --2- 172.21.15.6:0/3038561706 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1658071cd0 0x7f16580c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.960+0000 7f165cf6e700 1 --2- 172.21.15.6:0/3038561706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16580ca850 0x7f165806bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.960+0000 7f1657fff700 1 -- 172.21.15.6:0/3038561706 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1658071cd0 msgr2=0x7f16580c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:05.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.960+0000 7f1657fff700 1 --2- 172.21.15.6:0/3038561706 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1658071cd0 0x7f16580c4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.960+0000 7f1657fff700 1 -- 172.21.15.6:0/3038561706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16580ca850 msgr2=0x7f165806bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:05.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.960+0000 7f1657fff700 1 --2- 172.21.15.6:0/3038561706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16580ca850 0x7f165806bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.960+0000 7f1657fff700 1 -- 172.21.15.6:0/3038561706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1650009a70 con 0x7f1658071900 2023-07-06T19:59:05.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.961+0000 7f1657fff700 1 --2- 172.21.15.6:0/3038561706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1658071900 0x7f165814c050 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f164800c550 tx=0x7f164800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:05.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.961+0000 7f1654ff9700 1 -- 172.21.15.6:0/3038561706 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1648004c80 con 0x7f1658071900 2023-07-06T19:59:05.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.961+0000 7f1654ff9700 1 -- 172.21.15.6:0/3038561706 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1648004e00 con 0x7f1658071900 2023-07-06T19:59:05.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.961+0000 7f165e9d1700 1 -- 172.21.15.6:0/3038561706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16400094a0 con 0x7f1658071900 2023-07-06T19:59:05.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.961+0000 7f1654ff9700 1 -- 172.21.15.6:0/3038561706 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1648007310 con 0x7f1658071900 2023-07-06T19:59:05.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.961+0000 7f165e9d1700 1 -- 172.21.15.6:0/3038561706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16580c5cf0 con 0x7f1658071900 2023-07-06T19:59:05.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.962+0000 7f165e9d1700 1 -- 172.21.15.6:0/3038561706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f165804eb90 con 0x7f1658071900 2023-07-06T19:59:05.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.962+0000 7f1654ff9700 1 -- 172.21.15.6:0/3038561706 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1648007470 con 0x7f1658071900 2023-07-06T19:59:05.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.963+0000 7f1654ff9700 1 --2- 172.21.15.6:0/3038561706 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f163806ace0 0x7f163806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:05.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.963+0000 7f1654ff9700 1 -- 172.21.15.6:0/3038561706 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1648089340 con 0x7f1658071900 2023-07-06T19:59:05.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.963+0000 7f16577fe700 1 --2- 172.21.15.6:0/3038561706 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f163806ace0 0x7f163806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:05.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.963+0000 7f16577fe700 1 --2- 172.21.15.6:0/3038561706 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f163806ace0 0x7f163806d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f16580cac80 tx=0x7f1640008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:05.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:04.967+0000 7f1654ff9700 1 -- 172.21.15.6:0/3038561706 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f16480540f0 con 0x7f1658071900 2023-07-06T19:59:05.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.167+0000 7f165e9d1700 1 -- 172.21.15.6:0/3038561706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f16580b58e0 con 0x7f1658071900 2023-07-06T19:59:05.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.167+0000 7f1654ff9700 1 -- 172.21.15.6:0/3038561706 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1648057710 con 0x7f1658071900 2023-07-06T19:59:05.170 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-06T19:59:05.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.169+0000 7f165e9d1700 1 -- 172.21.15.6:0/3038561706 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f163806ace0 msgr2=0x7f163806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:05.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.169+0000 7f165e9d1700 1 --2- 172.21.15.6:0/3038561706 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f163806ace0 0x7f163806d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f16580cac80 tx=0x7f1640008030 comp rx=0 tx=0).stop 2023-07-06T19:59:05.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.169+0000 7f165e9d1700 1 -- 172.21.15.6:0/3038561706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1658071900 msgr2=0x7f165814c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:05.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.169+0000 7f165e9d1700 1 --2- 172.21.15.6:0/3038561706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1658071900 0x7f165814c050 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f164800c550 tx=0x7f164800c860 comp rx=0 tx=0).stop 2023-07-06T19:59:05.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.169+0000 7f165e9d1700 1 -- 172.21.15.6:0/3038561706 shutdown_connections 2023-07-06T19:59:05.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.169+0000 7f165e9d1700 1 --2- 172.21.15.6:0/3038561706 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f163806ace0 0x7f163806d190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.169+0000 7f165e9d1700 1 --2- 172.21.15.6:0/3038561706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1658071900 0x7f165814c050 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.169+0000 7f165e9d1700 1 --2- 172.21.15.6:0/3038561706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f16580ca850 0x7f165806bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.169+0000 7f165e9d1700 1 --2- 172.21.15.6:0/3038561706 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1658071cd0 0x7f16580c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.169+0000 7f165e9d1700 1 -- 172.21.15.6:0/3038561706 >> 172.21.15.6:0/3038561706 conn(0x7f16580cf960 msgr2=0x7f16580b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:05.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.170+0000 7f165e9d1700 1 -- 172.21.15.6:0/3038561706 shutdown_connections 2023-07-06T19:59:05.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.170+0000 7f165e9d1700 1 -- 172.21.15.6:0/3038561706 wait complete. 2023-07-06T19:59:05.185 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T19:59:05.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.310+0000 7f8e75201700 1 Processor -- start 2023-07-06T19:59:05.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.311+0000 7f8e75201700 1 -- start start 2023-07-06T19:59:05.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.311+0000 7f8e75201700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e7015c440 0x7f8e700caa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:05.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.311+0000 7f8e75201700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8e7015cf20 0x7f8e700719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:05.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.311+0000 7f8e75201700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e700aefe0 con 0x7f8e70071550 2023-07-06T19:59:05.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.311+0000 7f8e75201700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e70071ee0 con 0x7f8e7015cf20 2023-07-06T19:59:05.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.311+0000 7f8e75201700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7015d7e0 con 0x7f8e7015c440 2023-07-06T19:59:05.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.311+0000 7f8e6f59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8e7015cf20 0x7f8e700719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:05.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.312+0000 7f8e6f59e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8e7015cf20 0x7f8e700719a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58574/0 (socket says 172.21.15.6:58574) 2023-07-06T19:59:05.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.312+0000 7f8e6e59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8e70071550 0x7f8e7015c810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59778/0 (socket says 172.21.15.6:59778) 2023-07-06T19:59:05.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.312+0000 7f8e6f59e700 1 -- 172.21.15.6:0/3444225026 learned_addr learned my addr 172.21.15.6:0/3444225026 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:05.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.312+0000 7f8e6ed9d700 1 --2- 172.21.15.6:0/3444225026 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e7015c440 0x7f8e700caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:05.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.312+0000 7f8e6f59e700 1 -- 172.21.15.6:0/3444225026 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e7015c440 msgr2=0x7f8e700caa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:05.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.312+0000 7f8e6f59e700 1 --2- 172.21.15.6:0/3444225026 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e7015c440 0x7f8e700caa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.312+0000 7f8e6f59e700 1 -- 172.21.15.6:0/3444225026 >> v1:172.21.15.6:6789/0 conn(0x7f8e70071550 legacy=0x7f8e7015c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:05.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.312+0000 7f8e6dd9b700 1 -- 172.21.15.6:0/3444225026 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902593230 0 0) 0x7f8e700aefe0 con 0x7f8e70071550 2023-07-06T19:59:05.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.312+0000 7f8e6f59e700 1 -- 172.21.15.6:0/3444225026 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7015d500 con 0x7f8e7015cf20 2023-07-06T19:59:05.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.312+0000 7f8e6ed9d700 1 --2- 172.21.15.6:0/3444225026 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e7015c440 0x7f8e700caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:05.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.312+0000 7f8e6f59e700 1 --2- 172.21.15.6:0/3444225026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e7015cf20 0x7f8e700719a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8e68009e50 tx=0x7f8e6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75bec1cca6884c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:05.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.312+0000 7f8e6dd9b700 1 -- 172.21.15.6:0/3444225026 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6800e070 con 0x7f8e7015cf20 2023-07-06T19:59:05.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.312+0000 7f8e6dd9b700 1 -- 172.21.15.6:0/3444225026 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6800b9c0 con 0x7f8e7015cf20 2023-07-06T19:59:05.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.312+0000 7f8e6dd9b700 1 -- 172.21.15.6:0/3444225026 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6800bd70 con 0x7f8e7015cf20 2023-07-06T19:59:05.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.313+0000 7f8e75201700 1 -- 172.21.15.6:0/3444225026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e7015cf20 msgr2=0x7f8e700719a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:05.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.313+0000 7f8e75201700 1 --2- 172.21.15.6:0/3444225026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e7015cf20 0x7f8e700719a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8e68009e50 tx=0x7f8e6800b330 comp rx=0 tx=0).stop 2023-07-06T19:59:05.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.313+0000 7f8e75201700 1 -- 172.21.15.6:0/3444225026 shutdown_connections 2023-07-06T19:59:05.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.313+0000 7f8e75201700 1 --2- 172.21.15.6:0/3444225026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e7015cf20 0x7f8e700719a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.313+0000 7f8e75201700 1 --2- 172.21.15.6:0/3444225026 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e7015c440 0x7f8e700caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.313+0000 7f8e75201700 1 -- 172.21.15.6:0/3444225026 >> 172.21.15.6:0/3444225026 conn(0x7f8e700cf800 msgr2=0x7f8e700cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:05.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.313+0000 7f8e75201700 1 -- 172.21.15.6:0/3444225026 shutdown_connections 2023-07-06T19:59:05.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.313+0000 7f8e75201700 1 -- 172.21.15.6:0/3444225026 wait complete. 2023-07-06T19:59:05.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.314+0000 7f8e75201700 1 Processor -- start 2023-07-06T19:59:05.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.314+0000 7f8e75201700 1 -- start start 2023-07-06T19:59:05.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.315+0000 7f8e75201700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e70071550 0x7f8e701555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:05.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.315+0000 7f8e75201700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e7015c440 0x7f8e700b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:05.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.315+0000 7f8e75201700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e7015cf20 0x7f8e70154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:05.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.315+0000 7f8e75201700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e700b57d0 con 0x7f8e7015cf20 2023-07-06T19:59:05.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.315+0000 7f8e75201700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e70155e40 con 0x7f8e7015c440 2023-07-06T19:59:05.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.315+0000 7f8e75201700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e700c8f40 con 0x7f8e70071550 2023-07-06T19:59:05.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.315+0000 7f8e6f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e7015cf20 0x7f8e70154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:05.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.315+0000 7f8e6f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e7015cf20 0x7f8e70154d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58580/0 (socket says 172.21.15.6:58580) 2023-07-06T19:59:05.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.315+0000 7f8e6f59e700 1 -- 172.21.15.6:0/4186078625 learned_addr learned my addr 172.21.15.6:0/4186078625 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:05.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.315+0000 7f8e6ed9d700 1 --2- 172.21.15.6:0/4186078625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e70071550 0x7f8e701555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:05.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.315+0000 7f8e6e59c700 1 --2- 172.21.15.6:0/4186078625 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e7015c440 0x7f8e700b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:05.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.315+0000 7f8e6f59e700 1 -- 172.21.15.6:0/4186078625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e70071550 msgr2=0x7f8e701555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:05.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.315+0000 7f8e6f59e700 1 --2- 172.21.15.6:0/4186078625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e70071550 0x7f8e701555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.316+0000 7f8e6f59e700 1 -- 172.21.15.6:0/4186078625 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e7015c440 msgr2=0x7f8e700b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:05.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.316+0000 7f8e6f59e700 1 --2- 172.21.15.6:0/4186078625 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e7015c440 0x7f8e700b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.316+0000 7f8e6f59e700 1 -- 172.21.15.6:0/4186078625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e68009b30 con 0x7f8e7015cf20 2023-07-06T19:59:05.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.316+0000 7f8e6e59c700 1 --2- 172.21.15.6:0/4186078625 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e7015c440 0x7f8e700b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:05.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.316+0000 7f8e6f59e700 1 --2- 172.21.15.6:0/4186078625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e7015cf20 0x7f8e70154d60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800b730 tx=0x7f8e68004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:05.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.316+0000 7f8e577fe700 1 -- 172.21.15.6:0/4186078625 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e68003ea0 con 0x7f8e7015cf20 2023-07-06T19:59:05.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.316+0000 7f8e577fe700 1 -- 172.21.15.6:0/4186078625 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e680099b0 con 0x7f8e7015cf20 2023-07-06T19:59:05.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.316+0000 7f8e75201700 1 -- 172.21.15.6:0/4186078625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e700c9220 con 0x7f8e7015cf20 2023-07-06T19:59:05.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.316+0000 7f8e577fe700 1 -- 172.21.15.6:0/4186078625 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6801c680 con 0x7f8e7015cf20 2023-07-06T19:59:05.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.316+0000 7f8e75201700 1 -- 172.21.15.6:0/4186078625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e701e5dd0 con 0x7f8e7015cf20 2023-07-06T19:59:05.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.317+0000 7f8e75201700 1 -- 172.21.15.6:0/4186078625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e7004eb90 con 0x7f8e7015cf20 2023-07-06T19:59:05.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.317+0000 7f8e577fe700 1 -- 172.21.15.6:0/4186078625 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8e6801c7e0 con 0x7f8e7015cf20 2023-07-06T19:59:05.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.318+0000 7f8e577fe700 1 --2- 172.21.15.6:0/4186078625 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f8e5c06ace0 0x7f8e5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:05.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.318+0000 7f8e577fe700 1 -- 172.21.15.6:0/4186078625 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8e6808b220 con 0x7f8e7015cf20 2023-07-06T19:59:05.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.318+0000 7f8e6ed9d700 1 --2- 172.21.15.6:0/4186078625 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f8e5c06ace0 0x7f8e5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:05.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.318+0000 7f8e6ed9d700 1 --2- 172.21.15.6:0/4186078625 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f8e5c06ace0 0x7f8e5c06d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8e64006fd0 tx=0x7f8e64008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.322+0000 7f8e577fe700 1 -- 172.21.15.6:0/4186078625 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8e68056070 con 0x7f8e7015cf20 2023-07-06T19:59:05.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.519+0000 7f8e75201700 1 -- 172.21.15.6:0/4186078625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8e700c96e0 con 0x7f8e7015cf20 2023-07-06T19:59:05.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.519+0000 7f8e577fe700 1 -- 172.21.15.6:0/4186078625 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8e68059690 con 0x7f8e7015cf20 2023-07-06T19:59:05.523 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T19:59:05.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.521+0000 7f8e75201700 1 -- 172.21.15.6:0/4186078625 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f8e5c06ace0 msgr2=0x7f8e5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.521+0000 7f8e75201700 1 --2- 172.21.15.6:0/4186078625 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f8e5c06ace0 0x7f8e5c06d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8e64006fd0 tx=0x7f8e64008040 comp rx=0 tx=0).stop 2023-07-06T19:59:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.521+0000 7f8e75201700 1 -- 172.21.15.6:0/4186078625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e7015cf20 msgr2=0x7f8e70154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.521+0000 7f8e75201700 1 --2- 172.21.15.6:0/4186078625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e7015cf20 0x7f8e70154d60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800b730 tx=0x7f8e68004ad0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.521+0000 7f8e75201700 1 -- 172.21.15.6:0/4186078625 shutdown_connections 2023-07-06T19:59:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.521+0000 7f8e75201700 1 --2- 172.21.15.6:0/4186078625 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f8e5c06ace0 0x7f8e5c06d190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.521+0000 7f8e75201700 1 --2- 172.21.15.6:0/4186078625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e7015cf20 0x7f8e70154d60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.521+0000 7f8e75201700 1 --2- 172.21.15.6:0/4186078625 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8e70071550 0x7f8e701555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.521+0000 7f8e75201700 1 --2- 172.21.15.6:0/4186078625 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e7015c440 0x7f8e700b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.521+0000 7f8e75201700 1 -- 172.21.15.6:0/4186078625 >> 172.21.15.6:0/4186078625 conn(0x7f8e700cf800 msgr2=0x7f8e700cdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.521+0000 7f8e75201700 1 -- 172.21.15.6:0/4186078625 shutdown_connections 2023-07-06T19:59:05.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.521+0000 7f8e75201700 1 -- 172.21.15.6:0/4186078625 wait complete. 2023-07-06T19:59:05.536 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T19:59:05.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.662+0000 7f4387ccf700 1 Processor -- start 2023-07-06T19:59:05.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.662+0000 7f4387ccf700 1 -- start start 2023-07-06T19:59:05.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.663+0000 7f4387ccf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f438015a520 0x7f438006dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.663+0000 7f4387ccf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43800d15e0 0x7f438006e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.663+0000 7f4387ccf700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43800cd300 con 0x7f438006e690 2023-07-06T19:59:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.663+0000 7f4387ccf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43800b0290 con 0x7f438015a520 2023-07-06T19:59:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.663+0000 7f4387ccf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43800ccd80 con 0x7f43800d15e0 2023-07-06T19:59:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.663+0000 7f438626c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f438006e690 0x7f438015ded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59796/0 (socket says 172.21.15.6:59796) 2023-07-06T19:59:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.663+0000 7f438626c700 1 -- 172.21.15.6:0/989361088 learned_addr learned my addr 172.21.15.6:0/989361088 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.663+0000 7f438526a700 1 --2- 172.21.15.6:0/989361088 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43800d15e0 0x7f438006e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.663+0000 7f4385a6b700 1 --2- 172.21.15.6:0/989361088 >> v2:172.21.15.40:3300/0 conn(0x7f438015a520 0x7f438006dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.663+0000 7f4384a69700 1 -- 172.21.15.6:0/989361088 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261367781 0 0) 0x7f43800cd300 con 0x7f438006e690 2023-07-06T19:59:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.663+0000 7f4384a69700 1 -- 172.21.15.6:0/989361088 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f436c0035b0 con 0x7f438006e690 2023-07-06T19:59:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.663+0000 7f4384a69700 1 -- 172.21.15.6:0/989361088 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1022157657 0 0) 0x7f436c0035b0 con 0x7f438006e690 2023-07-06T19:59:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.663+0000 7f4384a69700 1 -- 172.21.15.6:0/989361088 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43800d15e0 msgr2=0x7f438006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.663+0000 7f4384a69700 1 --2- 172.21.15.6:0/989361088 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43800d15e0 0x7f438006e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.663+0000 7f4384a69700 1 -- 172.21.15.6:0/989361088 >> v2:172.21.15.40:3300/0 conn(0x7f438015a520 msgr2=0x7f438006dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.663+0000 7f4384a69700 1 --2- 172.21.15.6:0/989361088 >> v2:172.21.15.40:3300/0 conn(0x7f438015a520 0x7f438006dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.663+0000 7f4384a69700 1 -- 172.21.15.6:0/989361088 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43800cd020 con 0x7f438006e690 2023-07-06T19:59:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.663+0000 7f4384a69700 1 -- 172.21.15.6:0/989361088 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f43780019f0 con 0x7f438006e690 2023-07-06T19:59:05.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.663+0000 7f438526a700 1 --2- 172.21.15.6:0/989361088 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43800d15e0 0x7f438006e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:59:05.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.663+0000 7f4385a6b700 1 --2- 172.21.15.6:0/989361088 >> v2:172.21.15.40:3300/0 conn(0x7f438015a520 0x7f438006dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:59:05.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.663+0000 7f4384a69700 1 -- 172.21.15.6:0/989361088 >> v1:172.21.15.6:6789/0 conn(0x7f438006e690 legacy=0x7f438015ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:05.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.663+0000 7f4384a69700 1 --2- 172.21.15.6:0/989361088 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43800d15e0 0x7f436c003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.664+0000 7f4384a69700 1 --2- 172.21.15.6:0/989361088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f436c003f40 0x7f436c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.664+0000 7f4384a69700 1 --2- 172.21.15.6:0/989361088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f436c004d90 0x7f436c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.664+0000 7f4384a69700 1 -- 172.21.15.6:0/989361088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43800b0290 con 0x7f436c004d90 2023-07-06T19:59:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.664+0000 7f4384a69700 1 -- 172.21.15.6:0/989361088 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43800ccd80 con 0x7f436c003f40 2023-07-06T19:59:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.664+0000 7f4384a69700 1 -- 172.21.15.6:0/989361088 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436c00ba10 con 0x7f43800d15e0 2023-07-06T19:59:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.664+0000 7f438626c700 1 --2- 172.21.15.6:0/989361088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f436c004d90 0x7f436c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:05.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.664+0000 7f438526a700 1 --2- 172.21.15.6:0/989361088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f436c003f40 0x7f436c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.664+0000 7f4385a6b700 1 --2- 172.21.15.6:0/989361088 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43800d15e0 0x7f436c003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.664+0000 7f438626c700 1 -- 172.21.15.6:0/989361088 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43800d15e0 msgr2=0x7f436c003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.664+0000 7f438626c700 1 --2- 172.21.15.6:0/989361088 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43800d15e0 0x7f436c003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.664+0000 7f438626c700 1 -- 172.21.15.6:0/989361088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f436c003f40 msgr2=0x7f436c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:05.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.664+0000 7f438626c700 1 --2- 172.21.15.6:0/989361088 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f436c003f40 0x7f436c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.664+0000 7f438626c700 1 -- 172.21.15.6:0/989361088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43700094a0 con 0x7f436c004d90 2023-07-06T19:59:05.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.664+0000 7f438626c700 1 --2- 172.21.15.6:0/989361088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f436c004d90 0x7f436c005200 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f437800a860 tx=0x7f436c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455901701778081b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:05.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.664+0000 7f4384a69700 1 -- 172.21.15.6:0/989361088 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4378012600 con 0x7f436c004d90 2023-07-06T19:59:05.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.664+0000 7f4384a69700 1 -- 172.21.15.6:0/989361088 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4378012780 con 0x7f436c004d90 2023-07-06T19:59:05.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.664+0000 7f4384a69700 1 -- 172.21.15.6:0/989361088 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4378012b30 con 0x7f436c004d90 2023-07-06T19:59:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.665+0000 7f4387ccf700 1 -- 172.21.15.6:0/989361088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f436c004d90 msgr2=0x7f436c005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.665+0000 7f4387ccf700 1 --2- 172.21.15.6:0/989361088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f436c004d90 0x7f436c005200 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f437800a860 tx=0x7f436c005880 comp rx=0 tx=0).stop 2023-07-06T19:59:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.665+0000 7f438626c700 1 -- 172.21.15.6:0/989361088 reap_dead start 2023-07-06T19:59:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.665+0000 7f4387ccf700 1 -- 172.21.15.6:0/989361088 shutdown_connections 2023-07-06T19:59:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.665+0000 7f4387ccf700 1 -- 172.21.15.6:0/989361088 >> 172.21.15.6:0/989361088 conn(0x7f43800ce120 msgr2=0x7f43800d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.665+0000 7f4387ccf700 1 -- 172.21.15.6:0/989361088 shutdown_connections 2023-07-06T19:59:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.665+0000 7f4387ccf700 1 -- 172.21.15.6:0/989361088 wait complete. 2023-07-06T19:59:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.666+0000 7f4387ccf700 1 Processor -- start 2023-07-06T19:59:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.666+0000 7f4387ccf700 1 -- start start 2023-07-06T19:59:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.667+0000 7f4387ccf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f438014bf30 0x7f43800aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.667+0000 7f4387ccf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f438014c300 0x7f43800b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.667+0000 7f4387ccf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43800c6c90 0x7f43800b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.667+0000 7f4387ccf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43800b11e0 con 0x7f438014c300 2023-07-06T19:59:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.667+0000 7f4387ccf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43800b14c0 con 0x7f438014bf30 2023-07-06T19:59:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.667+0000 7f4387ccf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43800b17a0 con 0x7f43800c6c90 2023-07-06T19:59:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.667+0000 7f438526a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f438014c300 0x7f43800b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.667+0000 7f438526a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f438014c300 0x7f43800b0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58598/0 (socket says 172.21.15.6:58598) 2023-07-06T19:59:05.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.667+0000 7f438526a700 1 -- 172.21.15.6:0/2334302084 learned_addr learned my addr 172.21.15.6:0/2334302084 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:05.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.667+0000 7f438626c700 1 --2- 172.21.15.6:0/2334302084 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43800c6c90 0x7f43800b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:05.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.667+0000 7f4385a6b700 1 --2- 172.21.15.6:0/2334302084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f438014bf30 0x7f43800aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:05.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.667+0000 7f438526a700 1 -- 172.21.15.6:0/2334302084 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43800c6c90 msgr2=0x7f43800b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:05.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.667+0000 7f438526a700 1 --2- 172.21.15.6:0/2334302084 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43800c6c90 0x7f43800b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.667+0000 7f438526a700 1 -- 172.21.15.6:0/2334302084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f438014bf30 msgr2=0x7f43800aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.667+0000 7f438526a700 1 --2- 172.21.15.6:0/2334302084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f438014bf30 0x7f43800aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.667+0000 7f438526a700 1 -- 172.21.15.6:0/2334302084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43800b1a80 con 0x7f438014c300 2023-07-06T19:59:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.668+0000 7f438526a700 1 --2- 172.21.15.6:0/2334302084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f438014c300 0x7f43800b0460 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4370011ca0 tx=0x7f4370009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.668+0000 7f43767fc700 1 -- 172.21.15.6:0/2334302084 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437000fa00 con 0x7f438014c300 2023-07-06T19:59:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.668+0000 7f43767fc700 1 -- 172.21.15.6:0/2334302084 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437000fb60 con 0x7f438014c300 2023-07-06T19:59:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.668+0000 7f4387ccf700 1 -- 172.21.15.6:0/2334302084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43800b0ee0 con 0x7f438014c300 2023-07-06T19:59:05.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.668+0000 7f43767fc700 1 -- 172.21.15.6:0/2334302084 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4370004020 con 0x7f438014c300 2023-07-06T19:59:05.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.668+0000 7f4387ccf700 1 -- 172.21.15.6:0/2334302084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438006c0b0 con 0x7f438014c300 2023-07-06T19:59:05.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.669+0000 7f4387ccf700 1 -- 172.21.15.6:0/2334302084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f438004eb90 con 0x7f438014c300 2023-07-06T19:59:05.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.669+0000 7f43767fc700 1 -- 172.21.15.6:0/2334302084 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4370004180 con 0x7f438014c300 2023-07-06T19:59:05.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.669+0000 7f43767fc700 1 --2- 172.21.15.6:0/2334302084 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f436406ace0 0x7f436406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.670+0000 7f43767fc700 1 -- 172.21.15.6:0/2334302084 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4370089bc0 con 0x7f438014c300 2023-07-06T19:59:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.670+0000 7f4385a6b700 1 --2- 172.21.15.6:0/2334302084 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f436406ace0 0x7f436406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.670+0000 7f4385a6b700 1 --2- 172.21.15.6:0/2334302084 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f436406ace0 0x7f436406d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4380159c60 tx=0x7f437c009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:05.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.674+0000 7f43767fc700 1 -- 172.21.15.6:0/2334302084 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4370054a10 con 0x7f438014c300 2023-07-06T19:59:05.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.876+0000 7f4387ccf700 1 -- 172.21.15.6:0/2334302084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f43800d13c0 con 0x7f438014c300 2023-07-06T19:59:05.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.876+0000 7f43767fc700 1 -- 172.21.15.6:0/2334302084 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f43700220a0 con 0x7f438014c300 2023-07-06T19:59:05.882 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-06T19:59:05.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.878+0000 7f4387ccf700 1 -- 172.21.15.6:0/2334302084 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f436406ace0 msgr2=0x7f436406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:05.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.878+0000 7f4387ccf700 1 --2- 172.21.15.6:0/2334302084 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f436406ace0 0x7f436406d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4380159c60 tx=0x7f437c009210 comp rx=0 tx=0).stop 2023-07-06T19:59:05.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.878+0000 7f4387ccf700 1 -- 172.21.15.6:0/2334302084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f438014c300 msgr2=0x7f43800b0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:05.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.878+0000 7f4387ccf700 1 --2- 172.21.15.6:0/2334302084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f438014c300 0x7f43800b0460 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4370011ca0 tx=0x7f4370009e80 comp rx=0 tx=0).stop 2023-07-06T19:59:05.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.878+0000 7f4387ccf700 1 -- 172.21.15.6:0/2334302084 shutdown_connections 2023-07-06T19:59:05.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.878+0000 7f4387ccf700 1 --2- 172.21.15.6:0/2334302084 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f436406ace0 0x7f436406d190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.878+0000 7f4387ccf700 1 --2- 172.21.15.6:0/2334302084 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f43800c6c90 0x7f43800b09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.878+0000 7f4387ccf700 1 --2- 172.21.15.6:0/2334302084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f438014bf30 0x7f43800aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.878+0000 7f4387ccf700 1 --2- 172.21.15.6:0/2334302084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f438014c300 0x7f43800b0460 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:05.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.878+0000 7f4387ccf700 1 -- 172.21.15.6:0/2334302084 >> 172.21.15.6:0/2334302084 conn(0x7f43800ce120 msgr2=0x7f438015bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:05.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.878+0000 7f4387ccf700 1 -- 172.21.15.6:0/2334302084 shutdown_connections 2023-07-06T19:59:05.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:05.878+0000 7f4387ccf700 1 -- 172.21.15.6:0/2334302084 wait complete. 2023-07-06T19:59:05.895 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T19:59:06.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.023+0000 7f9329fe3700 1 Processor -- start 2023-07-06T19:59:06.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.023+0000 7f9329fe3700 1 -- start start 2023-07-06T19:59:06.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.024+0000 7f9329fe3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93240aef10 0x7f932415b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:06.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.024+0000 7f9329fe3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f932415de10 0x7f932415e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:06.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.024+0000 7f9329fe3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f932415e890 con 0x7f9324071690 2023-07-06T19:59:06.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.024+0000 7f9329fe3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9324151750 con 0x7f932415de10 2023-07-06T19:59:06.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.024+0000 7f9329fe3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932415eb70 con 0x7f93240aef10 2023-07-06T19:59:06.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.024+0000 7f93237fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93240aef10 0x7f932415b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:06.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.024+0000 7f9322ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f932415de10 0x7f932415e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:06.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.024+0000 7f9322ffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f932415de10 0x7f932415e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:37650/0 (socket says 172.21.15.6:37650) 2023-07-06T19:59:06.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.024+0000 7f9322ffd700 1 -- 172.21.15.6:0/2504301468 learned_addr learned my addr 172.21.15.6:0/2504301468 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:06.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.024+0000 7f9323fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9324071690 0x7f93240ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:49696/0 (socket says 172.21.15.6:49696) 2023-07-06T19:59:06.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.024+0000 7f93237fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93240aef10 0x7f932415b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:51260/0 (socket says 172.21.15.6:51260) 2023-07-06T19:59:06.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.024+0000 7f93237fe700 1 -- 172.21.15.6:0/2504301468 >> v2:172.21.15.40:3300/0 conn(0x7f932415de10 msgr2=0x7f932415e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:06.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.024+0000 7f93237fe700 1 --2- 172.21.15.6:0/2504301468 >> v2:172.21.15.40:3300/0 conn(0x7f932415de10 0x7f932415e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:06.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.024+0000 7f93237fe700 1 -- 172.21.15.6:0/2504301468 >> v1:172.21.15.40:6789/0 conn(0x7f9324071690 legacy=0x7f93240ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:06.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.025+0000 7f93237fe700 1 -- 172.21.15.6:0/2504301468 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932415ab70 con 0x7f93240aef10 2023-07-06T19:59:06.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.025+0000 7f9322ffd700 1 --2- 172.21.15.6:0/2504301468 >> v2:172.21.15.40:3300/0 conn(0x7f932415de10 0x7f932415e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:59:06.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.025+0000 7f93237fe700 1 --2- 172.21.15.6:0/2504301468 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93240aef10 0x7f932415b370 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9314009840 tx=0x7f9314009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f58adc4508e19b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:06.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.025+0000 7f93227fc700 1 -- 172.21.15.6:0/2504301468 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9314011830 con 0x7f93240aef10 2023-07-06T19:59:06.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.025+0000 7f93227fc700 1 -- 172.21.15.6:0/2504301468 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9314011990 con 0x7f93240aef10 2023-07-06T19:59:06.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.025+0000 7f93227fc700 1 -- 172.21.15.6:0/2504301468 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9314011d20 con 0x7f93240aef10 2023-07-06T19:59:06.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.025+0000 7f9329fe3700 1 -- 172.21.15.6:0/2504301468 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93240aef10 msgr2=0x7f932415b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:06.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.025+0000 7f9329fe3700 1 --2- 172.21.15.6:0/2504301468 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93240aef10 0x7f932415b370 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9314009840 tx=0x7f9314009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:06.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.025+0000 7f9329fe3700 1 -- 172.21.15.6:0/2504301468 shutdown_connections 2023-07-06T19:59:06.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.025+0000 7f9329fe3700 1 --2- 172.21.15.6:0/2504301468 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93240aef10 0x7f932415b370 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:06.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.025+0000 7f9329fe3700 1 --2- 172.21.15.6:0/2504301468 >> v2:172.21.15.40:3300/0 conn(0x7f932415de10 0x7f932415e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:06.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.025+0000 7f9329fe3700 1 -- 172.21.15.6:0/2504301468 >> 172.21.15.6:0/2504301468 conn(0x7f93240cf960 msgr2=0x7f93240cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:06.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.026+0000 7f9329fe3700 1 -- 172.21.15.6:0/2504301468 shutdown_connections 2023-07-06T19:59:06.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.026+0000 7f9329fe3700 1 -- 172.21.15.6:0/2504301468 wait complete. 2023-07-06T19:59:06.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.027+0000 7f9329fe3700 1 Processor -- start 2023-07-06T19:59:06.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.027+0000 7f9329fe3700 1 -- start start 2023-07-06T19:59:06.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.028+0000 7f9329fe3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9324071690 0x7f93240cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:06.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.028+0000 7f9329fe3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93240aef10 0x7f932414ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:06.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.028+0000 7f9329fe3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f932415de10 0x7f9324155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:06.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.028+0000 7f9329fe3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93240cf360 con 0x7f93240aef10 2023-07-06T19:59:06.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.028+0000 7f9329fe3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93240ce480 con 0x7f932415de10 2023-07-06T19:59:06.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.028+0000 7f9329fe3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93240ce750 con 0x7f9324071690 2023-07-06T19:59:06.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.028+0000 7f9322ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93240aef10 0x7f932414ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:06.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.028+0000 7f9322ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93240aef10 0x7f932414ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58622/0 (socket says 172.21.15.6:58622) 2023-07-06T19:59:06.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.028+0000 7f9322ffd700 1 -- 172.21.15.6:0/2770202688 learned_addr learned my addr 172.21.15.6:0/2770202688 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:06.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.028+0000 7f93237fe700 1 --2- 172.21.15.6:0/2770202688 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9324071690 0x7f93240cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:06.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.028+0000 7f9323fff700 1 --2- 172.21.15.6:0/2770202688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f932415de10 0x7f9324155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:06.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.028+0000 7f9322ffd700 1 -- 172.21.15.6:0/2770202688 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9324071690 msgr2=0x7f93240cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:06.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.028+0000 7f9322ffd700 1 --2- 172.21.15.6:0/2770202688 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9324071690 0x7f93240cdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:06.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.028+0000 7f9322ffd700 1 -- 172.21.15.6:0/2770202688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f932415de10 msgr2=0x7f9324155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:06.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.028+0000 7f9322ffd700 1 --2- 172.21.15.6:0/2770202688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f932415de10 0x7f9324155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:06.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.028+0000 7f9322ffd700 1 -- 172.21.15.6:0/2770202688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9318009550 con 0x7f93240aef10 2023-07-06T19:59:06.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.028+0000 7f9322ffd700 1 --2- 172.21.15.6:0/2770202688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93240aef10 0x7f932414ea10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f931800ebe0 tx=0x7f931800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:06.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.028+0000 7f930bfff700 1 -- 172.21.15.6:0/2770202688 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931800c850 con 0x7f93240aef10 2023-07-06T19:59:06.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.028+0000 7f930bfff700 1 -- 172.21.15.6:0/2770202688 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931800c9b0 con 0x7f93240aef10 2023-07-06T19:59:06.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.029+0000 7f9329fe3700 1 -- 172.21.15.6:0/2770202688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93140094a0 con 0x7f93240aef10 2023-07-06T19:59:06.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.029+0000 7f930bfff700 1 -- 172.21.15.6:0/2770202688 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931800cd60 con 0x7f93240aef10 2023-07-06T19:59:06.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.029+0000 7f9329fe3700 1 -- 172.21.15.6:0/2770202688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93240ced10 con 0x7f93240aef10 2023-07-06T19:59:06.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.030+0000 7f9329fe3700 1 -- 172.21.15.6:0/2770202688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93240cf510 con 0x7f93240aef10 2023-07-06T19:59:06.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.030+0000 7f930bfff700 1 -- 172.21.15.6:0/2770202688 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9318013470 con 0x7f93240aef10 2023-07-06T19:59:06.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.030+0000 7f930bfff700 1 --2- 172.21.15.6:0/2770202688 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f931006ace0 0x7f931006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:06.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.031+0000 7f930bfff700 1 -- 172.21.15.6:0/2770202688 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f93180897f0 con 0x7f93240aef10 2023-07-06T19:59:06.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.031+0000 7f93237fe700 1 --2- 172.21.15.6:0/2770202688 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f931006ace0 0x7f931006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:06.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.031+0000 7f93237fe700 1 --2- 172.21.15.6:0/2770202688 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f931006ace0 0x7f931006d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9314009fd0 tx=0x7f9314008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:06.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.035+0000 7f930bfff700 1 -- 172.21.15.6:0/2770202688 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f93240cf510 con 0x7f93240aef10 2023-07-06T19:59:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.230+0000 7f9329fe3700 1 -- 172.21.15.6:0/2770202688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f932406b980 con 0x7f93240aef10 2023-07-06T19:59:06.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.231+0000 7f930bfff700 1 -- 172.21.15.6:0/2770202688 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f93180545a0 con 0x7f93240aef10 2023-07-06T19:59:06.233 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T19:59:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.233+0000 7f9329fe3700 1 -- 172.21.15.6:0/2770202688 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f931006ace0 msgr2=0x7f931006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.233+0000 7f9329fe3700 1 --2- 172.21.15.6:0/2770202688 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f931006ace0 0x7f931006d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9314009fd0 tx=0x7f9314008030 comp rx=0 tx=0).stop 2023-07-06T19:59:06.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.233+0000 7f9329fe3700 1 -- 172.21.15.6:0/2770202688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93240aef10 msgr2=0x7f932414ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:06.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.233+0000 7f9329fe3700 1 --2- 172.21.15.6:0/2770202688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93240aef10 0x7f932414ea10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f931800ebe0 tx=0x7f931800eef0 comp rx=0 tx=0).stop 2023-07-06T19:59:06.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.233+0000 7f9329fe3700 1 -- 172.21.15.6:0/2770202688 shutdown_connections 2023-07-06T19:59:06.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.233+0000 7f9329fe3700 1 --2- 172.21.15.6:0/2770202688 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f931006ace0 0x7f931006d190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:06.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.233+0000 7f9329fe3700 1 --2- 172.21.15.6:0/2770202688 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f932415de10 0x7f9324155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:06.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.233+0000 7f9329fe3700 1 --2- 172.21.15.6:0/2770202688 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9324071690 0x7f93240cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:06.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.233+0000 7f9329fe3700 1 --2- 172.21.15.6:0/2770202688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93240aef10 0x7f932414ea10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:06.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.233+0000 7f9329fe3700 1 -- 172.21.15.6:0/2770202688 >> 172.21.15.6:0/2770202688 conn(0x7f93240cf960 msgr2=0x7f9324159060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:06.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.233+0000 7f9329fe3700 1 -- 172.21.15.6:0/2770202688 shutdown_connections 2023-07-06T19:59:06.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.233+0000 7f9329fe3700 1 -- 172.21.15.6:0/2770202688 wait complete. 2023-07-06T19:59:06.254 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T19:59:06.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.380+0000 7f1817d52700 1 Processor -- start 2023-07-06T19:59:06.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.380+0000 7f1817d52700 1 -- start start 2023-07-06T19:59:06.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.381+0000 7f1817d52700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18100d15e0 0x7f181006e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:06.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.381+0000 7f1817d52700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18100cd300 con 0x7f18100ce860 2023-07-06T19:59:06.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.381+0000 7f1817d52700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18100b0290 con 0x7f181015a520 2023-07-06T19:59:06.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.381+0000 7f1817d52700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18100ccd80 con 0x7f18100d15e0 2023-07-06T19:59:06.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.381+0000 7f18152ed700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18100d15e0 0x7f181006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:06.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.381+0000 7f18162ef700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f18100ce860 0x7f18100cecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59840/0 (socket says 172.21.15.6:59840) 2023-07-06T19:59:06.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.381+0000 7f18162ef700 1 -- 172.21.15.6:0/2558409668 learned_addr learned my addr 172.21.15.6:0/2558409668 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:06.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.381+0000 7f18152ed700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18100d15e0 0x7f181006e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58630/0 (socket says 172.21.15.6:58630) 2023-07-06T19:59:06.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.381+0000 7f18152ed700 1 -- 172.21.15.6:0/2558409668 >> v1:172.21.15.40:6789/0 conn(0x7f181015a520 legacy=0x7f181006dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:06.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.381+0000 7f18152ed700 1 -- 172.21.15.6:0/2558409668 >> v1:172.21.15.6:6789/0 conn(0x7f18100ce860 legacy=0x7f18100cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:06.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.382+0000 7f18152ed700 1 -- 172.21.15.6:0/2558409668 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18100cd020 con 0x7f18100d15e0 2023-07-06T19:59:06.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.381+0000 7f1814aec700 1 -- 172.21.15.6:0/2558409668 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 740460881 0 0) 0x7f18100cd300 con 0x7f18100ce860 2023-07-06T19:59:06.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.382+0000 7f18152ed700 1 --2- 172.21.15.6:0/2558409668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18100d15e0 0x7f181006e320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f180c009840 tx=0x7f180c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4660a471cc4b7e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:06.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.382+0000 7f1814aec700 1 -- 172.21.15.6:0/2558409668 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c011830 con 0x7f18100d15e0 2023-07-06T19:59:06.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.382+0000 7f1814aec700 1 -- 172.21.15.6:0/2558409668 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180c011990 con 0x7f18100d15e0 2023-07-06T19:59:06.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.382+0000 7f1814aec700 1 -- 172.21.15.6:0/2558409668 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c011d20 con 0x7f18100d15e0 2023-07-06T19:59:06.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.382+0000 7f1817d52700 1 -- 172.21.15.6:0/2558409668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18100d15e0 msgr2=0x7f181006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:06.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.382+0000 7f1817d52700 1 --2- 172.21.15.6:0/2558409668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18100d15e0 0x7f181006e320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f180c009840 tx=0x7f180c009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:06.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.382+0000 7f1817d52700 1 -- 172.21.15.6:0/2558409668 shutdown_connections 2023-07-06T19:59:06.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.382+0000 7f1817d52700 1 --2- 172.21.15.6:0/2558409668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18100d15e0 0x7f181006e320 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:06.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.382+0000 7f1817d52700 1 -- 172.21.15.6:0/2558409668 >> 172.21.15.6:0/2558409668 conn(0x7f18100ce120 msgr2=0x7f18100d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:06.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.382+0000 7f1817d52700 1 -- 172.21.15.6:0/2558409668 shutdown_connections 2023-07-06T19:59:06.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.382+0000 7f1817d52700 1 -- 172.21.15.6:0/2558409668 wait complete. 2023-07-06T19:59:06.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.384+0000 7f1817d52700 1 Processor -- start 2023-07-06T19:59:06.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.384+0000 7f1817d52700 1 -- start start 2023-07-06T19:59:06.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.385+0000 7f1817d52700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18100ce860 0x7f18100b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:06.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.385+0000 7f1817d52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18100d15e0 0x7f18100b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:06.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.385+0000 7f1817d52700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f181015a520 0x7f18101530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:06.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.385+0000 7f1817d52700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18100c5960 con 0x7f18100d15e0 2023-07-06T19:59:06.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.385+0000 7f1817d52700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18100c5bb0 con 0x7f181015a520 2023-07-06T19:59:06.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.385+0000 7f1817d52700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18100c5e90 con 0x7f18100ce860 2023-07-06T19:59:06.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.385+0000 7f18152ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18100d15e0 0x7f18100b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:06.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.385+0000 7f18152ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18100d15e0 0x7f18100b1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58636/0 (socket says 172.21.15.6:58636) 2023-07-06T19:59:06.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.385+0000 7f18152ed700 1 -- 172.21.15.6:0/2543414028 learned_addr learned my addr 172.21.15.6:0/2543414028 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:06.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.385+0000 7f1815aee700 1 --2- 172.21.15.6:0/2543414028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18100ce860 0x7f18100b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:06.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.385+0000 7f18162ef700 1 --2- 172.21.15.6:0/2543414028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f181015a520 0x7f18101530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:06.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.386+0000 7f18152ed700 1 -- 172.21.15.6:0/2543414028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18100ce860 msgr2=0x7f18100b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:06.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.386+0000 7f18152ed700 1 --2- 172.21.15.6:0/2543414028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18100ce860 0x7f18100b3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:06.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.386+0000 7f18152ed700 1 -- 172.21.15.6:0/2543414028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f181015a520 msgr2=0x7f18101530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:06.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.386+0000 7f18152ed700 1 --2- 172.21.15.6:0/2543414028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f181015a520 0x7f18101530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:06.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.386+0000 7f18152ed700 1 -- 172.21.15.6:0/2543414028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c0094a0 con 0x7f18100d15e0 2023-07-06T19:59:06.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.386+0000 7f18152ed700 1 --2- 172.21.15.6:0/2543414028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18100d15e0 0x7f18100b1a10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1810066bd0 tx=0x7f180c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:06.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.386+0000 7f18027fc700 1 -- 172.21.15.6:0/2543414028 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c01a7e0 con 0x7f18100d15e0 2023-07-06T19:59:06.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.386+0000 7f18027fc700 1 -- 172.21.15.6:0/2543414028 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180c01a940 con 0x7f18100d15e0 2023-07-06T19:59:06.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.386+0000 7f1817d52700 1 -- 172.21.15.6:0/2543414028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18100c6170 con 0x7f18100d15e0 2023-07-06T19:59:06.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.386+0000 7f18027fc700 1 -- 172.21.15.6:0/2543414028 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180c01acb0 con 0x7f18100d15e0 2023-07-06T19:59:06.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.386+0000 7f1817d52700 1 -- 172.21.15.6:0/2543414028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18100b3dc0 con 0x7f18100d15e0 2023-07-06T19:59:06.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.387+0000 7f1817d52700 1 -- 172.21.15.6:0/2543414028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18100c6690 con 0x7f18100d15e0 2023-07-06T19:59:06.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.388+0000 7f18027fc700 1 -- 172.21.15.6:0/2543414028 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f180c022070 con 0x7f18100d15e0 2023-07-06T19:59:06.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.388+0000 7f18027fc700 1 --2- 172.21.15.6:0/2543414028 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f17f406ace0 0x7f17f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:06.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.388+0000 7f1815aee700 1 --2- 172.21.15.6:0/2543414028 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f17f406ace0 0x7f17f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:06.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.388+0000 7f18027fc700 1 -- 172.21.15.6:0/2543414028 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f180c08a920 con 0x7f18100d15e0 2023-07-06T19:59:06.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.389+0000 7f1815aee700 1 --2- 172.21.15.6:0/2543414028 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f17f406ace0 0x7f17f406d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1804007fd0 tx=0x7f1804009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:06.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.393+0000 7f18027fc700 1 -- 172.21.15.6:0/2543414028 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f18100c6690 con 0x7f18100d15e0 2023-07-06T19:59:06.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.603+0000 7f1817d52700 1 -- 172.21.15.6:0/2543414028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f18100c6690 con 0x7f18100d15e0 2023-07-06T19:59:06.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.604+0000 7f18027fc700 1 -- 172.21.15.6:0/2543414028 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f18100c6690 con 0x7f18100d15e0 2023-07-06T19:59:06.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.606+0000 7f1817d52700 1 -- 172.21.15.6:0/2543414028 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f17f406ace0 msgr2=0x7f17f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:06.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.606+0000 7f1817d52700 1 --2- 172.21.15.6:0/2543414028 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f17f406ace0 0x7f17f406d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1804007fd0 tx=0x7f1804009040 comp rx=0 tx=0).stop 2023-07-06T19:59:06.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.606+0000 7f1817d52700 1 -- 172.21.15.6:0/2543414028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18100d15e0 msgr2=0x7f18100b1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:06.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.606+0000 7f1817d52700 1 --2- 172.21.15.6:0/2543414028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18100d15e0 0x7f18100b1a10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1810066bd0 tx=0x7f180c004750 comp rx=0 tx=0).stop 2023-07-06T19:59:06.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.606+0000 7f1817d52700 1 -- 172.21.15.6:0/2543414028 shutdown_connections 2023-07-06T19:59:06.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.606+0000 7f1817d52700 1 --2- 172.21.15.6:0/2543414028 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f17f406ace0 0x7f17f406d190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:06.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.606+0000 7f1817d52700 1 --2- 172.21.15.6:0/2543414028 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f181015a520 0x7f18101530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:06.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.606+0000 7f1817d52700 1 --2- 172.21.15.6:0/2543414028 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18100ce860 0x7f18100b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:06.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.606+0000 7f1817d52700 1 --2- 172.21.15.6:0/2543414028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18100d15e0 0x7f18100b1a10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:06.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.606+0000 7f1817d52700 1 -- 172.21.15.6:0/2543414028 >> 172.21.15.6:0/2543414028 conn(0x7f18100ce120 msgr2=0x7f1810158f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:06.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.606+0000 7f1817d52700 1 -- 172.21.15.6:0/2543414028 shutdown_connections 2023-07-06T19:59:06.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.606+0000 7f1817d52700 1 -- 172.21.15.6:0/2543414028 wait complete. 2023-07-06T19:59:06.634 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-07-06T19:59:06.636 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:59:06.637 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T19:59:06.660 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T19:59:06.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.823+0000 7fd68b6e2700 1 Processor -- start 2023-07-06T19:59:06.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.823+0000 7fd68b6e2700 1 -- start start 2023-07-06T19:59:06.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.824+0000 7fd68b6e2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6840cd1b0 0x7fd68406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:06.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.824+0000 7fd68b6e2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd68406c2f0 0x7fd6840d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:06.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.824+0000 7fd68b6e2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd684160060 con 0x7fd68415ce50 2023-07-06T19:59:06.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.824+0000 7fd68b6e2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68406c6f0 con 0x7fd6840cd1b0 2023-07-06T19:59:06.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.824+0000 7fd68b6e2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6840cd800 con 0x7fd68406c2f0 2023-07-06T19:59:06.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.824+0000 7fd68947e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd68415ce50 0x7fd68415d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59850/0 (socket says 172.21.15.6:59850) 2023-07-06T19:59:06.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.824+0000 7fd68947e700 1 -- 172.21.15.6:0/700330330 learned_addr learned my addr 172.21.15.6:0/700330330 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:06.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.824+0000 7fd688c7d700 1 --2- 172.21.15.6:0/700330330 >> v2:172.21.15.6:3300/0 conn(0x7fd6840cd1b0 0x7fd68406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:06.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.824+0000 7fd689c7f700 1 --2- 172.21.15.6:0/700330330 >> v2:172.21.15.40:3300/0 conn(0x7fd68406c2f0 0x7fd6840d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:06.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.824+0000 7fd688c7d700 1 -- 172.21.15.6:0/700330330 >> v2:172.21.15.40:3300/0 conn(0x7fd68406c2f0 msgr2=0x7fd6840d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:06.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.824+0000 7fd688c7d700 1 --2- 172.21.15.6:0/700330330 >> v2:172.21.15.40:3300/0 conn(0x7fd68406c2f0 0x7fd6840d0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:06.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.824+0000 7fd688c7d700 1 -- 172.21.15.6:0/700330330 >> v1:172.21.15.6:6789/0 conn(0x7fd68415ce50 legacy=0x7fd68415d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:06.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.824+0000 7fd688c7d700 1 -- 172.21.15.6:0/700330330 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6841602b0 con 0x7fd6840cd1b0 2023-07-06T19:59:06.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.824+0000 7fd67bfff700 1 -- 172.21.15.6:0/700330330 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2699295543 0 0) 0x7fd684160060 con 0x7fd68415ce50 2023-07-06T19:59:06.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.824+0000 7fd688c7d700 1 --2- 172.21.15.6:0/700330330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6840cd1b0 0x7fd68406bdb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd6840cd140 tx=0x7fd674009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35dc86476a79fa8 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:06.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.825+0000 7fd67bfff700 1 -- 172.21.15.6:0/700330330 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd674011830 con 0x7fd6840cd1b0 2023-07-06T19:59:06.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.825+0000 7fd67bfff700 1 -- 172.21.15.6:0/700330330 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd674011990 con 0x7fd6840cd1b0 2023-07-06T19:59:06.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.825+0000 7fd67bfff700 1 -- 172.21.15.6:0/700330330 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd674011d20 con 0x7fd6840cd1b0 2023-07-06T19:59:06.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.825+0000 7fd68b6e2700 1 -- 172.21.15.6:0/700330330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6840cd1b0 msgr2=0x7fd68406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:06.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.825+0000 7fd68b6e2700 1 --2- 172.21.15.6:0/700330330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6840cd1b0 0x7fd68406bdb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd6840cd140 tx=0x7fd674009b20 comp rx=0 tx=0).stop 2023-07-06T19:59:06.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.825+0000 7fd68b6e2700 1 -- 172.21.15.6:0/700330330 shutdown_connections 2023-07-06T19:59:06.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.825+0000 7fd68b6e2700 1 --2- 172.21.15.6:0/700330330 >> v2:172.21.15.40:3300/0 conn(0x7fd68406c2f0 0x7fd6840d0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:06.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.825+0000 7fd68b6e2700 1 --2- 172.21.15.6:0/700330330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6840cd1b0 0x7fd68406bdb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:06.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.825+0000 7fd68b6e2700 1 -- 172.21.15.6:0/700330330 >> 172.21.15.6:0/700330330 conn(0x7fd6840d3880 msgr2=0x7fd6840cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:06.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.825+0000 7fd68b6e2700 1 -- 172.21.15.6:0/700330330 shutdown_connections 2023-07-06T19:59:06.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.825+0000 7fd68b6e2700 1 -- 172.21.15.6:0/700330330 wait complete. 2023-07-06T19:59:06.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.827+0000 7fd68b6e2700 1 Processor -- start 2023-07-06T19:59:06.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.827+0000 7fd68b6e2700 1 -- start start 2023-07-06T19:59:06.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.828+0000 7fd68b6e2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd68406c2f0 0x7fd684152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:06.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.828+0000 7fd68b6e2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6840cd1b0 0x7fd6840cab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:06.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.828+0000 7fd68b6e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68415ce50 0x7fd6840d1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:06.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.828+0000 7fd68b6e2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6840cb680 con 0x7fd68415ce50 2023-07-06T19:59:06.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.828+0000 7fd68b6e2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6840cc9e0 con 0x7fd68406c2f0 2023-07-06T19:59:06.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.828+0000 7fd68b6e2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6840cb940 con 0x7fd6840cd1b0 2023-07-06T19:59:06.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.828+0000 7fd689c7f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68415ce50 0x7fd6840d1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:06.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.828+0000 7fd689c7f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68415ce50 0x7fd6840d1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58652/0 (socket says 172.21.15.6:58652) 2023-07-06T19:59:06.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.828+0000 7fd689c7f700 1 -- 172.21.15.6:0/1851947900 learned_addr learned my addr 172.21.15.6:0/1851947900 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:06.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.828+0000 7fd688c7d700 1 --2- 172.21.15.6:0/1851947900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6840cd1b0 0x7fd6840cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:06.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.828+0000 7fd68947e700 1 --2- 172.21.15.6:0/1851947900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd68406c2f0 0x7fd684152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:06.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.828+0000 7fd689c7f700 1 -- 172.21.15.6:0/1851947900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6840cd1b0 msgr2=0x7fd6840cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:06.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.828+0000 7fd689c7f700 1 --2- 172.21.15.6:0/1851947900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6840cd1b0 0x7fd6840cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:06.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.828+0000 7fd689c7f700 1 -- 172.21.15.6:0/1851947900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd68406c2f0 msgr2=0x7fd684152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:06.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.828+0000 7fd689c7f700 1 --2- 172.21.15.6:0/1851947900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd68406c2f0 0x7fd684152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:06.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.828+0000 7fd689c7f700 1 -- 172.21.15.6:0/1851947900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6740094a0 con 0x7fd68415ce50 2023-07-06T19:59:06.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.828+0000 7fd689c7f700 1 --2- 172.21.15.6:0/1851947900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68415ce50 0x7fd6840d1430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00cd70 tx=0x7fd67c00a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:06.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.828+0000 7fd679ffb700 1 -- 172.21.15.6:0/1851947900 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c003a20 con 0x7fd68415ce50 2023-07-06T19:59:06.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.829+0000 7fd679ffb700 1 -- 172.21.15.6:0/1851947900 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67c003b80 con 0x7fd68415ce50 2023-07-06T19:59:06.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.829+0000 7fd679ffb700 1 -- 172.21.15.6:0/1851947900 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c004020 con 0x7fd68415ce50 2023-07-06T19:59:06.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.829+0000 7fd68b6e2700 1 -- 172.21.15.6:0/1851947900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6840cbc20 con 0x7fd68415ce50 2023-07-06T19:59:06.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.829+0000 7fd68b6e2700 1 -- 172.21.15.6:0/1851947900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6840cc1e0 con 0x7fd68415ce50 2023-07-06T19:59:06.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.830+0000 7fd68b6e2700 1 -- 172.21.15.6:0/1851947900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd684074200 con 0x7fd68415ce50 2023-07-06T19:59:06.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.830+0000 7fd679ffb700 1 -- 172.21.15.6:0/1851947900 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd67c004180 con 0x7fd68415ce50 2023-07-06T19:59:06.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.831+0000 7fd679ffb700 1 --2- 172.21.15.6:0/1851947900 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd66806ace0 0x7fd66806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:06.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.831+0000 7fd679ffb700 1 -- 172.21.15.6:0/1851947900 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd67c012070 con 0x7fd68415ce50 2023-07-06T19:59:06.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.831+0000 7fd68947e700 1 --2- 172.21.15.6:0/1851947900 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd66806ace0 0x7fd66806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:06.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.831+0000 7fd68947e700 1 --2- 172.21.15.6:0/1851947900 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd66806ace0 0x7fd66806d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd680000f60 tx=0x7fd680007e70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:06.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:06.835+0000 7fd679ffb700 1 -- 172.21.15.6:0/1851947900 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd67c054c50 con 0x7fd68415ce50 2023-07-06T19:59:07.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.034+0000 7fd68b6e2700 1 -- 172.21.15.6:0/1851947900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6840ccf20 con 0x7fd68415ce50 2023-07-06T19:59:07.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.035+0000 7fd679ffb700 1 -- 172.21.15.6:0/1851947900 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19964 (secure 0 0 0) 0x7fd67c058270 con 0x7fd68415ce50 2023-07-06T19:59:07.039 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:07.039 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:58:58.202291+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T19:58:51.062712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T19:58:52.130350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T19:58:55.785128+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:59:07.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.038+0000 7fd68b6e2700 1 -- 172.21.15.6:0/1851947900 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd66806ace0 msgr2=0x7fd66806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:07.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.038+0000 7fd68b6e2700 1 --2- 172.21.15.6:0/1851947900 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd66806ace0 0x7fd66806d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd680000f60 tx=0x7fd680007e70 comp rx=0 tx=0).stop 2023-07-06T19:59:07.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.038+0000 7fd68b6e2700 1 -- 172.21.15.6:0/1851947900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68415ce50 msgr2=0x7fd6840d1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:07.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.038+0000 7fd68b6e2700 1 --2- 172.21.15.6:0/1851947900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68415ce50 0x7fd6840d1430 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00cd70 tx=0x7fd67c00a570 comp rx=0 tx=0).stop 2023-07-06T19:59:07.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.038+0000 7fd68b6e2700 1 -- 172.21.15.6:0/1851947900 shutdown_connections 2023-07-06T19:59:07.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.038+0000 7fd68b6e2700 1 --2- 172.21.15.6:0/1851947900 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd66806ace0 0x7fd66806d190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.038+0000 7fd68b6e2700 1 --2- 172.21.15.6:0/1851947900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68415ce50 0x7fd6840d1430 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.038+0000 7fd68b6e2700 1 --2- 172.21.15.6:0/1851947900 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd68406c2f0 0x7fd684152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.038+0000 7fd68b6e2700 1 --2- 172.21.15.6:0/1851947900 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6840cd1b0 0x7fd6840cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.038+0000 7fd68b6e2700 1 -- 172.21.15.6:0/1851947900 >> 172.21.15.6:0/1851947900 conn(0x7fd6840d3880 msgr2=0x7fd6840d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:07.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.038+0000 7fd68b6e2700 1 -- 172.21.15.6:0/1851947900 shutdown_connections 2023-07-06T19:59:07.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.038+0000 7fd68b6e2700 1 -- 172.21.15.6:0/1851947900 wait complete. 2023-07-06T19:59:07.073 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T19:58:38.767727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T19:58:45.759808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T19:58:51.062712+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T19:58:52.130350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T19:58:55.785128+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T19:59:07.075 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T19:59:07.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.202+0000 7f1dd5f1d700 1 Processor -- start 2023-07-06T19:59:07.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.202+0000 7f1dd5f1d700 1 -- start start 2023-07-06T19:59:07.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.202+0000 7f1dd5f1d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1dd015c660 0x7f1dd0167420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:07.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.202+0000 7f1dd5f1d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd00cb310 con 0x7f1dd0071900 2023-07-06T19:59:07.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.202+0000 7f1dd5f1d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd00af070 con 0x7f1dd00ca850 2023-07-06T19:59:07.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.202+0000 7f1dd5f1d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd00cdbf0 con 0x7f1dd015c660 2023-07-06T19:59:07.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.203+0000 7f1dcf7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f1dd0071900 0x7f1dd00ca140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59864/0 (socket says 172.21.15.6:59864) 2023-07-06T19:59:07.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.203+0000 7f1dcf7fe700 1 -- 172.21.15.6:0/52413874 learned_addr learned my addr 172.21.15.6:0/52413874 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:07.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.203+0000 7f1dce7fc700 1 -- 172.21.15.6:0/52413874 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3934785994 0 0) 0x7f1dd00cb310 con 0x7f1dd0071900 2023-07-06T19:59:07.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.203+0000 7f1dcffff700 1 --2- 172.21.15.6:0/52413874 >> v2:172.21.15.40:3300/0 conn(0x7f1dd015c660 0x7f1dd0167420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:07.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.203+0000 7f1dce7fc700 1 -- 172.21.15.6:0/52413874 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1db80035b0 con 0x7f1dd0071900 2023-07-06T19:59:07.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.203+0000 7f1dce7fc700 1 -- 172.21.15.6:0/52413874 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 953934842 0 0) 0x7f1db80035b0 con 0x7f1dd0071900 2023-07-06T19:59:07.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.203+0000 7f1dce7fc700 1 -- 172.21.15.6:0/52413874 >> v2:172.21.15.40:3300/0 conn(0x7f1dd015c660 msgr2=0x7f1dd0167420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:07.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.203+0000 7f1dce7fc700 1 --2- 172.21.15.6:0/52413874 >> v2:172.21.15.40:3300/0 conn(0x7f1dd015c660 0x7f1dd0167420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.203+0000 7f1dce7fc700 1 -- 172.21.15.6:0/52413874 >> v1:172.21.15.40:6789/0 conn(0x7f1dd00ca850 legacy=0x7f1dd015bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:07.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.203+0000 7f1dce7fc700 1 -- 172.21.15.6:0/52413874 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd00cad50 con 0x7f1dd0071900 2023-07-06T19:59:07.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.203+0000 7f1dce7fc700 1 -- 172.21.15.6:0/52413874 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f1dc0001670 con 0x7f1dd0071900 2023-07-06T19:59:07.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.203+0000 7f1dce7fc700 1 -- 172.21.15.6:0/52413874 >> v1:172.21.15.6:6789/0 conn(0x7f1dd0071900 legacy=0x7f1dd00ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:07.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.203+0000 7f1dce7fc700 1 --2- 172.21.15.6:0/52413874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db8003a00 0x7f1db8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:07.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.203+0000 7f1dce7fc700 1 --2- 172.21.15.6:0/52413874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1db8004850 0x7f1db8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:07.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.203+0000 7f1dce7fc700 1 --2- 172.21.15.6:0/52413874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1db8005320 0x7f1db800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:07.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.203+0000 7f1dce7fc700 1 -- 172.21.15.6:0/52413874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00cdbf0 con 0x7f1db8003a00 2023-07-06T19:59:07.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.203+0000 7f1dce7fc700 1 -- 172.21.15.6:0/52413874 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db800c250 con 0x7f1db8004850 2023-07-06T19:59:07.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.203+0000 7f1dce7fc700 1 -- 172.21.15.6:0/52413874 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db800c410 con 0x7f1db8005320 2023-07-06T19:59:07.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.203+0000 7f1dcf7fe700 1 --2- 172.21.15.6:0/52413874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db8003a00 0x7f1db8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:07.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.203+0000 7f1dceffd700 1 --2- 172.21.15.6:0/52413874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1db8004850 0x7f1db8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:07.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.203+0000 7f1dcffff700 1 --2- 172.21.15.6:0/52413874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1db8005320 0x7f1db800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:07.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.204+0000 7f1dcf7fe700 1 -- 172.21.15.6:0/52413874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1db8005320 msgr2=0x7f1db800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:07.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.204+0000 7f1dcf7fe700 1 --2- 172.21.15.6:0/52413874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1db8005320 0x7f1db800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.204+0000 7f1dcf7fe700 1 -- 172.21.15.6:0/52413874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1db8004850 msgr2=0x7f1db8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:07.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.204+0000 7f1dcf7fe700 1 --2- 172.21.15.6:0/52413874 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1db8004850 0x7f1db8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.204+0000 7f1dcf7fe700 1 -- 172.21.15.6:0/52413874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db80035b0 con 0x7f1db8003a00 2023-07-06T19:59:07.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.204+0000 7f1dcffff700 1 -- 172.21.15.6:0/52413874 reap_dead start 2023-07-06T19:59:07.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.204+0000 7f1dcf7fe700 1 --2- 172.21.15.6:0/52413874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db8003a00 0x7f1db8003e10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1dc000c240 tx=0x7f1db8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7637a022a307b2fa server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:07.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.204+0000 7f1dce7fc700 1 -- 172.21.15.6:0/52413874 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0007c10 con 0x7f1db8003a00 2023-07-06T19:59:07.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.204+0000 7f1dce7fc700 1 -- 172.21.15.6:0/52413874 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc000cd80 con 0x7f1db8003a00 2023-07-06T19:59:07.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.204+0000 7f1dce7fc700 1 -- 172.21.15.6:0/52413874 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc0005ba0 con 0x7f1db8003a00 2023-07-06T19:59:07.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.204+0000 7f1dd5f1d700 1 -- 172.21.15.6:0/52413874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db8003a00 msgr2=0x7f1db8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:07.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.204+0000 7f1dd5f1d700 1 --2- 172.21.15.6:0/52413874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db8003a00 0x7f1db8003e10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1dc000c240 tx=0x7f1db8005880 comp rx=0 tx=0).stop 2023-07-06T19:59:07.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.204+0000 7f1dd5f1d700 1 -- 172.21.15.6:0/52413874 shutdown_connections 2023-07-06T19:59:07.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.204+0000 7f1dd5f1d700 1 --2- 172.21.15.6:0/52413874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1db8003a00 0x7f1db8003e10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.204+0000 7f1dd5f1d700 1 -- 172.21.15.6:0/52413874 >> 172.21.15.6:0/52413874 conn(0x7f1dd00cf960 msgr2=0x7f1dd00cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:07.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.205+0000 7f1dd5f1d700 1 -- 172.21.15.6:0/52413874 shutdown_connections 2023-07-06T19:59:07.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.205+0000 7f1dd5f1d700 1 -- 172.21.15.6:0/52413874 wait complete. 2023-07-06T19:59:07.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.206+0000 7f1dd5f1d700 1 Processor -- start 2023-07-06T19:59:07.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.206+0000 7f1dd5f1d700 1 -- start start 2023-07-06T19:59:07.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.207+0000 7f1dd5f1d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1db8003a00 0x7f1dd015e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:07.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.207+0000 7f1dd5f1d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1dd00c8120 0x7f1dd00c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:07.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.207+0000 7f1dd5f1d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd00b37e0 0x7f1dd00b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:07.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.207+0000 7f1dd5f1d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00b4190 con 0x7f1dd00b37e0 2023-07-06T19:59:07.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.207+0000 7f1dd5f1d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00c8be0 con 0x7f1db8003a00 2023-07-06T19:59:07.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.207+0000 7f1dd5f1d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00c8ec0 con 0x7f1dd00c8120 2023-07-06T19:59:07.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.207+0000 7f1dcffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd00b37e0 0x7f1dd00b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:07.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.207+0000 7f1dcffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd00b37e0 0x7f1dd00b3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58672/0 (socket says 172.21.15.6:58672) 2023-07-06T19:59:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.207+0000 7f1dcffff700 1 -- 172.21.15.6:0/3425680207 learned_addr learned my addr 172.21.15.6:0/3425680207 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.207+0000 7f1dcf7fe700 1 --2- 172.21.15.6:0/3425680207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1db8003a00 0x7f1dd015e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:07.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.207+0000 7f1dceffd700 1 --2- 172.21.15.6:0/3425680207 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1dd00c8120 0x7f1dd00c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:07.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.207+0000 7f1dcffff700 1 -- 172.21.15.6:0/3425680207 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1dd00c8120 msgr2=0x7f1dd00c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:07.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.207+0000 7f1dcffff700 1 --2- 172.21.15.6:0/3425680207 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1dd00c8120 0x7f1dd00c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.207+0000 7f1dcffff700 1 -- 172.21.15.6:0/3425680207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1db8003a00 msgr2=0x7f1dd015e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:07.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.207+0000 7f1dcffff700 1 --2- 172.21.15.6:0/3425680207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1db8003a00 0x7f1dd015e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.207+0000 7f1dcffff700 1 -- 172.21.15.6:0/3425680207 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd00c91a0 con 0x7f1dd00b37e0 2023-07-06T19:59:07.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.207+0000 7f1dcffff700 1 --2- 172.21.15.6:0/3425680207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd00b37e0 0x7f1dd00b3c50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00cbfe0 tx=0x7f1dc8011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:07.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.207+0000 7f1db7fff700 1 -- 172.21.15.6:0/3425680207 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc800e040 con 0x7f1dd00b37e0 2023-07-06T19:59:07.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.207+0000 7f1db7fff700 1 -- 172.21.15.6:0/3425680207 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc800f040 con 0x7f1dd00b37e0 2023-07-06T19:59:07.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.207+0000 7f1dd5f1d700 1 -- 172.21.15.6:0/3425680207 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd00c9480 con 0x7f1dd00b37e0 2023-07-06T19:59:07.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.207+0000 7f1db7fff700 1 -- 172.21.15.6:0/3425680207 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc800fc40 con 0x7f1dd00b37e0 2023-07-06T19:59:07.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.207+0000 7f1dd5f1d700 1 -- 172.21.15.6:0/3425680207 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd00b3210 con 0x7f1dd00b37e0 2023-07-06T19:59:07.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.208+0000 7f1dd5f1d700 1 -- 172.21.15.6:0/3425680207 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd004eb90 con 0x7f1dd00b37e0 2023-07-06T19:59:07.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.209+0000 7f1db7fff700 1 -- 172.21.15.6:0/3425680207 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1dc8022460 con 0x7f1dd00b37e0 2023-07-06T19:59:07.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.209+0000 7f1db7fff700 1 --2- 172.21.15.6:0/3425680207 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1dbc06ace0 0x7f1dbc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:07.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.209+0000 7f1dcf7fe700 1 --2- 172.21.15.6:0/3425680207 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1dbc06ace0 0x7f1dbc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:07.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.209+0000 7f1db7fff700 1 -- 172.21.15.6:0/3425680207 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1dc8089c50 con 0x7f1dd00b37e0 2023-07-06T19:59:07.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.210+0000 7f1dcf7fe700 1 --2- 172.21.15.6:0/3425680207 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1dbc06ace0 0x7f1dbc06d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0000c00 tx=0x7f1dc0007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:07.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.214+0000 7f1db7fff700 1 -- 172.21.15.6:0/3425680207 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1dc8058400 con 0x7f1dd00b37e0 2023-07-06T19:59:07.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.409+0000 7f1dd5f1d700 1 -- 172.21.15.6:0/3425680207 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1dd00b58e0 con 0x7f1dd00b37e0 2023-07-06T19:59:07.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.409+0000 7f1db7fff700 1 -- 172.21.15.6:0/3425680207 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1dc8057f90 con 0x7f1dd00b37e0 2023-07-06T19:59:07.412 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-06T19:59:07.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.411+0000 7f1dd5f1d700 1 -- 172.21.15.6:0/3425680207 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1dbc06ace0 msgr2=0x7f1dbc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:07.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.411+0000 7f1dd5f1d700 1 --2- 172.21.15.6:0/3425680207 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1dbc06ace0 0x7f1dbc06d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1dc0000c00 tx=0x7f1dc0007000 comp rx=0 tx=0).stop 2023-07-06T19:59:07.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.411+0000 7f1dd5f1d700 1 -- 172.21.15.6:0/3425680207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd00b37e0 msgr2=0x7f1dd00b3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:07.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.411+0000 7f1dd5f1d700 1 --2- 172.21.15.6:0/3425680207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd00b37e0 0x7f1dd00b3c50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00cbfe0 tx=0x7f1dc8011ed0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.411+0000 7f1dd5f1d700 1 -- 172.21.15.6:0/3425680207 shutdown_connections 2023-07-06T19:59:07.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.411+0000 7f1dd5f1d700 1 --2- 172.21.15.6:0/3425680207 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1dbc06ace0 0x7f1dbc06d190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.411+0000 7f1dd5f1d700 1 --2- 172.21.15.6:0/3425680207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1dd00b37e0 0x7f1dd00b3c50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.411+0000 7f1dd5f1d700 1 --2- 172.21.15.6:0/3425680207 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1db8003a00 0x7f1dd015e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.411+0000 7f1dd5f1d700 1 --2- 172.21.15.6:0/3425680207 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1dd00c8120 0x7f1dd00c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.411+0000 7f1dd5f1d700 1 -- 172.21.15.6:0/3425680207 >> 172.21.15.6:0/3425680207 conn(0x7f1dd00cf960 msgr2=0x7f1dd00cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:07.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.412+0000 7f1dd5f1d700 1 -- 172.21.15.6:0/3425680207 shutdown_connections 2023-07-06T19:59:07.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.412+0000 7f1dd5f1d700 1 -- 172.21.15.6:0/3425680207 wait complete. 2023-07-06T19:59:07.426 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T19:59:07.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.555+0000 7faddcaaf700 1 Processor -- start 2023-07-06T19:59:07.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.555+0000 7faddcaaf700 1 -- start start 2023-07-06T19:59:07.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.556+0000 7faddcaaf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadd80d15e0 0x7fadd806e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:07.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.556+0000 7faddcaaf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fadd80ce860 0x7fadd80cece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:07.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.556+0000 7faddcaaf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadd80cd300 con 0x7fadd815a520 2023-07-06T19:59:07.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.556+0000 7faddcaaf700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd80b0290 con 0x7fadd80ce860 2023-07-06T19:59:07.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.556+0000 7faddcaaf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80ccd80 con 0x7fadd80d15e0 2023-07-06T19:59:07.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.556+0000 7fadd6d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fadd80ce860 0x7fadd80cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:07.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.556+0000 7fadd6d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fadd80ce860 0x7fadd80cece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58680/0 (socket says 172.21.15.6:58680) 2023-07-06T19:59:07.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.556+0000 7fadd6d9d700 1 -- 172.21.15.6:0/1909923571 learned_addr learned my addr 172.21.15.6:0/1909923571 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:07.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.556+0000 7fadd5d9b700 1 --2- 172.21.15.6:0/1909923571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadd80d15e0 0x7fadd806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:07.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.556+0000 7fadd6d9d700 1 -- 172.21.15.6:0/1909923571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadd80d15e0 msgr2=0x7fadd806e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:07.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.556+0000 7fadd6d9d700 1 --2- 172.21.15.6:0/1909923571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadd80d15e0 0x7fadd806e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.556+0000 7fadd6d9d700 1 -- 172.21.15.6:0/1909923571 >> v1:172.21.15.40:6789/0 conn(0x7fadd815a520 legacy=0x7fadd806dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:07.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.556+0000 7fadd6d9d700 1 -- 172.21.15.6:0/1909923571 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd80cd020 con 0x7fadd80ce860 2023-07-06T19:59:07.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.557+0000 7fadd6d9d700 1 --2- 172.21.15.6:0/1909923571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd80ce860 0x7fadd80cece0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009e50 tx=0x7fadd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ebabe7d11bf96 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:07.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.557+0000 7fadd559a700 1 -- 172.21.15.6:0/1909923571 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd000e070 con 0x7fadd80ce860 2023-07-06T19:59:07.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.557+0000 7fadd559a700 1 -- 172.21.15.6:0/1909923571 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd000b910 con 0x7fadd80ce860 2023-07-06T19:59:07.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.557+0000 7fadd559a700 1 -- 172.21.15.6:0/1909923571 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd000bcc0 con 0x7fadd80ce860 2023-07-06T19:59:07.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.557+0000 7faddcaaf700 1 -- 172.21.15.6:0/1909923571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd80ce860 msgr2=0x7fadd80cece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:07.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.557+0000 7faddcaaf700 1 --2- 172.21.15.6:0/1909923571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd80ce860 0x7fadd80cece0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009e50 tx=0x7fadd000b330 comp rx=0 tx=0).stop 2023-07-06T19:59:07.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.557+0000 7faddcaaf700 1 -- 172.21.15.6:0/1909923571 shutdown_connections 2023-07-06T19:59:07.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.557+0000 7faddcaaf700 1 --2- 172.21.15.6:0/1909923571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd80ce860 0x7fadd80cece0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.557+0000 7faddcaaf700 1 --2- 172.21.15.6:0/1909923571 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadd80d15e0 0x7fadd806e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.557+0000 7faddcaaf700 1 -- 172.21.15.6:0/1909923571 >> 172.21.15.6:0/1909923571 conn(0x7fadd80ce120 msgr2=0x7fadd80d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:07.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.557+0000 7faddcaaf700 1 -- 172.21.15.6:0/1909923571 shutdown_connections 2023-07-06T19:59:07.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.557+0000 7faddcaaf700 1 -- 172.21.15.6:0/1909923571 wait complete. 2023-07-06T19:59:07.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.559+0000 7faddcaaf700 1 Processor -- start 2023-07-06T19:59:07.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.559+0000 7faddcaaf700 1 -- start start 2023-07-06T19:59:07.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.560+0000 7faddcaaf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadd80ce860 0x7fadd8152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:07.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.560+0000 7faddcaaf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd80d15e0 0x7fadd80b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:07.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.560+0000 7faddcaaf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadd815a520 0x7fadd81523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:07.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.560+0000 7faddcaaf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd8152920 con 0x7fadd80d15e0 2023-07-06T19:59:07.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.560+0000 7faddcaaf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80b08f0 con 0x7fadd80ce860 2023-07-06T19:59:07.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.560+0000 7faddcaaf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd80b0bd0 con 0x7fadd815a520 2023-07-06T19:59:07.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.560+0000 7fadd5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd80d15e0 0x7fadd80b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:07.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.560+0000 7fadd5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd80d15e0 0x7fadd80b1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58684/0 (socket says 172.21.15.6:58684) 2023-07-06T19:59:07.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.560+0000 7fadd5d9b700 1 -- 172.21.15.6:0/3650102630 learned_addr learned my addr 172.21.15.6:0/3650102630 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:07.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.560+0000 7fadd659c700 1 --2- 172.21.15.6:0/3650102630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadd80ce860 0x7fadd8152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:07.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.560+0000 7fadd6d9d700 1 --2- 172.21.15.6:0/3650102630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadd815a520 0x7fadd81523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:07.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.560+0000 7fadd5d9b700 1 -- 172.21.15.6:0/3650102630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadd815a520 msgr2=0x7fadd81523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:07.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.560+0000 7fadd5d9b700 1 --2- 172.21.15.6:0/3650102630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadd815a520 0x7fadd81523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.560+0000 7fadd5d9b700 1 -- 172.21.15.6:0/3650102630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadd80ce860 msgr2=0x7fadd8152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:07.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.560+0000 7fadd5d9b700 1 --2- 172.21.15.6:0/3650102630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadd80ce860 0x7fadd8152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.560+0000 7fadd5d9b700 1 -- 172.21.15.6:0/3650102630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd0009b30 con 0x7fadd80d15e0 2023-07-06T19:59:07.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.560+0000 7fadd6d9d700 1 --2- 172.21.15.6:0/3650102630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadd815a520 0x7fadd81523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:07.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.560+0000 7fadd5d9b700 1 --2- 172.21.15.6:0/3650102630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd80d15e0 0x7fadd80b1990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fadc800e9b0 tx=0x7fadc800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:07.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.560+0000 7fadc6ffd700 1 -- 172.21.15.6:0/3650102630 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc8009710 con 0x7fadd80d15e0 2023-07-06T19:59:07.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.560+0000 7fadc6ffd700 1 -- 172.21.15.6:0/3650102630 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadc800c850 con 0x7fadd80d15e0 2023-07-06T19:59:07.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.560+0000 7faddcaaf700 1 -- 172.21.15.6:0/3650102630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd80b0eb0 con 0x7fadd80d15e0 2023-07-06T19:59:07.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.560+0000 7fadc6ffd700 1 -- 172.21.15.6:0/3650102630 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadc800cbc0 con 0x7fadd80d15e0 2023-07-06T19:59:07.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.560+0000 7faddcaaf700 1 -- 172.21.15.6:0/3650102630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd80b1470 con 0x7fadd80d15e0 2023-07-06T19:59:07.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.561+0000 7faddcaaf700 1 -- 172.21.15.6:0/3650102630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd80b1630 con 0x7fadd80d15e0 2023-07-06T19:59:07.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.562+0000 7fadc6ffd700 1 -- 172.21.15.6:0/3650102630 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fadc800cd20 con 0x7fadd80d15e0 2023-07-06T19:59:07.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.562+0000 7fadc6ffd700 1 --2- 172.21.15.6:0/3650102630 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fadb806ace0 0x7fadb806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:07.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.562+0000 7fadc6ffd700 1 -- 172.21.15.6:0/3650102630 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fadc8089800 con 0x7fadd80d15e0 2023-07-06T19:59:07.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.562+0000 7fadd659c700 1 --2- 172.21.15.6:0/3650102630 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fadb806ace0 0x7fadb806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:07.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.563+0000 7fadd659c700 1 --2- 172.21.15.6:0/3650102630 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fadb806ace0 0x7fadb806d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fadd80c76a0 tx=0x7fadcc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:07.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.567+0000 7fadc6ffd700 1 -- 172.21.15.6:0/3650102630 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fadc80545c0 con 0x7fadd80d15e0 2023-07-06T19:59:07.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.762+0000 7faddcaaf700 1 -- 172.21.15.6:0/3650102630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fadd806dc10 con 0x7fadd80d15e0 2023-07-06T19:59:07.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.762+0000 7fadc6ffd700 1 -- 172.21.15.6:0/3650102630 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fadc8057be0 con 0x7fadd80d15e0 2023-07-06T19:59:07.765 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-06T19:59:07.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.764+0000 7faddcaaf700 1 -- 172.21.15.6:0/3650102630 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fadb806ace0 msgr2=0x7fadb806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:07.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.764+0000 7faddcaaf700 1 --2- 172.21.15.6:0/3650102630 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fadb806ace0 0x7fadb806d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fadd80c76a0 tx=0x7fadcc009040 comp rx=0 tx=0).stop 2023-07-06T19:59:07.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.764+0000 7faddcaaf700 1 -- 172.21.15.6:0/3650102630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd80d15e0 msgr2=0x7fadd80b1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:07.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.764+0000 7faddcaaf700 1 --2- 172.21.15.6:0/3650102630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd80d15e0 0x7fadd80b1990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fadc800e9b0 tx=0x7fadc800ecc0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.764+0000 7faddcaaf700 1 -- 172.21.15.6:0/3650102630 shutdown_connections 2023-07-06T19:59:07.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.764+0000 7faddcaaf700 1 --2- 172.21.15.6:0/3650102630 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fadb806ace0 0x7fadb806d190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.764+0000 7faddcaaf700 1 --2- 172.21.15.6:0/3650102630 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fadd815a520 0x7fadd81523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.764+0000 7faddcaaf700 1 --2- 172.21.15.6:0/3650102630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fadd80ce860 0x7fadd8152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.764+0000 7faddcaaf700 1 --2- 172.21.15.6:0/3650102630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd80d15e0 0x7fadd80b1990 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.764+0000 7faddcaaf700 1 -- 172.21.15.6:0/3650102630 >> 172.21.15.6:0/3650102630 conn(0x7fadd80ce120 msgr2=0x7fadd80ca1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:07.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.764+0000 7faddcaaf700 1 -- 172.21.15.6:0/3650102630 shutdown_connections 2023-07-06T19:59:07.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.764+0000 7faddcaaf700 1 -- 172.21.15.6:0/3650102630 wait complete. 2023-07-06T19:59:07.801 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T19:59:07.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.931+0000 7f77f78a1700 1 Processor -- start 2023-07-06T19:59:07.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.931+0000 7f77f78a1700 1 -- start start 2023-07-06T19:59:07.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.932+0000 7f77f78a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77f0071900 0x7f77f00ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:07.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.932+0000 7f77f78a1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f77f0071cd0 0x7f77f00ca680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:07.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.932+0000 7f77f78a1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f00cb310 con 0x7f77f015bf50 2023-07-06T19:59:07.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.932+0000 7f77f78a1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f00cdbf0 con 0x7f77f0071cd0 2023-07-06T19:59:07.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.932+0000 7f77f78a1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f00af070 con 0x7f77f0071900 2023-07-06T19:59:07.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.932+0000 7f77f4e3c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f77f0071cd0 0x7f77f00ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:07.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.932+0000 7f77f4e3c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f77f0071cd0 0x7f77f00ca680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58690/0 (socket says 172.21.15.6:58690) 2023-07-06T19:59:07.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.932+0000 7f77f4e3c700 1 -- 172.21.15.6:0/1295850699 learned_addr learned my addr 172.21.15.6:0/1295850699 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:07.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.932+0000 7f77f563d700 1 --2- 172.21.15.6:0/1295850699 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77f0071900 0x7f77f00ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:07.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.932+0000 7f77f4e3c700 1 -- 172.21.15.6:0/1295850699 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77f0071900 msgr2=0x7f77f00ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:07.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.932+0000 7f77f4e3c700 1 --2- 172.21.15.6:0/1295850699 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77f0071900 0x7f77f00ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.932+0000 7f77f4e3c700 1 -- 172.21.15.6:0/1295850699 >> v1:172.21.15.40:6789/0 conn(0x7f77f015bf50 legacy=0x7f77f015c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:07.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.932+0000 7f77f4e3c700 1 -- 172.21.15.6:0/1295850699 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f00cad50 con 0x7f77f0071cd0 2023-07-06T19:59:07.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.932+0000 7f77f563d700 1 --2- 172.21.15.6:0/1295850699 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77f0071900 0x7f77f00ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:07.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.933+0000 7f77f4e3c700 1 --2- 172.21.15.6:0/1295850699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77f0071cd0 0x7f77f00ca680 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0098f0 tx=0x7f77ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80127b2afa60a8b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:07.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.933+0000 7f77e7fff700 1 -- 172.21.15.6:0/1295850699 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec00b8a0 con 0x7f77f0071cd0 2023-07-06T19:59:07.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.933+0000 7f77e7fff700 1 -- 172.21.15.6:0/1295850699 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ec00ba00 con 0x7f77f0071cd0 2023-07-06T19:59:07.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.933+0000 7f77e7fff700 1 -- 172.21.15.6:0/1295850699 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec00bd90 con 0x7f77f0071cd0 2023-07-06T19:59:07.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.933+0000 7f77f78a1700 1 -- 172.21.15.6:0/1295850699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77f0071cd0 msgr2=0x7f77f00ca680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:07.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.933+0000 7f77f78a1700 1 --2- 172.21.15.6:0/1295850699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77f0071cd0 0x7f77f00ca680 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f77ec0098f0 tx=0x7f77ec009c00 comp rx=0 tx=0).stop 2023-07-06T19:59:07.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.933+0000 7f77f78a1700 1 -- 172.21.15.6:0/1295850699 shutdown_connections 2023-07-06T19:59:07.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.933+0000 7f77f78a1700 1 --2- 172.21.15.6:0/1295850699 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77f0071900 0x7f77f00ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.933+0000 7f77f78a1700 1 --2- 172.21.15.6:0/1295850699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77f0071cd0 0x7f77f00ca680 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.933+0000 7f77f78a1700 1 -- 172.21.15.6:0/1295850699 >> 172.21.15.6:0/1295850699 conn(0x7f77f00cf960 msgr2=0x7f77f00cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:07.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.933+0000 7f77f78a1700 1 -- 172.21.15.6:0/1295850699 shutdown_connections 2023-07-06T19:59:07.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.933+0000 7f77f78a1700 1 -- 172.21.15.6:0/1295850699 wait complete. 2023-07-06T19:59:07.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.935+0000 7f77f78a1700 1 Processor -- start 2023-07-06T19:59:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.935+0000 7f77f78a1700 1 -- start start 2023-07-06T19:59:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.935+0000 7f77f78a1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77f0071900 0x7f77f0154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.935+0000 7f77f78a1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77f0071cd0 0x7f77f014e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.935+0000 7f77f78a1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77f015bf50 0x7f77f00c5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.935+0000 7f77f78a1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f014ef90 con 0x7f77f0071cd0 2023-07-06T19:59:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.935+0000 7f77f78a1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f01557d0 con 0x7f77f015bf50 2023-07-06T19:59:07.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.935+0000 7f77f78a1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f0154c50 con 0x7f77f0071900 2023-07-06T19:59:07.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.935+0000 7f77f4e3c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77f0071cd0 0x7f77f014e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:07.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.935+0000 7f77f4e3c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77f0071cd0 0x7f77f014e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58698/0 (socket says 172.21.15.6:58698) 2023-07-06T19:59:07.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.935+0000 7f77f4e3c700 1 -- 172.21.15.6:0/1337657859 learned_addr learned my addr 172.21.15.6:0/1337657859 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:07.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.936+0000 7f77f563d700 1 --2- 172.21.15.6:0/1337657859 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77f0071900 0x7f77f0154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:07.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.936+0000 7f77f5e3e700 1 --2- 172.21.15.6:0/1337657859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77f015bf50 0x7f77f00c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:07.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.936+0000 7f77f4e3c700 1 -- 172.21.15.6:0/1337657859 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77f0071900 msgr2=0x7f77f0154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:07.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.936+0000 7f77f4e3c700 1 --2- 172.21.15.6:0/1337657859 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77f0071900 0x7f77f0154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.936+0000 7f77f4e3c700 1 -- 172.21.15.6:0/1337657859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77f015bf50 msgr2=0x7f77f00c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:07.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.936+0000 7f77f4e3c700 1 --2- 172.21.15.6:0/1337657859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77f015bf50 0x7f77f00c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:07.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.936+0000 7f77f4e3c700 1 -- 172.21.15.6:0/1337657859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ec009550 con 0x7f77f0071cd0 2023-07-06T19:59:07.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.936+0000 7f77f4e3c700 1 --2- 172.21.15.6:0/1337657859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77f0071cd0 0x7f77f014e4c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009c40 tx=0x7f77ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:07.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.936+0000 7f77e5ffb700 1 -- 172.21.15.6:0/1337657859 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec0036a0 con 0x7f77f0071cd0 2023-07-06T19:59:07.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.936+0000 7f77e5ffb700 1 -- 172.21.15.6:0/1337657859 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ec01e070 con 0x7f77f0071cd0 2023-07-06T19:59:07.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.936+0000 7f77f78a1700 1 -- 172.21.15.6:0/1337657859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f014ea00 con 0x7f77f0071cd0 2023-07-06T19:59:07.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.936+0000 7f77e5ffb700 1 -- 172.21.15.6:0/1337657859 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ec003a40 con 0x7f77f0071cd0 2023-07-06T19:59:07.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.936+0000 7f77f78a1700 1 -- 172.21.15.6:0/1337657859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f00c4b60 con 0x7f77f0071cd0 2023-07-06T19:59:07.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.937+0000 7f77f78a1700 1 -- 172.21.15.6:0/1337657859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f004eb90 con 0x7f77f0071cd0 2023-07-06T19:59:07.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.938+0000 7f77e5ffb700 1 -- 172.21.15.6:0/1337657859 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f77ec003ba0 con 0x7f77f0071cd0 2023-07-06T19:59:07.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.938+0000 7f77e5ffb700 1 --2- 172.21.15.6:0/1337657859 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f77d406ace0 0x7f77d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:07.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.938+0000 7f77e5ffb700 1 -- 172.21.15.6:0/1337657859 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f77ec020070 con 0x7f77f0071cd0 2023-07-06T19:59:07.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.938+0000 7f77f563d700 1 --2- 172.21.15.6:0/1337657859 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f77d406ace0 0x7f77d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:07.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.939+0000 7f77f563d700 1 --2- 172.21.15.6:0/1337657859 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f77d406ace0 0x7f77d406d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f77f0154f50 tx=0x7f77e0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:07.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:07.943+0000 7f77e5ffb700 1 -- 172.21.15.6:0/1337657859 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f77ec0559c0 con 0x7f77f0071cd0 2023-07-06T19:59:08.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.143+0000 7f77f78a1700 1 -- 172.21.15.6:0/1337657859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f77f00b58e0 con 0x7f77f0071cd0 2023-07-06T19:59:08.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.144+0000 7f77e5ffb700 1 -- 172.21.15.6:0/1337657859 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f77ec058fe0 con 0x7f77f0071cd0 2023-07-06T19:59:08.146 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T19:59:08.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.146+0000 7f77f78a1700 1 -- 172.21.15.6:0/1337657859 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f77d406ace0 msgr2=0x7f77d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:08.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.146+0000 7f77f78a1700 1 --2- 172.21.15.6:0/1337657859 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f77d406ace0 0x7f77d406d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f77f0154f50 tx=0x7f77e0008040 comp rx=0 tx=0).stop 2023-07-06T19:59:08.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.146+0000 7f77f78a1700 1 -- 172.21.15.6:0/1337657859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77f0071cd0 msgr2=0x7f77f014e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:08.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.146+0000 7f77f78a1700 1 --2- 172.21.15.6:0/1337657859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77f0071cd0 0x7f77f014e4c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009c40 tx=0x7f77ec004750 comp rx=0 tx=0).stop 2023-07-06T19:59:08.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.146+0000 7f77f78a1700 1 -- 172.21.15.6:0/1337657859 shutdown_connections 2023-07-06T19:59:08.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.146+0000 7f77f78a1700 1 --2- 172.21.15.6:0/1337657859 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f77d406ace0 0x7f77d406d190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:08.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.146+0000 7f77f78a1700 1 --2- 172.21.15.6:0/1337657859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f77f015bf50 0x7f77f00c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:08.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.146+0000 7f77f78a1700 1 --2- 172.21.15.6:0/1337657859 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f77f0071900 0x7f77f0154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:08.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.146+0000 7f77f78a1700 1 --2- 172.21.15.6:0/1337657859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77f0071cd0 0x7f77f014e4c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:08.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.146+0000 7f77f78a1700 1 -- 172.21.15.6:0/1337657859 >> 172.21.15.6:0/1337657859 conn(0x7f77f00cf960 msgr2=0x7f77f00b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:08.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.146+0000 7f77f78a1700 1 -- 172.21.15.6:0/1337657859 shutdown_connections 2023-07-06T19:59:08.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.146+0000 7f77f78a1700 1 -- 172.21.15.6:0/1337657859 wait complete. 2023-07-06T19:59:08.161 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T19:59:08.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.288+0000 7f35ebd6b700 1 Processor -- start 2023-07-06T19:59:08.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.288+0000 7f35ebd6b700 1 -- start start 2023-07-06T19:59:08.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.289+0000 7f35ebd6b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f35e40ca850 0x7f35e415bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:08.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.289+0000 7f35ebd6b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35e4071cd0 0x7f35e415c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:08.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.289+0000 7f35ebd6b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e40cb310 con 0x7f35e4071900 2023-07-06T19:59:08.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.289+0000 7f35ebd6b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e40cdbf0 con 0x7f35e40ca850 2023-07-06T19:59:08.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.289+0000 7f35ebd6b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e415c9d0 con 0x7f35e4071cd0 2023-07-06T19:59:08.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.290+0000 7f35e9306700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f35e40ca850 0x7f35e415bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:08.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.290+0000 7f35ea308700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35e4071cd0 0x7f35e415c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:08.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.290+0000 7f35e9b07700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f35e4071900 0x7f35e40ca140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:49784/0 (socket says 172.21.15.6:49784) 2023-07-06T19:59:08.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.290+0000 7f35e9306700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f35e40ca850 0x7f35e415bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:37742/0 (socket says 172.21.15.6:37742) 2023-07-06T19:59:08.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.290+0000 7f35e9b07700 1 -- 172.21.15.6:0/4061907801 learned_addr learned my addr 172.21.15.6:0/4061907801 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:08.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.290+0000 7f35ea308700 1 -- 172.21.15.6:0/4061907801 >> v2:172.21.15.40:3300/0 conn(0x7f35e40ca850 msgr2=0x7f35e415bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:08.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.290+0000 7f35ea308700 1 --2- 172.21.15.6:0/4061907801 >> v2:172.21.15.40:3300/0 conn(0x7f35e40ca850 0x7f35e415bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:08.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.290+0000 7f35ea308700 1 -- 172.21.15.6:0/4061907801 >> v1:172.21.15.40:6789/0 conn(0x7f35e4071900 legacy=0x7f35e40ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:08.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.290+0000 7f35ea308700 1 -- 172.21.15.6:0/4061907801 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e40af070 con 0x7f35e4071cd0 2023-07-06T19:59:08.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.290+0000 7f35e9306700 1 --2- 172.21.15.6:0/4061907801 >> v2:172.21.15.40:3300/0 conn(0x7f35e40ca850 0x7f35e415bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:59:08.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.290+0000 7f35ea308700 1 --2- 172.21.15.6:0/4061907801 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35e4071cd0 0x7f35e415c490 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009d90 tx=0x7f35dc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5edd39eea09d0b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:08.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.290+0000 7f35e8b05700 1 -- 172.21.15.6:0/4061907801 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc00e070 con 0x7f35e4071cd0 2023-07-06T19:59:08.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.290+0000 7f35e8b05700 1 -- 172.21.15.6:0/4061907801 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35dc003a20 con 0x7f35e4071cd0 2023-07-06T19:59:08.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.290+0000 7f35e8b05700 1 -- 172.21.15.6:0/4061907801 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc003dd0 con 0x7f35e4071cd0 2023-07-06T19:59:08.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.291+0000 7f35ebd6b700 1 -- 172.21.15.6:0/4061907801 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35e4071cd0 msgr2=0x7f35e415c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:08.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.291+0000 7f35ebd6b700 1 --2- 172.21.15.6:0/4061907801 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35e4071cd0 0x7f35e415c490 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009d90 tx=0x7f35dc00b330 comp rx=0 tx=0).stop 2023-07-06T19:59:08.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.291+0000 7f35ebd6b700 1 -- 172.21.15.6:0/4061907801 shutdown_connections 2023-07-06T19:59:08.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.291+0000 7f35ebd6b700 1 --2- 172.21.15.6:0/4061907801 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35e4071cd0 0x7f35e415c490 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:08.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.291+0000 7f35ebd6b700 1 --2- 172.21.15.6:0/4061907801 >> v2:172.21.15.40:3300/0 conn(0x7f35e40ca850 0x7f35e415bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:08.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.291+0000 7f35ebd6b700 1 -- 172.21.15.6:0/4061907801 >> 172.21.15.6:0/4061907801 conn(0x7f35e40cf960 msgr2=0x7f35e40cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:08.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.291+0000 7f35ebd6b700 1 -- 172.21.15.6:0/4061907801 shutdown_connections 2023-07-06T19:59:08.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.291+0000 7f35ebd6b700 1 -- 172.21.15.6:0/4061907801 wait complete. 2023-07-06T19:59:08.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.292+0000 7f35ebd6b700 1 Processor -- start 2023-07-06T19:59:08.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.292+0000 7f35ebd6b700 1 -- start start 2023-07-06T19:59:08.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.293+0000 7f35ebd6b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35e4071900 0x7f35e414bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:08.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.293+0000 7f35ebd6b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35e4071cd0 0x7f35e40b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:08.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.293+0000 7f35ebd6b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35e40ca850 0x7f35e40b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:08.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.293+0000 7f35ebd6b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e414c400 con 0x7f35e4071900 2023-07-06T19:59:08.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.293+0000 7f35ebd6b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e40c9670 con 0x7f35e40ca850 2023-07-06T19:59:08.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.293+0000 7f35ebd6b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e40c8a60 con 0x7f35e4071cd0 2023-07-06T19:59:08.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.293+0000 7f35e9b07700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35e4071900 0x7f35e414bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:08.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.293+0000 7f35e9b07700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35e4071900 0x7f35e414bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58710/0 (socket says 172.21.15.6:58710) 2023-07-06T19:59:08.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.293+0000 7f35e9b07700 1 -- 172.21.15.6:0/3080152861 learned_addr learned my addr 172.21.15.6:0/3080152861 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:08.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.293+0000 7f35ea308700 1 --2- 172.21.15.6:0/3080152861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35e40ca850 0x7f35e40b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:08.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.293+0000 7f35e9306700 1 --2- 172.21.15.6:0/3080152861 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35e4071cd0 0x7f35e40b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:08.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.294+0000 7f35e9b07700 1 -- 172.21.15.6:0/3080152861 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35e4071cd0 msgr2=0x7f35e40b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:08.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.294+0000 7f35e9b07700 1 --2- 172.21.15.6:0/3080152861 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35e4071cd0 0x7f35e40b06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:08.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.294+0000 7f35e9b07700 1 -- 172.21.15.6:0/3080152861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35e40ca850 msgr2=0x7f35e40b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:08.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.294+0000 7f35e9b07700 1 --2- 172.21.15.6:0/3080152861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35e40ca850 0x7f35e40b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:08.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.294+0000 7f35e9b07700 1 -- 172.21.15.6:0/3080152861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e00094a0 con 0x7f35e4071900 2023-07-06T19:59:08.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.294+0000 7f35e9b07700 1 --2- 172.21.15.6:0/3080152861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35e4071900 0x7f35e414bec0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f35d400c780 tx=0x7f35d400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:08.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.294+0000 7f35da7fc700 1 -- 172.21.15.6:0/3080152861 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d4004c80 con 0x7f35e4071900 2023-07-06T19:59:08.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.294+0000 7f35da7fc700 1 -- 172.21.15.6:0/3080152861 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d4004de0 con 0x7f35e4071900 2023-07-06T19:59:08.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.294+0000 7f35ebd6b700 1 -- 172.21.15.6:0/3080152861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35dc009a70 con 0x7f35e4071900 2023-07-06T19:59:08.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.294+0000 7f35da7fc700 1 -- 172.21.15.6:0/3080152861 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d4007310 con 0x7f35e4071900 2023-07-06T19:59:08.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.294+0000 7f35ebd6b700 1 -- 172.21.15.6:0/3080152861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e40c9020 con 0x7f35e4071900 2023-07-06T19:59:08.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.295+0000 7f35ebd6b700 1 -- 172.21.15.6:0/3080152861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e404eb90 con 0x7f35e4071900 2023-07-06T19:59:08.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.295+0000 7f35da7fc700 1 -- 172.21.15.6:0/3080152861 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f35d4007470 con 0x7f35e4071900 2023-07-06T19:59:08.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.296+0000 7f35da7fc700 1 --2- 172.21.15.6:0/3080152861 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f35c806ace0 0x7f35c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:08.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.296+0000 7f35da7fc700 1 -- 172.21.15.6:0/3080152861 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f35d4089440 con 0x7f35e4071900 2023-07-06T19:59:08.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.296+0000 7f35e9306700 1 --2- 172.21.15.6:0/3080152861 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f35c806ace0 0x7f35c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:08.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.296+0000 7f35e9306700 1 --2- 172.21.15.6:0/3080152861 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f35c806ace0 0x7f35c806d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f35e40723b0 tx=0x7f35e0009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:08.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.300+0000 7f35da7fc700 1 -- 172.21.15.6:0/3080152861 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f35d4054200 con 0x7f35e4071900 2023-07-06T19:59:08.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.496+0000 7f35ebd6b700 1 -- 172.21.15.6:0/3080152861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f35e40b58e0 con 0x7f35e4071900 2023-07-06T19:59:08.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.496+0000 7f35da7fc700 1 -- 172.21.15.6:0/3080152861 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f35d4057820 con 0x7f35e4071900 2023-07-06T19:59:08.500 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-06T19:59:08.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.498+0000 7f35ebd6b700 1 -- 172.21.15.6:0/3080152861 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f35c806ace0 msgr2=0x7f35c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:08.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.498+0000 7f35ebd6b700 1 --2- 172.21.15.6:0/3080152861 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f35c806ace0 0x7f35c806d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f35e40723b0 tx=0x7f35e0009210 comp rx=0 tx=0).stop 2023-07-06T19:59:08.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.498+0000 7f35ebd6b700 1 -- 172.21.15.6:0/3080152861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35e4071900 msgr2=0x7f35e414bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:08.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.498+0000 7f35ebd6b700 1 --2- 172.21.15.6:0/3080152861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35e4071900 0x7f35e414bec0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f35d400c780 tx=0x7f35d400ca90 comp rx=0 tx=0).stop 2023-07-06T19:59:08.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.498+0000 7f35ebd6b700 1 -- 172.21.15.6:0/3080152861 shutdown_connections 2023-07-06T19:59:08.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.498+0000 7f35ebd6b700 1 --2- 172.21.15.6:0/3080152861 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f35c806ace0 0x7f35c806d190 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:08.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.498+0000 7f35ebd6b700 1 --2- 172.21.15.6:0/3080152861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35e4071900 0x7f35e414bec0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:08.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.498+0000 7f35ebd6b700 1 --2- 172.21.15.6:0/3080152861 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35e40ca850 0x7f35e40b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:08.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.498+0000 7f35ebd6b700 1 --2- 172.21.15.6:0/3080152861 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35e4071cd0 0x7f35e40b06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:08.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.498+0000 7f35ebd6b700 1 -- 172.21.15.6:0/3080152861 >> 172.21.15.6:0/3080152861 conn(0x7f35e40cf960 msgr2=0x7f35e40cece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:08.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.498+0000 7f35ebd6b700 1 -- 172.21.15.6:0/3080152861 shutdown_connections 2023-07-06T19:59:08.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.498+0000 7f35ebd6b700 1 -- 172.21.15.6:0/3080152861 wait complete. 2023-07-06T19:59:08.519 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T19:59:08.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.647+0000 7f6244dfc700 1 Processor -- start 2023-07-06T19:59:08.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.647+0000 7f6244dfc700 1 -- start start 2023-07-06T19:59:08.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.648+0000 7f6244dfc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f62400aef10 0x7f624015b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:08.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.648+0000 7f6244dfc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f624015de10 0x7f624015e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:08.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.648+0000 7f6244dfc700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624015e890 con 0x7f6240071690 2023-07-06T19:59:08.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.648+0000 7f6244dfc700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6240151750 con 0x7f62400aef10 2023-07-06T19:59:08.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.648+0000 7f6244dfc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624015eb70 con 0x7f624015de10 2023-07-06T19:59:08.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.648+0000 7f623e59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f62400aef10 0x7f624015b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:08.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.648+0000 7f623ed9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6240071690 0x7f62400ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59928/0 (socket says 172.21.15.6:59928) 2023-07-06T19:59:08.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.648+0000 7f623ed9d700 1 -- 172.21.15.6:0/3537397790 learned_addr learned my addr 172.21.15.6:0/3537397790 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:08.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.648+0000 7f623dd9b700 1 --2- 172.21.15.6:0/3537397790 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f624015de10 0x7f624015e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:08.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.648+0000 7f623e59c700 1 -- 172.21.15.6:0/3537397790 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f624015de10 msgr2=0x7f624015e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:08.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.648+0000 7f623e59c700 1 --2- 172.21.15.6:0/3537397790 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f624015de10 0x7f624015e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:08.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.648+0000 7f623e59c700 1 -- 172.21.15.6:0/3537397790 >> v1:172.21.15.6:6789/0 conn(0x7f6240071690 legacy=0x7f62400ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:08.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.648+0000 7f623d59a700 1 -- 172.21.15.6:0/3537397790 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3874459652 0 0) 0x7f624015e890 con 0x7f6240071690 2023-07-06T19:59:08.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.648+0000 7f623e59c700 1 -- 172.21.15.6:0/3537397790 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624015ab70 con 0x7f62400aef10 2023-07-06T19:59:08.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.648+0000 7f623dd9b700 1 --2- 172.21.15.6:0/3537397790 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f624015de10 0x7f624015e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:08.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.648+0000 7f623e59c700 1 --2- 172.21.15.6:0/3537397790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62400aef10 0x7f624015b370 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6230009840 tx=0x7f6230009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dbe6031a442db9f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:08.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.648+0000 7f623d59a700 1 -- 172.21.15.6:0/3537397790 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230011830 con 0x7f62400aef10 2023-07-06T19:59:08.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.649+0000 7f623d59a700 1 -- 172.21.15.6:0/3537397790 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6230011990 con 0x7f62400aef10 2023-07-06T19:59:08.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.649+0000 7f623d59a700 1 -- 172.21.15.6:0/3537397790 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230011d20 con 0x7f62400aef10 2023-07-06T19:59:08.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.649+0000 7f6244dfc700 1 -- 172.21.15.6:0/3537397790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62400aef10 msgr2=0x7f624015b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:08.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.649+0000 7f6244dfc700 1 --2- 172.21.15.6:0/3537397790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62400aef10 0x7f624015b370 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6230009840 tx=0x7f6230009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:08.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.649+0000 7f6244dfc700 1 -- 172.21.15.6:0/3537397790 shutdown_connections 2023-07-06T19:59:08.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.649+0000 7f6244dfc700 1 --2- 172.21.15.6:0/3537397790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62400aef10 0x7f624015b370 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:08.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.649+0000 7f6244dfc700 1 --2- 172.21.15.6:0/3537397790 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f624015de10 0x7f624015e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:08.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.649+0000 7f6244dfc700 1 -- 172.21.15.6:0/3537397790 >> 172.21.15.6:0/3537397790 conn(0x7f62400cf960 msgr2=0x7f62400cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:08.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.649+0000 7f6244dfc700 1 -- 172.21.15.6:0/3537397790 shutdown_connections 2023-07-06T19:59:08.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.649+0000 7f6244dfc700 1 -- 172.21.15.6:0/3537397790 wait complete. 2023-07-06T19:59:08.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.650+0000 7f6244dfc700 1 Processor -- start 2023-07-06T19:59:08.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.651+0000 7f6244dfc700 1 -- start start 2023-07-06T19:59:08.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.651+0000 7f6244dfc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6240071690 0x7f624014e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:08.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.651+0000 7f6244dfc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62400aef10 0x7f6240153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:08.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.651+0000 7f6244dfc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f624015de10 0x7f6240157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:08.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.651+0000 7f6244dfc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6240153670 con 0x7f6240071690 2023-07-06T19:59:08.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.651+0000 7f6244dfc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6240152a60 con 0x7f624015de10 2023-07-06T19:59:08.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.651+0000 7f6244dfc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6240152d40 con 0x7f62400aef10 2023-07-06T19:59:08.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.651+0000 7f623e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6240071690 0x7f624014e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:08.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.651+0000 7f623e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6240071690 0x7f624014e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58722/0 (socket says 172.21.15.6:58722) 2023-07-06T19:59:08.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.651+0000 7f623e59c700 1 -- 172.21.15.6:0/1145231436 learned_addr learned my addr 172.21.15.6:0/1145231436 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:08.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.651+0000 7f623ed9d700 1 --2- 172.21.15.6:0/1145231436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f624015de10 0x7f6240157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:08.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.651+0000 7f623dd9b700 1 --2- 172.21.15.6:0/1145231436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62400aef10 0x7f6240153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:08.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.652+0000 7f623e59c700 1 -- 172.21.15.6:0/1145231436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62400aef10 msgr2=0x7f6240153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:08.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.652+0000 7f623e59c700 1 --2- 172.21.15.6:0/1145231436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62400aef10 0x7f6240153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:08.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.652+0000 7f623e59c700 1 -- 172.21.15.6:0/1145231436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f624015de10 msgr2=0x7f6240157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:08.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.652+0000 7f623e59c700 1 --2- 172.21.15.6:0/1145231436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f624015de10 0x7f6240157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:08.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.652+0000 7f623e59c700 1 -- 172.21.15.6:0/1145231436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62300094a0 con 0x7f6240071690 2023-07-06T19:59:08.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.652+0000 7f623e59c700 1 --2- 172.21.15.6:0/1145231436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6240071690 0x7f624014e9a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f62300090b0 tx=0x7f6230004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:08.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.652+0000 7f622effd700 1 -- 172.21.15.6:0/1145231436 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62300036a0 con 0x7f6240071690 2023-07-06T19:59:08.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.652+0000 7f622effd700 1 -- 172.21.15.6:0/1145231436 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623001f070 con 0x7f6240071690 2023-07-06T19:59:08.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.652+0000 7f6244dfc700 1 -- 172.21.15.6:0/1145231436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6240153020 con 0x7f6240071690 2023-07-06T19:59:08.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.652+0000 7f622effd700 1 -- 172.21.15.6:0/1145231436 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6230003a20 con 0x7f6240071690 2023-07-06T19:59:08.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.652+0000 7f6244dfc700 1 -- 172.21.15.6:0/1145231436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624014eee0 con 0x7f6240071690 2023-07-06T19:59:08.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.653+0000 7f6244dfc700 1 -- 172.21.15.6:0/1145231436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624004eb90 con 0x7f6240071690 2023-07-06T19:59:08.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.653+0000 7f622effd700 1 -- 172.21.15.6:0/1145231436 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6230003b80 con 0x7f6240071690 2023-07-06T19:59:08.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.654+0000 7f622effd700 1 --2- 172.21.15.6:0/1145231436 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f622006ace0 0x7f622006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:08.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.654+0000 7f622effd700 1 -- 172.21.15.6:0/1145231436 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6230021070 con 0x7f6240071690 2023-07-06T19:59:08.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.654+0000 7f623dd9b700 1 --2- 172.21.15.6:0/1145231436 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f622006ace0 0x7f622006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:08.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.654+0000 7f623dd9b700 1 --2- 172.21.15.6:0/1145231436 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f622006ace0 0x7f622006d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f624015e7c0 tx=0x7f6234008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:08.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.658+0000 7f622effd700 1 -- 172.21.15.6:0/1145231436 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6230055e20 con 0x7f6240071690 2023-07-06T19:59:08.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.858+0000 7f6244dfc700 1 -- 172.21.15.6:0/1145231436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f62400c31a0 con 0x7f6240071690 2023-07-06T19:59:08.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.858+0000 7f622effd700 1 -- 172.21.15.6:0/1145231436 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f623002b0a0 con 0x7f6240071690 2023-07-06T19:59:08.860 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T19:59:08.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.860+0000 7f6244dfc700 1 -- 172.21.15.6:0/1145231436 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f622006ace0 msgr2=0x7f622006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:08.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.860+0000 7f6244dfc700 1 --2- 172.21.15.6:0/1145231436 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f622006ace0 0x7f622006d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f624015e7c0 tx=0x7f6234008040 comp rx=0 tx=0).stop 2023-07-06T19:59:08.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.860+0000 7f6244dfc700 1 -- 172.21.15.6:0/1145231436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6240071690 msgr2=0x7f624014e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:08.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.860+0000 7f6244dfc700 1 --2- 172.21.15.6:0/1145231436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6240071690 0x7f624014e9a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f62300090b0 tx=0x7f6230004750 comp rx=0 tx=0).stop 2023-07-06T19:59:08.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.860+0000 7f6244dfc700 1 -- 172.21.15.6:0/1145231436 shutdown_connections 2023-07-06T19:59:08.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.860+0000 7f6244dfc700 1 --2- 172.21.15.6:0/1145231436 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f622006ace0 0x7f622006d190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:08.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.860+0000 7f6244dfc700 1 --2- 172.21.15.6:0/1145231436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6240071690 0x7f624014e9a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:08.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.860+0000 7f6244dfc700 1 --2- 172.21.15.6:0/1145231436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f624015de10 0x7f6240157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:08.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.860+0000 7f6244dfc700 1 --2- 172.21.15.6:0/1145231436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62400aef10 0x7f6240153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:08.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.860+0000 7f6244dfc700 1 -- 172.21.15.6:0/1145231436 >> 172.21.15.6:0/1145231436 conn(0x7f62400cf960 msgr2=0x7f624015d380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:08.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.860+0000 7f6244dfc700 1 -- 172.21.15.6:0/1145231436 shutdown_connections 2023-07-06T19:59:08.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:08.860+0000 7f6244dfc700 1 -- 172.21.15.6:0/1145231436 wait complete. 2023-07-06T19:59:08.877 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T19:59:09.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.001+0000 7f28c8a9e700 1 Processor -- start 2023-07-06T19:59:09.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.001+0000 7f28c8a9e700 1 -- start start 2023-07-06T19:59:09.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.002+0000 7f28c8a9e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f28c415e930 0x7f28c40cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:09.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.002+0000 7f28c8a9e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28c40cf520 0x7f28c40c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:09.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.002+0000 7f28c8a9e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c406a840 con 0x7f28c40b4940 2023-07-06T19:59:09.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.002+0000 7f28c8a9e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c40cf9a0 con 0x7f28c415e930 2023-07-06T19:59:09.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.002+0000 7f28c8a9e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c415b700 con 0x7f28c40cf520 2023-07-06T19:59:09.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.003+0000 7f28c259c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f28c40b4940 0x7f28c406a060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59938/0 (socket says 172.21.15.6:59938) 2023-07-06T19:59:09.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.003+0000 7f28c259c700 1 -- 172.21.15.6:0/51630811 learned_addr learned my addr 172.21.15.6:0/51630811 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:09.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.003+0000 7f28c159a700 1 -- 172.21.15.6:0/51630811 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 163311083 0 0) 0x7f28c406a840 con 0x7f28c40b4940 2023-07-06T19:59:09.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.003+0000 7f28c159a700 1 -- 172.21.15.6:0/51630811 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28b00035b0 con 0x7f28c40b4940 2023-07-06T19:59:09.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.003+0000 7f28c1d9b700 1 --2- 172.21.15.6:0/51630811 >> v2:172.21.15.40:3300/0 conn(0x7f28c415e930 0x7f28c40cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:09.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.003+0000 7f28c2d9d700 1 --2- 172.21.15.6:0/51630811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28c40cf520 0x7f28c40c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:09.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.003+0000 7f28c159a700 1 -- 172.21.15.6:0/51630811 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1250822762 0 0) 0x7f28b00035b0 con 0x7f28c40b4940 2023-07-06T19:59:09.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.003+0000 7f28c159a700 1 -- 172.21.15.6:0/51630811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28c40cf520 msgr2=0x7f28c40c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:09.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.003+0000 7f28c159a700 1 --2- 172.21.15.6:0/51630811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28c40cf520 0x7f28c40c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:09.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.003+0000 7f28c159a700 1 -- 172.21.15.6:0/51630811 >> v2:172.21.15.40:3300/0 conn(0x7f28c415e930 msgr2=0x7f28c40cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:09.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.003+0000 7f28c159a700 1 --2- 172.21.15.6:0/51630811 >> v2:172.21.15.40:3300/0 conn(0x7f28c415e930 0x7f28c40cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:09.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.003+0000 7f28c159a700 1 -- 172.21.15.6:0/51630811 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c415a940 con 0x7f28c40b4940 2023-07-06T19:59:09.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.003+0000 7f28c159a700 1 -- 172.21.15.6:0/51630811 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f28b4001670 con 0x7f28c40b4940 2023-07-06T19:59:09.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.003+0000 7f28c159a700 1 -- 172.21.15.6:0/51630811 >> v1:172.21.15.6:6789/0 conn(0x7f28c40b4940 legacy=0x7f28c406a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:09.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.003+0000 7f28c159a700 1 --2- 172.21.15.6:0/51630811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28c40cf520 0x7f28b0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:09.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.003+0000 7f28c159a700 1 --2- 172.21.15.6:0/51630811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28b0003f80 0x7f28b0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:09.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.003+0000 7f28c159a700 1 --2- 172.21.15.6:0/51630811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b0004d90 0x7f28b0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:09.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.003+0000 7f28c159a700 1 -- 172.21.15.6:0/51630811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c40cf9a0 con 0x7f28b0004d90 2023-07-06T19:59:09.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.003+0000 7f28c159a700 1 -- 172.21.15.6:0/51630811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c415b700 con 0x7f28b0003f80 2023-07-06T19:59:09.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.003+0000 7f28c159a700 1 -- 172.21.15.6:0/51630811 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b000ba10 con 0x7f28c40cf520 2023-07-06T19:59:09.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.003+0000 7f28c2d9d700 1 --2- 172.21.15.6:0/51630811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b0004d90 0x7f28b0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:09.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.003+0000 7f28c259c700 1 --2- 172.21.15.6:0/51630811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28c40cf520 0x7f28b0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:09.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.003+0000 7f28c1d9b700 1 --2- 172.21.15.6:0/51630811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28b0003f80 0x7f28b0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:09.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.004+0000 7f28c2d9d700 1 -- 172.21.15.6:0/51630811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28c40cf520 msgr2=0x7f28b0003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:09.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.004+0000 7f28c2d9d700 1 --2- 172.21.15.6:0/51630811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28c40cf520 0x7f28b0003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:09.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.004+0000 7f28c2d9d700 1 -- 172.21.15.6:0/51630811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28b0003f80 msgr2=0x7f28b0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:09.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.004+0000 7f28c2d9d700 1 --2- 172.21.15.6:0/51630811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28b0003f80 0x7f28b0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:09.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.004+0000 7f28c2d9d700 1 -- 172.21.15.6:0/51630811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b00035b0 con 0x7f28b0004d90 2023-07-06T19:59:09.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.004+0000 7f28c1d9b700 1 --2- 172.21.15.6:0/51630811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28b0003f80 0x7f28b0004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:09.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.004+0000 7f28c259c700 1 --2- 172.21.15.6:0/51630811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28c40cf520 0x7f28b0003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:09.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.004+0000 7f28c2d9d700 1 --2- 172.21.15.6:0/51630811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b0004d90 0x7f28b0005200 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f28bc009fc0 tx=0x7f28b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff42ea8d078b987 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:09.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.004+0000 7f28c159a700 1 -- 172.21.15.6:0/51630811 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc00ec30 con 0x7f28b0004d90 2023-07-06T19:59:09.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.004+0000 7f28c159a700 1 -- 172.21.15.6:0/51630811 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28bc00f040 con 0x7f28b0004d90 2023-07-06T19:59:09.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.004+0000 7f28c159a700 1 -- 172.21.15.6:0/51630811 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc014480 con 0x7f28b0004d90 2023-07-06T19:59:09.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.004+0000 7f28c8a9e700 1 -- 172.21.15.6:0/51630811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b0004d90 msgr2=0x7f28b0005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:09.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.004+0000 7f28c8a9e700 1 --2- 172.21.15.6:0/51630811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28b0004d90 0x7f28b0005200 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f28bc009fc0 tx=0x7f28b0005880 comp rx=0 tx=0).stop 2023-07-06T19:59:09.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.004+0000 7f28c2d9d700 1 -- 172.21.15.6:0/51630811 reap_dead start 2023-07-06T19:59:09.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.005+0000 7f28c8a9e700 1 -- 172.21.15.6:0/51630811 shutdown_connections 2023-07-06T19:59:09.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.005+0000 7f28c8a9e700 1 -- 172.21.15.6:0/51630811 >> 172.21.15.6:0/51630811 conn(0x7f28c40b0b60 msgr2=0x7f28c40b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:09.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.005+0000 7f28c8a9e700 1 -- 172.21.15.6:0/51630811 shutdown_connections 2023-07-06T19:59:09.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.005+0000 7f28c8a9e700 1 -- 172.21.15.6:0/51630811 wait complete. 2023-07-06T19:59:09.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.006+0000 7f28c8a9e700 1 Processor -- start 2023-07-06T19:59:09.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.006+0000 7f28c8a9e700 1 -- start start 2023-07-06T19:59:09.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.007+0000 7f28c8a9e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28b0004d90 0x7f28c40cd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:09.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.007+0000 7f28c8a9e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28c40cb080 0x7f28c41f1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:09.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.007+0000 7f28c8a9e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28c40af340 0x7f28c40af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:09.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.007+0000 7f28c8a9e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c40afcf0 con 0x7f28c40cb080 2023-07-06T19:59:09.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.007+0000 7f28c8a9e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c40cebc0 con 0x7f28b0004d90 2023-07-06T19:59:09.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.007+0000 7f28c8a9e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c40ce040 con 0x7f28c40af340 2023-07-06T19:59:09.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.007+0000 7f28c1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28c40cb080 0x7f28c41f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:09.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.007+0000 7f28c1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28c40cb080 0x7f28c41f1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58742/0 (socket says 172.21.15.6:58742) 2023-07-06T19:59:09.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.007+0000 7f28c1d9b700 1 -- 172.21.15.6:0/3871524883 learned_addr learned my addr 172.21.15.6:0/3871524883 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:09.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.007+0000 7f28c259c700 1 --2- 172.21.15.6:0/3871524883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28b0004d90 0x7f28c40cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:09.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.007+0000 7f28c1d9b700 1 -- 172.21.15.6:0/3871524883 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28c40af340 msgr2=0x7f28c40af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:09.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.007+0000 7f28c2d9d700 1 --2- 172.21.15.6:0/3871524883 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28c40af340 0x7f28c40af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:09.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.007+0000 7f28c1d9b700 1 --2- 172.21.15.6:0/3871524883 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28c40af340 0x7f28c40af7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:09.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.007+0000 7f28c1d9b700 1 -- 172.21.15.6:0/3871524883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28b0004d90 msgr2=0x7f28c40cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:09.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.007+0000 7f28c1d9b700 1 --2- 172.21.15.6:0/3871524883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28b0004d90 0x7f28c40cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:09.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.007+0000 7f28c1d9b700 1 -- 172.21.15.6:0/3871524883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c40ce320 con 0x7f28c40cb080 2023-07-06T19:59:09.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.008+0000 7f28c259c700 1 --2- 172.21.15.6:0/3871524883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28b0004d90 0x7f28c40cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:09.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.008+0000 7f28c2d9d700 1 --2- 172.21.15.6:0/3871524883 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28c40af340 0x7f28c40af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:09.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.008+0000 7f28c1d9b700 1 --2- 172.21.15.6:0/3871524883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28c40cb080 0x7f28c41f1240 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f28ac010930 tx=0x7f28ac010cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:09.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.008+0000 7f28baffd700 1 -- 172.21.15.6:0/3871524883 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac004020 con 0x7f28c40cb080 2023-07-06T19:59:09.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.008+0000 7f28baffd700 1 -- 172.21.15.6:0/3871524883 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ac004180 con 0x7f28c40cb080 2023-07-06T19:59:09.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.008+0000 7f28baffd700 1 -- 172.21.15.6:0/3871524883 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac004530 con 0x7f28c40cb080 2023-07-06T19:59:09.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.008+0000 7f28c8a9e700 1 -- 172.21.15.6:0/3871524883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c40ce600 con 0x7f28c40cb080 2023-07-06T19:59:09.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.008+0000 7f28c8a9e700 1 -- 172.21.15.6:0/3871524883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c40cb4f0 con 0x7f28c40cb080 2023-07-06T19:59:09.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.009+0000 7f28c8a9e700 1 -- 172.21.15.6:0/3871524883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c404eb90 con 0x7f28c40cb080 2023-07-06T19:59:09.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.009+0000 7f28baffd700 1 -- 172.21.15.6:0/3871524883 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f28ac00e870 con 0x7f28c40cb080 2023-07-06T19:59:09.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.010+0000 7f28baffd700 1 --2- 172.21.15.6:0/3871524883 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f28a406ace0 0x7f28a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:09.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.010+0000 7f28baffd700 1 -- 172.21.15.6:0/3871524883 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f28ac089ba0 con 0x7f28c40cb080 2023-07-06T19:59:09.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.010+0000 7f28c259c700 1 --2- 172.21.15.6:0/3871524883 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f28a406ace0 0x7f28a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:09.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.010+0000 7f28c259c700 1 --2- 172.21.15.6:0/3871524883 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f28a406ace0 0x7f28a406d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f28b4000fb0 tx=0x7f28b4001ba0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:09.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.014+0000 7f28baffd700 1 -- 172.21.15.6:0/3871524883 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f28ac0548c0 con 0x7f28c40cb080 2023-07-06T19:59:09.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.231+0000 7f28c8a9e700 1 -- 172.21.15.6:0/3871524883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f28c40abfc0 con 0x7f28c40cb080 2023-07-06T19:59:09.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.231+0000 7f28baffd700 1 -- 172.21.15.6:0/3871524883 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f28ac057ee0 con 0x7f28c40cb080 2023-07-06T19:59:09.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.233+0000 7f28c8a9e700 1 -- 172.21.15.6:0/3871524883 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f28a406ace0 msgr2=0x7f28a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:09.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.233+0000 7f28c8a9e700 1 --2- 172.21.15.6:0/3871524883 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f28a406ace0 0x7f28a406d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f28b4000fb0 tx=0x7f28b4001ba0 comp rx=0 tx=0).stop 2023-07-06T19:59:09.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.233+0000 7f28c8a9e700 1 -- 172.21.15.6:0/3871524883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28c40cb080 msgr2=0x7f28c41f1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:09.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.233+0000 7f28c8a9e700 1 --2- 172.21.15.6:0/3871524883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28c40cb080 0x7f28c41f1240 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f28ac010930 tx=0x7f28ac010cf0 comp rx=0 tx=0).stop 2023-07-06T19:59:09.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.233+0000 7f28c8a9e700 1 -- 172.21.15.6:0/3871524883 shutdown_connections 2023-07-06T19:59:09.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.233+0000 7f28c8a9e700 1 --2- 172.21.15.6:0/3871524883 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f28a406ace0 0x7f28a406d190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:09.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.233+0000 7f28c8a9e700 1 --2- 172.21.15.6:0/3871524883 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f28c40af340 0x7f28c40af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:09.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.233+0000 7f28c8a9e700 1 --2- 172.21.15.6:0/3871524883 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f28b0004d90 0x7f28c40cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:09.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.233+0000 7f28c8a9e700 1 --2- 172.21.15.6:0/3871524883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28c40cb080 0x7f28c41f1240 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:09.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.233+0000 7f28c8a9e700 1 -- 172.21.15.6:0/3871524883 >> 172.21.15.6:0/3871524883 conn(0x7f28c40b0b60 msgr2=0x7f28c40b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:09.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.233+0000 7f28c8a9e700 1 -- 172.21.15.6:0/3871524883 shutdown_connections 2023-07-06T19:59:09.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:09.233+0000 7f28c8a9e700 1 -- 172.21.15.6:0/3871524883 wait complete. 2023-07-06T19:59:09.245 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-07-06T19:59:09.247 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2023-07-06T19:59:09.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:09.249 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-07-06T19:59:09.291 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi006.stderr:ceph-fuse[109101]: fuse finished with error 0 and tester_r 0 2023-07-06T19:59:09.295 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T19:59:15.402 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-07-06T19:59:15.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:15.403 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-07-06T19:59:15.444 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T19:59:15.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.624+0000 7f48c87e1700 1 Processor -- start 2023-07-06T19:59:15.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.624+0000 7f48c87e1700 1 -- start start 2023-07-06T19:59:15.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.625+0000 7f48c87e1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f48c0158860 0x7f48c00b2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:15.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.625+0000 7f48c87e1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f48c00715f0 0x7f48c015c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:15.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.625+0000 7f48c87e1700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c00b2d80 con 0x7f48c00b2870 2023-07-06T19:59:15.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.625+0000 7f48c87e1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c0159000 con 0x7f48c00715f0 2023-07-06T19:59:15.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.625+0000 7f48c87e1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c01592e0 con 0x7f48c0158860 2023-07-06T19:59:15.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.626+0000 7f48c6d7e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f48c00715f0 0x7f48c015c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:15.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.626+0000 7f48c6d7e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f48c00715f0 0x7f48c015c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58754/0 (socket says 172.21.15.6:58754) 2023-07-06T19:59:15.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.626+0000 7f48c6d7e700 1 -- 172.21.15.6:0/87273779 learned_addr learned my addr 172.21.15.6:0/87273779 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:15.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.626+0000 7f48c657d700 1 --2- 172.21.15.6:0/87273779 >> v2:172.21.15.40:3300/0 conn(0x7f48c0158860 0x7f48c00b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:15.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.626+0000 7f48c6d7e700 1 -- 172.21.15.6:0/87273779 >> v2:172.21.15.40:3300/0 conn(0x7f48c0158860 msgr2=0x7f48c00b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:15.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.626+0000 7f48c6d7e700 1 --2- 172.21.15.6:0/87273779 >> v2:172.21.15.40:3300/0 conn(0x7f48c0158860 0x7f48c00b2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:15.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.626+0000 7f48c6d7e700 1 -- 172.21.15.6:0/87273779 >> v1:172.21.15.40:6789/0 conn(0x7f48c00b2870 legacy=0x7f48c0070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:15.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.626+0000 7f48c6d7e700 1 -- 172.21.15.6:0/87273779 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c01595c0 con 0x7f48c00715f0 2023-07-06T19:59:15.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.626+0000 7f48c6d7e700 1 --2- 172.21.15.6:0/87273779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c00715f0 0x7f48c015c3c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f48c00b3f80 tx=0x7f48b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a6b15bb6f3c1bf server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:15.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.626+0000 7f48c557b700 1 -- 172.21.15.6:0/87273779 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b800e070 con 0x7f48c00715f0 2023-07-06T19:59:15.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.626+0000 7f48c557b700 1 -- 172.21.15.6:0/87273779 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b800b910 con 0x7f48c00715f0 2023-07-06T19:59:15.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.626+0000 7f48c557b700 1 -- 172.21.15.6:0/87273779 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b800bcc0 con 0x7f48c00715f0 2023-07-06T19:59:15.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.627+0000 7f48c87e1700 1 -- 172.21.15.6:0/87273779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c00715f0 msgr2=0x7f48c015c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:15.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.627+0000 7f48c87e1700 1 --2- 172.21.15.6:0/87273779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c00715f0 0x7f48c015c3c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f48c00b3f80 tx=0x7f48b800b330 comp rx=0 tx=0).stop 2023-07-06T19:59:15.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.627+0000 7f48c87e1700 1 -- 172.21.15.6:0/87273779 shutdown_connections 2023-07-06T19:59:15.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.627+0000 7f48c87e1700 1 --2- 172.21.15.6:0/87273779 >> v2:172.21.15.40:3300/0 conn(0x7f48c0158860 0x7f48c00b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:15.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.627+0000 7f48c87e1700 1 --2- 172.21.15.6:0/87273779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c00715f0 0x7f48c015c3c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:15.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.627+0000 7f48c87e1700 1 -- 172.21.15.6:0/87273779 >> 172.21.15.6:0/87273779 conn(0x7f48c00b05b0 msgr2=0x7f48c00b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:15.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.627+0000 7f48c87e1700 1 -- 172.21.15.6:0/87273779 shutdown_connections 2023-07-06T19:59:15.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.627+0000 7f48c87e1700 1 -- 172.21.15.6:0/87273779 wait complete. 2023-07-06T19:59:15.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.628+0000 7f48c87e1700 1 Processor -- start 2023-07-06T19:59:15.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.628+0000 7f48c87e1700 1 -- start start 2023-07-06T19:59:15.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.629+0000 7f48c87e1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c00715f0 0x7f48c00cc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:15.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.629+0000 7f48c87e1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c00b2870 0x7f48c00ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:15.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.629+0000 7f48c87e1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48c0158860 0x7f48c0145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:15.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.629+0000 7f48c87e1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c00c7f60 con 0x7f48c00715f0 2023-07-06T19:59:15.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.629+0000 7f48c87e1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c00c8240 con 0x7f48c00b2870 2023-07-06T19:59:15.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.629+0000 7f48c87e1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c00c8520 con 0x7f48c0158860 2023-07-06T19:59:15.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.629+0000 7f48c657d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c00715f0 0x7f48c00cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:15.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.629+0000 7f48c657d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c00715f0 0x7f48c00cc860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58756/0 (socket says 172.21.15.6:58756) 2023-07-06T19:59:15.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.629+0000 7f48c657d700 1 -- 172.21.15.6:0/2018090811 learned_addr learned my addr 172.21.15.6:0/2018090811 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:15.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.629+0000 7f48c5d7c700 1 --2- 172.21.15.6:0/2018090811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c00b2870 0x7f48c00ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:15.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.629+0000 7f48c6d7e700 1 --2- 172.21.15.6:0/2018090811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48c0158860 0x7f48c0145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:15.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.629+0000 7f48c657d700 1 -- 172.21.15.6:0/2018090811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48c0158860 msgr2=0x7f48c0145e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:15.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.629+0000 7f48c657d700 1 --2- 172.21.15.6:0/2018090811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48c0158860 0x7f48c0145e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:15.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.629+0000 7f48c657d700 1 -- 172.21.15.6:0/2018090811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c00b2870 msgr2=0x7f48c00ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:15.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.629+0000 7f48c657d700 1 --2- 172.21.15.6:0/2018090811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c00b2870 0x7f48c00ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:15.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.629+0000 7f48c657d700 1 -- 172.21.15.6:0/2018090811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b8009b30 con 0x7f48c00715f0 2023-07-06T19:59:15.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.630+0000 7f48c657d700 1 --2- 172.21.15.6:0/2018090811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c00715f0 0x7f48c00cc860 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f48bc00e870 tx=0x7f48bc00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:15.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.630+0000 7f48b2ffd700 1 -- 172.21.15.6:0/2018090811 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc009590 con 0x7f48c00715f0 2023-07-06T19:59:15.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.630+0000 7f48b2ffd700 1 -- 172.21.15.6:0/2018090811 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48bc013680 con 0x7f48c00715f0 2023-07-06T19:59:15.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.630+0000 7f48c87e1700 1 -- 172.21.15.6:0/2018090811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c00c8800 con 0x7f48c00715f0 2023-07-06T19:59:15.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.630+0000 7f48b2ffd700 1 -- 172.21.15.6:0/2018090811 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc0139f0 con 0x7f48c00715f0 2023-07-06T19:59:15.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.630+0000 7f48c87e1700 1 -- 172.21.15.6:0/2018090811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c00c7c30 con 0x7f48c00715f0 2023-07-06T19:59:15.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.631+0000 7f48c87e1700 1 -- 172.21.15.6:0/2018090811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c00b0a50 con 0x7f48c00715f0 2023-07-06T19:59:15.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.631+0000 7f48b2ffd700 1 -- 172.21.15.6:0/2018090811 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f48bc013b50 con 0x7f48c00715f0 2023-07-06T19:59:15.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.632+0000 7f48b2ffd700 1 --2- 172.21.15.6:0/2018090811 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f48a406ace0 0x7f48a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:15.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.632+0000 7f48b2ffd700 1 -- 172.21.15.6:0/2018090811 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f48bc089ec0 con 0x7f48c00715f0 2023-07-06T19:59:15.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.632+0000 7f48c5d7c700 1 --2- 172.21.15.6:0/2018090811 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f48a406ace0 0x7f48a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:15.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.632+0000 7f48c5d7c700 1 --2- 172.21.15.6:0/2018090811 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f48a406ace0 0x7f48a406d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f48c00cd470 tx=0x7f48b4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:15.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.636+0000 7f48b2ffd700 1 -- 172.21.15.6:0/2018090811 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f48bc054c60 con 0x7f48c00715f0 2023-07-06T19:59:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.836+0000 7f48c87e1700 1 -- 172.21.15.6:0/2018090811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48c006caf0 con 0x7f48c00715f0 2023-07-06T19:59:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.837+0000 7f48b2ffd700 1 -- 172.21.15.6:0/2018090811 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19964 (secure 0 0 0) 0x7f48bc058280 con 0x7f48c00715f0 2023-07-06T19:59:15.842 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:15.842 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:58:58.202291+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T19:58:51.062712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T19:58:52.130350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T19:58:55.785128+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:59:15.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.839+0000 7f48c87e1700 1 -- 172.21.15.6:0/2018090811 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f48a406ace0 msgr2=0x7f48a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:15.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.839+0000 7f48c87e1700 1 --2- 172.21.15.6:0/2018090811 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f48a406ace0 0x7f48a406d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f48c00cd470 tx=0x7f48b4009040 comp rx=0 tx=0).stop 2023-07-06T19:59:15.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.839+0000 7f48c87e1700 1 -- 172.21.15.6:0/2018090811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c00715f0 msgr2=0x7f48c00cc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:15.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.839+0000 7f48c87e1700 1 --2- 172.21.15.6:0/2018090811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c00715f0 0x7f48c00cc860 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f48bc00e870 tx=0x7f48bc00eb80 comp rx=0 tx=0).stop 2023-07-06T19:59:15.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.839+0000 7f48c87e1700 1 -- 172.21.15.6:0/2018090811 shutdown_connections 2023-07-06T19:59:15.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.839+0000 7f48c87e1700 1 --2- 172.21.15.6:0/2018090811 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f48a406ace0 0x7f48a406d190 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:15.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.839+0000 7f48c87e1700 1 --2- 172.21.15.6:0/2018090811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48c00715f0 0x7f48c00cc860 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:15.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.839+0000 7f48c87e1700 1 --2- 172.21.15.6:0/2018090811 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f48c0158860 0x7f48c0145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:15.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.839+0000 7f48c87e1700 1 --2- 172.21.15.6:0/2018090811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c00b2870 0x7f48c00ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:15.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.839+0000 7f48c87e1700 1 -- 172.21.15.6:0/2018090811 >> 172.21.15.6:0/2018090811 conn(0x7f48c00b05b0 msgr2=0x7f48c0151ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:15.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.839+0000 7f48c87e1700 1 -- 172.21.15.6:0/2018090811 shutdown_connections 2023-07-06T19:59:15.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.839+0000 7f48c87e1700 1 -- 172.21.15.6:0/2018090811 wait complete. 2023-07-06T19:59:15.853 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T19:59:15.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.978+0000 7f973ff9b700 1 Processor -- start 2023-07-06T19:59:15.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.978+0000 7f973ff9b700 1 -- start start 2023-07-06T19:59:15.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.979+0000 7f973ff9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f97380ceab0 0x7f97380caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:15.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.979+0000 7f973ff9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9738071dd0 0x7f97381602c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:15.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.979+0000 7f973ff9b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9738160ff0 con 0x7f97380cee80 2023-07-06T19:59:15.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.979+0000 7f973ff9b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97380cb400 con 0x7f97380ceab0 2023-07-06T19:59:15.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.979+0000 7f973ff9b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97380ca100 con 0x7f9738071dd0 2023-07-06T19:59:15.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.980+0000 7f973dd37700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f97380ceab0 0x7f97380caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:15.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.980+0000 7f973e538700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9738071dd0 0x7f97381602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:15.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.980+0000 7f973dd37700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f97380ceab0 0x7f97380caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:37800/0 (socket says 172.21.15.6:37800) 2023-07-06T19:59:15.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.980+0000 7f973e538700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9738071dd0 0x7f97381602c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:51412/0 (socket says 172.21.15.6:51412) 2023-07-06T19:59:15.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.980+0000 7f973dd37700 1 -- 172.21.15.6:0/3110697426 learned_addr learned my addr 172.21.15.6:0/3110697426 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:15.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.980+0000 7f973d536700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f97380cee80 0x7f97380716c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:49846/0 (socket says 172.21.15.6:49846) 2023-07-06T19:59:15.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.980+0000 7f973dd37700 1 -- 172.21.15.6:0/3110697426 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9738071dd0 msgr2=0x7f97381602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:15.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.980+0000 7f973dd37700 1 --2- 172.21.15.6:0/3110697426 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9738071dd0 0x7f97381602c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:15.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.980+0000 7f973dd37700 1 -- 172.21.15.6:0/3110697426 >> v1:172.21.15.40:6789/0 conn(0x7f97380cee80 legacy=0x7f97380716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:15.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.980+0000 7f973dd37700 1 -- 172.21.15.6:0/3110697426 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97380ca3e0 con 0x7f97380ceab0 2023-07-06T19:59:15.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.980+0000 7f973dd37700 1 --2- 172.21.15.6:0/3110697426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97380ceab0 0x7f97380caec0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9728009e50 tx=0x7f972800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3988307a522d7139 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:15.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.980+0000 7f973cd35700 1 -- 172.21.15.6:0/3110697426 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972800e070 con 0x7f97380ceab0 2023-07-06T19:59:15.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.980+0000 7f973cd35700 1 -- 172.21.15.6:0/3110697426 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972800b910 con 0x7f97380ceab0 2023-07-06T19:59:15.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.980+0000 7f973cd35700 1 -- 172.21.15.6:0/3110697426 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972800bcc0 con 0x7f97380ceab0 2023-07-06T19:59:15.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.981+0000 7f973ff9b700 1 -- 172.21.15.6:0/3110697426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97380ceab0 msgr2=0x7f97380caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:15.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.981+0000 7f973ff9b700 1 --2- 172.21.15.6:0/3110697426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97380ceab0 0x7f97380caec0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9728009e50 tx=0x7f972800b330 comp rx=0 tx=0).stop 2023-07-06T19:59:15.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.981+0000 7f973ff9b700 1 -- 172.21.15.6:0/3110697426 shutdown_connections 2023-07-06T19:59:15.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.981+0000 7f973ff9b700 1 --2- 172.21.15.6:0/3110697426 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9738071dd0 0x7f97381602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:15.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.981+0000 7f973ff9b700 1 --2- 172.21.15.6:0/3110697426 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97380ceab0 0x7f97380caec0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:15.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.981+0000 7f973ff9b700 1 -- 172.21.15.6:0/3110697426 >> 172.21.15.6:0/3110697426 conn(0x7f97380cc420 msgr2=0x7f97380cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:15.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.981+0000 7f973ff9b700 1 -- 172.21.15.6:0/3110697426 shutdown_connections 2023-07-06T19:59:15.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.981+0000 7f973ff9b700 1 -- 172.21.15.6:0/3110697426 wait complete. 2023-07-06T19:59:15.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.982+0000 7f973ff9b700 1 Processor -- start 2023-07-06T19:59:15.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.982+0000 7f973ff9b700 1 -- start start 2023-07-06T19:59:15.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.983+0000 7f973ff9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9738071dd0 0x7f97380b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:15.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.983+0000 7f973ff9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97380ceab0 0x7f973815abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:15.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.983+0000 7f973ff9b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97380cee80 0x7f9738150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:15.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.983+0000 7f973ff9b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97380b02e0 con 0x7f97380ceab0 2023-07-06T19:59:15.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.983+0000 7f973ff9b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97380b12d0 con 0x7f97380cee80 2023-07-06T19:59:15.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.983+0000 7f973ff9b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97380b0980 con 0x7f9738071dd0 2023-07-06T19:59:15.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.983+0000 7f973d536700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97380ceab0 0x7f973815abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:15.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.983+0000 7f973d536700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97380ceab0 0x7f973815abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58772/0 (socket says 172.21.15.6:58772) 2023-07-06T19:59:15.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.983+0000 7f973d536700 1 -- 172.21.15.6:0/3868840488 learned_addr learned my addr 172.21.15.6:0/3868840488 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:15.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.983+0000 7f973dd37700 1 --2- 172.21.15.6:0/3868840488 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9738071dd0 0x7f97380b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:15.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.983+0000 7f973e538700 1 --2- 172.21.15.6:0/3868840488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97380cee80 0x7f9738150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:15.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.983+0000 7f973d536700 1 -- 172.21.15.6:0/3868840488 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9738071dd0 msgr2=0x7f97380b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:15.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.983+0000 7f973d536700 1 --2- 172.21.15.6:0/3868840488 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9738071dd0 0x7f97380b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:15.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.983+0000 7f973d536700 1 -- 172.21.15.6:0/3868840488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97380cee80 msgr2=0x7f9738150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:15.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.983+0000 7f973d536700 1 --2- 172.21.15.6:0/3868840488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97380cee80 0x7f9738150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:15.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.983+0000 7f973d536700 1 -- 172.21.15.6:0/3868840488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9728009b30 con 0x7f97380ceab0 2023-07-06T19:59:15.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.984+0000 7f973d536700 1 --2- 172.21.15.6:0/3868840488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97380ceab0 0x7f973815abf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f972c00c520 tx=0x7f972c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:15.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.984+0000 7f97367fc700 1 -- 172.21.15.6:0/3868840488 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c005cb0 con 0x7f97380ceab0 2023-07-06T19:59:16.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.984+0000 7f97367fc700 1 -- 172.21.15.6:0/3868840488 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972c005e10 con 0x7f97380ceab0 2023-07-06T19:59:16.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.984+0000 7f973ff9b700 1 -- 172.21.15.6:0/3868840488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97380af760 con 0x7f97380ceab0 2023-07-06T19:59:16.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.984+0000 7f97367fc700 1 -- 172.21.15.6:0/3868840488 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c0072d0 con 0x7f97380ceab0 2023-07-06T19:59:16.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.984+0000 7f973ff9b700 1 -- 172.21.15.6:0/3868840488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97380afd20 con 0x7f97380ceab0 2023-07-06T19:59:16.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.985+0000 7f973ff9b700 1 -- 172.21.15.6:0/3868840488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97380b3570 con 0x7f97380ceab0 2023-07-06T19:59:16.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.985+0000 7f97367fc700 1 -- 172.21.15.6:0/3868840488 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f972c007430 con 0x7f97380ceab0 2023-07-06T19:59:16.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.986+0000 7f97367fc700 1 --2- 172.21.15.6:0/3868840488 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f972406ace0 0x7f972406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:16.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.986+0000 7f97367fc700 1 -- 172.21.15.6:0/3868840488 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f972c088af0 con 0x7f97380ceab0 2023-07-06T19:59:16.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.986+0000 7f973dd37700 1 --2- 172.21.15.6:0/3868840488 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f972406ace0 0x7f972406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:16.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.986+0000 7f973dd37700 1 --2- 172.21.15.6:0/3868840488 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f972406ace0 0x7f972406d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f972800b370 tx=0x7f9728009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:16.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:15.990+0000 7f97367fc700 1 -- 172.21.15.6:0/3868840488 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f97380b3570 con 0x7f97380ceab0 2023-07-06T19:59:16.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.187+0000 7f973ff9b700 1 -- 172.21.15.6:0/3868840488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97380b3570 con 0x7f97380ceab0 2023-07-06T19:59:16.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.189+0000 7f97367fc700 1 -- 172.21.15.6:0/3868840488 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19964 (secure 0 0 0) 0x7f97380b3570 con 0x7f97380ceab0 2023-07-06T19:59:16.191 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:16.191 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:58:58.202291+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T19:58:51.062712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T19:58:52.130350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T19:58:55.785128+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:59:16.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.191+0000 7f973ff9b700 1 -- 172.21.15.6:0/3868840488 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f972406ace0 msgr2=0x7f972406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:16.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.191+0000 7f973ff9b700 1 --2- 172.21.15.6:0/3868840488 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f972406ace0 0x7f972406d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f972800b370 tx=0x7f9728009000 comp rx=0 tx=0).stop 2023-07-06T19:59:16.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.191+0000 7f973ff9b700 1 -- 172.21.15.6:0/3868840488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97380ceab0 msgr2=0x7f973815abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:16.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.191+0000 7f973ff9b700 1 --2- 172.21.15.6:0/3868840488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97380ceab0 0x7f973815abf0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f972c00c520 tx=0x7f972c00c8e0 comp rx=0 tx=0).stop 2023-07-06T19:59:16.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.191+0000 7f973ff9b700 1 -- 172.21.15.6:0/3868840488 shutdown_connections 2023-07-06T19:59:16.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.191+0000 7f973ff9b700 1 --2- 172.21.15.6:0/3868840488 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f972406ace0 0x7f972406d190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:16.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.191+0000 7f973ff9b700 1 --2- 172.21.15.6:0/3868840488 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97380cee80 0x7f9738150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:16.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.191+0000 7f973ff9b700 1 --2- 172.21.15.6:0/3868840488 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9738071dd0 0x7f97380b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:16.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.191+0000 7f973ff9b700 1 --2- 172.21.15.6:0/3868840488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f97380ceab0 0x7f973815abf0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:16.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.191+0000 7f973ff9b700 1 -- 172.21.15.6:0/3868840488 >> 172.21.15.6:0/3868840488 conn(0x7f97380cc420 msgr2=0x7f97380cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:16.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.191+0000 7f973ff9b700 1 -- 172.21.15.6:0/3868840488 shutdown_connections 2023-07-06T19:59:16.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.191+0000 7f973ff9b700 1 -- 172.21.15.6:0/3868840488 wait complete. 2023-07-06T19:59:16.205 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-06T19:59:16.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.333+0000 7fd8ee032700 1 Processor -- start 2023-07-06T19:59:16.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.333+0000 7fd8ee032700 1 -- start start 2023-07-06T19:59:16.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.334+0000 7fd8ee032700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd8e80cf6f0 0x7fd8e8165120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:16.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.334+0000 7fd8ee032700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e806a840 con 0x7fd8e80b4940 2023-07-06T19:59:16.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.334+0000 7fd8ee032700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8e815b700 con 0x7fd8e815e930 2023-07-06T19:59:16.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.334+0000 7fd8ee032700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8e815a940 con 0x7fd8e80cf6f0 2023-07-06T19:59:16.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.334+0000 7fd8e77fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd8e80b4940 0x7fd8e806a060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:59986/0 (socket says 172.21.15.6:59986) 2023-07-06T19:59:16.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.334+0000 7fd8e77fe700 1 -- 172.21.15.6:0/1681696639 learned_addr learned my addr 172.21.15.6:0/1681696639 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:16.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.334+0000 7fd8e7fff700 1 --2- 172.21.15.6:0/1681696639 >> v2:172.21.15.40:3300/0 conn(0x7fd8e80cf6f0 0x7fd8e8165120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.334+0000 7fd8e67fc700 1 -- 172.21.15.6:0/1681696639 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3759137847 0 0) 0x7fd8e806a840 con 0x7fd8e80b4940 2023-07-06T19:59:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.334+0000 7fd8e67fc700 1 -- 172.21.15.6:0/1681696639 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8d40035b0 con 0x7fd8e80b4940 2023-07-06T19:59:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.334+0000 7fd8e67fc700 1 -- 172.21.15.6:0/1681696639 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 305931484 0 0) 0x7fd8d40035b0 con 0x7fd8e80b4940 2023-07-06T19:59:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.334+0000 7fd8e67fc700 1 -- 172.21.15.6:0/1681696639 >> v2:172.21.15.40:3300/0 conn(0x7fd8e80cf6f0 msgr2=0x7fd8e8165120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.334+0000 7fd8e67fc700 1 --2- 172.21.15.6:0/1681696639 >> v2:172.21.15.40:3300/0 conn(0x7fd8e80cf6f0 0x7fd8e8165120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.334+0000 7fd8e67fc700 1 -- 172.21.15.6:0/1681696639 >> v1:172.21.15.40:6789/0 conn(0x7fd8e815e930 legacy=0x7fd8e80cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:16.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.334+0000 7fd8e67fc700 1 -- 172.21.15.6:0/1681696639 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e815ac20 con 0x7fd8e80b4940 2023-07-06T19:59:16.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.334+0000 7fd8e67fc700 1 -- 172.21.15.6:0/1681696639 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7fd8e0001670 con 0x7fd8e80b4940 2023-07-06T19:59:16.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.334+0000 7fd8e67fc700 1 -- 172.21.15.6:0/1681696639 >> v1:172.21.15.6:6789/0 conn(0x7fd8e80b4940 legacy=0x7fd8e806a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:16.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.334+0000 7fd8e67fc700 1 --2- 172.21.15.6:0/1681696639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8d4003a00 0x7fd8d4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:16.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.334+0000 7fd8e67fc700 1 --2- 172.21.15.6:0/1681696639 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8d4004850 0x7fd8d4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:16.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.335+0000 7fd8e67fc700 1 --2- 172.21.15.6:0/1681696639 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8d4005200 0x7fd8d400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:16.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.335+0000 7fd8e67fc700 1 -- 172.21.15.6:0/1681696639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e815a940 con 0x7fd8d4003a00 2023-07-06T19:59:16.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.335+0000 7fd8e67fc700 1 -- 172.21.15.6:0/1681696639 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d400c190 con 0x7fd8d4005200 2023-07-06T19:59:16.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.335+0000 7fd8e67fc700 1 -- 172.21.15.6:0/1681696639 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d400c350 con 0x7fd8d4004850 2023-07-06T19:59:16.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.335+0000 7fd8e77fe700 1 --2- 172.21.15.6:0/1681696639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8d4003a00 0x7fd8d4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:16.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.335+0000 7fd8e6ffd700 1 --2- 172.21.15.6:0/1681696639 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8d4004850 0x7fd8d4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:16.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.335+0000 7fd8e7fff700 1 --2- 172.21.15.6:0/1681696639 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8d4005200 0x7fd8d400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:16.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.335+0000 7fd8e77fe700 1 -- 172.21.15.6:0/1681696639 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8d4004850 msgr2=0x7fd8d4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:16.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.335+0000 7fd8e77fe700 1 --2- 172.21.15.6:0/1681696639 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8d4004850 0x7fd8d4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:16.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.335+0000 7fd8e77fe700 1 -- 172.21.15.6:0/1681696639 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8d4005200 msgr2=0x7fd8d400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:16.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.335+0000 7fd8e77fe700 1 --2- 172.21.15.6:0/1681696639 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8d4005200 0x7fd8d400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:16.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.335+0000 7fd8e77fe700 1 -- 172.21.15.6:0/1681696639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d40035b0 con 0x7fd8d4003a00 2023-07-06T19:59:16.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.335+0000 7fd8e7fff700 1 -- 172.21.15.6:0/1681696639 reap_dead start 2023-07-06T19:59:16.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.335+0000 7fd8e77fe700 1 --2- 172.21.15.6:0/1681696639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8d4003a00 0x7fd8d4003e10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd8e000c210 tx=0x7fd8d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0280c6769ef4e4d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:16.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.335+0000 7fd8e67fc700 1 -- 172.21.15.6:0/1681696639 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0007c10 con 0x7fd8d4003a00 2023-07-06T19:59:16.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.335+0000 7fd8e67fc700 1 -- 172.21.15.6:0/1681696639 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e000cd90 con 0x7fd8d4003a00 2023-07-06T19:59:16.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.335+0000 7fd8e67fc700 1 -- 172.21.15.6:0/1681696639 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0005ba0 con 0x7fd8d4003a00 2023-07-06T19:59:16.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.336+0000 7fd8ee032700 1 -- 172.21.15.6:0/1681696639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8d4003a00 msgr2=0x7fd8d4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:16.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.336+0000 7fd8ee032700 1 --2- 172.21.15.6:0/1681696639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8d4003a00 0x7fd8d4003e10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd8e000c210 tx=0x7fd8d4005880 comp rx=0 tx=0).stop 2023-07-06T19:59:16.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.336+0000 7fd8ee032700 1 -- 172.21.15.6:0/1681696639 shutdown_connections 2023-07-06T19:59:16.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.336+0000 7fd8ee032700 1 --2- 172.21.15.6:0/1681696639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8d4003a00 0x7fd8d4003e10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:16.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.336+0000 7fd8ee032700 1 -- 172.21.15.6:0/1681696639 >> 172.21.15.6:0/1681696639 conn(0x7fd8e80b0b60 msgr2=0x7fd8e80b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:16.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.336+0000 7fd8ee032700 1 -- 172.21.15.6:0/1681696639 shutdown_connections 2023-07-06T19:59:16.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.336+0000 7fd8ee032700 1 -- 172.21.15.6:0/1681696639 wait complete. 2023-07-06T19:59:16.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.337+0000 7fd8ee032700 1 Processor -- start 2023-07-06T19:59:16.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.337+0000 7fd8ee032700 1 -- start start 2023-07-06T19:59:16.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.338+0000 7fd8ee032700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8d4003a00 0x7fd8e8151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:16.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.338+0000 7fd8ee032700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8e80ccc20 0x7fd8e80ad410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:16.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.338+0000 7fd8ee032700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e80ad950 0x7fd8e8156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:16.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.338+0000 7fd8ee032700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e80b1e80 con 0x7fd8e80ad950 2023-07-06T19:59:16.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.338+0000 7fd8ee032700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e80cd090 con 0x7fd8d4003a00 2023-07-06T19:59:16.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.338+0000 7fd8ee032700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e81f1e40 con 0x7fd8e80ccc20 2023-07-06T19:59:16.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.338+0000 7fd8e7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e80ad950 0x7fd8e8156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:16.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.338+0000 7fd8e7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e80ad950 0x7fd8e8156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58794/0 (socket says 172.21.15.6:58794) 2023-07-06T19:59:16.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.338+0000 7fd8e7fff700 1 -- 172.21.15.6:0/1028824015 learned_addr learned my addr 172.21.15.6:0/1028824015 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:16.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.338+0000 7fd8e77fe700 1 --2- 172.21.15.6:0/1028824015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8d4003a00 0x7fd8e8151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:16.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.338+0000 7fd8e6ffd700 1 --2- 172.21.15.6:0/1028824015 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8e80ccc20 0x7fd8e80ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:16.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.338+0000 7fd8e7fff700 1 -- 172.21.15.6:0/1028824015 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8e80ccc20 msgr2=0x7fd8e80ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:16.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.338+0000 7fd8e7fff700 1 --2- 172.21.15.6:0/1028824015 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8e80ccc20 0x7fd8e80ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:16.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.338+0000 7fd8e7fff700 1 -- 172.21.15.6:0/1028824015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8d4003a00 msgr2=0x7fd8e8151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:16.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.338+0000 7fd8e7fff700 1 --2- 172.21.15.6:0/1028824015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8d4003a00 0x7fd8e8151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:16.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.338+0000 7fd8e7fff700 1 -- 172.21.15.6:0/1028824015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e80b20d0 con 0x7fd8e80ad950 2023-07-06T19:59:16.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.338+0000 7fd8e77fe700 1 --2- 172.21.15.6:0/1028824015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8d4003a00 0x7fd8e8151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:16.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.339+0000 7fd8e7fff700 1 --2- 172.21.15.6:0/1028824015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e80ad950 0x7fd8e8156960 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd8e80d0150 tx=0x7fd8d8004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:16.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.339+0000 7fd8dffff700 1 -- 172.21.15.6:0/1028824015 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8007a20 con 0x7fd8e80ad950 2023-07-06T19:59:16.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.339+0000 7fd8dffff700 1 -- 172.21.15.6:0/1028824015 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d8007ba0 con 0x7fd8e80ad950 2023-07-06T19:59:16.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.339+0000 7fd8ee032700 1 -- 172.21.15.6:0/1028824015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e80b23b0 con 0x7fd8e80ad950 2023-07-06T19:59:16.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.339+0000 7fd8dffff700 1 -- 172.21.15.6:0/1028824015 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8015420 con 0x7fd8e80ad950 2023-07-06T19:59:16.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.339+0000 7fd8ee032700 1 -- 172.21.15.6:0/1028824015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e80b2970 con 0x7fd8e80ad950 2023-07-06T19:59:16.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.340+0000 7fd8ee032700 1 -- 172.21.15.6:0/1028824015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e804eb90 con 0x7fd8e80ad950 2023-07-06T19:59:16.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.340+0000 7fd8dffff700 1 -- 172.21.15.6:0/1028824015 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd8d8015580 con 0x7fd8e80ad950 2023-07-06T19:59:16.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.341+0000 7fd8dffff700 1 --2- 172.21.15.6:0/1028824015 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd8c806ace0 0x7fd8c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:16.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.341+0000 7fd8e77fe700 1 --2- 172.21.15.6:0/1028824015 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd8c806ace0 0x7fd8c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:16.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.341+0000 7fd8dffff700 1 -- 172.21.15.6:0/1028824015 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd8d8089b90 con 0x7fd8e80ad950 2023-07-06T19:59:16.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.341+0000 7fd8e77fe700 1 --2- 172.21.15.6:0/1028824015 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd8c806ace0 0x7fd8c806d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0000c00 tx=0x7fd8e0007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:16.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.345+0000 7fd8dffff700 1 -- 172.21.15.6:0/1028824015 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd8d80549e0 con 0x7fd8e80ad950 2023-07-06T19:59:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.592+0000 7fd8ee032700 1 -- 172.21.15.6:0/1028824015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd8e80b0000 con 0x7fd8e80ad950 2023-07-06T19:59:16.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.828+0000 7fd8dffff700 1 -- 172.21.15.6:0/1028824015 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd8d8058000 con 0x7fd8e80ad950 2023-07-06T19:59:16.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.831+0000 7fd8ee032700 1 -- 172.21.15.6:0/1028824015 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd8c806ace0 msgr2=0x7fd8c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:16.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.831+0000 7fd8ee032700 1 --2- 172.21.15.6:0/1028824015 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd8c806ace0 0x7fd8c806d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0000c00 tx=0x7fd8e0007000 comp rx=0 tx=0).stop 2023-07-06T19:59:16.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.831+0000 7fd8ee032700 1 -- 172.21.15.6:0/1028824015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e80ad950 msgr2=0x7fd8e8156960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:16.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.831+0000 7fd8ee032700 1 --2- 172.21.15.6:0/1028824015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e80ad950 0x7fd8e8156960 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd8e80d0150 tx=0x7fd8d8004970 comp rx=0 tx=0).stop 2023-07-06T19:59:16.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.831+0000 7fd8ee032700 1 -- 172.21.15.6:0/1028824015 shutdown_connections 2023-07-06T19:59:16.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.831+0000 7fd8ee032700 1 --2- 172.21.15.6:0/1028824015 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd8c806ace0 0x7fd8c806d190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:16.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.831+0000 7fd8ee032700 1 --2- 172.21.15.6:0/1028824015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8e80ad950 0x7fd8e8156960 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:16.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.831+0000 7fd8ee032700 1 --2- 172.21.15.6:0/1028824015 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd8d4003a00 0x7fd8e8151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:16.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.831+0000 7fd8ee032700 1 --2- 172.21.15.6:0/1028824015 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8e80ccc20 0x7fd8e80ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:16.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.831+0000 7fd8ee032700 1 -- 172.21.15.6:0/1028824015 >> 172.21.15.6:0/1028824015 conn(0x7fd8e80b0b60 msgr2=0x7fd8e81599c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:16.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.831+0000 7fd8ee032700 1 -- 172.21.15.6:0/1028824015 shutdown_connections 2023-07-06T19:59:16.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.831+0000 7fd8ee032700 1 -- 172.21.15.6:0/1028824015 wait complete. 2023-07-06T19:59:16.845 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-07-06T19:59:16.846 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-06T19:59:16.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.975+0000 7fa6e7817700 1 Processor -- start 2023-07-06T19:59:16.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.975+0000 7fa6e7817700 1 -- start start 2023-07-06T19:59:16.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.976+0000 7fa6e7817700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6e00cddc0 0x7fa6e00715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.976+0000 7fa6e7817700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa6e006c440 0x7fa6e0071b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.976+0000 7fa6e7817700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6e01599d0 con 0x7fa6e00ce3f0 2023-07-06T19:59:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.976+0000 7fa6e7817700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6e015a610 con 0x7fa6e006c440 2023-07-06T19:59:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.976+0000 7fa6e7817700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e0159720 con 0x7fa6e00cddc0 2023-07-06T19:59:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.976+0000 7fa6e5db4700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa6e00ce3f0 0x7fa6e00ce850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60010/0 (socket says 172.21.15.6:60010) 2023-07-06T19:59:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.976+0000 7fa6e5db4700 1 -- 172.21.15.6:0/1218504769 learned_addr learned my addr 172.21.15.6:0/1218504769 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:16.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.976+0000 7fa6e55b3700 1 --2- 172.21.15.6:0/1218504769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6e00cddc0 0x7fa6e00715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:16.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.976+0000 7fa6e4db2700 1 --2- 172.21.15.6:0/1218504769 >> v2:172.21.15.40:3300/0 conn(0x7fa6e006c440 0x7fa6e0071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:16.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.976+0000 7fa6d7fff700 1 -- 172.21.15.6:0/1218504769 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3864965804 0 0) 0x7fa6e01599d0 con 0x7fa6e00ce3f0 2023-07-06T19:59:16.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.976+0000 7fa6d7fff700 1 -- 172.21.15.6:0/1218504769 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6cc0035b0 con 0x7fa6e00ce3f0 2023-07-06T19:59:16.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.976+0000 7fa6d7fff700 1 -- 172.21.15.6:0/1218504769 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 672735635 0 0) 0x7fa6cc0035b0 con 0x7fa6e00ce3f0 2023-07-06T19:59:16.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.976+0000 7fa6d7fff700 1 -- 172.21.15.6:0/1218504769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6e00cddc0 msgr2=0x7fa6e00715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:16.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.976+0000 7fa6d7fff700 1 --2- 172.21.15.6:0/1218504769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6e00cddc0 0x7fa6e00715e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.976+0000 7fa6d7fff700 1 -- 172.21.15.6:0/1218504769 >> v2:172.21.15.40:3300/0 conn(0x7fa6e006c440 msgr2=0x7fa6e0071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.976+0000 7fa6d7fff700 1 --2- 172.21.15.6:0/1218504769 >> v2:172.21.15.40:3300/0 conn(0x7fa6e006c440 0x7fa6e0071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.976+0000 7fa6d7fff700 1 -- 172.21.15.6:0/1218504769 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e0159c70 con 0x7fa6e00ce3f0 2023-07-06T19:59:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.976+0000 7fa6d7fff700 1 -- 172.21.15.6:0/1218504769 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7fa6d80019f0 con 0x7fa6e00ce3f0 2023-07-06T19:59:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.976+0000 7fa6e4db2700 1 --2- 172.21.15.6:0/1218504769 >> v2:172.21.15.40:3300/0 conn(0x7fa6e006c440 0x7fa6e0071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:59:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.976+0000 7fa6d7fff700 1 -- 172.21.15.6:0/1218504769 >> v1:172.21.15.6:6789/0 conn(0x7fa6e00ce3f0 legacy=0x7fa6e00ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.977+0000 7fa6d7fff700 1 --2- 172.21.15.6:0/1218504769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6cc003a00 0x7fa6cc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.977+0000 7fa6d7fff700 1 --2- 172.21.15.6:0/1218504769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6e00cddc0 0x7fa6cc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:16.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.977+0000 7fa6d7fff700 1 --2- 172.21.15.6:0/1218504769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6cc004d90 0x7fa6cc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:16.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.977+0000 7fa6d7fff700 1 -- 172.21.15.6:0/1218504769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e015a610 con 0x7fa6cc004d90 2023-07-06T19:59:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.977+0000 7fa6d7fff700 1 -- 172.21.15.6:0/1218504769 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e0159720 con 0x7fa6cc003a00 2023-07-06T19:59:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.977+0000 7fa6d7fff700 1 -- 172.21.15.6:0/1218504769 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6cc00ba90 con 0x7fa6e00cddc0 2023-07-06T19:59:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.977+0000 7fa6e5db4700 1 --2- 172.21.15.6:0/1218504769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6cc004d90 0x7fa6cc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:16.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.977+0000 7fa6e4db2700 1 --2- 172.21.15.6:0/1218504769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6e00cddc0 0x7fa6cc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.977+0000 7fa6e55b3700 1 --2- 172.21.15.6:0/1218504769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6cc003a00 0x7fa6cc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.977+0000 7fa6e5db4700 1 -- 172.21.15.6:0/1218504769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6e00cddc0 msgr2=0x7fa6cc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.977+0000 7fa6e5db4700 1 --2- 172.21.15.6:0/1218504769 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6e00cddc0 0x7fa6cc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.977+0000 7fa6e5db4700 1 -- 172.21.15.6:0/1218504769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6cc003a00 msgr2=0x7fa6cc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.977+0000 7fa6e5db4700 1 --2- 172.21.15.6:0/1218504769 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6cc003a00 0x7fa6cc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:16.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.977+0000 7fa6e5db4700 1 -- 172.21.15.6:0/1218504769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc0035b0 con 0x7fa6cc004d90 2023-07-06T19:59:16.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.977+0000 7fa6e5db4700 1 --2- 172.21.15.6:0/1218504769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6cc004d90 0x7fa6cc005200 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa6d800a860 tx=0x7fa6cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c764c50fb3fb41ff server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:16.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.977+0000 7fa6d7fff700 1 -- 172.21.15.6:0/1218504769 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d8012600 con 0x7fa6cc004d90 2023-07-06T19:59:16.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.977+0000 7fa6d7fff700 1 -- 172.21.15.6:0/1218504769 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d8012760 con 0x7fa6cc004d90 2023-07-06T19:59:16.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.977+0000 7fa6d7fff700 1 -- 172.21.15.6:0/1218504769 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d8012b10 con 0x7fa6cc004d90 2023-07-06T19:59:16.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.978+0000 7fa6e7817700 1 -- 172.21.15.6:0/1218504769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6cc004d90 msgr2=0x7fa6cc005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:16.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.978+0000 7fa6e7817700 1 --2- 172.21.15.6:0/1218504769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6cc004d90 0x7fa6cc005200 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa6d800a860 tx=0x7fa6cc005880 comp rx=0 tx=0).stop 2023-07-06T19:59:16.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.978+0000 7fa6e5db4700 1 -- 172.21.15.6:0/1218504769 reap_dead start 2023-07-06T19:59:16.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.978+0000 7fa6e7817700 1 -- 172.21.15.6:0/1218504769 shutdown_connections 2023-07-06T19:59:16.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.978+0000 7fa6e7817700 1 -- 172.21.15.6:0/1218504769 >> 172.21.15.6:0/1218504769 conn(0x7fa6e00cc3a0 msgr2=0x7fa6e00cc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:16.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.978+0000 7fa6e7817700 1 -- 172.21.15.6:0/1218504769 shutdown_connections 2023-07-06T19:59:16.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.978+0000 7fa6e7817700 1 -- 172.21.15.6:0/1218504769 wait complete. 2023-07-06T19:59:16.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.979+0000 7fa6e7817700 1 Processor -- start 2023-07-06T19:59:16.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.979+0000 7fa6e7817700 1 -- start start 2023-07-06T19:59:16.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.980+0000 7fa6e7817700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6cc004d90 0x7fa6e00b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:16.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.980+0000 7fa6e7817700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6e00b5490 0x7fa6e01f17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:16.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.980+0000 7fa6e7817700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6e01f1d30 0x7fa6e00b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:16.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.980+0000 7fa6e7817700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e015b040 con 0x7fa6e00b5490 2023-07-06T19:59:16.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.980+0000 7fa6e7817700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e014d900 con 0x7fa6cc004d90 2023-07-06T19:59:16.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.980+0000 7fa6e7817700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e00c4910 con 0x7fa6e01f1d30 2023-07-06T19:59:16.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.980+0000 7fa6e4db2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6e00b5490 0x7fa6e01f17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:16.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.980+0000 7fa6e4db2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6e00b5490 0x7fa6e01f17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58810/0 (socket says 172.21.15.6:58810) 2023-07-06T19:59:16.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.980+0000 7fa6e4db2700 1 -- 172.21.15.6:0/91907157 learned_addr learned my addr 172.21.15.6:0/91907157 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:16.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.980+0000 7fa6e55b3700 1 --2- 172.21.15.6:0/91907157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6cc004d90 0x7fa6e00b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:16.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.980+0000 7fa6e5db4700 1 --2- 172.21.15.6:0/91907157 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6e01f1d30 0x7fa6e00b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:16.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.980+0000 7fa6e4db2700 1 -- 172.21.15.6:0/91907157 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6e01f1d30 msgr2=0x7fa6e00b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.980+0000 7fa6e4db2700 1 --2- 172.21.15.6:0/91907157 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6e01f1d30 0x7fa6e00b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.980+0000 7fa6e4db2700 1 -- 172.21.15.6:0/91907157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6cc004d90 msgr2=0x7fa6e00b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.980+0000 7fa6e4db2700 1 --2- 172.21.15.6:0/91907157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6cc004d90 0x7fa6e00b4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.980+0000 7fa6e4db2700 1 -- 172.21.15.6:0/91907157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e00c4bf0 con 0x7fa6e00b5490 2023-07-06T19:59:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.980+0000 7fa6e5db4700 1 --2- 172.21.15.6:0/91907157 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6e01f1d30 0x7fa6e00b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.980+0000 7fa6e4db2700 1 --2- 172.21.15.6:0/91907157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6e00b5490 0x7fa6e01f17f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc011c20 tx=0x7fa6dc00f240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:16.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.981+0000 7fa6d5ffb700 1 -- 172.21.15.6:0/91907157 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc00fa60 con 0x7fa6e00b5490 2023-07-06T19:59:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.981+0000 7fa6d5ffb700 1 -- 172.21.15.6:0/91907157 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6dc00fbc0 con 0x7fa6e00b5490 2023-07-06T19:59:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.981+0000 7fa6e7817700 1 -- 172.21.15.6:0/91907157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e015a980 con 0x7fa6e00b5490 2023-07-06T19:59:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.981+0000 7fa6d5ffb700 1 -- 172.21.15.6:0/91907157 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc004020 con 0x7fa6e00b5490 2023-07-06T19:59:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.981+0000 7fa6e7817700 1 -- 172.21.15.6:0/91907157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e00b47f0 con 0x7fa6e00b5490 2023-07-06T19:59:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.982+0000 7fa6e7817700 1 -- 172.21.15.6:0/91907157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e004eb90 con 0x7fa6e00b5490 2023-07-06T19:59:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.982+0000 7fa6d5ffb700 1 -- 172.21.15.6:0/91907157 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa6dc004180 con 0x7fa6e00b5490 2023-07-06T19:59:16.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.983+0000 7fa6d5ffb700 1 --2- 172.21.15.6:0/91907157 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa6c406ace0 0x7fa6c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.983+0000 7fa6d5ffb700 1 -- 172.21.15.6:0/91907157 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa6dc089cf0 con 0x7fa6e00b5490 2023-07-06T19:59:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.983+0000 7fa6e55b3700 1 --2- 172.21.15.6:0/91907157 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa6c406ace0 0x7fa6c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.983+0000 7fa6e55b3700 1 --2- 172.21.15.6:0/91907157 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa6c406ace0 0x7fa6c406d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0009be0 tx=0x7fa6d0009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:16.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:16.987+0000 7fa6d5ffb700 1 -- 172.21.15.6:0/91907157 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa6dc08e070 con 0x7fa6e00b5490 2023-07-06T19:59:17.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.234+0000 7fa6e7817700 1 -- 172.21.15.6:0/91907157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa6e00cbe30 con 0x7fa6e00b5490 2023-07-06T19:59:17.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.831+0000 7fa6d5ffb700 1 -- 172.21.15.6:0/91907157 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa6dc022020 con 0x7fa6e00b5490 2023-07-06T19:59:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.834+0000 7fa6e7817700 1 -- 172.21.15.6:0/91907157 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa6c406ace0 msgr2=0x7fa6c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.834+0000 7fa6e7817700 1 --2- 172.21.15.6:0/91907157 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa6c406ace0 0x7fa6c406d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0009be0 tx=0x7fa6d0009210 comp rx=0 tx=0).stop 2023-07-06T19:59:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.834+0000 7fa6e7817700 1 -- 172.21.15.6:0/91907157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6e00b5490 msgr2=0x7fa6e01f17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.834+0000 7fa6e7817700 1 --2- 172.21.15.6:0/91907157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6e00b5490 0x7fa6e01f17f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc011c20 tx=0x7fa6dc00f240 comp rx=0 tx=0).stop 2023-07-06T19:59:17.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.834+0000 7fa6e7817700 1 -- 172.21.15.6:0/91907157 shutdown_connections 2023-07-06T19:59:17.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.834+0000 7fa6e7817700 1 --2- 172.21.15.6:0/91907157 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa6c406ace0 0x7fa6c406d190 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:17.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.834+0000 7fa6e7817700 1 --2- 172.21.15.6:0/91907157 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa6e01f1d30 0x7fa6e00b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:17.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.834+0000 7fa6e7817700 1 --2- 172.21.15.6:0/91907157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa6cc004d90 0x7fa6e00b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:17.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.834+0000 7fa6e7817700 1 --2- 172.21.15.6:0/91907157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6e00b5490 0x7fa6e01f17f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:17.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.834+0000 7fa6e7817700 1 -- 172.21.15.6:0/91907157 >> 172.21.15.6:0/91907157 conn(0x7fa6e00cc3a0 msgr2=0x7fa6e0071970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:17.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.834+0000 7fa6e7817700 1 -- 172.21.15.6:0/91907157 shutdown_connections 2023-07-06T19:59:17.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.834+0000 7fa6e7817700 1 -- 172.21.15.6:0/91907157 wait complete. 2023-07-06T19:59:17.853 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-06T19:59:17.853 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T19:59:17.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.985+0000 7f59f1a6a700 1 Processor -- start 2023-07-06T19:59:17.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.985+0000 7f59f1a6a700 1 -- start start 2023-07-06T19:59:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.986+0000 7f59f1a6a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f59ec071550 0x7f59ec15cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.986+0000 7f59f1a6a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59ec06ef30 0x7f59ec15cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.986+0000 7f59f1a6a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59ec15c800 con 0x7f59ec15c430 2023-07-06T19:59:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.986+0000 7f59f1a6a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59ec15d820 con 0x7f59ec071550 2023-07-06T19:59:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.986+0000 7f59f1a6a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec06e170 con 0x7f59ec06ef30 2023-07-06T19:59:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.986+0000 7f59eaffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f59ec071550 0x7f59ec15cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.986+0000 7f59eb7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f59ec15c430 0x7f59ec070e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60026/0 (socket says 172.21.15.6:60026) 2023-07-06T19:59:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.986+0000 7f59eb7fe700 1 -- 172.21.15.6:0/3263425225 learned_addr learned my addr 172.21.15.6:0/3263425225 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.987+0000 7f59eaffd700 1 -- 172.21.15.6:0/3263425225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59ec06ef30 msgr2=0x7f59ec15cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.987+0000 7f59eaffd700 1 --2- 172.21.15.6:0/3263425225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59ec06ef30 0x7f59ec15cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.987+0000 7f59eaffd700 1 -- 172.21.15.6:0/3263425225 >> v1:172.21.15.6:6789/0 conn(0x7f59ec15c430 legacy=0x7f59ec070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.987+0000 7f59eaffd700 1 -- 172.21.15.6:0/3263425225 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ec06e450 con 0x7f59ec071550 2023-07-06T19:59:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.987+0000 7f59ea7fc700 1 -- 172.21.15.6:0/3263425225 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351471224 0 0) 0x7f59ec15c800 con 0x7f59ec15c430 2023-07-06T19:59:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.987+0000 7f59eaffd700 1 --2- 172.21.15.6:0/3263425225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59ec071550 0x7f59ec15cab0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009840 tx=0x7f59d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794f61eb300f9541 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.987+0000 7f59ea7fc700 1 -- 172.21.15.6:0/3263425225 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4011830 con 0x7f59ec071550 2023-07-06T19:59:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.987+0000 7f59ea7fc700 1 -- 172.21.15.6:0/3263425225 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d4011990 con 0x7f59ec071550 2023-07-06T19:59:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.987+0000 7f59ea7fc700 1 -- 172.21.15.6:0/3263425225 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4011d20 con 0x7f59ec071550 2023-07-06T19:59:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.987+0000 7f59f1a6a700 1 -- 172.21.15.6:0/3263425225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59ec071550 msgr2=0x7f59ec15cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:18.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.987+0000 7f59f1a6a700 1 --2- 172.21.15.6:0/3263425225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59ec071550 0x7f59ec15cab0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009840 tx=0x7f59d4009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.988+0000 7f59f1a6a700 1 -- 172.21.15.6:0/3263425225 shutdown_connections 2023-07-06T19:59:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.988+0000 7f59f1a6a700 1 --2- 172.21.15.6:0/3263425225 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59ec06ef30 0x7f59ec15cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.988+0000 7f59f1a6a700 1 --2- 172.21.15.6:0/3263425225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59ec071550 0x7f59ec15cab0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.988+0000 7f59f1a6a700 1 -- 172.21.15.6:0/3263425225 >> 172.21.15.6:0/3263425225 conn(0x7f59ec0cf0f0 msgr2=0x7f59ec0cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.988+0000 7f59f1a6a700 1 -- 172.21.15.6:0/3263425225 shutdown_connections 2023-07-06T19:59:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.988+0000 7f59f1a6a700 1 -- 172.21.15.6:0/3263425225 wait complete. 2023-07-06T19:59:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.989+0000 7f59f1a6a700 1 Processor -- start 2023-07-06T19:59:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.989+0000 7f59f1a6a700 1 -- start start 2023-07-06T19:59:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.990+0000 7f59f1a6a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59ec06ef30 0x7f59ec1587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.990+0000 7f59f1a6a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59ec071550 0x7f59ec1f2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.990+0000 7f59f1a6a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59ec15c430 0x7f59ec0c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.990+0000 7f59f1a6a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec0c6260 con 0x7f59ec071550 2023-07-06T19:59:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.990+0000 7f59f1a6a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec0c64d0 con 0x7f59ec15c430 2023-07-06T19:59:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.990+0000 7f59f1a6a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec0c67b0 con 0x7f59ec06ef30 2023-07-06T19:59:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.990+0000 7f59eaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59ec071550 0x7f59ec1f2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:18.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.990+0000 7f59eaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59ec071550 0x7f59ec1f2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58826/0 (socket says 172.21.15.6:58826) 2023-07-06T19:59:18.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.990+0000 7f59eaffd700 1 -- 172.21.15.6:0/561446657 learned_addr learned my addr 172.21.15.6:0/561446657 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:18.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.991+0000 7f59eb7fe700 1 --2- 172.21.15.6:0/561446657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59ec06ef30 0x7f59ec1587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:18.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.991+0000 7f59ebfff700 1 --2- 172.21.15.6:0/561446657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59ec15c430 0x7f59ec0c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:18.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.991+0000 7f59eaffd700 1 -- 172.21.15.6:0/561446657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59ec06ef30 msgr2=0x7f59ec1587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:18.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.991+0000 7f59eaffd700 1 --2- 172.21.15.6:0/561446657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59ec06ef30 0x7f59ec1587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.991+0000 7f59eaffd700 1 -- 172.21.15.6:0/561446657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59ec15c430 msgr2=0x7f59ec0c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:18.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.991+0000 7f59eaffd700 1 --2- 172.21.15.6:0/561446657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59ec15c430 0x7f59ec0c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.991+0000 7f59eaffd700 1 -- 172.21.15.6:0/561446657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d40094a0 con 0x7f59ec071550 2023-07-06T19:59:18.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.991+0000 7f59eb7fe700 1 --2- 172.21.15.6:0/561446657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59ec06ef30 0x7f59ec1587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:18.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.991+0000 7f59ebfff700 1 --2- 172.21.15.6:0/561446657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59ec15c430 0x7f59ec0c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:18.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.991+0000 7f59eaffd700 1 --2- 172.21.15.6:0/561446657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59ec071550 0x7f59ec1f2de0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f59d40090b0 tx=0x7f59d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:18.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.991+0000 7f59e3fff700 1 -- 172.21.15.6:0/561446657 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d40038a0 con 0x7f59ec071550 2023-07-06T19:59:18.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.991+0000 7f59e3fff700 1 -- 172.21.15.6:0/561446657 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d401f070 con 0x7f59ec071550 2023-07-06T19:59:18.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.991+0000 7f59f1a6a700 1 -- 172.21.15.6:0/561446657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59ec0c6a90 con 0x7f59ec071550 2023-07-06T19:59:18.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.991+0000 7f59e3fff700 1 -- 172.21.15.6:0/561446657 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4003c00 con 0x7f59ec071550 2023-07-06T19:59:18.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.991+0000 7f59f1a6a700 1 -- 172.21.15.6:0/561446657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59ec0c8a80 con 0x7f59ec071550 2023-07-06T19:59:18.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.992+0000 7f59f1a6a700 1 -- 172.21.15.6:0/561446657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59ec071cf0 con 0x7f59ec071550 2023-07-06T19:59:18.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.992+0000 7f59e3fff700 1 -- 172.21.15.6:0/561446657 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f59d401a430 con 0x7f59ec071550 2023-07-06T19:59:18.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.993+0000 7f59e3fff700 1 --2- 172.21.15.6:0/561446657 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f59cc06ace0 0x7f59cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:18.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.993+0000 7f59e3fff700 1 -- 172.21.15.6:0/561446657 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f59d4021070 con 0x7f59ec071550 2023-07-06T19:59:18.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.993+0000 7f59eb7fe700 1 --2- 172.21.15.6:0/561446657 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f59cc06ace0 0x7f59cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:18.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.993+0000 7f59eb7fe700 1 --2- 172.21.15.6:0/561446657 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f59cc06ace0 0x7f59cc06d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f59dc000f60 tx=0x7f59dc007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:18.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:17.997+0000 7f59e3fff700 1 -- 172.21.15.6:0/561446657 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f59d40560f0 con 0x7f59ec071550 2023-07-06T19:59:18.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.240+0000 7f59f1a6a700 1 -- 172.21.15.6:0/561446657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59ec0cf710 con 0x7f59ec071550 2023-07-06T19:59:18.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.241+0000 7f59e3fff700 1 -- 172.21.15.6:0/561446657 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4652 (secure 0 0 0) 0x7f59d4059710 con 0x7f59ec071550 2023-07-06T19:59:18.245 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:18.246 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3695014381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3695014381},{"type":"v1","addr":"172.21.15.6:6835","nonce":3695014381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/849399781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":849399781},{"type":"v1","addr":"172.21.15.40:6833","nonce":849399781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/512806705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":512806705},{"type":"v1","addr":"172.21.15.40:6835","nonce":512806705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T19:58:53.158966+0000","modified":"2023-07-06T19:59:17.827616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/368324315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":368324315},{"type":"v1","addr":"172.21.15.6:6837","nonce":368324315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-06T19:59:18.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.243+0000 7f59f1a6a700 1 -- 172.21.15.6:0/561446657 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f59cc06ace0 msgr2=0x7f59cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:18.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.243+0000 7f59f1a6a700 1 --2- 172.21.15.6:0/561446657 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f59cc06ace0 0x7f59cc06d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f59dc000f60 tx=0x7f59dc007d30 comp rx=0 tx=0).stop 2023-07-06T19:59:18.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.243+0000 7f59f1a6a700 1 -- 172.21.15.6:0/561446657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59ec071550 msgr2=0x7f59ec1f2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:18.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.243+0000 7f59f1a6a700 1 --2- 172.21.15.6:0/561446657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59ec071550 0x7f59ec1f2de0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f59d40090b0 tx=0x7f59d4004750 comp rx=0 tx=0).stop 2023-07-06T19:59:18.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.243+0000 7f59f1a6a700 1 -- 172.21.15.6:0/561446657 shutdown_connections 2023-07-06T19:59:18.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.243+0000 7f59f1a6a700 1 --2- 172.21.15.6:0/561446657 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f59cc06ace0 0x7f59cc06d190 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.243+0000 7f59f1a6a700 1 --2- 172.21.15.6:0/561446657 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59ec15c430 0x7f59ec0c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.243+0000 7f59f1a6a700 1 --2- 172.21.15.6:0/561446657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59ec06ef30 0x7f59ec1587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.243+0000 7f59f1a6a700 1 --2- 172.21.15.6:0/561446657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59ec071550 0x7f59ec1f2de0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.243+0000 7f59f1a6a700 1 -- 172.21.15.6:0/561446657 >> 172.21.15.6:0/561446657 conn(0x7f59ec0cf0f0 msgr2=0x7f59ec06a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:18.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.243+0000 7f59f1a6a700 1 -- 172.21.15.6:0/561446657 shutdown_connections 2023-07-06T19:59:18.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.243+0000 7f59f1a6a700 1 -- 172.21.15.6:0/561446657 wait complete. 2023-07-06T19:59:18.248 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 9 2023-07-06T19:59:18.260 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T19:59:18.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.387+0000 7f06d23df700 1 Processor -- start 2023-07-06T19:59:18.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.387+0000 7f06d23df700 1 -- start start 2023-07-06T19:59:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.388+0000 7f06d23df700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f06cc0b47e0 0x7f06cc06e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.388+0000 7f06d23df700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f06cc0cb5c0 0x7f06cc15aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:18.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.388+0000 7f06d23df700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06cc15ebd0 con 0x7f06cc06a060 2023-07-06T19:59:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.388+0000 7f06d23df700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06cc15dfc0 con 0x7f06cc0b47e0 2023-07-06T19:59:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.388+0000 7f06d23df700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06cc15e2a0 con 0x7f06cc0cb5c0 2023-07-06T19:59:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.388+0000 7f06cbfff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f06cc0b47e0 0x7f06cc06e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.388+0000 7f06cb7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f06cc06a060 0x7f06cc0caeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60040/0 (socket says 172.21.15.6:60040) 2023-07-06T19:59:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.388+0000 7f06cb7fe700 1 -- 172.21.15.6:0/2360251718 learned_addr learned my addr 172.21.15.6:0/2360251718 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.388+0000 7f06d097c700 1 --2- 172.21.15.6:0/2360251718 >> v2:172.21.15.40:3300/0 conn(0x7f06cc0cb5c0 0x7f06cc15aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.388+0000 7f06cbfff700 1 -- 172.21.15.6:0/2360251718 >> v2:172.21.15.40:3300/0 conn(0x7f06cc0cb5c0 msgr2=0x7f06cc15aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.388+0000 7f06cbfff700 1 --2- 172.21.15.6:0/2360251718 >> v2:172.21.15.40:3300/0 conn(0x7f06cc0cb5c0 0x7f06cc15aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.388+0000 7f06cbfff700 1 -- 172.21.15.6:0/2360251718 >> v1:172.21.15.6:6789/0 conn(0x7f06cc06a060 legacy=0x7f06cc0caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.388+0000 7f06cbfff700 1 -- 172.21.15.6:0/2360251718 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc15e580 con 0x7f06cc0b47e0 2023-07-06T19:59:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.388+0000 7f06d097c700 1 --2- 172.21.15.6:0/2360251718 >> v2:172.21.15.40:3300/0 conn(0x7f06cc0cb5c0 0x7f06cc15aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.388+0000 7f06cbfff700 1 --2- 172.21.15.6:0/2360251718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06cc0b47e0 0x7f06cc06e170 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f06cc158360 tx=0x7f06bc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aea74d521901803 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.388+0000 7f06caffd700 1 -- 172.21.15.6:0/2360251718 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06bc011830 con 0x7f06cc0b47e0 2023-07-06T19:59:18.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.388+0000 7f06caffd700 1 -- 172.21.15.6:0/2360251718 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06bc011990 con 0x7f06cc0b47e0 2023-07-06T19:59:18.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.388+0000 7f06caffd700 1 -- 172.21.15.6:0/2360251718 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06bc011d20 con 0x7f06cc0b47e0 2023-07-06T19:59:18.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.389+0000 7f06d23df700 1 -- 172.21.15.6:0/2360251718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06cc0b47e0 msgr2=0x7f06cc06e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:18.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.389+0000 7f06d23df700 1 --2- 172.21.15.6:0/2360251718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06cc0b47e0 0x7f06cc06e170 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f06cc158360 tx=0x7f06bc009b20 comp rx=0 tx=0).stop 2023-07-06T19:59:18.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.389+0000 7f06d23df700 1 -- 172.21.15.6:0/2360251718 shutdown_connections 2023-07-06T19:59:18.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.389+0000 7f06d23df700 1 --2- 172.21.15.6:0/2360251718 >> v2:172.21.15.40:3300/0 conn(0x7f06cc0cb5c0 0x7f06cc15aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.389+0000 7f06d23df700 1 --2- 172.21.15.6:0/2360251718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06cc0b47e0 0x7f06cc06e170 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.389+0000 7f06d23df700 1 -- 172.21.15.6:0/2360251718 >> 172.21.15.6:0/2360251718 conn(0x7f06cc0cf0f0 msgr2=0x7f06cc0cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.389+0000 7f06d23df700 1 -- 172.21.15.6:0/2360251718 shutdown_connections 2023-07-06T19:59:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.389+0000 7f06d23df700 1 -- 172.21.15.6:0/2360251718 wait complete. 2023-07-06T19:59:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.390+0000 7f06d23df700 1 Processor -- start 2023-07-06T19:59:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.390+0000 7f06d23df700 1 -- start start 2023-07-06T19:59:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.391+0000 7f06d23df700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06cc06a060 0x7f06cc1e6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.391+0000 7f06d23df700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06cc0b47e0 0x7f06cc15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.391+0000 7f06d23df700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06cc0cb5c0 0x7f06cc14af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.391+0000 7f06d23df700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc14adf0 con 0x7f06cc0cb5c0 2023-07-06T19:59:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.391+0000 7f06d23df700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc15ab80 con 0x7f06cc0b47e0 2023-07-06T19:59:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.391+0000 7f06d23df700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc15ae60 con 0x7f06cc06a060 2023-07-06T19:59:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.391+0000 7f06d097c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06cc0cb5c0 0x7f06cc14af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.391+0000 7f06d097c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06cc0cb5c0 0x7f06cc14af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58842/0 (socket says 172.21.15.6:58842) 2023-07-06T19:59:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.391+0000 7f06d097c700 1 -- 172.21.15.6:0/1088110373 learned_addr learned my addr 172.21.15.6:0/1088110373 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.391+0000 7f06cb7fe700 1 --2- 172.21.15.6:0/1088110373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06cc0b47e0 0x7f06cc15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.391+0000 7f06cbfff700 1 --2- 172.21.15.6:0/1088110373 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06cc06a060 0x7f06cc1e6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.392+0000 7f06d097c700 1 -- 172.21.15.6:0/1088110373 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06cc06a060 msgr2=0x7f06cc1e6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.392+0000 7f06d097c700 1 --2- 172.21.15.6:0/1088110373 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06cc06a060 0x7f06cc1e6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.392+0000 7f06d097c700 1 -- 172.21.15.6:0/1088110373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06cc0b47e0 msgr2=0x7f06cc15bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.392+0000 7f06d097c700 1 --2- 172.21.15.6:0/1088110373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06cc0b47e0 0x7f06cc15bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.392+0000 7f06d097c700 1 -- 172.21.15.6:0/1088110373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06bc0094a0 con 0x7f06cc0cb5c0 2023-07-06T19:59:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.392+0000 7f06cb7fe700 1 --2- 172.21.15.6:0/1088110373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06cc0b47e0 0x7f06cc15bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.392+0000 7f06d097c700 1 --2- 172.21.15.6:0/1088110373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06cc0cb5c0 0x7f06cc14af80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f06c4007ec0 tx=0x7f06c400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.392+0000 7f06c8ff9700 1 -- 172.21.15.6:0/1088110373 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c400de30 con 0x7f06cc0cb5c0 2023-07-06T19:59:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.392+0000 7f06c8ff9700 1 -- 172.21.15.6:0/1088110373 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c400f040 con 0x7f06cc0cb5c0 2023-07-06T19:59:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.392+0000 7f06d23df700 1 -- 172.21.15.6:0/1088110373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06cc15b140 con 0x7f06cc0cb5c0 2023-07-06T19:59:18.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.392+0000 7f06c8ff9700 1 -- 172.21.15.6:0/1088110373 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c4003c60 con 0x7f06cc0cb5c0 2023-07-06T19:59:18.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.392+0000 7f06d23df700 1 -- 172.21.15.6:0/1088110373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06cc15b700 con 0x7f06cc0cb5c0 2023-07-06T19:59:18.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.393+0000 7f06d23df700 1 -- 172.21.15.6:0/1088110373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06cc15b920 con 0x7f06cc0cb5c0 2023-07-06T19:59:18.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.393+0000 7f06c8ff9700 1 -- 172.21.15.6:0/1088110373 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f06c4004030 con 0x7f06cc0cb5c0 2023-07-06T19:59:18.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.394+0000 7f06c8ff9700 1 --2- 172.21.15.6:0/1088110373 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f06b806ace0 0x7f06b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:18.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.394+0000 7f06c8ff9700 1 -- 172.21.15.6:0/1088110373 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f06c4089870 con 0x7f06cc0cb5c0 2023-07-06T19:59:18.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.394+0000 7f06cbfff700 1 --2- 172.21.15.6:0/1088110373 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f06b806ace0 0x7f06b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:18.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.394+0000 7f06cbfff700 1 --2- 172.21.15.6:0/1088110373 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f06b806ace0 0x7f06b806d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0090b0 tx=0x7f06bc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:18.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.398+0000 7f06c8ff9700 1 -- 172.21.15.6:0/1088110373 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f06c40546c0 con 0x7f06cc0cb5c0 2023-07-06T19:59:18.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.598+0000 7f06d23df700 1 -- 172.21.15.6:0/1088110373 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06cc06f280 con 0x7f06cc0cb5c0 2023-07-06T19:59:18.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.599+0000 7f06c8ff9700 1 -- 172.21.15.6:0/1088110373 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19964 (secure 0 0 0) 0x7f06c4057ce0 con 0x7f06cc0cb5c0 2023-07-06T19:59:18.601 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:18.601 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:58:58.202291+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T19:58:51.062712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T19:58:52.130350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T19:58:55.785128+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:59:18.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.601+0000 7f06d23df700 1 -- 172.21.15.6:0/1088110373 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f06b806ace0 msgr2=0x7f06b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:18.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.601+0000 7f06d23df700 1 --2- 172.21.15.6:0/1088110373 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f06b806ace0 0x7f06b806d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0090b0 tx=0x7f06bc008030 comp rx=0 tx=0).stop 2023-07-06T19:59:18.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.601+0000 7f06d23df700 1 -- 172.21.15.6:0/1088110373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06cc0cb5c0 msgr2=0x7f06cc14af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:18.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.601+0000 7f06d23df700 1 --2- 172.21.15.6:0/1088110373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06cc0cb5c0 0x7f06cc14af80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f06c4007ec0 tx=0x7f06c400d3b0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.601+0000 7f06d23df700 1 -- 172.21.15.6:0/1088110373 shutdown_connections 2023-07-06T19:59:18.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.601+0000 7f06d23df700 1 --2- 172.21.15.6:0/1088110373 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f06b806ace0 0x7f06b806d190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.601+0000 7f06d23df700 1 --2- 172.21.15.6:0/1088110373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06cc0cb5c0 0x7f06cc14af80 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.601+0000 7f06d23df700 1 --2- 172.21.15.6:0/1088110373 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06cc06a060 0x7f06cc1e6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.601+0000 7f06d23df700 1 --2- 172.21.15.6:0/1088110373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06cc0b47e0 0x7f06cc15bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.601+0000 7f06d23df700 1 -- 172.21.15.6:0/1088110373 >> 172.21.15.6:0/1088110373 conn(0x7f06cc0cf0f0 msgr2=0x7f06cc0b0220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:18.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.601+0000 7f06d23df700 1 -- 172.21.15.6:0/1088110373 shutdown_connections 2023-07-06T19:59:18.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.601+0000 7f06d23df700 1 -- 172.21.15.6:0/1088110373 wait complete. 2023-07-06T19:59:18.615 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-06T19:59:18.615 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T19:59:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.741+0000 7f8563063700 1 Processor -- start 2023-07-06T19:59:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.742+0000 7f8563063700 1 -- start start 2023-07-06T19:59:18.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.742+0000 7f8563063700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f855c15a510 0x7f855c0cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.742+0000 7f8563063700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f855c0cb620 0x7f855c0af740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.742+0000 7f8563063700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f855c0afc80 0x7f855c15e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.742+0000 7f8563063700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f855c0cba90 con 0x7f855c15a510 2023-07-06T19:59:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.742+0000 7f8563063700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f855c0cf440 con 0x7f855c0cb620 2023-07-06T19:59:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.742+0000 7f8563063700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855c0cf720 con 0x7f855c0afc80 2023-07-06T19:59:18.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.742+0000 7f8560dff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f855c15a510 0x7f855c0cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:18.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.743+0000 7f8560dff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f855c15a510 0x7f855c0cb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58846/0 (socket says 172.21.15.6:58846) 2023-07-06T19:59:18.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.743+0000 7f8560dff700 1 -- 172.21.15.6:0/1275875131 learned_addr learned my addr 172.21.15.6:0/1275875131 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:18.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.743+0000 7f855bfff700 1 --2- 172.21.15.6:0/1275875131 >> v2:172.21.15.40:3300/0 conn(0x7f855c0cb620 0x7f855c0af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:18.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.743+0000 7f8561600700 1 --2- 172.21.15.6:0/1275875131 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f855c0afc80 0x7f855c15e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.743+0000 7f8560dff700 1 -- 172.21.15.6:0/1275875131 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f855c0afc80 msgr2=0x7f855c15e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.743+0000 7f8560dff700 1 --2- 172.21.15.6:0/1275875131 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f855c0afc80 0x7f855c15e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.743+0000 7f8560dff700 1 -- 172.21.15.6:0/1275875131 >> v2:172.21.15.40:3300/0 conn(0x7f855c0cb620 msgr2=0x7f855c0af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.743+0000 7f8560dff700 1 --2- 172.21.15.6:0/1275875131 >> v2:172.21.15.40:3300/0 conn(0x7f855c0cb620 0x7f855c0af740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.743+0000 7f8560dff700 1 -- 172.21.15.6:0/1275875131 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855c0cfa00 con 0x7f855c15a510 2023-07-06T19:59:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.743+0000 7f855bfff700 1 --2- 172.21.15.6:0/1275875131 >> v2:172.21.15.40:3300/0 conn(0x7f855c0cb620 0x7f855c0af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.743+0000 7f8561600700 1 --2- 172.21.15.6:0/1275875131 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f855c0afc80 0x7f855c15e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.743+0000 7f8560dff700 1 --2- 172.21.15.6:0/1275875131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f855c15a510 0x7f855c0cb0e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f855c072660 tx=0x7f8550009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729fea63772c6915 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.743+0000 7f855b7fe700 1 -- 172.21.15.6:0/1275875131 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855000b870 con 0x7f855c15a510 2023-07-06T19:59:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.743+0000 7f855b7fe700 1 -- 172.21.15.6:0/1275875131 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855000b9d0 con 0x7f855c15a510 2023-07-06T19:59:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.743+0000 7f855b7fe700 1 -- 172.21.15.6:0/1275875131 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855000bd60 con 0x7f855c15a510 2023-07-06T19:59:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.744+0000 7f8563063700 1 -- 172.21.15.6:0/1275875131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f855c15a510 msgr2=0x7f855c0cb0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.744+0000 7f8563063700 1 --2- 172.21.15.6:0/1275875131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f855c15a510 0x7f855c0cb0e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f855c072660 tx=0x7f8550009bd0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.744+0000 7f8563063700 1 -- 172.21.15.6:0/1275875131 shutdown_connections 2023-07-06T19:59:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.744+0000 7f8563063700 1 --2- 172.21.15.6:0/1275875131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f855c15a510 0x7f855c0cb0e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.744+0000 7f8563063700 1 --2- 172.21.15.6:0/1275875131 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f855c0afc80 0x7f855c15e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.744+0000 7f8563063700 1 --2- 172.21.15.6:0/1275875131 >> v2:172.21.15.40:3300/0 conn(0x7f855c0cb620 0x7f855c0af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.744+0000 7f8563063700 1 -- 172.21.15.6:0/1275875131 >> 172.21.15.6:0/1275875131 conn(0x7f855c0ce1a0 msgr2=0x7f855c0d0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:18.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.744+0000 7f8563063700 1 -- 172.21.15.6:0/1275875131 shutdown_connections 2023-07-06T19:59:18.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.744+0000 7f8563063700 1 -- 172.21.15.6:0/1275875131 wait complete. 2023-07-06T19:59:18.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.745+0000 7f8563063700 1 Processor -- start 2023-07-06T19:59:18.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.745+0000 7f8563063700 1 -- start start 2023-07-06T19:59:18.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.746+0000 7f8563063700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f855c0afc80 0x7f855c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:18.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.746+0000 7f8563063700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f855c0cb620 0x7f855c1ef140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:18.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.746+0000 7f8563063700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f855c15a510 0x7f855c1f5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:18.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.746+0000 7f8563063700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c06d2f0 con 0x7f855c15a510 2023-07-06T19:59:18.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.746+0000 7f8563063700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c1f6110 con 0x7f855c0afc80 2023-07-06T19:59:18.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.746+0000 7f8563063700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855c06c6e0 con 0x7f855c0cb620 2023-07-06T19:59:18.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.746+0000 7f8561600700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f855c15a510 0x7f855c1f5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:18.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.746+0000 7f8561600700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f855c15a510 0x7f855c1f5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58856/0 (socket says 172.21.15.6:58856) 2023-07-06T19:59:18.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.746+0000 7f8561600700 1 -- 172.21.15.6:0/2519147067 learned_addr learned my addr 172.21.15.6:0/2519147067 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:18.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.747+0000 7f8560dff700 1 --2- 172.21.15.6:0/2519147067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f855c0afc80 0x7f855c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:18.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.747+0000 7f855bfff700 1 --2- 172.21.15.6:0/2519147067 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f855c0cb620 0x7f855c1ef140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:18.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.747+0000 7f8561600700 1 -- 172.21.15.6:0/2519147067 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f855c0cb620 msgr2=0x7f855c1ef140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:18.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.747+0000 7f8561600700 1 --2- 172.21.15.6:0/2519147067 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f855c0cb620 0x7f855c1ef140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.747+0000 7f8561600700 1 -- 172.21.15.6:0/2519147067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f855c0afc80 msgr2=0x7f855c0b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:18.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.747+0000 7f8561600700 1 --2- 172.21.15.6:0/2519147067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f855c0afc80 0x7f855c0b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.747+0000 7f8561600700 1 -- 172.21.15.6:0/2519147067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8550009550 con 0x7f855c15a510 2023-07-06T19:59:18.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.747+0000 7f8561600700 1 --2- 172.21.15.6:0/2519147067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f855c15a510 0x7f855c1f5340 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8554007db0 tx=0x7f855400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:18.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.747+0000 7f85597fa700 1 -- 172.21.15.6:0/2519147067 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855400ddd0 con 0x7f855c15a510 2023-07-06T19:59:18.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.747+0000 7f85597fa700 1 -- 172.21.15.6:0/2519147067 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855400f040 con 0x7f855c15a510 2023-07-06T19:59:18.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.747+0000 7f8563063700 1 -- 172.21.15.6:0/2519147067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855c06c9c0 con 0x7f855c15a510 2023-07-06T19:59:18.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.747+0000 7f85597fa700 1 -- 172.21.15.6:0/2519147067 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8554003c60 con 0x7f855c15a510 2023-07-06T19:59:18.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.747+0000 7f8563063700 1 -- 172.21.15.6:0/2519147067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855c06cf80 con 0x7f855c15a510 2023-07-06T19:59:18.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.748+0000 7f8563063700 1 -- 172.21.15.6:0/2519147067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855c06d4a0 con 0x7f855c15a510 2023-07-06T19:59:18.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.749+0000 7f85597fa700 1 -- 172.21.15.6:0/2519147067 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8554004030 con 0x7f855c15a510 2023-07-06T19:59:18.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.749+0000 7f85597fa700 1 --2- 172.21.15.6:0/2519147067 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f854006ace0 0x7f854006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:18.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.749+0000 7f85597fa700 1 -- 172.21.15.6:0/2519147067 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f85540898b0 con 0x7f855c15a510 2023-07-06T19:59:18.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.749+0000 7f8560dff700 1 --2- 172.21.15.6:0/2519147067 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f854006ace0 0x7f854006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:18.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.749+0000 7f8560dff700 1 --2- 172.21.15.6:0/2519147067 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f854006ace0 0x7f854006d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8550000c00 tx=0x7f8550008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:18.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.753+0000 7f85597fa700 1 -- 172.21.15.6:0/2519147067 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f855c06d4a0 con 0x7f855c15a510 2023-07-06T19:59:18.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.949+0000 7f8563063700 1 -- 172.21.15.6:0/2519147067 --> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f855c0b0100 con 0x7f854006ace0 2023-07-06T19:59:18.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.960+0000 7f85597fa700 1 -- 172.21.15.6:0/2519147067 <== mgr.4110 v2:172.21.15.6:6832/201543369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367366 (secure 0 0 0) 0x7f855000bb40 con 0x7f854006ace0 2023-07-06T19:59:18.967 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:18.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.963+0000 7f8563063700 1 -- 172.21.15.6:0/2519147067 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f854006ace0 msgr2=0x7f854006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:18.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.963+0000 7f8563063700 1 --2- 172.21.15.6:0/2519147067 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f854006ace0 0x7f854006d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8550000c00 tx=0x7f8550008030 comp rx=0 tx=0).stop 2023-07-06T19:59:18.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.963+0000 7f8563063700 1 -- 172.21.15.6:0/2519147067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f855c15a510 msgr2=0x7f855c1f5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:18.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.963+0000 7f8563063700 1 --2- 172.21.15.6:0/2519147067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f855c15a510 0x7f855c1f5340 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8554007db0 tx=0x7f855400d3b0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.963+0000 7f8563063700 1 -- 172.21.15.6:0/2519147067 shutdown_connections 2023-07-06T19:59:18.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.963+0000 7f8563063700 1 --2- 172.21.15.6:0/2519147067 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f854006ace0 0x7f854006d190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.963+0000 7f8563063700 1 --2- 172.21.15.6:0/2519147067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f855c15a510 0x7f855c1f5340 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.963+0000 7f8563063700 1 --2- 172.21.15.6:0/2519147067 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f855c0afc80 0x7f855c0b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.963+0000 7f8563063700 1 --2- 172.21.15.6:0/2519147067 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f855c0cb620 0x7f855c1ef140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:18.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.963+0000 7f8563063700 1 -- 172.21.15.6:0/2519147067 >> 172.21.15.6:0/2519147067 conn(0x7f855c0ce1a0 msgr2=0x7f855c06e760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:18.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.963+0000 7f8563063700 1 -- 172.21.15.6:0/2519147067 shutdown_connections 2023-07-06T19:59:18.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:18.963+0000 7f8563063700 1 -- 172.21.15.6:0/2519147067 wait complete. 2023-07-06T19:59:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-06T19:59:18.987 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2023-07-06T19:59:18.718385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219112,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755608,"statfs":{"total":773094113280,"available":772869742592,"internally_reserved":0,"allocated":3579904,"data_stored":2149128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003209"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376670+0000","last_change":"2023-07-06T19:58:53.761270+0000","last_active":"2023-07-06T19:58:59.376670+0000","last_peered":"2023-07-06T19:58:59.376670+0000","last_clean":"2023-07-06T19:58:59.376670+0000","last_became_active":"2023-07-06T19:58:53.760980+0000","last_became_peered":"2023-07-06T19:58:53.760980+0000","last_unstale":"2023-07-06T19:58:59.376670+0000","last_undegraded":"2023-07-06T19:58:59.376670+0000","last_fullsized":"2023-07-06T19:58:59.376670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:01:18.056559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782312+0000","last_change":"2023-07-06T19:58:53.753947+0000","last_active":"2023-07-06T19:58:58.782312+0000","last_peered":"2023-07-06T19:58:58.782312+0000","last_clean":"2023-07-06T19:58:58.782312+0000","last_became_active":"2023-07-06T19:58:53.753672+0000","last_became_peered":"2023-07-06T19:58:53.753672+0000","last_unstale":"2023-07-06T19:58:58.782312+0000","last_undegraded":"2023-07-06T19:58:58.782312+0000","last_fullsized":"2023-07-06T19:58:58.782312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:39:21.484949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378490+0000","last_change":"2023-07-06T19:58:53.757466+0000","last_active":"2023-07-06T19:58:59.378490+0000","last_peered":"2023-07-06T19:58:59.378490+0000","last_clean":"2023-07-06T19:58:59.378490+0000","last_became_active":"2023-07-06T19:58:53.757125+0000","last_became_peered":"2023-07-06T19:58:53.757125+0000","last_unstale":"2023-07-06T19:58:59.378490+0000","last_undegraded":"2023-07-06T19:58:59.378490+0000","last_fullsized":"2023-07-06T19:58:59.378490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:52:06.851223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783173+0000","last_change":"2023-07-06T19:58:53.752337+0000","last_active":"2023-07-06T19:58:58.783173+0000","last_peered":"2023-07-06T19:58:58.783173+0000","last_clean":"2023-07-06T19:58:58.783173+0000","last_became_active":"2023-07-06T19:58:53.752006+0000","last_became_peered":"2023-07-06T19:58:53.752006+0000","last_unstale":"2023-07-06T19:58:58.783173+0000","last_undegraded":"2023-07-06T19:58:58.783173+0000","last_fullsized":"2023-07-06T19:58:58.783173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:04:50.697845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378401+0000","last_change":"2023-07-06T19:58:53.761648+0000","last_active":"2023-07-06T19:58:59.378401+0000","last_peered":"2023-07-06T19:58:59.378401+0000","last_clean":"2023-07-06T19:58:59.378401+0000","last_became_active":"2023-07-06T19:58:53.760919+0000","last_became_peered":"2023-07-06T19:58:53.760919+0000","last_unstale":"2023-07-06T19:58:59.378401+0000","last_undegraded":"2023-07-06T19:58:59.378401+0000","last_fullsized":"2023-07-06T19:58:59.378401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:54:30.126613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378278+0000","last_change":"2023-07-06T19:58:53.757513+0000","last_active":"2023-07-06T19:58:59.378278+0000","last_peered":"2023-07-06T19:58:59.378278+0000","last_clean":"2023-07-06T19:58:59.378278+0000","last_became_active":"2023-07-06T19:58:53.757153+0000","last_became_peered":"2023-07-06T19:58:53.757153+0000","last_unstale":"2023-07-06T19:58:59.378278+0000","last_undegraded":"2023-07-06T19:58:59.378278+0000","last_fullsized":"2023-07-06T19:58:59.378278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:08:34.198031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378467+0000","last_change":"2023-07-06T19:58:53.754935+0000","last_active":"2023-07-06T19:58:59.378467+0000","last_peered":"2023-07-06T19:58:59.378467+0000","last_clean":"2023-07-06T19:58:59.378467+0000","last_became_active":"2023-07-06T19:58:53.754471+0000","last_became_peered":"2023-07-06T19:58:53.754471+0000","last_unstale":"2023-07-06T19:58:59.378467+0000","last_undegraded":"2023-07-06T19:58:59.378467+0000","last_fullsized":"2023-07-06T19:58:59.378467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:31:43.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.781819+0000","last_change":"2023-07-06T19:58:53.741003+0000","last_active":"2023-07-06T19:58:58.781819+0000","last_peered":"2023-07-06T19:58:58.781819+0000","last_clean":"2023-07-06T19:58:58.781819+0000","last_became_active":"2023-07-06T19:58:53.740713+0000","last_became_peered":"2023-07-06T19:58:53.740713+0000","last_unstale":"2023-07-06T19:58:58.781819+0000","last_undegraded":"2023-07-06T19:58:58.781819+0000","last_fullsized":"2023-07-06T19:58:58.781819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:39:05.600911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378417+0000","last_change":"2023-07-06T19:58:53.760616+0000","last_active":"2023-07-06T19:58:59.378417+0000","last_peered":"2023-07-06T19:58:59.378417+0000","last_clean":"2023-07-06T19:58:59.378417+0000","last_became_active":"2023-07-06T19:58:53.760325+0000","last_became_peered":"2023-07-06T19:58:53.760325+0000","last_unstale":"2023-07-06T19:58:59.378417+0000","last_undegraded":"2023-07-06T19:58:59.378417+0000","last_fullsized":"2023-07-06T19:58:59.378417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:08:51.828984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782658+0000","last_change":"2023-07-06T19:58:53.755075+0000","last_active":"2023-07-06T19:58:58.782658+0000","last_peered":"2023-07-06T19:58:58.782658+0000","last_clean":"2023-07-06T19:58:58.782658+0000","last_became_active":"2023-07-06T19:58:53.754806+0000","last_became_peered":"2023-07-06T19:58:53.754806+0000","last_unstale":"2023-07-06T19:58:58.782658+0000","last_undegraded":"2023-07-06T19:58:58.782658+0000","last_fullsized":"2023-07-06T19:58:58.782658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:36:41.784617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378084+0000","last_change":"2023-07-06T19:58:53.757287+0000","last_active":"2023-07-06T19:58:59.378084+0000","last_peered":"2023-07-06T19:58:59.378084+0000","last_clean":"2023-07-06T19:58:59.378084+0000","last_became_active":"2023-07-06T19:58:53.756825+0000","last_became_peered":"2023-07-06T19:58:53.756825+0000","last_unstale":"2023-07-06T19:58:59.378084+0000","last_undegraded":"2023-07-06T19:58:59.378084+0000","last_fullsized":"2023-07-06T19:58:59.378084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:32:20.366406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377664+0000","last_change":"2023-07-06T19:58:53.745164+0000","last_active":"2023-07-06T19:58:59.377664+0000","last_peered":"2023-07-06T19:58:59.377664+0000","last_clean":"2023-07-06T19:58:59.377664+0000","last_became_active":"2023-07-06T19:58:53.744861+0000","last_became_peered":"2023-07-06T19:58:53.744861+0000","last_unstale":"2023-07-06T19:58:59.377664+0000","last_undegraded":"2023-07-06T19:58:59.377664+0000","last_fullsized":"2023-07-06T19:58:59.377664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:06:50.770125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377329+0000","last_change":"2023-07-06T19:58:53.766071+0000","last_active":"2023-07-06T19:58:59.377329+0000","last_peered":"2023-07-06T19:58:59.377329+0000","last_clean":"2023-07-06T19:58:59.377329+0000","last_became_active":"2023-07-06T19:58:53.765744+0000","last_became_peered":"2023-07-06T19:58:53.765744+0000","last_unstale":"2023-07-06T19:58:59.377329+0000","last_undegraded":"2023-07-06T19:58:59.377329+0000","last_fullsized":"2023-07-06T19:58:59.377329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:31:39.273909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782018+0000","last_change":"2023-07-06T19:58:53.743381+0000","last_active":"2023-07-06T19:58:58.782018+0000","last_peered":"2023-07-06T19:58:58.782018+0000","last_clean":"2023-07-06T19:58:58.782018+0000","last_became_active":"2023-07-06T19:58:53.743098+0000","last_became_peered":"2023-07-06T19:58:53.743098+0000","last_unstale":"2023-07-06T19:58:58.782018+0000","last_undegraded":"2023-07-06T19:58:58.782018+0000","last_fullsized":"2023-07-06T19:58:58.782018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:00:39.522945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377130+0000","last_change":"2023-07-06T19:58:53.754741+0000","last_active":"2023-07-06T19:58:59.377130+0000","last_peered":"2023-07-06T19:58:59.377130+0000","last_clean":"2023-07-06T19:58:59.377130+0000","last_became_active":"2023-07-06T19:58:53.754089+0000","last_became_peered":"2023-07-06T19:58:53.754089+0000","last_unstale":"2023-07-06T19:58:59.377130+0000","last_undegraded":"2023-07-06T19:58:59.377130+0000","last_fullsized":"2023-07-06T19:58:59.377130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:40:15.607877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377294+0000","last_change":"2023-07-06T19:58:53.758130+0000","last_active":"2023-07-06T19:58:59.377294+0000","last_peered":"2023-07-06T19:58:59.377294+0000","last_clean":"2023-07-06T19:58:59.377294+0000","last_became_active":"2023-07-06T19:58:53.757837+0000","last_became_peered":"2023-07-06T19:58:53.757837+0000","last_unstale":"2023-07-06T19:58:59.377294+0000","last_undegraded":"2023-07-06T19:58:59.377294+0000","last_fullsized":"2023-07-06T19:58:59.377294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:12:08.363104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.379057+0000","last_change":"2023-07-06T19:58:53.760750+0000","last_active":"2023-07-06T19:58:59.379057+0000","last_peered":"2023-07-06T19:58:59.379057+0000","last_clean":"2023-07-06T19:58:59.379057+0000","last_became_active":"2023-07-06T19:58:53.760484+0000","last_became_peered":"2023-07-06T19:58:53.760484+0000","last_unstale":"2023-07-06T19:58:59.379057+0000","last_undegraded":"2023-07-06T19:58:59.379057+0000","last_fullsized":"2023-07-06T19:58:59.379057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:55:10.096543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378425+0000","last_change":"2023-07-06T19:58:53.742270+0000","last_active":"2023-07-06T19:58:59.378425+0000","last_peered":"2023-07-06T19:58:59.378425+0000","last_clean":"2023-07-06T19:58:59.378425+0000","last_became_active":"2023-07-06T19:58:53.741974+0000","last_became_peered":"2023-07-06T19:58:53.741974+0000","last_unstale":"2023-07-06T19:58:59.378425+0000","last_undegraded":"2023-07-06T19:58:59.378425+0000","last_fullsized":"2023-07-06T19:58:59.378425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:49:02.964314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377806+0000","last_change":"2023-07-06T19:58:53.750109+0000","last_active":"2023-07-06T19:58:59.377806+0000","last_peered":"2023-07-06T19:58:59.377806+0000","last_clean":"2023-07-06T19:58:59.377806+0000","last_became_active":"2023-07-06T19:58:53.749826+0000","last_became_peered":"2023-07-06T19:58:53.749826+0000","last_unstale":"2023-07-06T19:58:59.377806+0000","last_undegraded":"2023-07-06T19:58:59.377806+0000","last_fullsized":"2023-07-06T19:58:59.377806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:36:45.949174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378110+0000","last_change":"2023-07-06T19:58:53.757988+0000","last_active":"2023-07-06T19:58:59.378110+0000","last_peered":"2023-07-06T19:58:59.378110+0000","last_clean":"2023-07-06T19:58:59.378110+0000","last_became_active":"2023-07-06T19:58:53.751497+0000","last_became_peered":"2023-07-06T19:58:53.751497+0000","last_unstale":"2023-07-06T19:58:59.378110+0000","last_undegraded":"2023-07-06T19:58:59.378110+0000","last_fullsized":"2023-07-06T19:58:59.378110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:27:11.308820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377168+0000","last_change":"2023-07-06T19:58:53.765678+0000","last_active":"2023-07-06T19:58:59.377168+0000","last_peered":"2023-07-06T19:58:59.377168+0000","last_clean":"2023-07-06T19:58:59.377168+0000","last_became_active":"2023-07-06T19:58:53.765413+0000","last_became_peered":"2023-07-06T19:58:53.765413+0000","last_unstale":"2023-07-06T19:58:59.377168+0000","last_undegraded":"2023-07-06T19:58:59.377168+0000","last_fullsized":"2023-07-06T19:58:59.377168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:47:30.856849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377784+0000","last_change":"2023-07-06T19:58:53.755073+0000","last_active":"2023-07-06T19:58:59.377784+0000","last_peered":"2023-07-06T19:58:59.377784+0000","last_clean":"2023-07-06T19:58:59.377784+0000","last_became_active":"2023-07-06T19:58:53.754882+0000","last_became_peered":"2023-07-06T19:58:53.754882+0000","last_unstale":"2023-07-06T19:58:59.377784+0000","last_undegraded":"2023-07-06T19:58:59.377784+0000","last_fullsized":"2023-07-06T19:58:59.377784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:39:05.600911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377911+0000","last_change":"2023-07-06T19:58:53.758162+0000","last_active":"2023-07-06T19:58:59.377911+0000","last_peered":"2023-07-06T19:58:59.377911+0000","last_clean":"2023-07-06T19:58:59.377911+0000","last_became_active":"2023-07-06T19:58:53.753528+0000","last_became_peered":"2023-07-06T19:58:53.753528+0000","last_unstale":"2023-07-06T19:58:59.377911+0000","last_undegraded":"2023-07-06T19:58:59.377911+0000","last_fullsized":"2023-07-06T19:58:59.377911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:43:37.810101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376985+0000","last_change":"2023-07-06T19:58:53.765139+0000","last_active":"2023-07-06T19:58:59.376985+0000","last_peered":"2023-07-06T19:58:59.376985+0000","last_clean":"2023-07-06T19:58:59.376985+0000","last_became_active":"2023-07-06T19:58:53.764887+0000","last_became_peered":"2023-07-06T19:58:53.764887+0000","last_unstale":"2023-07-06T19:58:59.376985+0000","last_undegraded":"2023-07-06T19:58:59.376985+0000","last_fullsized":"2023-07-06T19:58:59.376985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:06:38.381299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782849+0000","last_change":"2023-07-06T19:58:53.750438+0000","last_active":"2023-07-06T19:58:58.782849+0000","last_peered":"2023-07-06T19:58:58.782849+0000","last_clean":"2023-07-06T19:58:58.782849+0000","last_became_active":"2023-07-06T19:58:53.750169+0000","last_became_peered":"2023-07-06T19:58:53.750169+0000","last_unstale":"2023-07-06T19:58:58.782849+0000","last_undegraded":"2023-07-06T19:58:58.782849+0000","last_fullsized":"2023-07-06T19:58:58.782849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:14:20.481463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783170+0000","last_change":"2023-07-06T19:58:53.741853+0000","last_active":"2023-07-06T19:58:58.783170+0000","last_peered":"2023-07-06T19:58:58.783170+0000","last_clean":"2023-07-06T19:58:58.783170+0000","last_became_active":"2023-07-06T19:58:53.741559+0000","last_became_peered":"2023-07-06T19:58:53.741559+0000","last_unstale":"2023-07-06T19:58:58.783170+0000","last_undegraded":"2023-07-06T19:58:58.783170+0000","last_fullsized":"2023-07-06T19:58:58.783170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:06:38.381299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783184+0000","last_change":"2023-07-06T19:58:53.759862+0000","last_active":"2023-07-06T19:58:58.783184+0000","last_peered":"2023-07-06T19:58:58.783184+0000","last_clean":"2023-07-06T19:58:58.783184+0000","last_became_active":"2023-07-06T19:58:53.758903+0000","last_became_peered":"2023-07-06T19:58:53.758903+0000","last_unstale":"2023-07-06T19:58:58.783184+0000","last_undegraded":"2023-07-06T19:58:58.783184+0000","last_fullsized":"2023-07-06T19:58:58.783184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:31:43.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378789+0000","last_change":"2023-07-06T19:58:57.789865+0000","last_active":"2023-07-06T19:58:59.378789+0000","last_peered":"2023-07-06T19:58:59.378789+0000","last_clean":"2023-07-06T19:58:59.378789+0000","last_became_active":"2023-07-06T19:58:57.788796+0000","last_became_peered":"2023-07-06T19:58:57.788796+0000","last_unstale":"2023-07-06T19:58:59.378789+0000","last_undegraded":"2023-07-06T19:58:59.378789+0000","last_fullsized":"2023-07-06T19:58:59.378789+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:40:09.950829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377817+0000","last_change":"2023-07-06T19:58:52.747722+0000","last_active":"2023-07-06T19:58:59.377817+0000","last_peered":"2023-07-06T19:58:59.377817+0000","last_clean":"2023-07-06T19:58:59.377817+0000","last_became_active":"2023-07-06T19:58:52.747373+0000","last_became_peered":"2023-07-06T19:58:52.747373+0000","last_unstale":"2023-07-06T19:58:59.377817+0000","last_undegraded":"2023-07-06T19:58:59.377817+0000","last_fullsized":"2023-07-06T19:58:59.377817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:52:21.260915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377423+0000","last_change":"2023-07-06T19:58:53.760791+0000","last_active":"2023-07-06T19:58:59.377423+0000","last_peered":"2023-07-06T19:58:59.377423+0000","last_clean":"2023-07-06T19:58:59.377423+0000","last_became_active":"2023-07-06T19:58:53.760496+0000","last_became_peered":"2023-07-06T19:58:53.760496+0000","last_unstale":"2023-07-06T19:58:59.377423+0000","last_undegraded":"2023-07-06T19:58:59.377423+0000","last_fullsized":"2023-07-06T19:58:59.377423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:55:35.512797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783686+0000","last_change":"2023-07-06T19:58:57.791584+0000","last_active":"2023-07-06T19:58:58.783686+0000","last_peered":"2023-07-06T19:58:58.783686+0000","last_clean":"2023-07-06T19:58:58.783686+0000","last_became_active":"2023-07-06T19:58:57.791118+0000","last_became_peered":"2023-07-06T19:58:57.791118+0000","last_unstale":"2023-07-06T19:58:58.783686+0000","last_undegraded":"2023-07-06T19:58:58.783686+0000","last_fullsized":"2023-07-06T19:58:58.783686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:22:47.617986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782223+0000","last_change":"2023-07-06T19:58:52.750959+0000","last_active":"2023-07-06T19:58:58.782223+0000","last_peered":"2023-07-06T19:58:58.782223+0000","last_clean":"2023-07-06T19:58:58.782223+0000","last_became_active":"2023-07-06T19:58:52.750645+0000","last_became_peered":"2023-07-06T19:58:52.750645+0000","last_unstale":"2023-07-06T19:58:58.782223+0000","last_undegraded":"2023-07-06T19:58:58.782223+0000","last_fullsized":"2023-07-06T19:58:58.782223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:56:04.557448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378391+0000","last_change":"2023-07-06T19:58:53.756467+0000","last_active":"2023-07-06T19:58:59.378391+0000","last_peered":"2023-07-06T19:58:59.378391+0000","last_clean":"2023-07-06T19:58:59.378391+0000","last_became_active":"2023-07-06T19:58:53.752938+0000","last_became_peered":"2023-07-06T19:58:53.752938+0000","last_unstale":"2023-07-06T19:58:59.378391+0000","last_undegraded":"2023-07-06T19:58:59.378391+0000","last_fullsized":"2023-07-06T19:58:59.378391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:40:15.607877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378564+0000","last_change":"2023-07-06T19:58:57.790380+0000","last_active":"2023-07-06T19:58:59.378564+0000","last_peered":"2023-07-06T19:58:59.378564+0000","last_clean":"2023-07-06T19:58:59.378564+0000","last_became_active":"2023-07-06T19:58:57.789989+0000","last_became_peered":"2023-07-06T19:58:57.789989+0000","last_unstale":"2023-07-06T19:58:59.378564+0000","last_undegraded":"2023-07-06T19:58:59.378564+0000","last_fullsized":"2023-07-06T19:58:59.378564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:38:28.294697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376778+0000","last_change":"2023-07-06T19:58:52.747131+0000","last_active":"2023-07-06T19:58:59.376778+0000","last_peered":"2023-07-06T19:58:59.376778+0000","last_clean":"2023-07-06T19:58:59.376778+0000","last_became_active":"2023-07-06T19:58:52.746849+0000","last_became_peered":"2023-07-06T19:58:52.746849+0000","last_unstale":"2023-07-06T19:58:59.376778+0000","last_undegraded":"2023-07-06T19:58:59.376778+0000","last_fullsized":"2023-07-06T19:58:59.376778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:38:23.255098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783965+0000","last_change":"2023-07-06T19:58:53.752844+0000","last_active":"2023-07-06T19:58:58.783965+0000","last_peered":"2023-07-06T19:58:58.783965+0000","last_clean":"2023-07-06T19:58:58.783965+0000","last_became_active":"2023-07-06T19:58:53.752535+0000","last_became_peered":"2023-07-06T19:58:53.752535+0000","last_unstale":"2023-07-06T19:58:58.783965+0000","last_undegraded":"2023-07-06T19:58:58.783965+0000","last_fullsized":"2023-07-06T19:58:58.783965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:23:37.838134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783216+0000","last_change":"2023-07-06T19:58:57.797542+0000","last_active":"2023-07-06T19:58:58.783216+0000","last_peered":"2023-07-06T19:58:58.783216+0000","last_clean":"2023-07-06T19:58:58.783216+0000","last_became_active":"2023-07-06T19:58:57.794412+0000","last_became_peered":"2023-07-06T19:58:57.794412+0000","last_unstale":"2023-07-06T19:58:58.783216+0000","last_undegraded":"2023-07-06T19:58:58.783216+0000","last_fullsized":"2023-07-06T19:58:58.783216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:04:41.883822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378545+0000","last_change":"2023-07-06T19:58:52.746045+0000","last_active":"2023-07-06T19:58:59.378545+0000","last_peered":"2023-07-06T19:58:59.378545+0000","last_clean":"2023-07-06T19:58:59.378545+0000","last_became_active":"2023-07-06T19:58:52.745753+0000","last_became_peered":"2023-07-06T19:58:52.745753+0000","last_unstale":"2023-07-06T19:58:59.378545+0000","last_undegraded":"2023-07-06T19:58:59.378545+0000","last_fullsized":"2023-07-06T19:58:59.378545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:39:20.477362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376652+0000","last_change":"2023-07-06T19:58:53.760982+0000","last_active":"2023-07-06T19:58:59.376652+0000","last_peered":"2023-07-06T19:58:59.376652+0000","last_clean":"2023-07-06T19:58:59.376652+0000","last_became_active":"2023-07-06T19:58:53.758282+0000","last_became_peered":"2023-07-06T19:58:53.758282+0000","last_unstale":"2023-07-06T19:58:59.376652+0000","last_undegraded":"2023-07-06T19:58:59.376652+0000","last_fullsized":"2023-07-06T19:58:59.376652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:39:21.484949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376781+0000","last_change":"2023-07-06T19:58:57.790546+0000","last_active":"2023-07-06T19:58:59.376781+0000","last_peered":"2023-07-06T19:58:59.376781+0000","last_clean":"2023-07-06T19:58:59.376781+0000","last_became_active":"2023-07-06T19:58:57.790151+0000","last_became_peered":"2023-07-06T19:58:57.790151+0000","last_unstale":"2023-07-06T19:58:59.376781+0000","last_undegraded":"2023-07-06T19:58:59.376781+0000","last_fullsized":"2023-07-06T19:58:59.376781+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:07.546083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782508+0000","last_change":"2023-07-06T19:58:52.746111+0000","last_active":"2023-07-06T19:58:58.782508+0000","last_peered":"2023-07-06T19:58:58.782508+0000","last_clean":"2023-07-06T19:58:58.782508+0000","last_became_active":"2023-07-06T19:58:52.745886+0000","last_became_peered":"2023-07-06T19:58:52.745886+0000","last_unstale":"2023-07-06T19:58:58.782508+0000","last_undegraded":"2023-07-06T19:58:58.782508+0000","last_fullsized":"2023-07-06T19:58:58.782508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:38:23.255098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376789+0000","last_change":"2023-07-06T19:58:53.748570+0000","last_active":"2023-07-06T19:58:59.376789+0000","last_peered":"2023-07-06T19:58:59.376789+0000","last_clean":"2023-07-06T19:58:59.376789+0000","last_became_active":"2023-07-06T19:58:53.748044+0000","last_became_peered":"2023-07-06T19:58:53.748044+0000","last_unstale":"2023-07-06T19:58:59.376789+0000","last_undegraded":"2023-07-06T19:58:59.376789+0000","last_fullsized":"2023-07-06T19:58:59.376789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:01:56.605555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377868+0000","last_change":"2023-07-06T19:58:57.786412+0000","last_active":"2023-07-06T19:58:59.377868+0000","last_peered":"2023-07-06T19:58:59.377868+0000","last_clean":"2023-07-06T19:58:59.377868+0000","last_became_active":"2023-07-06T19:58:57.785979+0000","last_became_peered":"2023-07-06T19:58:57.785979+0000","last_unstale":"2023-07-06T19:58:59.377868+0000","last_undegraded":"2023-07-06T19:58:59.377868+0000","last_fullsized":"2023-07-06T19:58:59.377868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:34:38.161520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378178+0000","last_change":"2023-07-06T19:58:52.751370+0000","last_active":"2023-07-06T19:58:59.378178+0000","last_peered":"2023-07-06T19:58:59.378178+0000","last_clean":"2023-07-06T19:58:59.378178+0000","last_became_active":"2023-07-06T19:58:52.750871+0000","last_became_peered":"2023-07-06T19:58:52.750871+0000","last_unstale":"2023-07-06T19:58:59.378178+0000","last_undegraded":"2023-07-06T19:58:59.378178+0000","last_fullsized":"2023-07-06T19:58:59.378178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:54:29.119026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783170+0000","last_change":"2023-07-06T19:58:53.749382+0000","last_active":"2023-07-06T19:58:58.783170+0000","last_peered":"2023-07-06T19:58:58.783170+0000","last_clean":"2023-07-06T19:58:58.783170+0000","last_became_active":"2023-07-06T19:58:53.749102+0000","last_became_peered":"2023-07-06T19:58:53.749102+0000","last_unstale":"2023-07-06T19:58:58.783170+0000","last_undegraded":"2023-07-06T19:58:58.783170+0000","last_fullsized":"2023-07-06T19:58:58.783170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:00:39.522945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782423+0000","last_change":"2023-07-06T19:58:57.788620+0000","last_active":"2023-07-06T19:58:58.782423+0000","last_peered":"2023-07-06T19:58:58.782423+0000","last_clean":"2023-07-06T19:58:58.782423+0000","last_became_active":"2023-07-06T19:58:57.788179+0000","last_became_peered":"2023-07-06T19:58:57.788179+0000","last_unstale":"2023-07-06T19:58:58.782423+0000","last_undegraded":"2023-07-06T19:58:58.782423+0000","last_fullsized":"2023-07-06T19:58:58.782423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:26:32.189069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:59:09.287689+0000","last_change":"2023-07-06T19:58:52.742265+0000","last_active":"2023-07-06T19:59:09.287689+0000","last_peered":"2023-07-06T19:59:09.287689+0000","last_clean":"2023-07-06T19:59:09.287689+0000","last_became_active":"2023-07-06T19:58:52.741835+0000","last_became_peered":"2023-07-06T19:58:52.741835+0000","last_unstale":"2023-07-06T19:59:09.287689+0000","last_undegraded":"2023-07-06T19:59:09.287689+0000","last_fullsized":"2023-07-06T19:59:09.287689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:02:15.845300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378090+0000","last_change":"2023-07-06T19:58:53.751100+0000","last_active":"2023-07-06T19:58:59.378090+0000","last_peered":"2023-07-06T19:58:59.378090+0000","last_clean":"2023-07-06T19:58:59.378090+0000","last_became_active":"2023-07-06T19:58:53.750777+0000","last_became_peered":"2023-07-06T19:58:53.750777+0000","last_unstale":"2023-07-06T19:58:59.378090+0000","last_undegraded":"2023-07-06T19:58:59.378090+0000","last_fullsized":"2023-07-06T19:58:59.378090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:34:07.170685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783447+0000","last_change":"2023-07-06T19:58:57.787972+0000","last_active":"2023-07-06T19:58:58.783447+0000","last_peered":"2023-07-06T19:58:58.783447+0000","last_clean":"2023-07-06T19:58:58.783447+0000","last_became_active":"2023-07-06T19:58:57.787603+0000","last_became_peered":"2023-07-06T19:58:57.787603+0000","last_unstale":"2023-07-06T19:58:58.783447+0000","last_undegraded":"2023-07-06T19:58:58.783447+0000","last_fullsized":"2023-07-06T19:58:58.783447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:55:39.544808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377410+0000","last_change":"2023-07-06T19:58:52.749256+0000","last_active":"2023-07-06T19:58:59.377410+0000","last_peered":"2023-07-06T19:58:59.377410+0000","last_clean":"2023-07-06T19:58:59.377410+0000","last_became_active":"2023-07-06T19:58:52.748938+0000","last_became_peered":"2023-07-06T19:58:52.748938+0000","last_unstale":"2023-07-06T19:58:59.377410+0000","last_undegraded":"2023-07-06T19:58:59.377410+0000","last_fullsized":"2023-07-06T19:58:59.377410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:38:23.255098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377106+0000","last_change":"2023-07-06T19:58:53.760190+0000","last_active":"2023-07-06T19:58:59.377106+0000","last_peered":"2023-07-06T19:58:59.377106+0000","last_clean":"2023-07-06T19:58:59.377106+0000","last_became_active":"2023-07-06T19:58:53.758351+0000","last_became_peered":"2023-07-06T19:58:53.758351+0000","last_unstale":"2023-07-06T19:58:59.377106+0000","last_undegraded":"2023-07-06T19:58:59.377106+0000","last_fullsized":"2023-07-06T19:58:59.377106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:54:30.126613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376773+0000","last_change":"2023-07-06T19:58:57.787323+0000","last_active":"2023-07-06T19:58:59.376773+0000","last_peered":"2023-07-06T19:58:59.376773+0000","last_clean":"2023-07-06T19:58:59.376773+0000","last_became_active":"2023-07-06T19:58:57.786685+0000","last_became_peered":"2023-07-06T19:58:57.786685+0000","last_unstale":"2023-07-06T19:58:59.376773+0000","last_undegraded":"2023-07-06T19:58:59.376773+0000","last_fullsized":"2023-07-06T19:58:59.376773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:31:48.633170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377567+0000","last_change":"2023-07-06T19:58:52.746786+0000","last_active":"2023-07-06T19:58:59.377567+0000","last_peered":"2023-07-06T19:58:59.377567+0000","last_clean":"2023-07-06T19:58:59.377567+0000","last_became_active":"2023-07-06T19:58:52.746457+0000","last_became_peered":"2023-07-06T19:58:52.746457+0000","last_unstale":"2023-07-06T19:58:59.377567+0000","last_undegraded":"2023-07-06T19:58:59.377567+0000","last_fullsized":"2023-07-06T19:58:59.377567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:06.187998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782712+0000","last_change":"2023-07-06T19:58:53.760059+0000","last_active":"2023-07-06T19:58:58.782712+0000","last_peered":"2023-07-06T19:58:58.782712+0000","last_clean":"2023-07-06T19:58:58.782712+0000","last_became_active":"2023-07-06T19:58:53.759271+0000","last_became_peered":"2023-07-06T19:58:53.759271+0000","last_unstale":"2023-07-06T19:58:58.782712+0000","last_undegraded":"2023-07-06T19:58:58.782712+0000","last_fullsized":"2023-07-06T19:58:58.782712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:54:30.126613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376813+0000","last_change":"2023-07-06T19:58:57.786715+0000","last_active":"2023-07-06T19:58:59.376813+0000","last_peered":"2023-07-06T19:58:59.376813+0000","last_clean":"2023-07-06T19:58:59.376813+0000","last_became_active":"2023-07-06T19:58:57.786187+0000","last_became_peered":"2023-07-06T19:58:57.786187+0000","last_unstale":"2023-07-06T19:58:59.376813+0000","last_undegraded":"2023-07-06T19:58:59.376813+0000","last_fullsized":"2023-07-06T19:58:59.376813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:41:58.726961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377292+0000","last_change":"2023-07-06T19:58:52.751844+0000","last_active":"2023-07-06T19:58:59.377292+0000","last_peered":"2023-07-06T19:58:59.377292+0000","last_clean":"2023-07-06T19:58:59.377292+0000","last_became_active":"2023-07-06T19:58:52.751507+0000","last_became_peered":"2023-07-06T19:58:52.751507+0000","last_unstale":"2023-07-06T19:58:59.377292+0000","last_undegraded":"2023-07-06T19:58:59.377292+0000","last_fullsized":"2023-07-06T19:58:59.377292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:39:20.477362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378484+0000","last_change":"2023-07-06T19:58:53.760239+0000","last_active":"2023-07-06T19:58:59.378484+0000","last_peered":"2023-07-06T19:58:59.378484+0000","last_clean":"2023-07-06T19:58:59.378484+0000","last_became_active":"2023-07-06T19:58:53.759987+0000","last_became_peered":"2023-07-06T19:58:53.759987+0000","last_unstale":"2023-07-06T19:58:59.378484+0000","last_undegraded":"2023-07-06T19:58:59.378484+0000","last_fullsized":"2023-07-06T19:58:59.378484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:47:30.856849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782048+0000","last_change":"2023-07-06T19:58:57.791677+0000","last_active":"2023-07-06T19:58:58.782048+0000","last_peered":"2023-07-06T19:58:58.782048+0000","last_clean":"2023-07-06T19:58:58.782048+0000","last_became_active":"2023-07-06T19:58:57.791232+0000","last_became_peered":"2023-07-06T19:58:57.791232+0000","last_unstale":"2023-07-06T19:58:58.782048+0000","last_undegraded":"2023-07-06T19:58:58.782048+0000","last_fullsized":"2023-07-06T19:58:58.782048+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:06:42.413310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783606+0000","last_change":"2023-07-06T19:58:52.743480+0000","last_active":"2023-07-06T19:58:58.783606+0000","last_peered":"2023-07-06T19:58:58.783606+0000","last_clean":"2023-07-06T19:58:58.783606+0000","last_became_active":"2023-07-06T19:58:52.742980+0000","last_became_peered":"2023-07-06T19:58:52.742980+0000","last_unstale":"2023-07-06T19:58:58.783606+0000","last_undegraded":"2023-07-06T19:58:58.783606+0000","last_fullsized":"2023-07-06T19:58:58.783606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:30:09.417733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377140+0000","last_change":"2023-07-06T19:58:53.760648+0000","last_active":"2023-07-06T19:58:59.377140+0000","last_peered":"2023-07-06T19:58:59.377140+0000","last_clean":"2023-07-06T19:58:59.377140+0000","last_became_active":"2023-07-06T19:58:53.760334+0000","last_became_peered":"2023-07-06T19:58:53.760334+0000","last_unstale":"2023-07-06T19:58:59.377140+0000","last_undegraded":"2023-07-06T19:58:59.377140+0000","last_fullsized":"2023-07-06T19:58:59.377140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:55:10.096543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378635+0000","last_change":"2023-07-06T19:58:57.795273+0000","last_active":"2023-07-06T19:58:59.378635+0000","last_peered":"2023-07-06T19:58:59.378635+0000","last_clean":"2023-07-06T19:58:59.378635+0000","last_became_active":"2023-07-06T19:58:57.793041+0000","last_became_peered":"2023-07-06T19:58:57.793041+0000","last_unstale":"2023-07-06T19:58:59.378635+0000","last_undegraded":"2023-07-06T19:58:59.378635+0000","last_fullsized":"2023-07-06T19:58:59.378635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:55:39.544808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377951+0000","last_change":"2023-07-06T19:58:52.749389+0000","last_active":"2023-07-06T19:58:59.377951+0000","last_peered":"2023-07-06T19:58:59.377951+0000","last_clean":"2023-07-06T19:58:59.377951+0000","last_became_active":"2023-07-06T19:58:52.748954+0000","last_became_peered":"2023-07-06T19:58:52.748954+0000","last_unstale":"2023-07-06T19:58:59.377951+0000","last_undegraded":"2023-07-06T19:58:59.377951+0000","last_fullsized":"2023-07-06T19:58:59.377951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:36:40.777030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.781709+0000","last_change":"2023-07-06T19:58:53.750314+0000","last_active":"2023-07-06T19:58:58.781709+0000","last_peered":"2023-07-06T19:58:58.781709+0000","last_clean":"2023-07-06T19:58:58.781709+0000","last_became_active":"2023-07-06T19:58:53.750016+0000","last_became_peered":"2023-07-06T19:58:53.750016+0000","last_unstale":"2023-07-06T19:58:58.781709+0000","last_undegraded":"2023-07-06T19:58:58.781709+0000","last_fullsized":"2023-07-06T19:58:58.781709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:07.195585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376267+0000","last_change":"2023-07-06T19:58:57.783293+0000","last_active":"2023-07-06T19:58:59.376267+0000","last_peered":"2023-07-06T19:58:59.376267+0000","last_clean":"2023-07-06T19:58:59.376267+0000","last_became_active":"2023-07-06T19:58:57.782891+0000","last_became_peered":"2023-07-06T19:58:57.782891+0000","last_unstale":"2023-07-06T19:58:59.376267+0000","last_undegraded":"2023-07-06T19:58:59.376267+0000","last_fullsized":"2023-07-06T19:58:59.376267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:46:14.072294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377762+0000","last_change":"2023-07-06T19:58:52.749788+0000","last_active":"2023-07-06T19:58:59.377762+0000","last_peered":"2023-07-06T19:58:59.377762+0000","last_clean":"2023-07-06T19:58:59.377762+0000","last_became_active":"2023-07-06T19:58:52.749502+0000","last_became_peered":"2023-07-06T19:58:52.749502+0000","last_unstale":"2023-07-06T19:58:59.377762+0000","last_undegraded":"2023-07-06T19:58:59.377762+0000","last_fullsized":"2023-07-06T19:58:59.377762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:41:53.687362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377616+0000","last_change":"2023-07-06T19:58:53.756711+0000","last_active":"2023-07-06T19:58:59.377616+0000","last_peered":"2023-07-06T19:58:59.377616+0000","last_clean":"2023-07-06T19:58:59.377616+0000","last_became_active":"2023-07-06T19:58:53.756385+0000","last_became_peered":"2023-07-06T19:58:53.756385+0000","last_unstale":"2023-07-06T19:58:59.377616+0000","last_undegraded":"2023-07-06T19:58:59.377616+0000","last_fullsized":"2023-07-06T19:58:59.377616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:14:07.791583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377139+0000","last_change":"2023-07-06T19:58:57.786660+0000","last_active":"2023-07-06T19:58:59.377139+0000","last_peered":"2023-07-06T19:58:59.377139+0000","last_clean":"2023-07-06T19:58:59.377139+0000","last_became_active":"2023-07-06T19:58:57.786238+0000","last_became_peered":"2023-07-06T19:58:57.786238+0000","last_unstale":"2023-07-06T19:58:59.377139+0000","last_undegraded":"2023-07-06T19:58:59.377139+0000","last_fullsized":"2023-07-06T19:58:59.377139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:47:26.705198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378304+0000","last_change":"2023-07-06T19:58:52.751151+0000","last_active":"2023-07-06T19:58:59.378304+0000","last_peered":"2023-07-06T19:58:59.378304+0000","last_clean":"2023-07-06T19:58:59.378304+0000","last_became_active":"2023-07-06T19:58:52.750499+0000","last_became_peered":"2023-07-06T19:58:52.750499+0000","last_unstale":"2023-07-06T19:58:59.378304+0000","last_undegraded":"2023-07-06T19:58:59.378304+0000","last_fullsized":"2023-07-06T19:58:59.378304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:55:09.088956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783436+0000","last_change":"2023-07-06T19:58:53.755226+0000","last_active":"2023-07-06T19:58:58.783436+0000","last_peered":"2023-07-06T19:58:58.783436+0000","last_clean":"2023-07-06T19:58:58.783436+0000","last_became_active":"2023-07-06T19:58:53.754917+0000","last_became_peered":"2023-07-06T19:58:53.754917+0000","last_unstale":"2023-07-06T19:58:58.783436+0000","last_undegraded":"2023-07-06T19:58:58.783436+0000","last_fullsized":"2023-07-06T19:58:58.783436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:32:21.594143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376977+0000","last_change":"2023-07-06T19:58:57.788481+0000","last_active":"2023-07-06T19:58:59.376977+0000","last_peered":"2023-07-06T19:58:59.376977+0000","last_clean":"2023-07-06T19:58:59.376977+0000","last_became_active":"2023-07-06T19:58:57.788042+0000","last_became_peered":"2023-07-06T19:58:57.788042+0000","last_unstale":"2023-07-06T19:58:59.376977+0000","last_undegraded":"2023-07-06T19:58:59.376977+0000","last_fullsized":"2023-07-06T19:58:59.376977+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:12:56.591390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782017+0000","last_change":"2023-07-06T19:58:52.752037+0000","last_active":"2023-07-06T19:58:58.782017+0000","last_peered":"2023-07-06T19:58:58.782017+0000","last_clean":"2023-07-06T19:58:58.782017+0000","last_became_active":"2023-07-06T19:58:52.751743+0000","last_became_peered":"2023-07-06T19:58:52.751743+0000","last_unstale":"2023-07-06T19:58:58.782017+0000","last_undegraded":"2023-07-06T19:58:58.782017+0000","last_fullsized":"2023-07-06T19:58:58.782017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:02.506485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378860+0000","last_change":"2023-07-06T19:58:53.756515+0000","last_active":"2023-07-06T19:58:59.378860+0000","last_peered":"2023-07-06T19:58:59.378860+0000","last_clean":"2023-07-06T19:58:59.378860+0000","last_became_active":"2023-07-06T19:58:53.756160+0000","last_became_peered":"2023-07-06T19:58:53.756160+0000","last_unstale":"2023-07-06T19:58:59.378860+0000","last_undegraded":"2023-07-06T19:58:59.378860+0000","last_fullsized":"2023-07-06T19:58:59.378860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:09:50.298552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376553+0000","last_change":"2023-07-06T19:58:57.791364+0000","last_active":"2023-07-06T19:58:59.376553+0000","last_peered":"2023-07-06T19:58:59.376553+0000","last_clean":"2023-07-06T19:58:59.376553+0000","last_became_active":"2023-07-06T19:58:57.789062+0000","last_became_peered":"2023-07-06T19:58:57.789062+0000","last_unstale":"2023-07-06T19:58:59.376553+0000","last_undegraded":"2023-07-06T19:58:59.376553+0000","last_fullsized":"2023-07-06T19:58:59.376553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:06:20.866793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377550+0000","last_change":"2023-07-06T19:58:52.747602+0000","last_active":"2023-07-06T19:58:59.377550+0000","last_peered":"2023-07-06T19:58:59.377550+0000","last_clean":"2023-07-06T19:58:59.377550+0000","last_became_active":"2023-07-06T19:58:52.747306+0000","last_became_peered":"2023-07-06T19:58:52.747306+0000","last_unstale":"2023-07-06T19:58:59.377550+0000","last_undegraded":"2023-07-06T19:58:59.377550+0000","last_fullsized":"2023-07-06T19:58:59.377550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:46:23.956146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377454+0000","last_change":"2023-07-06T19:58:53.760870+0000","last_active":"2023-07-06T19:58:59.377454+0000","last_peered":"2023-07-06T19:58:59.377454+0000","last_clean":"2023-07-06T19:58:59.377454+0000","last_became_active":"2023-07-06T19:58:53.760583+0000","last_became_peered":"2023-07-06T19:58:53.760583+0000","last_unstale":"2023-07-06T19:58:59.377454+0000","last_undegraded":"2023-07-06T19:58:59.377454+0000","last_fullsized":"2023-07-06T19:58:59.377454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:36:39.721385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782589+0000","last_change":"2023-07-06T19:58:57.794470+0000","last_active":"2023-07-06T19:58:58.782589+0000","last_peered":"2023-07-06T19:58:58.782589+0000","last_clean":"2023-07-06T19:58:58.782589+0000","last_became_active":"2023-07-06T19:58:57.793975+0000","last_became_peered":"2023-07-06T19:58:57.793975+0000","last_unstale":"2023-07-06T19:58:58.782589+0000","last_undegraded":"2023-07-06T19:58:58.782589+0000","last_fullsized":"2023-07-06T19:58:58.782589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:28:54.247015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783537+0000","last_change":"2023-07-06T19:58:52.740315+0000","last_active":"2023-07-06T19:58:58.783537+0000","last_peered":"2023-07-06T19:58:58.783537+0000","last_clean":"2023-07-06T19:58:58.783537+0000","last_became_active":"2023-07-06T19:58:52.739933+0000","last_became_peered":"2023-07-06T19:58:52.739933+0000","last_unstale":"2023-07-06T19:58:58.783537+0000","last_undegraded":"2023-07-06T19:58:58.783537+0000","last_fullsized":"2023-07-06T19:58:58.783537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:49:50.590705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378294+0000","last_change":"2023-07-06T19:58:53.741928+0000","last_active":"2023-07-06T19:58:59.378294+0000","last_peered":"2023-07-06T19:58:59.378294+0000","last_clean":"2023-07-06T19:58:59.378294+0000","last_became_active":"2023-07-06T19:58:53.741625+0000","last_became_peered":"2023-07-06T19:58:53.741625+0000","last_unstale":"2023-07-06T19:58:59.378294+0000","last_undegraded":"2023-07-06T19:58:59.378294+0000","last_fullsized":"2023-07-06T19:58:59.378294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:10:07.041452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782705+0000","last_change":"2023-07-06T19:58:57.792062+0000","last_active":"2023-07-06T19:58:58.782705+0000","last_peered":"2023-07-06T19:58:58.782705+0000","last_clean":"2023-07-06T19:58:58.782705+0000","last_became_active":"2023-07-06T19:58:57.791281+0000","last_became_peered":"2023-07-06T19:58:57.791281+0000","last_unstale":"2023-07-06T19:58:58.782705+0000","last_undegraded":"2023-07-06T19:58:58.782705+0000","last_fullsized":"2023-07-06T19:58:58.782705+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:55:14.128554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377292+0000","last_change":"2023-07-06T19:58:52.747562+0000","last_active":"2023-07-06T19:58:59.377292+0000","last_peered":"2023-07-06T19:58:59.377292+0000","last_clean":"2023-07-06T19:58:59.377292+0000","last_became_active":"2023-07-06T19:58:52.747229+0000","last_became_peered":"2023-07-06T19:58:52.747229+0000","last_unstale":"2023-07-06T19:58:59.377292+0000","last_undegraded":"2023-07-06T19:58:59.377292+0000","last_fullsized":"2023-07-06T19:58:59.377292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:04:30.618240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378608+0000","last_change":"2023-07-06T19:58:53.756720+0000","last_active":"2023-07-06T19:58:59.378608+0000","last_peered":"2023-07-06T19:58:59.378608+0000","last_clean":"2023-07-06T19:58:59.378608+0000","last_became_active":"2023-07-06T19:58:53.756402+0000","last_became_peered":"2023-07-06T19:58:53.756402+0000","last_unstale":"2023-07-06T19:58:59.378608+0000","last_undegraded":"2023-07-06T19:58:59.378608+0000","last_fullsized":"2023-07-06T19:58:59.378608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:26:00.900208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378351+0000","last_change":"2023-07-06T19:58:57.783465+0000","last_active":"2023-07-06T19:58:59.378351+0000","last_peered":"2023-07-06T19:58:59.378351+0000","last_clean":"2023-07-06T19:58:59.378351+0000","last_became_active":"2023-07-06T19:58:57.782790+0000","last_became_peered":"2023-07-06T19:58:57.782790+0000","last_unstale":"2023-07-06T19:58:59.378351+0000","last_undegraded":"2023-07-06T19:58:59.378351+0000","last_fullsized":"2023-07-06T19:58:59.378351+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:43:02.955936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376589+0000","last_change":"2023-07-06T19:58:52.749725+0000","last_active":"2023-07-06T19:58:59.376589+0000","last_peered":"2023-07-06T19:58:59.376589+0000","last_clean":"2023-07-06T19:58:59.376589+0000","last_became_active":"2023-07-06T19:58:52.749426+0000","last_became_peered":"2023-07-06T19:58:52.749426+0000","last_unstale":"2023-07-06T19:58:59.376589+0000","last_undegraded":"2023-07-06T19:58:59.376589+0000","last_fullsized":"2023-07-06T19:58:59.376589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:08:50.821397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783208+0000","last_change":"2023-07-06T19:58:53.759474+0000","last_active":"2023-07-06T19:58:58.783208+0000","last_peered":"2023-07-06T19:58:58.783208+0000","last_clean":"2023-07-06T19:58:58.783208+0000","last_became_active":"2023-07-06T19:58:53.759191+0000","last_became_peered":"2023-07-06T19:58:53.759191+0000","last_unstale":"2023-07-06T19:58:58.783208+0000","last_undegraded":"2023-07-06T19:58:58.783208+0000","last_fullsized":"2023-07-06T19:58:58.783208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:40:15.607877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378239+0000","last_change":"2023-07-06T19:58:57.787350+0000","last_active":"2023-07-06T19:58:59.378239+0000","last_peered":"2023-07-06T19:58:59.378239+0000","last_clean":"2023-07-06T19:58:59.378239+0000","last_became_active":"2023-07-06T19:58:57.786760+0000","last_became_peered":"2023-07-06T19:58:57.786760+0000","last_unstale":"2023-07-06T19:58:59.378239+0000","last_undegraded":"2023-07-06T19:58:59.378239+0000","last_fullsized":"2023-07-06T19:58:59.378239+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:07.546083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782756+0000","last_change":"2023-07-06T19:58:47.723855+0000","last_active":"2023-07-06T19:58:58.782756+0000","last_peered":"2023-07-06T19:58:58.782756+0000","last_clean":"2023-07-06T19:58:58.782756+0000","last_became_active":"2023-07-06T19:58:47.723553+0000","last_became_peered":"2023-07-06T19:58:47.723553+0000","last_unstale":"2023-07-06T19:58:58.782756+0000","last_undegraded":"2023-07-06T19:58:58.782756+0000","last_fullsized":"2023-07-06T19:58:58.782756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:00:46.116158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782566+0000","last_change":"2023-07-06T19:58:52.751410+0000","last_active":"2023-07-06T19:58:58.782566+0000","last_peered":"2023-07-06T19:58:58.782566+0000","last_clean":"2023-07-06T19:58:58.782566+0000","last_became_active":"2023-07-06T19:58:52.751112+0000","last_became_peered":"2023-07-06T19:58:52.751112+0000","last_unstale":"2023-07-06T19:58:58.782566+0000","last_undegraded":"2023-07-06T19:58:58.782566+0000","last_fullsized":"2023-07-06T19:58:58.782566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:01:55.597968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782915+0000","last_change":"2023-07-06T19:58:53.749897+0000","last_active":"2023-07-06T19:58:58.782915+0000","last_peered":"2023-07-06T19:58:58.782915+0000","last_clean":"2023-07-06T19:58:58.782915+0000","last_became_active":"2023-07-06T19:58:53.749624+0000","last_became_peered":"2023-07-06T19:58:53.749624+0000","last_unstale":"2023-07-06T19:58:58.782915+0000","last_undegraded":"2023-07-06T19:58:58.782915+0000","last_fullsized":"2023-07-06T19:58:58.782915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:15:46.167902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378551+0000","last_change":"2023-07-06T19:58:57.789358+0000","last_active":"2023-07-06T19:58:59.378551+0000","last_peered":"2023-07-06T19:58:59.378551+0000","last_clean":"2023-07-06T19:58:59.378551+0000","last_became_active":"2023-07-06T19:58:57.788645+0000","last_became_peered":"2023-07-06T19:58:57.788645+0000","last_unstale":"2023-07-06T19:58:59.378551+0000","last_undegraded":"2023-07-06T19:58:59.378551+0000","last_fullsized":"2023-07-06T19:58:59.378551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:31:48.633170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782612+0000","last_change":"2023-07-06T19:58:47.705294+0000","last_active":"2023-07-06T19:58:58.782612+0000","last_peered":"2023-07-06T19:58:58.782612+0000","last_clean":"2023-07-06T19:58:58.782612+0000","last_became_active":"2023-07-06T19:58:47.704921+0000","last_became_peered":"2023-07-06T19:58:47.704921+0000","last_unstale":"2023-07-06T19:58:58.782612+0000","last_undegraded":"2023-07-06T19:58:58.782612+0000","last_fullsized":"2023-07-06T19:58:58.782612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:41:48.663962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378365+0000","last_change":"2023-07-06T19:58:52.748067+0000","last_active":"2023-07-06T19:58:59.378365+0000","last_peered":"2023-07-06T19:58:59.378365+0000","last_clean":"2023-07-06T19:58:59.378365+0000","last_became_active":"2023-07-06T19:58:52.747728+0000","last_became_peered":"2023-07-06T19:58:52.747728+0000","last_unstale":"2023-07-06T19:58:59.378365+0000","last_undegraded":"2023-07-06T19:58:59.378365+0000","last_fullsized":"2023-07-06T19:58:59.378365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:22:44.301281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782686+0000","last_change":"2023-07-06T19:58:53.742174+0000","last_active":"2023-07-06T19:58:58.782686+0000","last_peered":"2023-07-06T19:58:58.782686+0000","last_clean":"2023-07-06T19:58:58.782686+0000","last_became_active":"2023-07-06T19:58:53.741231+0000","last_became_peered":"2023-07-06T19:58:53.741231+0000","last_unstale":"2023-07-06T19:58:58.782686+0000","last_undegraded":"2023-07-06T19:58:58.782686+0000","last_fullsized":"2023-07-06T19:58:58.782686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:27:23.271688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376951+0000","last_change":"2023-07-06T19:58:57.785326+0000","last_active":"2023-07-06T19:58:59.376951+0000","last_peered":"2023-07-06T19:58:59.376951+0000","last_clean":"2023-07-06T19:58:59.376951+0000","last_became_active":"2023-07-06T19:58:57.784907+0000","last_became_peered":"2023-07-06T19:58:57.784907+0000","last_unstale":"2023-07-06T19:58:59.376951+0000","last_undegraded":"2023-07-06T19:58:59.376951+0000","last_fullsized":"2023-07-06T19:58:59.376951+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:19:07.540692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376590+0000","last_change":"2023-07-06T19:58:47.766992+0000","last_active":"2023-07-06T19:58:59.376590+0000","last_peered":"2023-07-06T19:58:59.376590+0000","last_clean":"2023-07-06T19:58:59.376590+0000","last_became_active":"2023-07-06T19:58:47.766697+0000","last_became_peered":"2023-07-06T19:58:47.766697+0000","last_unstale":"2023-07-06T19:58:59.376590+0000","last_undegraded":"2023-07-06T19:58:59.376590+0000","last_fullsized":"2023-07-06T19:58:59.376590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:44:05.260069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782473+0000","last_change":"2023-07-06T19:58:52.747039+0000","last_active":"2023-07-06T19:58:58.782473+0000","last_peered":"2023-07-06T19:58:58.782473+0000","last_clean":"2023-07-06T19:58:58.782473+0000","last_became_active":"2023-07-06T19:58:52.746770+0000","last_became_peered":"2023-07-06T19:58:52.746770+0000","last_unstale":"2023-07-06T19:58:58.782473+0000","last_undegraded":"2023-07-06T19:58:58.782473+0000","last_fullsized":"2023-07-06T19:58:58.782473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:34:28.429392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783138+0000","last_change":"2023-07-06T19:58:53.745314+0000","last_active":"2023-07-06T19:58:58.783138+0000","last_peered":"2023-07-06T19:58:58.783138+0000","last_clean":"2023-07-06T19:58:58.783138+0000","last_became_active":"2023-07-06T19:58:53.744843+0000","last_became_peered":"2023-07-06T19:58:53.744843+0000","last_unstale":"2023-07-06T19:58:58.783138+0000","last_undegraded":"2023-07-06T19:58:58.783138+0000","last_fullsized":"2023-07-06T19:58:58.783138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:03.514072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377298+0000","last_change":"2023-07-06T19:58:57.793087+0000","last_active":"2023-07-06T19:58:59.377298+0000","last_peered":"2023-07-06T19:58:59.377298+0000","last_clean":"2023-07-06T19:58:59.377298+0000","last_became_active":"2023-07-06T19:58:57.792685+0000","last_became_peered":"2023-07-06T19:58:57.792685+0000","last_unstale":"2023-07-06T19:58:59.377298+0000","last_undegraded":"2023-07-06T19:58:59.377298+0000","last_fullsized":"2023-07-06T19:58:59.377298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:31:48.633170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782184+0000","last_change":"2023-07-06T19:58:47.704498+0000","last_active":"2023-07-06T19:58:58.782184+0000","last_peered":"2023-07-06T19:58:58.782184+0000","last_clean":"2023-07-06T19:58:58.782184+0000","last_became_active":"2023-07-06T19:58:47.704172+0000","last_became_peered":"2023-07-06T19:58:47.704172+0000","last_unstale":"2023-07-06T19:58:58.782184+0000","last_undegraded":"2023-07-06T19:58:58.782184+0000","last_fullsized":"2023-07-06T19:58:58.782184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:08:45.797996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377014+0000","last_change":"2023-07-06T19:58:40.972763+0000","last_active":"2023-07-06T19:58:59.377014+0000","last_peered":"2023-07-06T19:58:59.377014+0000","last_clean":"2023-07-06T19:58:59.377014+0000","last_became_active":"2023-07-06T19:58:40.971570+0000","last_became_peered":"2023-07-06T19:58:40.971570+0000","last_unstale":"2023-07-06T19:58:59.377014+0000","last_undegraded":"2023-07-06T19:58:59.377014+0000","last_fullsized":"2023-07-06T19:58:59.377014+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_clean_scrub_stamp":"2023-07-06T19:58:39.653546+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:00:26.457825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376600+0000","last_change":"2023-07-06T19:58:52.746886+0000","last_active":"2023-07-06T19:58:59.376600+0000","last_peered":"2023-07-06T19:58:59.376600+0000","last_clean":"2023-07-06T19:58:59.376600+0000","last_became_active":"2023-07-06T19:58:52.746551+0000","last_became_peered":"2023-07-06T19:58:52.746551+0000","last_unstale":"2023-07-06T19:58:59.376600+0000","last_undegraded":"2023-07-06T19:58:59.376600+0000","last_fullsized":"2023-07-06T19:58:59.376600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:47:29.849262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783755+0000","last_change":"2023-07-06T19:58:53.750523+0000","last_active":"2023-07-06T19:58:58.783755+0000","last_peered":"2023-07-06T19:58:58.783755+0000","last_clean":"2023-07-06T19:58:58.783755+0000","last_became_active":"2023-07-06T19:58:53.750242+0000","last_became_peered":"2023-07-06T19:58:53.750242+0000","last_unstale":"2023-07-06T19:58:58.783755+0000","last_undegraded":"2023-07-06T19:58:58.783755+0000","last_fullsized":"2023-07-06T19:58:58.783755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:56:30.660740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782488+0000","last_change":"2023-07-06T19:58:57.786254+0000","last_active":"2023-07-06T19:58:58.782488+0000","last_peered":"2023-07-06T19:58:58.782488+0000","last_clean":"2023-07-06T19:58:58.782488+0000","last_became_active":"2023-07-06T19:58:57.785873+0000","last_became_peered":"2023-07-06T19:58:57.785873+0000","last_unstale":"2023-07-06T19:58:58.782488+0000","last_undegraded":"2023-07-06T19:58:58.782488+0000","last_fullsized":"2023-07-06T19:58:58.782488+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:31:48.633170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377148+0000","last_change":"2023-07-06T19:58:47.708545+0000","last_active":"2023-07-06T19:58:59.377148+0000","last_peered":"2023-07-06T19:58:59.377148+0000","last_clean":"2023-07-06T19:58:59.377148+0000","last_became_active":"2023-07-06T19:58:47.708230+0000","last_became_peered":"2023-07-06T19:58:47.708230+0000","last_unstale":"2023-07-06T19:58:59.377148+0000","last_undegraded":"2023-07-06T19:58:59.377148+0000","last_fullsized":"2023-07-06T19:58:59.377148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:08:45.797996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376917+0000","last_change":"2023-07-06T19:58:52.751850+0000","last_active":"2023-07-06T19:58:59.376917+0000","last_peered":"2023-07-06T19:58:59.376917+0000","last_clean":"2023-07-06T19:58:59.376917+0000","last_became_active":"2023-07-06T19:58:52.751537+0000","last_became_peered":"2023-07-06T19:58:52.751537+0000","last_unstale":"2023-07-06T19:58:59.376917+0000","last_undegraded":"2023-07-06T19:58:59.376917+0000","last_fullsized":"2023-07-06T19:58:59.376917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:15:45.160315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378259+0000","last_change":"2023-07-06T19:58:53.753894+0000","last_active":"2023-07-06T19:58:59.378259+0000","last_peered":"2023-07-06T19:58:59.378259+0000","last_clean":"2023-07-06T19:58:59.378259+0000","last_became_active":"2023-07-06T19:58:53.753530+0000","last_became_peered":"2023-07-06T19:58:53.753530+0000","last_unstale":"2023-07-06T19:58:59.378259+0000","last_undegraded":"2023-07-06T19:58:59.378259+0000","last_fullsized":"2023-07-06T19:58:59.378259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:06:38.381299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783829+0000","last_change":"2023-07-06T19:58:57.798396+0000","last_active":"2023-07-06T19:58:58.783829+0000","last_peered":"2023-07-06T19:58:58.783829+0000","last_clean":"2023-07-06T19:58:58.783829+0000","last_became_active":"2023-07-06T19:58:57.798003+0000","last_became_peered":"2023-07-06T19:58:57.798003+0000","last_unstale":"2023-07-06T19:58:58.783829+0000","last_undegraded":"2023-07-06T19:58:58.783829+0000","last_fullsized":"2023-07-06T19:58:58.783829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:48:14.761542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378171+0000","last_change":"2023-07-06T19:58:47.723926+0000","last_active":"2023-07-06T19:58:59.378171+0000","last_peered":"2023-07-06T19:58:59.378171+0000","last_clean":"2023-07-06T19:58:59.378171+0000","last_became_active":"2023-07-06T19:58:47.723646+0000","last_became_peered":"2023-07-06T19:58:47.723646+0000","last_unstale":"2023-07-06T19:58:59.378171+0000","last_undegraded":"2023-07-06T19:58:59.378171+0000","last_fullsized":"2023-07-06T19:58:59.378171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:09:44.267564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783304+0000","last_change":"2023-07-06T19:58:52.744960+0000","last_active":"2023-07-06T19:58:58.783304+0000","last_peered":"2023-07-06T19:58:58.783304+0000","last_clean":"2023-07-06T19:58:58.783304+0000","last_became_active":"2023-07-06T19:58:52.744634+0000","last_became_peered":"2023-07-06T19:58:52.744634+0000","last_unstale":"2023-07-06T19:58:58.783304+0000","last_undegraded":"2023-07-06T19:58:58.783304+0000","last_fullsized":"2023-07-06T19:58:58.783304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:08:50.821397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378559+0000","last_change":"2023-07-06T19:58:53.750128+0000","last_active":"2023-07-06T19:58:59.378559+0000","last_peered":"2023-07-06T19:58:59.378559+0000","last_clean":"2023-07-06T19:58:59.378559+0000","last_became_active":"2023-07-06T19:58:53.749580+0000","last_became_peered":"2023-07-06T19:58:53.749580+0000","last_unstale":"2023-07-06T19:58:59.378559+0000","last_undegraded":"2023-07-06T19:58:59.378559+0000","last_fullsized":"2023-07-06T19:58:59.378559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:01:56.605555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377697+0000","last_change":"2023-07-06T19:58:57.788139+0000","last_active":"2023-07-06T19:58:59.377697+0000","last_peered":"2023-07-06T19:58:59.377697+0000","last_clean":"2023-07-06T19:58:59.377697+0000","last_became_active":"2023-07-06T19:58:57.787755+0000","last_became_peered":"2023-07-06T19:58:57.787755+0000","last_unstale":"2023-07-06T19:58:59.377697+0000","last_undegraded":"2023-07-06T19:58:59.377697+0000","last_fullsized":"2023-07-06T19:58:59.377697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:49:04.545425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377011+0000","last_change":"2023-07-06T19:58:52.749383+0000","last_active":"2023-07-06T19:58:59.377011+0000","last_peered":"2023-07-06T19:58:59.377011+0000","last_clean":"2023-07-06T19:58:59.377011+0000","last_became_active":"2023-07-06T19:58:52.749084+0000","last_became_peered":"2023-07-06T19:58:52.749084+0000","last_unstale":"2023-07-06T19:58:59.377011+0000","last_undegraded":"2023-07-06T19:58:59.377011+0000","last_fullsized":"2023-07-06T19:58:59.377011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:09:49.290965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782895+0000","last_change":"2023-07-06T19:58:47.711918+0000","last_active":"2023-07-06T19:58:58.782895+0000","last_peered":"2023-07-06T19:58:58.782895+0000","last_clean":"2023-07-06T19:58:58.782895+0000","last_became_active":"2023-07-06T19:58:47.711591+0000","last_became_peered":"2023-07-06T19:58:47.711591+0000","last_unstale":"2023-07-06T19:58:58.782895+0000","last_undegraded":"2023-07-06T19:58:58.782895+0000","last_fullsized":"2023-07-06T19:58:58.782895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:01.164597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376523+0000","last_change":"2023-07-06T19:58:53.756858+0000","last_active":"2023-07-06T19:58:59.376523+0000","last_peered":"2023-07-06T19:58:59.376523+0000","last_clean":"2023-07-06T19:58:59.376523+0000","last_became_active":"2023-07-06T19:58:53.756704+0000","last_became_peered":"2023-07-06T19:58:53.756704+0000","last_unstale":"2023-07-06T19:58:59.376523+0000","last_undegraded":"2023-07-06T19:58:59.376523+0000","last_fullsized":"2023-07-06T19:58:59.376523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:40:15.607877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376385+0000","last_change":"2023-07-06T19:58:57.790196+0000","last_active":"2023-07-06T19:58:59.376385+0000","last_peered":"2023-07-06T19:58:59.376385+0000","last_clean":"2023-07-06T19:58:59.376385+0000","last_became_active":"2023-07-06T19:58:57.789783+0000","last_became_peered":"2023-07-06T19:58:57.789783+0000","last_unstale":"2023-07-06T19:58:59.376385+0000","last_undegraded":"2023-07-06T19:58:59.376385+0000","last_fullsized":"2023-07-06T19:58:59.376385+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:00:43.554956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783818+0000","last_change":"2023-07-06T19:58:47.712143+0000","last_active":"2023-07-06T19:58:58.783818+0000","last_peered":"2023-07-06T19:58:58.783818+0000","last_clean":"2023-07-06T19:58:58.783818+0000","last_became_active":"2023-07-06T19:58:47.711788+0000","last_became_peered":"2023-07-06T19:58:47.711788+0000","last_unstale":"2023-07-06T19:58:58.783818+0000","last_undegraded":"2023-07-06T19:58:58.783818+0000","last_fullsized":"2023-07-06T19:58:58.783818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:14:46.864853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378347+0000","last_change":"2023-07-06T19:58:52.745653+0000","last_active":"2023-07-06T19:58:59.378347+0000","last_peered":"2023-07-06T19:58:59.378347+0000","last_clean":"2023-07-06T19:58:59.378347+0000","last_became_active":"2023-07-06T19:58:52.745371+0000","last_became_peered":"2023-07-06T19:58:52.745371+0000","last_unstale":"2023-07-06T19:58:59.378347+0000","last_undegraded":"2023-07-06T19:58:59.378347+0000","last_fullsized":"2023-07-06T19:58:59.378347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:00:38.515358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377461+0000","last_change":"2023-07-06T19:58:53.748251+0000","last_active":"2023-07-06T19:58:59.377461+0000","last_peered":"2023-07-06T19:58:59.377461+0000","last_clean":"2023-07-06T19:58:59.377461+0000","last_became_active":"2023-07-06T19:58:53.743355+0000","last_became_peered":"2023-07-06T19:58:53.743355+0000","last_unstale":"2023-07-06T19:58:59.377461+0000","last_undegraded":"2023-07-06T19:58:59.377461+0000","last_fullsized":"2023-07-06T19:58:59.377461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:32:07.064198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783329+0000","last_change":"2023-07-06T19:58:57.788802+0000","last_active":"2023-07-06T19:58:58.783329+0000","last_peered":"2023-07-06T19:58:58.783329+0000","last_clean":"2023-07-06T19:58:58.783329+0000","last_became_active":"2023-07-06T19:58:57.788255+0000","last_became_peered":"2023-07-06T19:58:57.788255+0000","last_unstale":"2023-07-06T19:58:58.783329+0000","last_undegraded":"2023-07-06T19:58:58.783329+0000","last_fullsized":"2023-07-06T19:58:58.783329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:47:34.888861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378713+0000","last_change":"2023-07-06T19:58:52.751073+0000","last_active":"2023-07-06T19:58:59.378713+0000","last_peered":"2023-07-06T19:58:59.378713+0000","last_clean":"2023-07-06T19:58:59.378713+0000","last_became_active":"2023-07-06T19:58:52.750801+0000","last_became_peered":"2023-07-06T19:58:52.750801+0000","last_unstale":"2023-07-06T19:58:59.378713+0000","last_undegraded":"2023-07-06T19:58:59.378713+0000","last_fullsized":"2023-07-06T19:58:59.378713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:41:53.687362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377890+0000","last_change":"2023-07-06T19:58:53.752885+0000","last_active":"2023-07-06T19:58:59.377890+0000","last_peered":"2023-07-06T19:58:59.377890+0000","last_clean":"2023-07-06T19:58:59.377890+0000","last_became_active":"2023-07-06T19:58:53.752604+0000","last_became_peered":"2023-07-06T19:58:53.752604+0000","last_unstale":"2023-07-06T19:58:59.377890+0000","last_undegraded":"2023-07-06T19:58:59.377890+0000","last_fullsized":"2023-07-06T19:58:59.377890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:04:50.697845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377636+0000","last_change":"2023-07-06T19:58:57.792965+0000","last_active":"2023-07-06T19:58:59.377636+0000","last_peered":"2023-07-06T19:58:59.377636+0000","last_clean":"2023-07-06T19:58:59.377636+0000","last_became_active":"2023-07-06T19:58:57.792542+0000","last_became_peered":"2023-07-06T19:58:57.792542+0000","last_unstale":"2023-07-06T19:58:59.377636+0000","last_undegraded":"2023-07-06T19:58:59.377636+0000","last_fullsized":"2023-07-06T19:58:59.377636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:02:00.637566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782164+0000","last_change":"2023-07-06T19:58:52.748757+0000","last_active":"2023-07-06T19:58:58.782164+0000","last_peered":"2023-07-06T19:58:58.782164+0000","last_clean":"2023-07-06T19:58:58.782164+0000","last_became_active":"2023-07-06T19:58:52.748438+0000","last_became_peered":"2023-07-06T19:58:52.748438+0000","last_unstale":"2023-07-06T19:58:58.782164+0000","last_undegraded":"2023-07-06T19:58:58.782164+0000","last_fullsized":"2023-07-06T19:58:58.782164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:40:14.600290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378827+0000","last_change":"2023-07-06T19:58:53.760898+0000","last_active":"2023-07-06T19:58:59.378827+0000","last_peered":"2023-07-06T19:58:59.378827+0000","last_clean":"2023-07-06T19:58:59.378827+0000","last_became_active":"2023-07-06T19:58:53.760643+0000","last_became_peered":"2023-07-06T19:58:53.760643+0000","last_unstale":"2023-07-06T19:58:59.378827+0000","last_undegraded":"2023-07-06T19:58:59.378827+0000","last_fullsized":"2023-07-06T19:58:59.378827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:03:04.431089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782178+0000","last_change":"2023-07-06T19:58:57.780940+0000","last_active":"2023-07-06T19:58:58.782178+0000","last_peered":"2023-07-06T19:58:58.782178+0000","last_clean":"2023-07-06T19:58:58.782178+0000","last_became_active":"2023-07-06T19:58:57.780557+0000","last_became_peered":"2023-07-06T19:58:57.780557+0000","last_unstale":"2023-07-06T19:58:58.782178+0000","last_undegraded":"2023-07-06T19:58:58.782178+0000","last_fullsized":"2023-07-06T19:58:58.782178+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:09:54.330563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782271+0000","last_change":"2023-07-06T19:58:52.748732+0000","last_active":"2023-07-06T19:58:58.782271+0000","last_peered":"2023-07-06T19:58:58.782271+0000","last_clean":"2023-07-06T19:58:58.782271+0000","last_became_active":"2023-07-06T19:58:52.748464+0000","last_became_peered":"2023-07-06T19:58:52.748464+0000","last_unstale":"2023-07-06T19:58:58.782271+0000","last_undegraded":"2023-07-06T19:58:58.782271+0000","last_fullsized":"2023-07-06T19:58:58.782271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:47:29.849262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377654+0000","last_change":"2023-07-06T19:58:53.749638+0000","last_active":"2023-07-06T19:58:59.377654+0000","last_peered":"2023-07-06T19:58:59.377654+0000","last_clean":"2023-07-06T19:58:59.377654+0000","last_became_active":"2023-07-06T19:58:53.749360+0000","last_became_peered":"2023-07-06T19:58:53.749360+0000","last_unstale":"2023-07-06T19:58:59.377654+0000","last_undegraded":"2023-07-06T19:58:59.377654+0000","last_fullsized":"2023-07-06T19:58:59.377654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:52:07.484161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376759+0000","last_change":"2023-07-06T19:58:57.789615+0000","last_active":"2023-07-06T19:58:59.376759+0000","last_peered":"2023-07-06T19:58:59.376759+0000","last_clean":"2023-07-06T19:58:59.376759+0000","last_became_active":"2023-07-06T19:58:57.789210+0000","last_became_peered":"2023-07-06T19:58:57.789210+0000","last_unstale":"2023-07-06T19:58:59.376759+0000","last_undegraded":"2023-07-06T19:58:59.376759+0000","last_fullsized":"2023-07-06T19:58:59.376759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:43:41.842113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377561+0000","last_change":"2023-07-06T19:58:52.749215+0000","last_active":"2023-07-06T19:58:59.377561+0000","last_peered":"2023-07-06T19:58:59.377561+0000","last_clean":"2023-07-06T19:58:59.377561+0000","last_became_active":"2023-07-06T19:58:52.748873+0000","last_became_peered":"2023-07-06T19:58:52.748873+0000","last_unstale":"2023-07-06T19:58:59.377561+0000","last_undegraded":"2023-07-06T19:58:59.377561+0000","last_fullsized":"2023-07-06T19:58:59.377561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:01:34.409863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376989+0000","last_change":"2023-07-06T19:58:53.750239+0000","last_active":"2023-07-06T19:58:59.376989+0000","last_peered":"2023-07-06T19:58:59.376989+0000","last_clean":"2023-07-06T19:58:59.376989+0000","last_became_active":"2023-07-06T19:58:53.749937+0000","last_became_peered":"2023-07-06T19:58:53.749937+0000","last_unstale":"2023-07-06T19:58:59.376989+0000","last_undegraded":"2023-07-06T19:58:59.376989+0000","last_fullsized":"2023-07-06T19:58:59.376989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:36:41.784617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782718+0000","last_change":"2023-07-06T19:58:57.793838+0000","last_active":"2023-07-06T19:58:58.782718+0000","last_peered":"2023-07-06T19:58:58.782718+0000","last_clean":"2023-07-06T19:58:58.782718+0000","last_became_active":"2023-07-06T19:58:57.790467+0000","last_became_peered":"2023-07-06T19:58:57.790467+0000","last_unstale":"2023-07-06T19:58:58.782718+0000","last_undegraded":"2023-07-06T19:58:58.782718+0000","last_fullsized":"2023-07-06T19:58:58.782718+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:58:24.336299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378755+0000","last_change":"2023-07-06T19:58:52.745091+0000","last_active":"2023-07-06T19:58:59.378755+0000","last_peered":"2023-07-06T19:58:59.378755+0000","last_clean":"2023-07-06T19:58:59.378755+0000","last_became_active":"2023-07-06T19:58:52.744779+0000","last_became_peered":"2023-07-06T19:58:52.744779+0000","last_unstale":"2023-07-06T19:58:59.378755+0000","last_undegraded":"2023-07-06T19:58:59.378755+0000","last_fullsized":"2023-07-06T19:58:59.378755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:36:40.777030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377012+0000","last_change":"2023-07-06T19:58:53.756293+0000","last_active":"2023-07-06T19:58:59.377012+0000","last_peered":"2023-07-06T19:58:59.377012+0000","last_clean":"2023-07-06T19:58:59.377012+0000","last_became_active":"2023-07-06T19:58:53.750936+0000","last_became_peered":"2023-07-06T19:58:53.750936+0000","last_unstale":"2023-07-06T19:58:59.377012+0000","last_undegraded":"2023-07-06T19:58:59.377012+0000","last_fullsized":"2023-07-06T19:58:59.377012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:37:12.135763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783921+0000","last_change":"2023-07-06T19:58:53.749882+0000","last_active":"2023-07-06T19:58:58.783921+0000","last_peered":"2023-07-06T19:58:58.783921+0000","last_clean":"2023-07-06T19:58:58.783921+0000","last_became_active":"2023-07-06T19:58:53.749571+0000","last_became_peered":"2023-07-06T19:58:53.749571+0000","last_unstale":"2023-07-06T19:58:58.783921+0000","last_undegraded":"2023-07-06T19:58:58.783921+0000","last_fullsized":"2023-07-06T19:58:58.783921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:35:07.767106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377264+0000","last_change":"2023-07-06T19:58:53.761493+0000","last_active":"2023-07-06T19:58:59.377264+0000","last_peered":"2023-07-06T19:58:59.377264+0000","last_clean":"2023-07-06T19:58:59.377264+0000","last_became_active":"2023-07-06T19:58:53.759928+0000","last_became_peered":"2023-07-06T19:58:53.759928+0000","last_unstale":"2023-07-06T19:58:59.377264+0000","last_undegraded":"2023-07-06T19:58:59.377264+0000","last_fullsized":"2023-07-06T19:58:59.377264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:31:43.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378108+0000","last_change":"2023-07-06T19:58:53.756852+0000","last_active":"2023-07-06T19:58:59.378108+0000","last_peered":"2023-07-06T19:58:59.378108+0000","last_clean":"2023-07-06T19:58:59.378108+0000","last_became_active":"2023-07-06T19:58:53.751349+0000","last_became_peered":"2023-07-06T19:58:53.751349+0000","last_unstale":"2023-07-06T19:58:59.378108+0000","last_undegraded":"2023-07-06T19:58:59.378108+0000","last_fullsized":"2023-07-06T19:58:59.378108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:00:07.931135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377953+0000","last_change":"2023-07-06T19:58:53.766577+0000","last_active":"2023-07-06T19:58:59.377953+0000","last_peered":"2023-07-06T19:58:59.377953+0000","last_clean":"2023-07-06T19:58:59.377953+0000","last_became_active":"2023-07-06T19:58:53.766262+0000","last_became_peered":"2023-07-06T19:58:53.766262+0000","last_unstale":"2023-07-06T19:58:59.377953+0000","last_undegraded":"2023-07-06T19:58:59.377953+0000","last_fullsized":"2023-07-06T19:58:59.377953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:37:12.135763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783011+0000","last_change":"2023-07-06T19:58:53.756981+0000","last_active":"2023-07-06T19:58:58.783011+0000","last_peered":"2023-07-06T19:58:58.783011+0000","last_clean":"2023-07-06T19:58:58.783011+0000","last_became_active":"2023-07-06T19:58:53.756728+0000","last_became_peered":"2023-07-06T19:58:53.756728+0000","last_unstale":"2023-07-06T19:58:58.783011+0000","last_undegraded":"2023-07-06T19:58:58.783011+0000","last_fullsized":"2023-07-06T19:58:58.783011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:39:05.600911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":913408,"data_stored":714279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":888832,"data_stored":710851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":123751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T19:59:19.014 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T19:59:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.155+0000 7f83253d7700 1 Processor -- start 2023-07-06T19:59:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.155+0000 7f83253d7700 1 -- start start 2023-07-06T19:59:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.156+0000 7f83253d7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83200cccf0 0x7f83200ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.156+0000 7f83253d7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83200b5850 con 0x7f83200cc8a0 2023-07-06T19:59:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.156+0000 7f83253d7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83200b43a0 con 0x7f832015c700 2023-07-06T19:59:19.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.156+0000 7f83253d7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83200b6490 con 0x7f83200cccf0 2023-07-06T19:59:19.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.156+0000 7f831f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f83200cccf0 0x7f83200ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:19.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.156+0000 7f831e7fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f83200cc8a0 0x7f83200ce660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60068/0 (socket says 172.21.15.6:60068) 2023-07-06T19:59:19.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.156+0000 7f831e7fc700 1 -- 172.21.15.6:0/3751408824 learned_addr learned my addr 172.21.15.6:0/3751408824 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:19.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.156+0000 7f831f7fe700 1 -- 172.21.15.6:0/3751408824 >> v1:172.21.15.40:6789/0 conn(0x7f832015c700 legacy=0x7f83200b38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:19.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.156+0000 7f831f7fe700 1 -- 172.21.15.6:0/3751408824 >> v1:172.21.15.6:6789/0 conn(0x7f83200cc8a0 legacy=0x7f83200ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:19.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.156+0000 7f831f7fe700 1 -- 172.21.15.6:0/3751408824 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83200b5af0 con 0x7f83200cccf0 2023-07-06T19:59:19.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.156+0000 7f831dffb700 1 -- 172.21.15.6:0/3751408824 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781598217 0 0) 0x7f83200b5850 con 0x7f83200cc8a0 2023-07-06T19:59:19.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.156+0000 7f831f7fe700 1 --2- 172.21.15.6:0/3751408824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83200cccf0 0x7f83200ced70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8318009d90 tx=0x7f831800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f5cf3a0a195384 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:19.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.156+0000 7f831dffb700 1 -- 172.21.15.6:0/3751408824 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831800e070 con 0x7f83200cccf0 2023-07-06T19:59:19.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.157+0000 7f831dffb700 1 -- 172.21.15.6:0/3751408824 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831800bb90 con 0x7f83200cccf0 2023-07-06T19:59:19.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.157+0000 7f831dffb700 1 -- 172.21.15.6:0/3751408824 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8318003a20 con 0x7f83200cccf0 2023-07-06T19:59:19.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.157+0000 7f83253d7700 1 -- 172.21.15.6:0/3751408824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83200cccf0 msgr2=0x7f83200ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:19.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.157+0000 7f83253d7700 1 --2- 172.21.15.6:0/3751408824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83200cccf0 0x7f83200ced70 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8318009d90 tx=0x7f831800b330 comp rx=0 tx=0).stop 2023-07-06T19:59:19.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.157+0000 7f83253d7700 1 -- 172.21.15.6:0/3751408824 shutdown_connections 2023-07-06T19:59:19.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.157+0000 7f83253d7700 1 --2- 172.21.15.6:0/3751408824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83200cccf0 0x7f83200ced70 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:19.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.157+0000 7f83253d7700 1 -- 172.21.15.6:0/3751408824 >> 172.21.15.6:0/3751408824 conn(0x7f83200ce1a0 msgr2=0x7f83200d0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:19.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.157+0000 7f83253d7700 1 -- 172.21.15.6:0/3751408824 shutdown_connections 2023-07-06T19:59:19.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.157+0000 7f83253d7700 1 -- 172.21.15.6:0/3751408824 wait complete. 2023-07-06T19:59:19.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.158+0000 7f83253d7700 1 Processor -- start 2023-07-06T19:59:19.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.158+0000 7f83253d7700 1 -- start start 2023-07-06T19:59:19.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.159+0000 7f83253d7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83200cc8a0 0x7f8320149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:19.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.159+0000 7f83253d7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83200cccf0 0x7f83200c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.159+0000 7f83253d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f832015c700 0x7f83201599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.159+0000 7f83253d7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83200c4ad0 con 0x7f832015c700 2023-07-06T19:59:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.159+0000 7f83253d7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83200c6410 con 0x7f83200cccf0 2023-07-06T19:59:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.159+0000 7f83253d7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83200c66f0 con 0x7f83200cc8a0 2023-07-06T19:59:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.159+0000 7f831f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f832015c700 0x7f83201599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.159+0000 7f831f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f832015c700 0x7f83201599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58870/0 (socket says 172.21.15.6:58870) 2023-07-06T19:59:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.159+0000 7f831f7fe700 1 -- 172.21.15.6:0/1883331846 learned_addr learned my addr 172.21.15.6:0/1883331846 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.160+0000 7f831e7fc700 1 --2- 172.21.15.6:0/1883331846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83200cccf0 0x7f83200c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.160+0000 7f831effd700 1 --2- 172.21.15.6:0/1883331846 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83200cc8a0 0x7f8320149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.160+0000 7f831f7fe700 1 -- 172.21.15.6:0/1883331846 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83200cc8a0 msgr2=0x7f8320149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.160+0000 7f831f7fe700 1 --2- 172.21.15.6:0/1883331846 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83200cc8a0 0x7f8320149790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.160+0000 7f831f7fe700 1 -- 172.21.15.6:0/1883331846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83200cccf0 msgr2=0x7f83200c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.160+0000 7f831f7fe700 1 --2- 172.21.15.6:0/1883331846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83200cccf0 0x7f83200c4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.160+0000 7f831f7fe700 1 -- 172.21.15.6:0/1883331846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8318009a70 con 0x7f832015c700 2023-07-06T19:59:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.160+0000 7f831f7fe700 1 --2- 172.21.15.6:0/1883331846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f832015c700 0x7f83201599a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8320072c30 tx=0x7f8318004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.160+0000 7f83077fe700 1 -- 172.21.15.6:0/1883331846 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8318012630 con 0x7f832015c700 2023-07-06T19:59:19.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.160+0000 7f83077fe700 1 -- 172.21.15.6:0/1883331846 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83180127b0 con 0x7f832015c700 2023-07-06T19:59:19.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.160+0000 7f83253d7700 1 -- 172.21.15.6:0/1883331846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83200c69d0 con 0x7f832015c700 2023-07-06T19:59:19.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.160+0000 7f83077fe700 1 -- 172.21.15.6:0/1883331846 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8318012b60 con 0x7f832015c700 2023-07-06T19:59:19.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.160+0000 7f83253d7700 1 -- 172.21.15.6:0/1883331846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83200c4d30 con 0x7f832015c700 2023-07-06T19:59:19.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.161+0000 7f83253d7700 1 -- 172.21.15.6:0/1883331846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83200c4340 con 0x7f832015c700 2023-07-06T19:59:19.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.162+0000 7f83077fe700 1 -- 172.21.15.6:0/1883331846 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8318012cc0 con 0x7f832015c700 2023-07-06T19:59:19.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.162+0000 7f83077fe700 1 --2- 172.21.15.6:0/1883331846 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f830c06ace0 0x7f830c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.162+0000 7f83077fe700 1 -- 172.21.15.6:0/1883331846 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f831808bce0 con 0x7f832015c700 2023-07-06T19:59:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.162+0000 7f831effd700 1 --2- 172.21.15.6:0/1883331846 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f830c06ace0 0x7f830c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.163+0000 7f831effd700 1 --2- 172.21.15.6:0/1883331846 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f830c06ace0 0x7f830c06d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8310003e60 tx=0x7f8310009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.167+0000 7f83077fe700 1 -- 172.21.15.6:0/1883331846 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f831805a5c0 con 0x7f832015c700 2023-07-06T19:59:19.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.362+0000 7f83253d7700 1 -- 172.21.15.6:0/1883331846 --> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f83200c6580 con 0x7f830c06ace0 2023-07-06T19:59:19.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.371+0000 7f83077fe700 1 -- 172.21.15.6:0/1883331846 <== mgr.4110 v2:172.21.15.6:6832/201543369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367366 (secure 0 0 0) 0x7f83200c6580 con 0x7f830c06ace0 2023-07-06T19:59:19.380 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:19.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.375+0000 7f83253d7700 1 -- 172.21.15.6:0/1883331846 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f830c06ace0 msgr2=0x7f830c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:19.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.375+0000 7f83253d7700 1 --2- 172.21.15.6:0/1883331846 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f830c06ace0 0x7f830c06d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8310003e60 tx=0x7f8310009040 comp rx=0 tx=0).stop 2023-07-06T19:59:19.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.375+0000 7f83253d7700 1 -- 172.21.15.6:0/1883331846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f832015c700 msgr2=0x7f83201599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:19.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.375+0000 7f83253d7700 1 --2- 172.21.15.6:0/1883331846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f832015c700 0x7f83201599a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8320072c30 tx=0x7f8318004ad0 comp rx=0 tx=0).stop 2023-07-06T19:59:19.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.375+0000 7f83253d7700 1 -- 172.21.15.6:0/1883331846 shutdown_connections 2023-07-06T19:59:19.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.375+0000 7f83253d7700 1 --2- 172.21.15.6:0/1883331846 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f830c06ace0 0x7f830c06d190 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:19.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.375+0000 7f83253d7700 1 --2- 172.21.15.6:0/1883331846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f832015c700 0x7f83201599a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:19.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.375+0000 7f83253d7700 1 --2- 172.21.15.6:0/1883331846 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f83200cc8a0 0x7f8320149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:19.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.375+0000 7f83253d7700 1 --2- 172.21.15.6:0/1883331846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f83200cccf0 0x7f83200c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:19.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.375+0000 7f83253d7700 1 -- 172.21.15.6:0/1883331846 >> 172.21.15.6:0/1883331846 conn(0x7f83200ce1a0 msgr2=0x7f83200b2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:19.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.376+0000 7f83253d7700 1 -- 172.21.15.6:0/1883331846 shutdown_connections 2023-07-06T19:59:19.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.376+0000 7f83253d7700 1 -- 172.21.15.6:0/1883331846 wait complete. 2023-07-06T19:59:19.386 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-06T19:59:19.389 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2023-07-06T19:59:18.718385+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219112,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755608,"statfs":{"total":773094113280,"available":772869742592,"internally_reserved":0,"allocated":3579904,"data_stored":2149128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003209"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376670+0000","last_change":"2023-07-06T19:58:53.761270+0000","last_active":"2023-07-06T19:58:59.376670+0000","last_peered":"2023-07-06T19:58:59.376670+0000","last_clean":"2023-07-06T19:58:59.376670+0000","last_became_active":"2023-07-06T19:58:53.760980+0000","last_became_peered":"2023-07-06T19:58:53.760980+0000","last_unstale":"2023-07-06T19:58:59.376670+0000","last_undegraded":"2023-07-06T19:58:59.376670+0000","last_fullsized":"2023-07-06T19:58:59.376670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:01:18.056559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782312+0000","last_change":"2023-07-06T19:58:53.753947+0000","last_active":"2023-07-06T19:58:58.782312+0000","last_peered":"2023-07-06T19:58:58.782312+0000","last_clean":"2023-07-06T19:58:58.782312+0000","last_became_active":"2023-07-06T19:58:53.753672+0000","last_became_peered":"2023-07-06T19:58:53.753672+0000","last_unstale":"2023-07-06T19:58:58.782312+0000","last_undegraded":"2023-07-06T19:58:58.782312+0000","last_fullsized":"2023-07-06T19:58:58.782312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:39:21.484949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378490+0000","last_change":"2023-07-06T19:58:53.757466+0000","last_active":"2023-07-06T19:58:59.378490+0000","last_peered":"2023-07-06T19:58:59.378490+0000","last_clean":"2023-07-06T19:58:59.378490+0000","last_became_active":"2023-07-06T19:58:53.757125+0000","last_became_peered":"2023-07-06T19:58:53.757125+0000","last_unstale":"2023-07-06T19:58:59.378490+0000","last_undegraded":"2023-07-06T19:58:59.378490+0000","last_fullsized":"2023-07-06T19:58:59.378490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:52:06.851223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783173+0000","last_change":"2023-07-06T19:58:53.752337+0000","last_active":"2023-07-06T19:58:58.783173+0000","last_peered":"2023-07-06T19:58:58.783173+0000","last_clean":"2023-07-06T19:58:58.783173+0000","last_became_active":"2023-07-06T19:58:53.752006+0000","last_became_peered":"2023-07-06T19:58:53.752006+0000","last_unstale":"2023-07-06T19:58:58.783173+0000","last_undegraded":"2023-07-06T19:58:58.783173+0000","last_fullsized":"2023-07-06T19:58:58.783173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:04:50.697845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378401+0000","last_change":"2023-07-06T19:58:53.761648+0000","last_active":"2023-07-06T19:58:59.378401+0000","last_peered":"2023-07-06T19:58:59.378401+0000","last_clean":"2023-07-06T19:58:59.378401+0000","last_became_active":"2023-07-06T19:58:53.760919+0000","last_became_peered":"2023-07-06T19:58:53.760919+0000","last_unstale":"2023-07-06T19:58:59.378401+0000","last_undegraded":"2023-07-06T19:58:59.378401+0000","last_fullsized":"2023-07-06T19:58:59.378401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:54:30.126613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378278+0000","last_change":"2023-07-06T19:58:53.757513+0000","last_active":"2023-07-06T19:58:59.378278+0000","last_peered":"2023-07-06T19:58:59.378278+0000","last_clean":"2023-07-06T19:58:59.378278+0000","last_became_active":"2023-07-06T19:58:53.757153+0000","last_became_peered":"2023-07-06T19:58:53.757153+0000","last_unstale":"2023-07-06T19:58:59.378278+0000","last_undegraded":"2023-07-06T19:58:59.378278+0000","last_fullsized":"2023-07-06T19:58:59.378278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:08:34.198031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378467+0000","last_change":"2023-07-06T19:58:53.754935+0000","last_active":"2023-07-06T19:58:59.378467+0000","last_peered":"2023-07-06T19:58:59.378467+0000","last_clean":"2023-07-06T19:58:59.378467+0000","last_became_active":"2023-07-06T19:58:53.754471+0000","last_became_peered":"2023-07-06T19:58:53.754471+0000","last_unstale":"2023-07-06T19:58:59.378467+0000","last_undegraded":"2023-07-06T19:58:59.378467+0000","last_fullsized":"2023-07-06T19:58:59.378467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:31:43.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.781819+0000","last_change":"2023-07-06T19:58:53.741003+0000","last_active":"2023-07-06T19:58:58.781819+0000","last_peered":"2023-07-06T19:58:58.781819+0000","last_clean":"2023-07-06T19:58:58.781819+0000","last_became_active":"2023-07-06T19:58:53.740713+0000","last_became_peered":"2023-07-06T19:58:53.740713+0000","last_unstale":"2023-07-06T19:58:58.781819+0000","last_undegraded":"2023-07-06T19:58:58.781819+0000","last_fullsized":"2023-07-06T19:58:58.781819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:39:05.600911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378417+0000","last_change":"2023-07-06T19:58:53.760616+0000","last_active":"2023-07-06T19:58:59.378417+0000","last_peered":"2023-07-06T19:58:59.378417+0000","last_clean":"2023-07-06T19:58:59.378417+0000","last_became_active":"2023-07-06T19:58:53.760325+0000","last_became_peered":"2023-07-06T19:58:53.760325+0000","last_unstale":"2023-07-06T19:58:59.378417+0000","last_undegraded":"2023-07-06T19:58:59.378417+0000","last_fullsized":"2023-07-06T19:58:59.378417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:08:51.828984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782658+0000","last_change":"2023-07-06T19:58:53.755075+0000","last_active":"2023-07-06T19:58:58.782658+0000","last_peered":"2023-07-06T19:58:58.782658+0000","last_clean":"2023-07-06T19:58:58.782658+0000","last_became_active":"2023-07-06T19:58:53.754806+0000","last_became_peered":"2023-07-06T19:58:53.754806+0000","last_unstale":"2023-07-06T19:58:58.782658+0000","last_undegraded":"2023-07-06T19:58:58.782658+0000","last_fullsized":"2023-07-06T19:58:58.782658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:36:41.784617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378084+0000","last_change":"2023-07-06T19:58:53.757287+0000","last_active":"2023-07-06T19:58:59.378084+0000","last_peered":"2023-07-06T19:58:59.378084+0000","last_clean":"2023-07-06T19:58:59.378084+0000","last_became_active":"2023-07-06T19:58:53.756825+0000","last_became_peered":"2023-07-06T19:58:53.756825+0000","last_unstale":"2023-07-06T19:58:59.378084+0000","last_undegraded":"2023-07-06T19:58:59.378084+0000","last_fullsized":"2023-07-06T19:58:59.378084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:32:20.366406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377664+0000","last_change":"2023-07-06T19:58:53.745164+0000","last_active":"2023-07-06T19:58:59.377664+0000","last_peered":"2023-07-06T19:58:59.377664+0000","last_clean":"2023-07-06T19:58:59.377664+0000","last_became_active":"2023-07-06T19:58:53.744861+0000","last_became_peered":"2023-07-06T19:58:53.744861+0000","last_unstale":"2023-07-06T19:58:59.377664+0000","last_undegraded":"2023-07-06T19:58:59.377664+0000","last_fullsized":"2023-07-06T19:58:59.377664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:06:50.770125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377329+0000","last_change":"2023-07-06T19:58:53.766071+0000","last_active":"2023-07-06T19:58:59.377329+0000","last_peered":"2023-07-06T19:58:59.377329+0000","last_clean":"2023-07-06T19:58:59.377329+0000","last_became_active":"2023-07-06T19:58:53.765744+0000","last_became_peered":"2023-07-06T19:58:53.765744+0000","last_unstale":"2023-07-06T19:58:59.377329+0000","last_undegraded":"2023-07-06T19:58:59.377329+0000","last_fullsized":"2023-07-06T19:58:59.377329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:31:39.273909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782018+0000","last_change":"2023-07-06T19:58:53.743381+0000","last_active":"2023-07-06T19:58:58.782018+0000","last_peered":"2023-07-06T19:58:58.782018+0000","last_clean":"2023-07-06T19:58:58.782018+0000","last_became_active":"2023-07-06T19:58:53.743098+0000","last_became_peered":"2023-07-06T19:58:53.743098+0000","last_unstale":"2023-07-06T19:58:58.782018+0000","last_undegraded":"2023-07-06T19:58:58.782018+0000","last_fullsized":"2023-07-06T19:58:58.782018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:00:39.522945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377130+0000","last_change":"2023-07-06T19:58:53.754741+0000","last_active":"2023-07-06T19:58:59.377130+0000","last_peered":"2023-07-06T19:58:59.377130+0000","last_clean":"2023-07-06T19:58:59.377130+0000","last_became_active":"2023-07-06T19:58:53.754089+0000","last_became_peered":"2023-07-06T19:58:53.754089+0000","last_unstale":"2023-07-06T19:58:59.377130+0000","last_undegraded":"2023-07-06T19:58:59.377130+0000","last_fullsized":"2023-07-06T19:58:59.377130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:40:15.607877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377294+0000","last_change":"2023-07-06T19:58:53.758130+0000","last_active":"2023-07-06T19:58:59.377294+0000","last_peered":"2023-07-06T19:58:59.377294+0000","last_clean":"2023-07-06T19:58:59.377294+0000","last_became_active":"2023-07-06T19:58:53.757837+0000","last_became_peered":"2023-07-06T19:58:53.757837+0000","last_unstale":"2023-07-06T19:58:59.377294+0000","last_undegraded":"2023-07-06T19:58:59.377294+0000","last_fullsized":"2023-07-06T19:58:59.377294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:12:08.363104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.379057+0000","last_change":"2023-07-06T19:58:53.760750+0000","last_active":"2023-07-06T19:58:59.379057+0000","last_peered":"2023-07-06T19:58:59.379057+0000","last_clean":"2023-07-06T19:58:59.379057+0000","last_became_active":"2023-07-06T19:58:53.760484+0000","last_became_peered":"2023-07-06T19:58:53.760484+0000","last_unstale":"2023-07-06T19:58:59.379057+0000","last_undegraded":"2023-07-06T19:58:59.379057+0000","last_fullsized":"2023-07-06T19:58:59.379057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:55:10.096543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378425+0000","last_change":"2023-07-06T19:58:53.742270+0000","last_active":"2023-07-06T19:58:59.378425+0000","last_peered":"2023-07-06T19:58:59.378425+0000","last_clean":"2023-07-06T19:58:59.378425+0000","last_became_active":"2023-07-06T19:58:53.741974+0000","last_became_peered":"2023-07-06T19:58:53.741974+0000","last_unstale":"2023-07-06T19:58:59.378425+0000","last_undegraded":"2023-07-06T19:58:59.378425+0000","last_fullsized":"2023-07-06T19:58:59.378425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:49:02.964314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377806+0000","last_change":"2023-07-06T19:58:53.750109+0000","last_active":"2023-07-06T19:58:59.377806+0000","last_peered":"2023-07-06T19:58:59.377806+0000","last_clean":"2023-07-06T19:58:59.377806+0000","last_became_active":"2023-07-06T19:58:53.749826+0000","last_became_peered":"2023-07-06T19:58:53.749826+0000","last_unstale":"2023-07-06T19:58:59.377806+0000","last_undegraded":"2023-07-06T19:58:59.377806+0000","last_fullsized":"2023-07-06T19:58:59.377806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:36:45.949174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378110+0000","last_change":"2023-07-06T19:58:53.757988+0000","last_active":"2023-07-06T19:58:59.378110+0000","last_peered":"2023-07-06T19:58:59.378110+0000","last_clean":"2023-07-06T19:58:59.378110+0000","last_became_active":"2023-07-06T19:58:53.751497+0000","last_became_peered":"2023-07-06T19:58:53.751497+0000","last_unstale":"2023-07-06T19:58:59.378110+0000","last_undegraded":"2023-07-06T19:58:59.378110+0000","last_fullsized":"2023-07-06T19:58:59.378110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:27:11.308820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377168+0000","last_change":"2023-07-06T19:58:53.765678+0000","last_active":"2023-07-06T19:58:59.377168+0000","last_peered":"2023-07-06T19:58:59.377168+0000","last_clean":"2023-07-06T19:58:59.377168+0000","last_became_active":"2023-07-06T19:58:53.765413+0000","last_became_peered":"2023-07-06T19:58:53.765413+0000","last_unstale":"2023-07-06T19:58:59.377168+0000","last_undegraded":"2023-07-06T19:58:59.377168+0000","last_fullsized":"2023-07-06T19:58:59.377168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:47:30.856849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377784+0000","last_change":"2023-07-06T19:58:53.755073+0000","last_active":"2023-07-06T19:58:59.377784+0000","last_peered":"2023-07-06T19:58:59.377784+0000","last_clean":"2023-07-06T19:58:59.377784+0000","last_became_active":"2023-07-06T19:58:53.754882+0000","last_became_peered":"2023-07-06T19:58:53.754882+0000","last_unstale":"2023-07-06T19:58:59.377784+0000","last_undegraded":"2023-07-06T19:58:59.377784+0000","last_fullsized":"2023-07-06T19:58:59.377784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:39:05.600911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377911+0000","last_change":"2023-07-06T19:58:53.758162+0000","last_active":"2023-07-06T19:58:59.377911+0000","last_peered":"2023-07-06T19:58:59.377911+0000","last_clean":"2023-07-06T19:58:59.377911+0000","last_became_active":"2023-07-06T19:58:53.753528+0000","last_became_peered":"2023-07-06T19:58:53.753528+0000","last_unstale":"2023-07-06T19:58:59.377911+0000","last_undegraded":"2023-07-06T19:58:59.377911+0000","last_fullsized":"2023-07-06T19:58:59.377911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:43:37.810101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376985+0000","last_change":"2023-07-06T19:58:53.765139+0000","last_active":"2023-07-06T19:58:59.376985+0000","last_peered":"2023-07-06T19:58:59.376985+0000","last_clean":"2023-07-06T19:58:59.376985+0000","last_became_active":"2023-07-06T19:58:53.764887+0000","last_became_peered":"2023-07-06T19:58:53.764887+0000","last_unstale":"2023-07-06T19:58:59.376985+0000","last_undegraded":"2023-07-06T19:58:59.376985+0000","last_fullsized":"2023-07-06T19:58:59.376985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:06:38.381299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782849+0000","last_change":"2023-07-06T19:58:53.750438+0000","last_active":"2023-07-06T19:58:58.782849+0000","last_peered":"2023-07-06T19:58:58.782849+0000","last_clean":"2023-07-06T19:58:58.782849+0000","last_became_active":"2023-07-06T19:58:53.750169+0000","last_became_peered":"2023-07-06T19:58:53.750169+0000","last_unstale":"2023-07-06T19:58:58.782849+0000","last_undegraded":"2023-07-06T19:58:58.782849+0000","last_fullsized":"2023-07-06T19:58:58.782849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:14:20.481463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783170+0000","last_change":"2023-07-06T19:58:53.741853+0000","last_active":"2023-07-06T19:58:58.783170+0000","last_peered":"2023-07-06T19:58:58.783170+0000","last_clean":"2023-07-06T19:58:58.783170+0000","last_became_active":"2023-07-06T19:58:53.741559+0000","last_became_peered":"2023-07-06T19:58:53.741559+0000","last_unstale":"2023-07-06T19:58:58.783170+0000","last_undegraded":"2023-07-06T19:58:58.783170+0000","last_fullsized":"2023-07-06T19:58:58.783170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:06:38.381299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783184+0000","last_change":"2023-07-06T19:58:53.759862+0000","last_active":"2023-07-06T19:58:58.783184+0000","last_peered":"2023-07-06T19:58:58.783184+0000","last_clean":"2023-07-06T19:58:58.783184+0000","last_became_active":"2023-07-06T19:58:53.758903+0000","last_became_peered":"2023-07-06T19:58:53.758903+0000","last_unstale":"2023-07-06T19:58:58.783184+0000","last_undegraded":"2023-07-06T19:58:58.783184+0000","last_fullsized":"2023-07-06T19:58:58.783184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:31:43.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378789+0000","last_change":"2023-07-06T19:58:57.789865+0000","last_active":"2023-07-06T19:58:59.378789+0000","last_peered":"2023-07-06T19:58:59.378789+0000","last_clean":"2023-07-06T19:58:59.378789+0000","last_became_active":"2023-07-06T19:58:57.788796+0000","last_became_peered":"2023-07-06T19:58:57.788796+0000","last_unstale":"2023-07-06T19:58:59.378789+0000","last_undegraded":"2023-07-06T19:58:59.378789+0000","last_fullsized":"2023-07-06T19:58:59.378789+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:40:09.950829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377817+0000","last_change":"2023-07-06T19:58:52.747722+0000","last_active":"2023-07-06T19:58:59.377817+0000","last_peered":"2023-07-06T19:58:59.377817+0000","last_clean":"2023-07-06T19:58:59.377817+0000","last_became_active":"2023-07-06T19:58:52.747373+0000","last_became_peered":"2023-07-06T19:58:52.747373+0000","last_unstale":"2023-07-06T19:58:59.377817+0000","last_undegraded":"2023-07-06T19:58:59.377817+0000","last_fullsized":"2023-07-06T19:58:59.377817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:52:21.260915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377423+0000","last_change":"2023-07-06T19:58:53.760791+0000","last_active":"2023-07-06T19:58:59.377423+0000","last_peered":"2023-07-06T19:58:59.377423+0000","last_clean":"2023-07-06T19:58:59.377423+0000","last_became_active":"2023-07-06T19:58:53.760496+0000","last_became_peered":"2023-07-06T19:58:53.760496+0000","last_unstale":"2023-07-06T19:58:59.377423+0000","last_undegraded":"2023-07-06T19:58:59.377423+0000","last_fullsized":"2023-07-06T19:58:59.377423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:55:35.512797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783686+0000","last_change":"2023-07-06T19:58:57.791584+0000","last_active":"2023-07-06T19:58:58.783686+0000","last_peered":"2023-07-06T19:58:58.783686+0000","last_clean":"2023-07-06T19:58:58.783686+0000","last_became_active":"2023-07-06T19:58:57.791118+0000","last_became_peered":"2023-07-06T19:58:57.791118+0000","last_unstale":"2023-07-06T19:58:58.783686+0000","last_undegraded":"2023-07-06T19:58:58.783686+0000","last_fullsized":"2023-07-06T19:58:58.783686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:22:47.617986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782223+0000","last_change":"2023-07-06T19:58:52.750959+0000","last_active":"2023-07-06T19:58:58.782223+0000","last_peered":"2023-07-06T19:58:58.782223+0000","last_clean":"2023-07-06T19:58:58.782223+0000","last_became_active":"2023-07-06T19:58:52.750645+0000","last_became_peered":"2023-07-06T19:58:52.750645+0000","last_unstale":"2023-07-06T19:58:58.782223+0000","last_undegraded":"2023-07-06T19:58:58.782223+0000","last_fullsized":"2023-07-06T19:58:58.782223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:56:04.557448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378391+0000","last_change":"2023-07-06T19:58:53.756467+0000","last_active":"2023-07-06T19:58:59.378391+0000","last_peered":"2023-07-06T19:58:59.378391+0000","last_clean":"2023-07-06T19:58:59.378391+0000","last_became_active":"2023-07-06T19:58:53.752938+0000","last_became_peered":"2023-07-06T19:58:53.752938+0000","last_unstale":"2023-07-06T19:58:59.378391+0000","last_undegraded":"2023-07-06T19:58:59.378391+0000","last_fullsized":"2023-07-06T19:58:59.378391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:40:15.607877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378564+0000","last_change":"2023-07-06T19:58:57.790380+0000","last_active":"2023-07-06T19:58:59.378564+0000","last_peered":"2023-07-06T19:58:59.378564+0000","last_clean":"2023-07-06T19:58:59.378564+0000","last_became_active":"2023-07-06T19:58:57.789989+0000","last_became_peered":"2023-07-06T19:58:57.789989+0000","last_unstale":"2023-07-06T19:58:59.378564+0000","last_undegraded":"2023-07-06T19:58:59.378564+0000","last_fullsized":"2023-07-06T19:58:59.378564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:38:28.294697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376778+0000","last_change":"2023-07-06T19:58:52.747131+0000","last_active":"2023-07-06T19:58:59.376778+0000","last_peered":"2023-07-06T19:58:59.376778+0000","last_clean":"2023-07-06T19:58:59.376778+0000","last_became_active":"2023-07-06T19:58:52.746849+0000","last_became_peered":"2023-07-06T19:58:52.746849+0000","last_unstale":"2023-07-06T19:58:59.376778+0000","last_undegraded":"2023-07-06T19:58:59.376778+0000","last_fullsized":"2023-07-06T19:58:59.376778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:38:23.255098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783965+0000","last_change":"2023-07-06T19:58:53.752844+0000","last_active":"2023-07-06T19:58:58.783965+0000","last_peered":"2023-07-06T19:58:58.783965+0000","last_clean":"2023-07-06T19:58:58.783965+0000","last_became_active":"2023-07-06T19:58:53.752535+0000","last_became_peered":"2023-07-06T19:58:53.752535+0000","last_unstale":"2023-07-06T19:58:58.783965+0000","last_undegraded":"2023-07-06T19:58:58.783965+0000","last_fullsized":"2023-07-06T19:58:58.783965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:23:37.838134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783216+0000","last_change":"2023-07-06T19:58:57.797542+0000","last_active":"2023-07-06T19:58:58.783216+0000","last_peered":"2023-07-06T19:58:58.783216+0000","last_clean":"2023-07-06T19:58:58.783216+0000","last_became_active":"2023-07-06T19:58:57.794412+0000","last_became_peered":"2023-07-06T19:58:57.794412+0000","last_unstale":"2023-07-06T19:58:58.783216+0000","last_undegraded":"2023-07-06T19:58:58.783216+0000","last_fullsized":"2023-07-06T19:58:58.783216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:04:41.883822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378545+0000","last_change":"2023-07-06T19:58:52.746045+0000","last_active":"2023-07-06T19:58:59.378545+0000","last_peered":"2023-07-06T19:58:59.378545+0000","last_clean":"2023-07-06T19:58:59.378545+0000","last_became_active":"2023-07-06T19:58:52.745753+0000","last_became_peered":"2023-07-06T19:58:52.745753+0000","last_unstale":"2023-07-06T19:58:59.378545+0000","last_undegraded":"2023-07-06T19:58:59.378545+0000","last_fullsized":"2023-07-06T19:58:59.378545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:39:20.477362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376652+0000","last_change":"2023-07-06T19:58:53.760982+0000","last_active":"2023-07-06T19:58:59.376652+0000","last_peered":"2023-07-06T19:58:59.376652+0000","last_clean":"2023-07-06T19:58:59.376652+0000","last_became_active":"2023-07-06T19:58:53.758282+0000","last_became_peered":"2023-07-06T19:58:53.758282+0000","last_unstale":"2023-07-06T19:58:59.376652+0000","last_undegraded":"2023-07-06T19:58:59.376652+0000","last_fullsized":"2023-07-06T19:58:59.376652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:39:21.484949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376781+0000","last_change":"2023-07-06T19:58:57.790546+0000","last_active":"2023-07-06T19:58:59.376781+0000","last_peered":"2023-07-06T19:58:59.376781+0000","last_clean":"2023-07-06T19:58:59.376781+0000","last_became_active":"2023-07-06T19:58:57.790151+0000","last_became_peered":"2023-07-06T19:58:57.790151+0000","last_unstale":"2023-07-06T19:58:59.376781+0000","last_undegraded":"2023-07-06T19:58:59.376781+0000","last_fullsized":"2023-07-06T19:58:59.376781+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:07.546083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782508+0000","last_change":"2023-07-06T19:58:52.746111+0000","last_active":"2023-07-06T19:58:58.782508+0000","last_peered":"2023-07-06T19:58:58.782508+0000","last_clean":"2023-07-06T19:58:58.782508+0000","last_became_active":"2023-07-06T19:58:52.745886+0000","last_became_peered":"2023-07-06T19:58:52.745886+0000","last_unstale":"2023-07-06T19:58:58.782508+0000","last_undegraded":"2023-07-06T19:58:58.782508+0000","last_fullsized":"2023-07-06T19:58:58.782508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:38:23.255098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376789+0000","last_change":"2023-07-06T19:58:53.748570+0000","last_active":"2023-07-06T19:58:59.376789+0000","last_peered":"2023-07-06T19:58:59.376789+0000","last_clean":"2023-07-06T19:58:59.376789+0000","last_became_active":"2023-07-06T19:58:53.748044+0000","last_became_peered":"2023-07-06T19:58:53.748044+0000","last_unstale":"2023-07-06T19:58:59.376789+0000","last_undegraded":"2023-07-06T19:58:59.376789+0000","last_fullsized":"2023-07-06T19:58:59.376789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:01:56.605555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377868+0000","last_change":"2023-07-06T19:58:57.786412+0000","last_active":"2023-07-06T19:58:59.377868+0000","last_peered":"2023-07-06T19:58:59.377868+0000","last_clean":"2023-07-06T19:58:59.377868+0000","last_became_active":"2023-07-06T19:58:57.785979+0000","last_became_peered":"2023-07-06T19:58:57.785979+0000","last_unstale":"2023-07-06T19:58:59.377868+0000","last_undegraded":"2023-07-06T19:58:59.377868+0000","last_fullsized":"2023-07-06T19:58:59.377868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:34:38.161520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378178+0000","last_change":"2023-07-06T19:58:52.751370+0000","last_active":"2023-07-06T19:58:59.378178+0000","last_peered":"2023-07-06T19:58:59.378178+0000","last_clean":"2023-07-06T19:58:59.378178+0000","last_became_active":"2023-07-06T19:58:52.750871+0000","last_became_peered":"2023-07-06T19:58:52.750871+0000","last_unstale":"2023-07-06T19:58:59.378178+0000","last_undegraded":"2023-07-06T19:58:59.378178+0000","last_fullsized":"2023-07-06T19:58:59.378178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:54:29.119026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783170+0000","last_change":"2023-07-06T19:58:53.749382+0000","last_active":"2023-07-06T19:58:58.783170+0000","last_peered":"2023-07-06T19:58:58.783170+0000","last_clean":"2023-07-06T19:58:58.783170+0000","last_became_active":"2023-07-06T19:58:53.749102+0000","last_became_peered":"2023-07-06T19:58:53.749102+0000","last_unstale":"2023-07-06T19:58:58.783170+0000","last_undegraded":"2023-07-06T19:58:58.783170+0000","last_fullsized":"2023-07-06T19:58:58.783170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:00:39.522945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782423+0000","last_change":"2023-07-06T19:58:57.788620+0000","last_active":"2023-07-06T19:58:58.782423+0000","last_peered":"2023-07-06T19:58:58.782423+0000","last_clean":"2023-07-06T19:58:58.782423+0000","last_became_active":"2023-07-06T19:58:57.788179+0000","last_became_peered":"2023-07-06T19:58:57.788179+0000","last_unstale":"2023-07-06T19:58:58.782423+0000","last_undegraded":"2023-07-06T19:58:58.782423+0000","last_fullsized":"2023-07-06T19:58:58.782423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:26:32.189069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:59:09.287689+0000","last_change":"2023-07-06T19:58:52.742265+0000","last_active":"2023-07-06T19:59:09.287689+0000","last_peered":"2023-07-06T19:59:09.287689+0000","last_clean":"2023-07-06T19:59:09.287689+0000","last_became_active":"2023-07-06T19:58:52.741835+0000","last_became_peered":"2023-07-06T19:58:52.741835+0000","last_unstale":"2023-07-06T19:59:09.287689+0000","last_undegraded":"2023-07-06T19:59:09.287689+0000","last_fullsized":"2023-07-06T19:59:09.287689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:02:15.845300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378090+0000","last_change":"2023-07-06T19:58:53.751100+0000","last_active":"2023-07-06T19:58:59.378090+0000","last_peered":"2023-07-06T19:58:59.378090+0000","last_clean":"2023-07-06T19:58:59.378090+0000","last_became_active":"2023-07-06T19:58:53.750777+0000","last_became_peered":"2023-07-06T19:58:53.750777+0000","last_unstale":"2023-07-06T19:58:59.378090+0000","last_undegraded":"2023-07-06T19:58:59.378090+0000","last_fullsized":"2023-07-06T19:58:59.378090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:34:07.170685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783447+0000","last_change":"2023-07-06T19:58:57.787972+0000","last_active":"2023-07-06T19:58:58.783447+0000","last_peered":"2023-07-06T19:58:58.783447+0000","last_clean":"2023-07-06T19:58:58.783447+0000","last_became_active":"2023-07-06T19:58:57.787603+0000","last_became_peered":"2023-07-06T19:58:57.787603+0000","last_unstale":"2023-07-06T19:58:58.783447+0000","last_undegraded":"2023-07-06T19:58:58.783447+0000","last_fullsized":"2023-07-06T19:58:58.783447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:55:39.544808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377410+0000","last_change":"2023-07-06T19:58:52.749256+0000","last_active":"2023-07-06T19:58:59.377410+0000","last_peered":"2023-07-06T19:58:59.377410+0000","last_clean":"2023-07-06T19:58:59.377410+0000","last_became_active":"2023-07-06T19:58:52.748938+0000","last_became_peered":"2023-07-06T19:58:52.748938+0000","last_unstale":"2023-07-06T19:58:59.377410+0000","last_undegraded":"2023-07-06T19:58:59.377410+0000","last_fullsized":"2023-07-06T19:58:59.377410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:38:23.255098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377106+0000","last_change":"2023-07-06T19:58:53.760190+0000","last_active":"2023-07-06T19:58:59.377106+0000","last_peered":"2023-07-06T19:58:59.377106+0000","last_clean":"2023-07-06T19:58:59.377106+0000","last_became_active":"2023-07-06T19:58:53.758351+0000","last_became_peered":"2023-07-06T19:58:53.758351+0000","last_unstale":"2023-07-06T19:58:59.377106+0000","last_undegraded":"2023-07-06T19:58:59.377106+0000","last_fullsized":"2023-07-06T19:58:59.377106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:54:30.126613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376773+0000","last_change":"2023-07-06T19:58:57.787323+0000","last_active":"2023-07-06T19:58:59.376773+0000","last_peered":"2023-07-06T19:58:59.376773+0000","last_clean":"2023-07-06T19:58:59.376773+0000","last_became_active":"2023-07-06T19:58:57.786685+0000","last_became_peered":"2023-07-06T19:58:57.786685+0000","last_unstale":"2023-07-06T19:58:59.376773+0000","last_undegraded":"2023-07-06T19:58:59.376773+0000","last_fullsized":"2023-07-06T19:58:59.376773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:31:48.633170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377567+0000","last_change":"2023-07-06T19:58:52.746786+0000","last_active":"2023-07-06T19:58:59.377567+0000","last_peered":"2023-07-06T19:58:59.377567+0000","last_clean":"2023-07-06T19:58:59.377567+0000","last_became_active":"2023-07-06T19:58:52.746457+0000","last_became_peered":"2023-07-06T19:58:52.746457+0000","last_unstale":"2023-07-06T19:58:59.377567+0000","last_undegraded":"2023-07-06T19:58:59.377567+0000","last_fullsized":"2023-07-06T19:58:59.377567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:06.187998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782712+0000","last_change":"2023-07-06T19:58:53.760059+0000","last_active":"2023-07-06T19:58:58.782712+0000","last_peered":"2023-07-06T19:58:58.782712+0000","last_clean":"2023-07-06T19:58:58.782712+0000","last_became_active":"2023-07-06T19:58:53.759271+0000","last_became_peered":"2023-07-06T19:58:53.759271+0000","last_unstale":"2023-07-06T19:58:58.782712+0000","last_undegraded":"2023-07-06T19:58:58.782712+0000","last_fullsized":"2023-07-06T19:58:58.782712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:54:30.126613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376813+0000","last_change":"2023-07-06T19:58:57.786715+0000","last_active":"2023-07-06T19:58:59.376813+0000","last_peered":"2023-07-06T19:58:59.376813+0000","last_clean":"2023-07-06T19:58:59.376813+0000","last_became_active":"2023-07-06T19:58:57.786187+0000","last_became_peered":"2023-07-06T19:58:57.786187+0000","last_unstale":"2023-07-06T19:58:59.376813+0000","last_undegraded":"2023-07-06T19:58:59.376813+0000","last_fullsized":"2023-07-06T19:58:59.376813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:41:58.726961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377292+0000","last_change":"2023-07-06T19:58:52.751844+0000","last_active":"2023-07-06T19:58:59.377292+0000","last_peered":"2023-07-06T19:58:59.377292+0000","last_clean":"2023-07-06T19:58:59.377292+0000","last_became_active":"2023-07-06T19:58:52.751507+0000","last_became_peered":"2023-07-06T19:58:52.751507+0000","last_unstale":"2023-07-06T19:58:59.377292+0000","last_undegraded":"2023-07-06T19:58:59.377292+0000","last_fullsized":"2023-07-06T19:58:59.377292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:39:20.477362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378484+0000","last_change":"2023-07-06T19:58:53.760239+0000","last_active":"2023-07-06T19:58:59.378484+0000","last_peered":"2023-07-06T19:58:59.378484+0000","last_clean":"2023-07-06T19:58:59.378484+0000","last_became_active":"2023-07-06T19:58:53.759987+0000","last_became_peered":"2023-07-06T19:58:53.759987+0000","last_unstale":"2023-07-06T19:58:59.378484+0000","last_undegraded":"2023-07-06T19:58:59.378484+0000","last_fullsized":"2023-07-06T19:58:59.378484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:47:30.856849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782048+0000","last_change":"2023-07-06T19:58:57.791677+0000","last_active":"2023-07-06T19:58:58.782048+0000","last_peered":"2023-07-06T19:58:58.782048+0000","last_clean":"2023-07-06T19:58:58.782048+0000","last_became_active":"2023-07-06T19:58:57.791232+0000","last_became_peered":"2023-07-06T19:58:57.791232+0000","last_unstale":"2023-07-06T19:58:58.782048+0000","last_undegraded":"2023-07-06T19:58:58.782048+0000","last_fullsized":"2023-07-06T19:58:58.782048+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:06:42.413310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783606+0000","last_change":"2023-07-06T19:58:52.743480+0000","last_active":"2023-07-06T19:58:58.783606+0000","last_peered":"2023-07-06T19:58:58.783606+0000","last_clean":"2023-07-06T19:58:58.783606+0000","last_became_active":"2023-07-06T19:58:52.742980+0000","last_became_peered":"2023-07-06T19:58:52.742980+0000","last_unstale":"2023-07-06T19:58:58.783606+0000","last_undegraded":"2023-07-06T19:58:58.783606+0000","last_fullsized":"2023-07-06T19:58:58.783606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:30:09.417733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377140+0000","last_change":"2023-07-06T19:58:53.760648+0000","last_active":"2023-07-06T19:58:59.377140+0000","last_peered":"2023-07-06T19:58:59.377140+0000","last_clean":"2023-07-06T19:58:59.377140+0000","last_became_active":"2023-07-06T19:58:53.760334+0000","last_became_peered":"2023-07-06T19:58:53.760334+0000","last_unstale":"2023-07-06T19:58:59.377140+0000","last_undegraded":"2023-07-06T19:58:59.377140+0000","last_fullsized":"2023-07-06T19:58:59.377140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:55:10.096543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378635+0000","last_change":"2023-07-06T19:58:57.795273+0000","last_active":"2023-07-06T19:58:59.378635+0000","last_peered":"2023-07-06T19:58:59.378635+0000","last_clean":"2023-07-06T19:58:59.378635+0000","last_became_active":"2023-07-06T19:58:57.793041+0000","last_became_peered":"2023-07-06T19:58:57.793041+0000","last_unstale":"2023-07-06T19:58:59.378635+0000","last_undegraded":"2023-07-06T19:58:59.378635+0000","last_fullsized":"2023-07-06T19:58:59.378635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:55:39.544808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377951+0000","last_change":"2023-07-06T19:58:52.749389+0000","last_active":"2023-07-06T19:58:59.377951+0000","last_peered":"2023-07-06T19:58:59.377951+0000","last_clean":"2023-07-06T19:58:59.377951+0000","last_became_active":"2023-07-06T19:58:52.748954+0000","last_became_peered":"2023-07-06T19:58:52.748954+0000","last_unstale":"2023-07-06T19:58:59.377951+0000","last_undegraded":"2023-07-06T19:58:59.377951+0000","last_fullsized":"2023-07-06T19:58:59.377951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:36:40.777030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.781709+0000","last_change":"2023-07-06T19:58:53.750314+0000","last_active":"2023-07-06T19:58:58.781709+0000","last_peered":"2023-07-06T19:58:58.781709+0000","last_clean":"2023-07-06T19:58:58.781709+0000","last_became_active":"2023-07-06T19:58:53.750016+0000","last_became_peered":"2023-07-06T19:58:53.750016+0000","last_unstale":"2023-07-06T19:58:58.781709+0000","last_undegraded":"2023-07-06T19:58:58.781709+0000","last_fullsized":"2023-07-06T19:58:58.781709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:07.195585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376267+0000","last_change":"2023-07-06T19:58:57.783293+0000","last_active":"2023-07-06T19:58:59.376267+0000","last_peered":"2023-07-06T19:58:59.376267+0000","last_clean":"2023-07-06T19:58:59.376267+0000","last_became_active":"2023-07-06T19:58:57.782891+0000","last_became_peered":"2023-07-06T19:58:57.782891+0000","last_unstale":"2023-07-06T19:58:59.376267+0000","last_undegraded":"2023-07-06T19:58:59.376267+0000","last_fullsized":"2023-07-06T19:58:59.376267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:46:14.072294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377762+0000","last_change":"2023-07-06T19:58:52.749788+0000","last_active":"2023-07-06T19:58:59.377762+0000","last_peered":"2023-07-06T19:58:59.377762+0000","last_clean":"2023-07-06T19:58:59.377762+0000","last_became_active":"2023-07-06T19:58:52.749502+0000","last_became_peered":"2023-07-06T19:58:52.749502+0000","last_unstale":"2023-07-06T19:58:59.377762+0000","last_undegraded":"2023-07-06T19:58:59.377762+0000","last_fullsized":"2023-07-06T19:58:59.377762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:41:53.687362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377616+0000","last_change":"2023-07-06T19:58:53.756711+0000","last_active":"2023-07-06T19:58:59.377616+0000","last_peered":"2023-07-06T19:58:59.377616+0000","last_clean":"2023-07-06T19:58:59.377616+0000","last_became_active":"2023-07-06T19:58:53.756385+0000","last_became_peered":"2023-07-06T19:58:53.756385+0000","last_unstale":"2023-07-06T19:58:59.377616+0000","last_undegraded":"2023-07-06T19:58:59.377616+0000","last_fullsized":"2023-07-06T19:58:59.377616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:14:07.791583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377139+0000","last_change":"2023-07-06T19:58:57.786660+0000","last_active":"2023-07-06T19:58:59.377139+0000","last_peered":"2023-07-06T19:58:59.377139+0000","last_clean":"2023-07-06T19:58:59.377139+0000","last_became_active":"2023-07-06T19:58:57.786238+0000","last_became_peered":"2023-07-06T19:58:57.786238+0000","last_unstale":"2023-07-06T19:58:59.377139+0000","last_undegraded":"2023-07-06T19:58:59.377139+0000","last_fullsized":"2023-07-06T19:58:59.377139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:47:26.705198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378304+0000","last_change":"2023-07-06T19:58:52.751151+0000","last_active":"2023-07-06T19:58:59.378304+0000","last_peered":"2023-07-06T19:58:59.378304+0000","last_clean":"2023-07-06T19:58:59.378304+0000","last_became_active":"2023-07-06T19:58:52.750499+0000","last_became_peered":"2023-07-06T19:58:52.750499+0000","last_unstale":"2023-07-06T19:58:59.378304+0000","last_undegraded":"2023-07-06T19:58:59.378304+0000","last_fullsized":"2023-07-06T19:58:59.378304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:55:09.088956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783436+0000","last_change":"2023-07-06T19:58:53.755226+0000","last_active":"2023-07-06T19:58:58.783436+0000","last_peered":"2023-07-06T19:58:58.783436+0000","last_clean":"2023-07-06T19:58:58.783436+0000","last_became_active":"2023-07-06T19:58:53.754917+0000","last_became_peered":"2023-07-06T19:58:53.754917+0000","last_unstale":"2023-07-06T19:58:58.783436+0000","last_undegraded":"2023-07-06T19:58:58.783436+0000","last_fullsized":"2023-07-06T19:58:58.783436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:32:21.594143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376977+0000","last_change":"2023-07-06T19:58:57.788481+0000","last_active":"2023-07-06T19:58:59.376977+0000","last_peered":"2023-07-06T19:58:59.376977+0000","last_clean":"2023-07-06T19:58:59.376977+0000","last_became_active":"2023-07-06T19:58:57.788042+0000","last_became_peered":"2023-07-06T19:58:57.788042+0000","last_unstale":"2023-07-06T19:58:59.376977+0000","last_undegraded":"2023-07-06T19:58:59.376977+0000","last_fullsized":"2023-07-06T19:58:59.376977+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:12:56.591390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782017+0000","last_change":"2023-07-06T19:58:52.752037+0000","last_active":"2023-07-06T19:58:58.782017+0000","last_peered":"2023-07-06T19:58:58.782017+0000","last_clean":"2023-07-06T19:58:58.782017+0000","last_became_active":"2023-07-06T19:58:52.751743+0000","last_became_peered":"2023-07-06T19:58:52.751743+0000","last_unstale":"2023-07-06T19:58:58.782017+0000","last_undegraded":"2023-07-06T19:58:58.782017+0000","last_fullsized":"2023-07-06T19:58:58.782017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:02.506485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378860+0000","last_change":"2023-07-06T19:58:53.756515+0000","last_active":"2023-07-06T19:58:59.378860+0000","last_peered":"2023-07-06T19:58:59.378860+0000","last_clean":"2023-07-06T19:58:59.378860+0000","last_became_active":"2023-07-06T19:58:53.756160+0000","last_became_peered":"2023-07-06T19:58:53.756160+0000","last_unstale":"2023-07-06T19:58:59.378860+0000","last_undegraded":"2023-07-06T19:58:59.378860+0000","last_fullsized":"2023-07-06T19:58:59.378860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:09:50.298552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376553+0000","last_change":"2023-07-06T19:58:57.791364+0000","last_active":"2023-07-06T19:58:59.376553+0000","last_peered":"2023-07-06T19:58:59.376553+0000","last_clean":"2023-07-06T19:58:59.376553+0000","last_became_active":"2023-07-06T19:58:57.789062+0000","last_became_peered":"2023-07-06T19:58:57.789062+0000","last_unstale":"2023-07-06T19:58:59.376553+0000","last_undegraded":"2023-07-06T19:58:59.376553+0000","last_fullsized":"2023-07-06T19:58:59.376553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:06:20.866793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377550+0000","last_change":"2023-07-06T19:58:52.747602+0000","last_active":"2023-07-06T19:58:59.377550+0000","last_peered":"2023-07-06T19:58:59.377550+0000","last_clean":"2023-07-06T19:58:59.377550+0000","last_became_active":"2023-07-06T19:58:52.747306+0000","last_became_peered":"2023-07-06T19:58:52.747306+0000","last_unstale":"2023-07-06T19:58:59.377550+0000","last_undegraded":"2023-07-06T19:58:59.377550+0000","last_fullsized":"2023-07-06T19:58:59.377550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:46:23.956146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377454+0000","last_change":"2023-07-06T19:58:53.760870+0000","last_active":"2023-07-06T19:58:59.377454+0000","last_peered":"2023-07-06T19:58:59.377454+0000","last_clean":"2023-07-06T19:58:59.377454+0000","last_became_active":"2023-07-06T19:58:53.760583+0000","last_became_peered":"2023-07-06T19:58:53.760583+0000","last_unstale":"2023-07-06T19:58:59.377454+0000","last_undegraded":"2023-07-06T19:58:59.377454+0000","last_fullsized":"2023-07-06T19:58:59.377454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:36:39.721385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782589+0000","last_change":"2023-07-06T19:58:57.794470+0000","last_active":"2023-07-06T19:58:58.782589+0000","last_peered":"2023-07-06T19:58:58.782589+0000","last_clean":"2023-07-06T19:58:58.782589+0000","last_became_active":"2023-07-06T19:58:57.793975+0000","last_became_peered":"2023-07-06T19:58:57.793975+0000","last_unstale":"2023-07-06T19:58:58.782589+0000","last_undegraded":"2023-07-06T19:58:58.782589+0000","last_fullsized":"2023-07-06T19:58:58.782589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:28:54.247015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783537+0000","last_change":"2023-07-06T19:58:52.740315+0000","last_active":"2023-07-06T19:58:58.783537+0000","last_peered":"2023-07-06T19:58:58.783537+0000","last_clean":"2023-07-06T19:58:58.783537+0000","last_became_active":"2023-07-06T19:58:52.739933+0000","last_became_peered":"2023-07-06T19:58:52.739933+0000","last_unstale":"2023-07-06T19:58:58.783537+0000","last_undegraded":"2023-07-06T19:58:58.783537+0000","last_fullsized":"2023-07-06T19:58:58.783537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:49:50.590705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378294+0000","last_change":"2023-07-06T19:58:53.741928+0000","last_active":"2023-07-06T19:58:59.378294+0000","last_peered":"2023-07-06T19:58:59.378294+0000","last_clean":"2023-07-06T19:58:59.378294+0000","last_became_active":"2023-07-06T19:58:53.741625+0000","last_became_peered":"2023-07-06T19:58:53.741625+0000","last_unstale":"2023-07-06T19:58:59.378294+0000","last_undegraded":"2023-07-06T19:58:59.378294+0000","last_fullsized":"2023-07-06T19:58:59.378294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:10:07.041452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782705+0000","last_change":"2023-07-06T19:58:57.792062+0000","last_active":"2023-07-06T19:58:58.782705+0000","last_peered":"2023-07-06T19:58:58.782705+0000","last_clean":"2023-07-06T19:58:58.782705+0000","last_became_active":"2023-07-06T19:58:57.791281+0000","last_became_peered":"2023-07-06T19:58:57.791281+0000","last_unstale":"2023-07-06T19:58:58.782705+0000","last_undegraded":"2023-07-06T19:58:58.782705+0000","last_fullsized":"2023-07-06T19:58:58.782705+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:55:14.128554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377292+0000","last_change":"2023-07-06T19:58:52.747562+0000","last_active":"2023-07-06T19:58:59.377292+0000","last_peered":"2023-07-06T19:58:59.377292+0000","last_clean":"2023-07-06T19:58:59.377292+0000","last_became_active":"2023-07-06T19:58:52.747229+0000","last_became_peered":"2023-07-06T19:58:52.747229+0000","last_unstale":"2023-07-06T19:58:59.377292+0000","last_undegraded":"2023-07-06T19:58:59.377292+0000","last_fullsized":"2023-07-06T19:58:59.377292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:04:30.618240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378608+0000","last_change":"2023-07-06T19:58:53.756720+0000","last_active":"2023-07-06T19:58:59.378608+0000","last_peered":"2023-07-06T19:58:59.378608+0000","last_clean":"2023-07-06T19:58:59.378608+0000","last_became_active":"2023-07-06T19:58:53.756402+0000","last_became_peered":"2023-07-06T19:58:53.756402+0000","last_unstale":"2023-07-06T19:58:59.378608+0000","last_undegraded":"2023-07-06T19:58:59.378608+0000","last_fullsized":"2023-07-06T19:58:59.378608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:26:00.900208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378351+0000","last_change":"2023-07-06T19:58:57.783465+0000","last_active":"2023-07-06T19:58:59.378351+0000","last_peered":"2023-07-06T19:58:59.378351+0000","last_clean":"2023-07-06T19:58:59.378351+0000","last_became_active":"2023-07-06T19:58:57.782790+0000","last_became_peered":"2023-07-06T19:58:57.782790+0000","last_unstale":"2023-07-06T19:58:59.378351+0000","last_undegraded":"2023-07-06T19:58:59.378351+0000","last_fullsized":"2023-07-06T19:58:59.378351+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:43:02.955936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376589+0000","last_change":"2023-07-06T19:58:52.749725+0000","last_active":"2023-07-06T19:58:59.376589+0000","last_peered":"2023-07-06T19:58:59.376589+0000","last_clean":"2023-07-06T19:58:59.376589+0000","last_became_active":"2023-07-06T19:58:52.749426+0000","last_became_peered":"2023-07-06T19:58:52.749426+0000","last_unstale":"2023-07-06T19:58:59.376589+0000","last_undegraded":"2023-07-06T19:58:59.376589+0000","last_fullsized":"2023-07-06T19:58:59.376589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:08:50.821397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783208+0000","last_change":"2023-07-06T19:58:53.759474+0000","last_active":"2023-07-06T19:58:58.783208+0000","last_peered":"2023-07-06T19:58:58.783208+0000","last_clean":"2023-07-06T19:58:58.783208+0000","last_became_active":"2023-07-06T19:58:53.759191+0000","last_became_peered":"2023-07-06T19:58:53.759191+0000","last_unstale":"2023-07-06T19:58:58.783208+0000","last_undegraded":"2023-07-06T19:58:58.783208+0000","last_fullsized":"2023-07-06T19:58:58.783208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:40:15.607877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378239+0000","last_change":"2023-07-06T19:58:57.787350+0000","last_active":"2023-07-06T19:58:59.378239+0000","last_peered":"2023-07-06T19:58:59.378239+0000","last_clean":"2023-07-06T19:58:59.378239+0000","last_became_active":"2023-07-06T19:58:57.786760+0000","last_became_peered":"2023-07-06T19:58:57.786760+0000","last_unstale":"2023-07-06T19:58:59.378239+0000","last_undegraded":"2023-07-06T19:58:59.378239+0000","last_fullsized":"2023-07-06T19:58:59.378239+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:07.546083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782756+0000","last_change":"2023-07-06T19:58:47.723855+0000","last_active":"2023-07-06T19:58:58.782756+0000","last_peered":"2023-07-06T19:58:58.782756+0000","last_clean":"2023-07-06T19:58:58.782756+0000","last_became_active":"2023-07-06T19:58:47.723553+0000","last_became_peered":"2023-07-06T19:58:47.723553+0000","last_unstale":"2023-07-06T19:58:58.782756+0000","last_undegraded":"2023-07-06T19:58:58.782756+0000","last_fullsized":"2023-07-06T19:58:58.782756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:00:46.116158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782566+0000","last_change":"2023-07-06T19:58:52.751410+0000","last_active":"2023-07-06T19:58:58.782566+0000","last_peered":"2023-07-06T19:58:58.782566+0000","last_clean":"2023-07-06T19:58:58.782566+0000","last_became_active":"2023-07-06T19:58:52.751112+0000","last_became_peered":"2023-07-06T19:58:52.751112+0000","last_unstale":"2023-07-06T19:58:58.782566+0000","last_undegraded":"2023-07-06T19:58:58.782566+0000","last_fullsized":"2023-07-06T19:58:58.782566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:01:55.597968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782915+0000","last_change":"2023-07-06T19:58:53.749897+0000","last_active":"2023-07-06T19:58:58.782915+0000","last_peered":"2023-07-06T19:58:58.782915+0000","last_clean":"2023-07-06T19:58:58.782915+0000","last_became_active":"2023-07-06T19:58:53.749624+0000","last_became_peered":"2023-07-06T19:58:53.749624+0000","last_unstale":"2023-07-06T19:58:58.782915+0000","last_undegraded":"2023-07-06T19:58:58.782915+0000","last_fullsized":"2023-07-06T19:58:58.782915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:15:46.167902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378551+0000","last_change":"2023-07-06T19:58:57.789358+0000","last_active":"2023-07-06T19:58:59.378551+0000","last_peered":"2023-07-06T19:58:59.378551+0000","last_clean":"2023-07-06T19:58:59.378551+0000","last_became_active":"2023-07-06T19:58:57.788645+0000","last_became_peered":"2023-07-06T19:58:57.788645+0000","last_unstale":"2023-07-06T19:58:59.378551+0000","last_undegraded":"2023-07-06T19:58:59.378551+0000","last_fullsized":"2023-07-06T19:58:59.378551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:31:48.633170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782612+0000","last_change":"2023-07-06T19:58:47.705294+0000","last_active":"2023-07-06T19:58:58.782612+0000","last_peered":"2023-07-06T19:58:58.782612+0000","last_clean":"2023-07-06T19:58:58.782612+0000","last_became_active":"2023-07-06T19:58:47.704921+0000","last_became_peered":"2023-07-06T19:58:47.704921+0000","last_unstale":"2023-07-06T19:58:58.782612+0000","last_undegraded":"2023-07-06T19:58:58.782612+0000","last_fullsized":"2023-07-06T19:58:58.782612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:41:48.663962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378365+0000","last_change":"2023-07-06T19:58:52.748067+0000","last_active":"2023-07-06T19:58:59.378365+0000","last_peered":"2023-07-06T19:58:59.378365+0000","last_clean":"2023-07-06T19:58:59.378365+0000","last_became_active":"2023-07-06T19:58:52.747728+0000","last_became_peered":"2023-07-06T19:58:52.747728+0000","last_unstale":"2023-07-06T19:58:59.378365+0000","last_undegraded":"2023-07-06T19:58:59.378365+0000","last_fullsized":"2023-07-06T19:58:59.378365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:22:44.301281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782686+0000","last_change":"2023-07-06T19:58:53.742174+0000","last_active":"2023-07-06T19:58:58.782686+0000","last_peered":"2023-07-06T19:58:58.782686+0000","last_clean":"2023-07-06T19:58:58.782686+0000","last_became_active":"2023-07-06T19:58:53.741231+0000","last_became_peered":"2023-07-06T19:58:53.741231+0000","last_unstale":"2023-07-06T19:58:58.782686+0000","last_undegraded":"2023-07-06T19:58:58.782686+0000","last_fullsized":"2023-07-06T19:58:58.782686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:27:23.271688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376951+0000","last_change":"2023-07-06T19:58:57.785326+0000","last_active":"2023-07-06T19:58:59.376951+0000","last_peered":"2023-07-06T19:58:59.376951+0000","last_clean":"2023-07-06T19:58:59.376951+0000","last_became_active":"2023-07-06T19:58:57.784907+0000","last_became_peered":"2023-07-06T19:58:57.784907+0000","last_unstale":"2023-07-06T19:58:59.376951+0000","last_undegraded":"2023-07-06T19:58:59.376951+0000","last_fullsized":"2023-07-06T19:58:59.376951+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:19:07.540692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376590+0000","last_change":"2023-07-06T19:58:47.766992+0000","last_active":"2023-07-06T19:58:59.376590+0000","last_peered":"2023-07-06T19:58:59.376590+0000","last_clean":"2023-07-06T19:58:59.376590+0000","last_became_active":"2023-07-06T19:58:47.766697+0000","last_became_peered":"2023-07-06T19:58:47.766697+0000","last_unstale":"2023-07-06T19:58:59.376590+0000","last_undegraded":"2023-07-06T19:58:59.376590+0000","last_fullsized":"2023-07-06T19:58:59.376590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:44:05.260069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782473+0000","last_change":"2023-07-06T19:58:52.747039+0000","last_active":"2023-07-06T19:58:58.782473+0000","last_peered":"2023-07-06T19:58:58.782473+0000","last_clean":"2023-07-06T19:58:58.782473+0000","last_became_active":"2023-07-06T19:58:52.746770+0000","last_became_peered":"2023-07-06T19:58:52.746770+0000","last_unstale":"2023-07-06T19:58:58.782473+0000","last_undegraded":"2023-07-06T19:58:58.782473+0000","last_fullsized":"2023-07-06T19:58:58.782473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:34:28.429392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783138+0000","last_change":"2023-07-06T19:58:53.745314+0000","last_active":"2023-07-06T19:58:58.783138+0000","last_peered":"2023-07-06T19:58:58.783138+0000","last_clean":"2023-07-06T19:58:58.783138+0000","last_became_active":"2023-07-06T19:58:53.744843+0000","last_became_peered":"2023-07-06T19:58:53.744843+0000","last_unstale":"2023-07-06T19:58:58.783138+0000","last_undegraded":"2023-07-06T19:58:58.783138+0000","last_fullsized":"2023-07-06T19:58:58.783138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:03.514072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377298+0000","last_change":"2023-07-06T19:58:57.793087+0000","last_active":"2023-07-06T19:58:59.377298+0000","last_peered":"2023-07-06T19:58:59.377298+0000","last_clean":"2023-07-06T19:58:59.377298+0000","last_became_active":"2023-07-06T19:58:57.792685+0000","last_became_peered":"2023-07-06T19:58:57.792685+0000","last_unstale":"2023-07-06T19:58:59.377298+0000","last_undegraded":"2023-07-06T19:58:59.377298+0000","last_fullsized":"2023-07-06T19:58:59.377298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:31:48.633170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782184+0000","last_change":"2023-07-06T19:58:47.704498+0000","last_active":"2023-07-06T19:58:58.782184+0000","last_peered":"2023-07-06T19:58:58.782184+0000","last_clean":"2023-07-06T19:58:58.782184+0000","last_became_active":"2023-07-06T19:58:47.704172+0000","last_became_peered":"2023-07-06T19:58:47.704172+0000","last_unstale":"2023-07-06T19:58:58.782184+0000","last_undegraded":"2023-07-06T19:58:58.782184+0000","last_fullsized":"2023-07-06T19:58:58.782184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:08:45.797996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377014+0000","last_change":"2023-07-06T19:58:40.972763+0000","last_active":"2023-07-06T19:58:59.377014+0000","last_peered":"2023-07-06T19:58:59.377014+0000","last_clean":"2023-07-06T19:58:59.377014+0000","last_became_active":"2023-07-06T19:58:40.971570+0000","last_became_peered":"2023-07-06T19:58:40.971570+0000","last_unstale":"2023-07-06T19:58:59.377014+0000","last_undegraded":"2023-07-06T19:58:59.377014+0000","last_fullsized":"2023-07-06T19:58:59.377014+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_clean_scrub_stamp":"2023-07-06T19:58:39.653546+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:00:26.457825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376600+0000","last_change":"2023-07-06T19:58:52.746886+0000","last_active":"2023-07-06T19:58:59.376600+0000","last_peered":"2023-07-06T19:58:59.376600+0000","last_clean":"2023-07-06T19:58:59.376600+0000","last_became_active":"2023-07-06T19:58:52.746551+0000","last_became_peered":"2023-07-06T19:58:52.746551+0000","last_unstale":"2023-07-06T19:58:59.376600+0000","last_undegraded":"2023-07-06T19:58:59.376600+0000","last_fullsized":"2023-07-06T19:58:59.376600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:47:29.849262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783755+0000","last_change":"2023-07-06T19:58:53.750523+0000","last_active":"2023-07-06T19:58:58.783755+0000","last_peered":"2023-07-06T19:58:58.783755+0000","last_clean":"2023-07-06T19:58:58.783755+0000","last_became_active":"2023-07-06T19:58:53.750242+0000","last_became_peered":"2023-07-06T19:58:53.750242+0000","last_unstale":"2023-07-06T19:58:58.783755+0000","last_undegraded":"2023-07-06T19:58:58.783755+0000","last_fullsized":"2023-07-06T19:58:58.783755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:56:30.660740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782488+0000","last_change":"2023-07-06T19:58:57.786254+0000","last_active":"2023-07-06T19:58:58.782488+0000","last_peered":"2023-07-06T19:58:58.782488+0000","last_clean":"2023-07-06T19:58:58.782488+0000","last_became_active":"2023-07-06T19:58:57.785873+0000","last_became_peered":"2023-07-06T19:58:57.785873+0000","last_unstale":"2023-07-06T19:58:58.782488+0000","last_undegraded":"2023-07-06T19:58:58.782488+0000","last_fullsized":"2023-07-06T19:58:58.782488+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:31:48.633170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377148+0000","last_change":"2023-07-06T19:58:47.708545+0000","last_active":"2023-07-06T19:58:59.377148+0000","last_peered":"2023-07-06T19:58:59.377148+0000","last_clean":"2023-07-06T19:58:59.377148+0000","last_became_active":"2023-07-06T19:58:47.708230+0000","last_became_peered":"2023-07-06T19:58:47.708230+0000","last_unstale":"2023-07-06T19:58:59.377148+0000","last_undegraded":"2023-07-06T19:58:59.377148+0000","last_fullsized":"2023-07-06T19:58:59.377148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:08:45.797996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376917+0000","last_change":"2023-07-06T19:58:52.751850+0000","last_active":"2023-07-06T19:58:59.376917+0000","last_peered":"2023-07-06T19:58:59.376917+0000","last_clean":"2023-07-06T19:58:59.376917+0000","last_became_active":"2023-07-06T19:58:52.751537+0000","last_became_peered":"2023-07-06T19:58:52.751537+0000","last_unstale":"2023-07-06T19:58:59.376917+0000","last_undegraded":"2023-07-06T19:58:59.376917+0000","last_fullsized":"2023-07-06T19:58:59.376917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:15:45.160315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378259+0000","last_change":"2023-07-06T19:58:53.753894+0000","last_active":"2023-07-06T19:58:59.378259+0000","last_peered":"2023-07-06T19:58:59.378259+0000","last_clean":"2023-07-06T19:58:59.378259+0000","last_became_active":"2023-07-06T19:58:53.753530+0000","last_became_peered":"2023-07-06T19:58:53.753530+0000","last_unstale":"2023-07-06T19:58:59.378259+0000","last_undegraded":"2023-07-06T19:58:59.378259+0000","last_fullsized":"2023-07-06T19:58:59.378259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:06:38.381299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783829+0000","last_change":"2023-07-06T19:58:57.798396+0000","last_active":"2023-07-06T19:58:58.783829+0000","last_peered":"2023-07-06T19:58:58.783829+0000","last_clean":"2023-07-06T19:58:58.783829+0000","last_became_active":"2023-07-06T19:58:57.798003+0000","last_became_peered":"2023-07-06T19:58:57.798003+0000","last_unstale":"2023-07-06T19:58:58.783829+0000","last_undegraded":"2023-07-06T19:58:58.783829+0000","last_fullsized":"2023-07-06T19:58:58.783829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:48:14.761542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378171+0000","last_change":"2023-07-06T19:58:47.723926+0000","last_active":"2023-07-06T19:58:59.378171+0000","last_peered":"2023-07-06T19:58:59.378171+0000","last_clean":"2023-07-06T19:58:59.378171+0000","last_became_active":"2023-07-06T19:58:47.723646+0000","last_became_peered":"2023-07-06T19:58:47.723646+0000","last_unstale":"2023-07-06T19:58:59.378171+0000","last_undegraded":"2023-07-06T19:58:59.378171+0000","last_fullsized":"2023-07-06T19:58:59.378171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:09:44.267564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783304+0000","last_change":"2023-07-06T19:58:52.744960+0000","last_active":"2023-07-06T19:58:58.783304+0000","last_peered":"2023-07-06T19:58:58.783304+0000","last_clean":"2023-07-06T19:58:58.783304+0000","last_became_active":"2023-07-06T19:58:52.744634+0000","last_became_peered":"2023-07-06T19:58:52.744634+0000","last_unstale":"2023-07-06T19:58:58.783304+0000","last_undegraded":"2023-07-06T19:58:58.783304+0000","last_fullsized":"2023-07-06T19:58:58.783304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:08:50.821397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378559+0000","last_change":"2023-07-06T19:58:53.750128+0000","last_active":"2023-07-06T19:58:59.378559+0000","last_peered":"2023-07-06T19:58:59.378559+0000","last_clean":"2023-07-06T19:58:59.378559+0000","last_became_active":"2023-07-06T19:58:53.749580+0000","last_became_peered":"2023-07-06T19:58:53.749580+0000","last_unstale":"2023-07-06T19:58:59.378559+0000","last_undegraded":"2023-07-06T19:58:59.378559+0000","last_fullsized":"2023-07-06T19:58:59.378559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:01:56.605555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377697+0000","last_change":"2023-07-06T19:58:57.788139+0000","last_active":"2023-07-06T19:58:59.377697+0000","last_peered":"2023-07-06T19:58:59.377697+0000","last_clean":"2023-07-06T19:58:59.377697+0000","last_became_active":"2023-07-06T19:58:57.787755+0000","last_became_peered":"2023-07-06T19:58:57.787755+0000","last_unstale":"2023-07-06T19:58:59.377697+0000","last_undegraded":"2023-07-06T19:58:59.377697+0000","last_fullsized":"2023-07-06T19:58:59.377697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:49:04.545425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377011+0000","last_change":"2023-07-06T19:58:52.749383+0000","last_active":"2023-07-06T19:58:59.377011+0000","last_peered":"2023-07-06T19:58:59.377011+0000","last_clean":"2023-07-06T19:58:59.377011+0000","last_became_active":"2023-07-06T19:58:52.749084+0000","last_became_peered":"2023-07-06T19:58:52.749084+0000","last_unstale":"2023-07-06T19:58:59.377011+0000","last_undegraded":"2023-07-06T19:58:59.377011+0000","last_fullsized":"2023-07-06T19:58:59.377011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:09:49.290965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782895+0000","last_change":"2023-07-06T19:58:47.711918+0000","last_active":"2023-07-06T19:58:58.782895+0000","last_peered":"2023-07-06T19:58:58.782895+0000","last_clean":"2023-07-06T19:58:58.782895+0000","last_became_active":"2023-07-06T19:58:47.711591+0000","last_became_peered":"2023-07-06T19:58:47.711591+0000","last_unstale":"2023-07-06T19:58:58.782895+0000","last_undegraded":"2023-07-06T19:58:58.782895+0000","last_fullsized":"2023-07-06T19:58:58.782895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:01.164597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376523+0000","last_change":"2023-07-06T19:58:53.756858+0000","last_active":"2023-07-06T19:58:59.376523+0000","last_peered":"2023-07-06T19:58:59.376523+0000","last_clean":"2023-07-06T19:58:59.376523+0000","last_became_active":"2023-07-06T19:58:53.756704+0000","last_became_peered":"2023-07-06T19:58:53.756704+0000","last_unstale":"2023-07-06T19:58:59.376523+0000","last_undegraded":"2023-07-06T19:58:59.376523+0000","last_fullsized":"2023-07-06T19:58:59.376523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:40:15.607877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376385+0000","last_change":"2023-07-06T19:58:57.790196+0000","last_active":"2023-07-06T19:58:59.376385+0000","last_peered":"2023-07-06T19:58:59.376385+0000","last_clean":"2023-07-06T19:58:59.376385+0000","last_became_active":"2023-07-06T19:58:57.789783+0000","last_became_peered":"2023-07-06T19:58:57.789783+0000","last_unstale":"2023-07-06T19:58:59.376385+0000","last_undegraded":"2023-07-06T19:58:59.376385+0000","last_fullsized":"2023-07-06T19:58:59.376385+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:00:43.554956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783818+0000","last_change":"2023-07-06T19:58:47.712143+0000","last_active":"2023-07-06T19:58:58.783818+0000","last_peered":"2023-07-06T19:58:58.783818+0000","last_clean":"2023-07-06T19:58:58.783818+0000","last_became_active":"2023-07-06T19:58:47.711788+0000","last_became_peered":"2023-07-06T19:58:47.711788+0000","last_unstale":"2023-07-06T19:58:58.783818+0000","last_undegraded":"2023-07-06T19:58:58.783818+0000","last_fullsized":"2023-07-06T19:58:58.783818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:14:46.864853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378347+0000","last_change":"2023-07-06T19:58:52.745653+0000","last_active":"2023-07-06T19:58:59.378347+0000","last_peered":"2023-07-06T19:58:59.378347+0000","last_clean":"2023-07-06T19:58:59.378347+0000","last_became_active":"2023-07-06T19:58:52.745371+0000","last_became_peered":"2023-07-06T19:58:52.745371+0000","last_unstale":"2023-07-06T19:58:59.378347+0000","last_undegraded":"2023-07-06T19:58:59.378347+0000","last_fullsized":"2023-07-06T19:58:59.378347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:00:38.515358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377461+0000","last_change":"2023-07-06T19:58:53.748251+0000","last_active":"2023-07-06T19:58:59.377461+0000","last_peered":"2023-07-06T19:58:59.377461+0000","last_clean":"2023-07-06T19:58:59.377461+0000","last_became_active":"2023-07-06T19:58:53.743355+0000","last_became_peered":"2023-07-06T19:58:53.743355+0000","last_unstale":"2023-07-06T19:58:59.377461+0000","last_undegraded":"2023-07-06T19:58:59.377461+0000","last_fullsized":"2023-07-06T19:58:59.377461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:32:07.064198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783329+0000","last_change":"2023-07-06T19:58:57.788802+0000","last_active":"2023-07-06T19:58:58.783329+0000","last_peered":"2023-07-06T19:58:58.783329+0000","last_clean":"2023-07-06T19:58:58.783329+0000","last_became_active":"2023-07-06T19:58:57.788255+0000","last_became_peered":"2023-07-06T19:58:57.788255+0000","last_unstale":"2023-07-06T19:58:58.783329+0000","last_undegraded":"2023-07-06T19:58:58.783329+0000","last_fullsized":"2023-07-06T19:58:58.783329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:47:34.888861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378713+0000","last_change":"2023-07-06T19:58:52.751073+0000","last_active":"2023-07-06T19:58:59.378713+0000","last_peered":"2023-07-06T19:58:59.378713+0000","last_clean":"2023-07-06T19:58:59.378713+0000","last_became_active":"2023-07-06T19:58:52.750801+0000","last_became_peered":"2023-07-06T19:58:52.750801+0000","last_unstale":"2023-07-06T19:58:59.378713+0000","last_undegraded":"2023-07-06T19:58:59.378713+0000","last_fullsized":"2023-07-06T19:58:59.378713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:41:53.687362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377890+0000","last_change":"2023-07-06T19:58:53.752885+0000","last_active":"2023-07-06T19:58:59.377890+0000","last_peered":"2023-07-06T19:58:59.377890+0000","last_clean":"2023-07-06T19:58:59.377890+0000","last_became_active":"2023-07-06T19:58:53.752604+0000","last_became_peered":"2023-07-06T19:58:53.752604+0000","last_unstale":"2023-07-06T19:58:59.377890+0000","last_undegraded":"2023-07-06T19:58:59.377890+0000","last_fullsized":"2023-07-06T19:58:59.377890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:04:50.697845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377636+0000","last_change":"2023-07-06T19:58:57.792965+0000","last_active":"2023-07-06T19:58:59.377636+0000","last_peered":"2023-07-06T19:58:59.377636+0000","last_clean":"2023-07-06T19:58:59.377636+0000","last_became_active":"2023-07-06T19:58:57.792542+0000","last_became_peered":"2023-07-06T19:58:57.792542+0000","last_unstale":"2023-07-06T19:58:59.377636+0000","last_undegraded":"2023-07-06T19:58:59.377636+0000","last_fullsized":"2023-07-06T19:58:59.377636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:02:00.637566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782164+0000","last_change":"2023-07-06T19:58:52.748757+0000","last_active":"2023-07-06T19:58:58.782164+0000","last_peered":"2023-07-06T19:58:58.782164+0000","last_clean":"2023-07-06T19:58:58.782164+0000","last_became_active":"2023-07-06T19:58:52.748438+0000","last_became_peered":"2023-07-06T19:58:52.748438+0000","last_unstale":"2023-07-06T19:58:58.782164+0000","last_undegraded":"2023-07-06T19:58:58.782164+0000","last_fullsized":"2023-07-06T19:58:58.782164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:40:14.600290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378827+0000","last_change":"2023-07-06T19:58:53.760898+0000","last_active":"2023-07-06T19:58:59.378827+0000","last_peered":"2023-07-06T19:58:59.378827+0000","last_clean":"2023-07-06T19:58:59.378827+0000","last_became_active":"2023-07-06T19:58:53.760643+0000","last_became_peered":"2023-07-06T19:58:53.760643+0000","last_unstale":"2023-07-06T19:58:59.378827+0000","last_undegraded":"2023-07-06T19:58:59.378827+0000","last_fullsized":"2023-07-06T19:58:59.378827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:03:04.431089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782178+0000","last_change":"2023-07-06T19:58:57.780940+0000","last_active":"2023-07-06T19:58:58.782178+0000","last_peered":"2023-07-06T19:58:58.782178+0000","last_clean":"2023-07-06T19:58:58.782178+0000","last_became_active":"2023-07-06T19:58:57.780557+0000","last_became_peered":"2023-07-06T19:58:57.780557+0000","last_unstale":"2023-07-06T19:58:58.782178+0000","last_undegraded":"2023-07-06T19:58:58.782178+0000","last_fullsized":"2023-07-06T19:58:58.782178+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:09:54.330563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782271+0000","last_change":"2023-07-06T19:58:52.748732+0000","last_active":"2023-07-06T19:58:58.782271+0000","last_peered":"2023-07-06T19:58:58.782271+0000","last_clean":"2023-07-06T19:58:58.782271+0000","last_became_active":"2023-07-06T19:58:52.748464+0000","last_became_peered":"2023-07-06T19:58:52.748464+0000","last_unstale":"2023-07-06T19:58:58.782271+0000","last_undegraded":"2023-07-06T19:58:58.782271+0000","last_fullsized":"2023-07-06T19:58:58.782271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:47:29.849262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377654+0000","last_change":"2023-07-06T19:58:53.749638+0000","last_active":"2023-07-06T19:58:59.377654+0000","last_peered":"2023-07-06T19:58:59.377654+0000","last_clean":"2023-07-06T19:58:59.377654+0000","last_became_active":"2023-07-06T19:58:53.749360+0000","last_became_peered":"2023-07-06T19:58:53.749360+0000","last_unstale":"2023-07-06T19:58:59.377654+0000","last_undegraded":"2023-07-06T19:58:59.377654+0000","last_fullsized":"2023-07-06T19:58:59.377654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:52:07.484161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376759+0000","last_change":"2023-07-06T19:58:57.789615+0000","last_active":"2023-07-06T19:58:59.376759+0000","last_peered":"2023-07-06T19:58:59.376759+0000","last_clean":"2023-07-06T19:58:59.376759+0000","last_became_active":"2023-07-06T19:58:57.789210+0000","last_became_peered":"2023-07-06T19:58:57.789210+0000","last_unstale":"2023-07-06T19:58:59.376759+0000","last_undegraded":"2023-07-06T19:58:59.376759+0000","last_fullsized":"2023-07-06T19:58:59.376759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:43:41.842113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377561+0000","last_change":"2023-07-06T19:58:52.749215+0000","last_active":"2023-07-06T19:58:59.377561+0000","last_peered":"2023-07-06T19:58:59.377561+0000","last_clean":"2023-07-06T19:58:59.377561+0000","last_became_active":"2023-07-06T19:58:52.748873+0000","last_became_peered":"2023-07-06T19:58:52.748873+0000","last_unstale":"2023-07-06T19:58:59.377561+0000","last_undegraded":"2023-07-06T19:58:59.377561+0000","last_fullsized":"2023-07-06T19:58:59.377561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:01:34.409863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376989+0000","last_change":"2023-07-06T19:58:53.750239+0000","last_active":"2023-07-06T19:58:59.376989+0000","last_peered":"2023-07-06T19:58:59.376989+0000","last_clean":"2023-07-06T19:58:59.376989+0000","last_became_active":"2023-07-06T19:58:53.749937+0000","last_became_peered":"2023-07-06T19:58:53.749937+0000","last_unstale":"2023-07-06T19:58:59.376989+0000","last_undegraded":"2023-07-06T19:58:59.376989+0000","last_fullsized":"2023-07-06T19:58:59.376989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:36:41.784617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782718+0000","last_change":"2023-07-06T19:58:57.793838+0000","last_active":"2023-07-06T19:58:58.782718+0000","last_peered":"2023-07-06T19:58:58.782718+0000","last_clean":"2023-07-06T19:58:58.782718+0000","last_became_active":"2023-07-06T19:58:57.790467+0000","last_became_peered":"2023-07-06T19:58:57.790467+0000","last_unstale":"2023-07-06T19:58:58.782718+0000","last_undegraded":"2023-07-06T19:58:58.782718+0000","last_fullsized":"2023-07-06T19:58:58.782718+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:58:24.336299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378755+0000","last_change":"2023-07-06T19:58:52.745091+0000","last_active":"2023-07-06T19:58:59.378755+0000","last_peered":"2023-07-06T19:58:59.378755+0000","last_clean":"2023-07-06T19:58:59.378755+0000","last_became_active":"2023-07-06T19:58:52.744779+0000","last_became_peered":"2023-07-06T19:58:52.744779+0000","last_unstale":"2023-07-06T19:58:59.378755+0000","last_undegraded":"2023-07-06T19:58:59.378755+0000","last_fullsized":"2023-07-06T19:58:59.378755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:36:40.777030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377012+0000","last_change":"2023-07-06T19:58:53.756293+0000","last_active":"2023-07-06T19:58:59.377012+0000","last_peered":"2023-07-06T19:58:59.377012+0000","last_clean":"2023-07-06T19:58:59.377012+0000","last_became_active":"2023-07-06T19:58:53.750936+0000","last_became_peered":"2023-07-06T19:58:53.750936+0000","last_unstale":"2023-07-06T19:58:59.377012+0000","last_undegraded":"2023-07-06T19:58:59.377012+0000","last_fullsized":"2023-07-06T19:58:59.377012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:37:12.135763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783921+0000","last_change":"2023-07-06T19:58:53.749882+0000","last_active":"2023-07-06T19:58:58.783921+0000","last_peered":"2023-07-06T19:58:58.783921+0000","last_clean":"2023-07-06T19:58:58.783921+0000","last_became_active":"2023-07-06T19:58:53.749571+0000","last_became_peered":"2023-07-06T19:58:53.749571+0000","last_unstale":"2023-07-06T19:58:58.783921+0000","last_undegraded":"2023-07-06T19:58:58.783921+0000","last_fullsized":"2023-07-06T19:58:58.783921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:35:07.767106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377264+0000","last_change":"2023-07-06T19:58:53.761493+0000","last_active":"2023-07-06T19:58:59.377264+0000","last_peered":"2023-07-06T19:58:59.377264+0000","last_clean":"2023-07-06T19:58:59.377264+0000","last_became_active":"2023-07-06T19:58:53.759928+0000","last_became_peered":"2023-07-06T19:58:53.759928+0000","last_unstale":"2023-07-06T19:58:59.377264+0000","last_undegraded":"2023-07-06T19:58:59.377264+0000","last_fullsized":"2023-07-06T19:58:59.377264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:31:43.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378108+0000","last_change":"2023-07-06T19:58:53.756852+0000","last_active":"2023-07-06T19:58:59.378108+0000","last_peered":"2023-07-06T19:58:59.378108+0000","last_clean":"2023-07-06T19:58:59.378108+0000","last_became_active":"2023-07-06T19:58:53.751349+0000","last_became_peered":"2023-07-06T19:58:53.751349+0000","last_unstale":"2023-07-06T19:58:59.378108+0000","last_undegraded":"2023-07-06T19:58:59.378108+0000","last_fullsized":"2023-07-06T19:58:59.378108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:00:07.931135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377953+0000","last_change":"2023-07-06T19:58:53.766577+0000","last_active":"2023-07-06T19:58:59.377953+0000","last_peered":"2023-07-06T19:58:59.377953+0000","last_clean":"2023-07-06T19:58:59.377953+0000","last_became_active":"2023-07-06T19:58:53.766262+0000","last_became_peered":"2023-07-06T19:58:53.766262+0000","last_unstale":"2023-07-06T19:58:59.377953+0000","last_undegraded":"2023-07-06T19:58:59.377953+0000","last_fullsized":"2023-07-06T19:58:59.377953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:37:12.135763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783011+0000","last_change":"2023-07-06T19:58:53.756981+0000","last_active":"2023-07-06T19:58:58.783011+0000","last_peered":"2023-07-06T19:58:58.783011+0000","last_clean":"2023-07-06T19:58:58.783011+0000","last_became_active":"2023-07-06T19:58:53.756728+0000","last_became_peered":"2023-07-06T19:58:53.756728+0000","last_unstale":"2023-07-06T19:58:58.783011+0000","last_undegraded":"2023-07-06T19:58:58.783011+0000","last_fullsized":"2023-07-06T19:58:58.783011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:39:05.600911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":913408,"data_stored":714279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":888832,"data_stored":710851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":123751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T19:59:19.399 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-06T19:59:19.400 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-06T19:59:19.400 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-06T19:59:19.400 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-06T19:59:19.401 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-06T19:59:19.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.557+0000 7fb1df029700 1 Processor -- start 2023-07-06T19:59:19.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.557+0000 7fb1df029700 1 -- start start 2023-07-06T19:59:19.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.557+0000 7fb1df029700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb1d80b47e0 0x7fb1d806e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:19.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.557+0000 7fb1df029700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1d806a060 0x7fb1d80caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:19.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.557+0000 7fb1df029700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d815ebd0 con 0x7fb1d806a4b0 2023-07-06T19:59:19.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.557+0000 7fb1df029700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d815dfc0 con 0x7fb1d80b47e0 2023-07-06T19:59:19.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.557+0000 7fb1df029700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d815e2a0 con 0x7fb1d806a060 2023-07-06T19:59:19.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.558+0000 7fb1dd5c6700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb1d806a4b0 0x7fb1d815aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60086/0 (socket says 172.21.15.6:60086) 2023-07-06T19:59:19.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.558+0000 7fb1dd5c6700 1 -- 172.21.15.6:0/1000077202 learned_addr learned my addr 172.21.15.6:0/1000077202 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:19.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.558+0000 7fb1dcdc5700 1 --2- 172.21.15.6:0/1000077202 >> v2:172.21.15.40:3300/0 conn(0x7fb1d80b47e0 0x7fb1d806e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:19.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.558+0000 7fb1d7fff700 1 --2- 172.21.15.6:0/1000077202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1d806a060 0x7fb1d80caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:19.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.558+0000 7fb1d77fe700 1 -- 172.21.15.6:0/1000077202 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160637357 0 0) 0x7fb1d815ebd0 con 0x7fb1d806a4b0 2023-07-06T19:59:19.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.558+0000 7fb1d77fe700 1 -- 172.21.15.6:0/1000077202 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1c80035b0 con 0x7fb1d806a4b0 2023-07-06T19:59:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.558+0000 7fb1dcdc5700 1 -- 172.21.15.6:0/1000077202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1d806a060 msgr2=0x7fb1d80caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.558+0000 7fb1dcdc5700 1 --2- 172.21.15.6:0/1000077202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1d806a060 0x7fb1d80caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.558+0000 7fb1dcdc5700 1 -- 172.21.15.6:0/1000077202 >> v1:172.21.15.6:6789/0 conn(0x7fb1d806a4b0 legacy=0x7fb1d815aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.558+0000 7fb1dcdc5700 1 -- 172.21.15.6:0/1000077202 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d815e580 con 0x7fb1d80b47e0 2023-07-06T19:59:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.558+0000 7fb1dcdc5700 1 --2- 172.21.15.6:0/1000077202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1d80b47e0 0x7fb1d806e170 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc009840 tx=0x7fb1cc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71635b469e72c99 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:19.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.558+0000 7fb1d77fe700 1 -- 172.21.15.6:0/1000077202 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc011830 con 0x7fb1d80b47e0 2023-07-06T19:59:19.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.559+0000 7fb1d77fe700 1 -- 172.21.15.6:0/1000077202 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1cc011990 con 0x7fb1d80b47e0 2023-07-06T19:59:19.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.559+0000 7fb1d77fe700 1 -- 172.21.15.6:0/1000077202 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc011d00 con 0x7fb1d80b47e0 2023-07-06T19:59:19.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.559+0000 7fb1df029700 1 -- 172.21.15.6:0/1000077202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1d80b47e0 msgr2=0x7fb1d806e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:19.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.559+0000 7fb1df029700 1 --2- 172.21.15.6:0/1000077202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1d80b47e0 0x7fb1d806e170 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc009840 tx=0x7fb1cc009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:19.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.559+0000 7fb1df029700 1 -- 172.21.15.6:0/1000077202 shutdown_connections 2023-07-06T19:59:19.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.559+0000 7fb1df029700 1 --2- 172.21.15.6:0/1000077202 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1d80b47e0 0x7fb1d806e170 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:19.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.559+0000 7fb1df029700 1 --2- 172.21.15.6:0/1000077202 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1d806a060 0x7fb1d80caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:19.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.559+0000 7fb1df029700 1 -- 172.21.15.6:0/1000077202 >> 172.21.15.6:0/1000077202 conn(0x7fb1d80cf0f0 msgr2=0x7fb1d80cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:19.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.559+0000 7fb1df029700 1 -- 172.21.15.6:0/1000077202 shutdown_connections 2023-07-06T19:59:19.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.559+0000 7fb1df029700 1 -- 172.21.15.6:0/1000077202 wait complete. 2023-07-06T19:59:19.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.560+0000 7fb1df029700 1 Processor -- start 2023-07-06T19:59:19.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.560+0000 7fb1df029700 1 -- start start 2023-07-06T19:59:19.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.561+0000 7fb1df029700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1d806a060 0x7fb1d814f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:19.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.561+0000 7fb1df029700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1d806a4b0 0x7fb1d8151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:19.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.561+0000 7fb1df029700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1d80b47e0 0x7fb1d8151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:19.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.561+0000 7fb1df029700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d80c2de0 con 0x7fb1d806a060 2023-07-06T19:59:19.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.561+0000 7fb1df029700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d8151740 con 0x7fb1d80b47e0 2023-07-06T19:59:19.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.561+0000 7fb1df029700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d8150ea0 con 0x7fb1d806a4b0 2023-07-06T19:59:19.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.561+0000 7fb1dcdc5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1d806a060 0x7fb1d814f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:19.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.561+0000 7fb1dcdc5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1d806a060 0x7fb1d814f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58880/0 (socket says 172.21.15.6:58880) 2023-07-06T19:59:19.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.561+0000 7fb1dcdc5700 1 -- 172.21.15.6:0/3824151995 learned_addr learned my addr 172.21.15.6:0/3824151995 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:19.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.562+0000 7fb1dd5c6700 1 --2- 172.21.15.6:0/3824151995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1d80b47e0 0x7fb1d8151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:19.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.562+0000 7fb1dcdc5700 1 -- 172.21.15.6:0/3824151995 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1d806a4b0 msgr2=0x7fb1d8151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:19.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.562+0000 7fb1dcdc5700 1 --2- 172.21.15.6:0/3824151995 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1d806a4b0 0x7fb1d8151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:19.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.562+0000 7fb1dcdc5700 1 -- 172.21.15.6:0/3824151995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1d80b47e0 msgr2=0x7fb1d8151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:19.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.562+0000 7fb1dcdc5700 1 --2- 172.21.15.6:0/3824151995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1d80b47e0 0x7fb1d8151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:19.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.562+0000 7fb1dcdc5700 1 -- 172.21.15.6:0/3824151995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1cc0094a0 con 0x7fb1d806a060 2023-07-06T19:59:19.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.562+0000 7fb1dcdc5700 1 --2- 172.21.15.6:0/3824151995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1d806a060 0x7fb1d814f700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0090b0 tx=0x7fb1cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:19.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.562+0000 7fb1d57fa700 1 -- 172.21.15.6:0/3824151995 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc0045d0 con 0x7fb1d806a060 2023-07-06T19:59:19.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.562+0000 7fb1d57fa700 1 -- 172.21.15.6:0/3824151995 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1cc01f070 con 0x7fb1d806a060 2023-07-06T19:59:19.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.562+0000 7fb1df029700 1 -- 172.21.15.6:0/3824151995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d8151180 con 0x7fb1d806a060 2023-07-06T19:59:19.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.562+0000 7fb1d57fa700 1 -- 172.21.15.6:0/3824151995 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc0038a0 con 0x7fb1d806a060 2023-07-06T19:59:19.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.562+0000 7fb1df029700 1 -- 172.21.15.6:0/3824151995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d8150170 con 0x7fb1d806a060 2023-07-06T19:59:19.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.563+0000 7fb1df029700 1 -- 172.21.15.6:0/3824151995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d8074200 con 0x7fb1d806a060 2023-07-06T19:59:19.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.563+0000 7fb1d57fa700 1 -- 172.21.15.6:0/3824151995 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb1cc003a00 con 0x7fb1d806a060 2023-07-06T19:59:19.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.564+0000 7fb1d57fa700 1 --2- 172.21.15.6:0/3824151995 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb1bc06ace0 0x7fb1bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:19.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.564+0000 7fb1d57fa700 1 -- 172.21.15.6:0/3824151995 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb1cc021070 con 0x7fb1d806a060 2023-07-06T19:59:19.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.564+0000 7fb1d7fff700 1 --2- 172.21.15.6:0/3824151995 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb1bc06ace0 0x7fb1bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:19.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.564+0000 7fb1d7fff700 1 --2- 172.21.15.6:0/3824151995 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb1bc06ace0 0x7fb1bc06d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4006b20 tx=0x7fb1c4006ab0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:19.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.568+0000 7fb1d57fa700 1 -- 172.21.15.6:0/3824151995 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb1cc055e30 con 0x7fb1d806a060 2023-07-06T19:59:19.707 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T19:59:19.709 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T19:59:19.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.824+0000 7fb1df029700 1 -- 172.21.15.6:0/3824151995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fb1d80b3570 con 0x7fb1d806a060 2023-07-06T19:59:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.827+0000 7fb1d57fa700 1 -- 172.21.15.6:0/3824151995 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170830 (secure 0 0 0) 0x7fb1cc015090 con 0x7fb1d806a060 2023-07-06T19:59:19.829 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:19.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.830+0000 7fb1df029700 1 -- 172.21.15.6:0/3824151995 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb1bc06ace0 msgr2=0x7fb1bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:19.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.830+0000 7fb1df029700 1 --2- 172.21.15.6:0/3824151995 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb1bc06ace0 0x7fb1bc06d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4006b20 tx=0x7fb1c4006ab0 comp rx=0 tx=0).stop 2023-07-06T19:59:19.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.830+0000 7fb1df029700 1 -- 172.21.15.6:0/3824151995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1d806a060 msgr2=0x7fb1d814f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:19.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.830+0000 7fb1df029700 1 --2- 172.21.15.6:0/3824151995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1d806a060 0x7fb1d814f700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc0090b0 tx=0x7fb1cc004750 comp rx=0 tx=0).stop 2023-07-06T19:59:19.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.831+0000 7fb1df029700 1 -- 172.21.15.6:0/3824151995 shutdown_connections 2023-07-06T19:59:19.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.831+0000 7fb1df029700 1 --2- 172.21.15.6:0/3824151995 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb1bc06ace0 0x7fb1bc06d190 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:19.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.831+0000 7fb1df029700 1 --2- 172.21.15.6:0/3824151995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1d806a060 0x7fb1d814f700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:19.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.831+0000 7fb1df029700 1 --2- 172.21.15.6:0/3824151995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1d80b47e0 0x7fb1d8151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:19.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.831+0000 7fb1df029700 1 --2- 172.21.15.6:0/3824151995 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1d806a4b0 0x7fb1d8151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:19.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.831+0000 7fb1df029700 1 -- 172.21.15.6:0/3824151995 >> 172.21.15.6:0/3824151995 conn(0x7fb1d80cf0f0 msgr2=0x7fb1d80b1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:19.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.831+0000 7fb1df029700 1 -- 172.21.15.6:0/3824151995 shutdown_connections 2023-07-06T19:59:19.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.831+0000 7fb1df029700 1 -- 172.21.15.6:0/3824151995 wait complete. 2023-07-06T19:59:19.845 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":5,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":201543369},{"type":"v1","addr":"172.21.15.6:6833","nonce":201543369}]},"active_addr":"172.21.15.6:6833/201543369","active_change":"2023-07-06T19:58:32.704041+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":3616940327}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":4040172367}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":489020847}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":684349760}]}]} 2023-07-06T19:59:19.852 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-06T19:59:19.854 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-06T19:59:19.854 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T19:59:19.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.978+0000 7fd84b0ab700 1 Processor -- start 2023-07-06T19:59:19.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.978+0000 7fd84b0ab700 1 -- start start 2023-07-06T19:59:19.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.979+0000 7fd84b0ab700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd844157ed0 0x7fd84406f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:19.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.979+0000 7fd84b0ab700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84406e6c0 con 0x7fd8440ccbe0 2023-07-06T19:59:19.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.979+0000 7fd84b0ab700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8440cb080 con 0x7fd84415e4c0 2023-07-06T19:59:19.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.979+0000 7fd84b0ab700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd84406f6a0 con 0x7fd844157ed0 2023-07-06T19:59:19.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.979+0000 7fd843fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd8440ccbe0 0x7fd84415ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60098/0 (socket says 172.21.15.6:60098) 2023-07-06T19:59:19.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.979+0000 7fd843fff700 1 -- 172.21.15.6:0/4216487644 learned_addr learned my addr 172.21.15.6:0/4216487644 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:19.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.979+0000 7fd848e47700 1 --2- 172.21.15.6:0/4216487644 >> v2:172.21.15.40:3300/0 conn(0x7fd844157ed0 0x7fd84406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:19.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.979+0000 7fd8437fe700 1 -- 172.21.15.6:0/4216487644 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1497058016 0 0) 0x7fd84406e6c0 con 0x7fd8440ccbe0 2023-07-06T19:59:19.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.980+0000 7fd8437fe700 1 -- 172.21.15.6:0/4216487644 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8340035b0 con 0x7fd8440ccbe0 2023-07-06T19:59:19.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.980+0000 7fd8437fe700 1 -- 172.21.15.6:0/4216487644 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2403949545 0 0) 0x7fd8340035b0 con 0x7fd8440ccbe0 2023-07-06T19:59:19.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.980+0000 7fd8437fe700 1 -- 172.21.15.6:0/4216487644 >> v2:172.21.15.40:3300/0 conn(0x7fd844157ed0 msgr2=0x7fd84406f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:19.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.980+0000 7fd8437fe700 1 --2- 172.21.15.6:0/4216487644 >> v2:172.21.15.40:3300/0 conn(0x7fd844157ed0 0x7fd84406f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:19.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.980+0000 7fd8437fe700 1 -- 172.21.15.6:0/4216487644 >> v1:172.21.15.40:6789/0 conn(0x7fd84415e4c0 legacy=0x7fd8440ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:19.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.980+0000 7fd8437fe700 1 -- 172.21.15.6:0/4216487644 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8440cb360 con 0x7fd8440ccbe0 2023-07-06T19:59:19.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.980+0000 7fd8437fe700 1 -- 172.21.15.6:0/4216487644 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7fd830001670 con 0x7fd8440ccbe0 2023-07-06T19:59:19.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.980+0000 7fd8437fe700 1 -- 172.21.15.6:0/4216487644 >> v1:172.21.15.6:6789/0 conn(0x7fd8440ccbe0 legacy=0x7fd84415ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:19.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.980+0000 7fd8437fe700 1 --2- 172.21.15.6:0/4216487644 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd834003a70 0x7fd834003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:19.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.980+0000 7fd8437fe700 1 --2- 172.21.15.6:0/4216487644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd834004850 0x7fd834004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:19.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.980+0000 7fd8437fe700 1 --2- 172.21.15.6:0/4216487644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd834005200 0x7fd83400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:19.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.980+0000 7fd8437fe700 1 -- 172.21.15.6:0/4216487644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84406f6a0 con 0x7fd834005200 2023-07-06T19:59:19.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.980+0000 7fd8437fe700 1 -- 172.21.15.6:0/4216487644 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83400c0e0 con 0x7fd834004850 2023-07-06T19:59:19.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.980+0000 7fd8437fe700 1 -- 172.21.15.6:0/4216487644 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83400c2a0 con 0x7fd834003a70 2023-07-06T19:59:19.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.980+0000 7fd849648700 1 --2- 172.21.15.6:0/4216487644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd834005200 0x7fd83400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:19.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.980+0000 7fd843fff700 1 --2- 172.21.15.6:0/4216487644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd834004850 0x7fd834004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:19.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.980+0000 7fd848e47700 1 --2- 172.21.15.6:0/4216487644 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd834003a70 0x7fd834003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:19.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.980+0000 7fd849648700 1 -- 172.21.15.6:0/4216487644 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd834003a70 msgr2=0x7fd834003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:19.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.980+0000 7fd849648700 1 --2- 172.21.15.6:0/4216487644 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd834003a70 0x7fd834003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:19.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.980+0000 7fd849648700 1 -- 172.21.15.6:0/4216487644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd834004850 msgr2=0x7fd834004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:19.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.980+0000 7fd849648700 1 --2- 172.21.15.6:0/4216487644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd834004850 0x7fd834004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:19.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.980+0000 7fd849648700 1 -- 172.21.15.6:0/4216487644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8340035b0 con 0x7fd834005200 2023-07-06T19:59:19.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.980+0000 7fd849648700 1 -- 172.21.15.6:0/4216487644 reap_dead start 2023-07-06T19:59:19.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.980+0000 7fd849648700 1 --2- 172.21.15.6:0/4216487644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd834005200 0x7fd83400ba10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd8440727a0 tx=0x7fd834005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779613d35d88b88c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:19.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.981+0000 7fd8437fe700 1 -- 172.21.15.6:0/4216487644 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c001db0 con 0x7fd834005200 2023-07-06T19:59:19.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.981+0000 7fd8437fe700 1 -- 172.21.15.6:0/4216487644 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83c00cc70 con 0x7fd834005200 2023-07-06T19:59:19.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.981+0000 7fd8437fe700 1 -- 172.21.15.6:0/4216487644 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83c003a00 con 0x7fd834005200 2023-07-06T19:59:19.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.981+0000 7fd84b0ab700 1 -- 172.21.15.6:0/4216487644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd834005200 msgr2=0x7fd83400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:19.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.981+0000 7fd84b0ab700 1 --2- 172.21.15.6:0/4216487644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd834005200 0x7fd83400ba10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd8440727a0 tx=0x7fd834005880 comp rx=0 tx=0).stop 2023-07-06T19:59:19.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.981+0000 7fd84b0ab700 1 -- 172.21.15.6:0/4216487644 shutdown_connections 2023-07-06T19:59:19.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.981+0000 7fd84b0ab700 1 --2- 172.21.15.6:0/4216487644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd834005200 0x7fd83400ba10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:19.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.981+0000 7fd84b0ab700 1 -- 172.21.15.6:0/4216487644 >> 172.21.15.6:0/4216487644 conn(0x7fd8440d0a30 msgr2=0x7fd8440d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:19.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.981+0000 7fd84b0ab700 1 -- 172.21.15.6:0/4216487644 shutdown_connections 2023-07-06T19:59:19.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.981+0000 7fd84b0ab700 1 -- 172.21.15.6:0/4216487644 wait complete. 2023-07-06T19:59:19.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.983+0000 7fd84b0ab700 1 Processor -- start 2023-07-06T19:59:19.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.983+0000 7fd84b0ab700 1 -- start start 2023-07-06T19:59:19.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.984+0000 7fd84b0ab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd834005200 0x7fd844149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:19.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.984+0000 7fd84b0ab700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd84414a090 0x7fd8440b6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:19.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.984+0000 7fd84b0ab700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8440b3860 0x7fd8440b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.984+0000 7fd84b0ab700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440b6260 con 0x7fd834005200 2023-07-06T19:59:20.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.984+0000 7fd84b0ab700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8441ef840 con 0x7fd84414a090 2023-07-06T19:59:20.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.984+0000 7fd84b0ab700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8440b55e0 con 0x7fd8440b3860 2023-07-06T19:59:20.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.984+0000 7fd848e47700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd834005200 0x7fd844149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.984+0000 7fd848e47700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd834005200 0x7fd844149a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58900/0 (socket says 172.21.15.6:58900) 2023-07-06T19:59:20.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.984+0000 7fd848e47700 1 -- 172.21.15.6:0/600079004 learned_addr learned my addr 172.21.15.6:0/600079004 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:20.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.984+0000 7fd843fff700 1 --2- 172.21.15.6:0/600079004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd84414a090 0x7fd8440b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.984+0000 7fd849648700 1 --2- 172.21.15.6:0/600079004 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8440b3860 0x7fd8440b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.984+0000 7fd848e47700 1 -- 172.21.15.6:0/600079004 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8440b3860 msgr2=0x7fd8440b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.984+0000 7fd848e47700 1 --2- 172.21.15.6:0/600079004 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8440b3860 0x7fd8440b1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.984+0000 7fd848e47700 1 -- 172.21.15.6:0/600079004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd84414a090 msgr2=0x7fd8440b6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.984+0000 7fd848e47700 1 --2- 172.21.15.6:0/600079004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd84414a090 0x7fd8440b6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.985+0000 7fd848e47700 1 -- 172.21.15.6:0/600079004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8440b58c0 con 0x7fd834005200 2023-07-06T19:59:20.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.985+0000 7fd843fff700 1 --2- 172.21.15.6:0/600079004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd84414a090 0x7fd8440b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:20.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.985+0000 7fd849648700 1 --2- 172.21.15.6:0/600079004 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8440b3860 0x7fd8440b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:20.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.985+0000 7fd848e47700 1 --2- 172.21.15.6:0/600079004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd834005200 0x7fd844149a10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd8380119a0 tx=0x7fd838011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.985+0000 7fd8417fa700 1 -- 172.21.15.6:0/600079004 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83800f940 con 0x7fd834005200 2023-07-06T19:59:20.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.985+0000 7fd8417fa700 1 -- 172.21.15.6:0/600079004 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83800faa0 con 0x7fd834005200 2023-07-06T19:59:20.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.985+0000 7fd8417fa700 1 -- 172.21.15.6:0/600079004 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83800fe30 con 0x7fd834005200 2023-07-06T19:59:20.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.985+0000 7fd84b0ab700 1 -- 172.21.15.6:0/600079004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8440b5ba0 con 0x7fd834005200 2023-07-06T19:59:20.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.985+0000 7fd84b0ab700 1 -- 172.21.15.6:0/600079004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8440b3d00 con 0x7fd834005200 2023-07-06T19:59:20.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.986+0000 7fd84b0ab700 1 -- 172.21.15.6:0/600079004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd84406e940 con 0x7fd834005200 2023-07-06T19:59:20.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.986+0000 7fd8417fa700 1 -- 172.21.15.6:0/600079004 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd838014440 con 0x7fd834005200 2023-07-06T19:59:20.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.987+0000 7fd8417fa700 1 --2- 172.21.15.6:0/600079004 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd82806ace0 0x7fd82806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.987+0000 7fd8417fa700 1 -- 172.21.15.6:0/600079004 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd838089eb0 con 0x7fd834005200 2023-07-06T19:59:20.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.987+0000 7fd843fff700 1 --2- 172.21.15.6:0/600079004 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd82806ace0 0x7fd82806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.987+0000 7fd843fff700 1 --2- 172.21.15.6:0/600079004 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd82806ace0 0x7fd82806d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd844155340 tx=0x7fd830009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:19.991+0000 7fd8417fa700 1 -- 172.21.15.6:0/600079004 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd84406e940 con 0x7fd834005200 2023-07-06T19:59:20.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.190+0000 7fd84b0ab700 1 -- 172.21.15.6:0/600079004 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd84406e940 con 0x7fd834005200 2023-07-06T19:59:20.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.191+0000 7fd8417fa700 1 -- 172.21.15.6:0/600079004 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19964 (secure 0 0 0) 0x7fd84406e940 con 0x7fd834005200 2023-07-06T19:59:20.194 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:20.194 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:58:58.202291+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T19:58:51.062712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T19:58:52.130350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T19:58:55.785128+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:59:20.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.193+0000 7fd84b0ab700 1 -- 172.21.15.6:0/600079004 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd82806ace0 msgr2=0x7fd82806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.193+0000 7fd84b0ab700 1 --2- 172.21.15.6:0/600079004 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd82806ace0 0x7fd82806d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd844155340 tx=0x7fd830009040 comp rx=0 tx=0).stop 2023-07-06T19:59:20.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.193+0000 7fd84b0ab700 1 -- 172.21.15.6:0/600079004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd834005200 msgr2=0x7fd844149a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.193+0000 7fd84b0ab700 1 --2- 172.21.15.6:0/600079004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd834005200 0x7fd844149a10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd8380119a0 tx=0x7fd838011d60 comp rx=0 tx=0).stop 2023-07-06T19:59:20.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.193+0000 7fd84b0ab700 1 -- 172.21.15.6:0/600079004 shutdown_connections 2023-07-06T19:59:20.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.193+0000 7fd84b0ab700 1 --2- 172.21.15.6:0/600079004 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd82806ace0 0x7fd82806d190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.193+0000 7fd84b0ab700 1 --2- 172.21.15.6:0/600079004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd834005200 0x7fd844149a10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.193+0000 7fd84b0ab700 1 --2- 172.21.15.6:0/600079004 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd8440b3860 0x7fd8440b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.193+0000 7fd84b0ab700 1 --2- 172.21.15.6:0/600079004 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd84414a090 0x7fd8440b6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.193+0000 7fd84b0ab700 1 -- 172.21.15.6:0/600079004 >> 172.21.15.6:0/600079004 conn(0x7fd8440d0a30 msgr2=0x7fd84415c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:20.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.193+0000 7fd84b0ab700 1 -- 172.21.15.6:0/600079004 shutdown_connections 2023-07-06T19:59:20.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.193+0000 7fd84b0ab700 1 -- 172.21.15.6:0/600079004 wait complete. 2023-07-06T19:59:20.207 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-06T19:59:20.207 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T19:59:20.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.335+0000 7fd153fe5700 1 Processor -- start 2023-07-06T19:59:20.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.335+0000 7fd153fe5700 1 -- start start 2023-07-06T19:59:20.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.336+0000 7fd153fe5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd14c15c420 0x7fd14c15ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.336+0000 7fd153fe5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd14c071da0 0x7fd14c0cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.336+0000 7fd153fe5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd14c0cd960 con 0x7fd14c0aeee0 2023-07-06T19:59:20.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.336+0000 7fd153fe5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd14c15c7f0 con 0x7fd14c071da0 2023-07-06T19:59:20.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.336+0000 7fd153fe5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c160750 con 0x7fd14c15c420 2023-07-06T19:59:20.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.336+0000 7fd151580700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd14c0aeee0 0x7fd14c071690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60116/0 (socket says 172.21.15.6:60116) 2023-07-06T19:59:20.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.336+0000 7fd151580700 1 -- 172.21.15.6:0/695224141 learned_addr learned my addr 172.21.15.6:0/695224141 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:20.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd152582700 1 --2- 172.21.15.6:0/695224141 >> v2:172.21.15.40:3300/0 conn(0x7fd14c071da0 0x7fd14c0cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd151d81700 1 --2- 172.21.15.6:0/695224141 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd14c15c420 0x7fd14c15ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd150d7f700 1 -- 172.21.15.6:0/695224141 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468282986 0 0) 0x7fd14c0cd960 con 0x7fd14c0aeee0 2023-07-06T19:59:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd150d7f700 1 -- 172.21.15.6:0/695224141 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1380035b0 con 0x7fd14c0aeee0 2023-07-06T19:59:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd150d7f700 1 -- 172.21.15.6:0/695224141 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1056792521 0 0) 0x7fd1380035b0 con 0x7fd14c0aeee0 2023-07-06T19:59:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd150d7f700 1 -- 172.21.15.6:0/695224141 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd14c15c420 msgr2=0x7fd14c15ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:20.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd150d7f700 1 --2- 172.21.15.6:0/695224141 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd14c15c420 0x7fd14c15ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd150d7f700 1 -- 172.21.15.6:0/695224141 >> v2:172.21.15.40:3300/0 conn(0x7fd14c071da0 msgr2=0x7fd14c0cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:20.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd150d7f700 1 --2- 172.21.15.6:0/695224141 >> v2:172.21.15.40:3300/0 conn(0x7fd14c071da0 0x7fd14c0cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd150d7f700 1 -- 172.21.15.6:0/695224141 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14c160a30 con 0x7fd14c0aeee0 2023-07-06T19:59:20.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd150d7f700 1 -- 172.21.15.6:0/695224141 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7fd148001670 con 0x7fd14c0aeee0 2023-07-06T19:59:20.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd150d7f700 1 -- 172.21.15.6:0/695224141 >> v1:172.21.15.6:6789/0 conn(0x7fd14c0aeee0 legacy=0x7fd14c071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd150d7f700 1 --2- 172.21.15.6:0/695224141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd138003a70 0x7fd138003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd150d7f700 1 --2- 172.21.15.6:0/695224141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd138004850 0x7fd138004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd150d7f700 1 --2- 172.21.15.6:0/695224141 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd14c15c420 0x7fd138005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd150d7f700 1 -- 172.21.15.6:0/695224141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c15c7f0 con 0x7fd138004850 2023-07-06T19:59:20.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd150d7f700 1 -- 172.21.15.6:0/695224141 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c160750 con 0x7fd138003a70 2023-07-06T19:59:20.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd150d7f700 1 -- 172.21.15.6:0/695224141 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13800ba10 con 0x7fd14c15c420 2023-07-06T19:59:20.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd152582700 1 --2- 172.21.15.6:0/695224141 >> v2:172.21.15.40:3300/0 conn(0x7fd14c071da0 0x7fd14c0cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:59:20.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd151580700 1 --2- 172.21.15.6:0/695224141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd138004850 0x7fd138004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd151d81700 1 --2- 172.21.15.6:0/695224141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd138003a70 0x7fd138003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd152582700 1 --2- 172.21.15.6:0/695224141 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd14c15c420 0x7fd138005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd151580700 1 -- 172.21.15.6:0/695224141 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd14c15c420 msgr2=0x7fd138005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:20.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd151580700 1 --2- 172.21.15.6:0/695224141 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd14c15c420 0x7fd138005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd151580700 1 -- 172.21.15.6:0/695224141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd138003a70 msgr2=0x7fd138003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:20.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd151580700 1 --2- 172.21.15.6:0/695224141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd138003a70 0x7fd138003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd151580700 1 -- 172.21.15.6:0/695224141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1380035b0 con 0x7fd138004850 2023-07-06T19:59:20.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.337+0000 7fd151d81700 1 --2- 172.21.15.6:0/695224141 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd138003a70 0x7fd138003e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:20.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.338+0000 7fd151580700 1 --2- 172.21.15.6:0/695224141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd138004850 0x7fd138004cc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd14800c2f0 tx=0x7fd138005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee3e356cb35fff5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.338+0000 7fd150d7f700 1 -- 172.21.15.6:0/695224141 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14800ce30 con 0x7fd138004850 2023-07-06T19:59:20.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.338+0000 7fd150d7f700 1 -- 172.21.15.6:0/695224141 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd148005960 con 0x7fd138004850 2023-07-06T19:59:20.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.338+0000 7fd150d7f700 1 -- 172.21.15.6:0/695224141 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd148005d10 con 0x7fd138004850 2023-07-06T19:59:20.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.338+0000 7fd153fe5700 1 -- 172.21.15.6:0/695224141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd138004850 msgr2=0x7fd138004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.338+0000 7fd153fe5700 1 --2- 172.21.15.6:0/695224141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd138004850 0x7fd138004cc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd14800c2f0 tx=0x7fd138005880 comp rx=0 tx=0).stop 2023-07-06T19:59:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.338+0000 7fd152582700 1 -- 172.21.15.6:0/695224141 reap_dead start 2023-07-06T19:59:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.338+0000 7fd153fe5700 1 -- 172.21.15.6:0/695224141 shutdown_connections 2023-07-06T19:59:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.338+0000 7fd153fe5700 1 -- 172.21.15.6:0/695224141 >> 172.21.15.6:0/695224141 conn(0x7fd14c0cf900 msgr2=0x7fd14c0cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.338+0000 7fd153fe5700 1 -- 172.21.15.6:0/695224141 shutdown_connections 2023-07-06T19:59:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.338+0000 7fd153fe5700 1 -- 172.21.15.6:0/695224141 wait complete. 2023-07-06T19:59:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.340+0000 7fd153fe5700 1 Processor -- start 2023-07-06T19:59:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.340+0000 7fd153fe5700 1 -- start start 2023-07-06T19:59:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.341+0000 7fd153fe5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd138004850 0x7fd14c154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.341+0000 7fd153fe5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd14c1f2330 0x7fd14c1f27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.341+0000 7fd153fe5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd14c0c7d80 0x7fd14c0c81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.341+0000 7fd153fe5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c0b2880 con 0x7fd14c0c7d80 2023-07-06T19:59:20.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.341+0000 7fd153fe5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c156340 con 0x7fd14c1f2330 2023-07-06T19:59:20.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.341+0000 7fd153fe5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14c155aa0 con 0x7fd138004850 2023-07-06T19:59:20.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.341+0000 7fd152582700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd14c0c7d80 0x7fd14c0c81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.341+0000 7fd152582700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd14c0c7d80 0x7fd14c0c81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58924/0 (socket says 172.21.15.6:58924) 2023-07-06T19:59:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.341+0000 7fd152582700 1 -- 172.21.15.6:0/3225556922 learned_addr learned my addr 172.21.15.6:0/3225556922 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.341+0000 7fd151d81700 1 --2- 172.21.15.6:0/3225556922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd138004850 0x7fd14c154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.341+0000 7fd151580700 1 --2- 172.21.15.6:0/3225556922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd14c1f2330 0x7fd14c1f27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.341+0000 7fd152582700 1 -- 172.21.15.6:0/3225556922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd138004850 msgr2=0x7fd14c154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.341+0000 7fd152582700 1 --2- 172.21.15.6:0/3225556922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd138004850 0x7fd14c154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.341+0000 7fd152582700 1 -- 172.21.15.6:0/3225556922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd14c1f2330 msgr2=0x7fd14c1f27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.341+0000 7fd152582700 1 --2- 172.21.15.6:0/3225556922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd14c1f2330 0x7fd14c1f27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.341+0000 7fd152582700 1 -- 172.21.15.6:0/3225556922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14c155d80 con 0x7fd14c0c7d80 2023-07-06T19:59:20.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.342+0000 7fd152582700 1 --2- 172.21.15.6:0/3225556922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd14c0c7d80 0x7fd14c0c81f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd14c071490 tx=0x7fd1440116e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.342+0000 7fd1427fc700 1 -- 172.21.15.6:0/3225556922 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14400e070 con 0x7fd14c0c7d80 2023-07-06T19:59:20.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.342+0000 7fd1427fc700 1 -- 172.21.15.6:0/3225556922 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd144011da0 con 0x7fd14c0c7d80 2023-07-06T19:59:20.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.342+0000 7fd153fe5700 1 -- 172.21.15.6:0/3225556922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd14c156060 con 0x7fd14c0c7d80 2023-07-06T19:59:20.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.342+0000 7fd1427fc700 1 -- 172.21.15.6:0/3225556922 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd144009ea0 con 0x7fd14c0c7d80 2023-07-06T19:59:20.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.342+0000 7fd153fe5700 1 -- 172.21.15.6:0/3225556922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd14c1553a0 con 0x7fd14c0c7d80 2023-07-06T19:59:20.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.343+0000 7fd153fe5700 1 -- 172.21.15.6:0/3225556922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd14c0b29c0 con 0x7fd14c0c7d80 2023-07-06T19:59:20.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.343+0000 7fd1427fc700 1 -- 172.21.15.6:0/3225556922 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd144003a20 con 0x7fd14c0c7d80 2023-07-06T19:59:20.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.344+0000 7fd1427fc700 1 --2- 172.21.15.6:0/3225556922 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd13006ace0 0x7fd13006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.344+0000 7fd1427fc700 1 -- 172.21.15.6:0/3225556922 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd144089d80 con 0x7fd14c0c7d80 2023-07-06T19:59:20.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.344+0000 7fd151d81700 1 --2- 172.21.15.6:0/3225556922 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd13006ace0 0x7fd13006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.344+0000 7fd151d81700 1 --2- 172.21.15.6:0/3225556922 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd13006ace0 0x7fd13006d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd13c009a60 tx=0x7fd13c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.348+0000 7fd1427fc700 1 -- 172.21.15.6:0/3225556922 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd144054ab0 con 0x7fd14c0c7d80 2023-07-06T19:59:20.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.546+0000 7fd153fe5700 1 -- 172.21.15.6:0/3225556922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd14c0ce0e0 con 0x7fd14c0c7d80 2023-07-06T19:59:20.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.548+0000 7fd1427fc700 1 -- 172.21.15.6:0/3225556922 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19964 (secure 0 0 0) 0x7fd1440580d0 con 0x7fd14c0c7d80 2023-07-06T19:59:20.551 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:20.552 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:58:58.202291+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T19:58:51.062712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T19:58:52.130350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T19:58:55.785128+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:59:20.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.550+0000 7fd153fe5700 1 -- 172.21.15.6:0/3225556922 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd13006ace0 msgr2=0x7fd13006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.550+0000 7fd153fe5700 1 --2- 172.21.15.6:0/3225556922 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd13006ace0 0x7fd13006d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd13c009a60 tx=0x7fd13c008040 comp rx=0 tx=0).stop 2023-07-06T19:59:20.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.550+0000 7fd153fe5700 1 -- 172.21.15.6:0/3225556922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd14c0c7d80 msgr2=0x7fd14c0c81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.550+0000 7fd153fe5700 1 --2- 172.21.15.6:0/3225556922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd14c0c7d80 0x7fd14c0c81f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd14c071490 tx=0x7fd1440116e0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.550+0000 7fd153fe5700 1 -- 172.21.15.6:0/3225556922 shutdown_connections 2023-07-06T19:59:20.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.550+0000 7fd153fe5700 1 --2- 172.21.15.6:0/3225556922 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd13006ace0 0x7fd13006d190 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.550+0000 7fd153fe5700 1 --2- 172.21.15.6:0/3225556922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd14c0c7d80 0x7fd14c0c81f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.550+0000 7fd153fe5700 1 --2- 172.21.15.6:0/3225556922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd138004850 0x7fd14c154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.550+0000 7fd153fe5700 1 --2- 172.21.15.6:0/3225556922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd14c1f2330 0x7fd14c1f27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.550+0000 7fd153fe5700 1 -- 172.21.15.6:0/3225556922 >> 172.21.15.6:0/3225556922 conn(0x7fd14c0cf900 msgr2=0x7fd14c0b03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:20.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.550+0000 7fd153fe5700 1 -- 172.21.15.6:0/3225556922 shutdown_connections 2023-07-06T19:59:20.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.550+0000 7fd153fe5700 1 -- 172.21.15.6:0/3225556922 wait complete. 2023-07-06T19:59:20.564 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-06T19:59:20.573 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-06T19:59:20.574 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-06T19:59:20.574 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-06T19:59:20.575 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-06T19:59:20.575 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-06T19:59:20.576 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-06T19:59:20.577 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-06T19:59:20.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.795+0000 7f9505b26700 1 Processor -- start 2023-07-06T19:59:20.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.795+0000 7f9505b26700 1 -- start start 2023-07-06T19:59:20.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.797+0000 7f9505b26700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9500160900 0x7f95000c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.797+0000 7f9505b26700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f950006a850 con 0x7f950006cd60 2023-07-06T19:59:20.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.797+0000 7f9505b26700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95000caad0 con 0x7f95000ca440 2023-07-06T19:59:20.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.797+0000 7f9505b26700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95000ca8e0 con 0x7f9500160900 2023-07-06T19:59:20.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.797+0000 7f94ff7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9500160900 0x7f95000c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.797+0000 7f94ff7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9500160900 0x7f95000c58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58932/0 (socket says 172.21.15.6:58932) 2023-07-06T19:59:20.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.798+0000 7f94ff7fe700 1 -- 172.21.15.6:0/4233823751 learned_addr learned my addr 172.21.15.6:0/4233823751 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:20.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.798+0000 7f94ff7fe700 1 -- 172.21.15.6:0/4233823751 >> v1:172.21.15.40:6789/0 conn(0x7f95000ca440 legacy=0x7f950006c650 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T19:59:20.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.798+0000 7f94ff7fe700 1 -- 172.21.15.6:0/4233823751 >> v1:172.21.15.6:6789/0 conn(0x7f950006cd60 legacy=0x7f950006ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:20.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.798+0000 7f94ff7fe700 1 -- 172.21.15.6:0/4233823751 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950006a200 con 0x7f9500160900 2023-07-06T19:59:20.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.798+0000 7f0bab97b700 1 Processor -- start 2023-07-06T19:59:20.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.798+0000 7f0bab97b700 1 -- start start 2023-07-06T19:59:20.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.800+0000 7f0bab97b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0ba406ac70 0x7f0ba40cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.800+0000 7f0bab97b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ba406d6e0 0x7f0ba40cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.800+0000 7f0bab97b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba40b0e50 con 0x7f0ba415bdd0 2023-07-06T19:59:20.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.800+0000 7f0bab97b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba40b1370 con 0x7f0ba406ac70 2023-07-06T19:59:20.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.800+0000 7f0bab97b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba415c1a0 con 0x7f0ba406d6e0 2023-07-06T19:59:20.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.799+0000 7f94ff7fe700 1 --2- 172.21.15.6:0/4233823751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9500160900 0x7f95000c58a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009e50 tx=0x7f94f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62bc51db685467d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.800+0000 7f94fe7fc700 1 -- 172.21.15.6:0/4233823751 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f800e070 con 0x7f9500160900 2023-07-06T19:59:20.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.800+0000 7f94fe7fc700 1 -- 172.21.15.6:0/4233823751 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f8003a20 con 0x7f9500160900 2023-07-06T19:59:20.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.800+0000 7f94fe7fc700 1 -- 172.21.15.6:0/4233823751 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f8003dd0 con 0x7f9500160900 2023-07-06T19:59:20.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.800+0000 7f1f5bd41700 1 Processor -- start 2023-07-06T19:59:20.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.800+0000 7f0ba8f16700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0ba406ac70 0x7f0ba40cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.800+0000 7f0ba8f16700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0ba406ac70 0x7f0ba40cda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:37974/0 (socket says 172.21.15.6:37974) 2023-07-06T19:59:20.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.800+0000 7f0ba8f16700 1 -- 172.21.15.6:0/3968234665 learned_addr learned my addr 172.21.15.6:0/3968234665 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:20.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.800+0000 7f0ba8f16700 1 -- 172.21.15.6:0/3968234665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ba406d6e0 msgr2=0x7f0ba40cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:20.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.800+0000 7f0ba8f16700 1 --2- 172.21.15.6:0/3968234665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ba406d6e0 0x7f0ba40cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.800+0000 7f0ba8f16700 1 -- 172.21.15.6:0/3968234665 >> v1:172.21.15.6:6789/0 conn(0x7f0ba415bdd0 legacy=0x7f0ba40b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:20.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.801+0000 7f0ba8f16700 1 -- 172.21.15.6:0/3968234665 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba40b1090 con 0x7f0ba406ac70 2023-07-06T19:59:20.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.801+0000 7f9505b26700 1 -- 172.21.15.6:0/4233823751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9500160900 msgr2=0x7f95000c58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.801+0000 7f9505b26700 1 --2- 172.21.15.6:0/4233823751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9500160900 0x7f95000c58a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009e50 tx=0x7f94f800b330 comp rx=0 tx=0).stop 2023-07-06T19:59:20.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.801+0000 7f9505b26700 1 -- 172.21.15.6:0/4233823751 shutdown_connections 2023-07-06T19:59:20.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.801+0000 7f9505b26700 1 --2- 172.21.15.6:0/4233823751 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9500160900 0x7f95000c58a0 secure :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f94f8009e50 tx=0x7f94f800b330 comp rx=0 tx=0).stop 2023-07-06T19:59:20.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.801+0000 7f9505b26700 1 -- 172.21.15.6:0/4233823751 >> 172.21.15.6:0/4233823751 conn(0x7f95000cf420 msgr2=0x7f95000cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:20.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.801+0000 7f9505b26700 1 -- 172.21.15.6:0/4233823751 shutdown_connections 2023-07-06T19:59:20.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.800+0000 7f1f5bd41700 1 -- start start 2023-07-06T19:59:20.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.801+0000 7f1f5bd41700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1f5406cd60 0x7f1f540c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.801+0000 7f1f5bd41700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f540ca440 0x7f1f5406d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.801+0000 7f1f5bd41700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5406d880 con 0x7f1f54160900 2023-07-06T19:59:20.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.802+0000 7f1f5bd41700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f5406a850 con 0x7f1f5406cd60 2023-07-06T19:59:20.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.802+0000 7f1f5bd41700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f540ca880 con 0x7f1f540ca440 2023-07-06T19:59:20.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.802+0000 7f1f59add700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1f54160900 0x7f1f5406c650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:50020/0 (socket says 172.21.15.6:50020) 2023-07-06T19:59:20.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.802+0000 7f1f59add700 1 -- 172.21.15.6:0/2396230996 learned_addr learned my addr 172.21.15.6:0/2396230996 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:20.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.802+0000 7f1f5a2de700 1 --2- 172.21.15.6:0/2396230996 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f540ca440 0x7f1f5406d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.802+0000 7f1f592dc700 1 --2- 172.21.15.6:0/2396230996 >> v2:172.21.15.6:3300/0 conn(0x7f1f5406cd60 0x7f1f540c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.802+0000 7f1f58adb700 1 -- 172.21.15.6:0/2396230996 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 71747350 0 0) 0x7f1f50001110 con 0x7f1f54160900 2023-07-06T19:59:20.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.802+0000 7f1f5a2de700 1 -- 172.21.15.6:0/2396230996 >> v2:172.21.15.6:3300/0 conn(0x7f1f5406cd60 msgr2=0x7f1f540c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:20.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.802+0000 7f1f5a2de700 1 --2- 172.21.15.6:0/2396230996 >> v2:172.21.15.6:3300/0 conn(0x7f1f5406cd60 0x7f1f540c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.802+0000 7f1f5a2de700 1 -- 172.21.15.6:0/2396230996 >> v1:172.21.15.40:6789/0 conn(0x7f1f54160900 legacy=0x7f1f5406c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.802+0000 7f1f5a2de700 1 -- 172.21.15.6:0/2396230996 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f540caad0 con 0x7f1f540ca440 2023-07-06T19:59:20.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.802+0000 7f1f592dc700 1 --2- 172.21.15.6:0/2396230996 >> v2:172.21.15.6:3300/0 conn(0x7f1f5406cd60 0x7f1f540c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:20.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.803+0000 7f1f5a2de700 1 --2- 172.21.15.6:0/2396230996 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f540ca440 0x7f1f5406d340 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009d90 tx=0x7f1f4c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65de433daea99903 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.801+0000 7f9505b26700 1 -- 172.21.15.6:0/4233823751 wait complete. 2023-07-06T19:59:20.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.803+0000 7f9505b26700 1 Processor -- start 2023-07-06T19:59:20.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.803+0000 7f9505b26700 1 -- start start 2023-07-06T19:59:20.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.803+0000 7f1f58adb700 1 -- 172.21.15.6:0/2396230996 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c00e070 con 0x7f1f540ca440 2023-07-06T19:59:20.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.803+0000 7f1f58adb700 1 -- 172.21.15.6:0/2396230996 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c00bbd0 con 0x7f1f540ca440 2023-07-06T19:59:20.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.803+0000 7f1f58adb700 1 -- 172.21.15.6:0/2396230996 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c012430 con 0x7f1f540ca440 2023-07-06T19:59:20.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.803+0000 7fee6267a700 1 Processor -- start 2023-07-06T19:59:20.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.804+0000 7f1f5bd41700 1 -- 172.21.15.6:0/2396230996 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f540ca440 msgr2=0x7f1f5406d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.804+0000 7f1f5bd41700 1 --2- 172.21.15.6:0/2396230996 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f540ca440 0x7f1f5406d340 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009d90 tx=0x7f1f4c00b330 comp rx=0 tx=0).stop 2023-07-06T19:59:20.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.803+0000 7fee6267a700 1 -- start start 2023-07-06T19:59:20.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.804+0000 7f1f5bd41700 1 -- 172.21.15.6:0/2396230996 shutdown_connections 2023-07-06T19:59:20.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.804+0000 7f1f5bd41700 1 --2- 172.21.15.6:0/2396230996 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f540ca440 0x7f1f5406d340 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.804+0000 7f1f5bd41700 1 --2- 172.21.15.6:0/2396230996 >> v2:172.21.15.6:3300/0 conn(0x7f1f5406cd60 0x7f1f540c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.804+0000 7f1f5bd41700 1 -- 172.21.15.6:0/2396230996 >> 172.21.15.6:0/2396230996 conn(0x7f1f540cf420 msgr2=0x7f1f540cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:20.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.804+0000 7f1f5bd41700 1 -- 172.21.15.6:0/2396230996 shutdown_connections 2023-07-06T19:59:20.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.804+0000 7f9505b26700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f950006cd60 0x7f95000c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.804+0000 7f9505b26700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95000ca440 0x7f95000b1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.804+0000 7f9505b26700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95001f6ea0 0x7f9500070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.804+0000 7f9505b26700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9500160fd0 con 0x7f95001f6ea0 2023-07-06T19:59:20.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.804+0000 7f9505b26700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95000b1de0 con 0x7f950006cd60 2023-07-06T19:59:20.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.804+0000 7f9505b26700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95000b20c0 con 0x7f95000ca440 2023-07-06T19:59:20.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.804+0000 7fee6267a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fee5c06d6f0 0x7fee5c06a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.804+0000 7fee6267a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5c1587d0 con 0x7fee5c158400 2023-07-06T19:59:20.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.804+0000 7fee6267a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee5c06c650 con 0x7fee5c071590 2023-07-06T19:59:20.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.804+0000 7fee6267a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee5c06db90 con 0x7fee5c06d6f0 2023-07-06T19:59:20.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.804+0000 7fee5bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fee5c158400 0x7fee5c0ca770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60154/0 (socket says 172.21.15.6:60154) 2023-07-06T19:59:20.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.804+0000 7fee5bfff700 1 -- 172.21.15.6:0/2747223670 learned_addr learned my addr 172.21.15.6:0/2747223670 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:20.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.804+0000 7f94feffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95000ca440 0x7f95000b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.804+0000 7f94feffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95000ca440 0x7f95000b1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:51596/0 (socket says 172.21.15.6:51596) 2023-07-06T19:59:20.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.805+0000 7f94feffd700 1 -- 172.21.15.6:0/4264949826 learned_addr learned my addr 172.21.15.6:0/4264949826 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:20.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.805+0000 7f94fffff700 1 --2- 172.21.15.6:0/4264949826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95001f6ea0 0x7f9500070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.805+0000 7f94feffd700 1 -- 172.21.15.6:0/4264949826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f950006cd60 msgr2=0x7f95000c8440 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T19:59:20.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.805+0000 7f94feffd700 1 --2- 172.21.15.6:0/4264949826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f950006cd60 0x7f95000c8440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.805+0000 7f94feffd700 1 -- 172.21.15.6:0/4264949826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95001f6ea0 msgr2=0x7f9500070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.805+0000 7f94feffd700 1 --2- 172.21.15.6:0/4264949826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95001f6ea0 0x7f9500070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.805+0000 7f94feffd700 1 -- 172.21.15.6:0/4264949826 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f8009b30 con 0x7f95000ca440 2023-07-06T19:59:20.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.805+0000 7f94feffd700 1 --2- 172.21.15.6:0/4264949826 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95000ca440 0x7f95000b1740 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f94f400b470 tx=0x7f94f400b780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.805+0000 7fee5affd700 1 -- 172.21.15.6:0/2747223670 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020492268 0 0) 0x7fee5c1587d0 con 0x7fee5c158400 2023-07-06T19:59:20.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.805+0000 7fee5affd700 1 -- 172.21.15.6:0/2747223670 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee440035b0 con 0x7fee5c158400 2023-07-06T19:59:20.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.805+0000 7f94e7fff700 1 -- 172.21.15.6:0/4264949826 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f4011830 con 0x7f95000ca440 2023-07-06T19:59:20.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.806+0000 7f94e7fff700 1 -- 172.21.15.6:0/4264949826 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f40119b0 con 0x7f95000ca440 2023-07-06T19:59:20.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.806+0000 7f94e7fff700 1 -- 172.21.15.6:0/4264949826 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f4011d60 con 0x7f95000ca440 2023-07-06T19:59:20.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.804+0000 7f1f5bd41700 1 -- 172.21.15.6:0/2396230996 wait complete. 2023-07-06T19:59:20.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.806+0000 7f1f5bd41700 1 Processor -- start 2023-07-06T19:59:20.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.806+0000 7fee5affd700 1 -- 172.21.15.6:0/2747223670 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1226216971 0 0) 0x7fee440035b0 con 0x7fee5c158400 2023-07-06T19:59:20.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.806+0000 7fee5affd700 1 -- 172.21.15.6:0/2747223670 >> v2:172.21.15.40:3300/0 conn(0x7fee5c06d6f0 msgr2=0x7fee5c06a060 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T19:59:20.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.806+0000 7fee5affd700 1 --2- 172.21.15.6:0/2747223670 >> v2:172.21.15.40:3300/0 conn(0x7fee5c06d6f0 0x7fee5c06a060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.806+0000 7fee5affd700 1 -- 172.21.15.6:0/2747223670 >> v1:172.21.15.40:6789/0 conn(0x7fee5c071590 legacy=0x7fee5c0cc3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T19:59:20.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.806+0000 7fee5affd700 1 -- 172.21.15.6:0/2747223670 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c06c930 con 0x7fee5c158400 2023-07-06T19:59:20.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.806+0000 7fee5affd700 1 -- 172.21.15.6:0/2747223670 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7fee50001670 con 0x7fee5c158400 2023-07-06T19:59:20.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.806+0000 7fee5affd700 1 -- 172.21.15.6:0/2747223670 >> v1:172.21.15.6:6789/0 conn(0x7fee5c158400 legacy=0x7fee5c0ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.806+0000 7fee5affd700 1 --2- 172.21.15.6:0/2747223670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee44003a00 0x7fee44003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.806+0000 7fee5affd700 1 --2- 172.21.15.6:0/2747223670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee44004850 0x7fee44004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.806+0000 7fee5affd700 1 --2- 172.21.15.6:0/2747223670 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fee44005320 0x7fee4400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.806+0000 7fee5affd700 1 -- 172.21.15.6:0/2747223670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c06db90 con 0x7fee44004850 2023-07-06T19:59:20.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.806+0000 7fee5affd700 1 -- 172.21.15.6:0/2747223670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4400c1e0 con 0x7fee44003a00 2023-07-06T19:59:20.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.806+0000 7fee5affd700 1 -- 172.21.15.6:0/2747223670 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4400c3a0 con 0x7fee44005320 2023-07-06T19:59:20.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.806+0000 7f0ba8f16700 1 --2- 172.21.15.6:0/3968234665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ba406ac70 0x7f0ba40cda10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400bb90 tx=0x7f0b9400bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4eb9338386e685dc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.807+0000 7f0b9bfff700 1 -- 172.21.15.6:0/3968234665 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9400dd10 con 0x7f0ba406ac70 2023-07-06T19:59:20.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.807+0000 7f0b9bfff700 1 -- 172.21.15.6:0/3968234665 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9400de70 con 0x7f0ba406ac70 2023-07-06T19:59:20.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.807+0000 7f0b9bfff700 1 -- 172.21.15.6:0/3968234665 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b94004230 con 0x7f0ba406ac70 2023-07-06T19:59:20.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.806+0000 7f9505b26700 1 -- 172.21.15.6:0/4264949826 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95000b23a0 con 0x7f95000ca440 2023-07-06T19:59:20.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.806+0000 7f9505b26700 1 -- 172.21.15.6:0/4264949826 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95001f7340 con 0x7f95000ca440 2023-07-06T19:59:20.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.806+0000 7fee5bfff700 1 --2- 172.21.15.6:0/2747223670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee44003a00 0x7fee44003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.807+0000 7fee5b7fe700 1 --2- 172.21.15.6:0/2747223670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee44004850 0x7fee44004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.807+0000 7f9505b26700 1 -- 172.21.15.6:0/4264949826 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f950006a4e0 con 0x7f95000ca440 2023-07-06T19:59:20.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.807+0000 7fee5bfff700 1 -- 172.21.15.6:0/2747223670 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fee44005320 msgr2=0x7fee4400ba10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T19:59:20.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.807+0000 7fee5bfff700 1 --2- 172.21.15.6:0/2747223670 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fee44005320 0x7fee4400ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.807+0000 7fee5bfff700 1 -- 172.21.15.6:0/2747223670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee44004850 msgr2=0x7fee44004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:20.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.807+0000 7fee5bfff700 1 --2- 172.21.15.6:0/2747223670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee44004850 0x7fee44004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.807+0000 7fee5bfff700 1 -- 172.21.15.6:0/2747223670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee440035b0 con 0x7fee44003a00 2023-07-06T19:59:20.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.807+0000 7fee60c17700 1 -- 172.21.15.6:0/2747223670 reap_dead start 2023-07-06T19:59:20.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.807+0000 7fee5bfff700 1 --2- 172.21.15.6:0/2747223670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee44003a00 0x7fee44003df0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fee5000c2f0 tx=0x7fee44005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f6588ae684c25fb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.807+0000 7fee5affd700 1 -- 172.21.15.6:0/2747223670 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5000ce30 con 0x7fee44003a00 2023-07-06T19:59:20.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.806+0000 7f1f5bd41700 1 -- start start 2023-07-06T19:59:20.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.807+0000 7f1f5bd41700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f5406cd60 0x7f1f54160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.807+0000 7f1f5bd41700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f540ca440 0x7f1f54163550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.807+0000 7f1f5bd41700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f54160900 0x7f1f54163a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.807+0000 7f1f5bd41700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f541366e0 con 0x7f1f540ca440 2023-07-06T19:59:20.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.807+0000 7f1f5bd41700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f541369c0 con 0x7f1f54160900 2023-07-06T19:59:20.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.807+0000 7f1f5bd41700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f54136ca0 con 0x7f1f5406cd60 2023-07-06T19:59:20.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.808+0000 7f1f59add700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f5406cd60 0x7f1f54160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.808+0000 7f1f59add700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f5406cd60 0x7f1f54160fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:51606/0 (socket says 172.21.15.6:51606) 2023-07-06T19:59:20.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.808+0000 7f1f59add700 1 -- 172.21.15.6:0/3263078675 learned_addr learned my addr 172.21.15.6:0/3263078675 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:20.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.808+0000 7f0bab97b700 1 -- 172.21.15.6:0/3968234665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ba406ac70 msgr2=0x7f0ba40cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.808+0000 7f0bab97b700 1 --2- 172.21.15.6:0/3968234665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ba406ac70 0x7f0ba40cda10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400bb90 tx=0x7f0b9400bea0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.808+0000 7f1f5a2de700 1 --2- 172.21.15.6:0/3263078675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f54160900 0x7f1f54163a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.808+0000 7f0bab97b700 1 -- 172.21.15.6:0/3968234665 shutdown_connections 2023-07-06T19:59:20.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.808+0000 7f0bab97b700 1 --2- 172.21.15.6:0/3968234665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ba406d6e0 0x7f0ba40cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.808+0000 7f0bab97b700 1 --2- 172.21.15.6:0/3968234665 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ba406ac70 0x7f0ba40cda10 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400bb90 tx=0x7f0b9400bea0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.808+0000 7f0bab97b700 1 -- 172.21.15.6:0/3968234665 >> 172.21.15.6:0/3968234665 conn(0x7f0ba40cf420 msgr2=0x7f0ba40cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:20.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.808+0000 7f1f59add700 1 -- 172.21.15.6:0/3263078675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f54160900 msgr2=0x7f1f54163a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.808+0000 7f1f59add700 1 --2- 172.21.15.6:0/3263078675 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f54160900 0x7f1f54163a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.808+0000 7f1f59add700 1 -- 172.21.15.6:0/3263078675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f540ca440 msgr2=0x7f1f54163550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.808+0000 7f1f59add700 1 --2- 172.21.15.6:0/3263078675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f540ca440 0x7f1f54163550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.808+0000 7f1f59add700 1 -- 172.21.15.6:0/3263078675 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c009a70 con 0x7f1f5406cd60 2023-07-06T19:59:20.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.808+0000 7fc099971700 1 Processor -- start 2023-07-06T19:59:20.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.808+0000 7f64a32e3700 1 Processor -- start 2023-07-06T19:59:20.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.808+0000 7f0bab97b700 1 -- 172.21.15.6:0/3968234665 shutdown_connections 2023-07-06T19:59:20.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.808+0000 7f1f59add700 1 --2- 172.21.15.6:0/3263078675 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f5406cd60 0x7f1f54160fa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000c550 tx=0x7f1f5000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.808+0000 7f64a32e3700 1 -- start start 2023-07-06T19:59:20.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.808+0000 7f94e7fff700 1 -- 172.21.15.6:0/4264949826 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f94f401a400 con 0x7f95000ca440 2023-07-06T19:59:20.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.809+0000 7f1f4a7fc700 1 -- 172.21.15.6:0/3263078675 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f50004c80 con 0x7f1f5406cd60 2023-07-06T19:59:20.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.809+0000 7f1f4a7fc700 1 -- 172.21.15.6:0/3263078675 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f50004e00 con 0x7f1f5406cd60 2023-07-06T19:59:20.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.809+0000 7f1f4a7fc700 1 -- 172.21.15.6:0/3263078675 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f50007310 con 0x7f1f5406cd60 2023-07-06T19:59:20.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.809+0000 7f1f5bd41700 1 -- 172.21.15.6:0/3263078675 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f54136f80 con 0x7f1f5406cd60 2023-07-06T19:59:20.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.809+0000 7f1f5bd41700 1 -- 172.21.15.6:0/3263078675 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f54137780 con 0x7f1f5406cd60 2023-07-06T19:59:20.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.809+0000 7f94e7fff700 1 --2- 172.21.15.6:0/4264949826 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f94ec06adb0 0x7f94ec06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.809+0000 7f94e7fff700 1 -- 172.21.15.6:0/4264949826 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f94f40897d0 con 0x7f95000ca440 2023-07-06T19:59:20.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.809+0000 7f94e7fff700 1 --2- 172.21.15.6:0/4264949826 >> [v2:172.21.15.6:6800/3393411907,v1:172.21.15.6:6801/3393411907] conn(0x7f94ec074a80 0x7f94ec076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.809+0000 7f94e7fff700 1 -- 172.21.15.6:0/4264949826 --> [v2:172.21.15.6:6800/3393411907,v1:172.21.15.6:6801/3393411907] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f94ec077580 con 0x7f94ec074a80 2023-07-06T19:59:20.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.809+0000 7f94e7fff700 1 -- 172.21.15.6:0/4264949826 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94f4089b80 con 0x7f95000ca440 2023-07-06T19:59:20.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.809+0000 7f94fffff700 1 --2- 172.21.15.6:0/4264949826 >> [v2:172.21.15.6:6800/3393411907,v1:172.21.15.6:6801/3393411907] conn(0x7f94ec074a80 0x7f94ec076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.807+0000 7fee5affd700 1 -- 172.21.15.6:0/2747223670 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee50005960 con 0x7fee44003a00 2023-07-06T19:59:20.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.807+0000 7fee5affd700 1 -- 172.21.15.6:0/2747223670 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50005d10 con 0x7fee44003a00 2023-07-06T19:59:20.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.808+0000 7fee6267a700 1 -- 172.21.15.6:0/2747223670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee44003a00 msgr2=0x7fee44003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.808+0000 7fee6267a700 1 --2- 172.21.15.6:0/2747223670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee44003a00 0x7fee44003df0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fee5000c2f0 tx=0x7fee44005880 comp rx=0 tx=0).stop 2023-07-06T19:59:20.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.809+0000 7fee6267a700 1 -- 172.21.15.6:0/2747223670 shutdown_connections 2023-07-06T19:59:20.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.809+0000 7fee6267a700 1 --2- 172.21.15.6:0/2747223670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee44003a00 0x7fee44003df0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.809+0000 7fee6267a700 1 -- 172.21.15.6:0/2747223670 >> 172.21.15.6:0/2747223670 conn(0x7fee5c0cf420 msgr2=0x7fee5c0cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:20.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.809+0000 7fee6267a700 1 -- 172.21.15.6:0/2747223670 shutdown_connections 2023-07-06T19:59:20.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.809+0000 7fee6267a700 1 -- 172.21.15.6:0/2747223670 wait complete. 2023-07-06T19:59:20.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.810+0000 7f64a32e3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f649c0cd630 0x7f649c06a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.810+0000 7f64a32e3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f649c06c040 0x7f649c0cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.810+0000 7f64a32e3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f649c0cf520 0x7f649c15c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.810+0000 7f64a32e3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f649c0c9810 con 0x7f649c06c040 2023-07-06T19:59:20.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.810+0000 7f64a32e3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f649c0c9d70 con 0x7f649c0cd630 2023-07-06T19:59:20.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.810+0000 7f64a32e3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649c0cf9a0 con 0x7f649c0cf520 2023-07-06T19:59:20.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.810+0000 7fd1c3f41700 1 Processor -- start 2023-07-06T19:59:20.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.810+0000 7f94fffff700 1 --2- 172.21.15.6:0/4264949826 >> [v2:172.21.15.6:6800/3393411907,v1:172.21.15.6:6801/3393411907] conn(0x7f94ec074a80 0x7f94ec076eb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.810+0000 7fd1c3f41700 1 -- start start 2023-07-06T19:59:20.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.810+0000 7f94ff7fe700 1 --2- 172.21.15.6:0/4264949826 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f94ec06adb0 0x7f94ec06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.810+0000 7f0bab97b700 1 -- 172.21.15.6:0/3968234665 wait complete. 2023-07-06T19:59:20.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.811+0000 7f1f5bd41700 1 -- 172.21.15.6:0/3263078675 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1f54136b30 con 0x7f1f5406cd60 2023-07-06T19:59:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.811+0000 7fee6267a700 1 Processor -- start 2023-07-06T19:59:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.811+0000 7fee6267a700 1 -- start start 2023-07-06T19:59:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.811+0000 7fd1c3f41700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd1bc158400 0x7fd1bc06d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.811+0000 7fd1c3f41700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd1bc06a770 0x7fd1bc0cac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.811+0000 7fd1c3f41700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1bc1587d0 con 0x7fd1bc0ca770 2023-07-06T19:59:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.811+0000 7fd1c3f41700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1bc06c650 con 0x7fd1bc06a770 2023-07-06T19:59:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.811+0000 7fd1c3f41700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1bc06c930 con 0x7fd1bc158400 2023-07-06T19:59:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.811+0000 7f0bab97b700 1 Processor -- start 2023-07-06T19:59:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.811+0000 7f0bab97b700 1 -- start start 2023-07-06T19:59:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.811+0000 7fd1c1cdd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd1bc158400 0x7fd1bc06d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.811+0000 7efe54e31700 1 Processor -- start 2023-07-06T19:59:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.811+0000 7fd1c1cdd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd1bc158400 0x7fd1bc06d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:38014/0 (socket says 172.21.15.6:38014) 2023-07-06T19:59:20.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.811+0000 7fd1c1cdd700 1 -- 172.21.15.6:0/569921041 learned_addr learned my addr 172.21.15.6:0/569921041 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:20.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.808+0000 7fc099971700 1 -- start start 2023-07-06T19:59:20.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.810+0000 7fc099971700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc09406d6f0 0x7fc09406a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.810+0000 7fc099971700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc09406a5a0 0x7fc0940cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.810+0000 7fc099971700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09406db60 con 0x7fc094158400 2023-07-06T19:59:20.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.810+0000 7fc099971700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc09406a9a0 con 0x7fc09406a5a0 2023-07-06T19:59:20.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.810+0000 7fc099971700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0941587d0 con 0x7fc09406d6f0 2023-07-06T19:59:20.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.810+0000 7fc092ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc094158400 0x7fc0940ca770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60182/0 (socket says 172.21.15.6:60182) 2023-07-06T19:59:20.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.810+0000 7fc092ffd700 1 -- 172.21.15.6:0/2239351454 learned_addr learned my addr 172.21.15.6:0/2239351454 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:20.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.811+0000 7fc0927fc700 1 --2- 172.21.15.6:0/2239351454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc09406d6f0 0x7fc09406a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7f94e7fff700 1 -- 172.21.15.6:0/4264949826 <== osd.1 v2:172.21.15.6:6800/3393411907 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f94ec077580 con 0x7f94ec074a80 2023-07-06T19:59:20.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7fc0927fc700 1 -- 172.21.15.6:0/2239351454 >> v2:172.21.15.40:3300/0 conn(0x7fc09406a5a0 msgr2=0x7fc0940cc3a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-06T19:59:20.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7fc0927fc700 1 --2- 172.21.15.6:0/2239351454 >> v2:172.21.15.40:3300/0 conn(0x7fc09406a5a0 0x7fc0940cc3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7fc0927fc700 1 -- 172.21.15.6:0/2239351454 >> v1:172.21.15.6:6789/0 conn(0x7fc094158400 legacy=0x7fc0940ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:20.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7fc0927fc700 1 -- 172.21.15.6:0/2239351454 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09406c650 con 0x7fc09406d6f0 2023-07-06T19:59:20.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7fee6267a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee44003a00 0x7fee5c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7fee6267a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee5c0c7230 0x7fee5c0b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7fee6267a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fee5c0b3570 0x7fee5c1f9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7fee6267a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c0b3a10 con 0x7fee5c0c7230 2023-07-06T19:59:20.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7fee6267a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c0c8300 con 0x7fee44003a00 2023-07-06T19:59:20.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7fee6267a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c0c7a60 con 0x7fee5c0b3570 2023-07-06T19:59:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7fee5b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee5c0c7230 0x7fee5c0b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7fee5b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee5c0c7230 0x7fee5c0b3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58984/0 (socket says 172.21.15.6:58984) 2023-07-06T19:59:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7fee5b7fe700 1 -- 172.21.15.6:0/3199428886 learned_addr learned my addr 172.21.15.6:0/3199428886 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7fd1c1cdd700 1 -- 172.21.15.6:0/569921041 >> v2:172.21.15.6:3300/0 conn(0x7fd1bc06a770 msgr2=0x7fd1bc0cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7fd1c1cdd700 1 --2- 172.21.15.6:0/569921041 >> v2:172.21.15.6:3300/0 conn(0x7fd1bc06a770 0x7fd1bc0cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7fd1c1cdd700 1 -- 172.21.15.6:0/569921041 >> v1:172.21.15.40:6789/0 conn(0x7fd1bc0ca770 legacy=0x7fd1bc06a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:20.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7fd1c1cdd700 1 -- 172.21.15.6:0/569921041 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc06cc10 con 0x7fd1bc158400 2023-07-06T19:59:20.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7fee5bfff700 1 --2- 172.21.15.6:0/3199428886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee44003a00 0x7fee5c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7fd1c1cdd700 1 --2- 172.21.15.6:0/569921041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1bc158400 0x7fd1bc06d6f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0c5770 tx=0x7fd1ac00be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecd6fc5f794d972e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7fc0927fc700 1 --2- 172.21.15.6:0/2239351454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc09406d6f0 0x7fc09406a060 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009d90 tx=0x7fc08c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0e20b636d2e49f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7f94ff7fe700 1 --2- 172.21.15.6:0/4264949826 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f94ec06adb0 0x7f94ec06d260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9500071a20 tx=0x7f94f8009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7fee5b7fe700 1 -- 172.21.15.6:0/3199428886 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fee5c0b3570 msgr2=0x7fee5c1f9c50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T19:59:20.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7fee5b7fe700 1 --2- 172.21.15.6:0/3199428886 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fee5c0b3570 0x7fee5c1f9c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7fee5b7fe700 1 -- 172.21.15.6:0/3199428886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee44003a00 msgr2=0x7fee5c1587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7fee5b7fe700 1 --2- 172.21.15.6:0/3199428886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fee44003a00 0x7fee5c1587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7fee5b7fe700 1 -- 172.21.15.6:0/3199428886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee5c0c7d40 con 0x7fee5c0c7230 2023-07-06T19:59:20.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.810+0000 7f64a1880700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f649c0cf520 0x7f649c15c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.810+0000 7f64a1880700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f649c0cf520 0x7f649c15c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:51616/0 (socket says 172.21.15.6:51616) 2023-07-06T19:59:20.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.810+0000 7f64a1880700 1 -- 172.21.15.6:0/2122151872 learned_addr learned my addr 172.21.15.6:0/2122151872 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:20.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7f64a1880700 1 -- 172.21.15.6:0/2122151872 >> v2:172.21.15.40:3300/0 conn(0x7f649c0cd630 msgr2=0x7f649c06a060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-06T19:59:20.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7f64a1880700 1 --2- 172.21.15.6:0/2122151872 >> v2:172.21.15.40:3300/0 conn(0x7f649c0cd630 0x7f649c06a060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7f64a1880700 1 -- 172.21.15.6:0/2122151872 >> v2:172.21.15.6:3300/0 conn(0x7f649c06c040 msgr2=0x7f649c0cefe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-06T19:59:20.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7f64a1880700 1 --2- 172.21.15.6:0/2122151872 >> v2:172.21.15.6:3300/0 conn(0x7f649c06c040 0x7f649c0cefe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7f64a1880700 1 -- 172.21.15.6:0/2122151872 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649c06bdf0 con 0x7f649c0cf520 2023-07-06T19:59:20.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7f64a1880700 1 --2- 172.21.15.6:0/2122151872 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f649c0cf520 0x7f649c15c4d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f649c06dea0 tx=0x7f649400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de547006f9bf6b91 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7fc091ffb700 1 -- 172.21.15.6:0/2239351454 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c00e070 con 0x7fc09406d6f0 2023-07-06T19:59:20.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7fc091ffb700 1 -- 172.21.15.6:0/2239351454 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c00bb90 con 0x7fc09406d6f0 2023-07-06T19:59:20.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7fc091ffb700 1 -- 172.21.15.6:0/2239351454 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c003a20 con 0x7fc09406d6f0 2023-07-06T19:59:20.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7f6493fff700 1 -- 172.21.15.6:0/2122151872 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649400e070 con 0x7f649c0cf520 2023-07-06T19:59:20.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.812+0000 7efe54e31700 1 -- start start 2023-07-06T19:59:20.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7efe54e31700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe500d2140 0x7efe500d2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7efe54e31700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe5006a060 con 0x7efe50160ec0 2023-07-06T19:59:20.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7efe54e31700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe500d2a50 con 0x7efe500cd2c0 2023-07-06T19:59:20.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7efe54e31700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5006ba60 con 0x7efe500d2140 2023-07-06T19:59:20.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7fee5b7fe700 1 --2- 172.21.15.6:0/3199428886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee5c0c7230 0x7fee5c0b3030 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00d800 tx=0x7fee4c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7fee58ff9700 1 -- 172.21.15.6:0/3199428886 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c018070 con 0x7fee5c0c7230 2023-07-06T19:59:20.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.814+0000 7efe4dd9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7efe50160ec0 0x7efe5006b350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60200/0 (socket says 172.21.15.6:60200) 2023-07-06T19:59:20.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.814+0000 7efe4dd9b700 1 -- 172.21.15.6:0/3923523998 learned_addr learned my addr 172.21.15.6:0/3923523998 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:20.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.814+0000 7efe4e59c700 1 --2- 172.21.15.6:0/3923523998 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe500d2140 0x7efe500d2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7f6493fff700 1 -- 172.21.15.6:0/2122151872 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649400b9c0 con 0x7f649c0cf520 2023-07-06T19:59:20.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7f6493fff700 1 -- 172.21.15.6:0/2122151872 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649400bd70 con 0x7f649c0cf520 2023-07-06T19:59:20.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.814+0000 7f64a32e3700 1 -- 172.21.15.6:0/2122151872 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f649c0cf520 msgr2=0x7f649c15c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.814+0000 7f64a32e3700 1 --2- 172.21.15.6:0/2122151872 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f649c0cf520 0x7f649c15c4d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f649c06dea0 tx=0x7f649400b330 comp rx=0 tx=0).stop 2023-07-06T19:59:20.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.814+0000 7fc099971700 1 -- 172.21.15.6:0/2239351454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc09406d6f0 msgr2=0x7fc09406a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.814+0000 7fc099971700 1 --2- 172.21.15.6:0/2239351454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc09406d6f0 0x7fc09406a060 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc08c009d90 tx=0x7fc08c00b330 comp rx=0 tx=0).stop 2023-07-06T19:59:20.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7fee58ff9700 1 -- 172.21.15.6:0/3199428886 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4c0125f0 con 0x7fee5c0c7230 2023-07-06T19:59:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7fee58ff9700 1 -- 172.21.15.6:0/3199428886 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c0127c0 con 0x7fee5c0c7230 2023-07-06T19:59:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7fee6267a700 1 -- 172.21.15.6:0/3199428886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee5c0c8020 con 0x7fee5c0c7230 2023-07-06T19:59:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7fee6267a700 1 -- 172.21.15.6:0/3199428886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee5c158d10 con 0x7fee5c0c7230 2023-07-06T19:59:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.814+0000 7f64a32e3700 1 -- 172.21.15.6:0/2122151872 shutdown_connections 2023-07-06T19:59:20.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.814+0000 7f64a32e3700 1 --2- 172.21.15.6:0/2122151872 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f649c0cf520 0x7f649c15c4d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.814+0000 7f64a32e3700 1 --2- 172.21.15.6:0/2122151872 >> v2:172.21.15.40:3300/0 conn(0x7f649c0cd630 0x7f649c06a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.814+0000 7f64a32e3700 1 --2- 172.21.15.6:0/2122151872 >> v2:172.21.15.6:3300/0 conn(0x7f649c06c040 0x7f649c0cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.814+0000 7f64a32e3700 1 -- 172.21.15.6:0/2122151872 >> 172.21.15.6:0/2122151872 conn(0x7f649c0b0b60 msgr2=0x7f649c0b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:20.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.814+0000 7fee6267a700 1 -- 172.21.15.6:0/3199428886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fee5c06cef0 con 0x7fee5c0c7230 2023-07-06T19:59:20.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.815+0000 7f64a32e3700 1 -- 172.21.15.6:0/2122151872 shutdown_connections 2023-07-06T19:59:20.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.815+0000 7f64a32e3700 1 -- 172.21.15.6:0/2122151872 wait complete. 2023-07-06T19:59:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.815+0000 7efe4d59a700 1 -- 172.21.15.6:0/3923523998 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626744621 0 0) 0x7efe5006a060 con 0x7efe50160ec0 2023-07-06T19:59:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.815+0000 7efe4d59a700 1 -- 172.21.15.6:0/3923523998 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe380035b0 con 0x7efe50160ec0 2023-07-06T19:59:20.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.815+0000 7fd1c0cdb700 1 -- 172.21.15.6:0/569921041 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac00dbe0 con 0x7fd1bc158400 2023-07-06T19:59:20.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.815+0000 7fd1c0cdb700 1 -- 172.21.15.6:0/569921041 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac00dd40 con 0x7fd1bc158400 2023-07-06T19:59:20.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.815+0000 7fd1c0cdb700 1 -- 172.21.15.6:0/569921041 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac004270 con 0x7fd1bc158400 2023-07-06T19:59:20.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.815+0000 7f1f4a7fc700 1 -- 172.21.15.6:0/3263078675 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1f50007470 con 0x7f1f5406cd60 2023-07-06T19:59:20.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7f1f4a7fc700 1 --2- 172.21.15.6:0/3263078675 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1f3806adb0 0x7f1f3806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7f1f4a7fc700 1 -- 172.21.15.6:0/3263078675 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1f500892a0 con 0x7f1f5406cd60 2023-07-06T19:59:20.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7efe4d59a700 1 -- 172.21.15.6:0/3923523998 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2969921815 0 0) 0x7efe380035b0 con 0x7efe50160ec0 2023-07-06T19:59:20.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7efe4d59a700 1 -- 172.21.15.6:0/3923523998 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe500d2140 msgr2=0x7efe500d2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:20.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7efe4d59a700 1 --2- 172.21.15.6:0/3923523998 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe500d2140 0x7efe500d2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7efe4d59a700 1 -- 172.21.15.6:0/3923523998 >> v1:172.21.15.40:6789/0 conn(0x7efe500cd2c0 legacy=0x7efe500b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:20.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7efe4d59a700 1 -- 172.21.15.6:0/3923523998 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5006a2b0 con 0x7efe50160ec0 2023-07-06T19:59:20.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7efe4d59a700 1 -- 172.21.15.6:0/3923523998 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7efe44001670 con 0x7efe50160ec0 2023-07-06T19:59:20.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7efe4d59a700 1 -- 172.21.15.6:0/3923523998 >> v1:172.21.15.6:6789/0 conn(0x7efe50160ec0 legacy=0x7efe5006b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7efe4d59a700 1 --2- 172.21.15.6:0/3923523998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe38003a30 0x7efe38003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7efe4d59a700 1 --2- 172.21.15.6:0/3923523998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe38004850 0x7efe38004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7efe4d59a700 1 --2- 172.21.15.6:0/3923523998 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe38005200 0x7efe3800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7efe4d59a700 1 -- 172.21.15.6:0/3923523998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5006ba60 con 0x7efe38003a30 2023-07-06T19:59:20.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7efe4d59a700 1 -- 172.21.15.6:0/3923523998 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3800bfd0 con 0x7efe38004850 2023-07-06T19:59:20.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7efe4d59a700 1 -- 172.21.15.6:0/3923523998 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3800c190 con 0x7efe38005200 2023-07-06T19:59:20.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7f1f4a7fc700 1 --2- 172.21.15.6:0/3263078675 >> [v2:172.21.15.40:6800/2298149583,v1:172.21.15.40:6801/2298149583] conn(0x7f1f38074a80 0x7f1f38076eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7f1f4a7fc700 1 -- 172.21.15.6:0/3263078675 --> [v2:172.21.15.40:6800/2298149583,v1:172.21.15.40:6801/2298149583] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1f38077580 con 0x7f1f38074a80 2023-07-06T19:59:20.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7f1f4a7fc700 1 -- 172.21.15.6:0/3263078675 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f5008b8c0 con 0x7f1f5406cd60 2023-07-06T19:59:20.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7fd1c3f41700 1 -- 172.21.15.6:0/569921041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1bc158400 msgr2=0x7fd1bc06d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7fd1c3f41700 1 --2- 172.21.15.6:0/569921041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1bc158400 0x7fd1bc06d6f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0c5770 tx=0x7fd1ac00be70 comp rx=0 tx=0).stop 2023-07-06T19:59:20.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7fd1c3f41700 1 -- 172.21.15.6:0/569921041 shutdown_connections 2023-07-06T19:59:20.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7fd1c3f41700 1 --2- 172.21.15.6:0/569921041 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1bc158400 0x7fd1bc06d6f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7fd1c3f41700 1 --2- 172.21.15.6:0/569921041 >> v2:172.21.15.6:3300/0 conn(0x7fd1bc06a770 0x7fd1bc0cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7fd1c3f41700 1 -- 172.21.15.6:0/569921041 >> 172.21.15.6:0/569921041 conn(0x7fd1bc0cf420 msgr2=0x7fd1bc0cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:20.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7f1f592dc700 1 --2- 172.21.15.6:0/3263078675 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1f3806adb0 0x7f1f3806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7f64a32e3700 1 Processor -- start 2023-07-06T19:59:20.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7f1f5a2de700 1 --2- 172.21.15.6:0/3263078675 >> [v2:172.21.15.40:6800/2298149583,v1:172.21.15.40:6801/2298149583] conn(0x7f1f38074a80 0x7f1f38076eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7fc099971700 1 -- 172.21.15.6:0/2239351454 shutdown_connections 2023-07-06T19:59:20.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7fc099971700 1 --2- 172.21.15.6:0/2239351454 >> v2:172.21.15.40:3300/0 conn(0x7fc09406a5a0 0x7fc0940cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7fc099971700 1 --2- 172.21.15.6:0/2239351454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc09406d6f0 0x7fc09406a060 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.816+0000 7fc099971700 1 -- 172.21.15.6:0/2239351454 >> 172.21.15.6:0/2239351454 conn(0x7fc0940cf420 msgr2=0x7fc0940cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:20.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.817+0000 7efe4e59c700 1 --2- 172.21.15.6:0/3923523998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe38003a30 0x7efe38003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.817+0000 7f1f592dc700 1 --2- 172.21.15.6:0/3263078675 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1f3806adb0 0x7f1f3806d260 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1f44006f10 tx=0x7f1f44008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.817+0000 7efe4dd9b700 1 --2- 172.21.15.6:0/3923523998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe38004850 0x7efe38004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7f0bab97b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ba406d6e0 0x7f0ba4158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7f0bab97b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ba415bdd0 0x7f0ba41f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7f0bab97b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ba40c62b0 0x7f0ba40b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7f0bab97b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba41f70e0 con 0x7f0ba415bdd0 2023-07-06T19:59:20.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7f0bab97b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba40c6820 con 0x7f0ba40c62b0 2023-07-06T19:59:20.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7f0bab97b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba40c6d40 con 0x7f0ba406d6e0 2023-07-06T19:59:20.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7f0ba8f16700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ba415bdd0 0x7f0ba41f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7f0ba8f16700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ba415bdd0 0x7f0ba41f6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58990/0 (socket says 172.21.15.6:58990) 2023-07-06T19:59:20.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7f0ba8f16700 1 -- 172.21.15.6:0/3227967690 learned_addr learned my addr 172.21.15.6:0/3227967690 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:20.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7f0ba8f16700 1 -- 172.21.15.6:0/3227967690 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ba406d6e0 msgr2=0x7f0ba4158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7f0ba8f16700 1 --2- 172.21.15.6:0/3227967690 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ba406d6e0 0x7f0ba4158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7f0ba8f16700 1 -- 172.21.15.6:0/3227967690 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ba40c62b0 msgr2=0x7f0ba40b2a00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-06T19:59:20.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.813+0000 7f0ba8f16700 1 --2- 172.21.15.6:0/3227967690 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ba40c62b0 0x7f0ba40b2a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.814+0000 7f0ba8f16700 1 -- 172.21.15.6:0/3227967690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9400b7f0 con 0x7f0ba415bdd0 2023-07-06T19:59:20.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.814+0000 7f0ba8f16700 1 --2- 172.21.15.6:0/3227967690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ba415bdd0 0x7f0ba41f6ba0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0b94004000 tx=0x7f0b94004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.814+0000 7f0b99ffb700 1 -- 172.21.15.6:0/3227967690 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b94003e60 con 0x7f0ba415bdd0 2023-07-06T19:59:20.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.814+0000 7f0b99ffb700 1 -- 172.21.15.6:0/3227967690 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b94010470 con 0x7f0ba415bdd0 2023-07-06T19:59:20.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.814+0000 7f0bab97b700 1 -- 172.21.15.6:0/3227967690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba40c7020 con 0x7f0ba415bdd0 2023-07-06T19:59:20.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.814+0000 7f0b99ffb700 1 -- 172.21.15.6:0/3227967690 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b940107e0 con 0x7f0ba415bdd0 2023-07-06T19:59:20.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.814+0000 7f0bab97b700 1 -- 172.21.15.6:0/3227967690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba40c75e0 con 0x7f0ba415bdd0 2023-07-06T19:59:20.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.815+0000 7f0bab97b700 1 -- 172.21.15.6:0/3227967690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0ba406a470 con 0x7f0ba415bdd0 2023-07-06T19:59:20.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7f1f5a2de700 1 --2- 172.21.15.6:0/3263078675 >> [v2:172.21.15.40:6800/2298149583,v1:172.21.15.40:6801/2298149583] conn(0x7f1f38074a80 0x7f1f38076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7efe4e59c700 1 -- 172.21.15.6:0/3923523998 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe38005200 msgr2=0x7efe3800ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-06T19:59:20.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7efe4e59c700 1 --2- 172.21.15.6:0/3923523998 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe38005200 0x7efe3800ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7efe4e59c700 1 -- 172.21.15.6:0/3923523998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe38004850 msgr2=0x7efe38004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:20.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7efe4e59c700 1 --2- 172.21.15.6:0/3923523998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe38004850 0x7efe38004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7efe4e59c700 1 -- 172.21.15.6:0/3923523998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5006a2b0 con 0x7efe38003a30 2023-07-06T19:59:20.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.817+0000 7fee58ff9700 1 -- 172.21.15.6:0/3199428886 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fee4c012920 con 0x7fee5c0c7230 2023-07-06T19:59:20.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7fee58ff9700 1 --2- 172.21.15.6:0/3199428886 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fee4806ace0 0x7fee4806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7fee58ff9700 1 -- 172.21.15.6:0/3199428886 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fee4c089fb0 con 0x7fee5c0c7230 2023-07-06T19:59:20.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7fee58ff9700 1 --2- 172.21.15.6:0/3199428886 >> [v2:172.21.15.40:6816/4092969902,v1:172.21.15.40:6817/4092969902] conn(0x7fee480749b0 0x7fee48076de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7fee58ff9700 1 -- 172.21.15.6:0/3199428886 --> [v2:172.21.15.40:6816/4092969902,v1:172.21.15.40:6817/4092969902] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fee480774b0 con 0x7fee480749b0 2023-07-06T19:59:20.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7fee58ff9700 1 -- 172.21.15.6:0/3199428886 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee4c08a360 con 0x7fee5c0c7230 2023-07-06T19:59:20.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7efe4dd9b700 1 --2- 172.21.15.6:0/3923523998 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe38004850 0x7efe38004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:59:20.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.817+0000 7f64a32e3700 1 -- start start 2023-07-06T19:59:20.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7f64a32e3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f649c06c040 0x7f649c151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7f64a32e3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f649c0cd630 0x7f649c157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7f64a32e3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0cf520 0x7f649c1577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7f64a32e3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649c1556c0 con 0x7f649c0cd630 2023-07-06T19:59:20.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7f64a32e3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649c158120 con 0x7f649c0cf520 2023-07-06T19:59:20.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7f64a32e3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649c1550b0 con 0x7f649c06c040 2023-07-06T19:59:20.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7f64a107f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f649c06c040 0x7f649c151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7f64a087e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f649c0cd630 0x7f649c157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7f64a087e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f649c0cd630 0x7f649c157280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59008/0 (socket says 172.21.15.6:59008) 2023-07-06T19:59:20.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7f64a087e700 1 -- 172.21.15.6:0/2361356198 learned_addr learned my addr 172.21.15.6:0/2361356198 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:20.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7f64a1880700 1 --2- 172.21.15.6:0/2361356198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0cf520 0x7f649c1577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7f64a087e700 1 -- 172.21.15.6:0/2361356198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f649c06c040 msgr2=0x7f649c151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7f64a087e700 1 --2- 172.21.15.6:0/2361356198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f649c06c040 0x7f649c151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7f64a087e700 1 -- 172.21.15.6:0/2361356198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0cf520 msgr2=0x7f649c1577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7f64a087e700 1 --2- 172.21.15.6:0/2361356198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f649c0cf520 0x7f649c1577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7f64a087e700 1 -- 172.21.15.6:0/2361356198 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6494009b30 con 0x7f649c0cd630 2023-07-06T19:59:20.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7efe4e59c700 1 --2- 172.21.15.6:0/3923523998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe38003a30 0x7efe38003e20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efe500d20f0 tx=0x7efe38005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d912033ff6e21fa6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7fee5bfff700 1 --2- 172.21.15.6:0/3199428886 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fee4806ace0 0x7fee4806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.818+0000 7f0b99ffb700 1 -- 172.21.15.6:0/3227967690 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0b94010940 con 0x7f0ba415bdd0 2023-07-06T19:59:20.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.819+0000 7f1f4a7fc700 1 -- 172.21.15.6:0/3263078675 <== osd.4 v2:172.21.15.40:6800/2298149583 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1f38077580 con 0x7f1f38074a80 2023-07-06T19:59:20.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.819+0000 7f64a087e700 1 --2- 172.21.15.6:0/2361356198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f649c0cd630 0x7f649c157280 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f648c00b450 tx=0x7f648c00b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.819+0000 7fc099971700 1 -- 172.21.15.6:0/2239351454 shutdown_connections 2023-07-06T19:59:20.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.819+0000 7f6491ffb700 1 -- 172.21.15.6:0/2361356198 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c011830 con 0x7f649c0cd630 2023-07-06T19:59:20.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.819+0000 7fc099971700 1 -- 172.21.15.6:0/2239351454 wait complete. 2023-07-06T19:59:20.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.819+0000 7f6491ffb700 1 -- 172.21.15.6:0/2361356198 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648c0119b0 con 0x7f649c0cd630 2023-07-06T19:59:20.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.819+0000 7f64a32e3700 1 -- 172.21.15.6:0/2361356198 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f649c157e40 con 0x7f649c0cd630 2023-07-06T19:59:20.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.819+0000 7efe4d59a700 1 -- 172.21.15.6:0/3923523998 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe40004020 con 0x7efe38003a30 2023-07-06T19:59:20.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.819+0000 7efe4d59a700 1 -- 172.21.15.6:0/3923523998 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe40004180 con 0x7efe38003a30 2023-07-06T19:59:20.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.819+0000 7efe4d59a700 1 -- 172.21.15.6:0/3923523998 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe400044f0 con 0x7efe38003a30 2023-07-06T19:59:20.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.819+0000 7fee5bfff700 1 --2- 172.21.15.6:0/3199428886 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fee4806ace0 0x7fee4806d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fee50001930 tx=0x7fee50007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.819+0000 7f0b99ffb700 1 --2- 172.21.15.6:0/3227967690 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0b8806ace0 0x7f0b8806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.819+0000 7f0b99ffb700 1 -- 172.21.15.6:0/3227967690 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0b9409c750 con 0x7f0ba415bdd0 2023-07-06T19:59:20.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.819+0000 7f0b99ffb700 1 --2- 172.21.15.6:0/3227967690 >> [v2:172.21.15.6:6808/43500803,v1:172.21.15.6:6809/43500803] conn(0x7f0b880749b0 0x7f0b88076de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.819+0000 7f0b99ffb700 1 -- 172.21.15.6:0/3227967690 --> [v2:172.21.15.6:6808/43500803,v1:172.21.15.6:6809/43500803] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0b880774b0 con 0x7f0b880749b0 2023-07-06T19:59:20.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.819+0000 7f0b99ffb700 1 -- 172.21.15.6:0/3227967690 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b9409cb00 con 0x7f0ba415bdd0 2023-07-06T19:59:20.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.820+0000 7fd1c3f41700 1 -- 172.21.15.6:0/569921041 shutdown_connections 2023-07-06T19:59:20.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.820+0000 7fee60c17700 1 --2- 172.21.15.6:0/3199428886 >> [v2:172.21.15.40:6816/4092969902,v1:172.21.15.40:6817/4092969902] conn(0x7fee480749b0 0x7fee48076de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.820+0000 7efe54e31700 1 -- 172.21.15.6:0/3923523998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe38003a30 msgr2=0x7efe38003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.820+0000 7efe54e31700 1 --2- 172.21.15.6:0/3923523998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe38003a30 0x7efe38003e20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efe500d20f0 tx=0x7efe38005880 comp rx=0 tx=0).stop 2023-07-06T19:59:20.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.819+0000 7f64a32e3700 1 -- 172.21.15.6:0/2361356198 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f649c152680 con 0x7f649c0cd630 2023-07-06T19:59:20.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.819+0000 7f6491ffb700 1 -- 172.21.15.6:0/2361356198 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c011d60 con 0x7f649c0cd630 2023-07-06T19:59:20.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.820+0000 7f64a32e3700 1 -- 172.21.15.6:0/2361356198 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6480000ff0 con 0x7f649c0cd630 2023-07-06T19:59:20.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.820+0000 7fd1c3f41700 1 -- 172.21.15.6:0/569921041 wait complete. 2023-07-06T19:59:20.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.821+0000 7fc099971700 1 Processor -- start 2023-07-06T19:59:20.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.821+0000 7f0ba9f18700 1 --2- 172.21.15.6:0/3227967690 >> [v2:172.21.15.6:6808/43500803,v1:172.21.15.6:6809/43500803] conn(0x7f0b880749b0 0x7f0b88076de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.821+0000 7efe4ed9d700 1 -- 172.21.15.6:0/3923523998 reap_dead start 2023-07-06T19:59:20.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.821+0000 7efe54e31700 1 -- 172.21.15.6:0/3923523998 shutdown_connections 2023-07-06T19:59:20.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.821+0000 7efe54e31700 1 -- 172.21.15.6:0/3923523998 >> 172.21.15.6:0/3923523998 conn(0x7efe500d3900 msgr2=0x7efe500b4760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:20.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.821+0000 7f0ba9717700 1 --2- 172.21.15.6:0/3227967690 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0b8806ace0 0x7f0b8806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.822+0000 7f0ba9f18700 1 --2- 172.21.15.6:0/3227967690 >> [v2:172.21.15.6:6808/43500803,v1:172.21.15.6:6809/43500803] conn(0x7f0b880749b0 0x7f0b88076de0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.822+0000 7f0ba9717700 1 --2- 172.21.15.6:0/3227967690 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0b8806ace0 0x7f0b8806d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4156160 tx=0x7f0ba0007a20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.822+0000 7fd1c3f41700 1 Processor -- start 2023-07-06T19:59:20.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.822+0000 7fd1c3f41700 1 -- start start 2023-07-06T19:59:20.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.821+0000 7fc099971700 1 -- start start 2023-07-06T19:59:20.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.822+0000 7fc099971700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc09406a5a0 0x7fc0940b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.822+0000 7fc099971700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc09406d6f0 0x7fc0940c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.822+0000 7fc099971700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc094158400 0x7fc0941f9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.822+0000 7fc099971700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0940b41c0 con 0x7fc094158400 2023-07-06T19:59:20.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.822+0000 7fc099971700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0941fa610 con 0x7fc09406a5a0 2023-07-06T19:59:20.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.822+0000 7fc099971700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0941fa330 con 0x7fc09406d6f0 2023-07-06T19:59:20.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.822+0000 7fc0937fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc094158400 0x7fc0941f9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.822+0000 7fc0937fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc094158400 0x7fc0941f9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59024/0 (socket says 172.21.15.6:59024) 2023-07-06T19:59:20.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.822+0000 7fc0937fe700 1 -- 172.21.15.6:0/3760234814 learned_addr learned my addr 172.21.15.6:0/3760234814 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:20.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.822+0000 7fc092ffd700 1 --2- 172.21.15.6:0/3760234814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc09406a5a0 0x7fc0940b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.823+0000 7f0b99ffb700 1 -- 172.21.15.6:0/3227967690 <== osd.0 v2:172.21.15.6:6808/43500803 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0b880774b0 con 0x7f0b880749b0 2023-07-06T19:59:20.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.823+0000 7fc092ffd700 1 -- 172.21.15.6:0/3760234814 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc09406d6f0 msgr2=0x7fc0940c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.823+0000 7fc092ffd700 1 --2- 172.21.15.6:0/3760234814 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc09406d6f0 0x7fc0940c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.823+0000 7fc092ffd700 1 -- 172.21.15.6:0/3760234814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc094158400 msgr2=0x7fc0941f9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.823+0000 7fc092ffd700 1 --2- 172.21.15.6:0/3760234814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc094158400 0x7fc0941f9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.823+0000 7fc092ffd700 1 -- 172.21.15.6:0/3760234814 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c009a70 con 0x7fc09406a5a0 2023-07-06T19:59:20.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.823+0000 7fd1c3f41700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1bc06a770 0x7fd1bc13d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.823+0000 7fd1c3f41700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1bc158400 0x7fd1bc159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.823+0000 7fd1c3f41700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1bc14d610 0x7fd1bc0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.823+0000 7fd1c3f41700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc13e7b0 con 0x7fd1bc14d610 2023-07-06T19:59:20.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.823+0000 7fd1c3f41700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc13d790 con 0x7fd1bc06a770 2023-07-06T19:59:20.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.823+0000 7fd1c3f41700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1bc13db30 con 0x7fd1bc158400 2023-07-06T19:59:20.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.823+0000 7fd1c24de700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1bc14d610 0x7fd1bc0cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.823+0000 7fd1c24de700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1bc14d610 0x7fd1bc0cd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59026/0 (socket says 172.21.15.6:59026) 2023-07-06T19:59:20.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.823+0000 7fd1c24de700 1 -- 172.21.15.6:0/3642557515 learned_addr learned my addr 172.21.15.6:0/3642557515 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:20.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.823+0000 7fd1c1cdd700 1 --2- 172.21.15.6:0/3642557515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1bc06a770 0x7fd1bc13d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.823+0000 7fd1c24de700 1 -- 172.21.15.6:0/3642557515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1bc158400 msgr2=0x7fd1bc159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.823+0000 7fd1c24de700 1 --2- 172.21.15.6:0/3642557515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd1bc158400 0x7fd1bc159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.823+0000 7fd1c24de700 1 -- 172.21.15.6:0/3642557515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1bc06a770 msgr2=0x7fd1bc13d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.823+0000 7fd1c24de700 1 --2- 172.21.15.6:0/3642557515 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd1bc06a770 0x7fd1bc13d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:20.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.824+0000 7fd1c24de700 1 -- 172.21.15.6:0/3642557515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac00b7f0 con 0x7fd1bc14d610 2023-07-06T19:59:20.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.824+0000 7fee60c17700 1 --2- 172.21.15.6:0/3199428886 >> [v2:172.21.15.40:6816/4092969902,v1:172.21.15.40:6817/4092969902] conn(0x7fee480749b0 0x7fee48076de0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.824+0000 7fd1c24de700 1 --2- 172.21.15.6:0/3642557515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1bc14d610 0x7fd1bc0cd0c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400b970 tx=0x7fd1b400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.824+0000 7fd1b27fc700 1 -- 172.21.15.6:0/3642557515 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400c930 con 0x7fd1bc14d610 2023-07-06T19:59:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.824+0000 7fd1b27fc700 1 -- 172.21.15.6:0/3642557515 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b400cab0 con 0x7fd1bc14d610 2023-07-06T19:59:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.824+0000 7fd1b27fc700 1 -- 172.21.15.6:0/3642557515 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400ce60 con 0x7fd1bc14d610 2023-07-06T19:59:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.824+0000 7fd1c3f41700 1 -- 172.21.15.6:0/3642557515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1bc13de10 con 0x7fd1bc14d610 2023-07-06T19:59:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.824+0000 7fd1c3f41700 1 -- 172.21.15.6:0/3642557515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1bc13e3d0 con 0x7fd1bc14d610 2023-07-06T19:59:20.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.824+0000 7fee58ff9700 1 -- 172.21.15.6:0/3199428886 <== osd.6 v2:172.21.15.40:6816/4092969902 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fee480774b0 con 0x7fee480749b0 2023-07-06T19:59:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.825+0000 7fd1c3f41700 1 -- 172.21.15.6:0/3642557515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd1bc06d1d0 con 0x7fd1bc14d610 2023-07-06T19:59:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.826+0000 7fd1b27fc700 1 -- 172.21.15.6:0/3642557515 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd1b4007370 con 0x7fd1bc14d610 2023-07-06T19:59:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.826+0000 7fd1b27fc700 1 --2- 172.21.15.6:0/3642557515 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd1a806ae60 0x7fd1a806d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.826+0000 7fd1b27fc700 1 -- 172.21.15.6:0/3642557515 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd1b4006e40 con 0x7fd1bc14d610 2023-07-06T19:59:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.826+0000 7fd1c1cdd700 1 --2- 172.21.15.6:0/3642557515 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd1a806ae60 0x7fd1a806d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.826+0000 7fd1b27fc700 1 --2- 172.21.15.6:0/3642557515 >> [v2:172.21.15.6:6824/49626386,v1:172.21.15.6:6825/49626386] conn(0x7fd1a8074a30 0x7fd1a8076e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.826+0000 7fd1b27fc700 1 -- 172.21.15.6:0/3642557515 --> [v2:172.21.15.6:6824/49626386,v1:172.21.15.6:6825/49626386] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd1a8077530 con 0x7fd1a8074a30 2023-07-06T19:59:20.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.826+0000 7fd1b27fc700 1 -- 172.21.15.6:0/3642557515 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1b408b9d0 con 0x7fd1bc14d610 2023-07-06T19:59:20.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.827+0000 7fd1c14dc700 1 --2- 172.21.15.6:0/3642557515 >> [v2:172.21.15.6:6824/49626386,v1:172.21.15.6:6825/49626386] conn(0x7fd1a8074a30 0x7fd1a8076e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:20.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.827+0000 7fd1c14dc700 1 --2- 172.21.15.6:0/3642557515 >> [v2:172.21.15.6:6824/49626386,v1:172.21.15.6:6825/49626386] conn(0x7fd1a8074a30 0x7fd1a8076e60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.827+0000 7f6491ffb700 1 -- 172.21.15.6:0/2361356198 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f648c01a400 con 0x7f649c0cd630 2023-07-06T19:59:20.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.828+0000 7fd1c1cdd700 1 --2- 172.21.15.6:0/3642557515 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd1a806ae60 0x7fd1a806d310 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00beb0 tx=0x7fd1ac00bf90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:20.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.828+0000 7f6491ffb700 1 --2- 172.21.15.6:0/2361356198 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f648806ae60 0x7f648806d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.828+0000 7f6491ffb700 1 -- 172.21.15.6:0/2361356198 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f648c089d80 con 0x7f649c0cd630 2023-07-06T19:59:21.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.828+0000 7f6491ffb700 1 --2- 172.21.15.6:0/2361356198 >> [v2:172.21.15.40:6824/4054264969,v1:172.21.15.40:6825/4054264969] conn(0x7f6488074ab0 0x7f6488076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.828+0000 7f6491ffb700 1 -- 172.21.15.6:0/2361356198 --> [v2:172.21.15.40:6824/4054264969,v1:172.21.15.40:6825/4054264969] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f64880775b0 con 0x7f6488074ab0 2023-07-06T19:59:21.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.828+0000 7f6491ffb700 1 -- 172.21.15.6:0/2361356198 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f648c08a1d0 con 0x7f649c0cd630 2023-07-06T19:59:21.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.828+0000 7fd1b27fc700 1 -- 172.21.15.6:0/3642557515 <== osd.3 v2:172.21.15.6:6824/49626386 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd1a8077530 con 0x7fd1a8074a30 2023-07-06T19:59:21.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.829+0000 7f64a107f700 1 --2- 172.21.15.6:0/2361356198 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f648806ae60 0x7f648806d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.829+0000 7f64a1880700 1 --2- 172.21.15.6:0/2361356198 >> [v2:172.21.15.40:6824/4054264969,v1:172.21.15.40:6825/4054264969] conn(0x7f6488074ab0 0x7f6488076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.829+0000 7efe54e31700 1 -- 172.21.15.6:0/3923523998 shutdown_connections 2023-07-06T19:59:21.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.829+0000 7efe54e31700 1 -- 172.21.15.6:0/3923523998 wait complete. 2023-07-06T19:59:21.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.829+0000 7f64a107f700 1 --2- 172.21.15.6:0/2361356198 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f648806ae60 0x7f648806d310 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6498009870 tx=0x7f6498008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.829+0000 7f64a1880700 1 --2- 172.21.15.6:0/2361356198 >> [v2:172.21.15.40:6824/4054264969,v1:172.21.15.40:6825/4054264969] conn(0x7f6488074ab0 0x7f6488076ee0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.830+0000 7f6491ffb700 1 -- 172.21.15.6:0/2361356198 <== osd.7 v2:172.21.15.40:6824/4054264969 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f64880775b0 con 0x7f6488074ab0 2023-07-06T19:59:21.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.831+0000 7efe54e31700 1 Processor -- start 2023-07-06T19:59:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.831+0000 7efe54e31700 1 -- start start 2023-07-06T19:59:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.831+0000 7efe54e31700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe5014f140 0x7efe50163c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.831+0000 7efe54e31700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe500ca700 0x7efe500cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.831+0000 7efe54e31700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe500cc340 0x7efe501f9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.831+0000 7efe54e31700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe500cc7b0 con 0x7efe500ca700 2023-07-06T19:59:21.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.831+0000 7efe54e31700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe501614a0 con 0x7efe500cc340 2023-07-06T19:59:21.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.831+0000 7efe54e31700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe500cb740 con 0x7efe5014f140 2023-07-06T19:59:21.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.832+0000 7efe4dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe500ca700 0x7efe500cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.832+0000 7fc092ffd700 1 --2- 172.21.15.6:0/3760234814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc09406a5a0 0x7fc0940b33a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc08400b410 tx=0x7fc08400b720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.832+0000 7efe4dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe500ca700 0x7efe500cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59042/0 (socket says 172.21.15.6:59042) 2023-07-06T19:59:21.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.832+0000 7efe4dd9b700 1 -- 172.21.15.6:0/3396183194 learned_addr learned my addr 172.21.15.6:0/3396183194 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:21.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.832+0000 7efe4ed9d700 1 --2- 172.21.15.6:0/3396183194 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe500cc340 0x7efe501f9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.832+0000 7efe4e59c700 1 --2- 172.21.15.6:0/3396183194 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe5014f140 0x7efe50163c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.832+0000 7efe4dd9b700 1 -- 172.21.15.6:0/3396183194 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe5014f140 msgr2=0x7efe50163c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.832+0000 7efe4dd9b700 1 --2- 172.21.15.6:0/3396183194 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe5014f140 0x7efe50163c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.832+0000 7efe4dd9b700 1 -- 172.21.15.6:0/3396183194 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe500cc340 msgr2=0x7efe501f9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.832+0000 7efe4dd9b700 1 --2- 172.21.15.6:0/3396183194 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe500cc340 0x7efe501f9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.832+0000 7efe4dd9b700 1 -- 172.21.15.6:0/3396183194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe500caea0 con 0x7efe500ca700 2023-07-06T19:59:21.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.832+0000 7efe4dd9b700 1 --2- 172.21.15.6:0/3396183194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe500ca700 0x7efe500cbe00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efe44007650 tx=0x7efe44007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.833+0000 7efe3effd700 1 -- 172.21.15.6:0/3396183194 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4400f930 con 0x7efe500ca700 2023-07-06T19:59:21.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.833+0000 7efe3effd700 1 -- 172.21.15.6:0/3396183194 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4400fa90 con 0x7efe500ca700 2023-07-06T19:59:21.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.833+0000 7efe3effd700 1 -- 172.21.15.6:0/3396183194 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4400fe00 con 0x7efe500ca700 2023-07-06T19:59:21.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.833+0000 7efe54e31700 1 -- 172.21.15.6:0/3396183194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe500cb180 con 0x7efe500ca700 2023-07-06T19:59:21.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.833+0000 7efe54e31700 1 -- 172.21.15.6:0/3396183194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe500cab70 con 0x7efe500ca700 2023-07-06T19:59:21.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.835+0000 7efe3effd700 1 -- 172.21.15.6:0/3396183194 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efe4401d460 con 0x7efe500ca700 2023-07-06T19:59:21.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.835+0000 7efe3effd700 1 --2- 172.21.15.6:0/3396183194 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efe3006ad30 0x7efe3006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.835+0000 7efe3effd700 1 -- 172.21.15.6:0/3396183194 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efe44089760 con 0x7efe500ca700 2023-07-06T19:59:21.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.835+0000 7efe4e59c700 1 --2- 172.21.15.6:0/3396183194 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efe3006ad30 0x7efe3006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.836+0000 7efe4e59c700 1 --2- 172.21.15.6:0/3396183194 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efe3006ad30 0x7efe3006d1e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efe400090b0 tx=0x7efe40008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.837+0000 7fc083fff700 1 -- 172.21.15.6:0/3760234814 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084011830 con 0x7fc09406a5a0 2023-07-06T19:59:21.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.837+0000 7fc083fff700 1 -- 172.21.15.6:0/3760234814 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0840119b0 con 0x7fc09406a5a0 2023-07-06T19:59:21.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.837+0000 7fc083fff700 1 -- 172.21.15.6:0/3760234814 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc084011d60 con 0x7fc09406a5a0 2023-07-06T19:59:21.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.837+0000 7fc099971700 1 -- 172.21.15.6:0/3760234814 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0940b28c0 con 0x7fc09406a5a0 2023-07-06T19:59:21.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.837+0000 7fc099971700 1 -- 172.21.15.6:0/3760234814 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0940b2e80 con 0x7fc09406a5a0 2023-07-06T19:59:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.839+0000 7fc083fff700 1 -- 172.21.15.6:0/3760234814 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc08401a400 con 0x7fc09406a5a0 2023-07-06T19:59:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.840+0000 7fc083fff700 1 --2- 172.21.15.6:0/3760234814 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc07806acb0 0x7fc07806d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.840+0000 7fc083fff700 1 -- 172.21.15.6:0/3760234814 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc0840895b0 con 0x7fc09406a5a0 2023-07-06T19:59:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.840+0000 7fc0927fc700 1 --2- 172.21.15.6:0/3760234814 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc07806acb0 0x7fc07806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.840+0000 7fc0927fc700 1 --2- 172.21.15.6:0/3760234814 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc07806acb0 0x7fc07806d160 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc0940b04b0 tx=0x7fc08c010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.845+0000 7f9505b26700 1 -- 172.21.15.6:0/4264949826 --> [v2:172.21.15.6:6800/3393411907,v1:172.21.15.6:6801/3393411907] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9500161140 con 0x7f94ec074a80 2023-07-06T19:59:21.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.846+0000 7f94e7fff700 1 -- 172.21.15.6:0/4264949826 <== osd.1 v2:172.21.15.6:6800/3393411907 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9500161140 con 0x7f94ec074a80 2023-07-06T19:59:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.847+0000 7f9505b26700 1 -- 172.21.15.6:0/4264949826 >> [v2:172.21.15.6:6800/3393411907,v1:172.21.15.6:6801/3393411907] conn(0x7f94ec074a80 msgr2=0x7f94ec076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.847+0000 7f9505b26700 1 --2- 172.21.15.6:0/4264949826 >> [v2:172.21.15.6:6800/3393411907,v1:172.21.15.6:6801/3393411907] conn(0x7f94ec074a80 0x7f94ec076eb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.846+0000 7efe54e31700 1 --2- 172.21.15.6:0/3396183194 >> [v2:172.21.15.6:6816/2050035126,v1:172.21.15.6:6817/2050035126] conn(0x7efe501fa280 0x7efe501fa650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.846+0000 7efe54e31700 1 -- 172.21.15.6:0/3396183194 --> [v2:172.21.15.6:6816/2050035126,v1:172.21.15.6:6817/2050035126] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe5006a590 con 0x7efe501fa280 2023-07-06T19:59:21.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.847+0000 7efe4ed9d700 1 --2- 172.21.15.6:0/3396183194 >> [v2:172.21.15.6:6816/2050035126,v1:172.21.15.6:6817/2050035126] conn(0x7efe501fa280 0x7efe501fa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.847+0000 7efe4ed9d700 1 --2- 172.21.15.6:0/3396183194 >> [v2:172.21.15.6:6816/2050035126,v1:172.21.15.6:6817/2050035126] conn(0x7efe501fa280 0x7efe501fa650 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.848+0000 7f9505b26700 1 -- 172.21.15.6:0/4264949826 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f94ec06adb0 msgr2=0x7f94ec06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.848+0000 7f9505b26700 1 --2- 172.21.15.6:0/4264949826 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f94ec06adb0 0x7f94ec06d260 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9500071a20 tx=0x7f94f8009000 comp rx=0 tx=0).stop 2023-07-06T19:59:21.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.848+0000 7f9505b26700 1 -- 172.21.15.6:0/4264949826 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95000ca440 msgr2=0x7f95000b1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.848+0000 7f9505b26700 1 --2- 172.21.15.6:0/4264949826 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f95000ca440 0x7f95000b1740 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f94f400b470 tx=0x7f94f400b780 comp rx=0 tx=0).stop 2023-07-06T19:59:21.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.848+0000 7f94fffff700 1 -- 172.21.15.6:0/4264949826 reap_dead start 2023-07-06T19:59:21.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.848+0000 7fc099971700 1 --2- 172.21.15.6:0/3760234814 >> [v2:172.21.15.40:6808/23442053,v1:172.21.15.40:6809/23442053] conn(0x7fc0940c36b0 0x7fc09414eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.848+0000 7fc099971700 1 -- 172.21.15.6:0/3760234814 --> [v2:172.21.15.40:6808/23442053,v1:172.21.15.40:6809/23442053] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc09406c930 con 0x7fc0940c36b0 2023-07-06T19:59:21.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.848+0000 7fc0937fe700 1 --2- 172.21.15.6:0/3760234814 >> [v2:172.21.15.40:6808/23442053,v1:172.21.15.40:6809/23442053] conn(0x7fc0940c36b0 0x7fc09414eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.849+0000 7fc0937fe700 1 --2- 172.21.15.6:0/3760234814 >> [v2:172.21.15.40:6808/23442053,v1:172.21.15.40:6809/23442053] conn(0x7fc0940c36b0 0x7fc09414eed0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.849+0000 7fc083fff700 1 -- 172.21.15.6:0/3760234814 <== osd.5 v2:172.21.15.40:6808/23442053 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc0880096a0 con 0x7fc0940c36b0 2023-07-06T19:59:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.851+0000 7f9505b26700 1 -- 172.21.15.6:0/4264949826 shutdown_connections 2023-07-06T19:59:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.851+0000 7f9505b26700 1 -- 172.21.15.6:0/4264949826 >> 172.21.15.6:0/4264949826 conn(0x7f95000cf420 msgr2=0x7f95000c36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.851+0000 7f9505b26700 1 -- 172.21.15.6:0/4264949826 shutdown_connections 2023-07-06T19:59:21.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.851+0000 7f9505b26700 1 -- 172.21.15.6:0/4264949826 wait complete. 2023-07-06T19:59:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.852+0000 7efe3effd700 1 -- 172.21.15.6:0/3396183194 <== osd.2 v2:172.21.15.6:6816/2050035126 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7efe48004610 con 0x7efe501fa280 2023-07-06T19:59:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.853+0000 7f1f5bd41700 1 -- 172.21.15.6:0/3263078675 --> [v2:172.21.15.40:6800/2298149583,v1:172.21.15.40:6801/2298149583] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1f5406a4e0 con 0x7f1f38074a80 2023-07-06T19:59:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.853+0000 7f1f4a7fc700 1 -- 172.21.15.6:0/3263078675 <== osd.4 v2:172.21.15.40:6800/2298149583 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1f4c003b80 con 0x7f1f38074a80 2023-07-06T19:59:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.854+0000 7f1f5bd41700 1 -- 172.21.15.6:0/3263078675 >> [v2:172.21.15.40:6800/2298149583,v1:172.21.15.40:6801/2298149583] conn(0x7f1f38074a80 msgr2=0x7f1f38076eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.854+0000 7f1f5bd41700 1 --2- 172.21.15.6:0/3263078675 >> [v2:172.21.15.40:6800/2298149583,v1:172.21.15.40:6801/2298149583] conn(0x7f1f38074a80 0x7f1f38076eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.854+0000 7f1f5bd41700 1 -- 172.21.15.6:0/3263078675 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1f3806adb0 msgr2=0x7f1f3806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.854+0000 7f1f5bd41700 1 --2- 172.21.15.6:0/3263078675 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1f3806adb0 0x7f1f3806d260 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1f44006f10 tx=0x7f1f44008040 comp rx=0 tx=0).stop 2023-07-06T19:59:21.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.854+0000 7f1f5bd41700 1 -- 172.21.15.6:0/3263078675 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f5406cd60 msgr2=0x7f1f54160fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.854+0000 7f1f5bd41700 1 --2- 172.21.15.6:0/3263078675 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f5406cd60 0x7f1f54160fa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1f5000c550 tx=0x7f1f5000c860 comp rx=0 tx=0).stop 2023-07-06T19:59:21.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.854+0000 7f1f5a2de700 1 -- 172.21.15.6:0/3263078675 reap_dead start 2023-07-06T19:59:21.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.854+0000 7f1f5bd41700 1 -- 172.21.15.6:0/3263078675 shutdown_connections 2023-07-06T19:59:21.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.854+0000 7f1f5bd41700 1 -- 172.21.15.6:0/3263078675 >> 172.21.15.6:0/3263078675 conn(0x7f1f540cf420 msgr2=0x7f1f5414ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:21.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.854+0000 7f1f5bd41700 1 -- 172.21.15.6:0/3263078675 shutdown_connections 2023-07-06T19:59:21.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.854+0000 7f1f5bd41700 1 -- 172.21.15.6:0/3263078675 wait complete. 2023-07-06T19:59:21.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.855+0000 7f0bab97b700 1 -- 172.21.15.6:0/3227967690 --> [v2:172.21.15.6:6808/43500803,v1:172.21.15.6:6809/43500803] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0ba406a190 con 0x7f0b880749b0 2023-07-06T19:59:21.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.856+0000 7f0b99ffb700 1 -- 172.21.15.6:0/3227967690 <== osd.0 v2:172.21.15.6:6808/43500803 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0b9c00a700 con 0x7f0b880749b0 2023-07-06T19:59:21.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.857+0000 7fee6267a700 1 -- 172.21.15.6:0/3199428886 --> [v2:172.21.15.40:6816/4092969902,v1:172.21.15.40:6817/4092969902] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fee5c06cc10 con 0x7fee480749b0 2023-07-06T19:59:21.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.857+0000 7fee58ff9700 1 -- 172.21.15.6:0/3199428886 <== osd.6 v2:172.21.15.40:6816/4092969902 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fee5400a5e0 con 0x7fee480749b0 2023-07-06T19:59:21.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.858+0000 7f0bab97b700 1 -- 172.21.15.6:0/3227967690 >> [v2:172.21.15.6:6808/43500803,v1:172.21.15.6:6809/43500803] conn(0x7f0b880749b0 msgr2=0x7f0b88076de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.858+0000 7f0bab97b700 1 --2- 172.21.15.6:0/3227967690 >> [v2:172.21.15.6:6808/43500803,v1:172.21.15.6:6809/43500803] conn(0x7f0b880749b0 0x7f0b88076de0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.860+0000 7fee6267a700 1 -- 172.21.15.6:0/3199428886 >> [v2:172.21.15.40:6816/4092969902,v1:172.21.15.40:6817/4092969902] conn(0x7fee480749b0 msgr2=0x7fee48076de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.860+0000 7fee6267a700 1 --2- 172.21.15.6:0/3199428886 >> [v2:172.21.15.40:6816/4092969902,v1:172.21.15.40:6817/4092969902] conn(0x7fee480749b0 0x7fee48076de0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.860+0000 7fee6267a700 1 -- 172.21.15.6:0/3199428886 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fee4806ace0 msgr2=0x7fee4806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.860+0000 7fee6267a700 1 --2- 172.21.15.6:0/3199428886 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fee4806ace0 0x7fee4806d190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fee50001930 tx=0x7fee50007000 comp rx=0 tx=0).stop 2023-07-06T19:59:21.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.860+0000 7fee6267a700 1 -- 172.21.15.6:0/3199428886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee5c0c7230 msgr2=0x7fee5c0b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.860+0000 7fee6267a700 1 --2- 172.21.15.6:0/3199428886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee5c0c7230 0x7fee5c0b3030 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00d800 tx=0x7fee4c00db10 comp rx=0 tx=0).stop 2023-07-06T19:59:21.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.860+0000 7fee60c17700 1 -- 172.21.15.6:0/3199428886 reap_dead start 2023-07-06T19:59:21.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.860+0000 7fee6267a700 1 -- 172.21.15.6:0/3199428886 shutdown_connections 2023-07-06T19:59:21.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.860+0000 7fee6267a700 1 -- 172.21.15.6:0/3199428886 >> 172.21.15.6:0/3199428886 conn(0x7fee5c0cf420 msgr2=0x7fee5c14e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:21.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.860+0000 7fee6267a700 1 -- 172.21.15.6:0/3199428886 shutdown_connections 2023-07-06T19:59:21.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.860+0000 7fee6267a700 1 -- 172.21.15.6:0/3199428886 wait complete. 2023-07-06T19:59:21.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.865+0000 7f0bab97b700 1 -- 172.21.15.6:0/3227967690 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0b8806ace0 msgr2=0x7f0b8806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.865+0000 7f0bab97b700 1 --2- 172.21.15.6:0/3227967690 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0b8806ace0 0x7f0b8806d190 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4156160 tx=0x7f0ba0007a20 comp rx=0 tx=0).stop 2023-07-06T19:59:21.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.865+0000 7f0bab97b700 1 -- 172.21.15.6:0/3227967690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ba415bdd0 msgr2=0x7f0ba41f6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.865+0000 7f0bab97b700 1 --2- 172.21.15.6:0/3227967690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ba415bdd0 0x7f0ba41f6ba0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0b94004000 tx=0x7f0b94004750 comp rx=0 tx=0).stop 2023-07-06T19:59:21.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.865+0000 7f0ba9f18700 1 -- 172.21.15.6:0/3227967690 reap_dead start 2023-07-06T19:59:21.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.865+0000 7f0bab97b700 1 -- 172.21.15.6:0/3227967690 shutdown_connections 2023-07-06T19:59:21.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.865+0000 7f0bab97b700 1 -- 172.21.15.6:0/3227967690 >> 172.21.15.6:0/3227967690 conn(0x7f0ba40cf420 msgr2=0x7f0ba40ccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:21.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.869+0000 7f0bab97b700 1 -- 172.21.15.6:0/3227967690 shutdown_connections 2023-07-06T19:59:21.088 INFO:teuthology.orchestra.run.smithi006.stdout:55834574859 2023-07-06T19:59:21.089 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-06T19:59:21.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.871+0000 7f64a32e3700 1 -- 172.21.15.6:0/2361356198 --> [v2:172.21.15.40:6824/4054264969,v1:172.21.15.40:6825/4054264969] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6480002d70 con 0x7f6488074ab0 2023-07-06T19:59:21.096 INFO:teuthology.orchestra.run.smithi006.stdout:55834574860 2023-07-06T19:59:21.098 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-06T19:59:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.871+0000 7f6491ffb700 1 -- 172.21.15.6:0/2361356198 <== osd.7 v2:172.21.15.40:6824/4054264969 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6480002d70 con 0x7f6488074ab0 2023-07-06T19:59:21.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.873+0000 7f64a32e3700 1 -- 172.21.15.6:0/2361356198 >> [v2:172.21.15.40:6824/4054264969,v1:172.21.15.40:6825/4054264969] conn(0x7f6488074ab0 msgr2=0x7f6488076ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.873+0000 7f64a32e3700 1 --2- 172.21.15.6:0/2361356198 >> [v2:172.21.15.40:6824/4054264969,v1:172.21.15.40:6825/4054264969] conn(0x7f6488074ab0 0x7f6488076ee0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.875+0000 7f64a32e3700 1 -- 172.21.15.6:0/2361356198 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f648806ae60 msgr2=0x7f648806d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.875+0000 7f64a32e3700 1 --2- 172.21.15.6:0/2361356198 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f648806ae60 0x7f648806d310 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6498009870 tx=0x7f6498008040 comp rx=0 tx=0).stop 2023-07-06T19:59:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.875+0000 7f64a32e3700 1 -- 172.21.15.6:0/2361356198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f649c0cd630 msgr2=0x7f649c157280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.875+0000 7f64a32e3700 1 --2- 172.21.15.6:0/2361356198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f649c0cd630 0x7f649c157280 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f648c00b450 tx=0x7f648c00b810 comp rx=0 tx=0).stop 2023-07-06T19:59:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.875+0000 7f64a1880700 1 -- 172.21.15.6:0/2361356198 reap_dead start 2023-07-06T19:59:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.875+0000 7f64a32e3700 1 -- 172.21.15.6:0/2361356198 shutdown_connections 2023-07-06T19:59:21.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.875+0000 7f64a32e3700 1 -- 172.21.15.6:0/2361356198 >> 172.21.15.6:0/2361356198 conn(0x7f649c0b0b60 msgr2=0x7f649c153570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:21.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.876+0000 7f0bab97b700 1 -- 172.21.15.6:0/3227967690 wait complete. 2023-07-06T19:59:21.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.876+0000 7efe54e31700 1 -- 172.21.15.6:0/3396183194 --> [v2:172.21.15.6:6816/2050035126,v1:172.21.15.6:6817/2050035126] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efe5006ab50 con 0x7efe501fa280 2023-07-06T19:59:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.876+0000 7f64a32e3700 1 -- 172.21.15.6:0/2361356198 shutdown_connections 2023-07-06T19:59:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.877+0000 7efe3effd700 1 -- 172.21.15.6:0/3396183194 <== osd.2 v2:172.21.15.6:6816/2050035126 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efe48013390 con 0x7efe501fa280 2023-07-06T19:59:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.877+0000 7fd1c3f41700 1 -- 172.21.15.6:0/3642557515 --> [v2:172.21.15.6:6824/49626386,v1:172.21.15.6:6825/49626386] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd1bc06cef0 con 0x7fd1a8074a30 2023-07-06T19:59:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.877+0000 7f64a32e3700 1 -- 172.21.15.6:0/2361356198 wait complete. 2023-07-06T19:59:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.878+0000 7efe54e31700 1 -- 172.21.15.6:0/3396183194 >> [v2:172.21.15.6:6816/2050035126,v1:172.21.15.6:6817/2050035126] conn(0x7efe501fa280 msgr2=0x7efe501fa650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.878+0000 7efe54e31700 1 --2- 172.21.15.6:0/3396183194 >> [v2:172.21.15.6:6816/2050035126,v1:172.21.15.6:6817/2050035126] conn(0x7efe501fa280 0x7efe501fa650 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.878+0000 7fd1b27fc700 1 -- 172.21.15.6:0/3642557515 <== osd.3 v2:172.21.15.6:6824/49626386 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd1b80012b0 con 0x7fd1a8074a30 2023-07-06T19:59:21.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.878+0000 7efe54e31700 1 -- 172.21.15.6:0/3396183194 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efe3006ad30 msgr2=0x7efe3006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.878+0000 7efe54e31700 1 --2- 172.21.15.6:0/3396183194 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efe3006ad30 0x7efe3006d1e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7efe400090b0 tx=0x7efe40008030 comp rx=0 tx=0).stop 2023-07-06T19:59:21.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.878+0000 7fd1c3f41700 1 -- 172.21.15.6:0/3642557515 >> [v2:172.21.15.6:6824/49626386,v1:172.21.15.6:6825/49626386] conn(0x7fd1a8074a30 msgr2=0x7fd1a8076e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.878+0000 7fd1c3f41700 1 --2- 172.21.15.6:0/3642557515 >> [v2:172.21.15.6:6824/49626386,v1:172.21.15.6:6825/49626386] conn(0x7fd1a8074a30 0x7fd1a8076e60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.878+0000 7efe54e31700 1 -- 172.21.15.6:0/3396183194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe500ca700 msgr2=0x7efe500cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.878+0000 7efe54e31700 1 --2- 172.21.15.6:0/3396183194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe500ca700 0x7efe500cbe00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efe44007650 tx=0x7efe44007d40 comp rx=0 tx=0).stop 2023-07-06T19:59:21.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.878+0000 7efe4ed9d700 1 -- 172.21.15.6:0/3396183194 reap_dead start 2023-07-06T19:59:21.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.878+0000 7efe54e31700 1 -- 172.21.15.6:0/3396183194 shutdown_connections 2023-07-06T19:59:21.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.878+0000 7efe54e31700 1 -- 172.21.15.6:0/3396183194 >> 172.21.15.6:0/3396183194 conn(0x7efe500d3900 msgr2=0x7efe500b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:21.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.878+0000 7fd1c3f41700 1 -- 172.21.15.6:0/3642557515 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd1a806ae60 msgr2=0x7fd1a806d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.878+0000 7fd1c3f41700 1 --2- 172.21.15.6:0/3642557515 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd1a806ae60 0x7fd1a806d310 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac00beb0 tx=0x7fd1ac00bf90 comp rx=0 tx=0).stop 2023-07-06T19:59:21.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.878+0000 7fd1c3f41700 1 -- 172.21.15.6:0/3642557515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1bc14d610 msgr2=0x7fd1bc0cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.878+0000 7fd1c3f41700 1 --2- 172.21.15.6:0/3642557515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1bc14d610 0x7fd1bc0cd0c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400b970 tx=0x7fd1b400bc80 comp rx=0 tx=0).stop 2023-07-06T19:59:21.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.878+0000 7fd1c24de700 1 -- 172.21.15.6:0/3642557515 reap_dead start 2023-07-06T19:59:21.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.878+0000 7fd1c3f41700 1 -- 172.21.15.6:0/3642557515 shutdown_connections 2023-07-06T19:59:21.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.878+0000 7fd1c3f41700 1 -- 172.21.15.6:0/3642557515 >> 172.21.15.6:0/3642557515 conn(0x7fd1bc0cf420 msgr2=0x7fd1bc0c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:21.115 INFO:teuthology.orchestra.run.smithi006.stdout:55834574860 2023-07-06T19:59:21.117 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-06T19:59:21.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.879+0000 7efe54e31700 1 -- 172.21.15.6:0/3396183194 shutdown_connections 2023-07-06T19:59:21.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.879+0000 7efe54e31700 1 -- 172.21.15.6:0/3396183194 wait complete. 2023-07-06T19:59:21.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.880+0000 7fd1c3f41700 1 -- 172.21.15.6:0/3642557515 shutdown_connections 2023-07-06T19:59:21.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.880+0000 7fd1c3f41700 1 -- 172.21.15.6:0/3642557515 wait complete. 2023-07-06T19:59:21.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.883+0000 7fc099971700 1 -- 172.21.15.6:0/3760234814 --> [v2:172.21.15.40:6808/23442053,v1:172.21.15.40:6809/23442053] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc09406cef0 con 0x7fc0940c36b0 2023-07-06T19:59:21.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.884+0000 7fc083fff700 1 -- 172.21.15.6:0/3760234814 <== osd.5 v2:172.21.15.40:6808/23442053 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc088009b10 con 0x7fc0940c36b0 2023-07-06T19:59:21.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.885+0000 7fc099971700 1 -- 172.21.15.6:0/3760234814 >> [v2:172.21.15.40:6808/23442053,v1:172.21.15.40:6809/23442053] conn(0x7fc0940c36b0 msgr2=0x7fc09414eed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.885+0000 7fc099971700 1 --2- 172.21.15.6:0/3760234814 >> [v2:172.21.15.40:6808/23442053,v1:172.21.15.40:6809/23442053] conn(0x7fc0940c36b0 0x7fc09414eed0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.885+0000 7fc099971700 1 -- 172.21.15.6:0/3760234814 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc07806acb0 msgr2=0x7fc07806d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.885+0000 7fc099971700 1 --2- 172.21.15.6:0/3760234814 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc07806acb0 0x7fc07806d160 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc0940b04b0 tx=0x7fc08c010000 comp rx=0 tx=0).stop 2023-07-06T19:59:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.885+0000 7fc099971700 1 -- 172.21.15.6:0/3760234814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc09406a5a0 msgr2=0x7fc0940b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.885+0000 7fc099971700 1 --2- 172.21.15.6:0/3760234814 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc09406a5a0 0x7fc0940b33a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc08400b410 tx=0x7fc08400b720 comp rx=0 tx=0).stop 2023-07-06T19:59:21.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.885+0000 7fc0937fe700 1 -- 172.21.15.6:0/3760234814 reap_dead start 2023-07-06T19:59:21.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.885+0000 7fc099971700 1 -- 172.21.15.6:0/3760234814 shutdown_connections 2023-07-06T19:59:21.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.885+0000 7fc099971700 1 -- 172.21.15.6:0/3760234814 >> 172.21.15.6:0/3760234814 conn(0x7fc0940cf420 msgr2=0x7fc094070480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:21.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.885+0000 7fc099971700 1 -- 172.21.15.6:0/3760234814 shutdown_connections 2023-07-06T19:59:21.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:20.885+0000 7fc099971700 1 -- 172.21.15.6:0/3760234814 wait complete. 2023-07-06T19:59:21.137 INFO:teuthology.orchestra.run.smithi006.stdout:55834574860 2023-07-06T19:59:21.138 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-06T19:59:21.139 INFO:teuthology.orchestra.run.smithi006.stdout:55834574860 2023-07-06T19:59:21.140 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-06T19:59:21.141 INFO:teuthology.orchestra.run.smithi006.stdout:55834574860 2023-07-06T19:59:21.141 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-06T19:59:21.142 INFO:teuthology.orchestra.run.smithi006.stdout:55834574860 2023-07-06T19:59:21.142 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-06T19:59:21.150 INFO:teuthology.orchestra.run.smithi006.stdout:55834574861 2023-07-06T19:59:21.150 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-06T19:59:21.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.400+0000 7f990478e700 1 Processor -- start 2023-07-06T19:59:21.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.400+0000 7f990478e700 1 -- start start 2023-07-06T19:59:21.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.401+0000 7f990478e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98fc156d00 0x7f98fc159620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.401+0000 7f990478e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f98fc06aa70 0x7f98fc06ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.401+0000 7f990478e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98fc1570d0 con 0x7f98fc159b60 2023-07-06T19:59:21.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.401+0000 7f990478e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98fc0cc3a0 con 0x7f98fc06aa70 2023-07-06T19:59:21.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.401+0000 7f990478e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc0cb040 con 0x7f98fc156d00 2023-07-06T19:59:21.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.401+0000 7f990252a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98fc156d00 0x7f98fc159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.401+0000 7f9902d2b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f98fc06aa70 0x7f98fc06ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.401+0000 7f9902d2b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f98fc06aa70 0x7f98fc06ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:38092/0 (socket says 172.21.15.6:38092) 2023-07-06T19:59:21.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.401+0000 7f990252a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98fc156d00 0x7f98fc159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:51698/0 (socket says 172.21.15.6:51698) 2023-07-06T19:59:21.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.401+0000 7f9902d2b700 1 -- 172.21.15.6:0/2933830746 learned_addr learned my addr 172.21.15.6:0/2933830746 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:21.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.402+0000 7f9902d2b700 1 -- 172.21.15.6:0/2933830746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98fc156d00 msgr2=0x7f98fc159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:21.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.402+0000 7f9902d2b700 1 --2- 172.21.15.6:0/2933830746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98fc156d00 0x7f98fc159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.402+0000 7f9902d2b700 1 -- 172.21.15.6:0/2933830746 >> v1:172.21.15.40:6789/0 conn(0x7f98fc159b60 legacy=0x7f98fc159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.402+0000 7f9902d2b700 1 -- 172.21.15.6:0/2933830746 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc0b1200 con 0x7f98fc06aa70 2023-07-06T19:59:21.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.402+0000 7f990252a700 1 --2- 172.21.15.6:0/2933830746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98fc156d00 0x7f98fc159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:59:21.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.402+0000 7f9902d2b700 1 --2- 172.21.15.6:0/2933830746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98fc06aa70 0x7f98fc06ae90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f98f80098f0 tx=0x7f98f8009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3b179110245223 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.402+0000 7f9901528700 1 -- 172.21.15.6:0/2933830746 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f8011830 con 0x7f98fc06aa70 2023-07-06T19:59:21.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.403+0000 7f54db790700 1 Processor -- start 2023-07-06T19:59:21.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.403+0000 7f54db790700 1 -- start start 2023-07-06T19:59:21.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.404+0000 7f519e234700 1 Processor -- start 2023-07-06T19:59:21.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.404+0000 7f519e234700 1 -- start start 2023-07-06T19:59:21.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.405+0000 7f9901528700 1 -- 172.21.15.6:0/2933830746 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f8011990 con 0x7f98fc06aa70 2023-07-06T19:59:21.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.405+0000 7f9901528700 1 -- 172.21.15.6:0/2933830746 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f8011d20 con 0x7f98fc06aa70 2023-07-06T19:59:21.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.405+0000 7f54db790700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f54d415cd40 0x7f54d41592b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.405+0000 7f54db790700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f54d40cd950 0x7f54d4071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.405+0000 7f54db790700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54d4071bd0 0x7f54d406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.405+0000 7f54db790700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d4072050 con 0x7f54d40cd950 2023-07-06T19:59:21.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.405+0000 7f54db790700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d41600b0 con 0x7f54d415cd40 2023-07-06T19:59:21.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.405+0000 7f54db790700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d415d2b0 con 0x7f54d4071bd0 2023-07-06T19:59:21.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.405+0000 7f54d952c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f54d415cd40 0x7f54d41592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.405+0000 7f54d952c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f54d415cd40 0x7f54d41592b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:38096/0 (socket says 172.21.15.6:38096) 2023-07-06T19:59:21.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.405+0000 7f54d952c700 1 -- 172.21.15.6:0/3475008780 learned_addr learned my addr 172.21.15.6:0/3475008780 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:21.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.405+0000 7f519e234700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f519815c660 0x7f519806c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.405+0000 7f54d8d2b700 1 --2- 172.21.15.6:0/3475008780 >> v2:172.21.15.6:3300/0 conn(0x7f54d40cd950 0x7f54d4071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.405+0000 7f519e234700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519815ca30 con 0x7f519806a160 2023-07-06T19:59:21.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.405+0000 7f519e234700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51980ccdb0 con 0x7f51980b1060 2023-07-06T19:59:21.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.405+0000 7f519e234700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51980cd000 con 0x7f519815c660 2023-07-06T19:59:21.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.406+0000 7f990478e700 1 -- 172.21.15.6:0/2933830746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98fc06aa70 msgr2=0x7f98fc06ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.406+0000 7f990478e700 1 --2- 172.21.15.6:0/2933830746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98fc06aa70 0x7f98fc06ae90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f98f80098f0 tx=0x7f98f8009c00 comp rx=0 tx=0).stop 2023-07-06T19:59:21.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.406+0000 7f54d8d2b700 1 -- 172.21.15.6:0/3475008780 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54d4071bd0 msgr2=0x7f54d406d8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T19:59:21.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.406+0000 7f54d8d2b700 1 --2- 172.21.15.6:0/3475008780 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54d4071bd0 0x7f54d406d8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.406+0000 7f54d8d2b700 1 -- 172.21.15.6:0/3475008780 >> v2:172.21.15.40:3300/0 conn(0x7f54d415cd40 msgr2=0x7f54d41592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:21.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.406+0000 7f54d8d2b700 1 --2- 172.21.15.6:0/3475008780 >> v2:172.21.15.40:3300/0 conn(0x7f54d415cd40 0x7f54d41592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.406+0000 7f54d8d2b700 1 -- 172.21.15.6:0/3475008780 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d415d590 con 0x7f54d40cd950 2023-07-06T19:59:21.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.406+0000 7f990478e700 1 -- 172.21.15.6:0/2933830746 shutdown_connections 2023-07-06T19:59:21.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.406+0000 7f990478e700 1 --2- 172.21.15.6:0/2933830746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98fc06aa70 0x7f98fc06ae90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.406+0000 7f990478e700 1 --2- 172.21.15.6:0/2933830746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98fc156d00 0x7f98fc159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.406+0000 7f990478e700 1 -- 172.21.15.6:0/2933830746 >> 172.21.15.6:0/2933830746 conn(0x7f98fc0cf420 msgr2=0x7f98fc0cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:21.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.406+0000 7f990478e700 1 -- 172.21.15.6:0/2933830746 shutdown_connections 2023-07-06T19:59:21.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.406+0000 7f990478e700 1 -- 172.21.15.6:0/2933830746 wait complete. 2023-07-06T19:59:21.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.406+0000 7f54d8d2b700 1 --2- 172.21.15.6:0/3475008780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54d40cd950 0x7f54d4071690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f54d406a800 tx=0x7f54c4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2931aeee551e10b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.406+0000 7f51977fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f519815c660 0x7f519806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.406+0000 7f51977fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f519815c660 0x7f519806c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59070/0 (socket says 172.21.15.6:59070) 2023-07-06T19:59:21.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.406+0000 7f51977fe700 1 -- 172.21.15.6:0/2279303713 learned_addr learned my addr 172.21.15.6:0/2279303713 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:21.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.406+0000 7f69fe90a700 1 Processor -- start 2023-07-06T19:59:21.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.406+0000 7f69fe90a700 1 -- start start 2023-07-06T19:59:21.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.406+0000 7f51977fe700 1 -- 172.21.15.6:0/2279303713 >> v1:172.21.15.40:6789/0 conn(0x7f51980b1060 legacy=0x7f519806cb90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T19:59:21.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.406+0000 7f51977fe700 1 -- 172.21.15.6:0/2279303713 >> v1:172.21.15.6:6789/0 conn(0x7f519806a160 legacy=0x7f519806a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:21.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.406+0000 7f51977fe700 1 -- 172.21.15.6:0/2279303713 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51980cd2e0 con 0x7f519815c660 2023-07-06T19:59:21.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.407+0000 7f51977fe700 1 --2- 172.21.15.6:0/2279303713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f519815c660 0x7f519806c650 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f518c0098f0 tx=0x7f518c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed04bbc1ef8d241 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.407+0000 7f51967fc700 1 -- 172.21.15.6:0/2279303713 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c004230 con 0x7f519815c660 2023-07-06T19:59:21.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.407+0000 7f51967fc700 1 -- 172.21.15.6:0/2279303713 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518c004390 con 0x7f519815c660 2023-07-06T19:59:21.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.408+0000 7f990478e700 1 Processor -- start 2023-07-06T19:59:21.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.407+0000 7f51967fc700 1 -- 172.21.15.6:0/2279303713 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c0036a0 con 0x7f519815c660 2023-07-06T19:59:21.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.407+0000 7f54cbfff700 1 -- 172.21.15.6:0/3475008780 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4011830 con 0x7f54d40cd950 2023-07-06T19:59:21.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.407+0000 7f54cbfff700 1 -- 172.21.15.6:0/3475008780 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c4011990 con 0x7f54d40cd950 2023-07-06T19:59:21.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.407+0000 7f54cbfff700 1 -- 172.21.15.6:0/3475008780 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4011d00 con 0x7f54d40cd950 2023-07-06T19:59:21.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.408+0000 7f54db790700 1 -- 172.21.15.6:0/3475008780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54d40cd950 msgr2=0x7f54d4071690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.408+0000 7f54db790700 1 --2- 172.21.15.6:0/3475008780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54d40cd950 0x7f54d4071690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f54d406a800 tx=0x7f54c4009b20 comp rx=0 tx=0).stop 2023-07-06T19:59:21.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.409+0000 7f76e971a700 1 Processor -- start 2023-07-06T19:59:21.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.409+0000 7f76e971a700 1 -- start start 2023-07-06T19:59:21.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.408+0000 7f990478e700 1 -- start start 2023-07-06T19:59:21.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.409+0000 7f990478e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98fc06aa70 0x7f98fc13d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.409+0000 7f990478e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98fc156d00 0x7f98fc06cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.409+0000 7f990478e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98fc159b60 0x7f98fc06d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.409+0000 7f990478e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc0c6400 con 0x7f98fc159b60 2023-07-06T19:59:21.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.409+0000 7f990478e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc15c2f0 con 0x7f98fc06aa70 2023-07-06T19:59:21.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.409+0000 7f990478e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc15b250 con 0x7f98fc156d00 2023-07-06T19:59:21.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.409+0000 7f69fe90a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f69f815d790 0x7f69f806b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.409+0000 7f69fe90a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f69f815ea40 0x7f69f80b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.409+0000 7f69fe90a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69f80b2800 0x7f69f806cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.409+0000 7f69fe90a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f806cb60 con 0x7f69f815ea40 2023-07-06T19:59:21.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.409+0000 7f69fe90a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f80ca780 con 0x7f69f815d790 2023-07-06T19:59:21.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.409+0000 7f69fe90a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f80ca1c0 con 0x7f69f80b2800 2023-07-06T19:59:21.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.409+0000 7f69f7fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f69f815d790 0x7f69f806b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.408+0000 7f519e234700 1 -- 172.21.15.6:0/2279303713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f519815c660 msgr2=0x7f519806c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.408+0000 7f519e234700 1 --2- 172.21.15.6:0/2279303713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f519815c660 0x7f519806c650 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f518c0098f0 tx=0x7f518c009c00 comp rx=0 tx=0).stop 2023-07-06T19:59:21.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.408+0000 7f519e234700 1 -- 172.21.15.6:0/2279303713 shutdown_connections 2023-07-06T19:59:21.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.408+0000 7f519e234700 1 --2- 172.21.15.6:0/2279303713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f519815c660 0x7f519806c650 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.408+0000 7f519e234700 1 -- 172.21.15.6:0/2279303713 >> 172.21.15.6:0/2279303713 conn(0x7f51980cf420 msgr2=0x7f51980cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:21.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.408+0000 7f519e234700 1 -- 172.21.15.6:0/2279303713 shutdown_connections 2023-07-06T19:59:21.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.409+0000 7f69f7fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f69f815d790 0x7f69f806b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:38108/0 (socket says 172.21.15.6:38108) 2023-07-06T19:59:21.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.409+0000 7f69f7fff700 1 -- 172.21.15.6:0/248030209 learned_addr learned my addr 172.21.15.6:0/248030209 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:21.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.410+0000 7f9901d29700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98fc156d00 0x7f98fc06cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.410+0000 7f9901d29700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98fc156d00 0x7f98fc06cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:51722/0 (socket says 172.21.15.6:51722) 2023-07-06T19:59:21.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.410+0000 7f9901d29700 1 -- 172.21.15.6:0/160209594 learned_addr learned my addr 172.21.15.6:0/160209594 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:21.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.408+0000 7f54db790700 1 -- 172.21.15.6:0/3475008780 shutdown_connections 2023-07-06T19:59:21.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.408+0000 7f54db790700 1 --2- 172.21.15.6:0/3475008780 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54d4071bd0 0x7f54d406d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.408+0000 7f54db790700 1 --2- 172.21.15.6:0/3475008780 >> v2:172.21.15.40:3300/0 conn(0x7f54d415cd40 0x7f54d41592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.408+0000 7f54db790700 1 --2- 172.21.15.6:0/3475008780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54d40cd950 0x7f54d4071690 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.408+0000 7f54db790700 1 -- 172.21.15.6:0/3475008780 >> 172.21.15.6:0/3475008780 conn(0x7f54d40cf960 msgr2=0x7f54d40cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:21.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.410+0000 7f76e971a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76e4160b10 0x7f76e40c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.410+0000 7f76e971a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f76e40ca4b0 0x7f76e406ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.410+0000 7f76e971a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e406d8d0 con 0x7f76e406b220 2023-07-06T19:59:21.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.410+0000 7f76e971a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76e40ca920 con 0x7f76e40ca4b0 2023-07-06T19:59:21.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.410+0000 7f76e971a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40cab40 con 0x7f76e4160b10 2023-07-06T19:59:21.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.410+0000 7f9901d29700 1 -- 172.21.15.6:0/160209594 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98fc06aa70 msgr2=0x7f98fc13d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.410+0000 7f9901d29700 1 --2- 172.21.15.6:0/160209594 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98fc06aa70 0x7f98fc13d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.410+0000 7f9901d29700 1 -- 172.21.15.6:0/160209594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98fc159b60 msgr2=0x7f98fc06d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.410+0000 7f9901d29700 1 --2- 172.21.15.6:0/160209594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98fc159b60 0x7f98fc06d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.410+0000 7f9901d29700 1 -- 172.21.15.6:0/160209594 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec0094a0 con 0x7f98fc156d00 2023-07-06T19:59:21.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.409+0000 7f519e234700 1 -- 172.21.15.6:0/2279303713 wait complete. 2023-07-06T19:59:21.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.410+0000 7f519e234700 1 Processor -- start 2023-07-06T19:59:21.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.410+0000 7f9901d29700 1 --2- 172.21.15.6:0/160209594 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98fc156d00 0x7f98fc06cdd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f98f400cc50 tx=0x7f98f400a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.410+0000 7f54db790700 1 -- 172.21.15.6:0/3475008780 shutdown_connections 2023-07-06T19:59:21.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.411+0000 7f54db790700 1 -- 172.21.15.6:0/3475008780 wait complete. 2023-07-06T19:59:21.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.411+0000 7f519e234700 1 -- start start 2023-07-06T19:59:21.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.412+0000 7f69fcea7700 1 --2- 172.21.15.6:0/248030209 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69f80b2800 0x7f69f806cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.412+0000 7f519e234700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f519806a160 0x7f5198149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.412+0000 7f519e234700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51980b1060 0x7f519815b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.412+0000 7f519e234700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f519815c660 0x7f519814c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.412+0000 7f519e234700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51980b3d40 con 0x7f51980b1060 2023-07-06T19:59:21.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.412+0000 7f519e234700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51980b3130 con 0x7f519815c660 2023-07-06T19:59:21.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.412+0000 7f519e234700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51980b3410 con 0x7f519806a160 2023-07-06T19:59:21.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.412+0000 7f69f7fff700 1 -- 172.21.15.6:0/248030209 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69f80b2800 msgr2=0x7f69f806cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:21.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.412+0000 7f69f7fff700 1 --2- 172.21.15.6:0/248030209 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69f80b2800 0x7f69f806cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.412+0000 7f69f7fff700 1 -- 172.21.15.6:0/248030209 >> v2:172.21.15.6:3300/0 conn(0x7f69f815ea40 msgr2=0x7f69f80b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:21.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.412+0000 7f69f7fff700 1 --2- 172.21.15.6:0/248030209 >> v2:172.21.15.6:3300/0 conn(0x7f69f815ea40 0x7f69f80b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.412+0000 7f69f7fff700 1 -- 172.21.15.6:0/248030209 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f80ca4a0 con 0x7f69f815d790 2023-07-06T19:59:21.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.412+0000 7f51977fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f519806a160 0x7f5198149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.412+0000 7f51977fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f519806a160 0x7f5198149e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:51734/0 (socket says 172.21.15.6:51734) 2023-07-06T19:59:21.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.412+0000 7f51977fe700 1 -- 172.21.15.6:0/2523045430 learned_addr learned my addr 172.21.15.6:0/2523045430 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:21.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.412+0000 7f5197fff700 1 --2- 172.21.15.6:0/2523045430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f519815c660 0x7f519814c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.412+0000 7f76e2ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76e4160b10 0x7f76e40c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.412+0000 7f76e2ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76e4160b10 0x7f76e40c58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:51728/0 (socket says 172.21.15.6:51728) 2023-07-06T19:59:21.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.412+0000 7f76e2ffd700 1 -- 172.21.15.6:0/2386866042 learned_addr learned my addr 172.21.15.6:0/2386866042 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:21.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.412+0000 7f69f7fff700 1 --2- 172.21.15.6:0/248030209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69f815d790 0x7f69f806b4c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f69f80c5820 tx=0x7f69ec009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ee0f72a4b83fc2d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.412+0000 7f51977fe700 1 -- 172.21.15.6:0/2523045430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f519815c660 msgr2=0x7f519814c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.412+0000 7f51977fe700 1 --2- 172.21.15.6:0/2523045430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f519815c660 0x7f519814c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.412+0000 7f51977fe700 1 -- 172.21.15.6:0/2523045430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51980b1060 msgr2=0x7f519815b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.413+0000 7f51977fe700 1 --2- 172.21.15.6:0/2523045430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51980b1060 0x7f519815b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.413+0000 7f98f2ffd700 1 -- 172.21.15.6:0/160209594 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f400ade0 con 0x7f98fc156d00 2023-07-06T19:59:21.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.413+0000 7f990478e700 1 -- 172.21.15.6:0/160209594 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f8009550 con 0x7f98fc156d00 2023-07-06T19:59:21.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.413+0000 7f990478e700 1 -- 172.21.15.6:0/160209594 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98fc15b810 con 0x7f98fc156d00 2023-07-06T19:59:21.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.413+0000 7f69f6ffd700 1 -- 172.21.15.6:0/248030209 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec011830 con 0x7f69f815d790 2023-07-06T19:59:21.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.413+0000 7f69f6ffd700 1 -- 172.21.15.6:0/248030209 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ec011990 con 0x7f69f815d790 2023-07-06T19:59:21.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.413+0000 7f69f6ffd700 1 -- 172.21.15.6:0/248030209 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec011d20 con 0x7f69f815d790 2023-07-06T19:59:21.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.413+0000 7f51977fe700 1 -- 172.21.15.6:0/2523045430 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518c009550 con 0x7f519806a160 2023-07-06T19:59:21.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.413+0000 7f51977fe700 1 --2- 172.21.15.6:0/2523045430 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f519806a160 0x7f5198149e20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f519806fe70 tx=0x7f518c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.413+0000 7f76e2ffd700 1 -- 172.21.15.6:0/2386866042 >> v2:172.21.15.6:3300/0 conn(0x7f76e40ca4b0 msgr2=0x7f76e406ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:21.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.413+0000 7f76e2ffd700 1 --2- 172.21.15.6:0/2386866042 >> v2:172.21.15.6:3300/0 conn(0x7f76e40ca4b0 0x7f76e406ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.413+0000 7f76e2ffd700 1 -- 172.21.15.6:0/2386866042 >> v1:172.21.15.6:6789/0 conn(0x7f76e406b220 legacy=0x7f76e40ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:21.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.412+0000 7f54db790700 1 Processor -- start 2023-07-06T19:59:21.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.413+0000 7f76e2ffd700 1 -- 172.21.15.6:0/2386866042 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e406a200 con 0x7f76e4160b10 2023-07-06T19:59:21.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.413+0000 7f54db790700 1 -- start start 2023-07-06T19:59:21.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.414+0000 7f990478e700 1 -- 172.21.15.6:0/160209594 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98fc04eb90 con 0x7f98fc156d00 2023-07-06T19:59:21.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.414+0000 7f69fe90a700 1 -- 172.21.15.6:0/248030209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69f815d790 msgr2=0x7f69f806b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.414+0000 7f69fe90a700 1 --2- 172.21.15.6:0/248030209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69f815d790 0x7f69f806b4c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f69f80c5820 tx=0x7f69ec009bd0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.414+0000 7f69fe90a700 1 -- 172.21.15.6:0/248030209 shutdown_connections 2023-07-06T19:59:21.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.414+0000 7f69fe90a700 1 --2- 172.21.15.6:0/248030209 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69f80b2800 0x7f69f806cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.414+0000 7f69fe90a700 1 --2- 172.21.15.6:0/248030209 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69f815d790 0x7f69f806b4c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.414+0000 7f69fe90a700 1 --2- 172.21.15.6:0/248030209 >> v2:172.21.15.6:3300/0 conn(0x7f69f815ea40 0x7f69f80b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.414+0000 7f69fe90a700 1 -- 172.21.15.6:0/248030209 >> 172.21.15.6:0/248030209 conn(0x7f69f80cf420 msgr2=0x7f69f80cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:21.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.414+0000 7f54db790700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54d4071bd0 0x7f54d4156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.414+0000 7f54db790700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54d40cd950 0x7f54d40c0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.414+0000 7f54db790700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54d415cd40 0x7f54d41594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.414+0000 7f54db790700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d4158150 con 0x7f54d4071bd0 2023-07-06T19:59:21.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.414+0000 7f54db790700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d41572a0 con 0x7f54d415cd40 2023-07-06T19:59:21.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.414+0000 7f54db790700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d4157540 con 0x7f54d40cd950 2023-07-06T19:59:21.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.414+0000 7f69fe90a700 1 -- 172.21.15.6:0/248030209 shutdown_connections 2023-07-06T19:59:21.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.413+0000 7f102dfbb700 1 Processor -- start 2023-07-06T19:59:21.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.413+0000 7f102dfbb700 1 -- start start 2023-07-06T19:59:21.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.414+0000 7f102dfbb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1028160900 0x7f10280c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.414+0000 7f102dfbb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f10280ca440 0x7f102806d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.414+0000 7f102dfbb700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f102806d880 con 0x7f102806c650 2023-07-06T19:59:21.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.414+0000 7f102dfbb700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10280ca8e0 con 0x7f10280ca440 2023-07-06T19:59:21.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.414+0000 7f102dfbb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f102806a850 con 0x7f1028160900 2023-07-06T19:59:21.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.414+0000 7f54d952c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54d4071bd0 0x7f54d4156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.415+0000 7f54d952c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54d4071bd0 0x7f54d4156d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59098/0 (socket says 172.21.15.6:59098) 2023-07-06T19:59:21.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.415+0000 7f54d952c700 1 -- 172.21.15.6:0/1188056862 learned_addr learned my addr 172.21.15.6:0/1188056862 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:21.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.415+0000 7f54d8d2b700 1 --2- 172.21.15.6:0/1188056862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54d40cd950 0x7f54d40c0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.415+0000 7f54d9d2d700 1 --2- 172.21.15.6:0/1188056862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54d415cd40 0x7f54d41594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.415+0000 7f54d8d2b700 1 -- 172.21.15.6:0/1188056862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54d415cd40 msgr2=0x7f54d41594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.415+0000 7f54d8d2b700 1 --2- 172.21.15.6:0/1188056862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54d415cd40 0x7f54d41594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.415+0000 7f54d8d2b700 1 -- 172.21.15.6:0/1188056862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54d4071bd0 msgr2=0x7f54d4156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.415+0000 7f54d8d2b700 1 --2- 172.21.15.6:0/1188056862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54d4071bd0 0x7f54d4156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.415+0000 7f54d8d2b700 1 -- 172.21.15.6:0/1188056862 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c40094a0 con 0x7f54d40cd950 2023-07-06T19:59:21.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.415+0000 7f54d952c700 1 --2- 172.21.15.6:0/1188056862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54d4071bd0 0x7f54d4156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:59:21.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.415+0000 7f69fe90a700 1 -- 172.21.15.6:0/248030209 wait complete. 2023-07-06T19:59:21.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.416+0000 7f54d8d2b700 1 --2- 172.21.15.6:0/1188056862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54d40cd950 0x7f54d40c0dc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f54c4016000 tx=0x7f54c4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.413+0000 7f98f2ffd700 1 -- 172.21.15.6:0/160209594 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f400ce50 con 0x7f98fc156d00 2023-07-06T19:59:21.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.416+0000 7f98f2ffd700 1 -- 172.21.15.6:0/160209594 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f4003c40 con 0x7f98fc156d00 2023-07-06T19:59:21.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.416+0000 7f98f2ffd700 1 -- 172.21.15.6:0/160209594 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f98f40050d0 con 0x7f98fc156d00 2023-07-06T19:59:21.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.416+0000 7f98f2ffd700 1 --2- 172.21.15.6:0/160209594 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f98e006ae30 0x7f98e006d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.416+0000 7f98f2ffd700 1 -- 172.21.15.6:0/160209594 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f98f40898e0 con 0x7f98fc156d00 2023-07-06T19:59:21.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.416+0000 7f990252a700 1 --2- 172.21.15.6:0/160209594 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f98e006ae30 0x7f98e006d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.416+0000 7f69fe90a700 1 Processor -- start 2023-07-06T19:59:21.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.417+0000 7f69fe90a700 1 -- start start 2023-07-06T19:59:21.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.417+0000 7f517ffff700 1 -- 172.21.15.6:0/2523045430 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c011630 con 0x7f519806a160 2023-07-06T19:59:21.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.417+0000 7f517ffff700 1 -- 172.21.15.6:0/2523045430 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518c011790 con 0x7f519806a160 2023-07-06T19:59:21.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.417+0000 7f517ffff700 1 -- 172.21.15.6:0/2523045430 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c011b20 con 0x7f519806a160 2023-07-06T19:59:21.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.417+0000 7f519e234700 1 -- 172.21.15.6:0/2523045430 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51980b36f0 con 0x7f519806a160 2023-07-06T19:59:21.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.417+0000 7f519e234700 1 -- 172.21.15.6:0/2523045430 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519815bde0 con 0x7f519806a160 2023-07-06T19:59:21.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.416+0000 7f76e2ffd700 1 --2- 172.21.15.6:0/2386866042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76e4160b10 0x7f76e40c58a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f76d40098f0 tx=0x7f76d4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3fe7a76a03cbf29 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.418+0000 7f69fe90a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69f80b2800 0x7f69f813f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.418+0000 7f69fe90a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69f815d790 0x7f69f80c64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.418+0000 7f69fe90a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69f815ea40 0x7f69f814a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.418+0000 7f69fe90a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f80c8480 con 0x7f69f815d790 2023-07-06T19:59:21.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.418+0000 7f69fe90a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f814a110 con 0x7f69f815ea40 2023-07-06T19:59:21.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.418+0000 7f69fe90a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f813faf0 con 0x7f69f80b2800 2023-07-06T19:59:21.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.418+0000 7f69f77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69f815d790 0x7f69f80c64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.418+0000 7f69f77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69f815d790 0x7f69f80c64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59112/0 (socket says 172.21.15.6:59112) 2023-07-06T19:59:21.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.418+0000 7f69f77fe700 1 -- 172.21.15.6:0/2641278430 learned_addr learned my addr 172.21.15.6:0/2641278430 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:21.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.418+0000 7f69fcea7700 1 --2- 172.21.15.6:0/2641278430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69f815ea40 0x7f69f814a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.419+0000 7f46bbd42700 1 Processor -- start 2023-07-06T19:59:21.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.419+0000 7f519e234700 1 -- 172.21.15.6:0/2523045430 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51780052f0 con 0x7f519806a160 2023-07-06T19:59:21.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.419+0000 7f69f77fe700 1 -- 172.21.15.6:0/2641278430 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69f80b2800 msgr2=0x7f69f813f5b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T19:59:21.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.419+0000 7f69f77fe700 1 --2- 172.21.15.6:0/2641278430 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69f80b2800 0x7f69f813f5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.419+0000 7f69f77fe700 1 -- 172.21.15.6:0/2641278430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69f815ea40 msgr2=0x7f69f814a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.419+0000 7f69f77fe700 1 --2- 172.21.15.6:0/2641278430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69f815ea40 0x7f69f814a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.419+0000 7f69f77fe700 1 -- 172.21.15.6:0/2641278430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ec009550 con 0x7f69f815d790 2023-07-06T19:59:21.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.419+0000 7f69fcea7700 1 --2- 172.21.15.6:0/2641278430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69f815ea40 0x7f69f814a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:21.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.419+0000 7f990252a700 1 --2- 172.21.15.6:0/160209594 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f98e006ae30 0x7f98e006d2e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f98ec006f10 tx=0x7f98ec006e60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.415+0000 7f1027fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f102806c650 0x7f102806ca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:50184/0 (socket says 172.21.15.6:50184) 2023-07-06T19:59:21.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.415+0000 7f1026ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f10280ca440 0x7f102806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.415+0000 7f1027fff700 1 -- 172.21.15.6:0/975523900 learned_addr learned my addr 172.21.15.6:0/975523900 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:21.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.415+0000 7f10277fe700 1 --2- 172.21.15.6:0/975523900 >> v2:172.21.15.40:3300/0 conn(0x7f1028160900 0x7f10280c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.415+0000 7f1026ffd700 1 -- 172.21.15.6:0/975523900 >> v2:172.21.15.40:3300/0 conn(0x7f1028160900 msgr2=0x7f10280c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:21.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.415+0000 7f1026ffd700 1 --2- 172.21.15.6:0/975523900 >> v2:172.21.15.40:3300/0 conn(0x7f1028160900 0x7f10280c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.415+0000 7f1026ffd700 1 -- 172.21.15.6:0/975523900 >> v1:172.21.15.40:6789/0 conn(0x7f102806c650 legacy=0x7f102806ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.415+0000 7f1026ffd700 1 -- 172.21.15.6:0/975523900 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10280caad0 con 0x7f10280ca440 2023-07-06T19:59:21.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.415+0000 7f1026ffd700 1 --2- 172.21.15.6:0/975523900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10280ca440 0x7f102806d340 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f10280b1500 tx=0x7f101c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f955ac1169d48373 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.416+0000 7f10267fc700 1 -- 172.21.15.6:0/975523900 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c011830 con 0x7f10280ca440 2023-07-06T19:59:21.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.416+0000 7f10267fc700 1 -- 172.21.15.6:0/975523900 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c011990 con 0x7f10280ca440 2023-07-06T19:59:21.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.416+0000 7f10267fc700 1 -- 172.21.15.6:0/975523900 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c011d20 con 0x7f10280ca440 2023-07-06T19:59:21.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.417+0000 7f102dfbb700 1 -- 172.21.15.6:0/975523900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10280ca440 msgr2=0x7f102806d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.417+0000 7f102dfbb700 1 --2- 172.21.15.6:0/975523900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10280ca440 0x7f102806d340 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f10280b1500 tx=0x7f101c009b20 comp rx=0 tx=0).stop 2023-07-06T19:59:21.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.417+0000 7f102dfbb700 1 -- 172.21.15.6:0/975523900 shutdown_connections 2023-07-06T19:59:21.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.417+0000 7f102dfbb700 1 --2- 172.21.15.6:0/975523900 >> v2:172.21.15.40:3300/0 conn(0x7f1028160900 0x7f10280c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.417+0000 7f102dfbb700 1 --2- 172.21.15.6:0/975523900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10280ca440 0x7f102806d340 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.417+0000 7f102dfbb700 1 -- 172.21.15.6:0/975523900 >> 172.21.15.6:0/975523900 conn(0x7f10280cf420 msgr2=0x7f10280cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:21.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.417+0000 7f102dfbb700 1 -- 172.21.15.6:0/975523900 shutdown_connections 2023-07-06T19:59:21.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.417+0000 7f102dfbb700 1 -- 172.21.15.6:0/975523900 wait complete. 2023-07-06T19:59:21.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.419+0000 7f69f77fe700 1 --2- 172.21.15.6:0/2641278430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69f815d790 0x7f69f80c64c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f69f000ba50 tx=0x7f69f000be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.419+0000 7f102dfbb700 1 Processor -- start 2023-07-06T19:59:21.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.419+0000 7f69f4ff9700 1 -- 172.21.15.6:0/2641278430 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f000cab0 con 0x7f69f815d790 2023-07-06T19:59:21.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.419+0000 7f69f4ff9700 1 -- 172.21.15.6:0/2641278430 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f000cc30 con 0x7f69f815d790 2023-07-06T19:59:21.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.419+0000 7f69fe90a700 1 -- 172.21.15.6:0/2641278430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f8149500 con 0x7f69f815d790 2023-07-06T19:59:21.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.419+0000 7f69f4ff9700 1 -- 172.21.15.6:0/2641278430 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f0014440 con 0x7f69f815d790 2023-07-06T19:59:21.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.419+0000 7f69fe90a700 1 -- 172.21.15.6:0/2641278430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f8149ac0 con 0x7f69f815d790 2023-07-06T19:59:21.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.419+0000 7f102dfbb700 1 -- start start 2023-07-06T19:59:21.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.419+0000 7f46bbd42700 1 -- start start 2023-07-06T19:59:21.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.420+0000 7f46bbd42700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46b40c27b0 0x7f46b4164ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.420+0000 7f46bbd42700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f46b40cf470 0x7f46b4161320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.420+0000 7f46bbd42700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b4161960 con 0x7f46b4160eb0 2023-07-06T19:59:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.420+0000 7f46bbd42700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b4165420 con 0x7f46b40cf470 2023-07-06T19:59:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.420+0000 7f46bbd42700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b41644d0 con 0x7f46b40c27b0 2023-07-06T19:59:21.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.421+0000 7f76e1ffb700 1 -- 172.21.15.6:0/2386866042 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d4004230 con 0x7f76e4160b10 2023-07-06T19:59:21.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.421+0000 7f69fe90a700 1 -- 172.21.15.6:0/2641278430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f804eb90 con 0x7f69f815d790 2023-07-06T19:59:21.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.420+0000 7f46b92dd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f46b4160eb0 0x7f46b40ced60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:50198/0 (socket says 172.21.15.6:50198) 2023-07-06T19:59:21.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.420+0000 7f46b92dd700 1 -- 172.21.15.6:0/4259634978 learned_addr learned my addr 172.21.15.6:0/4259634978 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:21.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.421+0000 7f46ba2df700 1 --2- 172.21.15.6:0/4259634978 >> v2:172.21.15.40:3300/0 conn(0x7f46b40cf470 0x7f46b4161320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.421+0000 7f46b9ade700 1 --2- 172.21.15.6:0/4259634978 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46b40c27b0 0x7f46b4164ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.420+0000 7f102dfbb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f102806c650 0x7f1028088200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.420+0000 7f102dfbb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10280ca440 0x7f10280c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.420+0000 7f102dfbb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1028160900 0x7f1028159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.421+0000 7f102dfbb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1028158990 con 0x7f102806c650 2023-07-06T19:59:21.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.421+0000 7f102dfbb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1028158c70 con 0x7f10280ca440 2023-07-06T19:59:21.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.421+0000 7f102dfbb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10281619b0 con 0x7f1028160900 2023-07-06T19:59:21.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.421+0000 7f1026ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10280ca440 0x7f10280c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.421+0000 7f1026ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10280ca440 0x7f10280c5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:38158/0 (socket says 172.21.15.6:38158) 2023-07-06T19:59:21.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.421+0000 7f1026ffd700 1 -- 172.21.15.6:0/2126929575 learned_addr learned my addr 172.21.15.6:0/2126929575 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:21.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.421+0000 7f46ba2df700 1 -- 172.21.15.6:0/4259634978 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46b40c27b0 msgr2=0x7f46b4164ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:21.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.421+0000 7f46ba2df700 1 --2- 172.21.15.6:0/4259634978 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46b40c27b0 0x7f46b4164ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.421+0000 7f46ba2df700 1 -- 172.21.15.6:0/4259634978 >> v1:172.21.15.40:6789/0 conn(0x7f46b4160eb0 legacy=0x7f46b40ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.421+0000 7f46ba2df700 1 -- 172.21.15.6:0/4259634978 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b4161c40 con 0x7f46b40cf470 2023-07-06T19:59:21.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.421+0000 7f98f2ffd700 1 -- 172.21.15.6:0/160209594 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f98f4054710 con 0x7f98fc156d00 2023-07-06T19:59:21.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.421+0000 7f10277fe700 1 --2- 172.21.15.6:0/2126929575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f102806c650 0x7f1028088200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.421+0000 7f46ba2df700 1 --2- 172.21.15.6:0/4259634978 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46b40cf470 0x7f46b4161320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f46ac009d90 tx=0x7f46ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc716b8442d15469 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.421+0000 7f1026ffd700 1 -- 172.21.15.6:0/2126929575 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1028160900 msgr2=0x7f1028159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.421+0000 7f1026ffd700 1 --2- 172.21.15.6:0/2126929575 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1028160900 0x7f1028159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.421+0000 7f1026ffd700 1 -- 172.21.15.6:0/2126929575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f102806c650 msgr2=0x7f1028088200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.421+0000 7f1026ffd700 1 --2- 172.21.15.6:0/2126929575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f102806c650 0x7f1028088200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.421+0000 7f1026ffd700 1 -- 172.21.15.6:0/2126929575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101c0094a0 con 0x7f10280ca440 2023-07-06T19:59:21.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.422+0000 7f46b8adc700 1 -- 172.21.15.6:0/4259634978 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac00e070 con 0x7f46b40cf470 2023-07-06T19:59:21.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.422+0000 7f46b8adc700 1 -- 172.21.15.6:0/4259634978 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ac00bb20 con 0x7f46b40cf470 2023-07-06T19:59:21.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.422+0000 7f46b8adc700 1 -- 172.21.15.6:0/4259634978 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac012430 con 0x7f46b40cf470 2023-07-06T19:59:21.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.422+0000 7f69f4ff9700 1 -- 172.21.15.6:0/2641278430 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f69f001d3b0 con 0x7f69f815d790 2023-07-06T19:59:21.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.422+0000 7f54c9ffb700 1 -- 172.21.15.6:0/1188056862 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c40036a0 con 0x7f54d40cd950 2023-07-06T19:59:21.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.422+0000 7f46bbd42700 1 -- 172.21.15.6:0/4259634978 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46b40cf470 msgr2=0x7f46b4161320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.422+0000 7f46bbd42700 1 --2- 172.21.15.6:0/4259634978 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46b40cf470 0x7f46b4161320 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f46ac009d90 tx=0x7f46ac00b330 comp rx=0 tx=0).stop 2023-07-06T19:59:21.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.421+0000 7f76e1ffb700 1 -- 172.21.15.6:0/2386866042 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d4004390 con 0x7f76e4160b10 2023-07-06T19:59:21.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.421+0000 7f76e1ffb700 1 -- 172.21.15.6:0/2386866042 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d40036a0 con 0x7f76e4160b10 2023-07-06T19:59:21.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.422+0000 7f76e971a700 1 -- 172.21.15.6:0/2386866042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76e4160b10 msgr2=0x7f76e40c58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.422+0000 7f76e971a700 1 --2- 172.21.15.6:0/2386866042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76e4160b10 0x7f76e40c58a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f76d40098f0 tx=0x7f76d4009c00 comp rx=0 tx=0).stop 2023-07-06T19:59:21.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.423+0000 7f69f4ff9700 1 --2- 172.21.15.6:0/2641278430 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f69e406ace0 0x7f69e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.423+0000 7f76e971a700 1 -- 172.21.15.6:0/2386866042 shutdown_connections 2023-07-06T19:59:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.423+0000 7f76e971a700 1 --2- 172.21.15.6:0/2386866042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76e4160b10 0x7f76e40c58a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.423+0000 7f76e971a700 1 --2- 172.21.15.6:0/2386866042 >> v2:172.21.15.6:3300/0 conn(0x7f76e40ca4b0 0x7f76e406ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.423+0000 7f76e971a700 1 -- 172.21.15.6:0/2386866042 >> 172.21.15.6:0/2386866042 conn(0x7f76e40cf420 msgr2=0x7f76e40cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:21.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.422+0000 7f54c9ffb700 1 -- 172.21.15.6:0/1188056862 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c401f070 con 0x7f54d40cd950 2023-07-06T19:59:21.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.422+0000 7f54c9ffb700 1 -- 172.21.15.6:0/1188056862 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4003a40 con 0x7f54d40cd950 2023-07-06T19:59:21.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.423+0000 7f69f4ff9700 1 -- 172.21.15.6:0/2641278430 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f69f0006e40 con 0x7f69f815d790 2023-07-06T19:59:21.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.423+0000 7f1026ffd700 1 --2- 172.21.15.6:0/2126929575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10280ca440 0x7f10280c5cf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f101c000c00 tx=0x7f101c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.423+0000 7f1017fff700 1 -- 172.21.15.6:0/2126929575 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c0036a0 con 0x7f10280ca440 2023-07-06T19:59:21.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.423+0000 7f1017fff700 1 -- 172.21.15.6:0/2126929575 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c01f070 con 0x7f10280ca440 2023-07-06T19:59:21.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.423+0000 7f1017fff700 1 -- 172.21.15.6:0/2126929575 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c003a40 con 0x7f10280ca440 2023-07-06T19:59:21.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.423+0000 7f54db790700 1 -- 172.21.15.6:0/1188056862 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d4157820 con 0x7f54d40cd950 2023-07-06T19:59:21.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.423+0000 7f54db790700 1 -- 172.21.15.6:0/1188056862 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d4157de0 con 0x7f54d40cd950 2023-07-06T19:59:21.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.423+0000 7f76e971a700 1 -- 172.21.15.6:0/2386866042 shutdown_connections 2023-07-06T19:59:21.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.424+0000 7f76e971a700 1 -- 172.21.15.6:0/2386866042 wait complete. 2023-07-06T19:59:21.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.423+0000 7f102dfbb700 1 -- 172.21.15.6:0/2126929575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1028161c90 con 0x7f10280ca440 2023-07-06T19:59:21.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.423+0000 7f102dfbb700 1 -- 172.21.15.6:0/2126929575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1028088740 con 0x7f10280ca440 2023-07-06T19:59:21.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.424+0000 7f102dfbb700 1 -- 172.21.15.6:0/2126929575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10281621b0 con 0x7f10280ca440 2023-07-06T19:59:21.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.424+0000 7f54db790700 1 -- 172.21.15.6:0/1188056862 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d4157f70 con 0x7f54d40cd950 2023-07-06T19:59:21.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.426+0000 7f517ffff700 1 -- 172.21.15.6:0/2523045430 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f518c021070 con 0x7f519806a160 2023-07-06T19:59:21.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.426+0000 7f76e971a700 1 Processor -- start 2023-07-06T19:59:21.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.426+0000 7f1017fff700 1 -- 172.21.15.6:0/2126929575 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f101c003ba0 con 0x7f10280ca440 2023-07-06T19:59:21.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.426+0000 7f46bbd42700 1 -- 172.21.15.6:0/4259634978 shutdown_connections 2023-07-06T19:59:21.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.426+0000 7f46bbd42700 1 --2- 172.21.15.6:0/4259634978 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46b40cf470 0x7f46b4161320 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.426+0000 7f46bbd42700 1 --2- 172.21.15.6:0/4259634978 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46b40c27b0 0x7f46b4164ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.426+0000 7f46bbd42700 1 -- 172.21.15.6:0/4259634978 >> 172.21.15.6:0/4259634978 conn(0x7f46b40b0b60 msgr2=0x7f46b40b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:21.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.427+0000 7f1017fff700 1 --2- 172.21.15.6:0/2126929575 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f100c06acb0 0x7f100c06d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.427+0000 7f1017fff700 1 -- 172.21.15.6:0/2126929575 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f101c021070 con 0x7f10280ca440 2023-07-06T19:59:21.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.426+0000 7f517ffff700 1 --2- 172.21.15.6:0/2523045430 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f518406ad30 0x7f518406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.426+0000 7f5196ffd700 1 --2- 172.21.15.6:0/2523045430 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f518406ad30 0x7f518406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.426+0000 7f517ffff700 1 -- 172.21.15.6:0/2523045430 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f518c08b060 con 0x7f519806a160 2023-07-06T19:59:21.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.427+0000 7f517ffff700 1 -- 172.21.15.6:0/2523045430 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f518c055f10 con 0x7f519806a160 2023-07-06T19:59:21.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.427+0000 7f76e971a700 1 -- start start 2023-07-06T19:59:21.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.428+0000 7f76e971a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76e406b220 0x7f76e414d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.428+0000 7f76e971a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e40ca4b0 0x7f76e4162f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.428+0000 7f76e971a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76e4160b10 0x7f76e41634c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.428+0000 7f76e971a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40c59d0 con 0x7f76e40ca4b0 2023-07-06T19:59:21.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.428+0000 7f76e971a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e4163de0 con 0x7f76e406b220 2023-07-06T19:59:21.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.428+0000 7f76e971a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e4163b00 con 0x7f76e4160b10 2023-07-06T19:59:21.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.428+0000 7f54c9ffb700 1 -- 172.21.15.6:0/1188056862 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f54c4003ba0 con 0x7f54d40cd950 2023-07-06T19:59:21.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.428+0000 7f76e27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e40ca4b0 0x7f76e4162f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.428+0000 7f76e27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e40ca4b0 0x7f76e4162f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59132/0 (socket says 172.21.15.6:59132) 2023-07-06T19:59:21.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.428+0000 7f76e27fc700 1 -- 172.21.15.6:0/3033441891 learned_addr learned my addr 172.21.15.6:0/3033441891 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:21.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.429+0000 7f76e37fe700 1 --2- 172.21.15.6:0/3033441891 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76e4160b10 0x7f76e41634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.429+0000 7f54c9ffb700 1 --2- 172.21.15.6:0/1188056862 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f54b806ad30 0x7f54b806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.429+0000 7f54c9ffb700 1 -- 172.21.15.6:0/1188056862 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f54c4021070 con 0x7f54d40cd950 2023-07-06T19:59:21.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.429+0000 7f54d952c700 1 --2- 172.21.15.6:0/1188056862 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f54b806ad30 0x7f54b806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.428+0000 7f10277fe700 1 --2- 172.21.15.6:0/2126929575 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f100c06acb0 0x7f100c06d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.429+0000 7f10277fe700 1 --2- 172.21.15.6:0/2126929575 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f100c06acb0 0x7f100c06d160 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1018009b40 tx=0x7f1018009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.429+0000 7f5196ffd700 1 --2- 172.21.15.6:0/2523045430 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f518406ad30 0x7f518406d1e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f51981540f0 tx=0x7f5188006c30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.430+0000 7f46bbd42700 1 -- 172.21.15.6:0/4259634978 shutdown_connections 2023-07-06T19:59:21.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.430+0000 7f69f7fff700 1 --2- 172.21.15.6:0/2641278430 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f69e406ace0 0x7f69e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.430+0000 7f46bbd42700 1 -- 172.21.15.6:0/4259634978 wait complete. 2023-07-06T19:59:21.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.430+0000 7f54d952c700 1 --2- 172.21.15.6:0/1188056862 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f54b806ad30 0x7f54b806d1e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f54d0006b20 tx=0x7f54d0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.430+0000 7f69f4ff9700 1 -- 172.21.15.6:0/2641278430 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f69f00547b0 con 0x7f69f815d790 2023-07-06T19:59:21.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.431+0000 7f46bbd42700 1 Processor -- start 2023-07-06T19:59:21.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.429+0000 7f76e27fc700 1 -- 172.21.15.6:0/3033441891 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76e4160b10 msgr2=0x7f76e41634c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.429+0000 7f76e27fc700 1 --2- 172.21.15.6:0/3033441891 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76e4160b10 0x7f76e41634c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.429+0000 7f76e27fc700 1 -- 172.21.15.6:0/3033441891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76e406b220 msgr2=0x7f76e414d3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T19:59:21.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.429+0000 7f76e27fc700 1 --2- 172.21.15.6:0/3033441891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76e406b220 0x7f76e414d3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.429+0000 7f76e27fc700 1 -- 172.21.15.6:0/3033441891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d4009550 con 0x7f76e40ca4b0 2023-07-06T19:59:21.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.429+0000 7f76e27fc700 1 --2- 172.21.15.6:0/3033441891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e40ca4b0 0x7f76e4162f80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00ba50 tx=0x7f76dc00be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.430+0000 7f76cb7fe700 1 -- 172.21.15.6:0/3033441891 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc00cab0 con 0x7f76e40ca4b0 2023-07-06T19:59:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.430+0000 7f76cb7fe700 1 -- 172.21.15.6:0/3033441891 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76dc00cc30 con 0x7f76e40ca4b0 2023-07-06T19:59:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.430+0000 7f76cb7fe700 1 -- 172.21.15.6:0/3033441891 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc014440 con 0x7f76e40ca4b0 2023-07-06T19:59:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.431+0000 7f76e971a700 1 -- 172.21.15.6:0/3033441891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e40c5c70 con 0x7f76e40ca4b0 2023-07-06T19:59:21.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.431+0000 7f76e971a700 1 -- 172.21.15.6:0/3033441891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e40c4960 con 0x7f76e40ca4b0 2023-07-06T19:59:21.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.432+0000 7f46bbd42700 1 -- start start 2023-07-06T19:59:21.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.433+0000 7f46bbd42700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46b40c27b0 0x7f46b40cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.433+0000 7f46bbd42700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46b40cf470 0x7f46b40c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.433+0000 7f46bbd42700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46b4160eb0 0x7f46b40c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.433+0000 7f46bbd42700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b41514f0 con 0x7f46b4160eb0 2023-07-06T19:59:21.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.433+0000 7f46bbd42700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b41508e0 con 0x7f46b40cf470 2023-07-06T19:59:21.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.433+0000 7f46bbd42700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b4150bc0 con 0x7f46b40c27b0 2023-07-06T19:59:21.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.433+0000 7f46b92dd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46b40cf470 0x7f46b40c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.433+0000 7f46b92dd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46b40cf470 0x7f46b40c7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:38182/0 (socket says 172.21.15.6:38182) 2023-07-06T19:59:21.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.433+0000 7f46b92dd700 1 -- 172.21.15.6:0/3689607358 learned_addr learned my addr 172.21.15.6:0/3689607358 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:21.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.433+0000 7f69f7fff700 1 --2- 172.21.15.6:0/2641278430 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f69e406ace0 0x7f69e406d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f69ec014040 tx=0x7f69ec008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.433+0000 7f46b92dd700 1 -- 172.21.15.6:0/3689607358 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46b40c27b0 msgr2=0x7f46b40cb660 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T19:59:21.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.433+0000 7f46b92dd700 1 --2- 172.21.15.6:0/3689607358 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46b40c27b0 0x7f46b40cb660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.433+0000 7f46b92dd700 1 -- 172.21.15.6:0/3689607358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46b4160eb0 msgr2=0x7f46b40c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.433+0000 7f46b92dd700 1 --2- 172.21.15.6:0/3689607358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46b4160eb0 0x7f46b40c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.433+0000 7f46b92dd700 1 -- 172.21.15.6:0/3689607358 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac009a70 con 0x7f46b40cf470 2023-07-06T19:59:21.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.434+0000 7f46b92dd700 1 --2- 172.21.15.6:0/3689607358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46b40cf470 0x7f46b40c7990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f46b000c480 tx=0x7f46b000c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.434+0000 7f76cb7fe700 1 -- 172.21.15.6:0/3033441891 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f76dc0145c0 con 0x7f76e40ca4b0 2023-07-06T19:59:21.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.434+0000 7f46aa7fc700 1 -- 172.21.15.6:0/3689607358 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0005d70 con 0x7f46b40cf470 2023-07-06T19:59:21.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.434+0000 7f76cb7fe700 1 --2- 172.21.15.6:0/3033441891 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f76d006ad30 0x7f76d006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.435+0000 7f76cb7fe700 1 -- 172.21.15.6:0/3033441891 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f76dc006e40 con 0x7f76e40ca4b0 2023-07-06T19:59:21.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.435+0000 7f76e2ffd700 1 --2- 172.21.15.6:0/3033441891 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f76d006ad30 0x7f76d006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.434+0000 7f46aa7fc700 1 -- 172.21.15.6:0/3689607358 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b00070d0 con 0x7f46b40cf470 2023-07-06T19:59:21.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.434+0000 7f46aa7fc700 1 -- 172.21.15.6:0/3689607358 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0007440 con 0x7f46b40cf470 2023-07-06T19:59:21.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.435+0000 7f46bbd42700 1 -- 172.21.15.6:0/3689607358 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b4150ea0 con 0x7f46b40cf470 2023-07-06T19:59:21.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.435+0000 7f76e2ffd700 1 --2- 172.21.15.6:0/3033441891 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f76d006ad30 0x7f76d006d1e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f76d4000c00 tx=0x7f76d4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.435+0000 7f46bbd42700 1 -- 172.21.15.6:0/3689607358 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b40c8410 con 0x7f46b40cf470 2023-07-06T19:59:21.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.436+0000 7f1017fff700 1 -- 172.21.15.6:0/2126929575 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f101c055d70 con 0x7f10280ca440 2023-07-06T19:59:21.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.437+0000 7f46bbd42700 1 -- 172.21.15.6:0/3689607358 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b4151660 con 0x7f46b40cf470 2023-07-06T19:59:21.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.437+0000 7f46aa7fc700 1 -- 172.21.15.6:0/3689607358 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f46b00075a0 con 0x7f46b40cf470 2023-07-06T19:59:21.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.438+0000 7f46aa7fc700 1 --2- 172.21.15.6:0/3689607358 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f469806ad30 0x7f469806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.438+0000 7f46aa7fc700 1 -- 172.21.15.6:0/3689607358 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f46b0088ac0 con 0x7f46b40cf470 2023-07-06T19:59:21.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.438+0000 7f54c9ffb700 1 -- 172.21.15.6:0/1188056862 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f54c4056040 con 0x7f54d40cd950 2023-07-06T19:59:21.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.439+0000 7f76e971a700 1 -- 172.21.15.6:0/3033441891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e404eb90 con 0x7f76e40ca4b0 2023-07-06T19:59:21.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.438+0000 7f46b9ade700 1 --2- 172.21.15.6:0/3689607358 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f469806ad30 0x7f469806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.438+0000 7f46b9ade700 1 --2- 172.21.15.6:0/3689607358 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f469806ad30 0x7f469806d1e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009a70 tx=0x7f46a4009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.442+0000 7f46aa7fc700 1 -- 172.21.15.6:0/3689607358 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f46b0053a10 con 0x7f46b40cf470 2023-07-06T19:59:21.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.457+0000 7f76cb7fe700 1 -- 172.21.15.6:0/3033441891 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f76dc0542e0 con 0x7f76e40ca4b0 2023-07-06T19:59:21.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.483+0000 7f1b58954700 1 Processor -- start 2023-07-06T19:59:21.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.483+0000 7f1b58954700 1 -- start start 2023-07-06T19:59:21.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.485+0000 7f1b58954700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1b54160b10 0x7f1b540c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.485+0000 7f1b58954700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b5406b3f0 0x7f1b5406c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.485+0000 7f1b58954700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b5406d8d0 con 0x7f1b540ca4b0 2023-07-06T19:59:21.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.485+0000 7f1b58954700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b540ca950 con 0x7f1b54160b10 2023-07-06T19:59:21.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.485+0000 7f1b58954700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b540cab40 con 0x7f1b5406b3f0 2023-07-06T19:59:21.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.486+0000 7f1b52d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b5406b3f0 0x7f1b5406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.486+0000 7f1b5259c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1b54160b10 0x7f1b540c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.486+0000 7f1b51d9b700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1b540ca4b0 0x7f1b5406ace0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:50234/0 (socket says 172.21.15.6:50234) 2023-07-06T19:59:21.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.486+0000 7f1b51d9b700 1 -- 172.21.15.6:0/1562480632 learned_addr learned my addr 172.21.15.6:0/1562480632 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:21.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.486+0000 7f1b5259c700 1 -- 172.21.15.6:0/1562480632 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b5406b3f0 msgr2=0x7f1b5406c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:21.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.486+0000 7f1b5259c700 1 --2- 172.21.15.6:0/1562480632 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b5406b3f0 0x7f1b5406c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.486+0000 7f1b5259c700 1 -- 172.21.15.6:0/1562480632 >> v1:172.21.15.40:6789/0 conn(0x7f1b540ca4b0 legacy=0x7f1b5406ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.486+0000 7f1b5259c700 1 -- 172.21.15.6:0/1562480632 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5406a200 con 0x7f1b54160b10 2023-07-06T19:59:21.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.486+0000 7f1b5259c700 1 --2- 172.21.15.6:0/1562480632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b54160b10 0x7f1b540c58a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1b44009840 tx=0x7f1b44009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7501e44b4a606097 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.487+0000 7f1b5159a700 1 -- 172.21.15.6:0/1562480632 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44011830 con 0x7f1b54160b10 2023-07-06T19:59:21.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.487+0000 7f1b5159a700 1 -- 172.21.15.6:0/1562480632 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b44011990 con 0x7f1b54160b10 2023-07-06T19:59:21.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.487+0000 7f1b5159a700 1 -- 172.21.15.6:0/1562480632 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44011d00 con 0x7f1b54160b10 2023-07-06T19:59:21.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.488+0000 7f1b58954700 1 -- 172.21.15.6:0/1562480632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b54160b10 msgr2=0x7f1b540c58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.488+0000 7f1b58954700 1 --2- 172.21.15.6:0/1562480632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b54160b10 0x7f1b540c58a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1b44009840 tx=0x7f1b44009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:21.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.488+0000 7f1b58954700 1 -- 172.21.15.6:0/1562480632 shutdown_connections 2023-07-06T19:59:21.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.488+0000 7f1b58954700 1 --2- 172.21.15.6:0/1562480632 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b5406b3f0 0x7f1b5406c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.488+0000 7f1b58954700 1 --2- 172.21.15.6:0/1562480632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b54160b10 0x7f1b540c58a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.488+0000 7f1b58954700 1 -- 172.21.15.6:0/1562480632 >> 172.21.15.6:0/1562480632 conn(0x7f1b540cf420 msgr2=0x7f1b540cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:21.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.488+0000 7f1b58954700 1 -- 172.21.15.6:0/1562480632 shutdown_connections 2023-07-06T19:59:21.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.488+0000 7f1b58954700 1 -- 172.21.15.6:0/1562480632 wait complete. 2023-07-06T19:59:21.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.491+0000 7f1b58954700 1 Processor -- start 2023-07-06T19:59:21.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.491+0000 7f1b58954700 1 -- start start 2023-07-06T19:59:21.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.492+0000 7f1b58954700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b5406b3f0 0x7f1b540b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.492+0000 7f1b58954700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b540ca4b0 0x7f1b54155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.492+0000 7f1b58954700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b54160b10 0x7f1b54156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.492+0000 7f1b58954700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b54137c70 con 0x7f1b5406b3f0 2023-07-06T19:59:21.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.492+0000 7f1b58954700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b54137f50 con 0x7f1b540ca4b0 2023-07-06T19:59:21.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.492+0000 7f1b58954700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b54138230 con 0x7f1b54160b10 2023-07-06T19:59:21.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.493+0000 7f1b5259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b5406b3f0 0x7f1b540b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.493+0000 7f1b5259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b5406b3f0 0x7f1b540b4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59158/0 (socket says 172.21.15.6:59158) 2023-07-06T19:59:21.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.493+0000 7f1b5259c700 1 -- 172.21.15.6:0/477511239 learned_addr learned my addr 172.21.15.6:0/477511239 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:21.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.493+0000 7f1b5259c700 1 -- 172.21.15.6:0/477511239 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b54160b10 msgr2=0x7f1b54156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.493+0000 7f1b5259c700 1 --2- 172.21.15.6:0/477511239 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b54160b10 0x7f1b54156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.493+0000 7f1b5259c700 1 -- 172.21.15.6:0/477511239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b540ca4b0 msgr2=0x7f1b54155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.493+0000 7f1b5259c700 1 --2- 172.21.15.6:0/477511239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b540ca4b0 0x7f1b54155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.493+0000 7f1b5259c700 1 -- 172.21.15.6:0/477511239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b440094a0 con 0x7f1b5406b3f0 2023-07-06T19:59:21.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.494+0000 7f1b5259c700 1 --2- 172.21.15.6:0/477511239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b5406b3f0 0x7f1b540b4050 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1b44000c00 tx=0x7f1b44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.501+0000 7f1b42ffd700 1 -- 172.21.15.6:0/477511239 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b440036a0 con 0x7f1b5406b3f0 2023-07-06T19:59:21.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.501+0000 7f1b42ffd700 1 -- 172.21.15.6:0/477511239 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4401e070 con 0x7f1b5406b3f0 2023-07-06T19:59:21.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.501+0000 7f1b42ffd700 1 -- 172.21.15.6:0/477511239 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44003a40 con 0x7f1b5406b3f0 2023-07-06T19:59:21.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.501+0000 7f1b58954700 1 -- 172.21.15.6:0/477511239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b54138510 con 0x7f1b5406b3f0 2023-07-06T19:59:21.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.501+0000 7f1b58954700 1 -- 172.21.15.6:0/477511239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b540b4590 con 0x7f1b5406b3f0 2023-07-06T19:59:21.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.504+0000 7f1b42ffd700 1 -- 172.21.15.6:0/477511239 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1b44003ba0 con 0x7f1b5406b3f0 2023-07-06T19:59:21.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.505+0000 7f1b42ffd700 1 --2- 172.21.15.6:0/477511239 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1b3406adb0 0x7f1b3406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:21.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.505+0000 7f1b42ffd700 1 -- 172.21.15.6:0/477511239 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1b4408a5d0 con 0x7f1b5406b3f0 2023-07-06T19:59:21.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.507+0000 7f1b58954700 1 -- 172.21.15.6:0/477511239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b380052f0 con 0x7f1b5406b3f0 2023-07-06T19:59:21.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.511+0000 7f1b51d9b700 1 --2- 172.21.15.6:0/477511239 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1b3406adb0 0x7f1b3406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:21.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.512+0000 7f1b51d9b700 1 --2- 172.21.15.6:0/477511239 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1b3406adb0 0x7f1b3406d260 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1b540cd980 tx=0x7f1b4c001660 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:21.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.517+0000 7f1b42ffd700 1 -- 172.21.15.6:0/477511239 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1b44020080 con 0x7f1b5406b3f0 2023-07-06T19:59:21.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.835+0000 7f990478e700 1 -- 172.21.15.6:0/160209594 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f98fc0cbb10 con 0x7f98fc156d00 2023-07-06T19:59:21.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.835+0000 7f98f2ffd700 1 -- 172.21.15.6:0/160209594 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f98f4057d30 con 0x7f98fc156d00 2023-07-06T19:59:21.840 INFO:teuthology.orchestra.run.smithi006.stdout:55834574859 2023-07-06T19:59:21.842 INFO:teuthology.orchestra.run.smithi006.stdout:55834574859 2023-07-06T19:59:21.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.836+0000 7f519e234700 1 -- 172.21.15.6:0/2523045430 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5178005870 con 0x7f519806a160 2023-07-06T19:59:21.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.836+0000 7f517ffff700 1 -- 172.21.15.6:0/2523045430 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f518c059530 con 0x7f519806a160 2023-07-06T19:59:21.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.840+0000 7f519e234700 1 -- 172.21.15.6:0/2523045430 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f518406ad30 msgr2=0x7f518406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.840+0000 7f519e234700 1 --2- 172.21.15.6:0/2523045430 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f518406ad30 0x7f518406d1e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f51981540f0 tx=0x7f5188006c30 comp rx=0 tx=0).stop 2023-07-06T19:59:21.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.840+0000 7f519e234700 1 -- 172.21.15.6:0/2523045430 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f519806a160 msgr2=0x7f5198149e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.840+0000 7f519e234700 1 --2- 172.21.15.6:0/2523045430 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f519806a160 0x7f5198149e20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f519806fe70 tx=0x7f518c004750 comp rx=0 tx=0).stop 2023-07-06T19:59:21.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.841+0000 7f519e234700 1 -- 172.21.15.6:0/2523045430 shutdown_connections 2023-07-06T19:59:21.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.841+0000 7f519e234700 1 --2- 172.21.15.6:0/2523045430 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f518406ad30 0x7f518406d1e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.841+0000 7f519e234700 1 --2- 172.21.15.6:0/2523045430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f519815c660 0x7f519814c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.841+0000 7f519e234700 1 --2- 172.21.15.6:0/2523045430 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f519806a160 0x7f5198149e20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.841+0000 7f519e234700 1 --2- 172.21.15.6:0/2523045430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51980b1060 0x7f519815b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.841+0000 7f519e234700 1 -- 172.21.15.6:0/2523045430 >> 172.21.15.6:0/2523045430 conn(0x7f51980cf420 msgr2=0x7f519806c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:21.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.842+0000 7f519e234700 1 -- 172.21.15.6:0/2523045430 shutdown_connections 2023-07-06T19:59:21.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.842+0000 7f519e234700 1 -- 172.21.15.6:0/2523045430 wait complete. 2023-07-06T19:59:21.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.843+0000 7f990478e700 1 -- 172.21.15.6:0/160209594 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f98e006ae30 msgr2=0x7f98e006d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.843+0000 7f990478e700 1 --2- 172.21.15.6:0/160209594 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f98e006ae30 0x7f98e006d2e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f98ec006f10 tx=0x7f98ec006e60 comp rx=0 tx=0).stop 2023-07-06T19:59:21.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.843+0000 7f990478e700 1 -- 172.21.15.6:0/160209594 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98fc156d00 msgr2=0x7f98fc06cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.843+0000 7f990478e700 1 --2- 172.21.15.6:0/160209594 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98fc156d00 0x7f98fc06cdd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f98f400cc50 tx=0x7f98f400a340 comp rx=0 tx=0).stop 2023-07-06T19:59:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.843+0000 7f990478e700 1 -- 172.21.15.6:0/160209594 shutdown_connections 2023-07-06T19:59:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.843+0000 7f990478e700 1 --2- 172.21.15.6:0/160209594 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f98e006ae30 0x7f98e006d2e0 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f98ec006f10 tx=0x7f98ec006e60 comp rx=0 tx=0).stop 2023-07-06T19:59:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.843+0000 7f990478e700 1 --2- 172.21.15.6:0/160209594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98fc159b60 0x7f98fc06d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.843+0000 7f990478e700 1 --2- 172.21.15.6:0/160209594 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f98fc06aa70 0x7f98fc13d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.843+0000 7f990478e700 1 --2- 172.21.15.6:0/160209594 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f98fc156d00 0x7f98fc06cdd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.843+0000 7f990478e700 1 -- 172.21.15.6:0/160209594 >> 172.21.15.6:0/160209594 conn(0x7f98fc0cf420 msgr2=0x7f98fc0cb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:21.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.845+0000 7f990478e700 1 -- 172.21.15.6:0/160209594 shutdown_connections 2023-07-06T19:59:21.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.845+0000 7f990478e700 1 -- 172.21.15.6:0/160209594 wait complete. 2023-07-06T19:59:21.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.853+0000 7f69fe90a700 1 -- 172.21.15.6:0/2641278430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f69f80cc160 con 0x7f69f815d790 2023-07-06T19:59:21.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.853+0000 7f102dfbb700 1 -- 172.21.15.6:0/2126929575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f10281621b0 con 0x7f10280ca440 2023-07-06T19:59:21.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.853+0000 7f69f4ff9700 1 -- 172.21.15.6:0/2641278430 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f69f0057dd0 con 0x7f69f815d790 2023-07-06T19:59:21.868 INFO:teuthology.orchestra.run.smithi006.stdout:55834574858 2023-07-06T19:59:21.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.854+0000 7f1017fff700 1 -- 172.21.15.6:0/2126929575 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f10281621b0 con 0x7f10280ca440 2023-07-06T19:59:21.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.855+0000 7f76e971a700 1 -- 172.21.15.6:0/3033441891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f76e40c3ab0 con 0x7f76e40ca4b0 2023-07-06T19:59:21.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.855+0000 7f76cb7fe700 1 -- 172.21.15.6:0/3033441891 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f76dc019020 con 0x7f76e40ca4b0 2023-07-06T19:59:21.870 INFO:teuthology.orchestra.run.smithi006.stdout:55834574859 2023-07-06T19:59:21.870 INFO:teuthology.orchestra.run.smithi006.stdout:55834574859 2023-07-06T19:59:21.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.857+0000 7f69fe90a700 1 -- 172.21.15.6:0/2641278430 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f69e406ace0 msgr2=0x7f69e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.857+0000 7f69fe90a700 1 --2- 172.21.15.6:0/2641278430 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f69e406ace0 0x7f69e406d190 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f69ec014040 tx=0x7f69ec008030 comp rx=0 tx=0).stop 2023-07-06T19:59:21.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.857+0000 7f69fe90a700 1 -- 172.21.15.6:0/2641278430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69f815d790 msgr2=0x7f69f80c64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.857+0000 7f69fe90a700 1 --2- 172.21.15.6:0/2641278430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69f815d790 0x7f69f80c64c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f69f000ba50 tx=0x7f69f000be10 comp rx=0 tx=0).stop 2023-07-06T19:59:21.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.857+0000 7f46bbd42700 1 -- 172.21.15.6:0/3689607358 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f46b404eb90 con 0x7f46b40cf470 2023-07-06T19:59:21.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.858+0000 7f69fe90a700 1 -- 172.21.15.6:0/2641278430 shutdown_connections 2023-07-06T19:59:21.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.858+0000 7f69fe90a700 1 --2- 172.21.15.6:0/2641278430 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f69e406ace0 0x7f69e406d190 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.858+0000 7f69fe90a700 1 --2- 172.21.15.6:0/2641278430 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69f815ea40 0x7f69f814a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.858+0000 7f69fe90a700 1 --2- 172.21.15.6:0/2641278430 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69f80b2800 0x7f69f813f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.858+0000 7f69fe90a700 1 --2- 172.21.15.6:0/2641278430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69f815d790 0x7f69f80c64c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.858+0000 7f69fe90a700 1 -- 172.21.15.6:0/2641278430 >> 172.21.15.6:0/2641278430 conn(0x7f69f80cf420 msgr2=0x7f69f814bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:21.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.858+0000 7f69fe90a700 1 -- 172.21.15.6:0/2641278430 shutdown_connections 2023-07-06T19:59:21.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.858+0000 7f69fe90a700 1 -- 172.21.15.6:0/2641278430 wait complete. 2023-07-06T19:59:21.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.858+0000 7f46aa7fc700 1 -- 172.21.15.6:0/3689607358 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f46b0057030 con 0x7f46b40cf470 2023-07-06T19:59:21.874 INFO:teuthology.orchestra.run.smithi006.stdout:55834574859 2023-07-06T19:59:21.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.859+0000 7f76e971a700 1 -- 172.21.15.6:0/3033441891 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f76d006ad30 msgr2=0x7f76d006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.859+0000 7f76e971a700 1 --2- 172.21.15.6:0/3033441891 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f76d006ad30 0x7f76d006d1e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f76d4000c00 tx=0x7f76d4008030 comp rx=0 tx=0).stop 2023-07-06T19:59:21.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.859+0000 7f76e971a700 1 -- 172.21.15.6:0/3033441891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e40ca4b0 msgr2=0x7f76e4162f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.859+0000 7f76e971a700 1 --2- 172.21.15.6:0/3033441891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e40ca4b0 0x7f76e4162f80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00ba50 tx=0x7f76dc00be10 comp rx=0 tx=0).stop 2023-07-06T19:59:21.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.859+0000 7f102dfbb700 1 -- 172.21.15.6:0/2126929575 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f100c06acb0 msgr2=0x7f100c06d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.859+0000 7f102dfbb700 1 --2- 172.21.15.6:0/2126929575 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f100c06acb0 0x7f100c06d160 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1018009b40 tx=0x7f1018009210 comp rx=0 tx=0).stop 2023-07-06T19:59:21.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.859+0000 7f102dfbb700 1 -- 172.21.15.6:0/2126929575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10280ca440 msgr2=0x7f10280c5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.859+0000 7f102dfbb700 1 --2- 172.21.15.6:0/2126929575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10280ca440 0x7f10280c5cf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f101c000c00 tx=0x7f101c004750 comp rx=0 tx=0).stop 2023-07-06T19:59:21.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.859+0000 7f76e971a700 1 -- 172.21.15.6:0/3033441891 shutdown_connections 2023-07-06T19:59:21.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.859+0000 7f76e971a700 1 --2- 172.21.15.6:0/3033441891 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f76d006ad30 0x7f76d006d1e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.859+0000 7f76e971a700 1 --2- 172.21.15.6:0/3033441891 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76e4160b10 0x7f76e41634c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.859+0000 7f76e971a700 1 --2- 172.21.15.6:0/3033441891 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76e406b220 0x7f76e414d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.859+0000 7f76e971a700 1 --2- 172.21.15.6:0/3033441891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e40ca4b0 0x7f76e4162f80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.859+0000 7f76e971a700 1 -- 172.21.15.6:0/3033441891 >> 172.21.15.6:0/3033441891 conn(0x7f76e40cf420 msgr2=0x7f76e40c5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:21.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.859+0000 7f76e971a700 1 -- 172.21.15.6:0/3033441891 shutdown_connections 2023-07-06T19:59:21.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.859+0000 7f76e971a700 1 -- 172.21.15.6:0/3033441891 wait complete. 2023-07-06T19:59:21.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.861+0000 7f102dfbb700 1 -- 172.21.15.6:0/2126929575 shutdown_connections 2023-07-06T19:59:21.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.861+0000 7f102dfbb700 1 --2- 172.21.15.6:0/2126929575 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f100c06acb0 0x7f100c06d160 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.861+0000 7f102dfbb700 1 --2- 172.21.15.6:0/2126929575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f102806c650 0x7f1028088200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.861+0000 7f102dfbb700 1 --2- 172.21.15.6:0/2126929575 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1028160900 0x7f1028159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.861+0000 7f102dfbb700 1 --2- 172.21.15.6:0/2126929575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10280ca440 0x7f10280c5cf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.861+0000 7f102dfbb700 1 -- 172.21.15.6:0/2126929575 >> 172.21.15.6:0/2126929575 conn(0x7f10280cf420 msgr2=0x7f10280c4c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:21.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.861+0000 7f102dfbb700 1 -- 172.21.15.6:0/2126929575 shutdown_connections 2023-07-06T19:59:21.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.861+0000 7f102dfbb700 1 -- 172.21.15.6:0/2126929575 wait complete. 2023-07-06T19:59:21.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.862+0000 7f54db790700 1 -- 172.21.15.6:0/1188056862 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f54d40676f0 con 0x7f54d40cd950 2023-07-06T19:59:21.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.862+0000 7f46bbd42700 1 -- 172.21.15.6:0/3689607358 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f469806ad30 msgr2=0x7f469806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.862+0000 7f46bbd42700 1 --2- 172.21.15.6:0/3689607358 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f469806ad30 0x7f469806d1e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009a70 tx=0x7f46a4009210 comp rx=0 tx=0).stop 2023-07-06T19:59:21.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.862+0000 7f46bbd42700 1 -- 172.21.15.6:0/3689607358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46b40cf470 msgr2=0x7f46b40c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.862+0000 7f46bbd42700 1 --2- 172.21.15.6:0/3689607358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46b40cf470 0x7f46b40c7990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f46b000c480 tx=0x7f46b000c840 comp rx=0 tx=0).stop 2023-07-06T19:59:21.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.862+0000 7f46bbd42700 1 -- 172.21.15.6:0/3689607358 shutdown_connections 2023-07-06T19:59:21.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.862+0000 7f46bbd42700 1 --2- 172.21.15.6:0/3689607358 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f469806ad30 0x7f469806d1e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.862+0000 7f46bbd42700 1 --2- 172.21.15.6:0/3689607358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46b4160eb0 0x7f46b40c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.862+0000 7f46bbd42700 1 --2- 172.21.15.6:0/3689607358 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f46b40c27b0 0x7f46b40cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.862+0000 7f46bbd42700 1 --2- 172.21.15.6:0/3689607358 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f46b40cf470 0x7f46b40c7990 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.862+0000 7f46bbd42700 1 -- 172.21.15.6:0/3689607358 >> 172.21.15.6:0/3689607358 conn(0x7f46b40b0b60 msgr2=0x7f46b40af780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:21.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.862+0000 7f54c9ffb700 1 -- 172.21.15.6:0/1188056862 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f54c4015090 con 0x7f54d40cd950 2023-07-06T19:59:21.893 INFO:teuthology.orchestra.run.smithi006.stdout:55834574859 2023-07-06T19:59:21.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.0 2023-07-06T19:59:21.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.863+0000 7f46bbd42700 1 -- 172.21.15.6:0/3689607358 shutdown_connections 2023-07-06T19:59:21.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.863+0000 7f46bbd42700 1 -- 172.21.15.6:0/3689607358 wait complete. 2023-07-06T19:59:21.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.866+0000 7f54db790700 1 -- 172.21.15.6:0/1188056862 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f54b806ad30 msgr2=0x7f54b806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.866+0000 7f54db790700 1 --2- 172.21.15.6:0/1188056862 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f54b806ad30 0x7f54b806d1e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f54d0006b20 tx=0x7f54d0008040 comp rx=0 tx=0).stop 2023-07-06T19:59:21.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.866+0000 7f54db790700 1 -- 172.21.15.6:0/1188056862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54d40cd950 msgr2=0x7f54d40c0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.866+0000 7f54db790700 1 --2- 172.21.15.6:0/1188056862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54d40cd950 0x7f54d40c0dc0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f54c4016000 tx=0x7f54c4004750 comp rx=0 tx=0).stop 2023-07-06T19:59:21.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.1 2023-07-06T19:59:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.868+0000 7f54db790700 1 -- 172.21.15.6:0/1188056862 shutdown_connections 2023-07-06T19:59:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.868+0000 7f54db790700 1 --2- 172.21.15.6:0/1188056862 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f54b806ad30 0x7f54b806d1e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.868+0000 7f54db790700 1 --2- 172.21.15.6:0/1188056862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54d4071bd0 0x7f54d4156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.868+0000 7f54db790700 1 --2- 172.21.15.6:0/1188056862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54d415cd40 0x7f54d41594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.868+0000 7f54db790700 1 --2- 172.21.15.6:0/1188056862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f54d40cd950 0x7f54d40c0dc0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.868+0000 7f54db790700 1 -- 172.21.15.6:0/1188056862 >> 172.21.15.6:0/1188056862 conn(0x7f54d40cf960 msgr2=0x7f54d40b1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:21.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.868+0000 7f54db790700 1 -- 172.21.15.6:0/1188056862 shutdown_connections 2023-07-06T19:59:21.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.868+0000 7f54db790700 1 -- 172.21.15.6:0/1188056862 wait complete. 2023-07-06T19:59:21.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.3 2023-07-06T19:59:21.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.4 2023-07-06T19:59:21.910 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.7 2023-07-06T19:59:21.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.6 2023-07-06T19:59:21.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.2 2023-07-06T19:59:21.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.904+0000 7f1b58954700 1 -- 172.21.15.6:0/477511239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1b380055a0 con 0x7f1b5406b3f0 2023-07-06T19:59:21.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.905+0000 7f1b42ffd700 1 -- 172.21.15.6:0/477511239 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1b44015030 con 0x7f1b5406b3f0 2023-07-06T19:59:21.915 INFO:teuthology.orchestra.run.smithi006.stdout:55834574860 2023-07-06T19:59:21.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.907+0000 7f1b58954700 1 -- 172.21.15.6:0/477511239 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1b3406adb0 msgr2=0x7f1b3406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.907+0000 7f1b58954700 1 --2- 172.21.15.6:0/477511239 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1b3406adb0 0x7f1b3406d260 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1b540cd980 tx=0x7f1b4c001660 comp rx=0 tx=0).stop 2023-07-06T19:59:21.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.907+0000 7f1b58954700 1 -- 172.21.15.6:0/477511239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b5406b3f0 msgr2=0x7f1b540b4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:21.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.907+0000 7f1b58954700 1 --2- 172.21.15.6:0/477511239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b5406b3f0 0x7f1b540b4050 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1b44000c00 tx=0x7f1b44004750 comp rx=0 tx=0).stop 2023-07-06T19:59:21.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.907+0000 7f1b58954700 1 -- 172.21.15.6:0/477511239 shutdown_connections 2023-07-06T19:59:21.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.907+0000 7f1b58954700 1 --2- 172.21.15.6:0/477511239 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1b3406adb0 0x7f1b3406d260 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.907+0000 7f1b58954700 1 --2- 172.21.15.6:0/477511239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b5406b3f0 0x7f1b540b4050 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.907+0000 7f1b58954700 1 --2- 172.21.15.6:0/477511239 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b54160b10 0x7f1b54156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.907+0000 7f1b58954700 1 --2- 172.21.15.6:0/477511239 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b540ca4b0 0x7f1b54155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:21.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.907+0000 7f1b58954700 1 -- 172.21.15.6:0/477511239 >> 172.21.15.6:0/477511239 conn(0x7f1b540cf420 msgr2=0x7f1b5406ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:21.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.907+0000 7f1b58954700 1 -- 172.21.15.6:0/477511239 shutdown_connections 2023-07-06T19:59:21.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:21.907+0000 7f1b58954700 1 -- 172.21.15.6:0/477511239 wait complete. 2023-07-06T19:59:21.925 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574860 for osd.5 2023-07-06T19:59:22.894 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-06T19:59:22.900 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-06T19:59:22.915 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-06T19:59:22.916 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-06T19:59:22.916 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-06T19:59:22.917 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-06T19:59:22.925 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-06T19:59:22.938 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-06T19:59:23.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.102+0000 7fa288409700 1 Processor -- start 2023-07-06T19:59:23.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.102+0000 7fa288409700 1 -- start start 2023-07-06T19:59:23.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.104+0000 7fa288409700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa28016d6c0 0x7fa28006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.104+0000 7fa288409700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa2800705d0 0x7fa280070a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.104+0000 7fa288409700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2800b17b0 con 0x7fa280168f30 2023-07-06T19:59:23.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.104+0000 7fa288409700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa28016db30 con 0x7fa2800705d0 2023-07-06T19:59:23.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.104+0000 7fa288409700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa280070f90 con 0x7fa28016d6c0 2023-07-06T19:59:23.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.105+0000 7fa2869a6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa2800705d0 0x7fa280070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.105+0000 7fa2861a5700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa280168f30 0x7fa280089790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:50248/0 (socket says 172.21.15.6:50248) 2023-07-06T19:59:23.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.105+0000 7fa2861a5700 1 -- 172.21.15.6:0/3879772748 learned_addr learned my addr 172.21.15.6:0/3879772748 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:23.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.106+0000 7fa2859a4700 1 --2- 172.21.15.6:0/3879772748 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa28016d6c0 0x7fa28006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.106+0000 7fa2851a3700 1 -- 172.21.15.6:0/3879772748 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742156022 0 0) 0x7fa2800b17b0 con 0x7fa280168f30 2023-07-06T19:59:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.106+0000 7fa2851a3700 1 -- 172.21.15.6:0/3879772748 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa26c0035b0 con 0x7fa280168f30 2023-07-06T19:59:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.107+0000 7fa2869a6700 1 -- 172.21.15.6:0/3879772748 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa28016d6c0 msgr2=0x7fa28006c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.107+0000 7fa2869a6700 1 --2- 172.21.15.6:0/3879772748 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa28016d6c0 0x7fa28006c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.107+0000 7fa2869a6700 1 -- 172.21.15.6:0/3879772748 >> v1:172.21.15.40:6789/0 conn(0x7fa280168f30 legacy=0x7fa280089790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.107+0000 7fa2869a6700 1 -- 172.21.15.6:0/3879772748 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2800b1a90 con 0x7fa2800705d0 2023-07-06T19:59:23.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.107+0000 7fa2869a6700 1 --2- 172.21.15.6:0/3879772748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2800705d0 0x7fa280070a50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa278008d70 tx=0x7fa27800c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73dfe38d102aee9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.108+0000 7fa2851a3700 1 -- 172.21.15.6:0/3879772748 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27800cda0 con 0x7fa2800705d0 2023-07-06T19:59:23.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.108+0000 7fa2851a3700 1 -- 172.21.15.6:0/3879772748 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27800e040 con 0x7fa2800705d0 2023-07-06T19:59:23.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.108+0000 7fa2851a3700 1 -- 172.21.15.6:0/3879772748 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2780125f0 con 0x7fa2800705d0 2023-07-06T19:59:23.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.109+0000 7fa288409700 1 -- 172.21.15.6:0/3879772748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2800705d0 msgr2=0x7fa280070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.109+0000 7fa288409700 1 --2- 172.21.15.6:0/3879772748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2800705d0 0x7fa280070a50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa278008d70 tx=0x7fa27800c3b0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.109+0000 7fa288409700 1 -- 172.21.15.6:0/3879772748 shutdown_connections 2023-07-06T19:59:23.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.109+0000 7fa288409700 1 --2- 172.21.15.6:0/3879772748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2800705d0 0x7fa280070a50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.109+0000 7fa288409700 1 --2- 172.21.15.6:0/3879772748 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa28016d6c0 0x7fa28006c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.109+0000 7fa288409700 1 -- 172.21.15.6:0/3879772748 >> 172.21.15.6:0/3879772748 conn(0x7fa2800b1140 msgr2=0x7fa2800ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:23.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.110+0000 7fa288409700 1 -- 172.21.15.6:0/3879772748 shutdown_connections 2023-07-06T19:59:23.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.110+0000 7fa288409700 1 -- 172.21.15.6:0/3879772748 wait complete. 2023-07-06T19:59:23.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.112+0000 7fa288409700 1 Processor -- start 2023-07-06T19:59:23.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.112+0000 7fa288409700 1 -- start start 2023-07-06T19:59:23.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.113+0000 7fa288409700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2800705d0 0x7fa28016c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.113+0000 7fa288409700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa280168f30 0x7fa2801f7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.113+0000 7fa288409700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa28016d6c0 0x7fa2801f5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.113+0000 7fa288409700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2801f8130 con 0x7fa280168f30 2023-07-06T19:59:23.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.113+0000 7fa288409700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2801f8410 con 0x7fa28016d6c0 2023-07-06T19:59:23.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.113+0000 7fa288409700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2801f86f0 con 0x7fa2800705d0 2023-07-06T19:59:23.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.114+0000 7fa2859a4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa280168f30 0x7fa2801f7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.114+0000 7fa2859a4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa280168f30 0x7fa2801f7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59172/0 (socket says 172.21.15.6:59172) 2023-07-06T19:59:23.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.114+0000 7fa2859a4700 1 -- 172.21.15.6:0/1685428523 learned_addr learned my addr 172.21.15.6:0/1685428523 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:23.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.114+0000 7fa2859a4700 1 -- 172.21.15.6:0/1685428523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2800705d0 msgr2=0x7fa28016c0a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T19:59:23.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.114+0000 7fa2859a4700 1 --2- 172.21.15.6:0/1685428523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2800705d0 0x7fa28016c0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.114+0000 7fa2859a4700 1 -- 172.21.15.6:0/1685428523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa28016d6c0 msgr2=0x7fa2801f5980 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T19:59:23.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.114+0000 7fa2859a4700 1 --2- 172.21.15.6:0/1685428523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa28016d6c0 0x7fa2801f5980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.114+0000 7fa2859a4700 1 -- 172.21.15.6:0/1685428523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2780089d0 con 0x7fa280168f30 2023-07-06T19:59:23.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.115+0000 7fa2859a4700 1 --2- 172.21.15.6:0/1685428523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa280168f30 0x7fa2801f7890 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa27000ea40 tx=0x7fa27000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.120+0000 7fa276ffd700 1 -- 172.21.15.6:0/1685428523 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27000dd10 con 0x7fa280168f30 2023-07-06T19:59:23.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.120+0000 7fa276ffd700 1 -- 172.21.15.6:0/1685428523 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27000de70 con 0x7fa280168f30 2023-07-06T19:59:23.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.120+0000 7fa276ffd700 1 -- 172.21.15.6:0/1685428523 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa270010640 con 0x7fa280168f30 2023-07-06T19:59:23.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.121+0000 7fa288409700 1 -- 172.21.15.6:0/1685428523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2801f89d0 con 0x7fa280168f30 2023-07-06T19:59:23.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.121+0000 7fa288409700 1 -- 172.21.15.6:0/1685428523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2801f7dd0 con 0x7fa280168f30 2023-07-06T19:59:23.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.124+0000 7fa276ffd700 1 -- 172.21.15.6:0/1685428523 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa2700107a0 con 0x7fa280168f30 2023-07-06T19:59:23.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.124+0000 7fa276ffd700 1 --2- 172.21.15.6:0/1685428523 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa26406adb0 0x7fa26406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.124+0000 7fa276ffd700 1 -- 172.21.15.6:0/1685428523 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa270014070 con 0x7fa280168f30 2023-07-06T19:59:23.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.126+0000 7fa2861a5700 1 --2- 172.21.15.6:0/1685428523 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa26406adb0 0x7fa26406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.127+0000 7fa2861a5700 1 --2- 172.21.15.6:0/1685428523 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa26406adb0 0x7fa26406d260 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa27c007fd0 tx=0x7fa27c007980 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.128+0000 7fa288409700 1 -- 172.21.15.6:0/1685428523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2680052f0 con 0x7fa280168f30 2023-07-06T19:59:23.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.136+0000 7fa276ffd700 1 -- 172.21.15.6:0/1685428523 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa270054b30 con 0x7fa280168f30 2023-07-06T19:59:23.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.163+0000 7f69970ef700 1 Processor -- start 2023-07-06T19:59:23.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.163+0000 7f69970ef700 1 -- start start 2023-07-06T19:59:23.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.165+0000 7f69970ef700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69900b0b10 0x7f699006cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.165+0000 7f69970ef700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f699006a060 con 0x7f699006a4f0 2023-07-06T19:59:23.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.165+0000 7f69970ef700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f699006d900 con 0x7f699016c810 2023-07-06T19:59:23.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.165+0000 7f69970ef700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699016cbe0 con 0x7f69900b0b10 2023-07-06T19:59:23.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.165+0000 7f699568c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f699006a4f0 0x7f699006a930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60390/0 (socket says 172.21.15.6:60390) 2023-07-06T19:59:23.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.165+0000 7f699568c700 1 -- 172.21.15.6:0/2354670603 learned_addr learned my addr 172.21.15.6:0/2354670603 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:23.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.166+0000 7f698ffff700 1 --2- 172.21.15.6:0/2354670603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69900b0b10 0x7f699006cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.166+0000 7f698f7fe700 1 -- 172.21.15.6:0/2354670603 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3336729461 0 0) 0x7f699006a060 con 0x7f699006a4f0 2023-07-06T19:59:23.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.166+0000 7f698f7fe700 1 -- 172.21.15.6:0/2354670603 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69780034b0 con 0x7f699006a4f0 2023-07-06T19:59:23.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.166+0000 7f698f7fe700 1 -- 172.21.15.6:0/2354670603 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2000914261 0 0) 0x7f69780034b0 con 0x7f699006a4f0 2023-07-06T19:59:23.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.166+0000 7f698f7fe700 1 -- 172.21.15.6:0/2354670603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69900b0b10 msgr2=0x7f699006cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:23.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.166+0000 7f698f7fe700 1 --2- 172.21.15.6:0/2354670603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69900b0b10 0x7f699006cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.166+0000 7f698f7fe700 1 -- 172.21.15.6:0/2354670603 >> v1:172.21.15.40:6789/0 conn(0x7f699016c810 legacy=0x7f699006c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.166+0000 7f698f7fe700 1 -- 172.21.15.6:0/2354670603 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69900cdb10 con 0x7f699006a4f0 2023-07-06T19:59:23.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.166+0000 7f698f7fe700 1 -- 172.21.15.6:0/2354670603 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f69880019f0 con 0x7f699006a4f0 2023-07-06T19:59:23.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.166+0000 7f698f7fe700 1 -- 172.21.15.6:0/2354670603 >> v1:172.21.15.6:6789/0 conn(0x7f699006a4f0 legacy=0x7f699006a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.166+0000 7f698f7fe700 1 --2- 172.21.15.6:0/2354670603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6978004b10 0x7f6978004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.166+0000 7f698f7fe700 1 --2- 172.21.15.6:0/2354670603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69780036f0 0x7f6978003b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.166+0000 7f698f7fe700 1 --2- 172.21.15.6:0/2354670603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69780041a0 0x7f697800fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.166+0000 7f698f7fe700 1 -- 172.21.15.6:0/2354670603 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699016cbe0 con 0x7f6978004b10 2023-07-06T19:59:23.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.166+0000 7f698f7fe700 1 -- 172.21.15.6:0/2354670603 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69780103f0 con 0x7f69780041a0 2023-07-06T19:59:23.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.166+0000 7f698f7fe700 1 -- 172.21.15.6:0/2354670603 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69780105b0 con 0x7f69780036f0 2023-07-06T19:59:23.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.166+0000 7f698ffff700 1 --2- 172.21.15.6:0/2354670603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69900b0b10 0x7f699006cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:59:23.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.167+0000 7f698ffff700 1 --2- 172.21.15.6:0/2354670603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69780036f0 0x7f6978003b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.167+0000 7f698ffff700 1 -- 172.21.15.6:0/2354670603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69780041a0 msgr2=0x7f697800fc00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T19:59:23.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.167+0000 7f698ffff700 1 --2- 172.21.15.6:0/2354670603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69780041a0 0x7f697800fc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.167+0000 7f698ffff700 1 -- 172.21.15.6:0/2354670603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6978004b10 msgr2=0x7f6978004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:23.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.167+0000 7f698ffff700 1 --2- 172.21.15.6:0/2354670603 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6978004b10 0x7f6978004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.167+0000 7f698ffff700 1 -- 172.21.15.6:0/2354670603 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69900cdb10 con 0x7f69780036f0 2023-07-06T19:59:23.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.167+0000 7f698ffff700 1 --2- 172.21.15.6:0/2354670603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69780036f0 0x7f6978003b60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6984014a40 tx=0x7f6978004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44eec26a1a81bdf2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.167+0000 7f698f7fe700 1 -- 172.21.15.6:0/2354670603 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984004230 con 0x7f69780036f0 2023-07-06T19:59:23.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.167+0000 7f698f7fe700 1 -- 172.21.15.6:0/2354670603 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6984004390 con 0x7f69780036f0 2023-07-06T19:59:23.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.167+0000 7f698f7fe700 1 -- 172.21.15.6:0/2354670603 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69840036a0 con 0x7f69780036f0 2023-07-06T19:59:23.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.168+0000 7f1e4811f700 1 Processor -- start 2023-07-06T19:59:23.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.169+0000 7f69970ef700 1 -- 172.21.15.6:0/2354670603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69780036f0 msgr2=0x7f6978003b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.169+0000 7f69970ef700 1 --2- 172.21.15.6:0/2354670603 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69780036f0 0x7f6978003b60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6984014a40 tx=0x7f6978004770 comp rx=0 tx=0).stop 2023-07-06T19:59:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.168+0000 7f1e4811f700 1 -- start start 2023-07-06T19:59:23.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.169+0000 7f1e4811f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1e400b21c0 0x7f1e4015cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.169+0000 7f1e4811f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e400d0c00 0x7f1e400cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.169+0000 7f1e4811f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e400cdc40 con 0x7f1e400cd800 2023-07-06T19:59:23.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.169+0000 7f1e4811f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e400d11c0 con 0x7f1e400b21c0 2023-07-06T19:59:23.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.169+0000 7f1e4811f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e400d14a0 con 0x7f1e400d0c00 2023-07-06T19:59:23.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.170+0000 7f1e466bc700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1e400cd800 0x7f1e401601f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:50272/0 (socket says 172.21.15.6:50272) 2023-07-06T19:59:23.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.170+0000 7f1e466bc700 1 -- 172.21.15.6:0/2678307822 learned_addr learned my addr 172.21.15.6:0/2678307822 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:23.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.170+0000 7f1e456ba700 1 --2- 172.21.15.6:0/2678307822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e400d0c00 0x7f1e400cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.170+0000 7f699568c700 1 -- 172.21.15.6:0/2354670603 reap_dead start 2023-07-06T19:59:23.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.170+0000 7f69970ef700 1 -- 172.21.15.6:0/2354670603 shutdown_connections 2023-07-06T19:59:23.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.170+0000 7f69970ef700 1 -- 172.21.15.6:0/2354670603 >> 172.21.15.6:0/2354670603 conn(0x7f69900cf420 msgr2=0x7f69900cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:23.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.170+0000 7f1e44eb9700 1 -- 172.21.15.6:0/2678307822 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 960512231 0 0) 0x7f1e400cdc40 con 0x7f1e400cd800 2023-07-06T19:59:23.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.170+0000 7f1e44eb9700 1 -- 172.21.15.6:0/2678307822 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e2c0035b0 con 0x7f1e400cd800 2023-07-06T19:59:23.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.170+0000 7f1e45ebb700 1 --2- 172.21.15.6:0/2678307822 >> v2:172.21.15.40:3300/0 conn(0x7f1e400b21c0 0x7f1e4015cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.170+0000 7f1e456ba700 1 -- 172.21.15.6:0/2678307822 >> v2:172.21.15.40:3300/0 conn(0x7f1e400b21c0 msgr2=0x7f1e4015cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:23.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.170+0000 7f1e456ba700 1 --2- 172.21.15.6:0/2678307822 >> v2:172.21.15.40:3300/0 conn(0x7f1e400b21c0 0x7f1e4015cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.170+0000 7f1e456ba700 1 -- 172.21.15.6:0/2678307822 >> v1:172.21.15.40:6789/0 conn(0x7f1e400cd800 legacy=0x7f1e401601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.170+0000 7f1e456ba700 1 -- 172.21.15.6:0/2678307822 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e400d1780 con 0x7f1e400d0c00 2023-07-06T19:59:23.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.170+0000 7f69970ef700 1 -- 172.21.15.6:0/2354670603 shutdown_connections 2023-07-06T19:59:23.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.170+0000 7f69970ef700 1 -- 172.21.15.6:0/2354670603 wait complete. 2023-07-06T19:59:23.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.172+0000 7f69970ef700 1 Processor -- start 2023-07-06T19:59:23.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.174+0000 7f69970ef700 1 -- start start 2023-07-06T19:59:23.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.171+0000 7f1e456ba700 1 --2- 172.21.15.6:0/2678307822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e400d0c00 0x7f1e400cd2c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009840 tx=0x7f1e3c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b90cd42a0e499d25 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.171+0000 7f1e44eb9700 1 -- 172.21.15.6:0/2678307822 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c004230 con 0x7f1e400d0c00 2023-07-06T19:59:23.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.171+0000 7f1e44eb9700 1 -- 172.21.15.6:0/2678307822 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3c004390 con 0x7f1e400d0c00 2023-07-06T19:59:23.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.171+0000 7f1e44eb9700 1 -- 172.21.15.6:0/2678307822 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0036a0 con 0x7f1e400d0c00 2023-07-06T19:59:23.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.174+0000 7f1e4811f700 1 -- 172.21.15.6:0/2678307822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e400d0c00 msgr2=0x7f1e400cd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.174+0000 7f1e4811f700 1 --2- 172.21.15.6:0/2678307822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e400d0c00 0x7f1e400cd2c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009840 tx=0x7f1e3c009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:23.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.175+0000 7f1e4811f700 1 -- 172.21.15.6:0/2678307822 shutdown_connections 2023-07-06T19:59:23.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.175+0000 7f1e4811f700 1 --2- 172.21.15.6:0/2678307822 >> v2:172.21.15.40:3300/0 conn(0x7f1e400b21c0 0x7f1e4015cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.175+0000 7f1e4811f700 1 --2- 172.21.15.6:0/2678307822 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e400d0c00 0x7f1e400cd2c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.175+0000 7f1e4811f700 1 -- 172.21.15.6:0/2678307822 >> 172.21.15.6:0/2678307822 conn(0x7f1e400d3900 msgr2=0x7f1e400b4760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:23.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.175+0000 7f1e4811f700 1 -- 172.21.15.6:0/2678307822 shutdown_connections 2023-07-06T19:59:23.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.176+0000 7f69970ef700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6990202570 0x7f6990202940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.176+0000 7f69970ef700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6990161c20 0x7f6990202e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.176+0000 7f69970ef700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f699015fc30 0x7f69901600a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.176+0000 7f69970ef700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6990162d10 con 0x7f699015fc30 2023-07-06T19:59:23.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.176+0000 7f69970ef700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69901605e0 con 0x7f6990161c20 2023-07-06T19:59:23.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.176+0000 7f69970ef700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69900b4880 con 0x7f6990202570 2023-07-06T19:59:23.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.176+0000 7f1e4811f700 1 -- 172.21.15.6:0/2678307822 wait complete. 2023-07-06T19:59:23.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.176+0000 7f698ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6990161c20 0x7f6990202e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.176+0000 7f698ffff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6990161c20 0x7f6990202e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:38236/0 (socket says 172.21.15.6:38236) 2023-07-06T19:59:23.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.176+0000 7f698ffff700 1 -- 172.21.15.6:0/807823666 learned_addr learned my addr 172.21.15.6:0/807823666 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:23.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.176+0000 7f6994e8b700 1 --2- 172.21.15.6:0/807823666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6990202570 0x7f6990202940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.177+0000 7f699568c700 1 --2- 172.21.15.6:0/807823666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f699015fc30 0x7f69901600a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.177+0000 7f698ffff700 1 -- 172.21.15.6:0/807823666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6990202570 msgr2=0x7f6990202940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.177+0000 7f698ffff700 1 --2- 172.21.15.6:0/807823666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6990202570 0x7f6990202940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.177+0000 7f698ffff700 1 -- 172.21.15.6:0/807823666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f699015fc30 msgr2=0x7f69901600a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.177+0000 7f698ffff700 1 --2- 172.21.15.6:0/807823666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f699015fc30 0x7f69901600a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.177+0000 7f698ffff700 1 -- 172.21.15.6:0/807823666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6990162090 con 0x7f6990161c20 2023-07-06T19:59:23.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.177+0000 7f1e4811f700 1 Processor -- start 2023-07-06T19:59:23.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.177+0000 7f43347a7700 1 Processor -- start 2023-07-06T19:59:23.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.177+0000 7f1e4811f700 1 -- start start 2023-07-06T19:59:23.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.178+0000 7f43347a7700 1 -- start start 2023-07-06T19:59:23.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.178+0000 7f871143a700 1 Processor -- start 2023-07-06T19:59:23.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.179+0000 7f698ffff700 1 --2- 172.21.15.6:0/807823666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6990161c20 0x7f6990202e80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6984008d10 tx=0x7f6984008200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.179+0000 7f1e4811f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e400cd800 0x7f1e401e70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.179+0000 7f1e4811f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e400d0c00 0x7f1e401581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.179+0000 7f1e4811f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e4006a7f0 0x7f1e4006ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.179+0000 7f1e4811f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e401e6c90 con 0x7f1e4006a7f0 2023-07-06T19:59:23.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.179+0000 7f1e4811f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e4006b1b0 con 0x7f1e400d0c00 2023-07-06T19:59:23.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.179+0000 7f1e4811f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e401e75f0 con 0x7f1e400cd800 2023-07-06T19:59:23.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.179+0000 7f1e466bc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e4006a7f0 0x7f1e4006ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.179+0000 7f1e466bc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e4006a7f0 0x7f1e4006ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59206/0 (socket says 172.21.15.6:59206) 2023-07-06T19:59:23.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.179+0000 7f1e466bc700 1 -- 172.21.15.6:0/1481983945 learned_addr learned my addr 172.21.15.6:0/1481983945 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:23.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.179+0000 7f43347a7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f432c15cd40 0x7f432c0cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.179+0000 7f43347a7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432c15d2b0 con 0x7f432c1592b0 2023-07-06T19:59:23.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.179+0000 7f43347a7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432c15d590 con 0x7f432c071da0 2023-07-06T19:59:23.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.179+0000 7f43347a7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f432c159680 con 0x7f432c15cd40 2023-07-06T19:59:23.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.179+0000 7f4331d42700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f432c071da0 0x7f432c0cb150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:50292/0 (socket says 172.21.15.6:50292) 2023-07-06T19:59:23.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.179+0000 7f4331d42700 1 -- 172.21.15.6:0/710073846 learned_addr learned my addr 172.21.15.6:0/710073846 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:23.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.180+0000 7f4332d44700 1 --2- 172.21.15.6:0/710073846 >> v2:172.21.15.6:3300/0 conn(0x7f432c15cd40 0x7f432c0cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.180+0000 7f4331541700 1 -- 172.21.15.6:0/710073846 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519570015 0 0) 0x7f432c15d2b0 con 0x7f432c1592b0 2023-07-06T19:59:23.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.180+0000 7f4331541700 1 -- 172.21.15.6:0/710073846 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43180035b0 con 0x7f432c1592b0 2023-07-06T19:59:23.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.180+0000 7f1e456ba700 1 --2- 172.21.15.6:0/1481983945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e400d0c00 0x7f1e401581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.180+0000 7f4332d44700 1 -- 172.21.15.6:0/710073846 >> v1:172.21.15.40:6789/0 conn(0x7f432c071da0 legacy=0x7f432c0cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.180+0000 7f4332d44700 1 -- 172.21.15.6:0/710073846 >> v1:172.21.15.6:6789/0 conn(0x7f432c1592b0 legacy=0x7f432c071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.180+0000 7f4332d44700 1 -- 172.21.15.6:0/710073846 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c15d870 con 0x7f432c15cd40 2023-07-06T19:59:23.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.180+0000 7f698d7fa700 1 -- 172.21.15.6:0/807823666 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984005e10 con 0x7f6990161c20 2023-07-06T19:59:23.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.180+0000 7f698d7fa700 1 -- 172.21.15.6:0/807823666 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6984003bf0 con 0x7f6990161c20 2023-07-06T19:59:23.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.180+0000 7f698d7fa700 1 -- 172.21.15.6:0/807823666 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69840140d0 con 0x7f6990161c20 2023-07-06T19:59:23.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.180+0000 7f69970ef700 1 -- 172.21.15.6:0/807823666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6990162370 con 0x7f6990161c20 2023-07-06T19:59:23.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.180+0000 7f69970ef700 1 -- 172.21.15.6:0/807823666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6990162930 con 0x7f6990161c20 2023-07-06T19:59:23.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.180+0000 7f1e466bc700 1 -- 172.21.15.6:0/1481983945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e400cd800 msgr2=0x7f1e401e70b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-06T19:59:23.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.180+0000 7f1e466bc700 1 --2- 172.21.15.6:0/1481983945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e400cd800 0x7f1e401e70b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.180+0000 7f1e466bc700 1 -- 172.21.15.6:0/1481983945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e400d0c00 msgr2=0x7f1e401581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.180+0000 7f1e466bc700 1 --2- 172.21.15.6:0/1481983945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e400d0c00 0x7f1e401581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.180+0000 7f1e466bc700 1 -- 172.21.15.6:0/1481983945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3c0094a0 con 0x7f1e4006a7f0 2023-07-06T19:59:23.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.181+0000 7f1e466bc700 1 --2- 172.21.15.6:0/1481983945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e4006a7f0 0x7f1e4006ac70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1e38002230 tx=0x7f1e3800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.181+0000 7f1e367fc700 1 -- 172.21.15.6:0/1481983945 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3800ac20 con 0x7f1e4006a7f0 2023-07-06T19:59:23.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.181+0000 7f1e367fc700 1 -- 172.21.15.6:0/1481983945 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3800ada0 con 0x7f1e4006a7f0 2023-07-06T19:59:23.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.181+0000 7f1e367fc700 1 -- 172.21.15.6:0/1481983945 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e38007310 con 0x7f1e4006a7f0 2023-07-06T19:59:23.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.181+0000 7f1e4811f700 1 -- 172.21.15.6:0/1481983945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e401e6010 con 0x7f1e4006a7f0 2023-07-06T19:59:23.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.181+0000 7f69970ef700 1 -- 172.21.15.6:0/807823666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6990162e50 con 0x7f6990161c20 2023-07-06T19:59:23.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.181+0000 7f4332d44700 1 --2- 172.21.15.6:0/710073846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f432c15cd40 0x7f432c0cb860 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4324009d90 tx=0x7f432400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c7c9c586042480 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.182+0000 7f1e4811f700 1 -- 172.21.15.6:0/1481983945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e401e65d0 con 0x7f1e4006a7f0 2023-07-06T19:59:23.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.182+0000 7f4331541700 1 -- 172.21.15.6:0/710073846 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432400e070 con 0x7f432c15cd40 2023-07-06T19:59:23.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.182+0000 7f4331541700 1 -- 172.21.15.6:0/710073846 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432400bb20 con 0x7f432c15cd40 2023-07-06T19:59:23.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.182+0000 7f4331541700 1 -- 172.21.15.6:0/710073846 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4324012430 con 0x7f432c15cd40 2023-07-06T19:59:23.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.183+0000 7f698d7fa700 1 -- 172.21.15.6:0/807823666 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6984014230 con 0x7f6990161c20 2023-07-06T19:59:23.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.183+0000 7f1e4811f700 1 -- 172.21.15.6:0/1481983945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e400ce380 con 0x7f1e4006a7f0 2023-07-06T19:59:23.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.183+0000 7f698d7fa700 1 --2- 172.21.15.6:0/807823666 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f697c06ace0 0x7f697c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.183+0000 7f698d7fa700 1 -- 172.21.15.6:0/807823666 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f698409c210 con 0x7f6990161c20 2023-07-06T19:59:23.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.183+0000 7fb14a5f0700 1 Processor -- start 2023-07-06T19:59:23.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.183+0000 7fb14a5f0700 1 -- start start 2023-07-06T19:59:23.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.184+0000 7f1e367fc700 1 -- 172.21.15.6:0/1481983945 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1e38007470 con 0x7f1e4006a7f0 2023-07-06T19:59:23.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.183+0000 7f43347a7700 1 -- 172.21.15.6:0/710073846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f432c15cd40 msgr2=0x7f432c0cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.183+0000 7f43347a7700 1 --2- 172.21.15.6:0/710073846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f432c15cd40 0x7f432c0cb860 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4324009d90 tx=0x7f432400b330 comp rx=0 tx=0).stop 2023-07-06T19:59:23.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.183+0000 7f43347a7700 1 -- 172.21.15.6:0/710073846 shutdown_connections 2023-07-06T19:59:23.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.183+0000 7f43347a7700 1 --2- 172.21.15.6:0/710073846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f432c15cd40 0x7f432c0cb860 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.183+0000 7f43347a7700 1 -- 172.21.15.6:0/710073846 >> 172.21.15.6:0/710073846 conn(0x7f432c0cf960 msgr2=0x7f432c0cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:23.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.184+0000 7f6994e8b700 1 --2- 172.21.15.6:0/807823666 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f697c06ace0 0x7f697c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.184+0000 7f1e367fc700 1 --2- 172.21.15.6:0/1481983945 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1e2406ace0 0x7f1e2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.184+0000 7f1e367fc700 1 -- 172.21.15.6:0/1481983945 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1e380892c0 con 0x7f1e4006a7f0 2023-07-06T19:59:23.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.184+0000 7f43347a7700 1 -- 172.21.15.6:0/710073846 shutdown_connections 2023-07-06T19:59:23.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.185+0000 7f6994e8b700 1 --2- 172.21.15.6:0/807823666 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f697c06ace0 0x7f697c06d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6980001850 tx=0x7f6980009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.185+0000 7f43347a7700 1 -- 172.21.15.6:0/710073846 wait complete. 2023-07-06T19:59:23.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.185+0000 7fb14a5f0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb144160b10 0x7fb1440c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.185+0000 7fb14a5f0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb1440ca4b0 0x7fb14406ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.185+0000 7fb14a5f0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14406d8d0 con 0x7fb14406b220 2023-07-06T19:59:23.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.185+0000 7fb14a5f0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1440ca920 con 0x7fb1440ca4b0 2023-07-06T19:59:23.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.185+0000 7fb14a5f0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440cab40 con 0x7fb144160b10 2023-07-06T19:59:23.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.185+0000 7fb148b8d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb14406b220 0x7fb1440ccb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60430/0 (socket says 172.21.15.6:60430) 2023-07-06T19:59:23.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.185+0000 7fb148b8d700 1 -- 172.21.15.6:0/53102135 learned_addr learned my addr 172.21.15.6:0/53102135 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:23.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.185+0000 7fb1437fe700 1 --2- 172.21.15.6:0/53102135 >> v2:172.21.15.6:3300/0 conn(0x7fb1440ca4b0 0x7fb14406ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.185+0000 7fb1437fe700 1 -- 172.21.15.6:0/53102135 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb144160b10 msgr2=0x7fb1440c58a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-06T19:59:23.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.185+0000 7fb1437fe700 1 --2- 172.21.15.6:0/53102135 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb144160b10 0x7fb1440c58a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.185+0000 7fb1437fe700 1 -- 172.21.15.6:0/53102135 >> v1:172.21.15.6:6789/0 conn(0x7fb14406b220 legacy=0x7fb1440ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.185+0000 7fb1437fe700 1 -- 172.21.15.6:0/53102135 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14406a200 con 0x7fb1440ca4b0 2023-07-06T19:59:23.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.186+0000 7fb1437fe700 1 --2- 172.21.15.6:0/53102135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1440ca4b0 0x7fb14406ace0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb138009840 tx=0x7fb138009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e35cd9623c38cc6 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.186+0000 7f43347a7700 1 Processor -- start 2023-07-06T19:59:23.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.186+0000 7f43347a7700 1 -- start start 2023-07-06T19:59:23.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.188+0000 7f43347a7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f432c071da0 0x7f432c15bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.188+0000 7f43347a7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f432c1592b0 0x7f432c147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.187+0000 7f871143a700 1 -- start start 2023-07-06T19:59:23.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.188+0000 7f871143a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f870c158400 0x7f870c06d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.188+0000 7f871143a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f870c0ca770 0x7f870c0cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.188+0000 7f871143a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f870c1587d0 con 0x7f870c06a060 2023-07-06T19:59:23.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.188+0000 7f871143a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f870c06c650 con 0x7f870c158400 2023-07-06T19:59:23.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.188+0000 7f871143a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870c06c930 con 0x7f870c0ca770 2023-07-06T19:59:23.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.188+0000 7f870affd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f870c158400 0x7f870c06d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.188+0000 7f870affd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f870c158400 0x7f870c06d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:38264/0 (socket says 172.21.15.6:38264) 2023-07-06T19:59:23.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.188+0000 7f870affd700 1 -- 172.21.15.6:0/651283317 learned_addr learned my addr 172.21.15.6:0/651283317 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:23.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.188+0000 7f43347a7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f432c15cd40 0x7f432c148120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.188+0000 7f43347a7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c148660 con 0x7f432c15cd40 2023-07-06T19:59:23.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.188+0000 7f43347a7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c15b710 con 0x7f432c071da0 2023-07-06T19:59:23.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.188+0000 7f43347a7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432c158600 con 0x7f432c1592b0 2023-07-06T19:59:23.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.188+0000 7f4331d42700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f432c1592b0 0x7f432c147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.188+0000 7f4331d42700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f432c1592b0 0x7f432c147be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:51870/0 (socket says 172.21.15.6:51870) 2023-07-06T19:59:23.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.188+0000 7f4331d42700 1 -- 172.21.15.6:0/834616312 learned_addr learned my addr 172.21.15.6:0/834616312 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:23.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.188+0000 7f4332d44700 1 --2- 172.21.15.6:0/834616312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f432c15cd40 0x7f432c148120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.188+0000 7f4332543700 1 --2- 172.21.15.6:0/834616312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f432c071da0 0x7f432c15bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.187+0000 7f1e45ebb700 1 --2- 172.21.15.6:0/1481983945 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1e2406ace0 0x7f1e2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.189+0000 7f870a7fc700 1 --2- 172.21.15.6:0/651283317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f870c0ca770 0x7f870c0cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.188+0000 7f4332d44700 1 -- 172.21.15.6:0/834616312 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f432c1592b0 msgr2=0x7f432c147be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.188+0000 7f4332d44700 1 --2- 172.21.15.6:0/834616312 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f432c1592b0 0x7f432c147be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.188+0000 7f4332d44700 1 -- 172.21.15.6:0/834616312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f432c071da0 msgr2=0x7f432c15bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.188+0000 7f4332d44700 1 --2- 172.21.15.6:0/834616312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f432c071da0 0x7f432c15bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.188+0000 7f4332d44700 1 -- 172.21.15.6:0/834616312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4324009a70 con 0x7f432c15cd40 2023-07-06T19:59:23.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.189+0000 7f1e45ebb700 1 --2- 172.21.15.6:0/1481983945 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1e2406ace0 0x7f1e2406d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1e4008a0e0 tx=0x7f1e30008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.189+0000 7f744f7a9700 1 Processor -- start 2023-07-06T19:59:23.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.189+0000 7f4332d44700 1 --2- 172.21.15.6:0/834616312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f432c15cd40 0x7f432c148120 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4324016000 tx=0x7f4324004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.189+0000 7f870a7fc700 1 -- 172.21.15.6:0/651283317 >> v2:172.21.15.40:3300/0 conn(0x7f870c158400 msgr2=0x7f870c06d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:23.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.189+0000 7f870a7fc700 1 --2- 172.21.15.6:0/651283317 >> v2:172.21.15.40:3300/0 conn(0x7f870c158400 0x7f870c06d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.189+0000 7f870a7fc700 1 -- 172.21.15.6:0/651283317 >> v1:172.21.15.6:6789/0 conn(0x7f870c06a060 legacy=0x7f870c0cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.189+0000 7f698d7fa700 1 -- 172.21.15.6:0/807823666 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6990162e50 con 0x7f6990161c20 2023-07-06T19:59:23.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.189+0000 7f870a7fc700 1 -- 172.21.15.6:0/651283317 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f870c06cc10 con 0x7f870c0ca770 2023-07-06T19:59:23.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.189+0000 7f744f7a9700 1 -- start start 2023-07-06T19:59:23.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.190+0000 7f744f7a9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f744806a770 0x7f7448158400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.190+0000 7f744f7a9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f744806d6f0 0x7f74480cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.191+0000 7f870a7fc700 1 --2- 172.21.15.6:0/651283317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f870c0ca770 0x7f870c0cabe0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f86fc009840 tx=0x7f86fc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a71f189c3897a9b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.190+0000 7f744f7a9700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744806db10 con 0x7f7448071590 2023-07-06T19:59:23.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.190+0000 7f744f7a9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74480cb000 con 0x7f744806d6f0 2023-07-06T19:59:23.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.190+0000 7f744f7a9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744806c650 con 0x7f744806a770 2023-07-06T19:59:23.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.191+0000 7f744dd46700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f744806d6f0 0x7f74480cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.191+0000 7f744dd46700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f744806d6f0 0x7f74480cc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59242/0 (socket says 172.21.15.6:59242) 2023-07-06T19:59:23.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.191+0000 7f744dd46700 1 -- 172.21.15.6:0/2886728160 learned_addr learned my addr 172.21.15.6:0/2886728160 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:23.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.191+0000 7f8709ffb700 1 -- 172.21.15.6:0/651283317 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc011830 con 0x7f870c0ca770 2023-07-06T19:59:23.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.191+0000 7f8709ffb700 1 -- 172.21.15.6:0/651283317 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86fc011990 con 0x7f870c0ca770 2023-07-06T19:59:23.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.191+0000 7f8709ffb700 1 -- 172.21.15.6:0/651283317 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86fc011d20 con 0x7f870c0ca770 2023-07-06T19:59:23.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.191+0000 7f744dd46700 1 -- 172.21.15.6:0/2886728160 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f744806a770 msgr2=0x7f7448158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:23.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.191+0000 7f744dd46700 1 --2- 172.21.15.6:0/2886728160 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f744806a770 0x7f7448158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.191+0000 7f744dd46700 1 -- 172.21.15.6:0/2886728160 >> v1:172.21.15.6:6789/0 conn(0x7f7448071590 legacy=0x7f744806a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.191+0000 7f744dd46700 1 -- 172.21.15.6:0/2886728160 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744806c930 con 0x7f744806d6f0 2023-07-06T19:59:23.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.191+0000 7f744dd46700 1 --2- 172.21.15.6:0/2886728160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744806d6f0 0x7f74480cc3a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f744400bb90 tx=0x7f744400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea362a07eb2e00b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.192+0000 7f871143a700 1 -- 172.21.15.6:0/651283317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f870c0ca770 msgr2=0x7f870c0cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.192+0000 7f871143a700 1 --2- 172.21.15.6:0/651283317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f870c0ca770 0x7f870c0cabe0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f86fc009840 tx=0x7f86fc009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:23.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.192+0000 7f871143a700 1 -- 172.21.15.6:0/651283317 shutdown_connections 2023-07-06T19:59:23.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.192+0000 7f871143a700 1 --2- 172.21.15.6:0/651283317 >> v2:172.21.15.40:3300/0 conn(0x7f870c158400 0x7f870c06d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.192+0000 7f871143a700 1 --2- 172.21.15.6:0/651283317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f870c0ca770 0x7f870c0cabe0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.192+0000 7f871143a700 1 -- 172.21.15.6:0/651283317 >> 172.21.15.6:0/651283317 conn(0x7f870c0cf420 msgr2=0x7f870c0cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:23.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.192+0000 7f871143a700 1 -- 172.21.15.6:0/651283317 shutdown_connections 2023-07-06T19:59:23.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.192+0000 7f871143a700 1 -- 172.21.15.6:0/651283317 wait complete. 2023-07-06T19:59:23.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.194+0000 7f871143a700 1 Processor -- start 2023-07-06T19:59:23.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.194+0000 7f871143a700 1 -- start start 2023-07-06T19:59:23.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.195+0000 7f1e367fc700 1 -- 172.21.15.6:0/1481983945 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1e38054080 con 0x7f1e4006a7f0 2023-07-06T19:59:23.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.195+0000 7f4322ffd700 1 -- 172.21.15.6:0/834616312 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4324012430 con 0x7f432c15cd40 2023-07-06T19:59:23.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.195+0000 7fb142ffd700 1 -- 172.21.15.6:0/53102135 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb138011830 con 0x7fb1440ca4b0 2023-07-06T19:59:23.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.196+0000 7f871143a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f870c06a060 0x7f870c148620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.196+0000 7f871143a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f870c0ca770 0x7f870c0c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.196+0000 7f871143a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f870c158400 0x7f870c0b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.196+0000 7f871143a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c1556d0 con 0x7f870c158400 2023-07-06T19:59:23.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.196+0000 7f871143a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870c1559b0 con 0x7f870c06a060 2023-07-06T19:59:23.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.196+0000 7f871143a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f870c155c90 con 0x7f870c0ca770 2023-07-06T19:59:23.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.196+0000 7f870b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f870c158400 0x7f870c0b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.196+0000 7f870affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f870c06a060 0x7f870c148620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.196+0000 7f870affd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f870c06a060 0x7f870c148620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:38280/0 (socket says 172.21.15.6:38280) 2023-07-06T19:59:23.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.196+0000 7f870b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f870c158400 0x7f870c0b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59248/0 (socket says 172.21.15.6:59248) 2023-07-06T19:59:23.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.196+0000 7f870affd700 1 -- 172.21.15.6:0/628778294 learned_addr learned my addr 172.21.15.6:0/628778294 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:23.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.195+0000 7f4322ffd700 1 -- 172.21.15.6:0/834616312 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4324004470 con 0x7f432c15cd40 2023-07-06T19:59:23.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.195+0000 7f4322ffd700 1 -- 172.21.15.6:0/834616312 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4324004820 con 0x7f432c15cd40 2023-07-06T19:59:23.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.196+0000 7f43347a7700 1 -- 172.21.15.6:0/834616312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432c1588e0 con 0x7f432c15cd40 2023-07-06T19:59:23.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.196+0000 7f43347a7700 1 -- 172.21.15.6:0/834616312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432c0b4c70 con 0x7f432c15cd40 2023-07-06T19:59:23.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.196+0000 7f870b7fe700 1 -- 172.21.15.6:0/628778294 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f870c0ca770 msgr2=0x7f870c0c7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.196+0000 7f870b7fe700 1 --2- 172.21.15.6:0/628778294 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f870c0ca770 0x7f870c0c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.196+0000 7f870b7fe700 1 -- 172.21.15.6:0/628778294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f870c06a060 msgr2=0x7f870c148620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.196+0000 7f870b7fe700 1 --2- 172.21.15.6:0/628778294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f870c06a060 0x7f870c148620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.196+0000 7f870b7fe700 1 -- 172.21.15.6:0/628778294 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86fc0094a0 con 0x7f870c158400 2023-07-06T19:59:23.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.197+0000 7f870b7fe700 1 --2- 172.21.15.6:0/628778294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f870c158400 0x7f870c0b3ab0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8700000f60 tx=0x7f870000c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.197+0000 7f86f37fe700 1 -- 172.21.15.6:0/628778294 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87000052d0 con 0x7f870c158400 2023-07-06T19:59:23.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.197+0000 7f86f37fe700 1 -- 172.21.15.6:0/628778294 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8700005450 con 0x7f870c158400 2023-07-06T19:59:23.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.197+0000 7f86f37fe700 1 -- 172.21.15.6:0/628778294 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87000038c0 con 0x7f870c158400 2023-07-06T19:59:23.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.197+0000 7f871143a700 1 -- 172.21.15.6:0/628778294 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f870c155f70 con 0x7f870c158400 2023-07-06T19:59:23.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.197+0000 7f871143a700 1 -- 172.21.15.6:0/628778294 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870c148b60 con 0x7f870c158400 2023-07-06T19:59:23.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.195+0000 7fb142ffd700 1 -- 172.21.15.6:0/53102135 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb138011990 con 0x7fb1440ca4b0 2023-07-06T19:59:23.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.195+0000 7fb142ffd700 1 -- 172.21.15.6:0/53102135 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb138011d20 con 0x7fb1440ca4b0 2023-07-06T19:59:23.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.196+0000 7fb14a5f0700 1 -- 172.21.15.6:0/53102135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1440ca4b0 msgr2=0x7fb14406ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.196+0000 7fb14a5f0700 1 --2- 172.21.15.6:0/53102135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1440ca4b0 0x7fb14406ace0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb138009840 tx=0x7fb138009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:23.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.198+0000 7f43347a7700 1 -- 172.21.15.6:0/834616312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f432c158b20 con 0x7f432c15cd40 2023-07-06T19:59:23.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.198+0000 7f743ffff700 1 -- 172.21.15.6:0/2886728160 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744400dc40 con 0x7f744806d6f0 2023-07-06T19:59:23.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.198+0000 7f743ffff700 1 -- 172.21.15.6:0/2886728160 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744400dda0 con 0x7f744806d6f0 2023-07-06T19:59:23.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.198+0000 7f743ffff700 1 -- 172.21.15.6:0/2886728160 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7444017630 con 0x7f744806d6f0 2023-07-06T19:59:23.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.198+0000 7fb14a5f0700 1 -- 172.21.15.6:0/53102135 shutdown_connections 2023-07-06T19:59:23.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.198+0000 7fb14a5f0700 1 --2- 172.21.15.6:0/53102135 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb144160b10 0x7fb1440c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.198+0000 7fb14a5f0700 1 --2- 172.21.15.6:0/53102135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1440ca4b0 0x7fb14406ace0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.198+0000 7fb14a5f0700 1 -- 172.21.15.6:0/53102135 >> 172.21.15.6:0/53102135 conn(0x7fb1440cf420 msgr2=0x7fb1440cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:23.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.198+0000 7f871143a700 1 -- 172.21.15.6:0/628778294 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f870c156490 con 0x7f870c158400 2023-07-06T19:59:23.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.199+0000 7f744f7a9700 1 -- 172.21.15.6:0/2886728160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744806d6f0 msgr2=0x7f74480cc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.199+0000 7f744f7a9700 1 --2- 172.21.15.6:0/2886728160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744806d6f0 0x7f74480cc3a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f744400bb90 tx=0x7f744400bea0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.200+0000 7f86f37fe700 1 -- 172.21.15.6:0/628778294 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8700003a20 con 0x7f870c158400 2023-07-06T19:59:23.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.201+0000 7f86f37fe700 1 --2- 172.21.15.6:0/628778294 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f86f806acb0 0x7f86f806d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.201+0000 7f86f37fe700 1 -- 172.21.15.6:0/628778294 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8700088c70 con 0x7f870c158400 2023-07-06T19:59:23.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.201+0000 7f870affd700 1 --2- 172.21.15.6:0/628778294 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f86f806acb0 0x7f86f806d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.202+0000 7f870affd700 1 --2- 172.21.15.6:0/628778294 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f86f806acb0 0x7f86f806d160 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8704007c10 tx=0x7f8704007660 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.201+0000 7f4322ffd700 1 -- 172.21.15.6:0/834616312 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4324030430 con 0x7f432c15cd40 2023-07-06T19:59:23.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.202+0000 7f4322ffd700 1 --2- 172.21.15.6:0/834616312 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f431006ace0 0x7f431006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.202+0000 7f4322ffd700 1 -- 172.21.15.6:0/834616312 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f432408b9c0 con 0x7f432c15cd40 2023-07-06T19:59:23.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.202+0000 7f4332543700 1 --2- 172.21.15.6:0/834616312 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f431006ace0 0x7f431006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.202+0000 7f4332543700 1 --2- 172.21.15.6:0/834616312 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f431006ace0 0x7f431006d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f431c007fd0 tx=0x7f431c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.203+0000 7f09473e3700 1 Processor -- start 2023-07-06T19:59:23.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.203+0000 7f09473e3700 1 -- start start 2023-07-06T19:59:23.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.204+0000 7f09473e3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f094016c5a0 0x7f094006c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.204+0000 7f09473e3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094006a060 con 0x7f094006a4f0 2023-07-06T19:59:23.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.204+0000 7f09473e3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094006d900 con 0x7f094016c970 2023-07-06T19:59:23.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.204+0000 7f09473e3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09400cdb10 con 0x7f094016c5a0 2023-07-06T19:59:23.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.204+0000 7f094497e700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f094016c970 0x7f094006cb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:50336/0 (socket says 172.21.15.6:50336) 2023-07-06T19:59:23.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.204+0000 7f094497e700 1 -- 172.21.15.6:0/392865244 learned_addr learned my addr 172.21.15.6:0/392865244 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:23.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.204+0000 7f094517f700 1 --2- 172.21.15.6:0/392865244 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f094016c5a0 0x7f094006c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.204+0000 7f0937fff700 1 -- 172.21.15.6:0/392865244 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982980370 0 0) 0x7f094006d900 con 0x7f094016c970 2023-07-06T19:59:23.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.204+0000 7f0937fff700 1 -- 172.21.15.6:0/392865244 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f092c0035b0 con 0x7f094016c970 2023-07-06T19:59:23.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.204+0000 7f094517f700 1 -- 172.21.15.6:0/392865244 >> v1:172.21.15.40:6789/0 conn(0x7f094016c970 legacy=0x7f094006cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.204+0000 7f094517f700 1 -- 172.21.15.6:0/392865244 >> v1:172.21.15.6:6789/0 conn(0x7f094006a4f0 legacy=0x7f094006a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.205+0000 7f094517f700 1 -- 172.21.15.6:0/392865244 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09400ca8c0 con 0x7f094016c5a0 2023-07-06T19:59:23.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.205+0000 7f094517f700 1 --2- 172.21.15.6:0/392865244 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f094016c5a0 0x7f094006c650 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0938009dc0 tx=0x7f093800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e31e54edac3dd041 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.205+0000 7f0937fff700 1 -- 172.21.15.6:0/392865244 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093800e070 con 0x7f094016c5a0 2023-07-06T19:59:23.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.205+0000 7f0937fff700 1 -- 172.21.15.6:0/392865244 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093800bae0 con 0x7f094016c5a0 2023-07-06T19:59:23.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.205+0000 7f0937fff700 1 -- 172.21.15.6:0/392865244 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093800be90 con 0x7f094016c5a0 2023-07-06T19:59:23.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.206+0000 7fb14a5f0700 1 -- 172.21.15.6:0/53102135 shutdown_connections 2023-07-06T19:59:23.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.206+0000 7fb14a5f0700 1 -- 172.21.15.6:0/53102135 wait complete. 2023-07-06T19:59:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.206+0000 7f09473e3700 1 -- 172.21.15.6:0/392865244 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f094016c5a0 msgr2=0x7f094006c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.206+0000 7f09473e3700 1 --2- 172.21.15.6:0/392865244 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f094016c5a0 0x7f094006c650 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0938009dc0 tx=0x7f093800b330 comp rx=0 tx=0).stop 2023-07-06T19:59:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.206+0000 7f09473e3700 1 -- 172.21.15.6:0/392865244 shutdown_connections 2023-07-06T19:59:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.206+0000 7f09473e3700 1 --2- 172.21.15.6:0/392865244 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f094016c5a0 0x7f094006c650 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.206+0000 7f09473e3700 1 -- 172.21.15.6:0/392865244 >> 172.21.15.6:0/392865244 conn(0x7f09400cf420 msgr2=0x7f09400cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.206+0000 7f09473e3700 1 -- 172.21.15.6:0/392865244 shutdown_connections 2023-07-06T19:59:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.206+0000 7f09473e3700 1 -- 172.21.15.6:0/392865244 wait complete. 2023-07-06T19:59:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.207+0000 7fb14a5f0700 1 Processor -- start 2023-07-06T19:59:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.208+0000 7f09473e3700 1 Processor -- start 2023-07-06T19:59:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.208+0000 7f4322ffd700 1 -- 172.21.15.6:0/834616312 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4324056920 con 0x7f432c15cd40 2023-07-06T19:59:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.208+0000 7fb14a5f0700 1 -- start start 2023-07-06T19:59:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.209+0000 7fb14a5f0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb14406b220 0x7fb1440b4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.209+0000 7fb14a5f0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1440ca4b0 0x7fb144153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.209+0000 7fb14a5f0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb144160b10 0x7fb1441618f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.209+0000 7fb14a5f0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb144162090 con 0x7fb144160b10 2023-07-06T19:59:23.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.209+0000 7fb14a5f0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440b21a0 con 0x7fb14406b220 2023-07-06T19:59:23.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.209+0000 7fb14a5f0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1441543d0 con 0x7fb1440ca4b0 2023-07-06T19:59:23.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.209+0000 7fb148b8d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb144160b10 0x7fb1441618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.209+0000 7fb148b8d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb144160b10 0x7fb1441618f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59262/0 (socket says 172.21.15.6:59262) 2023-07-06T19:59:23.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.209+0000 7fb148b8d700 1 -- 172.21.15.6:0/2298481450 learned_addr learned my addr 172.21.15.6:0/2298481450 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:23.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.209+0000 7fb1437fe700 1 --2- 172.21.15.6:0/2298481450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1440ca4b0 0x7fb144153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.208+0000 7f09473e3700 1 -- start start 2023-07-06T19:59:23.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.210+0000 7f09473e3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f094006a4f0 0x7f09400c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.210+0000 7f09473e3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f094016c5a0 0x7f09400c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.210+0000 7f09473e3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094016c970 0x7f09400c5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.210+0000 7f09473e3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09400892e0 con 0x7f094016c970 2023-07-06T19:59:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.210+0000 7f09473e3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09400c7e90 con 0x7f094006a4f0 2023-07-06T19:59:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.210+0000 7f09473e3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09400c8170 con 0x7f094016c5a0 2023-07-06T19:59:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.210+0000 7f0945980700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094016c970 0x7f09400c5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.210+0000 7f0945980700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094016c970 0x7f09400c5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59266/0 (socket says 172.21.15.6:59266) 2023-07-06T19:59:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.210+0000 7f0945980700 1 -- 172.21.15.6:0/3684646277 learned_addr learned my addr 172.21.15.6:0/3684646277 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.210+0000 7f094517f700 1 --2- 172.21.15.6:0/3684646277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f094006a4f0 0x7f09400c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.210+0000 7f094497e700 1 --2- 172.21.15.6:0/3684646277 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f094016c5a0 0x7f09400c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.210+0000 7f094517f700 1 -- 172.21.15.6:0/3684646277 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f094016c5a0 msgr2=0x7f09400c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.210+0000 7f094517f700 1 --2- 172.21.15.6:0/3684646277 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f094016c5a0 0x7f09400c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.210+0000 7f094517f700 1 -- 172.21.15.6:0/3684646277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094016c970 msgr2=0x7f09400c5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.210+0000 7f094517f700 1 --2- 172.21.15.6:0/3684646277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094016c970 0x7f09400c5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.210+0000 7f094517f700 1 -- 172.21.15.6:0/3684646277 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0938009a70 con 0x7f094006a4f0 2023-07-06T19:59:23.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.210+0000 7fb148b8d700 1 -- 172.21.15.6:0/2298481450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1440ca4b0 msgr2=0x7fb144153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.210+0000 7fb148b8d700 1 --2- 172.21.15.6:0/2298481450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1440ca4b0 0x7fb144153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.210+0000 7fb148b8d700 1 -- 172.21.15.6:0/2298481450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb14406b220 msgr2=0x7fb1440b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.210+0000 7fb148b8d700 1 --2- 172.21.15.6:0/2298481450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb14406b220 0x7fb1440b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.210+0000 7fb148b8d700 1 -- 172.21.15.6:0/2298481450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1380094a0 con 0x7fb144160b10 2023-07-06T19:59:23.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.210+0000 7fb148b8d700 1 --2- 172.21.15.6:0/2298481450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb144160b10 0x7fb1441618f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb13c00cad0 tx=0x7fb13c00ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.211+0000 7f744f7a9700 1 -- 172.21.15.6:0/2886728160 shutdown_connections 2023-07-06T19:59:23.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.211+0000 7f744f7a9700 1 --2- 172.21.15.6:0/2886728160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744806d6f0 0x7f74480cc3a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.211+0000 7f744f7a9700 1 --2- 172.21.15.6:0/2886728160 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f744806a770 0x7f7448158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.211+0000 7f744f7a9700 1 -- 172.21.15.6:0/2886728160 >> 172.21.15.6:0/2886728160 conn(0x7f74480cf420 msgr2=0x7f74480cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:23.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.216+0000 7f744f7a9700 1 -- 172.21.15.6:0/2886728160 shutdown_connections 2023-07-06T19:59:23.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.217+0000 7f744f7a9700 1 -- 172.21.15.6:0/2886728160 wait complete. 2023-07-06T19:59:23.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.217+0000 7f094517f700 1 --2- 172.21.15.6:0/3684646277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f094006a4f0 0x7f09400c77b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0938015000 tx=0x7f0938004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.217+0000 7f86f37fe700 1 -- 172.21.15.6:0/628778294 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8700053b30 con 0x7f870c158400 2023-07-06T19:59:23.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.219+0000 7f744f7a9700 1 Processor -- start 2023-07-06T19:59:23.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.218+0000 7fb140ff9700 1 -- 172.21.15.6:0/2298481450 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c00aac0 con 0x7fb144160b10 2023-07-06T19:59:23.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.218+0000 7fb140ff9700 1 -- 172.21.15.6:0/2298481450 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c00ac20 con 0x7fb144160b10 2023-07-06T19:59:23.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.218+0000 7fb140ff9700 1 -- 172.21.15.6:0/2298481450 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c012400 con 0x7fb144160b10 2023-07-06T19:59:23.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.219+0000 7f0935ffb700 1 -- 172.21.15.6:0/3684646277 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938004640 con 0x7f094006a4f0 2023-07-06T19:59:23.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.219+0000 7f0935ffb700 1 -- 172.21.15.6:0/3684646277 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09380047c0 con 0x7f094006a4f0 2023-07-06T19:59:23.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.219+0000 7f0935ffb700 1 -- 172.21.15.6:0/3684646277 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938012670 con 0x7f094006a4f0 2023-07-06T19:59:23.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.219+0000 7f09473e3700 1 -- 172.21.15.6:0/3684646277 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09400c8450 con 0x7f094006a4f0 2023-07-06T19:59:23.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.219+0000 7f09473e3700 1 -- 172.21.15.6:0/3684646277 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09400c8730 con 0x7f094006a4f0 2023-07-06T19:59:23.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.220+0000 7f744f7a9700 1 -- start start 2023-07-06T19:59:23.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.221+0000 7f09473e3700 1 -- 172.21.15.6:0/3684646277 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09200052f0 con 0x7f094006a4f0 2023-07-06T19:59:23.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.221+0000 7fb14a5f0700 1 -- 172.21.15.6:0/2298481450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb144161e30 con 0x7fb144160b10 2023-07-06T19:59:23.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.221+0000 7fb14a5f0700 1 -- 172.21.15.6:0/2298481450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1440b1b50 con 0x7fb144160b10 2023-07-06T19:59:23.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.222+0000 7f744f7a9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f744806a770 0x7f74480b1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.222+0000 7f744f7a9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744806d6f0 0x7f74480b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.222+0000 7f744f7a9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7448071590 0x7f74481569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.222+0000 7f744f7a9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74480c58a0 con 0x7f744806d6f0 2023-07-06T19:59:23.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.222+0000 7f744f7a9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74480c5ab0 con 0x7f744806a770 2023-07-06T19:59:23.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.222+0000 7f744f7a9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74480c5d90 con 0x7f7448071590 2023-07-06T19:59:23.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.223+0000 7f0935ffb700 1 -- 172.21.15.6:0/3684646277 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f09380127d0 con 0x7f094006a4f0 2023-07-06T19:59:23.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.224+0000 7f0935ffb700 1 --2- 172.21.15.6:0/3684646277 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f092406ad30 0x7f092406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.224+0000 7f0935ffb700 1 -- 172.21.15.6:0/3684646277 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f093808bf50 con 0x7f094006a4f0 2023-07-06T19:59:23.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.225+0000 7f744d545700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f744806a770 0x7f74480b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.225+0000 7f744d545700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f744806a770 0x7f74480b1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:38314/0 (socket says 172.21.15.6:38314) 2023-07-06T19:59:23.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.225+0000 7f744d545700 1 -- 172.21.15.6:0/1820638615 learned_addr learned my addr 172.21.15.6:0/1820638615 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:23.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.225+0000 7fb140ff9700 1 -- 172.21.15.6:0/2298481450 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb13c01b3b0 con 0x7fb144160b10 2023-07-06T19:59:23.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.225+0000 7f744dd46700 1 --2- 172.21.15.6:0/1820638615 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7448071590 0x7f74481569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.225+0000 7f744cd44700 1 --2- 172.21.15.6:0/1820638615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744806d6f0 0x7f74480b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.226+0000 7f744cd44700 1 -- 172.21.15.6:0/1820638615 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7448071590 msgr2=0x7f74481569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.226+0000 7f744cd44700 1 --2- 172.21.15.6:0/1820638615 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7448071590 0x7f74481569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.226+0000 7f744cd44700 1 -- 172.21.15.6:0/1820638615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f744806a770 msgr2=0x7f74480b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.226+0000 7f744cd44700 1 --2- 172.21.15.6:0/1820638615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f744806a770 0x7f74480b1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.226+0000 7f744cd44700 1 -- 172.21.15.6:0/1820638615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744400b7f0 con 0x7f744806d6f0 2023-07-06T19:59:23.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.226+0000 7fb140ff9700 1 --2- 172.21.15.6:0/2298481450 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb13006ad30 0x7fb13006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.226+0000 7fb140ff9700 1 -- 172.21.15.6:0/2298481450 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb13c089480 con 0x7fb144160b10 2023-07-06T19:59:23.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.226+0000 7f744cd44700 1 --2- 172.21.15.6:0/1820638615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744806d6f0 0x7f74480b1c80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f74480c5820 tx=0x7f744000bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.226+0000 7f743dffb700 1 -- 172.21.15.6:0/1820638615 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744000cc30 con 0x7f744806d6f0 2023-07-06T19:59:23.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.226+0000 7f743dffb700 1 -- 172.21.15.6:0/1820638615 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744000cd90 con 0x7f744806d6f0 2023-07-06T19:59:23.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.226+0000 7f743dffb700 1 -- 172.21.15.6:0/1820638615 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7440014680 con 0x7f744806d6f0 2023-07-06T19:59:23.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.226+0000 7f744f7a9700 1 -- 172.21.15.6:0/1820638615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74480c6070 con 0x7f744806d6f0 2023-07-06T19:59:23.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.227+0000 7f0935ffb700 1 -- 172.21.15.6:0/3684646277 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0938056e00 con 0x7f094006a4f0 2023-07-06T19:59:23.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.228+0000 7f744f7a9700 1 -- 172.21.15.6:0/1820638615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74480c6630 con 0x7f744806d6f0 2023-07-06T19:59:23.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.233+0000 7fb143fff700 1 --2- 172.21.15.6:0/2298481450 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb13006ad30 0x7fb13006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.237+0000 7f094497e700 1 --2- 172.21.15.6:0/3684646277 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f092406ad30 0x7f092406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.229+0000 7f744f7a9700 1 -- 172.21.15.6:0/1820638615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74480cae70 con 0x7f744806d6f0 2023-07-06T19:59:23.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.229+0000 7f743dffb700 1 -- 172.21.15.6:0/1820638615 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f744001d3b0 con 0x7f744806d6f0 2023-07-06T19:59:23.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.230+0000 7f743dffb700 1 --2- 172.21.15.6:0/1820638615 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f742c06ace0 0x7f742c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.230+0000 7f743dffb700 1 -- 172.21.15.6:0/1820638615 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7440006e40 con 0x7f744806d6f0 2023-07-06T19:59:23.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.230+0000 7f744d545700 1 --2- 172.21.15.6:0/1820638615 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f742c06ace0 0x7f742c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.242+0000 7fb14a5f0700 1 -- 172.21.15.6:0/2298481450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb14404eb90 con 0x7fb144160b10 2023-07-06T19:59:23.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.242+0000 7fb143fff700 1 --2- 172.21.15.6:0/2298481450 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb13006ad30 0x7fb13006d1e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb1340096d0 tx=0x7fb134006c30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.240+0000 7f094497e700 1 --2- 172.21.15.6:0/3684646277 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f092406ad30 0x7f092406d1e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f094020ad50 tx=0x7f093c007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.246+0000 7f744d545700 1 --2- 172.21.15.6:0/1820638615 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f742c06ace0 0x7f742c06d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7438001880 tx=0x7f7438009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.252+0000 7fb140ff9700 1 -- 172.21.15.6:0/2298481450 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb13c0542b0 con 0x7fb144160b10 2023-07-06T19:59:23.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.252+0000 7f743dffb700 1 -- 172.21.15.6:0/1820638615 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f744008e060 con 0x7f744806d6f0 2023-07-06T19:59:23.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.542+0000 7fa288409700 1 -- 172.21.15.6:0/1685428523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa2680055a0 con 0x7fa280168f30 2023-07-06T19:59:23.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.543+0000 7fa276ffd700 1 -- 172.21.15.6:0/1685428523 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa270058150 con 0x7fa280168f30 2023-07-06T19:59:23.548 INFO:teuthology.orchestra.run.smithi006.stdout:55834574860 2023-07-06T19:59:23.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.546+0000 7fa288409700 1 -- 172.21.15.6:0/1685428523 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa26406adb0 msgr2=0x7fa26406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.546+0000 7fa288409700 1 --2- 172.21.15.6:0/1685428523 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa26406adb0 0x7fa26406d260 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa27c007fd0 tx=0x7fa27c007980 comp rx=0 tx=0).stop 2023-07-06T19:59:23.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.546+0000 7fa288409700 1 -- 172.21.15.6:0/1685428523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa280168f30 msgr2=0x7fa2801f7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.546+0000 7fa288409700 1 --2- 172.21.15.6:0/1685428523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa280168f30 0x7fa2801f7890 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa27000ea40 tx=0x7fa27000ee00 comp rx=0 tx=0).stop 2023-07-06T19:59:23.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.547+0000 7fa288409700 1 -- 172.21.15.6:0/1685428523 shutdown_connections 2023-07-06T19:59:23.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.547+0000 7fa288409700 1 --2- 172.21.15.6:0/1685428523 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa26406adb0 0x7fa26406d260 secure :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa27c007fd0 tx=0x7fa27c007980 comp rx=0 tx=0).stop 2023-07-06T19:59:23.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.547+0000 7fa288409700 1 --2- 172.21.15.6:0/1685428523 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa28016d6c0 0x7fa2801f5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.547+0000 7fa288409700 1 --2- 172.21.15.6:0/1685428523 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa2800705d0 0x7fa28016c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.547+0000 7fa288409700 1 --2- 172.21.15.6:0/1685428523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa280168f30 0x7fa2801f7890 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.547+0000 7fa288409700 1 -- 172.21.15.6:0/1685428523 >> 172.21.15.6:0/1685428523 conn(0x7fa2800b1140 msgr2=0x7fa2800b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:23.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.547+0000 7fa288409700 1 -- 172.21.15.6:0/1685428523 shutdown_connections 2023-07-06T19:59:23.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.547+0000 7fa288409700 1 -- 172.21.15.6:0/1685428523 wait complete. 2023-07-06T19:59:23.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.0 2023-07-06T19:59:23.567 DEBUG:teuthology.parallel:result is None 2023-07-06T19:59:23.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.578+0000 7f1e4811f700 1 -- 172.21.15.6:0/1481983945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1e4004eb90 con 0x7f1e4006a7f0 2023-07-06T19:59:23.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.582+0000 7f1e367fc700 1 -- 172.21.15.6:0/1481983945 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1e380576a0 con 0x7f1e4006a7f0 2023-07-06T19:59:23.584 INFO:teuthology.orchestra.run.smithi006.stdout:55834574860 2023-07-06T19:59:23.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.584+0000 7f69970ef700 1 -- 172.21.15.6:0/807823666 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f6990162e50 con 0x7f6990161c20 2023-07-06T19:59:23.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.585+0000 7f1e4811f700 1 -- 172.21.15.6:0/1481983945 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1e2406ace0 msgr2=0x7f1e2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.585+0000 7f1e4811f700 1 --2- 172.21.15.6:0/1481983945 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1e2406ace0 0x7f1e2406d190 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1e4008a0e0 tx=0x7f1e30008040 comp rx=0 tx=0).stop 2023-07-06T19:59:23.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.585+0000 7f1e4811f700 1 -- 172.21.15.6:0/1481983945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e4006a7f0 msgr2=0x7f1e4006ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.585+0000 7f1e4811f700 1 --2- 172.21.15.6:0/1481983945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e4006a7f0 0x7f1e4006ac70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1e38002230 tx=0x7f1e3800a060 comp rx=0 tx=0).stop 2023-07-06T19:59:23.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.585+0000 7f698d7fa700 1 -- 172.21.15.6:0/807823666 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6990162e50 con 0x7f6990161c20 2023-07-06T19:59:23.589 INFO:teuthology.orchestra.run.smithi006.stdout:55834574860 2023-07-06T19:59:23.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.586+0000 7f1e4811f700 1 -- 172.21.15.6:0/1481983945 shutdown_connections 2023-07-06T19:59:23.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.586+0000 7f1e4811f700 1 --2- 172.21.15.6:0/1481983945 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1e2406ace0 0x7f1e2406d190 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1e4008a0e0 tx=0x7f1e30008040 comp rx=0 tx=0).stop 2023-07-06T19:59:23.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.586+0000 7f1e4811f700 1 --2- 172.21.15.6:0/1481983945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e4006a7f0 0x7f1e4006ac70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.586+0000 7f1e4811f700 1 --2- 172.21.15.6:0/1481983945 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1e400cd800 0x7f1e401e70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.586+0000 7f1e4811f700 1 --2- 172.21.15.6:0/1481983945 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1e400d0c00 0x7f1e401581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.586+0000 7f1e4811f700 1 -- 172.21.15.6:0/1481983945 >> 172.21.15.6:0/1481983945 conn(0x7f1e400d3900 msgr2=0x7f1e400c9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:23.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.588+0000 7f69970ef700 1 -- 172.21.15.6:0/807823666 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f697c06ace0 msgr2=0x7f697c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.588+0000 7f69970ef700 1 --2- 172.21.15.6:0/807823666 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f697c06ace0 0x7f697c06d190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6980001850 tx=0x7f6980009040 comp rx=0 tx=0).stop 2023-07-06T19:59:23.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.588+0000 7f69970ef700 1 -- 172.21.15.6:0/807823666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6990161c20 msgr2=0x7f6990202e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.588+0000 7f69970ef700 1 --2- 172.21.15.6:0/807823666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6990161c20 0x7f6990202e80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6984008d10 tx=0x7f6984008200 comp rx=0 tx=0).stop 2023-07-06T19:59:23.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.589+0000 7f69970ef700 1 -- 172.21.15.6:0/807823666 shutdown_connections 2023-07-06T19:59:23.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.589+0000 7f69970ef700 1 --2- 172.21.15.6:0/807823666 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f697c06ace0 0x7f697c06d190 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.589+0000 7f69970ef700 1 --2- 172.21.15.6:0/807823666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f699015fc30 0x7f69901600a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.589+0000 7f69970ef700 1 --2- 172.21.15.6:0/807823666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6990202570 0x7f6990202940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.589+0000 7f69970ef700 1 --2- 172.21.15.6:0/807823666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6990161c20 0x7f6990202e80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.589+0000 7f69970ef700 1 -- 172.21.15.6:0/807823666 >> 172.21.15.6:0/807823666 conn(0x7f69900cf420 msgr2=0x7f6990168380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:23.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.590+0000 7f69970ef700 1 -- 172.21.15.6:0/807823666 shutdown_connections 2023-07-06T19:59:23.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.590+0000 7f69970ef700 1 -- 172.21.15.6:0/807823666 wait complete. 2023-07-06T19:59:23.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.595+0000 7f1e4811f700 1 -- 172.21.15.6:0/1481983945 shutdown_connections 2023-07-06T19:59:23.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.596+0000 7f1e4811f700 1 -- 172.21.15.6:0/1481983945 wait complete. 2023-07-06T19:59:23.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.604+0000 7f43347a7700 1 -- 172.21.15.6:0/834616312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f432c15b880 con 0x7f432c15cd40 2023-07-06T19:59:23.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.608+0000 7f4322ffd700 1 -- 172.21.15.6:0/834616312 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4324059f40 con 0x7f432c15cd40 2023-07-06T19:59:23.609 INFO:teuthology.orchestra.run.smithi006.stdout:55834574859 2023-07-06T19:59:23.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.611+0000 7f43347a7700 1 -- 172.21.15.6:0/834616312 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f431006ace0 msgr2=0x7f431006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.611+0000 7f43347a7700 1 --2- 172.21.15.6:0/834616312 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f431006ace0 0x7f431006d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f431c007fd0 tx=0x7f431c009040 comp rx=0 tx=0).stop 2023-07-06T19:59:23.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.611+0000 7f43347a7700 1 -- 172.21.15.6:0/834616312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f432c15cd40 msgr2=0x7f432c148120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.611+0000 7f43347a7700 1 --2- 172.21.15.6:0/834616312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f432c15cd40 0x7f432c148120 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4324016000 tx=0x7f4324004ad0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.7 2023-07-06T19:59:23.616 DEBUG:teuthology.parallel:result is None 2023-07-06T19:59:23.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.612+0000 7f43347a7700 1 -- 172.21.15.6:0/834616312 shutdown_connections 2023-07-06T19:59:23.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.612+0000 7f43347a7700 1 --2- 172.21.15.6:0/834616312 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f431006ace0 0x7f431006d190 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.612+0000 7f43347a7700 1 --2- 172.21.15.6:0/834616312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f432c15cd40 0x7f432c148120 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.612+0000 7f43347a7700 1 --2- 172.21.15.6:0/834616312 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f432c071da0 0x7f432c15bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.612+0000 7f43347a7700 1 --2- 172.21.15.6:0/834616312 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f432c1592b0 0x7f432c147be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.612+0000 7f43347a7700 1 -- 172.21.15.6:0/834616312 >> 172.21.15.6:0/834616312 conn(0x7f432c0cf960 msgr2=0x7f432c06ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:23.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.612+0000 7f43347a7700 1 -- 172.21.15.6:0/834616312 shutdown_connections 2023-07-06T19:59:23.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.612+0000 7f43347a7700 1 -- 172.21.15.6:0/834616312 wait complete. 2023-07-06T19:59:23.619 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.3 2023-07-06T19:59:23.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.617+0000 7f09473e3700 1 -- 172.21.15.6:0/3684646277 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0920005870 con 0x7f094006a4f0 2023-07-06T19:59:23.620 INFO:teuthology.orchestra.run.smithi006.stdout:55834574860 2023-07-06T19:59:23.620 DEBUG:teuthology.parallel:result is None 2023-07-06T19:59:23.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.618+0000 7f0935ffb700 1 -- 172.21.15.6:0/3684646277 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0938004930 con 0x7f094006a4f0 2023-07-06T19:59:23.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.620+0000 7f09473e3700 1 -- 172.21.15.6:0/3684646277 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f092406ad30 msgr2=0x7f092406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.620+0000 7f09473e3700 1 --2- 172.21.15.6:0/3684646277 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f092406ad30 0x7f092406d1e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f094020ad50 tx=0x7f093c007de0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.620+0000 7f09473e3700 1 -- 172.21.15.6:0/3684646277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f094006a4f0 msgr2=0x7f09400c77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.620+0000 7f09473e3700 1 --2- 172.21.15.6:0/3684646277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f094006a4f0 0x7f09400c77b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0938015000 tx=0x7f0938004ad0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.620+0000 7f09473e3700 1 -- 172.21.15.6:0/3684646277 shutdown_connections 2023-07-06T19:59:23.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.620+0000 7f09473e3700 1 --2- 172.21.15.6:0/3684646277 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f092406ad30 0x7f092406d1e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.620+0000 7f09473e3700 1 --2- 172.21.15.6:0/3684646277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f094016c970 0x7f09400c5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.620+0000 7f09473e3700 1 --2- 172.21.15.6:0/3684646277 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f094006a4f0 0x7f09400c77b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.620+0000 7f09473e3700 1 --2- 172.21.15.6:0/3684646277 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f094016c5a0 0x7f09400c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.620+0000 7f09473e3700 1 -- 172.21.15.6:0/3684646277 >> 172.21.15.6:0/3684646277 conn(0x7f09400cf420 msgr2=0x7f09400c4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:23.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.620+0000 7f09473e3700 1 -- 172.21.15.6:0/3684646277 shutdown_connections 2023-07-06T19:59:23.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.620+0000 7f09473e3700 1 -- 172.21.15.6:0/3684646277 wait complete. 2023-07-06T19:59:23.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.628+0000 7f871143a700 1 -- 172.21.15.6:0/628778294 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f870c156490 con 0x7f870c158400 2023-07-06T19:59:23.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.628+0000 7f86f37fe700 1 -- 172.21.15.6:0/628778294 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f870c156490 con 0x7f870c158400 2023-07-06T19:59:23.630 INFO:teuthology.orchestra.run.smithi006.stdout:55834574860 2023-07-06T19:59:23.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.631+0000 7f871143a700 1 -- 172.21.15.6:0/628778294 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f86f806acb0 msgr2=0x7f86f806d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.631+0000 7f871143a700 1 --2- 172.21.15.6:0/628778294 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f86f806acb0 0x7f86f806d160 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8704007c10 tx=0x7f8704007660 comp rx=0 tx=0).stop 2023-07-06T19:59:23.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.631+0000 7f871143a700 1 -- 172.21.15.6:0/628778294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f870c158400 msgr2=0x7f870c0b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.631+0000 7f871143a700 1 --2- 172.21.15.6:0/628778294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f870c158400 0x7f870c0b3ab0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8700000f60 tx=0x7f870000c720 comp rx=0 tx=0).stop 2023-07-06T19:59:23.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.631+0000 7f871143a700 1 -- 172.21.15.6:0/628778294 shutdown_connections 2023-07-06T19:59:23.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.631+0000 7f871143a700 1 --2- 172.21.15.6:0/628778294 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f86f806acb0 0x7f86f806d160 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.631+0000 7f871143a700 1 --2- 172.21.15.6:0/628778294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f870c158400 0x7f870c0b3ab0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.631+0000 7f871143a700 1 --2- 172.21.15.6:0/628778294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f870c06a060 0x7f870c148620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.631+0000 7f871143a700 1 --2- 172.21.15.6:0/628778294 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f870c0ca770 0x7f870c0c7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.631+0000 7f871143a700 1 -- 172.21.15.6:0/628778294 >> 172.21.15.6:0/628778294 conn(0x7f870c0cf420 msgr2=0x7f870c0c9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:23.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.631+0000 7f871143a700 1 -- 172.21.15.6:0/628778294 shutdown_connections 2023-07-06T19:59:23.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.631+0000 7f871143a700 1 -- 172.21.15.6:0/628778294 wait complete. 2023-07-06T19:59:23.638 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.4 2023-07-06T19:59:23.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.633+0000 7f744f7a9700 1 -- 172.21.15.6:0/1820638615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f74480c6850 con 0x7f744806d6f0 2023-07-06T19:59:23.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.634+0000 7f743dffb700 1 -- 172.21.15.6:0/1820638615 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7440019030 con 0x7f744806d6f0 2023-07-06T19:59:23.640 DEBUG:teuthology.parallel:result is None 2023-07-06T19:59:23.640 INFO:teuthology.orchestra.run.smithi006.stdout:55834574861 2023-07-06T19:59:23.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.2 2023-07-06T19:59:23.642 DEBUG:teuthology.parallel:result is None 2023-07-06T19:59:23.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.636+0000 7f744f7a9700 1 -- 172.21.15.6:0/1820638615 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f742c06ace0 msgr2=0x7f742c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.636+0000 7f744f7a9700 1 --2- 172.21.15.6:0/1820638615 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f742c06ace0 0x7f742c06d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7438001880 tx=0x7f7438009040 comp rx=0 tx=0).stop 2023-07-06T19:59:23.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.636+0000 7f744f7a9700 1 -- 172.21.15.6:0/1820638615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744806d6f0 msgr2=0x7f74480b1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.636+0000 7f744f7a9700 1 --2- 172.21.15.6:0/1820638615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744806d6f0 0x7f74480b1c80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f74480c5820 tx=0x7f744000bd40 comp rx=0 tx=0).stop 2023-07-06T19:59:23.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.636+0000 7f744f7a9700 1 -- 172.21.15.6:0/1820638615 shutdown_connections 2023-07-06T19:59:23.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.636+0000 7f744f7a9700 1 --2- 172.21.15.6:0/1820638615 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f742c06ace0 0x7f742c06d190 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.636+0000 7f744f7a9700 1 --2- 172.21.15.6:0/1820638615 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7448071590 0x7f74481569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.636+0000 7f744f7a9700 1 --2- 172.21.15.6:0/1820638615 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f744806a770 0x7f74480b1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.636+0000 7f744f7a9700 1 --2- 172.21.15.6:0/1820638615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744806d6f0 0x7f74480b1c80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.636+0000 7f744f7a9700 1 -- 172.21.15.6:0/1820638615 >> 172.21.15.6:0/1820638615 conn(0x7f74480cf420 msgr2=0x7f74480ca700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:23.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.636+0000 7f744f7a9700 1 -- 172.21.15.6:0/1820638615 shutdown_connections 2023-07-06T19:59:23.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.636+0000 7f744f7a9700 1 -- 172.21.15.6:0/1820638615 wait complete. 2023-07-06T19:59:23.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.640+0000 7fb14a5f0700 1 -- 172.21.15.6:0/2298481450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fb144071790 con 0x7fb144160b10 2023-07-06T19:59:23.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.640+0000 7fb140ff9700 1 -- 172.21.15.6:0/2298481450 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb13c017020 con 0x7fb144160b10 2023-07-06T19:59:23.657 INFO:teuthology.orchestra.run.smithi006.stdout:55834574860 2023-07-06T19:59:23.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.642+0000 7fb14a5f0700 1 -- 172.21.15.6:0/2298481450 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb13006ad30 msgr2=0x7fb13006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.642+0000 7fb14a5f0700 1 --2- 172.21.15.6:0/2298481450 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb13006ad30 0x7fb13006d1e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb1340096d0 tx=0x7fb134006c30 comp rx=0 tx=0).stop 2023-07-06T19:59:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.642+0000 7fb14a5f0700 1 -- 172.21.15.6:0/2298481450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb144160b10 msgr2=0x7fb1441618f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.642+0000 7fb14a5f0700 1 --2- 172.21.15.6:0/2298481450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb144160b10 0x7fb1441618f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb13c00cad0 tx=0x7fb13c00ce90 comp rx=0 tx=0).stop 2023-07-06T19:59:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.642+0000 7fb14a5f0700 1 -- 172.21.15.6:0/2298481450 shutdown_connections 2023-07-06T19:59:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.642+0000 7fb14a5f0700 1 --2- 172.21.15.6:0/2298481450 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb13006ad30 0x7fb13006d1e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.642+0000 7fb14a5f0700 1 --2- 172.21.15.6:0/2298481450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb144160b10 0x7fb1441618f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.642+0000 7fb14a5f0700 1 --2- 172.21.15.6:0/2298481450 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb14406b220 0x7fb1440b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.642+0000 7fb14a5f0700 1 --2- 172.21.15.6:0/2298481450 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1440ca4b0 0x7fb144153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.643+0000 7fb14a5f0700 1 -- 172.21.15.6:0/2298481450 >> 172.21.15.6:0/2298481450 conn(0x7fb1440cf420 msgr2=0x7fb1440c3950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:23.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.643+0000 7fb14a5f0700 1 -- 172.21.15.6:0/2298481450 shutdown_connections 2023-07-06T19:59:23.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.643+0000 7fb14a5f0700 1 -- 172.21.15.6:0/2298481450 wait complete. 2023-07-06T19:59:23.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.1 2023-07-06T19:59:23.661 DEBUG:teuthology.parallel:result is None 2023-07-06T19:59:23.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574861 got 55834574861 for osd.5 2023-07-06T19:59:23.663 DEBUG:teuthology.parallel:result is None 2023-07-06T19:59:23.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.6 2023-07-06T19:59:23.663 DEBUG:teuthology.parallel:result is None 2023-07-06T19:59:23.664 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-06T19:59:23.664 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T19:59:23.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.826+0000 7f0aa8707700 1 Processor -- start 2023-07-06T19:59:23.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.826+0000 7f0aa8707700 1 -- start start 2023-07-06T19:59:23.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.827+0000 7f0aa8707700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0aa0071dd0 0x7f0aa00caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.827+0000 7f0aa8707700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa0160ff0 con 0x7f0aa00cee80 2023-07-06T19:59:23.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.827+0000 7f0aa8707700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa00ca100 con 0x7f0aa00ceab0 2023-07-06T19:59:23.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.827+0000 7f0aa8707700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa00cb400 con 0x7f0aa0071dd0 2023-07-06T19:59:23.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.828+0000 7f0aa6ca4700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0aa00cee80 0x7f0aa01602c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60496/0 (socket says 172.21.15.6:60496) 2023-07-06T19:59:23.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.828+0000 7f0aa6ca4700 1 -- 172.21.15.6:0/3412215379 learned_addr learned my addr 172.21.15.6:0/3412215379 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:23.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.828+0000 7f0aa5ca2700 1 --2- 172.21.15.6:0/3412215379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0aa0071dd0 0x7f0aa00caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.828+0000 7f0aa54a1700 1 -- 172.21.15.6:0/3412215379 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3786367402 0 0) 0x7f0aa0160ff0 con 0x7f0aa00cee80 2023-07-06T19:59:23.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.828+0000 7f0aa54a1700 1 -- 172.21.15.6:0/3412215379 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a8c0035b0 con 0x7f0aa00cee80 2023-07-06T19:59:23.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.828+0000 7f0aa54a1700 1 -- 172.21.15.6:0/3412215379 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322584668 0 0) 0x7f0aa00ca100 con 0x7f0aa00ceab0 2023-07-06T19:59:23.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.828+0000 7f0aa54a1700 1 -- 172.21.15.6:0/3412215379 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0aa0160ff0 con 0x7f0aa00ceab0 2023-07-06T19:59:23.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.828+0000 7f0aa5ca2700 1 -- 172.21.15.6:0/3412215379 >> v1:172.21.15.40:6789/0 conn(0x7f0aa00ceab0 legacy=0x7f0aa00716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.828+0000 7f0aa5ca2700 1 -- 172.21.15.6:0/3412215379 >> v1:172.21.15.6:6789/0 conn(0x7f0aa00cee80 legacy=0x7f0aa01602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.828+0000 7f0aa5ca2700 1 -- 172.21.15.6:0/3412215379 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa00ca3e0 con 0x7f0aa0071dd0 2023-07-06T19:59:23.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.828+0000 7f0aa5ca2700 1 --2- 172.21.15.6:0/3412215379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0aa0071dd0 0x7f0aa00caec0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009870 tx=0x7f0a94009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3605cb6494f4781 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.828+0000 7f0aa54a1700 1 -- 172.21.15.6:0/3412215379 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a94011830 con 0x7f0aa0071dd0 2023-07-06T19:59:23.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.828+0000 7f0aa54a1700 1 -- 172.21.15.6:0/3412215379 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a94011990 con 0x7f0aa0071dd0 2023-07-06T19:59:23.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.828+0000 7f0aa54a1700 1 -- 172.21.15.6:0/3412215379 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a94011d20 con 0x7f0aa0071dd0 2023-07-06T19:59:23.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.829+0000 7f0aa8707700 1 -- 172.21.15.6:0/3412215379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0aa0071dd0 msgr2=0x7f0aa00caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.829+0000 7f0aa8707700 1 --2- 172.21.15.6:0/3412215379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0aa0071dd0 0x7f0aa00caec0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009870 tx=0x7f0a94009b80 comp rx=0 tx=0).stop 2023-07-06T19:59:23.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.829+0000 7f0aa8707700 1 -- 172.21.15.6:0/3412215379 shutdown_connections 2023-07-06T19:59:23.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.829+0000 7f0aa8707700 1 --2- 172.21.15.6:0/3412215379 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0aa0071dd0 0x7f0aa00caec0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.829+0000 7f0aa8707700 1 -- 172.21.15.6:0/3412215379 >> 172.21.15.6:0/3412215379 conn(0x7f0aa00cc420 msgr2=0x7f0aa00cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:23.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.829+0000 7f0aa8707700 1 -- 172.21.15.6:0/3412215379 shutdown_connections 2023-07-06T19:59:23.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.829+0000 7f0aa8707700 1 -- 172.21.15.6:0/3412215379 wait complete. 2023-07-06T19:59:23.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.830+0000 7f0aa8707700 1 Processor -- start 2023-07-06T19:59:23.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.830+0000 7f0aa8707700 1 -- start start 2023-07-06T19:59:23.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.831+0000 7f0aa8707700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aa0071dd0 0x7f0aa0151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.831+0000 7f0aa8707700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0aa00ceab0 0x7f0aa00c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.831+0000 7f0aa8707700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0aa00cee80 0x7f0aa0159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.831+0000 7f0aa8707700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa0157730 con 0x7f0aa00ceab0 2023-07-06T19:59:23.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.831+0000 7f0aa8707700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa0157a10 con 0x7f0aa0071dd0 2023-07-06T19:59:23.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.831+0000 7f0aa8707700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa0157cf0 con 0x7f0aa00cee80 2023-07-06T19:59:23.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.831+0000 7f0aa5ca2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0aa00ceab0 0x7f0aa00c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.831+0000 7f0aa5ca2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0aa00ceab0 0x7f0aa00c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59290/0 (socket says 172.21.15.6:59290) 2023-07-06T19:59:23.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.831+0000 7f0aa5ca2700 1 -- 172.21.15.6:0/2286443816 learned_addr learned my addr 172.21.15.6:0/2286443816 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:23.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.831+0000 7f0aa64a3700 1 --2- 172.21.15.6:0/2286443816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aa0071dd0 0x7f0aa0151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.831+0000 7f0aa6ca4700 1 --2- 172.21.15.6:0/2286443816 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0aa00cee80 0x7f0aa0159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.831+0000 7f0aa5ca2700 1 -- 172.21.15.6:0/2286443816 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0aa00cee80 msgr2=0x7f0aa0159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.831+0000 7f0aa5ca2700 1 --2- 172.21.15.6:0/2286443816 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0aa00cee80 0x7f0aa0159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.831+0000 7f0aa5ca2700 1 -- 172.21.15.6:0/2286443816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aa0071dd0 msgr2=0x7f0aa0151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:23.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.831+0000 7f0aa5ca2700 1 --2- 172.21.15.6:0/2286443816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aa0071dd0 0x7f0aa0151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:23.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.832+0000 7f0aa5ca2700 1 -- 172.21.15.6:0/2286443816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a940094a0 con 0x7f0aa00ceab0 2023-07-06T19:59:23.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.832+0000 7f0aa6ca4700 1 --2- 172.21.15.6:0/2286443816 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0aa00cee80 0x7f0aa0159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:23.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.832+0000 7f0aa5ca2700 1 --2- 172.21.15.6:0/2286443816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0aa00ceab0 0x7f0aa00c5c60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0a940090b0 tx=0x7f0a94004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.832+0000 7f0a92ffd700 1 -- 172.21.15.6:0/2286443816 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9401a760 con 0x7f0aa00ceab0 2023-07-06T19:59:23.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.832+0000 7f0a92ffd700 1 -- 172.21.15.6:0/2286443816 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9401a8c0 con 0x7f0aa00ceab0 2023-07-06T19:59:23.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.832+0000 7f0aa8707700 1 -- 172.21.15.6:0/2286443816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa0157fd0 con 0x7f0aa00ceab0 2023-07-06T19:59:23.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.832+0000 7f0a92ffd700 1 -- 172.21.15.6:0/2286443816 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9401ac30 con 0x7f0aa00ceab0 2023-07-06T19:59:23.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.832+0000 7f0aa8707700 1 -- 172.21.15.6:0/2286443816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa0152410 con 0x7f0aa00ceab0 2023-07-06T19:59:23.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.833+0000 7f0aa8707700 1 -- 172.21.15.6:0/2286443816 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa00b5920 con 0x7f0aa00ceab0 2023-07-06T19:59:23.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.833+0000 7f0a92ffd700 1 -- 172.21.15.6:0/2286443816 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0a94022070 con 0x7f0aa00ceab0 2023-07-06T19:59:23.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.834+0000 7f0a92ffd700 1 --2- 172.21.15.6:0/2286443816 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0a8406ace0 0x7f0a8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:23.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.834+0000 7f0a92ffd700 1 -- 172.21.15.6:0/2286443816 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0a9408a740 con 0x7f0aa00ceab0 2023-07-06T19:59:23.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.834+0000 7f0aa64a3700 1 --2- 172.21.15.6:0/2286443816 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0a8406ace0 0x7f0a8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:23.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.834+0000 7f0aa64a3700 1 --2- 172.21.15.6:0/2286443816 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0a8406ace0 0x7f0a8406d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0011e0 tx=0x7f0a9c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:23.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:23.838+0000 7f0a92ffd700 1 -- 172.21.15.6:0/2286443816 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0a940556b0 con 0x7f0aa00ceab0 2023-07-06T19:59:24.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.035+0000 7f0aa8707700 1 -- 172.21.15.6:0/2286443816 --> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0aa0157b80 con 0x7f0a8406ace0 2023-07-06T19:59:24.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.045+0000 7f0a92ffd700 1 -- 172.21.15.6:0/2286443816 <== mgr.4110 v2:172.21.15.6:6832/201543369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367320 (secure 0 0 0) 0x7f0aa0157b80 con 0x7f0a8406ace0 2023-07-06T19:59:24.062 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:24.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.049+0000 7f0aa8707700 1 -- 172.21.15.6:0/2286443816 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0a8406ace0 msgr2=0x7f0a8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:24.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.049+0000 7f0aa8707700 1 --2- 172.21.15.6:0/2286443816 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0a8406ace0 0x7f0a8406d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c0011e0 tx=0x7f0a9c009040 comp rx=0 tx=0).stop 2023-07-06T19:59:24.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.049+0000 7f0aa8707700 1 -- 172.21.15.6:0/2286443816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0aa00ceab0 msgr2=0x7f0aa00c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:24.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.049+0000 7f0aa8707700 1 --2- 172.21.15.6:0/2286443816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0aa00ceab0 0x7f0aa00c5c60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0a940090b0 tx=0x7f0a94004750 comp rx=0 tx=0).stop 2023-07-06T19:59:24.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.049+0000 7f0aa8707700 1 -- 172.21.15.6:0/2286443816 shutdown_connections 2023-07-06T19:59:24.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.049+0000 7f0aa8707700 1 --2- 172.21.15.6:0/2286443816 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0a8406ace0 0x7f0a8406d190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:24.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.049+0000 7f0aa8707700 1 --2- 172.21.15.6:0/2286443816 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0aa00cee80 0x7f0aa0159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:24.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.049+0000 7f0aa8707700 1 --2- 172.21.15.6:0/2286443816 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0aa0071dd0 0x7f0aa0151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:24.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.049+0000 7f0aa8707700 1 --2- 172.21.15.6:0/2286443816 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0aa00ceab0 0x7f0aa00c5c60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:24.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.049+0000 7f0aa8707700 1 -- 172.21.15.6:0/2286443816 >> 172.21.15.6:0/2286443816 conn(0x7f0aa00cc420 msgr2=0x7f0aa015fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:24.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.049+0000 7f0aa8707700 1 -- 172.21.15.6:0/2286443816 shutdown_connections 2023-07-06T19:59:24.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.049+0000 7f0aa8707700 1 -- 172.21.15.6:0/2286443816 wait complete. 2023-07-06T19:59:24.075 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-06T19:59:24.075 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-07-06T19:59:22.720069+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219112,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755608,"statfs":{"total":773094113280,"available":772869742592,"internally_reserved":0,"allocated":3579904,"data_stored":2149128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004077"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376670+0000","last_change":"2023-07-06T19:58:53.761270+0000","last_active":"2023-07-06T19:58:59.376670+0000","last_peered":"2023-07-06T19:58:59.376670+0000","last_clean":"2023-07-06T19:58:59.376670+0000","last_became_active":"2023-07-06T19:58:53.760980+0000","last_became_peered":"2023-07-06T19:58:53.760980+0000","last_unstale":"2023-07-06T19:58:59.376670+0000","last_undegraded":"2023-07-06T19:58:59.376670+0000","last_fullsized":"2023-07-06T19:58:59.376670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:01:18.056559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782312+0000","last_change":"2023-07-06T19:58:53.753947+0000","last_active":"2023-07-06T19:58:58.782312+0000","last_peered":"2023-07-06T19:58:58.782312+0000","last_clean":"2023-07-06T19:58:58.782312+0000","last_became_active":"2023-07-06T19:58:53.753672+0000","last_became_peered":"2023-07-06T19:58:53.753672+0000","last_unstale":"2023-07-06T19:58:58.782312+0000","last_undegraded":"2023-07-06T19:58:58.782312+0000","last_fullsized":"2023-07-06T19:58:58.782312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:39:21.484949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378490+0000","last_change":"2023-07-06T19:58:53.757466+0000","last_active":"2023-07-06T19:58:59.378490+0000","last_peered":"2023-07-06T19:58:59.378490+0000","last_clean":"2023-07-06T19:58:59.378490+0000","last_became_active":"2023-07-06T19:58:53.757125+0000","last_became_peered":"2023-07-06T19:58:53.757125+0000","last_unstale":"2023-07-06T19:58:59.378490+0000","last_undegraded":"2023-07-06T19:58:59.378490+0000","last_fullsized":"2023-07-06T19:58:59.378490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:52:06.851223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783173+0000","last_change":"2023-07-06T19:58:53.752337+0000","last_active":"2023-07-06T19:58:58.783173+0000","last_peered":"2023-07-06T19:58:58.783173+0000","last_clean":"2023-07-06T19:58:58.783173+0000","last_became_active":"2023-07-06T19:58:53.752006+0000","last_became_peered":"2023-07-06T19:58:53.752006+0000","last_unstale":"2023-07-06T19:58:58.783173+0000","last_undegraded":"2023-07-06T19:58:58.783173+0000","last_fullsized":"2023-07-06T19:58:58.783173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:04:50.697845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378401+0000","last_change":"2023-07-06T19:58:53.761648+0000","last_active":"2023-07-06T19:58:59.378401+0000","last_peered":"2023-07-06T19:58:59.378401+0000","last_clean":"2023-07-06T19:58:59.378401+0000","last_became_active":"2023-07-06T19:58:53.760919+0000","last_became_peered":"2023-07-06T19:58:53.760919+0000","last_unstale":"2023-07-06T19:58:59.378401+0000","last_undegraded":"2023-07-06T19:58:59.378401+0000","last_fullsized":"2023-07-06T19:58:59.378401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:54:30.126613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378278+0000","last_change":"2023-07-06T19:58:53.757513+0000","last_active":"2023-07-06T19:58:59.378278+0000","last_peered":"2023-07-06T19:58:59.378278+0000","last_clean":"2023-07-06T19:58:59.378278+0000","last_became_active":"2023-07-06T19:58:53.757153+0000","last_became_peered":"2023-07-06T19:58:53.757153+0000","last_unstale":"2023-07-06T19:58:59.378278+0000","last_undegraded":"2023-07-06T19:58:59.378278+0000","last_fullsized":"2023-07-06T19:58:59.378278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:08:34.198031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378467+0000","last_change":"2023-07-06T19:58:53.754935+0000","last_active":"2023-07-06T19:58:59.378467+0000","last_peered":"2023-07-06T19:58:59.378467+0000","last_clean":"2023-07-06T19:58:59.378467+0000","last_became_active":"2023-07-06T19:58:53.754471+0000","last_became_peered":"2023-07-06T19:58:53.754471+0000","last_unstale":"2023-07-06T19:58:59.378467+0000","last_undegraded":"2023-07-06T19:58:59.378467+0000","last_fullsized":"2023-07-06T19:58:59.378467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:31:43.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.781819+0000","last_change":"2023-07-06T19:58:53.741003+0000","last_active":"2023-07-06T19:58:58.781819+0000","last_peered":"2023-07-06T19:58:58.781819+0000","last_clean":"2023-07-06T19:58:58.781819+0000","last_became_active":"2023-07-06T19:58:53.740713+0000","last_became_peered":"2023-07-06T19:58:53.740713+0000","last_unstale":"2023-07-06T19:58:58.781819+0000","last_undegraded":"2023-07-06T19:58:58.781819+0000","last_fullsized":"2023-07-06T19:58:58.781819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:39:05.600911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378417+0000","last_change":"2023-07-06T19:58:53.760616+0000","last_active":"2023-07-06T19:58:59.378417+0000","last_peered":"2023-07-06T19:58:59.378417+0000","last_clean":"2023-07-06T19:58:59.378417+0000","last_became_active":"2023-07-06T19:58:53.760325+0000","last_became_peered":"2023-07-06T19:58:53.760325+0000","last_unstale":"2023-07-06T19:58:59.378417+0000","last_undegraded":"2023-07-06T19:58:59.378417+0000","last_fullsized":"2023-07-06T19:58:59.378417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:08:51.828984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782658+0000","last_change":"2023-07-06T19:58:53.755075+0000","last_active":"2023-07-06T19:58:58.782658+0000","last_peered":"2023-07-06T19:58:58.782658+0000","last_clean":"2023-07-06T19:58:58.782658+0000","last_became_active":"2023-07-06T19:58:53.754806+0000","last_became_peered":"2023-07-06T19:58:53.754806+0000","last_unstale":"2023-07-06T19:58:58.782658+0000","last_undegraded":"2023-07-06T19:58:58.782658+0000","last_fullsized":"2023-07-06T19:58:58.782658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:36:41.784617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378084+0000","last_change":"2023-07-06T19:58:53.757287+0000","last_active":"2023-07-06T19:58:59.378084+0000","last_peered":"2023-07-06T19:58:59.378084+0000","last_clean":"2023-07-06T19:58:59.378084+0000","last_became_active":"2023-07-06T19:58:53.756825+0000","last_became_peered":"2023-07-06T19:58:53.756825+0000","last_unstale":"2023-07-06T19:58:59.378084+0000","last_undegraded":"2023-07-06T19:58:59.378084+0000","last_fullsized":"2023-07-06T19:58:59.378084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:32:20.366406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377664+0000","last_change":"2023-07-06T19:58:53.745164+0000","last_active":"2023-07-06T19:58:59.377664+0000","last_peered":"2023-07-06T19:58:59.377664+0000","last_clean":"2023-07-06T19:58:59.377664+0000","last_became_active":"2023-07-06T19:58:53.744861+0000","last_became_peered":"2023-07-06T19:58:53.744861+0000","last_unstale":"2023-07-06T19:58:59.377664+0000","last_undegraded":"2023-07-06T19:58:59.377664+0000","last_fullsized":"2023-07-06T19:58:59.377664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:06:50.770125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377329+0000","last_change":"2023-07-06T19:58:53.766071+0000","last_active":"2023-07-06T19:58:59.377329+0000","last_peered":"2023-07-06T19:58:59.377329+0000","last_clean":"2023-07-06T19:58:59.377329+0000","last_became_active":"2023-07-06T19:58:53.765744+0000","last_became_peered":"2023-07-06T19:58:53.765744+0000","last_unstale":"2023-07-06T19:58:59.377329+0000","last_undegraded":"2023-07-06T19:58:59.377329+0000","last_fullsized":"2023-07-06T19:58:59.377329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:31:39.273909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782018+0000","last_change":"2023-07-06T19:58:53.743381+0000","last_active":"2023-07-06T19:58:58.782018+0000","last_peered":"2023-07-06T19:58:58.782018+0000","last_clean":"2023-07-06T19:58:58.782018+0000","last_became_active":"2023-07-06T19:58:53.743098+0000","last_became_peered":"2023-07-06T19:58:53.743098+0000","last_unstale":"2023-07-06T19:58:58.782018+0000","last_undegraded":"2023-07-06T19:58:58.782018+0000","last_fullsized":"2023-07-06T19:58:58.782018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:00:39.522945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377130+0000","last_change":"2023-07-06T19:58:53.754741+0000","last_active":"2023-07-06T19:58:59.377130+0000","last_peered":"2023-07-06T19:58:59.377130+0000","last_clean":"2023-07-06T19:58:59.377130+0000","last_became_active":"2023-07-06T19:58:53.754089+0000","last_became_peered":"2023-07-06T19:58:53.754089+0000","last_unstale":"2023-07-06T19:58:59.377130+0000","last_undegraded":"2023-07-06T19:58:59.377130+0000","last_fullsized":"2023-07-06T19:58:59.377130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:40:15.607877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377294+0000","last_change":"2023-07-06T19:58:53.758130+0000","last_active":"2023-07-06T19:58:59.377294+0000","last_peered":"2023-07-06T19:58:59.377294+0000","last_clean":"2023-07-06T19:58:59.377294+0000","last_became_active":"2023-07-06T19:58:53.757837+0000","last_became_peered":"2023-07-06T19:58:53.757837+0000","last_unstale":"2023-07-06T19:58:59.377294+0000","last_undegraded":"2023-07-06T19:58:59.377294+0000","last_fullsized":"2023-07-06T19:58:59.377294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:12:08.363104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.379057+0000","last_change":"2023-07-06T19:58:53.760750+0000","last_active":"2023-07-06T19:58:59.379057+0000","last_peered":"2023-07-06T19:58:59.379057+0000","last_clean":"2023-07-06T19:58:59.379057+0000","last_became_active":"2023-07-06T19:58:53.760484+0000","last_became_peered":"2023-07-06T19:58:53.760484+0000","last_unstale":"2023-07-06T19:58:59.379057+0000","last_undegraded":"2023-07-06T19:58:59.379057+0000","last_fullsized":"2023-07-06T19:58:59.379057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:55:10.096543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378425+0000","last_change":"2023-07-06T19:58:53.742270+0000","last_active":"2023-07-06T19:58:59.378425+0000","last_peered":"2023-07-06T19:58:59.378425+0000","last_clean":"2023-07-06T19:58:59.378425+0000","last_became_active":"2023-07-06T19:58:53.741974+0000","last_became_peered":"2023-07-06T19:58:53.741974+0000","last_unstale":"2023-07-06T19:58:59.378425+0000","last_undegraded":"2023-07-06T19:58:59.378425+0000","last_fullsized":"2023-07-06T19:58:59.378425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:49:02.964314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377806+0000","last_change":"2023-07-06T19:58:53.750109+0000","last_active":"2023-07-06T19:58:59.377806+0000","last_peered":"2023-07-06T19:58:59.377806+0000","last_clean":"2023-07-06T19:58:59.377806+0000","last_became_active":"2023-07-06T19:58:53.749826+0000","last_became_peered":"2023-07-06T19:58:53.749826+0000","last_unstale":"2023-07-06T19:58:59.377806+0000","last_undegraded":"2023-07-06T19:58:59.377806+0000","last_fullsized":"2023-07-06T19:58:59.377806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:36:45.949174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378110+0000","last_change":"2023-07-06T19:58:53.757988+0000","last_active":"2023-07-06T19:58:59.378110+0000","last_peered":"2023-07-06T19:58:59.378110+0000","last_clean":"2023-07-06T19:58:59.378110+0000","last_became_active":"2023-07-06T19:58:53.751497+0000","last_became_peered":"2023-07-06T19:58:53.751497+0000","last_unstale":"2023-07-06T19:58:59.378110+0000","last_undegraded":"2023-07-06T19:58:59.378110+0000","last_fullsized":"2023-07-06T19:58:59.378110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:27:11.308820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377168+0000","last_change":"2023-07-06T19:58:53.765678+0000","last_active":"2023-07-06T19:58:59.377168+0000","last_peered":"2023-07-06T19:58:59.377168+0000","last_clean":"2023-07-06T19:58:59.377168+0000","last_became_active":"2023-07-06T19:58:53.765413+0000","last_became_peered":"2023-07-06T19:58:53.765413+0000","last_unstale":"2023-07-06T19:58:59.377168+0000","last_undegraded":"2023-07-06T19:58:59.377168+0000","last_fullsized":"2023-07-06T19:58:59.377168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:47:30.856849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377784+0000","last_change":"2023-07-06T19:58:53.755073+0000","last_active":"2023-07-06T19:58:59.377784+0000","last_peered":"2023-07-06T19:58:59.377784+0000","last_clean":"2023-07-06T19:58:59.377784+0000","last_became_active":"2023-07-06T19:58:53.754882+0000","last_became_peered":"2023-07-06T19:58:53.754882+0000","last_unstale":"2023-07-06T19:58:59.377784+0000","last_undegraded":"2023-07-06T19:58:59.377784+0000","last_fullsized":"2023-07-06T19:58:59.377784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:39:05.600911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377911+0000","last_change":"2023-07-06T19:58:53.758162+0000","last_active":"2023-07-06T19:58:59.377911+0000","last_peered":"2023-07-06T19:58:59.377911+0000","last_clean":"2023-07-06T19:58:59.377911+0000","last_became_active":"2023-07-06T19:58:53.753528+0000","last_became_peered":"2023-07-06T19:58:53.753528+0000","last_unstale":"2023-07-06T19:58:59.377911+0000","last_undegraded":"2023-07-06T19:58:59.377911+0000","last_fullsized":"2023-07-06T19:58:59.377911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:43:37.810101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376985+0000","last_change":"2023-07-06T19:58:53.765139+0000","last_active":"2023-07-06T19:58:59.376985+0000","last_peered":"2023-07-06T19:58:59.376985+0000","last_clean":"2023-07-06T19:58:59.376985+0000","last_became_active":"2023-07-06T19:58:53.764887+0000","last_became_peered":"2023-07-06T19:58:53.764887+0000","last_unstale":"2023-07-06T19:58:59.376985+0000","last_undegraded":"2023-07-06T19:58:59.376985+0000","last_fullsized":"2023-07-06T19:58:59.376985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:06:38.381299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782849+0000","last_change":"2023-07-06T19:58:53.750438+0000","last_active":"2023-07-06T19:58:58.782849+0000","last_peered":"2023-07-06T19:58:58.782849+0000","last_clean":"2023-07-06T19:58:58.782849+0000","last_became_active":"2023-07-06T19:58:53.750169+0000","last_became_peered":"2023-07-06T19:58:53.750169+0000","last_unstale":"2023-07-06T19:58:58.782849+0000","last_undegraded":"2023-07-06T19:58:58.782849+0000","last_fullsized":"2023-07-06T19:58:58.782849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:14:20.481463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783170+0000","last_change":"2023-07-06T19:58:53.741853+0000","last_active":"2023-07-06T19:58:58.783170+0000","last_peered":"2023-07-06T19:58:58.783170+0000","last_clean":"2023-07-06T19:58:58.783170+0000","last_became_active":"2023-07-06T19:58:53.741559+0000","last_became_peered":"2023-07-06T19:58:53.741559+0000","last_unstale":"2023-07-06T19:58:58.783170+0000","last_undegraded":"2023-07-06T19:58:58.783170+0000","last_fullsized":"2023-07-06T19:58:58.783170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:06:38.381299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783184+0000","last_change":"2023-07-06T19:58:53.759862+0000","last_active":"2023-07-06T19:58:58.783184+0000","last_peered":"2023-07-06T19:58:58.783184+0000","last_clean":"2023-07-06T19:58:58.783184+0000","last_became_active":"2023-07-06T19:58:53.758903+0000","last_became_peered":"2023-07-06T19:58:53.758903+0000","last_unstale":"2023-07-06T19:58:58.783184+0000","last_undegraded":"2023-07-06T19:58:58.783184+0000","last_fullsized":"2023-07-06T19:58:58.783184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:31:43.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378789+0000","last_change":"2023-07-06T19:58:57.789865+0000","last_active":"2023-07-06T19:58:59.378789+0000","last_peered":"2023-07-06T19:58:59.378789+0000","last_clean":"2023-07-06T19:58:59.378789+0000","last_became_active":"2023-07-06T19:58:57.788796+0000","last_became_peered":"2023-07-06T19:58:57.788796+0000","last_unstale":"2023-07-06T19:58:59.378789+0000","last_undegraded":"2023-07-06T19:58:59.378789+0000","last_fullsized":"2023-07-06T19:58:59.378789+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:40:09.950829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377817+0000","last_change":"2023-07-06T19:58:52.747722+0000","last_active":"2023-07-06T19:58:59.377817+0000","last_peered":"2023-07-06T19:58:59.377817+0000","last_clean":"2023-07-06T19:58:59.377817+0000","last_became_active":"2023-07-06T19:58:52.747373+0000","last_became_peered":"2023-07-06T19:58:52.747373+0000","last_unstale":"2023-07-06T19:58:59.377817+0000","last_undegraded":"2023-07-06T19:58:59.377817+0000","last_fullsized":"2023-07-06T19:58:59.377817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:52:21.260915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377423+0000","last_change":"2023-07-06T19:58:53.760791+0000","last_active":"2023-07-06T19:58:59.377423+0000","last_peered":"2023-07-06T19:58:59.377423+0000","last_clean":"2023-07-06T19:58:59.377423+0000","last_became_active":"2023-07-06T19:58:53.760496+0000","last_became_peered":"2023-07-06T19:58:53.760496+0000","last_unstale":"2023-07-06T19:58:59.377423+0000","last_undegraded":"2023-07-06T19:58:59.377423+0000","last_fullsized":"2023-07-06T19:58:59.377423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:55:35.512797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783686+0000","last_change":"2023-07-06T19:58:57.791584+0000","last_active":"2023-07-06T19:58:58.783686+0000","last_peered":"2023-07-06T19:58:58.783686+0000","last_clean":"2023-07-06T19:58:58.783686+0000","last_became_active":"2023-07-06T19:58:57.791118+0000","last_became_peered":"2023-07-06T19:58:57.791118+0000","last_unstale":"2023-07-06T19:58:58.783686+0000","last_undegraded":"2023-07-06T19:58:58.783686+0000","last_fullsized":"2023-07-06T19:58:58.783686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:22:47.617986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782223+0000","last_change":"2023-07-06T19:58:52.750959+0000","last_active":"2023-07-06T19:58:58.782223+0000","last_peered":"2023-07-06T19:58:58.782223+0000","last_clean":"2023-07-06T19:58:58.782223+0000","last_became_active":"2023-07-06T19:58:52.750645+0000","last_became_peered":"2023-07-06T19:58:52.750645+0000","last_unstale":"2023-07-06T19:58:58.782223+0000","last_undegraded":"2023-07-06T19:58:58.782223+0000","last_fullsized":"2023-07-06T19:58:58.782223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:56:04.557448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378391+0000","last_change":"2023-07-06T19:58:53.756467+0000","last_active":"2023-07-06T19:58:59.378391+0000","last_peered":"2023-07-06T19:58:59.378391+0000","last_clean":"2023-07-06T19:58:59.378391+0000","last_became_active":"2023-07-06T19:58:53.752938+0000","last_became_peered":"2023-07-06T19:58:53.752938+0000","last_unstale":"2023-07-06T19:58:59.378391+0000","last_undegraded":"2023-07-06T19:58:59.378391+0000","last_fullsized":"2023-07-06T19:58:59.378391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:40:15.607877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378564+0000","last_change":"2023-07-06T19:58:57.790380+0000","last_active":"2023-07-06T19:58:59.378564+0000","last_peered":"2023-07-06T19:58:59.378564+0000","last_clean":"2023-07-06T19:58:59.378564+0000","last_became_active":"2023-07-06T19:58:57.789989+0000","last_became_peered":"2023-07-06T19:58:57.789989+0000","last_unstale":"2023-07-06T19:58:59.378564+0000","last_undegraded":"2023-07-06T19:58:59.378564+0000","last_fullsized":"2023-07-06T19:58:59.378564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:38:28.294697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376778+0000","last_change":"2023-07-06T19:58:52.747131+0000","last_active":"2023-07-06T19:58:59.376778+0000","last_peered":"2023-07-06T19:58:59.376778+0000","last_clean":"2023-07-06T19:58:59.376778+0000","last_became_active":"2023-07-06T19:58:52.746849+0000","last_became_peered":"2023-07-06T19:58:52.746849+0000","last_unstale":"2023-07-06T19:58:59.376778+0000","last_undegraded":"2023-07-06T19:58:59.376778+0000","last_fullsized":"2023-07-06T19:58:59.376778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:38:23.255098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783965+0000","last_change":"2023-07-06T19:58:53.752844+0000","last_active":"2023-07-06T19:58:58.783965+0000","last_peered":"2023-07-06T19:58:58.783965+0000","last_clean":"2023-07-06T19:58:58.783965+0000","last_became_active":"2023-07-06T19:58:53.752535+0000","last_became_peered":"2023-07-06T19:58:53.752535+0000","last_unstale":"2023-07-06T19:58:58.783965+0000","last_undegraded":"2023-07-06T19:58:58.783965+0000","last_fullsized":"2023-07-06T19:58:58.783965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:23:37.838134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783216+0000","last_change":"2023-07-06T19:58:57.797542+0000","last_active":"2023-07-06T19:58:58.783216+0000","last_peered":"2023-07-06T19:58:58.783216+0000","last_clean":"2023-07-06T19:58:58.783216+0000","last_became_active":"2023-07-06T19:58:57.794412+0000","last_became_peered":"2023-07-06T19:58:57.794412+0000","last_unstale":"2023-07-06T19:58:58.783216+0000","last_undegraded":"2023-07-06T19:58:58.783216+0000","last_fullsized":"2023-07-06T19:58:58.783216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:04:41.883822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378545+0000","last_change":"2023-07-06T19:58:52.746045+0000","last_active":"2023-07-06T19:58:59.378545+0000","last_peered":"2023-07-06T19:58:59.378545+0000","last_clean":"2023-07-06T19:58:59.378545+0000","last_became_active":"2023-07-06T19:58:52.745753+0000","last_became_peered":"2023-07-06T19:58:52.745753+0000","last_unstale":"2023-07-06T19:58:59.378545+0000","last_undegraded":"2023-07-06T19:58:59.378545+0000","last_fullsized":"2023-07-06T19:58:59.378545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:39:20.477362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376652+0000","last_change":"2023-07-06T19:58:53.760982+0000","last_active":"2023-07-06T19:58:59.376652+0000","last_peered":"2023-07-06T19:58:59.376652+0000","last_clean":"2023-07-06T19:58:59.376652+0000","last_became_active":"2023-07-06T19:58:53.758282+0000","last_became_peered":"2023-07-06T19:58:53.758282+0000","last_unstale":"2023-07-06T19:58:59.376652+0000","last_undegraded":"2023-07-06T19:58:59.376652+0000","last_fullsized":"2023-07-06T19:58:59.376652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:39:21.484949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376781+0000","last_change":"2023-07-06T19:58:57.790546+0000","last_active":"2023-07-06T19:58:59.376781+0000","last_peered":"2023-07-06T19:58:59.376781+0000","last_clean":"2023-07-06T19:58:59.376781+0000","last_became_active":"2023-07-06T19:58:57.790151+0000","last_became_peered":"2023-07-06T19:58:57.790151+0000","last_unstale":"2023-07-06T19:58:59.376781+0000","last_undegraded":"2023-07-06T19:58:59.376781+0000","last_fullsized":"2023-07-06T19:58:59.376781+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:07.546083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782508+0000","last_change":"2023-07-06T19:58:52.746111+0000","last_active":"2023-07-06T19:58:58.782508+0000","last_peered":"2023-07-06T19:58:58.782508+0000","last_clean":"2023-07-06T19:58:58.782508+0000","last_became_active":"2023-07-06T19:58:52.745886+0000","last_became_peered":"2023-07-06T19:58:52.745886+0000","last_unstale":"2023-07-06T19:58:58.782508+0000","last_undegraded":"2023-07-06T19:58:58.782508+0000","last_fullsized":"2023-07-06T19:58:58.782508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:38:23.255098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376789+0000","last_change":"2023-07-06T19:58:53.748570+0000","last_active":"2023-07-06T19:58:59.376789+0000","last_peered":"2023-07-06T19:58:59.376789+0000","last_clean":"2023-07-06T19:58:59.376789+0000","last_became_active":"2023-07-06T19:58:53.748044+0000","last_became_peered":"2023-07-06T19:58:53.748044+0000","last_unstale":"2023-07-06T19:58:59.376789+0000","last_undegraded":"2023-07-06T19:58:59.376789+0000","last_fullsized":"2023-07-06T19:58:59.376789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:01:56.605555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377868+0000","last_change":"2023-07-06T19:58:57.786412+0000","last_active":"2023-07-06T19:58:59.377868+0000","last_peered":"2023-07-06T19:58:59.377868+0000","last_clean":"2023-07-06T19:58:59.377868+0000","last_became_active":"2023-07-06T19:58:57.785979+0000","last_became_peered":"2023-07-06T19:58:57.785979+0000","last_unstale":"2023-07-06T19:58:59.377868+0000","last_undegraded":"2023-07-06T19:58:59.377868+0000","last_fullsized":"2023-07-06T19:58:59.377868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:34:38.161520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378178+0000","last_change":"2023-07-06T19:58:52.751370+0000","last_active":"2023-07-06T19:58:59.378178+0000","last_peered":"2023-07-06T19:58:59.378178+0000","last_clean":"2023-07-06T19:58:59.378178+0000","last_became_active":"2023-07-06T19:58:52.750871+0000","last_became_peered":"2023-07-06T19:58:52.750871+0000","last_unstale":"2023-07-06T19:58:59.378178+0000","last_undegraded":"2023-07-06T19:58:59.378178+0000","last_fullsized":"2023-07-06T19:58:59.378178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:54:29.119026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783170+0000","last_change":"2023-07-06T19:58:53.749382+0000","last_active":"2023-07-06T19:58:58.783170+0000","last_peered":"2023-07-06T19:58:58.783170+0000","last_clean":"2023-07-06T19:58:58.783170+0000","last_became_active":"2023-07-06T19:58:53.749102+0000","last_became_peered":"2023-07-06T19:58:53.749102+0000","last_unstale":"2023-07-06T19:58:58.783170+0000","last_undegraded":"2023-07-06T19:58:58.783170+0000","last_fullsized":"2023-07-06T19:58:58.783170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:00:39.522945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782423+0000","last_change":"2023-07-06T19:58:57.788620+0000","last_active":"2023-07-06T19:58:58.782423+0000","last_peered":"2023-07-06T19:58:58.782423+0000","last_clean":"2023-07-06T19:58:58.782423+0000","last_became_active":"2023-07-06T19:58:57.788179+0000","last_became_peered":"2023-07-06T19:58:57.788179+0000","last_unstale":"2023-07-06T19:58:58.782423+0000","last_undegraded":"2023-07-06T19:58:58.782423+0000","last_fullsized":"2023-07-06T19:58:58.782423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:26:32.189069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:59:09.287689+0000","last_change":"2023-07-06T19:58:52.742265+0000","last_active":"2023-07-06T19:59:09.287689+0000","last_peered":"2023-07-06T19:59:09.287689+0000","last_clean":"2023-07-06T19:59:09.287689+0000","last_became_active":"2023-07-06T19:58:52.741835+0000","last_became_peered":"2023-07-06T19:58:52.741835+0000","last_unstale":"2023-07-06T19:59:09.287689+0000","last_undegraded":"2023-07-06T19:59:09.287689+0000","last_fullsized":"2023-07-06T19:59:09.287689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:02:15.845300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378090+0000","last_change":"2023-07-06T19:58:53.751100+0000","last_active":"2023-07-06T19:58:59.378090+0000","last_peered":"2023-07-06T19:58:59.378090+0000","last_clean":"2023-07-06T19:58:59.378090+0000","last_became_active":"2023-07-06T19:58:53.750777+0000","last_became_peered":"2023-07-06T19:58:53.750777+0000","last_unstale":"2023-07-06T19:58:59.378090+0000","last_undegraded":"2023-07-06T19:58:59.378090+0000","last_fullsized":"2023-07-06T19:58:59.378090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:34:07.170685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783447+0000","last_change":"2023-07-06T19:58:57.787972+0000","last_active":"2023-07-06T19:58:58.783447+0000","last_peered":"2023-07-06T19:58:58.783447+0000","last_clean":"2023-07-06T19:58:58.783447+0000","last_became_active":"2023-07-06T19:58:57.787603+0000","last_became_peered":"2023-07-06T19:58:57.787603+0000","last_unstale":"2023-07-06T19:58:58.783447+0000","last_undegraded":"2023-07-06T19:58:58.783447+0000","last_fullsized":"2023-07-06T19:58:58.783447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:55:39.544808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377410+0000","last_change":"2023-07-06T19:58:52.749256+0000","last_active":"2023-07-06T19:58:59.377410+0000","last_peered":"2023-07-06T19:58:59.377410+0000","last_clean":"2023-07-06T19:58:59.377410+0000","last_became_active":"2023-07-06T19:58:52.748938+0000","last_became_peered":"2023-07-06T19:58:52.748938+0000","last_unstale":"2023-07-06T19:58:59.377410+0000","last_undegraded":"2023-07-06T19:58:59.377410+0000","last_fullsized":"2023-07-06T19:58:59.377410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:38:23.255098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377106+0000","last_change":"2023-07-06T19:58:53.760190+0000","last_active":"2023-07-06T19:58:59.377106+0000","last_peered":"2023-07-06T19:58:59.377106+0000","last_clean":"2023-07-06T19:58:59.377106+0000","last_became_active":"2023-07-06T19:58:53.758351+0000","last_became_peered":"2023-07-06T19:58:53.758351+0000","last_unstale":"2023-07-06T19:58:59.377106+0000","last_undegraded":"2023-07-06T19:58:59.377106+0000","last_fullsized":"2023-07-06T19:58:59.377106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:54:30.126613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376773+0000","last_change":"2023-07-06T19:58:57.787323+0000","last_active":"2023-07-06T19:58:59.376773+0000","last_peered":"2023-07-06T19:58:59.376773+0000","last_clean":"2023-07-06T19:58:59.376773+0000","last_became_active":"2023-07-06T19:58:57.786685+0000","last_became_peered":"2023-07-06T19:58:57.786685+0000","last_unstale":"2023-07-06T19:58:59.376773+0000","last_undegraded":"2023-07-06T19:58:59.376773+0000","last_fullsized":"2023-07-06T19:58:59.376773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:31:48.633170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377567+0000","last_change":"2023-07-06T19:58:52.746786+0000","last_active":"2023-07-06T19:58:59.377567+0000","last_peered":"2023-07-06T19:58:59.377567+0000","last_clean":"2023-07-06T19:58:59.377567+0000","last_became_active":"2023-07-06T19:58:52.746457+0000","last_became_peered":"2023-07-06T19:58:52.746457+0000","last_unstale":"2023-07-06T19:58:59.377567+0000","last_undegraded":"2023-07-06T19:58:59.377567+0000","last_fullsized":"2023-07-06T19:58:59.377567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:06.187998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782712+0000","last_change":"2023-07-06T19:58:53.760059+0000","last_active":"2023-07-06T19:58:58.782712+0000","last_peered":"2023-07-06T19:58:58.782712+0000","last_clean":"2023-07-06T19:58:58.782712+0000","last_became_active":"2023-07-06T19:58:53.759271+0000","last_became_peered":"2023-07-06T19:58:53.759271+0000","last_unstale":"2023-07-06T19:58:58.782712+0000","last_undegraded":"2023-07-06T19:58:58.782712+0000","last_fullsized":"2023-07-06T19:58:58.782712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:54:30.126613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376813+0000","last_change":"2023-07-06T19:58:57.786715+0000","last_active":"2023-07-06T19:58:59.376813+0000","last_peered":"2023-07-06T19:58:59.376813+0000","last_clean":"2023-07-06T19:58:59.376813+0000","last_became_active":"2023-07-06T19:58:57.786187+0000","last_became_peered":"2023-07-06T19:58:57.786187+0000","last_unstale":"2023-07-06T19:58:59.376813+0000","last_undegraded":"2023-07-06T19:58:59.376813+0000","last_fullsized":"2023-07-06T19:58:59.376813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:41:58.726961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377292+0000","last_change":"2023-07-06T19:58:52.751844+0000","last_active":"2023-07-06T19:58:59.377292+0000","last_peered":"2023-07-06T19:58:59.377292+0000","last_clean":"2023-07-06T19:58:59.377292+0000","last_became_active":"2023-07-06T19:58:52.751507+0000","last_became_peered":"2023-07-06T19:58:52.751507+0000","last_unstale":"2023-07-06T19:58:59.377292+0000","last_undegraded":"2023-07-06T19:58:59.377292+0000","last_fullsized":"2023-07-06T19:58:59.377292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:39:20.477362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378484+0000","last_change":"2023-07-06T19:58:53.760239+0000","last_active":"2023-07-06T19:58:59.378484+0000","last_peered":"2023-07-06T19:58:59.378484+0000","last_clean":"2023-07-06T19:58:59.378484+0000","last_became_active":"2023-07-06T19:58:53.759987+0000","last_became_peered":"2023-07-06T19:58:53.759987+0000","last_unstale":"2023-07-06T19:58:59.378484+0000","last_undegraded":"2023-07-06T19:58:59.378484+0000","last_fullsized":"2023-07-06T19:58:59.378484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:47:30.856849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782048+0000","last_change":"2023-07-06T19:58:57.791677+0000","last_active":"2023-07-06T19:58:58.782048+0000","last_peered":"2023-07-06T19:58:58.782048+0000","last_clean":"2023-07-06T19:58:58.782048+0000","last_became_active":"2023-07-06T19:58:57.791232+0000","last_became_peered":"2023-07-06T19:58:57.791232+0000","last_unstale":"2023-07-06T19:58:58.782048+0000","last_undegraded":"2023-07-06T19:58:58.782048+0000","last_fullsized":"2023-07-06T19:58:58.782048+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:06:42.413310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783606+0000","last_change":"2023-07-06T19:58:52.743480+0000","last_active":"2023-07-06T19:58:58.783606+0000","last_peered":"2023-07-06T19:58:58.783606+0000","last_clean":"2023-07-06T19:58:58.783606+0000","last_became_active":"2023-07-06T19:58:52.742980+0000","last_became_peered":"2023-07-06T19:58:52.742980+0000","last_unstale":"2023-07-06T19:58:58.783606+0000","last_undegraded":"2023-07-06T19:58:58.783606+0000","last_fullsized":"2023-07-06T19:58:58.783606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:30:09.417733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377140+0000","last_change":"2023-07-06T19:58:53.760648+0000","last_active":"2023-07-06T19:58:59.377140+0000","last_peered":"2023-07-06T19:58:59.377140+0000","last_clean":"2023-07-06T19:58:59.377140+0000","last_became_active":"2023-07-06T19:58:53.760334+0000","last_became_peered":"2023-07-06T19:58:53.760334+0000","last_unstale":"2023-07-06T19:58:59.377140+0000","last_undegraded":"2023-07-06T19:58:59.377140+0000","last_fullsized":"2023-07-06T19:58:59.377140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:55:10.096543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378635+0000","last_change":"2023-07-06T19:58:57.795273+0000","last_active":"2023-07-06T19:58:59.378635+0000","last_peered":"2023-07-06T19:58:59.378635+0000","last_clean":"2023-07-06T19:58:59.378635+0000","last_became_active":"2023-07-06T19:58:57.793041+0000","last_became_peered":"2023-07-06T19:58:57.793041+0000","last_unstale":"2023-07-06T19:58:59.378635+0000","last_undegraded":"2023-07-06T19:58:59.378635+0000","last_fullsized":"2023-07-06T19:58:59.378635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:55:39.544808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377951+0000","last_change":"2023-07-06T19:58:52.749389+0000","last_active":"2023-07-06T19:58:59.377951+0000","last_peered":"2023-07-06T19:58:59.377951+0000","last_clean":"2023-07-06T19:58:59.377951+0000","last_became_active":"2023-07-06T19:58:52.748954+0000","last_became_peered":"2023-07-06T19:58:52.748954+0000","last_unstale":"2023-07-06T19:58:59.377951+0000","last_undegraded":"2023-07-06T19:58:59.377951+0000","last_fullsized":"2023-07-06T19:58:59.377951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:36:40.777030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.781709+0000","last_change":"2023-07-06T19:58:53.750314+0000","last_active":"2023-07-06T19:58:58.781709+0000","last_peered":"2023-07-06T19:58:58.781709+0000","last_clean":"2023-07-06T19:58:58.781709+0000","last_became_active":"2023-07-06T19:58:53.750016+0000","last_became_peered":"2023-07-06T19:58:53.750016+0000","last_unstale":"2023-07-06T19:58:58.781709+0000","last_undegraded":"2023-07-06T19:58:58.781709+0000","last_fullsized":"2023-07-06T19:58:58.781709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:07.195585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376267+0000","last_change":"2023-07-06T19:58:57.783293+0000","last_active":"2023-07-06T19:58:59.376267+0000","last_peered":"2023-07-06T19:58:59.376267+0000","last_clean":"2023-07-06T19:58:59.376267+0000","last_became_active":"2023-07-06T19:58:57.782891+0000","last_became_peered":"2023-07-06T19:58:57.782891+0000","last_unstale":"2023-07-06T19:58:59.376267+0000","last_undegraded":"2023-07-06T19:58:59.376267+0000","last_fullsized":"2023-07-06T19:58:59.376267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:46:14.072294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377762+0000","last_change":"2023-07-06T19:58:52.749788+0000","last_active":"2023-07-06T19:58:59.377762+0000","last_peered":"2023-07-06T19:58:59.377762+0000","last_clean":"2023-07-06T19:58:59.377762+0000","last_became_active":"2023-07-06T19:58:52.749502+0000","last_became_peered":"2023-07-06T19:58:52.749502+0000","last_unstale":"2023-07-06T19:58:59.377762+0000","last_undegraded":"2023-07-06T19:58:59.377762+0000","last_fullsized":"2023-07-06T19:58:59.377762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:41:53.687362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377616+0000","last_change":"2023-07-06T19:58:53.756711+0000","last_active":"2023-07-06T19:58:59.377616+0000","last_peered":"2023-07-06T19:58:59.377616+0000","last_clean":"2023-07-06T19:58:59.377616+0000","last_became_active":"2023-07-06T19:58:53.756385+0000","last_became_peered":"2023-07-06T19:58:53.756385+0000","last_unstale":"2023-07-06T19:58:59.377616+0000","last_undegraded":"2023-07-06T19:58:59.377616+0000","last_fullsized":"2023-07-06T19:58:59.377616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:14:07.791583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377139+0000","last_change":"2023-07-06T19:58:57.786660+0000","last_active":"2023-07-06T19:58:59.377139+0000","last_peered":"2023-07-06T19:58:59.377139+0000","last_clean":"2023-07-06T19:58:59.377139+0000","last_became_active":"2023-07-06T19:58:57.786238+0000","last_became_peered":"2023-07-06T19:58:57.786238+0000","last_unstale":"2023-07-06T19:58:59.377139+0000","last_undegraded":"2023-07-06T19:58:59.377139+0000","last_fullsized":"2023-07-06T19:58:59.377139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:47:26.705198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378304+0000","last_change":"2023-07-06T19:58:52.751151+0000","last_active":"2023-07-06T19:58:59.378304+0000","last_peered":"2023-07-06T19:58:59.378304+0000","last_clean":"2023-07-06T19:58:59.378304+0000","last_became_active":"2023-07-06T19:58:52.750499+0000","last_became_peered":"2023-07-06T19:58:52.750499+0000","last_unstale":"2023-07-06T19:58:59.378304+0000","last_undegraded":"2023-07-06T19:58:59.378304+0000","last_fullsized":"2023-07-06T19:58:59.378304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:55:09.088956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783436+0000","last_change":"2023-07-06T19:58:53.755226+0000","last_active":"2023-07-06T19:58:58.783436+0000","last_peered":"2023-07-06T19:58:58.783436+0000","last_clean":"2023-07-06T19:58:58.783436+0000","last_became_active":"2023-07-06T19:58:53.754917+0000","last_became_peered":"2023-07-06T19:58:53.754917+0000","last_unstale":"2023-07-06T19:58:58.783436+0000","last_undegraded":"2023-07-06T19:58:58.783436+0000","last_fullsized":"2023-07-06T19:58:58.783436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:32:21.594143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376977+0000","last_change":"2023-07-06T19:58:57.788481+0000","last_active":"2023-07-06T19:58:59.376977+0000","last_peered":"2023-07-06T19:58:59.376977+0000","last_clean":"2023-07-06T19:58:59.376977+0000","last_became_active":"2023-07-06T19:58:57.788042+0000","last_became_peered":"2023-07-06T19:58:57.788042+0000","last_unstale":"2023-07-06T19:58:59.376977+0000","last_undegraded":"2023-07-06T19:58:59.376977+0000","last_fullsized":"2023-07-06T19:58:59.376977+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:12:56.591390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782017+0000","last_change":"2023-07-06T19:58:52.752037+0000","last_active":"2023-07-06T19:58:58.782017+0000","last_peered":"2023-07-06T19:58:58.782017+0000","last_clean":"2023-07-06T19:58:58.782017+0000","last_became_active":"2023-07-06T19:58:52.751743+0000","last_became_peered":"2023-07-06T19:58:52.751743+0000","last_unstale":"2023-07-06T19:58:58.782017+0000","last_undegraded":"2023-07-06T19:58:58.782017+0000","last_fullsized":"2023-07-06T19:58:58.782017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:02.506485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378860+0000","last_change":"2023-07-06T19:58:53.756515+0000","last_active":"2023-07-06T19:58:59.378860+0000","last_peered":"2023-07-06T19:58:59.378860+0000","last_clean":"2023-07-06T19:58:59.378860+0000","last_became_active":"2023-07-06T19:58:53.756160+0000","last_became_peered":"2023-07-06T19:58:53.756160+0000","last_unstale":"2023-07-06T19:58:59.378860+0000","last_undegraded":"2023-07-06T19:58:59.378860+0000","last_fullsized":"2023-07-06T19:58:59.378860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:09:50.298552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376553+0000","last_change":"2023-07-06T19:58:57.791364+0000","last_active":"2023-07-06T19:58:59.376553+0000","last_peered":"2023-07-06T19:58:59.376553+0000","last_clean":"2023-07-06T19:58:59.376553+0000","last_became_active":"2023-07-06T19:58:57.789062+0000","last_became_peered":"2023-07-06T19:58:57.789062+0000","last_unstale":"2023-07-06T19:58:59.376553+0000","last_undegraded":"2023-07-06T19:58:59.376553+0000","last_fullsized":"2023-07-06T19:58:59.376553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:06:20.866793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377550+0000","last_change":"2023-07-06T19:58:52.747602+0000","last_active":"2023-07-06T19:58:59.377550+0000","last_peered":"2023-07-06T19:58:59.377550+0000","last_clean":"2023-07-06T19:58:59.377550+0000","last_became_active":"2023-07-06T19:58:52.747306+0000","last_became_peered":"2023-07-06T19:58:52.747306+0000","last_unstale":"2023-07-06T19:58:59.377550+0000","last_undegraded":"2023-07-06T19:58:59.377550+0000","last_fullsized":"2023-07-06T19:58:59.377550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:46:23.956146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377454+0000","last_change":"2023-07-06T19:58:53.760870+0000","last_active":"2023-07-06T19:58:59.377454+0000","last_peered":"2023-07-06T19:58:59.377454+0000","last_clean":"2023-07-06T19:58:59.377454+0000","last_became_active":"2023-07-06T19:58:53.760583+0000","last_became_peered":"2023-07-06T19:58:53.760583+0000","last_unstale":"2023-07-06T19:58:59.377454+0000","last_undegraded":"2023-07-06T19:58:59.377454+0000","last_fullsized":"2023-07-06T19:58:59.377454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:36:39.721385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782589+0000","last_change":"2023-07-06T19:58:57.794470+0000","last_active":"2023-07-06T19:58:58.782589+0000","last_peered":"2023-07-06T19:58:58.782589+0000","last_clean":"2023-07-06T19:58:58.782589+0000","last_became_active":"2023-07-06T19:58:57.793975+0000","last_became_peered":"2023-07-06T19:58:57.793975+0000","last_unstale":"2023-07-06T19:58:58.782589+0000","last_undegraded":"2023-07-06T19:58:58.782589+0000","last_fullsized":"2023-07-06T19:58:58.782589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:28:54.247015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783537+0000","last_change":"2023-07-06T19:58:52.740315+0000","last_active":"2023-07-06T19:58:58.783537+0000","last_peered":"2023-07-06T19:58:58.783537+0000","last_clean":"2023-07-06T19:58:58.783537+0000","last_became_active":"2023-07-06T19:58:52.739933+0000","last_became_peered":"2023-07-06T19:58:52.739933+0000","last_unstale":"2023-07-06T19:58:58.783537+0000","last_undegraded":"2023-07-06T19:58:58.783537+0000","last_fullsized":"2023-07-06T19:58:58.783537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:49:50.590705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378294+0000","last_change":"2023-07-06T19:58:53.741928+0000","last_active":"2023-07-06T19:58:59.378294+0000","last_peered":"2023-07-06T19:58:59.378294+0000","last_clean":"2023-07-06T19:58:59.378294+0000","last_became_active":"2023-07-06T19:58:53.741625+0000","last_became_peered":"2023-07-06T19:58:53.741625+0000","last_unstale":"2023-07-06T19:58:59.378294+0000","last_undegraded":"2023-07-06T19:58:59.378294+0000","last_fullsized":"2023-07-06T19:58:59.378294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:10:07.041452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782705+0000","last_change":"2023-07-06T19:58:57.792062+0000","last_active":"2023-07-06T19:58:58.782705+0000","last_peered":"2023-07-06T19:58:58.782705+0000","last_clean":"2023-07-06T19:58:58.782705+0000","last_became_active":"2023-07-06T19:58:57.791281+0000","last_became_peered":"2023-07-06T19:58:57.791281+0000","last_unstale":"2023-07-06T19:58:58.782705+0000","last_undegraded":"2023-07-06T19:58:58.782705+0000","last_fullsized":"2023-07-06T19:58:58.782705+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:55:14.128554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377292+0000","last_change":"2023-07-06T19:58:52.747562+0000","last_active":"2023-07-06T19:58:59.377292+0000","last_peered":"2023-07-06T19:58:59.377292+0000","last_clean":"2023-07-06T19:58:59.377292+0000","last_became_active":"2023-07-06T19:58:52.747229+0000","last_became_peered":"2023-07-06T19:58:52.747229+0000","last_unstale":"2023-07-06T19:58:59.377292+0000","last_undegraded":"2023-07-06T19:58:59.377292+0000","last_fullsized":"2023-07-06T19:58:59.377292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:04:30.618240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378608+0000","last_change":"2023-07-06T19:58:53.756720+0000","last_active":"2023-07-06T19:58:59.378608+0000","last_peered":"2023-07-06T19:58:59.378608+0000","last_clean":"2023-07-06T19:58:59.378608+0000","last_became_active":"2023-07-06T19:58:53.756402+0000","last_became_peered":"2023-07-06T19:58:53.756402+0000","last_unstale":"2023-07-06T19:58:59.378608+0000","last_undegraded":"2023-07-06T19:58:59.378608+0000","last_fullsized":"2023-07-06T19:58:59.378608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:26:00.900208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378351+0000","last_change":"2023-07-06T19:58:57.783465+0000","last_active":"2023-07-06T19:58:59.378351+0000","last_peered":"2023-07-06T19:58:59.378351+0000","last_clean":"2023-07-06T19:58:59.378351+0000","last_became_active":"2023-07-06T19:58:57.782790+0000","last_became_peered":"2023-07-06T19:58:57.782790+0000","last_unstale":"2023-07-06T19:58:59.378351+0000","last_undegraded":"2023-07-06T19:58:59.378351+0000","last_fullsized":"2023-07-06T19:58:59.378351+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:43:02.955936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376589+0000","last_change":"2023-07-06T19:58:52.749725+0000","last_active":"2023-07-06T19:58:59.376589+0000","last_peered":"2023-07-06T19:58:59.376589+0000","last_clean":"2023-07-06T19:58:59.376589+0000","last_became_active":"2023-07-06T19:58:52.749426+0000","last_became_peered":"2023-07-06T19:58:52.749426+0000","last_unstale":"2023-07-06T19:58:59.376589+0000","last_undegraded":"2023-07-06T19:58:59.376589+0000","last_fullsized":"2023-07-06T19:58:59.376589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:08:50.821397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783208+0000","last_change":"2023-07-06T19:58:53.759474+0000","last_active":"2023-07-06T19:58:58.783208+0000","last_peered":"2023-07-06T19:58:58.783208+0000","last_clean":"2023-07-06T19:58:58.783208+0000","last_became_active":"2023-07-06T19:58:53.759191+0000","last_became_peered":"2023-07-06T19:58:53.759191+0000","last_unstale":"2023-07-06T19:58:58.783208+0000","last_undegraded":"2023-07-06T19:58:58.783208+0000","last_fullsized":"2023-07-06T19:58:58.783208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:40:15.607877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378239+0000","last_change":"2023-07-06T19:58:57.787350+0000","last_active":"2023-07-06T19:58:59.378239+0000","last_peered":"2023-07-06T19:58:59.378239+0000","last_clean":"2023-07-06T19:58:59.378239+0000","last_became_active":"2023-07-06T19:58:57.786760+0000","last_became_peered":"2023-07-06T19:58:57.786760+0000","last_unstale":"2023-07-06T19:58:59.378239+0000","last_undegraded":"2023-07-06T19:58:59.378239+0000","last_fullsized":"2023-07-06T19:58:59.378239+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:07.546083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782756+0000","last_change":"2023-07-06T19:58:47.723855+0000","last_active":"2023-07-06T19:58:58.782756+0000","last_peered":"2023-07-06T19:58:58.782756+0000","last_clean":"2023-07-06T19:58:58.782756+0000","last_became_active":"2023-07-06T19:58:47.723553+0000","last_became_peered":"2023-07-06T19:58:47.723553+0000","last_unstale":"2023-07-06T19:58:58.782756+0000","last_undegraded":"2023-07-06T19:58:58.782756+0000","last_fullsized":"2023-07-06T19:58:58.782756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:00:46.116158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782566+0000","last_change":"2023-07-06T19:58:52.751410+0000","last_active":"2023-07-06T19:58:58.782566+0000","last_peered":"2023-07-06T19:58:58.782566+0000","last_clean":"2023-07-06T19:58:58.782566+0000","last_became_active":"2023-07-06T19:58:52.751112+0000","last_became_peered":"2023-07-06T19:58:52.751112+0000","last_unstale":"2023-07-06T19:58:58.782566+0000","last_undegraded":"2023-07-06T19:58:58.782566+0000","last_fullsized":"2023-07-06T19:58:58.782566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:01:55.597968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782915+0000","last_change":"2023-07-06T19:58:53.749897+0000","last_active":"2023-07-06T19:58:58.782915+0000","last_peered":"2023-07-06T19:58:58.782915+0000","last_clean":"2023-07-06T19:58:58.782915+0000","last_became_active":"2023-07-06T19:58:53.749624+0000","last_became_peered":"2023-07-06T19:58:53.749624+0000","last_unstale":"2023-07-06T19:58:58.782915+0000","last_undegraded":"2023-07-06T19:58:58.782915+0000","last_fullsized":"2023-07-06T19:58:58.782915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:15:46.167902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378551+0000","last_change":"2023-07-06T19:58:57.789358+0000","last_active":"2023-07-06T19:58:59.378551+0000","last_peered":"2023-07-06T19:58:59.378551+0000","last_clean":"2023-07-06T19:58:59.378551+0000","last_became_active":"2023-07-06T19:58:57.788645+0000","last_became_peered":"2023-07-06T19:58:57.788645+0000","last_unstale":"2023-07-06T19:58:59.378551+0000","last_undegraded":"2023-07-06T19:58:59.378551+0000","last_fullsized":"2023-07-06T19:58:59.378551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:31:48.633170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782612+0000","last_change":"2023-07-06T19:58:47.705294+0000","last_active":"2023-07-06T19:58:58.782612+0000","last_peered":"2023-07-06T19:58:58.782612+0000","last_clean":"2023-07-06T19:58:58.782612+0000","last_became_active":"2023-07-06T19:58:47.704921+0000","last_became_peered":"2023-07-06T19:58:47.704921+0000","last_unstale":"2023-07-06T19:58:58.782612+0000","last_undegraded":"2023-07-06T19:58:58.782612+0000","last_fullsized":"2023-07-06T19:58:58.782612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:41:48.663962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378365+0000","last_change":"2023-07-06T19:58:52.748067+0000","last_active":"2023-07-06T19:58:59.378365+0000","last_peered":"2023-07-06T19:58:59.378365+0000","last_clean":"2023-07-06T19:58:59.378365+0000","last_became_active":"2023-07-06T19:58:52.747728+0000","last_became_peered":"2023-07-06T19:58:52.747728+0000","last_unstale":"2023-07-06T19:58:59.378365+0000","last_undegraded":"2023-07-06T19:58:59.378365+0000","last_fullsized":"2023-07-06T19:58:59.378365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:22:44.301281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782686+0000","last_change":"2023-07-06T19:58:53.742174+0000","last_active":"2023-07-06T19:58:58.782686+0000","last_peered":"2023-07-06T19:58:58.782686+0000","last_clean":"2023-07-06T19:58:58.782686+0000","last_became_active":"2023-07-06T19:58:53.741231+0000","last_became_peered":"2023-07-06T19:58:53.741231+0000","last_unstale":"2023-07-06T19:58:58.782686+0000","last_undegraded":"2023-07-06T19:58:58.782686+0000","last_fullsized":"2023-07-06T19:58:58.782686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:27:23.271688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376951+0000","last_change":"2023-07-06T19:58:57.785326+0000","last_active":"2023-07-06T19:58:59.376951+0000","last_peered":"2023-07-06T19:58:59.376951+0000","last_clean":"2023-07-06T19:58:59.376951+0000","last_became_active":"2023-07-06T19:58:57.784907+0000","last_became_peered":"2023-07-06T19:58:57.784907+0000","last_unstale":"2023-07-06T19:58:59.376951+0000","last_undegraded":"2023-07-06T19:58:59.376951+0000","last_fullsized":"2023-07-06T19:58:59.376951+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:19:07.540692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376590+0000","last_change":"2023-07-06T19:58:47.766992+0000","last_active":"2023-07-06T19:58:59.376590+0000","last_peered":"2023-07-06T19:58:59.376590+0000","last_clean":"2023-07-06T19:58:59.376590+0000","last_became_active":"2023-07-06T19:58:47.766697+0000","last_became_peered":"2023-07-06T19:58:47.766697+0000","last_unstale":"2023-07-06T19:58:59.376590+0000","last_undegraded":"2023-07-06T19:58:59.376590+0000","last_fullsized":"2023-07-06T19:58:59.376590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:44:05.260069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782473+0000","last_change":"2023-07-06T19:58:52.747039+0000","last_active":"2023-07-06T19:58:58.782473+0000","last_peered":"2023-07-06T19:58:58.782473+0000","last_clean":"2023-07-06T19:58:58.782473+0000","last_became_active":"2023-07-06T19:58:52.746770+0000","last_became_peered":"2023-07-06T19:58:52.746770+0000","last_unstale":"2023-07-06T19:58:58.782473+0000","last_undegraded":"2023-07-06T19:58:58.782473+0000","last_fullsized":"2023-07-06T19:58:58.782473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:34:28.429392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783138+0000","last_change":"2023-07-06T19:58:53.745314+0000","last_active":"2023-07-06T19:58:58.783138+0000","last_peered":"2023-07-06T19:58:58.783138+0000","last_clean":"2023-07-06T19:58:58.783138+0000","last_became_active":"2023-07-06T19:58:53.744843+0000","last_became_peered":"2023-07-06T19:58:53.744843+0000","last_unstale":"2023-07-06T19:58:58.783138+0000","last_undegraded":"2023-07-06T19:58:58.783138+0000","last_fullsized":"2023-07-06T19:58:58.783138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:03.514072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377298+0000","last_change":"2023-07-06T19:58:57.793087+0000","last_active":"2023-07-06T19:58:59.377298+0000","last_peered":"2023-07-06T19:58:59.377298+0000","last_clean":"2023-07-06T19:58:59.377298+0000","last_became_active":"2023-07-06T19:58:57.792685+0000","last_became_peered":"2023-07-06T19:58:57.792685+0000","last_unstale":"2023-07-06T19:58:59.377298+0000","last_undegraded":"2023-07-06T19:58:59.377298+0000","last_fullsized":"2023-07-06T19:58:59.377298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:31:48.633170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782184+0000","last_change":"2023-07-06T19:58:47.704498+0000","last_active":"2023-07-06T19:58:58.782184+0000","last_peered":"2023-07-06T19:58:58.782184+0000","last_clean":"2023-07-06T19:58:58.782184+0000","last_became_active":"2023-07-06T19:58:47.704172+0000","last_became_peered":"2023-07-06T19:58:47.704172+0000","last_unstale":"2023-07-06T19:58:58.782184+0000","last_undegraded":"2023-07-06T19:58:58.782184+0000","last_fullsized":"2023-07-06T19:58:58.782184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:08:45.797996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377014+0000","last_change":"2023-07-06T19:58:40.972763+0000","last_active":"2023-07-06T19:58:59.377014+0000","last_peered":"2023-07-06T19:58:59.377014+0000","last_clean":"2023-07-06T19:58:59.377014+0000","last_became_active":"2023-07-06T19:58:40.971570+0000","last_became_peered":"2023-07-06T19:58:40.971570+0000","last_unstale":"2023-07-06T19:58:59.377014+0000","last_undegraded":"2023-07-06T19:58:59.377014+0000","last_fullsized":"2023-07-06T19:58:59.377014+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_clean_scrub_stamp":"2023-07-06T19:58:39.653546+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:00:26.457825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376600+0000","last_change":"2023-07-06T19:58:52.746886+0000","last_active":"2023-07-06T19:58:59.376600+0000","last_peered":"2023-07-06T19:58:59.376600+0000","last_clean":"2023-07-06T19:58:59.376600+0000","last_became_active":"2023-07-06T19:58:52.746551+0000","last_became_peered":"2023-07-06T19:58:52.746551+0000","last_unstale":"2023-07-06T19:58:59.376600+0000","last_undegraded":"2023-07-06T19:58:59.376600+0000","last_fullsized":"2023-07-06T19:58:59.376600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:47:29.849262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783755+0000","last_change":"2023-07-06T19:58:53.750523+0000","last_active":"2023-07-06T19:58:58.783755+0000","last_peered":"2023-07-06T19:58:58.783755+0000","last_clean":"2023-07-06T19:58:58.783755+0000","last_became_active":"2023-07-06T19:58:53.750242+0000","last_became_peered":"2023-07-06T19:58:53.750242+0000","last_unstale":"2023-07-06T19:58:58.783755+0000","last_undegraded":"2023-07-06T19:58:58.783755+0000","last_fullsized":"2023-07-06T19:58:58.783755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:56:30.660740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782488+0000","last_change":"2023-07-06T19:58:57.786254+0000","last_active":"2023-07-06T19:58:58.782488+0000","last_peered":"2023-07-06T19:58:58.782488+0000","last_clean":"2023-07-06T19:58:58.782488+0000","last_became_active":"2023-07-06T19:58:57.785873+0000","last_became_peered":"2023-07-06T19:58:57.785873+0000","last_unstale":"2023-07-06T19:58:58.782488+0000","last_undegraded":"2023-07-06T19:58:58.782488+0000","last_fullsized":"2023-07-06T19:58:58.782488+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:31:48.633170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377148+0000","last_change":"2023-07-06T19:58:47.708545+0000","last_active":"2023-07-06T19:58:59.377148+0000","last_peered":"2023-07-06T19:58:59.377148+0000","last_clean":"2023-07-06T19:58:59.377148+0000","last_became_active":"2023-07-06T19:58:47.708230+0000","last_became_peered":"2023-07-06T19:58:47.708230+0000","last_unstale":"2023-07-06T19:58:59.377148+0000","last_undegraded":"2023-07-06T19:58:59.377148+0000","last_fullsized":"2023-07-06T19:58:59.377148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:08:45.797996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376917+0000","last_change":"2023-07-06T19:58:52.751850+0000","last_active":"2023-07-06T19:58:59.376917+0000","last_peered":"2023-07-06T19:58:59.376917+0000","last_clean":"2023-07-06T19:58:59.376917+0000","last_became_active":"2023-07-06T19:58:52.751537+0000","last_became_peered":"2023-07-06T19:58:52.751537+0000","last_unstale":"2023-07-06T19:58:59.376917+0000","last_undegraded":"2023-07-06T19:58:59.376917+0000","last_fullsized":"2023-07-06T19:58:59.376917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:15:45.160315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378259+0000","last_change":"2023-07-06T19:58:53.753894+0000","last_active":"2023-07-06T19:58:59.378259+0000","last_peered":"2023-07-06T19:58:59.378259+0000","last_clean":"2023-07-06T19:58:59.378259+0000","last_became_active":"2023-07-06T19:58:53.753530+0000","last_became_peered":"2023-07-06T19:58:53.753530+0000","last_unstale":"2023-07-06T19:58:59.378259+0000","last_undegraded":"2023-07-06T19:58:59.378259+0000","last_fullsized":"2023-07-06T19:58:59.378259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:06:38.381299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783829+0000","last_change":"2023-07-06T19:58:57.798396+0000","last_active":"2023-07-06T19:58:58.783829+0000","last_peered":"2023-07-06T19:58:58.783829+0000","last_clean":"2023-07-06T19:58:58.783829+0000","last_became_active":"2023-07-06T19:58:57.798003+0000","last_became_peered":"2023-07-06T19:58:57.798003+0000","last_unstale":"2023-07-06T19:58:58.783829+0000","last_undegraded":"2023-07-06T19:58:58.783829+0000","last_fullsized":"2023-07-06T19:58:58.783829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:48:14.761542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378171+0000","last_change":"2023-07-06T19:58:47.723926+0000","last_active":"2023-07-06T19:58:59.378171+0000","last_peered":"2023-07-06T19:58:59.378171+0000","last_clean":"2023-07-06T19:58:59.378171+0000","last_became_active":"2023-07-06T19:58:47.723646+0000","last_became_peered":"2023-07-06T19:58:47.723646+0000","last_unstale":"2023-07-06T19:58:59.378171+0000","last_undegraded":"2023-07-06T19:58:59.378171+0000","last_fullsized":"2023-07-06T19:58:59.378171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:09:44.267564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783304+0000","last_change":"2023-07-06T19:58:52.744960+0000","last_active":"2023-07-06T19:58:58.783304+0000","last_peered":"2023-07-06T19:58:58.783304+0000","last_clean":"2023-07-06T19:58:58.783304+0000","last_became_active":"2023-07-06T19:58:52.744634+0000","last_became_peered":"2023-07-06T19:58:52.744634+0000","last_unstale":"2023-07-06T19:58:58.783304+0000","last_undegraded":"2023-07-06T19:58:58.783304+0000","last_fullsized":"2023-07-06T19:58:58.783304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:08:50.821397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378559+0000","last_change":"2023-07-06T19:58:53.750128+0000","last_active":"2023-07-06T19:58:59.378559+0000","last_peered":"2023-07-06T19:58:59.378559+0000","last_clean":"2023-07-06T19:58:59.378559+0000","last_became_active":"2023-07-06T19:58:53.749580+0000","last_became_peered":"2023-07-06T19:58:53.749580+0000","last_unstale":"2023-07-06T19:58:59.378559+0000","last_undegraded":"2023-07-06T19:58:59.378559+0000","last_fullsized":"2023-07-06T19:58:59.378559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:01:56.605555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377697+0000","last_change":"2023-07-06T19:58:57.788139+0000","last_active":"2023-07-06T19:58:59.377697+0000","last_peered":"2023-07-06T19:58:59.377697+0000","last_clean":"2023-07-06T19:58:59.377697+0000","last_became_active":"2023-07-06T19:58:57.787755+0000","last_became_peered":"2023-07-06T19:58:57.787755+0000","last_unstale":"2023-07-06T19:58:59.377697+0000","last_undegraded":"2023-07-06T19:58:59.377697+0000","last_fullsized":"2023-07-06T19:58:59.377697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:49:04.545425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377011+0000","last_change":"2023-07-06T19:58:52.749383+0000","last_active":"2023-07-06T19:58:59.377011+0000","last_peered":"2023-07-06T19:58:59.377011+0000","last_clean":"2023-07-06T19:58:59.377011+0000","last_became_active":"2023-07-06T19:58:52.749084+0000","last_became_peered":"2023-07-06T19:58:52.749084+0000","last_unstale":"2023-07-06T19:58:59.377011+0000","last_undegraded":"2023-07-06T19:58:59.377011+0000","last_fullsized":"2023-07-06T19:58:59.377011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:09:49.290965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782895+0000","last_change":"2023-07-06T19:58:47.711918+0000","last_active":"2023-07-06T19:58:58.782895+0000","last_peered":"2023-07-06T19:58:58.782895+0000","last_clean":"2023-07-06T19:58:58.782895+0000","last_became_active":"2023-07-06T19:58:47.711591+0000","last_became_peered":"2023-07-06T19:58:47.711591+0000","last_unstale":"2023-07-06T19:58:58.782895+0000","last_undegraded":"2023-07-06T19:58:58.782895+0000","last_fullsized":"2023-07-06T19:58:58.782895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:01.164597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376523+0000","last_change":"2023-07-06T19:58:53.756858+0000","last_active":"2023-07-06T19:58:59.376523+0000","last_peered":"2023-07-06T19:58:59.376523+0000","last_clean":"2023-07-06T19:58:59.376523+0000","last_became_active":"2023-07-06T19:58:53.756704+0000","last_became_peered":"2023-07-06T19:58:53.756704+0000","last_unstale":"2023-07-06T19:58:59.376523+0000","last_undegraded":"2023-07-06T19:58:59.376523+0000","last_fullsized":"2023-07-06T19:58:59.376523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:40:15.607877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376385+0000","last_change":"2023-07-06T19:58:57.790196+0000","last_active":"2023-07-06T19:58:59.376385+0000","last_peered":"2023-07-06T19:58:59.376385+0000","last_clean":"2023-07-06T19:58:59.376385+0000","last_became_active":"2023-07-06T19:58:57.789783+0000","last_became_peered":"2023-07-06T19:58:57.789783+0000","last_unstale":"2023-07-06T19:58:59.376385+0000","last_undegraded":"2023-07-06T19:58:59.376385+0000","last_fullsized":"2023-07-06T19:58:59.376385+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:00:43.554956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783818+0000","last_change":"2023-07-06T19:58:47.712143+0000","last_active":"2023-07-06T19:58:58.783818+0000","last_peered":"2023-07-06T19:58:58.783818+0000","last_clean":"2023-07-06T19:58:58.783818+0000","last_became_active":"2023-07-06T19:58:47.711788+0000","last_became_peered":"2023-07-06T19:58:47.711788+0000","last_unstale":"2023-07-06T19:58:58.783818+0000","last_undegraded":"2023-07-06T19:58:58.783818+0000","last_fullsized":"2023-07-06T19:58:58.783818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:14:46.864853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378347+0000","last_change":"2023-07-06T19:58:52.745653+0000","last_active":"2023-07-06T19:58:59.378347+0000","last_peered":"2023-07-06T19:58:59.378347+0000","last_clean":"2023-07-06T19:58:59.378347+0000","last_became_active":"2023-07-06T19:58:52.745371+0000","last_became_peered":"2023-07-06T19:58:52.745371+0000","last_unstale":"2023-07-06T19:58:59.378347+0000","last_undegraded":"2023-07-06T19:58:59.378347+0000","last_fullsized":"2023-07-06T19:58:59.378347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:00:38.515358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377461+0000","last_change":"2023-07-06T19:58:53.748251+0000","last_active":"2023-07-06T19:58:59.377461+0000","last_peered":"2023-07-06T19:58:59.377461+0000","last_clean":"2023-07-06T19:58:59.377461+0000","last_became_active":"2023-07-06T19:58:53.743355+0000","last_became_peered":"2023-07-06T19:58:53.743355+0000","last_unstale":"2023-07-06T19:58:59.377461+0000","last_undegraded":"2023-07-06T19:58:59.377461+0000","last_fullsized":"2023-07-06T19:58:59.377461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:32:07.064198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783329+0000","last_change":"2023-07-06T19:58:57.788802+0000","last_active":"2023-07-06T19:58:58.783329+0000","last_peered":"2023-07-06T19:58:58.783329+0000","last_clean":"2023-07-06T19:58:58.783329+0000","last_became_active":"2023-07-06T19:58:57.788255+0000","last_became_peered":"2023-07-06T19:58:57.788255+0000","last_unstale":"2023-07-06T19:58:58.783329+0000","last_undegraded":"2023-07-06T19:58:58.783329+0000","last_fullsized":"2023-07-06T19:58:58.783329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:47:34.888861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378713+0000","last_change":"2023-07-06T19:58:52.751073+0000","last_active":"2023-07-06T19:58:59.378713+0000","last_peered":"2023-07-06T19:58:59.378713+0000","last_clean":"2023-07-06T19:58:59.378713+0000","last_became_active":"2023-07-06T19:58:52.750801+0000","last_became_peered":"2023-07-06T19:58:52.750801+0000","last_unstale":"2023-07-06T19:58:59.378713+0000","last_undegraded":"2023-07-06T19:58:59.378713+0000","last_fullsized":"2023-07-06T19:58:59.378713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:41:53.687362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377890+0000","last_change":"2023-07-06T19:58:53.752885+0000","last_active":"2023-07-06T19:58:59.377890+0000","last_peered":"2023-07-06T19:58:59.377890+0000","last_clean":"2023-07-06T19:58:59.377890+0000","last_became_active":"2023-07-06T19:58:53.752604+0000","last_became_peered":"2023-07-06T19:58:53.752604+0000","last_unstale":"2023-07-06T19:58:59.377890+0000","last_undegraded":"2023-07-06T19:58:59.377890+0000","last_fullsized":"2023-07-06T19:58:59.377890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:04:50.697845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377636+0000","last_change":"2023-07-06T19:58:57.792965+0000","last_active":"2023-07-06T19:58:59.377636+0000","last_peered":"2023-07-06T19:58:59.377636+0000","last_clean":"2023-07-06T19:58:59.377636+0000","last_became_active":"2023-07-06T19:58:57.792542+0000","last_became_peered":"2023-07-06T19:58:57.792542+0000","last_unstale":"2023-07-06T19:58:59.377636+0000","last_undegraded":"2023-07-06T19:58:59.377636+0000","last_fullsized":"2023-07-06T19:58:59.377636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:02:00.637566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782164+0000","last_change":"2023-07-06T19:58:52.748757+0000","last_active":"2023-07-06T19:58:58.782164+0000","last_peered":"2023-07-06T19:58:58.782164+0000","last_clean":"2023-07-06T19:58:58.782164+0000","last_became_active":"2023-07-06T19:58:52.748438+0000","last_became_peered":"2023-07-06T19:58:52.748438+0000","last_unstale":"2023-07-06T19:58:58.782164+0000","last_undegraded":"2023-07-06T19:58:58.782164+0000","last_fullsized":"2023-07-06T19:58:58.782164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:40:14.600290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378827+0000","last_change":"2023-07-06T19:58:53.760898+0000","last_active":"2023-07-06T19:58:59.378827+0000","last_peered":"2023-07-06T19:58:59.378827+0000","last_clean":"2023-07-06T19:58:59.378827+0000","last_became_active":"2023-07-06T19:58:53.760643+0000","last_became_peered":"2023-07-06T19:58:53.760643+0000","last_unstale":"2023-07-06T19:58:59.378827+0000","last_undegraded":"2023-07-06T19:58:59.378827+0000","last_fullsized":"2023-07-06T19:58:59.378827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:03:04.431089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782178+0000","last_change":"2023-07-06T19:58:57.780940+0000","last_active":"2023-07-06T19:58:58.782178+0000","last_peered":"2023-07-06T19:58:58.782178+0000","last_clean":"2023-07-06T19:58:58.782178+0000","last_became_active":"2023-07-06T19:58:57.780557+0000","last_became_peered":"2023-07-06T19:58:57.780557+0000","last_unstale":"2023-07-06T19:58:58.782178+0000","last_undegraded":"2023-07-06T19:58:58.782178+0000","last_fullsized":"2023-07-06T19:58:58.782178+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:09:54.330563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782271+0000","last_change":"2023-07-06T19:58:52.748732+0000","last_active":"2023-07-06T19:58:58.782271+0000","last_peered":"2023-07-06T19:58:58.782271+0000","last_clean":"2023-07-06T19:58:58.782271+0000","last_became_active":"2023-07-06T19:58:52.748464+0000","last_became_peered":"2023-07-06T19:58:52.748464+0000","last_unstale":"2023-07-06T19:58:58.782271+0000","last_undegraded":"2023-07-06T19:58:58.782271+0000","last_fullsized":"2023-07-06T19:58:58.782271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:47:29.849262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377654+0000","last_change":"2023-07-06T19:58:53.749638+0000","last_active":"2023-07-06T19:58:59.377654+0000","last_peered":"2023-07-06T19:58:59.377654+0000","last_clean":"2023-07-06T19:58:59.377654+0000","last_became_active":"2023-07-06T19:58:53.749360+0000","last_became_peered":"2023-07-06T19:58:53.749360+0000","last_unstale":"2023-07-06T19:58:59.377654+0000","last_undegraded":"2023-07-06T19:58:59.377654+0000","last_fullsized":"2023-07-06T19:58:59.377654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:52:07.484161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376759+0000","last_change":"2023-07-06T19:58:57.789615+0000","last_active":"2023-07-06T19:58:59.376759+0000","last_peered":"2023-07-06T19:58:59.376759+0000","last_clean":"2023-07-06T19:58:59.376759+0000","last_became_active":"2023-07-06T19:58:57.789210+0000","last_became_peered":"2023-07-06T19:58:57.789210+0000","last_unstale":"2023-07-06T19:58:59.376759+0000","last_undegraded":"2023-07-06T19:58:59.376759+0000","last_fullsized":"2023-07-06T19:58:59.376759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:43:41.842113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377561+0000","last_change":"2023-07-06T19:58:52.749215+0000","last_active":"2023-07-06T19:58:59.377561+0000","last_peered":"2023-07-06T19:58:59.377561+0000","last_clean":"2023-07-06T19:58:59.377561+0000","last_became_active":"2023-07-06T19:58:52.748873+0000","last_became_peered":"2023-07-06T19:58:52.748873+0000","last_unstale":"2023-07-06T19:58:59.377561+0000","last_undegraded":"2023-07-06T19:58:59.377561+0000","last_fullsized":"2023-07-06T19:58:59.377561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:01:34.409863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376989+0000","last_change":"2023-07-06T19:58:53.750239+0000","last_active":"2023-07-06T19:58:59.376989+0000","last_peered":"2023-07-06T19:58:59.376989+0000","last_clean":"2023-07-06T19:58:59.376989+0000","last_became_active":"2023-07-06T19:58:53.749937+0000","last_became_peered":"2023-07-06T19:58:53.749937+0000","last_unstale":"2023-07-06T19:58:59.376989+0000","last_undegraded":"2023-07-06T19:58:59.376989+0000","last_fullsized":"2023-07-06T19:58:59.376989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:36:41.784617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782718+0000","last_change":"2023-07-06T19:58:57.793838+0000","last_active":"2023-07-06T19:58:58.782718+0000","last_peered":"2023-07-06T19:58:58.782718+0000","last_clean":"2023-07-06T19:58:58.782718+0000","last_became_active":"2023-07-06T19:58:57.790467+0000","last_became_peered":"2023-07-06T19:58:57.790467+0000","last_unstale":"2023-07-06T19:58:58.782718+0000","last_undegraded":"2023-07-06T19:58:58.782718+0000","last_fullsized":"2023-07-06T19:58:58.782718+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:58:24.336299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378755+0000","last_change":"2023-07-06T19:58:52.745091+0000","last_active":"2023-07-06T19:58:59.378755+0000","last_peered":"2023-07-06T19:58:59.378755+0000","last_clean":"2023-07-06T19:58:59.378755+0000","last_became_active":"2023-07-06T19:58:52.744779+0000","last_became_peered":"2023-07-06T19:58:52.744779+0000","last_unstale":"2023-07-06T19:58:59.378755+0000","last_undegraded":"2023-07-06T19:58:59.378755+0000","last_fullsized":"2023-07-06T19:58:59.378755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:36:40.777030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377012+0000","last_change":"2023-07-06T19:58:53.756293+0000","last_active":"2023-07-06T19:58:59.377012+0000","last_peered":"2023-07-06T19:58:59.377012+0000","last_clean":"2023-07-06T19:58:59.377012+0000","last_became_active":"2023-07-06T19:58:53.750936+0000","last_became_peered":"2023-07-06T19:58:53.750936+0000","last_unstale":"2023-07-06T19:58:59.377012+0000","last_undegraded":"2023-07-06T19:58:59.377012+0000","last_fullsized":"2023-07-06T19:58:59.377012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:37:12.135763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783921+0000","last_change":"2023-07-06T19:58:53.749882+0000","last_active":"2023-07-06T19:58:58.783921+0000","last_peered":"2023-07-06T19:58:58.783921+0000","last_clean":"2023-07-06T19:58:58.783921+0000","last_became_active":"2023-07-06T19:58:53.749571+0000","last_became_peered":"2023-07-06T19:58:53.749571+0000","last_unstale":"2023-07-06T19:58:58.783921+0000","last_undegraded":"2023-07-06T19:58:58.783921+0000","last_fullsized":"2023-07-06T19:58:58.783921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:35:07.767106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377264+0000","last_change":"2023-07-06T19:58:53.761493+0000","last_active":"2023-07-06T19:58:59.377264+0000","last_peered":"2023-07-06T19:58:59.377264+0000","last_clean":"2023-07-06T19:58:59.377264+0000","last_became_active":"2023-07-06T19:58:53.759928+0000","last_became_peered":"2023-07-06T19:58:53.759928+0000","last_unstale":"2023-07-06T19:58:59.377264+0000","last_undegraded":"2023-07-06T19:58:59.377264+0000","last_fullsized":"2023-07-06T19:58:59.377264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:31:43.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378108+0000","last_change":"2023-07-06T19:58:53.756852+0000","last_active":"2023-07-06T19:58:59.378108+0000","last_peered":"2023-07-06T19:58:59.378108+0000","last_clean":"2023-07-06T19:58:59.378108+0000","last_became_active":"2023-07-06T19:58:53.751349+0000","last_became_peered":"2023-07-06T19:58:53.751349+0000","last_unstale":"2023-07-06T19:58:59.378108+0000","last_undegraded":"2023-07-06T19:58:59.378108+0000","last_fullsized":"2023-07-06T19:58:59.378108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:00:07.931135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377953+0000","last_change":"2023-07-06T19:58:53.766577+0000","last_active":"2023-07-06T19:58:59.377953+0000","last_peered":"2023-07-06T19:58:59.377953+0000","last_clean":"2023-07-06T19:58:59.377953+0000","last_became_active":"2023-07-06T19:58:53.766262+0000","last_became_peered":"2023-07-06T19:58:53.766262+0000","last_unstale":"2023-07-06T19:58:59.377953+0000","last_undegraded":"2023-07-06T19:58:59.377953+0000","last_fullsized":"2023-07-06T19:58:59.377953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:37:12.135763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783011+0000","last_change":"2023-07-06T19:58:53.756981+0000","last_active":"2023-07-06T19:58:58.783011+0000","last_peered":"2023-07-06T19:58:58.783011+0000","last_clean":"2023-07-06T19:58:58.783011+0000","last_became_active":"2023-07-06T19:58:53.756728+0000","last_became_peered":"2023-07-06T19:58:53.756728+0000","last_unstale":"2023-07-06T19:58:58.783011+0000","last_undegraded":"2023-07-06T19:58:58.783011+0000","last_fullsized":"2023-07-06T19:58:58.783011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:39:05.600911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":913408,"data_stored":714279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":888832,"data_stored":710851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":123751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T19:59:24.086 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T19:59:24.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.212+0000 7f03bb39f700 1 Processor -- start 2023-07-06T19:59:24.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.212+0000 7f03bb39f700 1 -- start start 2023-07-06T19:59:24.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.213+0000 7f03bb39f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f03b4159ea0 0x7f03b40caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:24.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.213+0000 7f03bb39f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03b415a270 0x7f03b406ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:24.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.213+0000 7f03bb39f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b4070900 con 0x7f03b40704a0 2023-07-06T19:59:24.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.213+0000 7f03bb39f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03b40d00f0 con 0x7f03b4159ea0 2023-07-06T19:59:24.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.213+0000 7f03bb39f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b40cc900 con 0x7f03b415a270 2023-07-06T19:59:24.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.213+0000 7f03ba39d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f03b4159ea0 0x7f03b40caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:24.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.213+0000 7f03bab9e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f03b40704a0 0x7f03b406dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60508/0 (socket says 172.21.15.6:60508) 2023-07-06T19:59:24.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.213+0000 7f03bab9e700 1 -- 172.21.15.6:0/681777617 learned_addr learned my addr 172.21.15.6:0/681777617 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:24.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.213+0000 7f03b9b9c700 1 --2- 172.21.15.6:0/681777617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03b415a270 0x7f03b406ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:24.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.213+0000 7f03ba39d700 1 -- 172.21.15.6:0/681777617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03b415a270 msgr2=0x7f03b406ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:24.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.213+0000 7f03ba39d700 1 --2- 172.21.15.6:0/681777617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03b415a270 0x7f03b406ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:24.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.213+0000 7f03ba39d700 1 -- 172.21.15.6:0/681777617 >> v1:172.21.15.6:6789/0 conn(0x7f03b40704a0 legacy=0x7f03b406dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:24.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.213+0000 7f03ba39d700 1 -- 172.21.15.6:0/681777617 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b40cca90 con 0x7f03b4159ea0 2023-07-06T19:59:24.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.213+0000 7f03ba39d700 1 --2- 172.21.15.6:0/681777617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b4159ea0 0x7f03b40caf30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f03b0009840 tx=0x7f03b0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45245783954ae408 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:24.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.214+0000 7f03b939b700 1 -- 172.21.15.6:0/681777617 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b0011830 con 0x7f03b4159ea0 2023-07-06T19:59:24.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.214+0000 7f03b939b700 1 -- 172.21.15.6:0/681777617 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b0011990 con 0x7f03b4159ea0 2023-07-06T19:59:24.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.214+0000 7f03b939b700 1 -- 172.21.15.6:0/681777617 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b0011d20 con 0x7f03b4159ea0 2023-07-06T19:59:24.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.214+0000 7f03bb39f700 1 -- 172.21.15.6:0/681777617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b4159ea0 msgr2=0x7f03b40caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:24.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.214+0000 7f03bb39f700 1 --2- 172.21.15.6:0/681777617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b4159ea0 0x7f03b40caf30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f03b0009840 tx=0x7f03b0009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:24.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.214+0000 7f03bb39f700 1 -- 172.21.15.6:0/681777617 shutdown_connections 2023-07-06T19:59:24.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.214+0000 7f03bb39f700 1 --2- 172.21.15.6:0/681777617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b4159ea0 0x7f03b40caf30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:24.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.214+0000 7f03bb39f700 1 --2- 172.21.15.6:0/681777617 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03b415a270 0x7f03b406ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:24.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.214+0000 7f03bb39f700 1 -- 172.21.15.6:0/681777617 >> 172.21.15.6:0/681777617 conn(0x7f03b40d08e0 msgr2=0x7f03b40d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:24.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.214+0000 7f03bb39f700 1 -- 172.21.15.6:0/681777617 shutdown_connections 2023-07-06T19:59:24.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.214+0000 7f03bb39f700 1 -- 172.21.15.6:0/681777617 wait complete. 2023-07-06T19:59:24.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.216+0000 7f03bb39f700 1 Processor -- start 2023-07-06T19:59:24.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.216+0000 7f03bb39f700 1 -- start start 2023-07-06T19:59:24.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.216+0000 7f03bb39f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b40704a0 0x7f03b406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:24.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.216+0000 7f03bb39f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03b4159ea0 0x7f03b4156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:24.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.216+0000 7f03bb39f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03b415a270 0x7f03b41564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:24.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.216+0000 7f03bb39f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b41569f0 con 0x7f03b40704a0 2023-07-06T19:59:24.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.216+0000 7f03bb39f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b406e860 con 0x7f03b4159ea0 2023-07-06T19:59:24.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.216+0000 7f03bb39f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b406dfc0 con 0x7f03b415a270 2023-07-06T19:59:24.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.216+0000 7f03ba39d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b40704a0 0x7f03b406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:24.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.216+0000 7f03ba39d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b40704a0 0x7f03b406d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59302/0 (socket says 172.21.15.6:59302) 2023-07-06T19:59:24.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.216+0000 7f03ba39d700 1 -- 172.21.15.6:0/3012047128 learned_addr learned my addr 172.21.15.6:0/3012047128 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:24.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.217+0000 7f03ba39d700 1 -- 172.21.15.6:0/3012047128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03b415a270 msgr2=0x7f03b41564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:24.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.217+0000 7f03bab9e700 1 --2- 172.21.15.6:0/3012047128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03b415a270 0x7f03b41564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:24.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.217+0000 7f03b9b9c700 1 --2- 172.21.15.6:0/3012047128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03b4159ea0 0x7f03b4156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:24.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.217+0000 7f03ba39d700 1 --2- 172.21.15.6:0/3012047128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03b415a270 0x7f03b41564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:24.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.217+0000 7f03ba39d700 1 -- 172.21.15.6:0/3012047128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03b4159ea0 msgr2=0x7f03b4156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:24.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.217+0000 7f03ba39d700 1 --2- 172.21.15.6:0/3012047128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03b4159ea0 0x7f03b4156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:24.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.217+0000 7f03ba39d700 1 -- 172.21.15.6:0/3012047128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b00094a0 con 0x7f03b40704a0 2023-07-06T19:59:24.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.217+0000 7f03b9b9c700 1 --2- 172.21.15.6:0/3012047128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03b4159ea0 0x7f03b4156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:24.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.217+0000 7f03ba39d700 1 --2- 172.21.15.6:0/3012047128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b40704a0 0x7f03b406d9e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f03b00090b0 tx=0x7f03b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:24.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.217+0000 7f03aaffd700 1 -- 172.21.15.6:0/3012047128 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b00036a0 con 0x7f03b40704a0 2023-07-06T19:59:24.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.217+0000 7f03aaffd700 1 -- 172.21.15.6:0/3012047128 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03b001f070 con 0x7f03b40704a0 2023-07-06T19:59:24.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.217+0000 7f03bb39f700 1 -- 172.21.15.6:0/3012047128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b406e2a0 con 0x7f03b40704a0 2023-07-06T19:59:24.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.217+0000 7f03aaffd700 1 -- 172.21.15.6:0/3012047128 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03b0003a40 con 0x7f03b40704a0 2023-07-06T19:59:24.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.217+0000 7f03bb39f700 1 -- 172.21.15.6:0/3012047128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b415a750 con 0x7f03b40704a0 2023-07-06T19:59:24.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.218+0000 7f03bb39f700 1 -- 172.21.15.6:0/3012047128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b404eb90 con 0x7f03b40704a0 2023-07-06T19:59:24.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.219+0000 7f03aaffd700 1 -- 172.21.15.6:0/3012047128 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f03b0003ba0 con 0x7f03b40704a0 2023-07-06T19:59:24.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.219+0000 7f03aaffd700 1 --2- 172.21.15.6:0/3012047128 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f039806ace0 0x7f039806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:24.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.219+0000 7f03aaffd700 1 -- 172.21.15.6:0/3012047128 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f03b0021070 con 0x7f03b40704a0 2023-07-06T19:59:24.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.219+0000 7f03b9b9c700 1 --2- 172.21.15.6:0/3012047128 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f039806ace0 0x7f039806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:24.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.220+0000 7f03b9b9c700 1 --2- 172.21.15.6:0/3012047128 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f039806ace0 0x7f039806d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f03a4009a00 tx=0x7f03a4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:24.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.224+0000 7f03aaffd700 1 -- 172.21.15.6:0/3012047128 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f03b0055f40 con 0x7f03b40704a0 2023-07-06T19:59:24.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.417+0000 7f03bb39f700 1 -- 172.21.15.6:0/3012047128 --> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f03b415e980 con 0x7f039806ace0 2023-07-06T19:59:24.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.427+0000 7f03aaffd700 1 -- 172.21.15.6:0/3012047128 <== mgr.4110 v2:172.21.15.6:6832/201543369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367320 (secure 0 0 0) 0x7f03a4009610 con 0x7f039806ace0 2023-07-06T19:59:24.430 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:24.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.430+0000 7f03bb39f700 1 -- 172.21.15.6:0/3012047128 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f039806ace0 msgr2=0x7f039806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:24.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.430+0000 7f03bb39f700 1 --2- 172.21.15.6:0/3012047128 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f039806ace0 0x7f039806d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f03a4009a00 tx=0x7f03a4008040 comp rx=0 tx=0).stop 2023-07-06T19:59:24.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.430+0000 7f03bb39f700 1 -- 172.21.15.6:0/3012047128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b40704a0 msgr2=0x7f03b406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:24.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.430+0000 7f03bb39f700 1 --2- 172.21.15.6:0/3012047128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b40704a0 0x7f03b406d9e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f03b00090b0 tx=0x7f03b0004750 comp rx=0 tx=0).stop 2023-07-06T19:59:24.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.430+0000 7f03bb39f700 1 -- 172.21.15.6:0/3012047128 shutdown_connections 2023-07-06T19:59:24.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.430+0000 7f03bb39f700 1 --2- 172.21.15.6:0/3012047128 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f039806ace0 0x7f039806d190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:24.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.430+0000 7f03bb39f700 1 --2- 172.21.15.6:0/3012047128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03b40704a0 0x7f03b406d9e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:24.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.430+0000 7f03bb39f700 1 --2- 172.21.15.6:0/3012047128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03b415a270 0x7f03b41564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:24.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.430+0000 7f03bb39f700 1 --2- 172.21.15.6:0/3012047128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03b4159ea0 0x7f03b4156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:24.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.430+0000 7f03bb39f700 1 -- 172.21.15.6:0/3012047128 >> 172.21.15.6:0/3012047128 conn(0x7f03b40d08e0 msgr2=0x7f03b40b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:24.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.430+0000 7f03bb39f700 1 -- 172.21.15.6:0/3012047128 shutdown_connections 2023-07-06T19:59:24.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.430+0000 7f03bb39f700 1 -- 172.21.15.6:0/3012047128 wait complete. 2023-07-06T19:59:24.442 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-06T19:59:24.452 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-07-06T19:59:22.720069+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219112,"kb_used_data":3496,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755608,"statfs":{"total":773094113280,"available":772869742592,"internally_reserved":0,"allocated":3579904,"data_stored":2149128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004077"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376670+0000","last_change":"2023-07-06T19:58:53.761270+0000","last_active":"2023-07-06T19:58:59.376670+0000","last_peered":"2023-07-06T19:58:59.376670+0000","last_clean":"2023-07-06T19:58:59.376670+0000","last_became_active":"2023-07-06T19:58:53.760980+0000","last_became_peered":"2023-07-06T19:58:53.760980+0000","last_unstale":"2023-07-06T19:58:59.376670+0000","last_undegraded":"2023-07-06T19:58:59.376670+0000","last_fullsized":"2023-07-06T19:58:59.376670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:01:18.056559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782312+0000","last_change":"2023-07-06T19:58:53.753947+0000","last_active":"2023-07-06T19:58:58.782312+0000","last_peered":"2023-07-06T19:58:58.782312+0000","last_clean":"2023-07-06T19:58:58.782312+0000","last_became_active":"2023-07-06T19:58:53.753672+0000","last_became_peered":"2023-07-06T19:58:53.753672+0000","last_unstale":"2023-07-06T19:58:58.782312+0000","last_undegraded":"2023-07-06T19:58:58.782312+0000","last_fullsized":"2023-07-06T19:58:58.782312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:39:21.484949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378490+0000","last_change":"2023-07-06T19:58:53.757466+0000","last_active":"2023-07-06T19:58:59.378490+0000","last_peered":"2023-07-06T19:58:59.378490+0000","last_clean":"2023-07-06T19:58:59.378490+0000","last_became_active":"2023-07-06T19:58:53.757125+0000","last_became_peered":"2023-07-06T19:58:53.757125+0000","last_unstale":"2023-07-06T19:58:59.378490+0000","last_undegraded":"2023-07-06T19:58:59.378490+0000","last_fullsized":"2023-07-06T19:58:59.378490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:52:06.851223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783173+0000","last_change":"2023-07-06T19:58:53.752337+0000","last_active":"2023-07-06T19:58:58.783173+0000","last_peered":"2023-07-06T19:58:58.783173+0000","last_clean":"2023-07-06T19:58:58.783173+0000","last_became_active":"2023-07-06T19:58:53.752006+0000","last_became_peered":"2023-07-06T19:58:53.752006+0000","last_unstale":"2023-07-06T19:58:58.783173+0000","last_undegraded":"2023-07-06T19:58:58.783173+0000","last_fullsized":"2023-07-06T19:58:58.783173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:04:50.697845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378401+0000","last_change":"2023-07-06T19:58:53.761648+0000","last_active":"2023-07-06T19:58:59.378401+0000","last_peered":"2023-07-06T19:58:59.378401+0000","last_clean":"2023-07-06T19:58:59.378401+0000","last_became_active":"2023-07-06T19:58:53.760919+0000","last_became_peered":"2023-07-06T19:58:53.760919+0000","last_unstale":"2023-07-06T19:58:59.378401+0000","last_undegraded":"2023-07-06T19:58:59.378401+0000","last_fullsized":"2023-07-06T19:58:59.378401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:54:30.126613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378278+0000","last_change":"2023-07-06T19:58:53.757513+0000","last_active":"2023-07-06T19:58:59.378278+0000","last_peered":"2023-07-06T19:58:59.378278+0000","last_clean":"2023-07-06T19:58:59.378278+0000","last_became_active":"2023-07-06T19:58:53.757153+0000","last_became_peered":"2023-07-06T19:58:53.757153+0000","last_unstale":"2023-07-06T19:58:59.378278+0000","last_undegraded":"2023-07-06T19:58:59.378278+0000","last_fullsized":"2023-07-06T19:58:59.378278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:08:34.198031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378467+0000","last_change":"2023-07-06T19:58:53.754935+0000","last_active":"2023-07-06T19:58:59.378467+0000","last_peered":"2023-07-06T19:58:59.378467+0000","last_clean":"2023-07-06T19:58:59.378467+0000","last_became_active":"2023-07-06T19:58:53.754471+0000","last_became_peered":"2023-07-06T19:58:53.754471+0000","last_unstale":"2023-07-06T19:58:59.378467+0000","last_undegraded":"2023-07-06T19:58:59.378467+0000","last_fullsized":"2023-07-06T19:58:59.378467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:31:43.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.781819+0000","last_change":"2023-07-06T19:58:53.741003+0000","last_active":"2023-07-06T19:58:58.781819+0000","last_peered":"2023-07-06T19:58:58.781819+0000","last_clean":"2023-07-06T19:58:58.781819+0000","last_became_active":"2023-07-06T19:58:53.740713+0000","last_became_peered":"2023-07-06T19:58:53.740713+0000","last_unstale":"2023-07-06T19:58:58.781819+0000","last_undegraded":"2023-07-06T19:58:58.781819+0000","last_fullsized":"2023-07-06T19:58:58.781819+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:39:05.600911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378417+0000","last_change":"2023-07-06T19:58:53.760616+0000","last_active":"2023-07-06T19:58:59.378417+0000","last_peered":"2023-07-06T19:58:59.378417+0000","last_clean":"2023-07-06T19:58:59.378417+0000","last_became_active":"2023-07-06T19:58:53.760325+0000","last_became_peered":"2023-07-06T19:58:53.760325+0000","last_unstale":"2023-07-06T19:58:59.378417+0000","last_undegraded":"2023-07-06T19:58:59.378417+0000","last_fullsized":"2023-07-06T19:58:59.378417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:08:51.828984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782658+0000","last_change":"2023-07-06T19:58:53.755075+0000","last_active":"2023-07-06T19:58:58.782658+0000","last_peered":"2023-07-06T19:58:58.782658+0000","last_clean":"2023-07-06T19:58:58.782658+0000","last_became_active":"2023-07-06T19:58:53.754806+0000","last_became_peered":"2023-07-06T19:58:53.754806+0000","last_unstale":"2023-07-06T19:58:58.782658+0000","last_undegraded":"2023-07-06T19:58:58.782658+0000","last_fullsized":"2023-07-06T19:58:58.782658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:36:41.784617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378084+0000","last_change":"2023-07-06T19:58:53.757287+0000","last_active":"2023-07-06T19:58:59.378084+0000","last_peered":"2023-07-06T19:58:59.378084+0000","last_clean":"2023-07-06T19:58:59.378084+0000","last_became_active":"2023-07-06T19:58:53.756825+0000","last_became_peered":"2023-07-06T19:58:53.756825+0000","last_unstale":"2023-07-06T19:58:59.378084+0000","last_undegraded":"2023-07-06T19:58:59.378084+0000","last_fullsized":"2023-07-06T19:58:59.378084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:32:20.366406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377664+0000","last_change":"2023-07-06T19:58:53.745164+0000","last_active":"2023-07-06T19:58:59.377664+0000","last_peered":"2023-07-06T19:58:59.377664+0000","last_clean":"2023-07-06T19:58:59.377664+0000","last_became_active":"2023-07-06T19:58:53.744861+0000","last_became_peered":"2023-07-06T19:58:53.744861+0000","last_unstale":"2023-07-06T19:58:59.377664+0000","last_undegraded":"2023-07-06T19:58:59.377664+0000","last_fullsized":"2023-07-06T19:58:59.377664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:06:50.770125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377329+0000","last_change":"2023-07-06T19:58:53.766071+0000","last_active":"2023-07-06T19:58:59.377329+0000","last_peered":"2023-07-06T19:58:59.377329+0000","last_clean":"2023-07-06T19:58:59.377329+0000","last_became_active":"2023-07-06T19:58:53.765744+0000","last_became_peered":"2023-07-06T19:58:53.765744+0000","last_unstale":"2023-07-06T19:58:59.377329+0000","last_undegraded":"2023-07-06T19:58:59.377329+0000","last_fullsized":"2023-07-06T19:58:59.377329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:31:39.273909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782018+0000","last_change":"2023-07-06T19:58:53.743381+0000","last_active":"2023-07-06T19:58:58.782018+0000","last_peered":"2023-07-06T19:58:58.782018+0000","last_clean":"2023-07-06T19:58:58.782018+0000","last_became_active":"2023-07-06T19:58:53.743098+0000","last_became_peered":"2023-07-06T19:58:53.743098+0000","last_unstale":"2023-07-06T19:58:58.782018+0000","last_undegraded":"2023-07-06T19:58:58.782018+0000","last_fullsized":"2023-07-06T19:58:58.782018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:00:39.522945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377130+0000","last_change":"2023-07-06T19:58:53.754741+0000","last_active":"2023-07-06T19:58:59.377130+0000","last_peered":"2023-07-06T19:58:59.377130+0000","last_clean":"2023-07-06T19:58:59.377130+0000","last_became_active":"2023-07-06T19:58:53.754089+0000","last_became_peered":"2023-07-06T19:58:53.754089+0000","last_unstale":"2023-07-06T19:58:59.377130+0000","last_undegraded":"2023-07-06T19:58:59.377130+0000","last_fullsized":"2023-07-06T19:58:59.377130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:40:15.607877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377294+0000","last_change":"2023-07-06T19:58:53.758130+0000","last_active":"2023-07-06T19:58:59.377294+0000","last_peered":"2023-07-06T19:58:59.377294+0000","last_clean":"2023-07-06T19:58:59.377294+0000","last_became_active":"2023-07-06T19:58:53.757837+0000","last_became_peered":"2023-07-06T19:58:53.757837+0000","last_unstale":"2023-07-06T19:58:59.377294+0000","last_undegraded":"2023-07-06T19:58:59.377294+0000","last_fullsized":"2023-07-06T19:58:59.377294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:12:08.363104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.379057+0000","last_change":"2023-07-06T19:58:53.760750+0000","last_active":"2023-07-06T19:58:59.379057+0000","last_peered":"2023-07-06T19:58:59.379057+0000","last_clean":"2023-07-06T19:58:59.379057+0000","last_became_active":"2023-07-06T19:58:53.760484+0000","last_became_peered":"2023-07-06T19:58:53.760484+0000","last_unstale":"2023-07-06T19:58:59.379057+0000","last_undegraded":"2023-07-06T19:58:59.379057+0000","last_fullsized":"2023-07-06T19:58:59.379057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:55:10.096543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378425+0000","last_change":"2023-07-06T19:58:53.742270+0000","last_active":"2023-07-06T19:58:59.378425+0000","last_peered":"2023-07-06T19:58:59.378425+0000","last_clean":"2023-07-06T19:58:59.378425+0000","last_became_active":"2023-07-06T19:58:53.741974+0000","last_became_peered":"2023-07-06T19:58:53.741974+0000","last_unstale":"2023-07-06T19:58:59.378425+0000","last_undegraded":"2023-07-06T19:58:59.378425+0000","last_fullsized":"2023-07-06T19:58:59.378425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:49:02.964314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377806+0000","last_change":"2023-07-06T19:58:53.750109+0000","last_active":"2023-07-06T19:58:59.377806+0000","last_peered":"2023-07-06T19:58:59.377806+0000","last_clean":"2023-07-06T19:58:59.377806+0000","last_became_active":"2023-07-06T19:58:53.749826+0000","last_became_peered":"2023-07-06T19:58:53.749826+0000","last_unstale":"2023-07-06T19:58:59.377806+0000","last_undegraded":"2023-07-06T19:58:59.377806+0000","last_fullsized":"2023-07-06T19:58:59.377806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:36:45.949174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378110+0000","last_change":"2023-07-06T19:58:53.757988+0000","last_active":"2023-07-06T19:58:59.378110+0000","last_peered":"2023-07-06T19:58:59.378110+0000","last_clean":"2023-07-06T19:58:59.378110+0000","last_became_active":"2023-07-06T19:58:53.751497+0000","last_became_peered":"2023-07-06T19:58:53.751497+0000","last_unstale":"2023-07-06T19:58:59.378110+0000","last_undegraded":"2023-07-06T19:58:59.378110+0000","last_fullsized":"2023-07-06T19:58:59.378110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:27:11.308820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377168+0000","last_change":"2023-07-06T19:58:53.765678+0000","last_active":"2023-07-06T19:58:59.377168+0000","last_peered":"2023-07-06T19:58:59.377168+0000","last_clean":"2023-07-06T19:58:59.377168+0000","last_became_active":"2023-07-06T19:58:53.765413+0000","last_became_peered":"2023-07-06T19:58:53.765413+0000","last_unstale":"2023-07-06T19:58:59.377168+0000","last_undegraded":"2023-07-06T19:58:59.377168+0000","last_fullsized":"2023-07-06T19:58:59.377168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:47:30.856849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377784+0000","last_change":"2023-07-06T19:58:53.755073+0000","last_active":"2023-07-06T19:58:59.377784+0000","last_peered":"2023-07-06T19:58:59.377784+0000","last_clean":"2023-07-06T19:58:59.377784+0000","last_became_active":"2023-07-06T19:58:53.754882+0000","last_became_peered":"2023-07-06T19:58:53.754882+0000","last_unstale":"2023-07-06T19:58:59.377784+0000","last_undegraded":"2023-07-06T19:58:59.377784+0000","last_fullsized":"2023-07-06T19:58:59.377784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:39:05.600911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377911+0000","last_change":"2023-07-06T19:58:53.758162+0000","last_active":"2023-07-06T19:58:59.377911+0000","last_peered":"2023-07-06T19:58:59.377911+0000","last_clean":"2023-07-06T19:58:59.377911+0000","last_became_active":"2023-07-06T19:58:53.753528+0000","last_became_peered":"2023-07-06T19:58:53.753528+0000","last_unstale":"2023-07-06T19:58:59.377911+0000","last_undegraded":"2023-07-06T19:58:59.377911+0000","last_fullsized":"2023-07-06T19:58:59.377911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:43:37.810101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376985+0000","last_change":"2023-07-06T19:58:53.765139+0000","last_active":"2023-07-06T19:58:59.376985+0000","last_peered":"2023-07-06T19:58:59.376985+0000","last_clean":"2023-07-06T19:58:59.376985+0000","last_became_active":"2023-07-06T19:58:53.764887+0000","last_became_peered":"2023-07-06T19:58:53.764887+0000","last_unstale":"2023-07-06T19:58:59.376985+0000","last_undegraded":"2023-07-06T19:58:59.376985+0000","last_fullsized":"2023-07-06T19:58:59.376985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:06:38.381299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782849+0000","last_change":"2023-07-06T19:58:53.750438+0000","last_active":"2023-07-06T19:58:58.782849+0000","last_peered":"2023-07-06T19:58:58.782849+0000","last_clean":"2023-07-06T19:58:58.782849+0000","last_became_active":"2023-07-06T19:58:53.750169+0000","last_became_peered":"2023-07-06T19:58:53.750169+0000","last_unstale":"2023-07-06T19:58:58.782849+0000","last_undegraded":"2023-07-06T19:58:58.782849+0000","last_fullsized":"2023-07-06T19:58:58.782849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:14:20.481463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783170+0000","last_change":"2023-07-06T19:58:53.741853+0000","last_active":"2023-07-06T19:58:58.783170+0000","last_peered":"2023-07-06T19:58:58.783170+0000","last_clean":"2023-07-06T19:58:58.783170+0000","last_became_active":"2023-07-06T19:58:53.741559+0000","last_became_peered":"2023-07-06T19:58:53.741559+0000","last_unstale":"2023-07-06T19:58:58.783170+0000","last_undegraded":"2023-07-06T19:58:58.783170+0000","last_fullsized":"2023-07-06T19:58:58.783170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:06:38.381299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783184+0000","last_change":"2023-07-06T19:58:53.759862+0000","last_active":"2023-07-06T19:58:58.783184+0000","last_peered":"2023-07-06T19:58:58.783184+0000","last_clean":"2023-07-06T19:58:58.783184+0000","last_became_active":"2023-07-06T19:58:53.758903+0000","last_became_peered":"2023-07-06T19:58:53.758903+0000","last_unstale":"2023-07-06T19:58:58.783184+0000","last_undegraded":"2023-07-06T19:58:58.783184+0000","last_fullsized":"2023-07-06T19:58:58.783184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:31:43.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378789+0000","last_change":"2023-07-06T19:58:57.789865+0000","last_active":"2023-07-06T19:58:59.378789+0000","last_peered":"2023-07-06T19:58:59.378789+0000","last_clean":"2023-07-06T19:58:59.378789+0000","last_became_active":"2023-07-06T19:58:57.788796+0000","last_became_peered":"2023-07-06T19:58:57.788796+0000","last_unstale":"2023-07-06T19:58:59.378789+0000","last_undegraded":"2023-07-06T19:58:59.378789+0000","last_fullsized":"2023-07-06T19:58:59.378789+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:40:09.950829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377817+0000","last_change":"2023-07-06T19:58:52.747722+0000","last_active":"2023-07-06T19:58:59.377817+0000","last_peered":"2023-07-06T19:58:59.377817+0000","last_clean":"2023-07-06T19:58:59.377817+0000","last_became_active":"2023-07-06T19:58:52.747373+0000","last_became_peered":"2023-07-06T19:58:52.747373+0000","last_unstale":"2023-07-06T19:58:59.377817+0000","last_undegraded":"2023-07-06T19:58:59.377817+0000","last_fullsized":"2023-07-06T19:58:59.377817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:52:21.260915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377423+0000","last_change":"2023-07-06T19:58:53.760791+0000","last_active":"2023-07-06T19:58:59.377423+0000","last_peered":"2023-07-06T19:58:59.377423+0000","last_clean":"2023-07-06T19:58:59.377423+0000","last_became_active":"2023-07-06T19:58:53.760496+0000","last_became_peered":"2023-07-06T19:58:53.760496+0000","last_unstale":"2023-07-06T19:58:59.377423+0000","last_undegraded":"2023-07-06T19:58:59.377423+0000","last_fullsized":"2023-07-06T19:58:59.377423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:55:35.512797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783686+0000","last_change":"2023-07-06T19:58:57.791584+0000","last_active":"2023-07-06T19:58:58.783686+0000","last_peered":"2023-07-06T19:58:58.783686+0000","last_clean":"2023-07-06T19:58:58.783686+0000","last_became_active":"2023-07-06T19:58:57.791118+0000","last_became_peered":"2023-07-06T19:58:57.791118+0000","last_unstale":"2023-07-06T19:58:58.783686+0000","last_undegraded":"2023-07-06T19:58:58.783686+0000","last_fullsized":"2023-07-06T19:58:58.783686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:22:47.617986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782223+0000","last_change":"2023-07-06T19:58:52.750959+0000","last_active":"2023-07-06T19:58:58.782223+0000","last_peered":"2023-07-06T19:58:58.782223+0000","last_clean":"2023-07-06T19:58:58.782223+0000","last_became_active":"2023-07-06T19:58:52.750645+0000","last_became_peered":"2023-07-06T19:58:52.750645+0000","last_unstale":"2023-07-06T19:58:58.782223+0000","last_undegraded":"2023-07-06T19:58:58.782223+0000","last_fullsized":"2023-07-06T19:58:58.782223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:56:04.557448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378391+0000","last_change":"2023-07-06T19:58:53.756467+0000","last_active":"2023-07-06T19:58:59.378391+0000","last_peered":"2023-07-06T19:58:59.378391+0000","last_clean":"2023-07-06T19:58:59.378391+0000","last_became_active":"2023-07-06T19:58:53.752938+0000","last_became_peered":"2023-07-06T19:58:53.752938+0000","last_unstale":"2023-07-06T19:58:59.378391+0000","last_undegraded":"2023-07-06T19:58:59.378391+0000","last_fullsized":"2023-07-06T19:58:59.378391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:40:15.607877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378564+0000","last_change":"2023-07-06T19:58:57.790380+0000","last_active":"2023-07-06T19:58:59.378564+0000","last_peered":"2023-07-06T19:58:59.378564+0000","last_clean":"2023-07-06T19:58:59.378564+0000","last_became_active":"2023-07-06T19:58:57.789989+0000","last_became_peered":"2023-07-06T19:58:57.789989+0000","last_unstale":"2023-07-06T19:58:59.378564+0000","last_undegraded":"2023-07-06T19:58:59.378564+0000","last_fullsized":"2023-07-06T19:58:59.378564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:38:28.294697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376778+0000","last_change":"2023-07-06T19:58:52.747131+0000","last_active":"2023-07-06T19:58:59.376778+0000","last_peered":"2023-07-06T19:58:59.376778+0000","last_clean":"2023-07-06T19:58:59.376778+0000","last_became_active":"2023-07-06T19:58:52.746849+0000","last_became_peered":"2023-07-06T19:58:52.746849+0000","last_unstale":"2023-07-06T19:58:59.376778+0000","last_undegraded":"2023-07-06T19:58:59.376778+0000","last_fullsized":"2023-07-06T19:58:59.376778+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:38:23.255098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783965+0000","last_change":"2023-07-06T19:58:53.752844+0000","last_active":"2023-07-06T19:58:58.783965+0000","last_peered":"2023-07-06T19:58:58.783965+0000","last_clean":"2023-07-06T19:58:58.783965+0000","last_became_active":"2023-07-06T19:58:53.752535+0000","last_became_peered":"2023-07-06T19:58:53.752535+0000","last_unstale":"2023-07-06T19:58:58.783965+0000","last_undegraded":"2023-07-06T19:58:58.783965+0000","last_fullsized":"2023-07-06T19:58:58.783965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:23:37.838134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783216+0000","last_change":"2023-07-06T19:58:57.797542+0000","last_active":"2023-07-06T19:58:58.783216+0000","last_peered":"2023-07-06T19:58:58.783216+0000","last_clean":"2023-07-06T19:58:58.783216+0000","last_became_active":"2023-07-06T19:58:57.794412+0000","last_became_peered":"2023-07-06T19:58:57.794412+0000","last_unstale":"2023-07-06T19:58:58.783216+0000","last_undegraded":"2023-07-06T19:58:58.783216+0000","last_fullsized":"2023-07-06T19:58:58.783216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:04:41.883822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378545+0000","last_change":"2023-07-06T19:58:52.746045+0000","last_active":"2023-07-06T19:58:59.378545+0000","last_peered":"2023-07-06T19:58:59.378545+0000","last_clean":"2023-07-06T19:58:59.378545+0000","last_became_active":"2023-07-06T19:58:52.745753+0000","last_became_peered":"2023-07-06T19:58:52.745753+0000","last_unstale":"2023-07-06T19:58:59.378545+0000","last_undegraded":"2023-07-06T19:58:59.378545+0000","last_fullsized":"2023-07-06T19:58:59.378545+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:39:20.477362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376652+0000","last_change":"2023-07-06T19:58:53.760982+0000","last_active":"2023-07-06T19:58:59.376652+0000","last_peered":"2023-07-06T19:58:59.376652+0000","last_clean":"2023-07-06T19:58:59.376652+0000","last_became_active":"2023-07-06T19:58:53.758282+0000","last_became_peered":"2023-07-06T19:58:53.758282+0000","last_unstale":"2023-07-06T19:58:59.376652+0000","last_undegraded":"2023-07-06T19:58:59.376652+0000","last_fullsized":"2023-07-06T19:58:59.376652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:39:21.484949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376781+0000","last_change":"2023-07-06T19:58:57.790546+0000","last_active":"2023-07-06T19:58:59.376781+0000","last_peered":"2023-07-06T19:58:59.376781+0000","last_clean":"2023-07-06T19:58:59.376781+0000","last_became_active":"2023-07-06T19:58:57.790151+0000","last_became_peered":"2023-07-06T19:58:57.790151+0000","last_unstale":"2023-07-06T19:58:59.376781+0000","last_undegraded":"2023-07-06T19:58:59.376781+0000","last_fullsized":"2023-07-06T19:58:59.376781+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:07.546083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782508+0000","last_change":"2023-07-06T19:58:52.746111+0000","last_active":"2023-07-06T19:58:58.782508+0000","last_peered":"2023-07-06T19:58:58.782508+0000","last_clean":"2023-07-06T19:58:58.782508+0000","last_became_active":"2023-07-06T19:58:52.745886+0000","last_became_peered":"2023-07-06T19:58:52.745886+0000","last_unstale":"2023-07-06T19:58:58.782508+0000","last_undegraded":"2023-07-06T19:58:58.782508+0000","last_fullsized":"2023-07-06T19:58:58.782508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:38:23.255098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376789+0000","last_change":"2023-07-06T19:58:53.748570+0000","last_active":"2023-07-06T19:58:59.376789+0000","last_peered":"2023-07-06T19:58:59.376789+0000","last_clean":"2023-07-06T19:58:59.376789+0000","last_became_active":"2023-07-06T19:58:53.748044+0000","last_became_peered":"2023-07-06T19:58:53.748044+0000","last_unstale":"2023-07-06T19:58:59.376789+0000","last_undegraded":"2023-07-06T19:58:59.376789+0000","last_fullsized":"2023-07-06T19:58:59.376789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:01:56.605555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377868+0000","last_change":"2023-07-06T19:58:57.786412+0000","last_active":"2023-07-06T19:58:59.377868+0000","last_peered":"2023-07-06T19:58:59.377868+0000","last_clean":"2023-07-06T19:58:59.377868+0000","last_became_active":"2023-07-06T19:58:57.785979+0000","last_became_peered":"2023-07-06T19:58:57.785979+0000","last_unstale":"2023-07-06T19:58:59.377868+0000","last_undegraded":"2023-07-06T19:58:59.377868+0000","last_fullsized":"2023-07-06T19:58:59.377868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:34:38.161520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378178+0000","last_change":"2023-07-06T19:58:52.751370+0000","last_active":"2023-07-06T19:58:59.378178+0000","last_peered":"2023-07-06T19:58:59.378178+0000","last_clean":"2023-07-06T19:58:59.378178+0000","last_became_active":"2023-07-06T19:58:52.750871+0000","last_became_peered":"2023-07-06T19:58:52.750871+0000","last_unstale":"2023-07-06T19:58:59.378178+0000","last_undegraded":"2023-07-06T19:58:59.378178+0000","last_fullsized":"2023-07-06T19:58:59.378178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:54:29.119026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783170+0000","last_change":"2023-07-06T19:58:53.749382+0000","last_active":"2023-07-06T19:58:58.783170+0000","last_peered":"2023-07-06T19:58:58.783170+0000","last_clean":"2023-07-06T19:58:58.783170+0000","last_became_active":"2023-07-06T19:58:53.749102+0000","last_became_peered":"2023-07-06T19:58:53.749102+0000","last_unstale":"2023-07-06T19:58:58.783170+0000","last_undegraded":"2023-07-06T19:58:58.783170+0000","last_fullsized":"2023-07-06T19:58:58.783170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:00:39.522945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782423+0000","last_change":"2023-07-06T19:58:57.788620+0000","last_active":"2023-07-06T19:58:58.782423+0000","last_peered":"2023-07-06T19:58:58.782423+0000","last_clean":"2023-07-06T19:58:58.782423+0000","last_became_active":"2023-07-06T19:58:57.788179+0000","last_became_peered":"2023-07-06T19:58:57.788179+0000","last_unstale":"2023-07-06T19:58:58.782423+0000","last_undegraded":"2023-07-06T19:58:58.782423+0000","last_fullsized":"2023-07-06T19:58:58.782423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:26:32.189069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:59:09.287689+0000","last_change":"2023-07-06T19:58:52.742265+0000","last_active":"2023-07-06T19:59:09.287689+0000","last_peered":"2023-07-06T19:59:09.287689+0000","last_clean":"2023-07-06T19:59:09.287689+0000","last_became_active":"2023-07-06T19:58:52.741835+0000","last_became_peered":"2023-07-06T19:58:52.741835+0000","last_unstale":"2023-07-06T19:59:09.287689+0000","last_undegraded":"2023-07-06T19:59:09.287689+0000","last_fullsized":"2023-07-06T19:59:09.287689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:02:15.845300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378090+0000","last_change":"2023-07-06T19:58:53.751100+0000","last_active":"2023-07-06T19:58:59.378090+0000","last_peered":"2023-07-06T19:58:59.378090+0000","last_clean":"2023-07-06T19:58:59.378090+0000","last_became_active":"2023-07-06T19:58:53.750777+0000","last_became_peered":"2023-07-06T19:58:53.750777+0000","last_unstale":"2023-07-06T19:58:59.378090+0000","last_undegraded":"2023-07-06T19:58:59.378090+0000","last_fullsized":"2023-07-06T19:58:59.378090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:34:07.170685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783447+0000","last_change":"2023-07-06T19:58:57.787972+0000","last_active":"2023-07-06T19:58:58.783447+0000","last_peered":"2023-07-06T19:58:58.783447+0000","last_clean":"2023-07-06T19:58:58.783447+0000","last_became_active":"2023-07-06T19:58:57.787603+0000","last_became_peered":"2023-07-06T19:58:57.787603+0000","last_unstale":"2023-07-06T19:58:58.783447+0000","last_undegraded":"2023-07-06T19:58:58.783447+0000","last_fullsized":"2023-07-06T19:58:58.783447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:55:39.544808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377410+0000","last_change":"2023-07-06T19:58:52.749256+0000","last_active":"2023-07-06T19:58:59.377410+0000","last_peered":"2023-07-06T19:58:59.377410+0000","last_clean":"2023-07-06T19:58:59.377410+0000","last_became_active":"2023-07-06T19:58:52.748938+0000","last_became_peered":"2023-07-06T19:58:52.748938+0000","last_unstale":"2023-07-06T19:58:59.377410+0000","last_undegraded":"2023-07-06T19:58:59.377410+0000","last_fullsized":"2023-07-06T19:58:59.377410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:38:23.255098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377106+0000","last_change":"2023-07-06T19:58:53.760190+0000","last_active":"2023-07-06T19:58:59.377106+0000","last_peered":"2023-07-06T19:58:59.377106+0000","last_clean":"2023-07-06T19:58:59.377106+0000","last_became_active":"2023-07-06T19:58:53.758351+0000","last_became_peered":"2023-07-06T19:58:53.758351+0000","last_unstale":"2023-07-06T19:58:59.377106+0000","last_undegraded":"2023-07-06T19:58:59.377106+0000","last_fullsized":"2023-07-06T19:58:59.377106+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:54:30.126613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376773+0000","last_change":"2023-07-06T19:58:57.787323+0000","last_active":"2023-07-06T19:58:59.376773+0000","last_peered":"2023-07-06T19:58:59.376773+0000","last_clean":"2023-07-06T19:58:59.376773+0000","last_became_active":"2023-07-06T19:58:57.786685+0000","last_became_peered":"2023-07-06T19:58:57.786685+0000","last_unstale":"2023-07-06T19:58:59.376773+0000","last_undegraded":"2023-07-06T19:58:59.376773+0000","last_fullsized":"2023-07-06T19:58:59.376773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:31:48.633170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377567+0000","last_change":"2023-07-06T19:58:52.746786+0000","last_active":"2023-07-06T19:58:59.377567+0000","last_peered":"2023-07-06T19:58:59.377567+0000","last_clean":"2023-07-06T19:58:59.377567+0000","last_became_active":"2023-07-06T19:58:52.746457+0000","last_became_peered":"2023-07-06T19:58:52.746457+0000","last_unstale":"2023-07-06T19:58:59.377567+0000","last_undegraded":"2023-07-06T19:58:59.377567+0000","last_fullsized":"2023-07-06T19:58:59.377567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:06.187998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782712+0000","last_change":"2023-07-06T19:58:53.760059+0000","last_active":"2023-07-06T19:58:58.782712+0000","last_peered":"2023-07-06T19:58:58.782712+0000","last_clean":"2023-07-06T19:58:58.782712+0000","last_became_active":"2023-07-06T19:58:53.759271+0000","last_became_peered":"2023-07-06T19:58:53.759271+0000","last_unstale":"2023-07-06T19:58:58.782712+0000","last_undegraded":"2023-07-06T19:58:58.782712+0000","last_fullsized":"2023-07-06T19:58:58.782712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:54:30.126613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376813+0000","last_change":"2023-07-06T19:58:57.786715+0000","last_active":"2023-07-06T19:58:59.376813+0000","last_peered":"2023-07-06T19:58:59.376813+0000","last_clean":"2023-07-06T19:58:59.376813+0000","last_became_active":"2023-07-06T19:58:57.786187+0000","last_became_peered":"2023-07-06T19:58:57.786187+0000","last_unstale":"2023-07-06T19:58:59.376813+0000","last_undegraded":"2023-07-06T19:58:59.376813+0000","last_fullsized":"2023-07-06T19:58:59.376813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:41:58.726961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377292+0000","last_change":"2023-07-06T19:58:52.751844+0000","last_active":"2023-07-06T19:58:59.377292+0000","last_peered":"2023-07-06T19:58:59.377292+0000","last_clean":"2023-07-06T19:58:59.377292+0000","last_became_active":"2023-07-06T19:58:52.751507+0000","last_became_peered":"2023-07-06T19:58:52.751507+0000","last_unstale":"2023-07-06T19:58:59.377292+0000","last_undegraded":"2023-07-06T19:58:59.377292+0000","last_fullsized":"2023-07-06T19:58:59.377292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:39:20.477362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378484+0000","last_change":"2023-07-06T19:58:53.760239+0000","last_active":"2023-07-06T19:58:59.378484+0000","last_peered":"2023-07-06T19:58:59.378484+0000","last_clean":"2023-07-06T19:58:59.378484+0000","last_became_active":"2023-07-06T19:58:53.759987+0000","last_became_peered":"2023-07-06T19:58:53.759987+0000","last_unstale":"2023-07-06T19:58:59.378484+0000","last_undegraded":"2023-07-06T19:58:59.378484+0000","last_fullsized":"2023-07-06T19:58:59.378484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:47:30.856849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782048+0000","last_change":"2023-07-06T19:58:57.791677+0000","last_active":"2023-07-06T19:58:58.782048+0000","last_peered":"2023-07-06T19:58:58.782048+0000","last_clean":"2023-07-06T19:58:58.782048+0000","last_became_active":"2023-07-06T19:58:57.791232+0000","last_became_peered":"2023-07-06T19:58:57.791232+0000","last_unstale":"2023-07-06T19:58:58.782048+0000","last_undegraded":"2023-07-06T19:58:58.782048+0000","last_fullsized":"2023-07-06T19:58:58.782048+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:06:42.413310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783606+0000","last_change":"2023-07-06T19:58:52.743480+0000","last_active":"2023-07-06T19:58:58.783606+0000","last_peered":"2023-07-06T19:58:58.783606+0000","last_clean":"2023-07-06T19:58:58.783606+0000","last_became_active":"2023-07-06T19:58:52.742980+0000","last_became_peered":"2023-07-06T19:58:52.742980+0000","last_unstale":"2023-07-06T19:58:58.783606+0000","last_undegraded":"2023-07-06T19:58:58.783606+0000","last_fullsized":"2023-07-06T19:58:58.783606+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:30:09.417733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377140+0000","last_change":"2023-07-06T19:58:53.760648+0000","last_active":"2023-07-06T19:58:59.377140+0000","last_peered":"2023-07-06T19:58:59.377140+0000","last_clean":"2023-07-06T19:58:59.377140+0000","last_became_active":"2023-07-06T19:58:53.760334+0000","last_became_peered":"2023-07-06T19:58:53.760334+0000","last_unstale":"2023-07-06T19:58:59.377140+0000","last_undegraded":"2023-07-06T19:58:59.377140+0000","last_fullsized":"2023-07-06T19:58:59.377140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:55:10.096543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378635+0000","last_change":"2023-07-06T19:58:57.795273+0000","last_active":"2023-07-06T19:58:59.378635+0000","last_peered":"2023-07-06T19:58:59.378635+0000","last_clean":"2023-07-06T19:58:59.378635+0000","last_became_active":"2023-07-06T19:58:57.793041+0000","last_became_peered":"2023-07-06T19:58:57.793041+0000","last_unstale":"2023-07-06T19:58:59.378635+0000","last_undegraded":"2023-07-06T19:58:59.378635+0000","last_fullsized":"2023-07-06T19:58:59.378635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:55:39.544808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377951+0000","last_change":"2023-07-06T19:58:52.749389+0000","last_active":"2023-07-06T19:58:59.377951+0000","last_peered":"2023-07-06T19:58:59.377951+0000","last_clean":"2023-07-06T19:58:59.377951+0000","last_became_active":"2023-07-06T19:58:52.748954+0000","last_became_peered":"2023-07-06T19:58:52.748954+0000","last_unstale":"2023-07-06T19:58:59.377951+0000","last_undegraded":"2023-07-06T19:58:59.377951+0000","last_fullsized":"2023-07-06T19:58:59.377951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:36:40.777030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.781709+0000","last_change":"2023-07-06T19:58:53.750314+0000","last_active":"2023-07-06T19:58:58.781709+0000","last_peered":"2023-07-06T19:58:58.781709+0000","last_clean":"2023-07-06T19:58:58.781709+0000","last_became_active":"2023-07-06T19:58:53.750016+0000","last_became_peered":"2023-07-06T19:58:53.750016+0000","last_unstale":"2023-07-06T19:58:58.781709+0000","last_undegraded":"2023-07-06T19:58:58.781709+0000","last_fullsized":"2023-07-06T19:58:58.781709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:07.195585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376267+0000","last_change":"2023-07-06T19:58:57.783293+0000","last_active":"2023-07-06T19:58:59.376267+0000","last_peered":"2023-07-06T19:58:59.376267+0000","last_clean":"2023-07-06T19:58:59.376267+0000","last_became_active":"2023-07-06T19:58:57.782891+0000","last_became_peered":"2023-07-06T19:58:57.782891+0000","last_unstale":"2023-07-06T19:58:59.376267+0000","last_undegraded":"2023-07-06T19:58:59.376267+0000","last_fullsized":"2023-07-06T19:58:59.376267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:46:14.072294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377762+0000","last_change":"2023-07-06T19:58:52.749788+0000","last_active":"2023-07-06T19:58:59.377762+0000","last_peered":"2023-07-06T19:58:59.377762+0000","last_clean":"2023-07-06T19:58:59.377762+0000","last_became_active":"2023-07-06T19:58:52.749502+0000","last_became_peered":"2023-07-06T19:58:52.749502+0000","last_unstale":"2023-07-06T19:58:59.377762+0000","last_undegraded":"2023-07-06T19:58:59.377762+0000","last_fullsized":"2023-07-06T19:58:59.377762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:41:53.687362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377616+0000","last_change":"2023-07-06T19:58:53.756711+0000","last_active":"2023-07-06T19:58:59.377616+0000","last_peered":"2023-07-06T19:58:59.377616+0000","last_clean":"2023-07-06T19:58:59.377616+0000","last_became_active":"2023-07-06T19:58:53.756385+0000","last_became_peered":"2023-07-06T19:58:53.756385+0000","last_unstale":"2023-07-06T19:58:59.377616+0000","last_undegraded":"2023-07-06T19:58:59.377616+0000","last_fullsized":"2023-07-06T19:58:59.377616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:14:07.791583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377139+0000","last_change":"2023-07-06T19:58:57.786660+0000","last_active":"2023-07-06T19:58:59.377139+0000","last_peered":"2023-07-06T19:58:59.377139+0000","last_clean":"2023-07-06T19:58:59.377139+0000","last_became_active":"2023-07-06T19:58:57.786238+0000","last_became_peered":"2023-07-06T19:58:57.786238+0000","last_unstale":"2023-07-06T19:58:59.377139+0000","last_undegraded":"2023-07-06T19:58:59.377139+0000","last_fullsized":"2023-07-06T19:58:59.377139+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:47:26.705198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378304+0000","last_change":"2023-07-06T19:58:52.751151+0000","last_active":"2023-07-06T19:58:59.378304+0000","last_peered":"2023-07-06T19:58:59.378304+0000","last_clean":"2023-07-06T19:58:59.378304+0000","last_became_active":"2023-07-06T19:58:52.750499+0000","last_became_peered":"2023-07-06T19:58:52.750499+0000","last_unstale":"2023-07-06T19:58:59.378304+0000","last_undegraded":"2023-07-06T19:58:59.378304+0000","last_fullsized":"2023-07-06T19:58:59.378304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:55:09.088956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783436+0000","last_change":"2023-07-06T19:58:53.755226+0000","last_active":"2023-07-06T19:58:58.783436+0000","last_peered":"2023-07-06T19:58:58.783436+0000","last_clean":"2023-07-06T19:58:58.783436+0000","last_became_active":"2023-07-06T19:58:53.754917+0000","last_became_peered":"2023-07-06T19:58:53.754917+0000","last_unstale":"2023-07-06T19:58:58.783436+0000","last_undegraded":"2023-07-06T19:58:58.783436+0000","last_fullsized":"2023-07-06T19:58:58.783436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:32:21.594143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376977+0000","last_change":"2023-07-06T19:58:57.788481+0000","last_active":"2023-07-06T19:58:59.376977+0000","last_peered":"2023-07-06T19:58:59.376977+0000","last_clean":"2023-07-06T19:58:59.376977+0000","last_became_active":"2023-07-06T19:58:57.788042+0000","last_became_peered":"2023-07-06T19:58:57.788042+0000","last_unstale":"2023-07-06T19:58:59.376977+0000","last_undegraded":"2023-07-06T19:58:59.376977+0000","last_fullsized":"2023-07-06T19:58:59.376977+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:12:56.591390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782017+0000","last_change":"2023-07-06T19:58:52.752037+0000","last_active":"2023-07-06T19:58:58.782017+0000","last_peered":"2023-07-06T19:58:58.782017+0000","last_clean":"2023-07-06T19:58:58.782017+0000","last_became_active":"2023-07-06T19:58:52.751743+0000","last_became_peered":"2023-07-06T19:58:52.751743+0000","last_unstale":"2023-07-06T19:58:58.782017+0000","last_undegraded":"2023-07-06T19:58:58.782017+0000","last_fullsized":"2023-07-06T19:58:58.782017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:02.506485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378860+0000","last_change":"2023-07-06T19:58:53.756515+0000","last_active":"2023-07-06T19:58:59.378860+0000","last_peered":"2023-07-06T19:58:59.378860+0000","last_clean":"2023-07-06T19:58:59.378860+0000","last_became_active":"2023-07-06T19:58:53.756160+0000","last_became_peered":"2023-07-06T19:58:53.756160+0000","last_unstale":"2023-07-06T19:58:59.378860+0000","last_undegraded":"2023-07-06T19:58:59.378860+0000","last_fullsized":"2023-07-06T19:58:59.378860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:09:50.298552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376553+0000","last_change":"2023-07-06T19:58:57.791364+0000","last_active":"2023-07-06T19:58:59.376553+0000","last_peered":"2023-07-06T19:58:59.376553+0000","last_clean":"2023-07-06T19:58:59.376553+0000","last_became_active":"2023-07-06T19:58:57.789062+0000","last_became_peered":"2023-07-06T19:58:57.789062+0000","last_unstale":"2023-07-06T19:58:59.376553+0000","last_undegraded":"2023-07-06T19:58:59.376553+0000","last_fullsized":"2023-07-06T19:58:59.376553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:06:20.866793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377550+0000","last_change":"2023-07-06T19:58:52.747602+0000","last_active":"2023-07-06T19:58:59.377550+0000","last_peered":"2023-07-06T19:58:59.377550+0000","last_clean":"2023-07-06T19:58:59.377550+0000","last_became_active":"2023-07-06T19:58:52.747306+0000","last_became_peered":"2023-07-06T19:58:52.747306+0000","last_unstale":"2023-07-06T19:58:59.377550+0000","last_undegraded":"2023-07-06T19:58:59.377550+0000","last_fullsized":"2023-07-06T19:58:59.377550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:46:23.956146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377454+0000","last_change":"2023-07-06T19:58:53.760870+0000","last_active":"2023-07-06T19:58:59.377454+0000","last_peered":"2023-07-06T19:58:59.377454+0000","last_clean":"2023-07-06T19:58:59.377454+0000","last_became_active":"2023-07-06T19:58:53.760583+0000","last_became_peered":"2023-07-06T19:58:53.760583+0000","last_unstale":"2023-07-06T19:58:59.377454+0000","last_undegraded":"2023-07-06T19:58:59.377454+0000","last_fullsized":"2023-07-06T19:58:59.377454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:36:39.721385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782589+0000","last_change":"2023-07-06T19:58:57.794470+0000","last_active":"2023-07-06T19:58:58.782589+0000","last_peered":"2023-07-06T19:58:58.782589+0000","last_clean":"2023-07-06T19:58:58.782589+0000","last_became_active":"2023-07-06T19:58:57.793975+0000","last_became_peered":"2023-07-06T19:58:57.793975+0000","last_unstale":"2023-07-06T19:58:58.782589+0000","last_undegraded":"2023-07-06T19:58:58.782589+0000","last_fullsized":"2023-07-06T19:58:58.782589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:28:54.247015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783537+0000","last_change":"2023-07-06T19:58:52.740315+0000","last_active":"2023-07-06T19:58:58.783537+0000","last_peered":"2023-07-06T19:58:58.783537+0000","last_clean":"2023-07-06T19:58:58.783537+0000","last_became_active":"2023-07-06T19:58:52.739933+0000","last_became_peered":"2023-07-06T19:58:52.739933+0000","last_unstale":"2023-07-06T19:58:58.783537+0000","last_undegraded":"2023-07-06T19:58:58.783537+0000","last_fullsized":"2023-07-06T19:58:58.783537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:49:50.590705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378294+0000","last_change":"2023-07-06T19:58:53.741928+0000","last_active":"2023-07-06T19:58:59.378294+0000","last_peered":"2023-07-06T19:58:59.378294+0000","last_clean":"2023-07-06T19:58:59.378294+0000","last_became_active":"2023-07-06T19:58:53.741625+0000","last_became_peered":"2023-07-06T19:58:53.741625+0000","last_unstale":"2023-07-06T19:58:59.378294+0000","last_undegraded":"2023-07-06T19:58:59.378294+0000","last_fullsized":"2023-07-06T19:58:59.378294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:10:07.041452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782705+0000","last_change":"2023-07-06T19:58:57.792062+0000","last_active":"2023-07-06T19:58:58.782705+0000","last_peered":"2023-07-06T19:58:58.782705+0000","last_clean":"2023-07-06T19:58:58.782705+0000","last_became_active":"2023-07-06T19:58:57.791281+0000","last_became_peered":"2023-07-06T19:58:57.791281+0000","last_unstale":"2023-07-06T19:58:58.782705+0000","last_undegraded":"2023-07-06T19:58:58.782705+0000","last_fullsized":"2023-07-06T19:58:58.782705+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:55:14.128554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377292+0000","last_change":"2023-07-06T19:58:52.747562+0000","last_active":"2023-07-06T19:58:59.377292+0000","last_peered":"2023-07-06T19:58:59.377292+0000","last_clean":"2023-07-06T19:58:59.377292+0000","last_became_active":"2023-07-06T19:58:52.747229+0000","last_became_peered":"2023-07-06T19:58:52.747229+0000","last_unstale":"2023-07-06T19:58:59.377292+0000","last_undegraded":"2023-07-06T19:58:59.377292+0000","last_fullsized":"2023-07-06T19:58:59.377292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:04:30.618240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378608+0000","last_change":"2023-07-06T19:58:53.756720+0000","last_active":"2023-07-06T19:58:59.378608+0000","last_peered":"2023-07-06T19:58:59.378608+0000","last_clean":"2023-07-06T19:58:59.378608+0000","last_became_active":"2023-07-06T19:58:53.756402+0000","last_became_peered":"2023-07-06T19:58:53.756402+0000","last_unstale":"2023-07-06T19:58:59.378608+0000","last_undegraded":"2023-07-06T19:58:59.378608+0000","last_fullsized":"2023-07-06T19:58:59.378608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:26:00.900208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378351+0000","last_change":"2023-07-06T19:58:57.783465+0000","last_active":"2023-07-06T19:58:59.378351+0000","last_peered":"2023-07-06T19:58:59.378351+0000","last_clean":"2023-07-06T19:58:59.378351+0000","last_became_active":"2023-07-06T19:58:57.782790+0000","last_became_peered":"2023-07-06T19:58:57.782790+0000","last_unstale":"2023-07-06T19:58:59.378351+0000","last_undegraded":"2023-07-06T19:58:59.378351+0000","last_fullsized":"2023-07-06T19:58:59.378351+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:43:02.955936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376589+0000","last_change":"2023-07-06T19:58:52.749725+0000","last_active":"2023-07-06T19:58:59.376589+0000","last_peered":"2023-07-06T19:58:59.376589+0000","last_clean":"2023-07-06T19:58:59.376589+0000","last_became_active":"2023-07-06T19:58:52.749426+0000","last_became_peered":"2023-07-06T19:58:52.749426+0000","last_unstale":"2023-07-06T19:58:59.376589+0000","last_undegraded":"2023-07-06T19:58:59.376589+0000","last_fullsized":"2023-07-06T19:58:59.376589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:08:50.821397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783208+0000","last_change":"2023-07-06T19:58:53.759474+0000","last_active":"2023-07-06T19:58:58.783208+0000","last_peered":"2023-07-06T19:58:58.783208+0000","last_clean":"2023-07-06T19:58:58.783208+0000","last_became_active":"2023-07-06T19:58:53.759191+0000","last_became_peered":"2023-07-06T19:58:53.759191+0000","last_unstale":"2023-07-06T19:58:58.783208+0000","last_undegraded":"2023-07-06T19:58:58.783208+0000","last_fullsized":"2023-07-06T19:58:58.783208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:40:15.607877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378239+0000","last_change":"2023-07-06T19:58:57.787350+0000","last_active":"2023-07-06T19:58:59.378239+0000","last_peered":"2023-07-06T19:58:59.378239+0000","last_clean":"2023-07-06T19:58:59.378239+0000","last_became_active":"2023-07-06T19:58:57.786760+0000","last_became_peered":"2023-07-06T19:58:57.786760+0000","last_unstale":"2023-07-06T19:58:59.378239+0000","last_undegraded":"2023-07-06T19:58:59.378239+0000","last_fullsized":"2023-07-06T19:58:59.378239+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:07.546083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782756+0000","last_change":"2023-07-06T19:58:47.723855+0000","last_active":"2023-07-06T19:58:58.782756+0000","last_peered":"2023-07-06T19:58:58.782756+0000","last_clean":"2023-07-06T19:58:58.782756+0000","last_became_active":"2023-07-06T19:58:47.723553+0000","last_became_peered":"2023-07-06T19:58:47.723553+0000","last_unstale":"2023-07-06T19:58:58.782756+0000","last_undegraded":"2023-07-06T19:58:58.782756+0000","last_fullsized":"2023-07-06T19:58:58.782756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:00:46.116158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782566+0000","last_change":"2023-07-06T19:58:52.751410+0000","last_active":"2023-07-06T19:58:58.782566+0000","last_peered":"2023-07-06T19:58:58.782566+0000","last_clean":"2023-07-06T19:58:58.782566+0000","last_became_active":"2023-07-06T19:58:52.751112+0000","last_became_peered":"2023-07-06T19:58:52.751112+0000","last_unstale":"2023-07-06T19:58:58.782566+0000","last_undegraded":"2023-07-06T19:58:58.782566+0000","last_fullsized":"2023-07-06T19:58:58.782566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:01:55.597968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782915+0000","last_change":"2023-07-06T19:58:53.749897+0000","last_active":"2023-07-06T19:58:58.782915+0000","last_peered":"2023-07-06T19:58:58.782915+0000","last_clean":"2023-07-06T19:58:58.782915+0000","last_became_active":"2023-07-06T19:58:53.749624+0000","last_became_peered":"2023-07-06T19:58:53.749624+0000","last_unstale":"2023-07-06T19:58:58.782915+0000","last_undegraded":"2023-07-06T19:58:58.782915+0000","last_fullsized":"2023-07-06T19:58:58.782915+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:15:46.167902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378551+0000","last_change":"2023-07-06T19:58:57.789358+0000","last_active":"2023-07-06T19:58:59.378551+0000","last_peered":"2023-07-06T19:58:59.378551+0000","last_clean":"2023-07-06T19:58:59.378551+0000","last_became_active":"2023-07-06T19:58:57.788645+0000","last_became_peered":"2023-07-06T19:58:57.788645+0000","last_unstale":"2023-07-06T19:58:59.378551+0000","last_undegraded":"2023-07-06T19:58:59.378551+0000","last_fullsized":"2023-07-06T19:58:59.378551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:31:48.633170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782612+0000","last_change":"2023-07-06T19:58:47.705294+0000","last_active":"2023-07-06T19:58:58.782612+0000","last_peered":"2023-07-06T19:58:58.782612+0000","last_clean":"2023-07-06T19:58:58.782612+0000","last_became_active":"2023-07-06T19:58:47.704921+0000","last_became_peered":"2023-07-06T19:58:47.704921+0000","last_unstale":"2023-07-06T19:58:58.782612+0000","last_undegraded":"2023-07-06T19:58:58.782612+0000","last_fullsized":"2023-07-06T19:58:58.782612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:41:48.663962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378365+0000","last_change":"2023-07-06T19:58:52.748067+0000","last_active":"2023-07-06T19:58:59.378365+0000","last_peered":"2023-07-06T19:58:59.378365+0000","last_clean":"2023-07-06T19:58:59.378365+0000","last_became_active":"2023-07-06T19:58:52.747728+0000","last_became_peered":"2023-07-06T19:58:52.747728+0000","last_unstale":"2023-07-06T19:58:59.378365+0000","last_undegraded":"2023-07-06T19:58:59.378365+0000","last_fullsized":"2023-07-06T19:58:59.378365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:22:44.301281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782686+0000","last_change":"2023-07-06T19:58:53.742174+0000","last_active":"2023-07-06T19:58:58.782686+0000","last_peered":"2023-07-06T19:58:58.782686+0000","last_clean":"2023-07-06T19:58:58.782686+0000","last_became_active":"2023-07-06T19:58:53.741231+0000","last_became_peered":"2023-07-06T19:58:53.741231+0000","last_unstale":"2023-07-06T19:58:58.782686+0000","last_undegraded":"2023-07-06T19:58:58.782686+0000","last_fullsized":"2023-07-06T19:58:58.782686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:27:23.271688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376951+0000","last_change":"2023-07-06T19:58:57.785326+0000","last_active":"2023-07-06T19:58:59.376951+0000","last_peered":"2023-07-06T19:58:59.376951+0000","last_clean":"2023-07-06T19:58:59.376951+0000","last_became_active":"2023-07-06T19:58:57.784907+0000","last_became_peered":"2023-07-06T19:58:57.784907+0000","last_unstale":"2023-07-06T19:58:59.376951+0000","last_undegraded":"2023-07-06T19:58:59.376951+0000","last_fullsized":"2023-07-06T19:58:59.376951+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:19:07.540692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376590+0000","last_change":"2023-07-06T19:58:47.766992+0000","last_active":"2023-07-06T19:58:59.376590+0000","last_peered":"2023-07-06T19:58:59.376590+0000","last_clean":"2023-07-06T19:58:59.376590+0000","last_became_active":"2023-07-06T19:58:47.766697+0000","last_became_peered":"2023-07-06T19:58:47.766697+0000","last_unstale":"2023-07-06T19:58:59.376590+0000","last_undegraded":"2023-07-06T19:58:59.376590+0000","last_fullsized":"2023-07-06T19:58:59.376590+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:44:05.260069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782473+0000","last_change":"2023-07-06T19:58:52.747039+0000","last_active":"2023-07-06T19:58:58.782473+0000","last_peered":"2023-07-06T19:58:58.782473+0000","last_clean":"2023-07-06T19:58:58.782473+0000","last_became_active":"2023-07-06T19:58:52.746770+0000","last_became_peered":"2023-07-06T19:58:52.746770+0000","last_unstale":"2023-07-06T19:58:58.782473+0000","last_undegraded":"2023-07-06T19:58:58.782473+0000","last_fullsized":"2023-07-06T19:58:58.782473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:34:28.429392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783138+0000","last_change":"2023-07-06T19:58:53.745314+0000","last_active":"2023-07-06T19:58:58.783138+0000","last_peered":"2023-07-06T19:58:58.783138+0000","last_clean":"2023-07-06T19:58:58.783138+0000","last_became_active":"2023-07-06T19:58:53.744843+0000","last_became_peered":"2023-07-06T19:58:53.744843+0000","last_unstale":"2023-07-06T19:58:58.783138+0000","last_undegraded":"2023-07-06T19:58:58.783138+0000","last_fullsized":"2023-07-06T19:58:58.783138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:03.514072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377298+0000","last_change":"2023-07-06T19:58:57.793087+0000","last_active":"2023-07-06T19:58:59.377298+0000","last_peered":"2023-07-06T19:58:59.377298+0000","last_clean":"2023-07-06T19:58:59.377298+0000","last_became_active":"2023-07-06T19:58:57.792685+0000","last_became_peered":"2023-07-06T19:58:57.792685+0000","last_unstale":"2023-07-06T19:58:59.377298+0000","last_undegraded":"2023-07-06T19:58:59.377298+0000","last_fullsized":"2023-07-06T19:58:59.377298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:31:48.633170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782184+0000","last_change":"2023-07-06T19:58:47.704498+0000","last_active":"2023-07-06T19:58:58.782184+0000","last_peered":"2023-07-06T19:58:58.782184+0000","last_clean":"2023-07-06T19:58:58.782184+0000","last_became_active":"2023-07-06T19:58:47.704172+0000","last_became_peered":"2023-07-06T19:58:47.704172+0000","last_unstale":"2023-07-06T19:58:58.782184+0000","last_undegraded":"2023-07-06T19:58:58.782184+0000","last_fullsized":"2023-07-06T19:58:58.782184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:08:45.797996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377014+0000","last_change":"2023-07-06T19:58:40.972763+0000","last_active":"2023-07-06T19:58:59.377014+0000","last_peered":"2023-07-06T19:58:59.377014+0000","last_clean":"2023-07-06T19:58:59.377014+0000","last_became_active":"2023-07-06T19:58:40.971570+0000","last_became_peered":"2023-07-06T19:58:40.971570+0000","last_unstale":"2023-07-06T19:58:59.377014+0000","last_undegraded":"2023-07-06T19:58:59.377014+0000","last_fullsized":"2023-07-06T19:58:59.377014+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_clean_scrub_stamp":"2023-07-06T19:58:39.653546+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:00:26.457825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376600+0000","last_change":"2023-07-06T19:58:52.746886+0000","last_active":"2023-07-06T19:58:59.376600+0000","last_peered":"2023-07-06T19:58:59.376600+0000","last_clean":"2023-07-06T19:58:59.376600+0000","last_became_active":"2023-07-06T19:58:52.746551+0000","last_became_peered":"2023-07-06T19:58:52.746551+0000","last_unstale":"2023-07-06T19:58:59.376600+0000","last_undegraded":"2023-07-06T19:58:59.376600+0000","last_fullsized":"2023-07-06T19:58:59.376600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:47:29.849262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783755+0000","last_change":"2023-07-06T19:58:53.750523+0000","last_active":"2023-07-06T19:58:58.783755+0000","last_peered":"2023-07-06T19:58:58.783755+0000","last_clean":"2023-07-06T19:58:58.783755+0000","last_became_active":"2023-07-06T19:58:53.750242+0000","last_became_peered":"2023-07-06T19:58:53.750242+0000","last_unstale":"2023-07-06T19:58:58.783755+0000","last_undegraded":"2023-07-06T19:58:58.783755+0000","last_fullsized":"2023-07-06T19:58:58.783755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:56:30.660740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782488+0000","last_change":"2023-07-06T19:58:57.786254+0000","last_active":"2023-07-06T19:58:58.782488+0000","last_peered":"2023-07-06T19:58:58.782488+0000","last_clean":"2023-07-06T19:58:58.782488+0000","last_became_active":"2023-07-06T19:58:57.785873+0000","last_became_peered":"2023-07-06T19:58:57.785873+0000","last_unstale":"2023-07-06T19:58:58.782488+0000","last_undegraded":"2023-07-06T19:58:58.782488+0000","last_fullsized":"2023-07-06T19:58:58.782488+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:31:48.633170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377148+0000","last_change":"2023-07-06T19:58:47.708545+0000","last_active":"2023-07-06T19:58:59.377148+0000","last_peered":"2023-07-06T19:58:59.377148+0000","last_clean":"2023-07-06T19:58:59.377148+0000","last_became_active":"2023-07-06T19:58:47.708230+0000","last_became_peered":"2023-07-06T19:58:47.708230+0000","last_unstale":"2023-07-06T19:58:59.377148+0000","last_undegraded":"2023-07-06T19:58:59.377148+0000","last_fullsized":"2023-07-06T19:58:59.377148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:08:45.797996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376917+0000","last_change":"2023-07-06T19:58:52.751850+0000","last_active":"2023-07-06T19:58:59.376917+0000","last_peered":"2023-07-06T19:58:59.376917+0000","last_clean":"2023-07-06T19:58:59.376917+0000","last_became_active":"2023-07-06T19:58:52.751537+0000","last_became_peered":"2023-07-06T19:58:52.751537+0000","last_unstale":"2023-07-06T19:58:59.376917+0000","last_undegraded":"2023-07-06T19:58:59.376917+0000","last_fullsized":"2023-07-06T19:58:59.376917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:15:45.160315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378259+0000","last_change":"2023-07-06T19:58:53.753894+0000","last_active":"2023-07-06T19:58:59.378259+0000","last_peered":"2023-07-06T19:58:59.378259+0000","last_clean":"2023-07-06T19:58:59.378259+0000","last_became_active":"2023-07-06T19:58:53.753530+0000","last_became_peered":"2023-07-06T19:58:53.753530+0000","last_unstale":"2023-07-06T19:58:59.378259+0000","last_undegraded":"2023-07-06T19:58:59.378259+0000","last_fullsized":"2023-07-06T19:58:59.378259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:06:38.381299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783829+0000","last_change":"2023-07-06T19:58:57.798396+0000","last_active":"2023-07-06T19:58:58.783829+0000","last_peered":"2023-07-06T19:58:58.783829+0000","last_clean":"2023-07-06T19:58:58.783829+0000","last_became_active":"2023-07-06T19:58:57.798003+0000","last_became_peered":"2023-07-06T19:58:57.798003+0000","last_unstale":"2023-07-06T19:58:58.783829+0000","last_undegraded":"2023-07-06T19:58:58.783829+0000","last_fullsized":"2023-07-06T19:58:58.783829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:48:14.761542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378171+0000","last_change":"2023-07-06T19:58:47.723926+0000","last_active":"2023-07-06T19:58:59.378171+0000","last_peered":"2023-07-06T19:58:59.378171+0000","last_clean":"2023-07-06T19:58:59.378171+0000","last_became_active":"2023-07-06T19:58:47.723646+0000","last_became_peered":"2023-07-06T19:58:47.723646+0000","last_unstale":"2023-07-06T19:58:59.378171+0000","last_undegraded":"2023-07-06T19:58:59.378171+0000","last_fullsized":"2023-07-06T19:58:59.378171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:09:44.267564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783304+0000","last_change":"2023-07-06T19:58:52.744960+0000","last_active":"2023-07-06T19:58:58.783304+0000","last_peered":"2023-07-06T19:58:58.783304+0000","last_clean":"2023-07-06T19:58:58.783304+0000","last_became_active":"2023-07-06T19:58:52.744634+0000","last_became_peered":"2023-07-06T19:58:52.744634+0000","last_unstale":"2023-07-06T19:58:58.783304+0000","last_undegraded":"2023-07-06T19:58:58.783304+0000","last_fullsized":"2023-07-06T19:58:58.783304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:08:50.821397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378559+0000","last_change":"2023-07-06T19:58:53.750128+0000","last_active":"2023-07-06T19:58:59.378559+0000","last_peered":"2023-07-06T19:58:59.378559+0000","last_clean":"2023-07-06T19:58:59.378559+0000","last_became_active":"2023-07-06T19:58:53.749580+0000","last_became_peered":"2023-07-06T19:58:53.749580+0000","last_unstale":"2023-07-06T19:58:59.378559+0000","last_undegraded":"2023-07-06T19:58:59.378559+0000","last_fullsized":"2023-07-06T19:58:59.378559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:01:56.605555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377697+0000","last_change":"2023-07-06T19:58:57.788139+0000","last_active":"2023-07-06T19:58:59.377697+0000","last_peered":"2023-07-06T19:58:59.377697+0000","last_clean":"2023-07-06T19:58:59.377697+0000","last_became_active":"2023-07-06T19:58:57.787755+0000","last_became_peered":"2023-07-06T19:58:57.787755+0000","last_unstale":"2023-07-06T19:58:59.377697+0000","last_undegraded":"2023-07-06T19:58:59.377697+0000","last_fullsized":"2023-07-06T19:58:59.377697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:49:04.545425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377011+0000","last_change":"2023-07-06T19:58:52.749383+0000","last_active":"2023-07-06T19:58:59.377011+0000","last_peered":"2023-07-06T19:58:59.377011+0000","last_clean":"2023-07-06T19:58:59.377011+0000","last_became_active":"2023-07-06T19:58:52.749084+0000","last_became_peered":"2023-07-06T19:58:52.749084+0000","last_unstale":"2023-07-06T19:58:59.377011+0000","last_undegraded":"2023-07-06T19:58:59.377011+0000","last_fullsized":"2023-07-06T19:58:59.377011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:09:49.290965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782895+0000","last_change":"2023-07-06T19:58:47.711918+0000","last_active":"2023-07-06T19:58:58.782895+0000","last_peered":"2023-07-06T19:58:58.782895+0000","last_clean":"2023-07-06T19:58:58.782895+0000","last_became_active":"2023-07-06T19:58:47.711591+0000","last_became_peered":"2023-07-06T19:58:47.711591+0000","last_unstale":"2023-07-06T19:58:58.782895+0000","last_undegraded":"2023-07-06T19:58:58.782895+0000","last_fullsized":"2023-07-06T19:58:58.782895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:37:01.164597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376523+0000","last_change":"2023-07-06T19:58:53.756858+0000","last_active":"2023-07-06T19:58:59.376523+0000","last_peered":"2023-07-06T19:58:59.376523+0000","last_clean":"2023-07-06T19:58:59.376523+0000","last_became_active":"2023-07-06T19:58:53.756704+0000","last_became_peered":"2023-07-06T19:58:53.756704+0000","last_unstale":"2023-07-06T19:58:59.376523+0000","last_undegraded":"2023-07-06T19:58:59.376523+0000","last_fullsized":"2023-07-06T19:58:59.376523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:40:15.607877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376385+0000","last_change":"2023-07-06T19:58:57.790196+0000","last_active":"2023-07-06T19:58:59.376385+0000","last_peered":"2023-07-06T19:58:59.376385+0000","last_clean":"2023-07-06T19:58:59.376385+0000","last_became_active":"2023-07-06T19:58:57.789783+0000","last_became_peered":"2023-07-06T19:58:57.789783+0000","last_unstale":"2023-07-06T19:58:59.376385+0000","last_undegraded":"2023-07-06T19:58:59.376385+0000","last_fullsized":"2023-07-06T19:58:59.376385+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:00:43.554956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783818+0000","last_change":"2023-07-06T19:58:47.712143+0000","last_active":"2023-07-06T19:58:58.783818+0000","last_peered":"2023-07-06T19:58:58.783818+0000","last_clean":"2023-07-06T19:58:58.783818+0000","last_became_active":"2023-07-06T19:58:47.711788+0000","last_became_peered":"2023-07-06T19:58:47.711788+0000","last_unstale":"2023-07-06T19:58:58.783818+0000","last_undegraded":"2023-07-06T19:58:58.783818+0000","last_fullsized":"2023-07-06T19:58:58.783818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:14:46.864853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378347+0000","last_change":"2023-07-06T19:58:52.745653+0000","last_active":"2023-07-06T19:58:59.378347+0000","last_peered":"2023-07-06T19:58:59.378347+0000","last_clean":"2023-07-06T19:58:59.378347+0000","last_became_active":"2023-07-06T19:58:52.745371+0000","last_became_peered":"2023-07-06T19:58:52.745371+0000","last_unstale":"2023-07-06T19:58:59.378347+0000","last_undegraded":"2023-07-06T19:58:59.378347+0000","last_fullsized":"2023-07-06T19:58:59.378347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:00:38.515358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377461+0000","last_change":"2023-07-06T19:58:53.748251+0000","last_active":"2023-07-06T19:58:59.377461+0000","last_peered":"2023-07-06T19:58:59.377461+0000","last_clean":"2023-07-06T19:58:59.377461+0000","last_became_active":"2023-07-06T19:58:53.743355+0000","last_became_peered":"2023-07-06T19:58:53.743355+0000","last_unstale":"2023-07-06T19:58:59.377461+0000","last_undegraded":"2023-07-06T19:58:59.377461+0000","last_fullsized":"2023-07-06T19:58:59.377461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:32:07.064198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783329+0000","last_change":"2023-07-06T19:58:57.788802+0000","last_active":"2023-07-06T19:58:58.783329+0000","last_peered":"2023-07-06T19:58:58.783329+0000","last_clean":"2023-07-06T19:58:58.783329+0000","last_became_active":"2023-07-06T19:58:57.788255+0000","last_became_peered":"2023-07-06T19:58:57.788255+0000","last_unstale":"2023-07-06T19:58:58.783329+0000","last_undegraded":"2023-07-06T19:58:58.783329+0000","last_fullsized":"2023-07-06T19:58:58.783329+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:47:34.888861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378713+0000","last_change":"2023-07-06T19:58:52.751073+0000","last_active":"2023-07-06T19:58:59.378713+0000","last_peered":"2023-07-06T19:58:59.378713+0000","last_clean":"2023-07-06T19:58:59.378713+0000","last_became_active":"2023-07-06T19:58:52.750801+0000","last_became_peered":"2023-07-06T19:58:52.750801+0000","last_unstale":"2023-07-06T19:58:59.378713+0000","last_undegraded":"2023-07-06T19:58:59.378713+0000","last_fullsized":"2023-07-06T19:58:59.378713+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:41:53.687362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377890+0000","last_change":"2023-07-06T19:58:53.752885+0000","last_active":"2023-07-06T19:58:59.377890+0000","last_peered":"2023-07-06T19:58:59.377890+0000","last_clean":"2023-07-06T19:58:59.377890+0000","last_became_active":"2023-07-06T19:58:53.752604+0000","last_became_peered":"2023-07-06T19:58:53.752604+0000","last_unstale":"2023-07-06T19:58:59.377890+0000","last_undegraded":"2023-07-06T19:58:59.377890+0000","last_fullsized":"2023-07-06T19:58:59.377890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:04:50.697845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377636+0000","last_change":"2023-07-06T19:58:57.792965+0000","last_active":"2023-07-06T19:58:59.377636+0000","last_peered":"2023-07-06T19:58:59.377636+0000","last_clean":"2023-07-06T19:58:59.377636+0000","last_became_active":"2023-07-06T19:58:57.792542+0000","last_became_peered":"2023-07-06T19:58:57.792542+0000","last_unstale":"2023-07-06T19:58:59.377636+0000","last_undegraded":"2023-07-06T19:58:59.377636+0000","last_fullsized":"2023-07-06T19:58:59.377636+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:02:00.637566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782164+0000","last_change":"2023-07-06T19:58:52.748757+0000","last_active":"2023-07-06T19:58:58.782164+0000","last_peered":"2023-07-06T19:58:58.782164+0000","last_clean":"2023-07-06T19:58:58.782164+0000","last_became_active":"2023-07-06T19:58:52.748438+0000","last_became_peered":"2023-07-06T19:58:52.748438+0000","last_unstale":"2023-07-06T19:58:58.782164+0000","last_undegraded":"2023-07-06T19:58:58.782164+0000","last_fullsized":"2023-07-06T19:58:58.782164+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:40:14.600290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378827+0000","last_change":"2023-07-06T19:58:53.760898+0000","last_active":"2023-07-06T19:58:59.378827+0000","last_peered":"2023-07-06T19:58:59.378827+0000","last_clean":"2023-07-06T19:58:59.378827+0000","last_became_active":"2023-07-06T19:58:53.760643+0000","last_became_peered":"2023-07-06T19:58:53.760643+0000","last_unstale":"2023-07-06T19:58:59.378827+0000","last_undegraded":"2023-07-06T19:58:59.378827+0000","last_fullsized":"2023-07-06T19:58:59.378827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:03:04.431089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782178+0000","last_change":"2023-07-06T19:58:57.780940+0000","last_active":"2023-07-06T19:58:58.782178+0000","last_peered":"2023-07-06T19:58:58.782178+0000","last_clean":"2023-07-06T19:58:58.782178+0000","last_became_active":"2023-07-06T19:58:57.780557+0000","last_became_peered":"2023-07-06T19:58:57.780557+0000","last_unstale":"2023-07-06T19:58:58.782178+0000","last_undegraded":"2023-07-06T19:58:58.782178+0000","last_fullsized":"2023-07-06T19:58:58.782178+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:09:54.330563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782271+0000","last_change":"2023-07-06T19:58:52.748732+0000","last_active":"2023-07-06T19:58:58.782271+0000","last_peered":"2023-07-06T19:58:58.782271+0000","last_clean":"2023-07-06T19:58:58.782271+0000","last_became_active":"2023-07-06T19:58:52.748464+0000","last_became_peered":"2023-07-06T19:58:52.748464+0000","last_unstale":"2023-07-06T19:58:58.782271+0000","last_undegraded":"2023-07-06T19:58:58.782271+0000","last_fullsized":"2023-07-06T19:58:58.782271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:47:29.849262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377654+0000","last_change":"2023-07-06T19:58:53.749638+0000","last_active":"2023-07-06T19:58:59.377654+0000","last_peered":"2023-07-06T19:58:59.377654+0000","last_clean":"2023-07-06T19:58:59.377654+0000","last_became_active":"2023-07-06T19:58:53.749360+0000","last_became_peered":"2023-07-06T19:58:53.749360+0000","last_unstale":"2023-07-06T19:58:59.377654+0000","last_undegraded":"2023-07-06T19:58:59.377654+0000","last_fullsized":"2023-07-06T19:58:59.377654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:52:07.484161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376759+0000","last_change":"2023-07-06T19:58:57.789615+0000","last_active":"2023-07-06T19:58:59.376759+0000","last_peered":"2023-07-06T19:58:59.376759+0000","last_clean":"2023-07-06T19:58:59.376759+0000","last_became_active":"2023-07-06T19:58:57.789210+0000","last_became_peered":"2023-07-06T19:58:57.789210+0000","last_unstale":"2023-07-06T19:58:59.376759+0000","last_undegraded":"2023-07-06T19:58:59.376759+0000","last_fullsized":"2023-07-06T19:58:59.376759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:43:41.842113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377561+0000","last_change":"2023-07-06T19:58:52.749215+0000","last_active":"2023-07-06T19:58:59.377561+0000","last_peered":"2023-07-06T19:58:59.377561+0000","last_clean":"2023-07-06T19:58:59.377561+0000","last_became_active":"2023-07-06T19:58:52.748873+0000","last_became_peered":"2023-07-06T19:58:52.748873+0000","last_unstale":"2023-07-06T19:58:59.377561+0000","last_undegraded":"2023-07-06T19:58:59.377561+0000","last_fullsized":"2023-07-06T19:58:59.377561+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:01:34.409863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.376989+0000","last_change":"2023-07-06T19:58:53.750239+0000","last_active":"2023-07-06T19:58:59.376989+0000","last_peered":"2023-07-06T19:58:59.376989+0000","last_clean":"2023-07-06T19:58:59.376989+0000","last_became_active":"2023-07-06T19:58:53.749937+0000","last_became_peered":"2023-07-06T19:58:53.749937+0000","last_unstale":"2023-07-06T19:58:59.376989+0000","last_undegraded":"2023-07-06T19:58:59.376989+0000","last_fullsized":"2023-07-06T19:58:59.376989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:36:41.784617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.782718+0000","last_change":"2023-07-06T19:58:57.793838+0000","last_active":"2023-07-06T19:58:58.782718+0000","last_peered":"2023-07-06T19:58:58.782718+0000","last_clean":"2023-07-06T19:58:58.782718+0000","last_became_active":"2023-07-06T19:58:57.790467+0000","last_became_peered":"2023-07-06T19:58:57.790467+0000","last_unstale":"2023-07-06T19:58:58.782718+0000","last_undegraded":"2023-07-06T19:58:58.782718+0000","last_fullsized":"2023-07-06T19:58:58.782718+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:56.750677+0000","last_clean_scrub_stamp":"2023-07-06T19:58:56.750677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:58:24.336299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378755+0000","last_change":"2023-07-06T19:58:52.745091+0000","last_active":"2023-07-06T19:58:59.378755+0000","last_peered":"2023-07-06T19:58:59.378755+0000","last_clean":"2023-07-06T19:58:59.378755+0000","last_became_active":"2023-07-06T19:58:52.744779+0000","last_became_peered":"2023-07-06T19:58:52.744779+0000","last_unstale":"2023-07-06T19:58:59.378755+0000","last_undegraded":"2023-07-06T19:58:59.378755+0000","last_fullsized":"2023-07-06T19:58:59.378755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:51.711079+0000","last_clean_scrub_stamp":"2023-07-06T19:58:51.711079+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:36:40.777030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377012+0000","last_change":"2023-07-06T19:58:53.756293+0000","last_active":"2023-07-06T19:58:59.377012+0000","last_peered":"2023-07-06T19:58:59.377012+0000","last_clean":"2023-07-06T19:58:59.377012+0000","last_became_active":"2023-07-06T19:58:53.750936+0000","last_became_peered":"2023-07-06T19:58:53.750936+0000","last_unstale":"2023-07-06T19:58:59.377012+0000","last_undegraded":"2023-07-06T19:58:59.377012+0000","last_fullsized":"2023-07-06T19:58:59.377012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:37:12.135763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783921+0000","last_change":"2023-07-06T19:58:53.749882+0000","last_active":"2023-07-06T19:58:58.783921+0000","last_peered":"2023-07-06T19:58:58.783921+0000","last_clean":"2023-07-06T19:58:58.783921+0000","last_became_active":"2023-07-06T19:58:53.749571+0000","last_became_peered":"2023-07-06T19:58:53.749571+0000","last_unstale":"2023-07-06T19:58:58.783921+0000","last_undegraded":"2023-07-06T19:58:58.783921+0000","last_fullsized":"2023-07-06T19:58:58.783921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:35:07.767106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377264+0000","last_change":"2023-07-06T19:58:53.761493+0000","last_active":"2023-07-06T19:58:59.377264+0000","last_peered":"2023-07-06T19:58:59.377264+0000","last_clean":"2023-07-06T19:58:59.377264+0000","last_became_active":"2023-07-06T19:58:53.759928+0000","last_became_peered":"2023-07-06T19:58:53.759928+0000","last_unstale":"2023-07-06T19:58:59.377264+0000","last_undegraded":"2023-07-06T19:58:59.377264+0000","last_fullsized":"2023-07-06T19:58:59.377264+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:31:43.832282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.378108+0000","last_change":"2023-07-06T19:58:53.756852+0000","last_active":"2023-07-06T19:58:59.378108+0000","last_peered":"2023-07-06T19:58:59.378108+0000","last_clean":"2023-07-06T19:58:59.378108+0000","last_became_active":"2023-07-06T19:58:53.751349+0000","last_became_peered":"2023-07-06T19:58:53.751349+0000","last_unstale":"2023-07-06T19:58:59.378108+0000","last_undegraded":"2023-07-06T19:58:59.378108+0000","last_fullsized":"2023-07-06T19:58:59.378108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:00:07.931135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:59.377953+0000","last_change":"2023-07-06T19:58:53.766577+0000","last_active":"2023-07-06T19:58:59.377953+0000","last_peered":"2023-07-06T19:58:59.377953+0000","last_clean":"2023-07-06T19:58:59.377953+0000","last_became_active":"2023-07-06T19:58:53.766262+0000","last_became_peered":"2023-07-06T19:58:53.766262+0000","last_unstale":"2023-07-06T19:58:59.377953+0000","last_undegraded":"2023-07-06T19:58:59.377953+0000","last_fullsized":"2023-07-06T19:58:59.377953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:37:12.135763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-07-06T19:58:58.783011+0000","last_change":"2023-07-06T19:58:53.756981+0000","last_active":"2023-07-06T19:58:58.783011+0000","last_peered":"2023-07-06T19:58:58.783011+0000","last_clean":"2023-07-06T19:58:58.783011+0000","last_became_active":"2023-07-06T19:58:53.756728+0000","last_became_peered":"2023-07-06T19:58:53.756728+0000","last_unstale":"2023-07-06T19:58:58.783011+0000","last_undegraded":"2023-07-06T19:58:58.783011+0000","last_fullsized":"2023-07-06T19:58:58.783011+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:52.718666+0000","last_clean_scrub_stamp":"2023-07-06T19:58:52.718666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:39:05.600911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":913408,"data_stored":714279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":868,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":888832,"data_stored":710851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":123751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]}]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T19:59:24.474 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-06T19:59:24.475 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-06T19:59:24.475 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-06T19:59:24.476 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-06T19:59:24.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.614+0000 7fe5e0728700 1 Processor -- start 2023-07-06T19:59:24.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.614+0000 7fe5e0728700 1 -- start start 2023-07-06T19:59:24.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.615+0000 7fe5e0728700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe5d80b4f60 0x7fe5d80aee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:24.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.615+0000 7fe5e0728700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5d8071cf0 0x7fe5d80ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:24.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.615+0000 7fe5e0728700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5d815e8f0 con 0x7fe5d806b300 2023-07-06T19:59:24.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.615+0000 7fe5e0728700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5d815a730 con 0x7fe5d80b4f60 2023-07-06T19:59:24.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.615+0000 7fe5e0728700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d815eb90 con 0x7fe5d8071cf0 2023-07-06T19:59:24.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.615+0000 7fe5de4c4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe5d80b4f60 0x7fe5d80aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:24.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.615+0000 7fe5ddcc3700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe5d806b300 0x7fe5d80715e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60520/0 (socket says 172.21.15.6:60520) 2023-07-06T19:59:24.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.615+0000 7fe5ddcc3700 1 -- 172.21.15.6:0/4281336460 learned_addr learned my addr 172.21.15.6:0/4281336460 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:24.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.616+0000 7fe5decc5700 1 --2- 172.21.15.6:0/4281336460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5d8071cf0 0x7fe5d80ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:24.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.616+0000 7fe5de4c4700 1 -- 172.21.15.6:0/4281336460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5d8071cf0 msgr2=0x7fe5d80ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:24.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.616+0000 7fe5de4c4700 1 --2- 172.21.15.6:0/4281336460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5d8071cf0 0x7fe5d80ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:24.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.616+0000 7fe5de4c4700 1 -- 172.21.15.6:0/4281336460 >> v1:172.21.15.6:6789/0 conn(0x7fe5d806b300 legacy=0x7fe5d80715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:24.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.616+0000 7fe5dd4c2700 1 -- 172.21.15.6:0/4281336460 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543085981 0 0) 0x7fe5d815e8f0 con 0x7fe5d806b300 2023-07-06T19:59:24.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.616+0000 7fe5de4c4700 1 -- 172.21.15.6:0/4281336460 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d806d020 con 0x7fe5d80b4f60 2023-07-06T19:59:24.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.616+0000 7fe5decc5700 1 --2- 172.21.15.6:0/4281336460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5d8071cf0 0x7fe5d80ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:24.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.616+0000 7fe5de4c4700 1 --2- 172.21.15.6:0/4281336460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5d80b4f60 0x7fe5d80aee20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4009840 tx=0x7fe5d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d4aa6da4b2a47d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:24.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.616+0000 7fe5dd4c2700 1 -- 172.21.15.6:0/4281336460 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4011830 con 0x7fe5d80b4f60 2023-07-06T19:59:24.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.616+0000 7fe5dd4c2700 1 -- 172.21.15.6:0/4281336460 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d4011990 con 0x7fe5d80b4f60 2023-07-06T19:59:24.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.616+0000 7fe5dd4c2700 1 -- 172.21.15.6:0/4281336460 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4011d20 con 0x7fe5d80b4f60 2023-07-06T19:59:24.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.617+0000 7fe5e0728700 1 -- 172.21.15.6:0/4281336460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5d80b4f60 msgr2=0x7fe5d80aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:24.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.617+0000 7fe5e0728700 1 --2- 172.21.15.6:0/4281336460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5d80b4f60 0x7fe5d80aee20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4009840 tx=0x7fe5d4009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:24.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.617+0000 7fe5e0728700 1 -- 172.21.15.6:0/4281336460 shutdown_connections 2023-07-06T19:59:24.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.617+0000 7fe5e0728700 1 --2- 172.21.15.6:0/4281336460 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5d8071cf0 0x7fe5d80ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:24.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.617+0000 7fe5e0728700 1 --2- 172.21.15.6:0/4281336460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5d80b4f60 0x7fe5d80aee20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:24.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.617+0000 7fe5e0728700 1 -- 172.21.15.6:0/4281336460 >> 172.21.15.6:0/4281336460 conn(0x7fe5d80cc3a0 msgr2=0x7fe5d80cc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:24.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.617+0000 7fe5e0728700 1 -- 172.21.15.6:0/4281336460 shutdown_connections 2023-07-06T19:59:24.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.617+0000 7fe5e0728700 1 -- 172.21.15.6:0/4281336460 wait complete. 2023-07-06T19:59:24.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.618+0000 7fe5e0728700 1 Processor -- start 2023-07-06T19:59:24.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.618+0000 7fe5e0728700 1 -- start start 2023-07-06T19:59:24.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.619+0000 7fe5e0728700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5d806b300 0x7fe5d80b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:24.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.619+0000 7fe5e0728700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5d8071cf0 0x7fe5d80c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:24.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.619+0000 7fe5e0728700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5d80b4f60 0x7fe5d81584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:24.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.619+0000 7fe5e0728700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d80af380 con 0x7fe5d8071cf0 2023-07-06T19:59:24.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.619+0000 7fe5e0728700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d81593f0 con 0x7fe5d80b4f60 2023-07-06T19:59:24.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.619+0000 7fe5e0728700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d80c8fc0 con 0x7fe5d806b300 2023-07-06T19:59:24.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.619+0000 7fe5ddcc3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5d8071cf0 0x7fe5d80c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:24.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.619+0000 7fe5ddcc3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5d8071cf0 0x7fe5d80c84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59318/0 (socket says 172.21.15.6:59318) 2023-07-06T19:59:24.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.619+0000 7fe5ddcc3700 1 -- 172.21.15.6:0/560969337 learned_addr learned my addr 172.21.15.6:0/560969337 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:24.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.619+0000 7fe5de4c4700 1 --2- 172.21.15.6:0/560969337 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5d806b300 0x7fe5d80b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:24.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.619+0000 7fe5decc5700 1 --2- 172.21.15.6:0/560969337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5d80b4f60 0x7fe5d81584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:24.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.619+0000 7fe5ddcc3700 1 -- 172.21.15.6:0/560969337 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5d806b300 msgr2=0x7fe5d80b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:24.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.619+0000 7fe5ddcc3700 1 --2- 172.21.15.6:0/560969337 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5d806b300 0x7fe5d80b1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:24.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.619+0000 7fe5ddcc3700 1 -- 172.21.15.6:0/560969337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5d80b4f60 msgr2=0x7fe5d81584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:24.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.619+0000 7fe5ddcc3700 1 --2- 172.21.15.6:0/560969337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5d80b4f60 0x7fe5d81584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:24.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.619+0000 7fe5ddcc3700 1 -- 172.21.15.6:0/560969337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d40094a0 con 0x7fe5d8071cf0 2023-07-06T19:59:24.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.619+0000 7fe5ddcc3700 1 --2- 172.21.15.6:0/560969337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5d8071cf0 0x7fe5d80c84b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00c550 tx=0x7fe5cc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:24.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.619+0000 7fe5caffd700 1 -- 172.21.15.6:0/560969337 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc004c80 con 0x7fe5d8071cf0 2023-07-06T19:59:24.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.619+0000 7fe5caffd700 1 -- 172.21.15.6:0/560969337 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5cc004e00 con 0x7fe5d8071cf0 2023-07-06T19:59:24.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.620+0000 7fe5e0728700 1 -- 172.21.15.6:0/560969337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d80c92a0 con 0x7fe5d8071cf0 2023-07-06T19:59:24.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.620+0000 7fe5caffd700 1 -- 172.21.15.6:0/560969337 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc007310 con 0x7fe5d8071cf0 2023-07-06T19:59:24.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.620+0000 7fe5e0728700 1 -- 172.21.15.6:0/560969337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d80c9860 con 0x7fe5d8071cf0 2023-07-06T19:59:24.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.621+0000 7fe5e0728700 1 -- 172.21.15.6:0/560969337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d80af530 con 0x7fe5d8071cf0 2023-07-06T19:59:24.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.621+0000 7fe5caffd700 1 -- 172.21.15.6:0/560969337 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe5cc007470 con 0x7fe5d8071cf0 2023-07-06T19:59:24.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.621+0000 7fe5caffd700 1 --2- 172.21.15.6:0/560969337 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe5bc06ace0 0x7fe5bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:24.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.622+0000 7fe5caffd700 1 -- 172.21.15.6:0/560969337 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe5cc0893c0 con 0x7fe5d8071cf0 2023-07-06T19:59:24.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.622+0000 7fe5de4c4700 1 --2- 172.21.15.6:0/560969337 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe5bc06ace0 0x7fe5bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:24.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.622+0000 7fe5de4c4700 1 --2- 172.21.15.6:0/560969337 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe5bc06ace0 0x7fe5bc06d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe5d40090b0 tx=0x7fe5d4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:24.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.626+0000 7fe5caffd700 1 -- 172.21.15.6:0/560969337 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe5d80af530 con 0x7fe5d8071cf0 2023-07-06T19:59:24.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.871+0000 7fe5e0728700 1 -- 172.21.15.6:0/560969337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe5d8074200 con 0x7fe5d8071cf0 2023-07-06T19:59:24.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.871+0000 7fe5caffd700 1 -- 172.21.15.6:0/560969337 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe5cc0540f0 con 0x7fe5d8071cf0 2023-07-06T19:59:24.873 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:24.873 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-06T19:59:24.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.873+0000 7fe5e0728700 1 -- 172.21.15.6:0/560969337 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe5bc06ace0 msgr2=0x7fe5bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:24.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.873+0000 7fe5e0728700 1 --2- 172.21.15.6:0/560969337 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe5bc06ace0 0x7fe5bc06d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe5d40090b0 tx=0x7fe5d4008030 comp rx=0 tx=0).stop 2023-07-06T19:59:24.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.873+0000 7fe5e0728700 1 -- 172.21.15.6:0/560969337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5d8071cf0 msgr2=0x7fe5d80c84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:24.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.873+0000 7fe5e0728700 1 --2- 172.21.15.6:0/560969337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5d8071cf0 0x7fe5d80c84b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00c550 tx=0x7fe5cc00c860 comp rx=0 tx=0).stop 2023-07-06T19:59:24.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.873+0000 7fe5e0728700 1 -- 172.21.15.6:0/560969337 shutdown_connections 2023-07-06T19:59:24.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.873+0000 7fe5e0728700 1 --2- 172.21.15.6:0/560969337 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe5bc06ace0 0x7fe5bc06d190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:24.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.873+0000 7fe5e0728700 1 --2- 172.21.15.6:0/560969337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5d80b4f60 0x7fe5d81584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:24.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.873+0000 7fe5e0728700 1 --2- 172.21.15.6:0/560969337 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5d806b300 0x7fe5d80b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:24.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.873+0000 7fe5e0728700 1 --2- 172.21.15.6:0/560969337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5d8071cf0 0x7fe5d80c84b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:24.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.873+0000 7fe5e0728700 1 -- 172.21.15.6:0/560969337 >> 172.21.15.6:0/560969337 conn(0x7fe5d80cc3a0 msgr2=0x7fe5d815daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:24.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.873+0000 7fe5e0728700 1 -- 172.21.15.6:0/560969337 shutdown_connections 2023-07-06T19:59:24.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:24.873+0000 7fe5e0728700 1 -- 172.21.15.6:0/560969337 wait complete. 2023-07-06T19:59:24.890 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-06T19:59:24.891 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T19:59:25.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.024+0000 7fe5cc297700 1 Processor -- start 2023-07-06T19:59:25.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.024+0000 7fe5cc297700 1 -- start start 2023-07-06T19:59:25.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.025+0000 7fe5cc297700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5c415ce50 0x7fe5c40cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:25.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.025+0000 7fe5cc297700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe5c415d220 0x7fe5c406bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:25.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.025+0000 7fe5cc297700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe5c415d690 0x7fe5c406c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:25.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.025+0000 7fe5cc297700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c4160060 con 0x7fe5c415d220 2023-07-06T19:59:25.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.025+0000 7fe5cc297700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c40cd800 con 0x7fe5c415d690 2023-07-06T19:59:25.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.025+0000 7fe5cc297700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c41602b0 con 0x7fe5c415ce50 2023-07-06T19:59:25.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.025+0000 7fe5c9832700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe5c415d220 0x7fe5c406bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:25.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.025+0000 7fe5c9832700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe5c415d220 0x7fe5c406bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59326/0 (socket says 172.21.15.6:59326) 2023-07-06T19:59:25.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.025+0000 7fe5c9832700 1 -- 172.21.15.6:0/583160914 learned_addr learned my addr 172.21.15.6:0/583160914 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:25.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.025+0000 7fe5ca834700 1 --2- 172.21.15.6:0/583160914 >> v2:172.21.15.40:3300/0 conn(0x7fe5c415d690 0x7fe5c406c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:25.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.025+0000 7fe5ca033700 1 --2- 172.21.15.6:0/583160914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5c415ce50 0x7fe5c40cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:25.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.025+0000 7fe5c9832700 1 -- 172.21.15.6:0/583160914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5c415ce50 msgr2=0x7fe5c40cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:25.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.025+0000 7fe5c9832700 1 --2- 172.21.15.6:0/583160914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5c415ce50 0x7fe5c40cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.025+0000 7fe5c9832700 1 -- 172.21.15.6:0/583160914 >> v2:172.21.15.40:3300/0 conn(0x7fe5c415d690 msgr2=0x7fe5c406c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:25.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.025+0000 7fe5c9832700 1 --2- 172.21.15.6:0/583160914 >> v2:172.21.15.40:3300/0 conn(0x7fe5c415d690 0x7fe5c406c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.025+0000 7fe5c9832700 1 -- 172.21.15.6:0/583160914 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c4160590 con 0x7fe5c415d220 2023-07-06T19:59:25.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.025+0000 7fe5ca834700 1 --2- 172.21.15.6:0/583160914 >> v2:172.21.15.40:3300/0 conn(0x7fe5c415d690 0x7fe5c406c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:25.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.026+0000 7fe5c9832700 1 --2- 172.21.15.6:0/583160914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c415d220 0x7fe5c406bdb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40b8ce0 tx=0x7fe5c0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2938952bdeb2da4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:25.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.026+0000 7fe5c9031700 1 -- 172.21.15.6:0/583160914 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c000b870 con 0x7fe5c415d220 2023-07-06T19:59:25.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.026+0000 7fe5c9031700 1 -- 172.21.15.6:0/583160914 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c000b9d0 con 0x7fe5c415d220 2023-07-06T19:59:25.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.026+0000 7fe5c9031700 1 -- 172.21.15.6:0/583160914 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c000bd60 con 0x7fe5c415d220 2023-07-06T19:59:25.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.026+0000 7fe5cc297700 1 -- 172.21.15.6:0/583160914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c415d220 msgr2=0x7fe5c406bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:25.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.026+0000 7fe5cc297700 1 --2- 172.21.15.6:0/583160914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c415d220 0x7fe5c406bdb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40b8ce0 tx=0x7fe5c0009bd0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.026+0000 7fe5cc297700 1 -- 172.21.15.6:0/583160914 shutdown_connections 2023-07-06T19:59:25.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.026+0000 7fe5cc297700 1 --2- 172.21.15.6:0/583160914 >> v2:172.21.15.40:3300/0 conn(0x7fe5c415d690 0x7fe5c406c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.026+0000 7fe5cc297700 1 --2- 172.21.15.6:0/583160914 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5c415ce50 0x7fe5c40cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.026+0000 7fe5cc297700 1 --2- 172.21.15.6:0/583160914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c415d220 0x7fe5c406bdb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.026+0000 7fe5cc297700 1 -- 172.21.15.6:0/583160914 >> 172.21.15.6:0/583160914 conn(0x7fe5c40d3880 msgr2=0x7fe5c40cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:25.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.026+0000 7fe5cc297700 1 -- 172.21.15.6:0/583160914 shutdown_connections 2023-07-06T19:59:25.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.026+0000 7fe5cc297700 1 -- 172.21.15.6:0/583160914 wait complete. 2023-07-06T19:59:25.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.028+0000 7fe5cc297700 1 Processor -- start 2023-07-06T19:59:25.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.028+0000 7fe5cc297700 1 -- start start 2023-07-06T19:59:25.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.028+0000 7fe5cc297700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5c415ce50 0x7fe5c40c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:25.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.028+0000 7fe5cc297700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5c415d220 0x7fe5c41e5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:25.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.028+0000 7fe5cc297700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c415d690 0x7fe5c4151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:25.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.028+0000 7fe5cc297700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c41e62f0 con 0x7fe5c415d690 2023-07-06T19:59:25.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.028+0000 7fe5cc297700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c41e6520 con 0x7fe5c415d220 2023-07-06T19:59:25.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.028+0000 7fe5cc297700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c41e6800 con 0x7fe5c415ce50 2023-07-06T19:59:25.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.029+0000 7fe5ca834700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c415d690 0x7fe5c4151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:25.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.029+0000 7fe5ca834700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c415d690 0x7fe5c4151000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59334/0 (socket says 172.21.15.6:59334) 2023-07-06T19:59:25.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.029+0000 7fe5ca834700 1 -- 172.21.15.6:0/3728129441 learned_addr learned my addr 172.21.15.6:0/3728129441 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:25.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.029+0000 7fe5ca033700 1 --2- 172.21.15.6:0/3728129441 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5c415ce50 0x7fe5c40c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:25.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.029+0000 7fe5c9832700 1 --2- 172.21.15.6:0/3728129441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5c415d220 0x7fe5c41e5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:25.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.029+0000 7fe5ca834700 1 -- 172.21.15.6:0/3728129441 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5c415ce50 msgr2=0x7fe5c40c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:25.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.029+0000 7fe5ca834700 1 --2- 172.21.15.6:0/3728129441 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5c415ce50 0x7fe5c40c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.029+0000 7fe5ca834700 1 -- 172.21.15.6:0/3728129441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5c415d220 msgr2=0x7fe5c41e5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:25.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.029+0000 7fe5ca834700 1 --2- 172.21.15.6:0/3728129441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5c415d220 0x7fe5c41e5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.029+0000 7fe5ca834700 1 -- 172.21.15.6:0/3728129441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c0009550 con 0x7fe5c415d690 2023-07-06T19:59:25.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.029+0000 7fe5c9832700 1 --2- 172.21.15.6:0/3728129441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5c415d220 0x7fe5c41e5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:25.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.029+0000 7fe5ca834700 1 --2- 172.21.15.6:0/3728129441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c415d690 0x7fe5c4151000 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc007df0 tx=0x7fe5bc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:25.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.029+0000 7fe5b6ffd700 1 -- 172.21.15.6:0/3728129441 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc00ddd0 con 0x7fe5c415d690 2023-07-06T19:59:25.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.029+0000 7fe5b6ffd700 1 -- 172.21.15.6:0/3728129441 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5bc00f040 con 0x7fe5c415d690 2023-07-06T19:59:25.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.029+0000 7fe5cc297700 1 -- 172.21.15.6:0/3728129441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c4160f10 con 0x7fe5c415d690 2023-07-06T19:59:25.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.029+0000 7fe5b6ffd700 1 -- 172.21.15.6:0/3728129441 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc003c60 con 0x7fe5c415d690 2023-07-06T19:59:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.029+0000 7fe5cc297700 1 -- 172.21.15.6:0/3728129441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c41e6dc0 con 0x7fe5c415d690 2023-07-06T19:59:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.030+0000 7fe5cc297700 1 -- 172.21.15.6:0/3728129441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c4074200 con 0x7fe5c415d690 2023-07-06T19:59:25.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.031+0000 7fe5b6ffd700 1 -- 172.21.15.6:0/3728129441 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe5bc004030 con 0x7fe5c415d690 2023-07-06T19:59:25.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.031+0000 7fe5b6ffd700 1 --2- 172.21.15.6:0/3728129441 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe5a806ace0 0x7fe5a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:25.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.031+0000 7fe5b6ffd700 1 -- 172.21.15.6:0/3728129441 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe5bc0899a0 con 0x7fe5c415d690 2023-07-06T19:59:25.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.031+0000 7fe5ca033700 1 --2- 172.21.15.6:0/3728129441 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe5a806ace0 0x7fe5a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.032+0000 7fe5ca033700 1 --2- 172.21.15.6:0/3728129441 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe5a806ace0 0x7fe5a806d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800c900 tx=0x7fe5b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.035+0000 7fe5b6ffd700 1 -- 172.21.15.6:0/3728129441 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe5bc054760 con 0x7fe5c415d690 2023-07-06T19:59:25.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.235+0000 7fe5cc297700 1 -- 172.21.15.6:0/3728129441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5c40c93c0 con 0x7fe5c415d690 2023-07-06T19:59:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.236+0000 7fe5b6ffd700 1 -- 172.21.15.6:0/3728129441 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19964 (secure 0 0 0) 0x7fe5bc057d80 con 0x7fe5c415d690 2023-07-06T19:59:25.240 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:25.241 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:58:58.202291+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T19:58:51.062712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T19:58:52.130350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T19:58:55.785128+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:59:25.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.238+0000 7fe5cc297700 1 -- 172.21.15.6:0/3728129441 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe5a806ace0 msgr2=0x7fe5a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:25.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.238+0000 7fe5cc297700 1 --2- 172.21.15.6:0/3728129441 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe5a806ace0 0x7fe5a806d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800c900 tx=0x7fe5b8008040 comp rx=0 tx=0).stop 2023-07-06T19:59:25.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.238+0000 7fe5cc297700 1 -- 172.21.15.6:0/3728129441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c415d690 msgr2=0x7fe5c4151000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:25.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.238+0000 7fe5cc297700 1 --2- 172.21.15.6:0/3728129441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c415d690 0x7fe5c4151000 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc007df0 tx=0x7fe5bc00d3b0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.238+0000 7fe5cc297700 1 -- 172.21.15.6:0/3728129441 shutdown_connections 2023-07-06T19:59:25.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.238+0000 7fe5cc297700 1 --2- 172.21.15.6:0/3728129441 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe5a806ace0 0x7fe5a806d190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.238+0000 7fe5cc297700 1 --2- 172.21.15.6:0/3728129441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c415d690 0x7fe5c4151000 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.238+0000 7fe5cc297700 1 --2- 172.21.15.6:0/3728129441 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5c415ce50 0x7fe5c40c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.238+0000 7fe5cc297700 1 --2- 172.21.15.6:0/3728129441 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5c415d220 0x7fe5c41e5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.238+0000 7fe5cc297700 1 -- 172.21.15.6:0/3728129441 >> 172.21.15.6:0/3728129441 conn(0x7fe5c40d3880 msgr2=0x7fe5c4157620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:25.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.239+0000 7fe5cc297700 1 -- 172.21.15.6:0/3728129441 shutdown_connections 2023-07-06T19:59:25.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.239+0000 7fe5cc297700 1 -- 172.21.15.6:0/3728129441 wait complete. 2023-07-06T19:59:25.252 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T19:58:38.767727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T19:58:45.759808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T19:58:51.062712+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T19:58:52.130350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T19:58:55.785128+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T19:59:25.253 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T19:59:25.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.383+0000 7fc5eaefe700 1 Processor -- start 2023-07-06T19:59:25.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.384+0000 7fc5eaefe700 1 -- start start 2023-07-06T19:59:25.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.384+0000 7fc5eaefe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5e40d15e0 0x7fc5e406e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:25.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.384+0000 7fc5eaefe700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e40cd300 con 0x7fc5e40ce860 2023-07-06T19:59:25.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.384+0000 7fc5eaefe700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e40b0290 con 0x7fc5e415a520 2023-07-06T19:59:25.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.384+0000 7fc5eaefe700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e40ccd80 con 0x7fc5e40d15e0 2023-07-06T19:59:25.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.384+0000 7fc5e949b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc5e40ce860 0x7fc5e40cece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60550/0 (socket says 172.21.15.6:60550) 2023-07-06T19:59:25.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.384+0000 7fc5e949b700 1 -- 172.21.15.6:0/2248375487 learned_addr learned my addr 172.21.15.6:0/2248375487 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:25.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.385+0000 7fc5e3fff700 1 --2- 172.21.15.6:0/2248375487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5e40d15e0 0x7fc5e406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:25.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.385+0000 7fc5e37fe700 1 -- 172.21.15.6:0/2248375487 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 64369866 0 0) 0x7fc5e40cd300 con 0x7fc5e40ce860 2023-07-06T19:59:25.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.385+0000 7fc5e37fe700 1 -- 172.21.15.6:0/2248375487 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5d40035b0 con 0x7fc5e40ce860 2023-07-06T19:59:25.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.385+0000 7fc5e37fe700 1 -- 172.21.15.6:0/2248375487 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925047177 0 0) 0x7fc5e40b0290 con 0x7fc5e415a520 2023-07-06T19:59:25.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.385+0000 7fc5e37fe700 1 -- 172.21.15.6:0/2248375487 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5e40cd300 con 0x7fc5e415a520 2023-07-06T19:59:25.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.385+0000 7fc5e37fe700 1 -- 172.21.15.6:0/2248375487 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2926175602 0 0) 0x7fc5d40035b0 con 0x7fc5e40ce860 2023-07-06T19:59:25.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.385+0000 7fc5e37fe700 1 -- 172.21.15.6:0/2248375487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5e40d15e0 msgr2=0x7fc5e406e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:25.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.385+0000 7fc5e37fe700 1 --2- 172.21.15.6:0/2248375487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5e40d15e0 0x7fc5e406e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.385+0000 7fc5e37fe700 1 -- 172.21.15.6:0/2248375487 >> v1:172.21.15.40:6789/0 conn(0x7fc5e415a520 legacy=0x7fc5e406dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:25.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.385+0000 7fc5e37fe700 1 -- 172.21.15.6:0/2248375487 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e40cd020 con 0x7fc5e40ce860 2023-07-06T19:59:25.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.385+0000 7fc5e37fe700 1 -- 172.21.15.6:0/2248375487 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7fc5dc0019f0 con 0x7fc5e40ce860 2023-07-06T19:59:25.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.385+0000 7fc5e3fff700 1 --2- 172.21.15.6:0/2248375487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5e40d15e0 0x7fc5e406e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:59:25.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.385+0000 7fc5e37fe700 1 -- 172.21.15.6:0/2248375487 >> v1:172.21.15.6:6789/0 conn(0x7fc5e40ce860 legacy=0x7fc5e40cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:25.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.385+0000 7fc5e37fe700 1 --2- 172.21.15.6:0/2248375487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5d4003bc0 0x7fc5d4003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:25.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.385+0000 7fc5e37fe700 1 --2- 172.21.15.6:0/2248375487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5e40d15e0 0x7fc5d4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:25.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.385+0000 7fc5e37fe700 1 --2- 172.21.15.6:0/2248375487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5d4004d90 0x7fc5d4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:25.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.385+0000 7fc5e37fe700 1 -- 172.21.15.6:0/2248375487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e40ccd80 con 0x7fc5d4004d90 2023-07-06T19:59:25.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.385+0000 7fc5e37fe700 1 -- 172.21.15.6:0/2248375487 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d400bac0 con 0x7fc5d4003bc0 2023-07-06T19:59:25.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.385+0000 7fc5e37fe700 1 -- 172.21.15.6:0/2248375487 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d400bc00 con 0x7fc5e40d15e0 2023-07-06T19:59:25.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.385+0000 7fc5e949b700 1 --2- 172.21.15.6:0/2248375487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5d4004d90 0x7fc5d4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:25.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.385+0000 7fc5e8c9a700 1 --2- 172.21.15.6:0/2248375487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5d4003bc0 0x7fc5d4003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:25.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.385+0000 7fc5e3fff700 1 --2- 172.21.15.6:0/2248375487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5e40d15e0 0x7fc5d4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:25.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.386+0000 7fc5e949b700 1 -- 172.21.15.6:0/2248375487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5e40d15e0 msgr2=0x7fc5d4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:25.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.386+0000 7fc5e949b700 1 --2- 172.21.15.6:0/2248375487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5e40d15e0 0x7fc5d4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.386+0000 7fc5e949b700 1 -- 172.21.15.6:0/2248375487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5d4003bc0 msgr2=0x7fc5d4003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:25.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.386+0000 7fc5e949b700 1 --2- 172.21.15.6:0/2248375487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5d4003bc0 0x7fc5d4003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.386+0000 7fc5e949b700 1 -- 172.21.15.6:0/2248375487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d00094a0 con 0x7fc5d4004d90 2023-07-06T19:59:25.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.386+0000 7fc5e949b700 1 --2- 172.21.15.6:0/2248375487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5d4004d90 0x7fc5d4005200 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc00a7a0 tx=0x7fc5d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a89ded738eed98 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:25.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.386+0000 7fc5e37fe700 1 -- 172.21.15.6:0/2248375487 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc012600 con 0x7fc5d4004d90 2023-07-06T19:59:25.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.386+0000 7fc5e37fe700 1 -- 172.21.15.6:0/2248375487 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5dc012780 con 0x7fc5d4004d90 2023-07-06T19:59:25.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.386+0000 7fc5e37fe700 1 -- 172.21.15.6:0/2248375487 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc012b30 con 0x7fc5d4004d90 2023-07-06T19:59:25.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.386+0000 7fc5eaefe700 1 -- 172.21.15.6:0/2248375487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5d4004d90 msgr2=0x7fc5d4005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:25.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.386+0000 7fc5eaefe700 1 --2- 172.21.15.6:0/2248375487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5d4004d90 0x7fc5d4005200 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc00a7a0 tx=0x7fc5d4005880 comp rx=0 tx=0).stop 2023-07-06T19:59:25.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.386+0000 7fc5e949b700 1 -- 172.21.15.6:0/2248375487 reap_dead start 2023-07-06T19:59:25.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.386+0000 7fc5eaefe700 1 -- 172.21.15.6:0/2248375487 shutdown_connections 2023-07-06T19:59:25.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.386+0000 7fc5eaefe700 1 -- 172.21.15.6:0/2248375487 >> 172.21.15.6:0/2248375487 conn(0x7fc5e40ce120 msgr2=0x7fc5e40d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:25.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.386+0000 7fc5eaefe700 1 -- 172.21.15.6:0/2248375487 shutdown_connections 2023-07-06T19:59:25.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.386+0000 7fc5eaefe700 1 -- 172.21.15.6:0/2248375487 wait complete. 2023-07-06T19:59:25.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.388+0000 7fc5eaefe700 1 Processor -- start 2023-07-06T19:59:25.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.388+0000 7fc5eaefe700 1 -- start start 2023-07-06T19:59:25.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.388+0000 7fc5eaefe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5e40c38b0 0x7fc5e4158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:25.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.388+0000 7fc5eaefe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5e4156720 0x7fc5e40c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:25.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.388+0000 7fc5eaefe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5e40ca490 0x7fc5e41e3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:25.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.388+0000 7fc5eaefe700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e40ca900 con 0x7fc5e40c38b0 2023-07-06T19:59:25.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.388+0000 7fc5eaefe700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e40b4700 con 0x7fc5e4156720 2023-07-06T19:59:25.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.388+0000 7fc5eaefe700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e40b49e0 con 0x7fc5e40ca490 2023-07-06T19:59:25.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.389+0000 7fc5e8c9a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5e40c38b0 0x7fc5e4158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:25.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.389+0000 7fc5e8c9a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5e40c38b0 0x7fc5e4158de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59350/0 (socket says 172.21.15.6:59350) 2023-07-06T19:59:25.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.389+0000 7fc5e8c9a700 1 -- 172.21.15.6:0/4205613073 learned_addr learned my addr 172.21.15.6:0/4205613073 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:25.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.389+0000 7fc5e949b700 1 --2- 172.21.15.6:0/4205613073 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5e40ca490 0x7fc5e41e3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:25.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.389+0000 7fc5e3fff700 1 --2- 172.21.15.6:0/4205613073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5e4156720 0x7fc5e40c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:25.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.389+0000 7fc5e8c9a700 1 -- 172.21.15.6:0/4205613073 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5e40ca490 msgr2=0x7fc5e41e3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:25.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.389+0000 7fc5e8c9a700 1 --2- 172.21.15.6:0/4205613073 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5e40ca490 0x7fc5e41e3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.389+0000 7fc5e8c9a700 1 -- 172.21.15.6:0/4205613073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5e4156720 msgr2=0x7fc5e40c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.389+0000 7fc5e8c9a700 1 --2- 172.21.15.6:0/4205613073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5e4156720 0x7fc5e40c9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.389+0000 7fc5e8c9a700 1 -- 172.21.15.6:0/4205613073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e40b4cc0 con 0x7fc5e40c38b0 2023-07-06T19:59:25.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.389+0000 7fc5e8c9a700 1 --2- 172.21.15.6:0/4205613073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5e40c38b0 0x7fc5e4158de0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc5d800f810 tx=0x7fc5d800fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:25.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.389+0000 7fc5e17fa700 1 -- 172.21.15.6:0/4205613073 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d80052e0 con 0x7fc5e40c38b0 2023-07-06T19:59:25.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.389+0000 7fc5e17fa700 1 -- 172.21.15.6:0/4205613073 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d8005440 con 0x7fc5e40c38b0 2023-07-06T19:59:25.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.389+0000 7fc5eaefe700 1 -- 172.21.15.6:0/4205613073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e40b4fa0 con 0x7fc5e40c38b0 2023-07-06T19:59:25.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.389+0000 7fc5e17fa700 1 -- 172.21.15.6:0/4205613073 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d80038c0 con 0x7fc5e40c38b0 2023-07-06T19:59:25.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.389+0000 7fc5eaefe700 1 -- 172.21.15.6:0/4205613073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e40c3c80 con 0x7fc5e40c38b0 2023-07-06T19:59:25.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.390+0000 7fc5eaefe700 1 -- 172.21.15.6:0/4205613073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e404eb90 con 0x7fc5e40c38b0 2023-07-06T19:59:25.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.391+0000 7fc5e17fa700 1 -- 172.21.15.6:0/4205613073 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc5d8003a20 con 0x7fc5e40c38b0 2023-07-06T19:59:25.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.391+0000 7fc5e17fa700 1 --2- 172.21.15.6:0/4205613073 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc5c806ace0 0x7fc5c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:25.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.391+0000 7fc5e17fa700 1 -- 172.21.15.6:0/4205613073 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc5d8089590 con 0x7fc5e40c38b0 2023-07-06T19:59:25.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.391+0000 7fc5e3fff700 1 --2- 172.21.15.6:0/4205613073 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc5c806ace0 0x7fc5c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:25.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.392+0000 7fc5e3fff700 1 --2- 172.21.15.6:0/4205613073 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc5c806ace0 0x7fc5c806d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4156e20 tx=0x7fc5d0009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:25.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.396+0000 7fc5e17fa700 1 -- 172.21.15.6:0/4205613073 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc5d8054350 con 0x7fc5e40c38b0 2023-07-06T19:59:25.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.591+0000 7fc5eaefe700 1 -- 172.21.15.6:0/4205613073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc5e40d0e30 con 0x7fc5e40c38b0 2023-07-06T19:59:25.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.591+0000 7fc5e17fa700 1 -- 172.21.15.6:0/4205613073 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc5d8057970 con 0x7fc5e40c38b0 2023-07-06T19:59:25.592 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-06T19:59:25.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.593+0000 7fc5eaefe700 1 -- 172.21.15.6:0/4205613073 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc5c806ace0 msgr2=0x7fc5c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:25.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.593+0000 7fc5eaefe700 1 --2- 172.21.15.6:0/4205613073 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc5c806ace0 0x7fc5c806d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4156e20 tx=0x7fc5d0009210 comp rx=0 tx=0).stop 2023-07-06T19:59:25.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.593+0000 7fc5eaefe700 1 -- 172.21.15.6:0/4205613073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5e40c38b0 msgr2=0x7fc5e4158de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:25.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.593+0000 7fc5eaefe700 1 --2- 172.21.15.6:0/4205613073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5e40c38b0 0x7fc5e4158de0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc5d800f810 tx=0x7fc5d800fb20 comp rx=0 tx=0).stop 2023-07-06T19:59:25.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.593+0000 7fc5eaefe700 1 -- 172.21.15.6:0/4205613073 shutdown_connections 2023-07-06T19:59:25.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.593+0000 7fc5eaefe700 1 --2- 172.21.15.6:0/4205613073 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc5c806ace0 0x7fc5c806d190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.593+0000 7fc5eaefe700 1 --2- 172.21.15.6:0/4205613073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5e40c38b0 0x7fc5e4158de0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.593+0000 7fc5eaefe700 1 --2- 172.21.15.6:0/4205613073 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc5e40ca490 0x7fc5e41e3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.593+0000 7fc5eaefe700 1 --2- 172.21.15.6:0/4205613073 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5e4156720 0x7fc5e40c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.593+0000 7fc5eaefe700 1 -- 172.21.15.6:0/4205613073 >> 172.21.15.6:0/4205613073 conn(0x7fc5e40ce120 msgr2=0x7fc5e40cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:25.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.593+0000 7fc5eaefe700 1 -- 172.21.15.6:0/4205613073 shutdown_connections 2023-07-06T19:59:25.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.593+0000 7fc5eaefe700 1 -- 172.21.15.6:0/4205613073 wait complete. 2023-07-06T19:59:25.606 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T19:59:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.732+0000 7fd49015f700 1 Processor -- start 2023-07-06T19:59:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.733+0000 7fd49015f700 1 -- start start 2023-07-06T19:59:25.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.733+0000 7fd49015f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd4881592b0 0x7fd488071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:25.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.733+0000 7fd49015f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48806e700 con 0x7fd48815cd40 2023-07-06T19:59:25.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.733+0000 7fd49015f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4880cc160 con 0x7fd4880cd950 2023-07-06T19:59:25.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.733+0000 7fd49015f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd488159680 con 0x7fd4881592b0 2023-07-06T19:59:25.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.733+0000 7fd48d6fa700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fd48815cd40 0x7fd48806d8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60568/0 (socket says 172.21.15.6:60568) 2023-07-06T19:59:25.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.733+0000 7fd48d6fa700 1 -- 172.21.15.6:0/3671952200 learned_addr learned my addr 172.21.15.6:0/3671952200 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:25.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.734+0000 7fd48defb700 1 --2- 172.21.15.6:0/3671952200 >> v2:172.21.15.40:3300/0 conn(0x7fd4881592b0 0x7fd488071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:25.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.734+0000 7fd48cef9700 1 -- 172.21.15.6:0/3671952200 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3173386755 0 0) 0x7fd48806e700 con 0x7fd48815cd40 2023-07-06T19:59:25.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.734+0000 7fd48cef9700 1 -- 172.21.15.6:0/3671952200 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4740035b0 con 0x7fd48815cd40 2023-07-06T19:59:25.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.734+0000 7fd48defb700 1 -- 172.21.15.6:0/3671952200 >> v1:172.21.15.40:6789/0 conn(0x7fd4880cd950 legacy=0x7fd48806dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:25.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.734+0000 7fd48defb700 1 -- 172.21.15.6:0/3671952200 >> v1:172.21.15.6:6789/0 conn(0x7fd48815cd40 legacy=0x7fd48806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:25.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.734+0000 7fd48cef9700 1 -- 172.21.15.6:0/3671952200 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2355217842 0 0) 0x7fd4740035b0 con 0x7fd48815cd40 2023-07-06T19:59:25.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.734+0000 7fd48defb700 1 -- 172.21.15.6:0/3671952200 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48815d2b0 con 0x7fd4881592b0 2023-07-06T19:59:25.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.734+0000 7fd48defb700 1 --2- 172.21.15.6:0/3671952200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4881592b0 0x7fd488071690 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd484009840 tx=0x7fd484009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc171b1ef1922635 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:25.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.734+0000 7fd48cef9700 1 -- 172.21.15.6:0/3671952200 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c001670 con 0x7fd4881592b0 2023-07-06T19:59:25.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.734+0000 7fd48cef9700 1 -- 172.21.15.6:0/3671952200 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd484004030 con 0x7fd4881592b0 2023-07-06T19:59:25.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.734+0000 7fd48cef9700 1 -- 172.21.15.6:0/3671952200 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4840043c0 con 0x7fd4881592b0 2023-07-06T19:59:25.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.735+0000 7fd49015f700 1 -- 172.21.15.6:0/3671952200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4881592b0 msgr2=0x7fd488071690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:25.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.735+0000 7fd49015f700 1 --2- 172.21.15.6:0/3671952200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4881592b0 0x7fd488071690 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd484009840 tx=0x7fd484009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:25.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.735+0000 7fd49015f700 1 -- 172.21.15.6:0/3671952200 shutdown_connections 2023-07-06T19:59:25.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.735+0000 7fd49015f700 1 --2- 172.21.15.6:0/3671952200 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4881592b0 0x7fd488071690 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.735+0000 7fd49015f700 1 -- 172.21.15.6:0/3671952200 >> 172.21.15.6:0/3671952200 conn(0x7fd4880cf960 msgr2=0x7fd4880cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:25.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.735+0000 7fd49015f700 1 -- 172.21.15.6:0/3671952200 shutdown_connections 2023-07-06T19:59:25.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.735+0000 7fd49015f700 1 -- 172.21.15.6:0/3671952200 wait complete. 2023-07-06T19:59:25.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.736+0000 7fd49015f700 1 Processor -- start 2023-07-06T19:59:25.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.736+0000 7fd49015f700 1 -- start start 2023-07-06T19:59:25.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.737+0000 7fd49015f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4880cd950 0x7fd488149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:25.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.737+0000 7fd49015f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4881592b0 0x7fd488149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:25.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.737+0000 7fd49015f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd48815cd40 0x7fd4880b0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:25.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.737+0000 7fd49015f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4880b16b0 con 0x7fd4881592b0 2023-07-06T19:59:25.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.737+0000 7fd49015f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4880b0aa0 con 0x7fd4880cd950 2023-07-06T19:59:25.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.737+0000 7fd49015f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4880b0d80 con 0x7fd48815cd40 2023-07-06T19:59:25.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.737+0000 7fd48d6fa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4881592b0 0x7fd488149720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:25.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.737+0000 7fd48d6fa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4881592b0 0x7fd488149720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59364/0 (socket says 172.21.15.6:59364) 2023-07-06T19:59:25.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.737+0000 7fd48d6fa700 1 -- 172.21.15.6:0/211521186 learned_addr learned my addr 172.21.15.6:0/211521186 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:25.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.737+0000 7fd48defb700 1 --2- 172.21.15.6:0/211521186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4880cd950 0x7fd488149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:25.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.737+0000 7fd48e6fc700 1 --2- 172.21.15.6:0/211521186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd48815cd40 0x7fd4880b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:25.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.737+0000 7fd48d6fa700 1 -- 172.21.15.6:0/211521186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd48815cd40 msgr2=0x7fd4880b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:25.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.737+0000 7fd48d6fa700 1 --2- 172.21.15.6:0/211521186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd48815cd40 0x7fd4880b0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.737+0000 7fd48d6fa700 1 -- 172.21.15.6:0/211521186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4880cd950 msgr2=0x7fd488149ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:25.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.737+0000 7fd48d6fa700 1 --2- 172.21.15.6:0/211521186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4880cd950 0x7fd488149ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.737+0000 7fd48d6fa700 1 -- 172.21.15.6:0/211521186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4840094a0 con 0x7fd4881592b0 2023-07-06T19:59:25.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.738+0000 7fd48d6fa700 1 --2- 172.21.15.6:0/211521186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4881592b0 0x7fd488149720 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd47c00e990 tx=0x7fd47c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:25.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.738+0000 7fd47a7fc700 1 -- 172.21.15.6:0/211521186 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c004a80 con 0x7fd4881592b0 2023-07-06T19:59:25.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.738+0000 7fd47a7fc700 1 -- 172.21.15.6:0/211521186 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47c004be0 con 0x7fd4881592b0 2023-07-06T19:59:25.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.738+0000 7fd49015f700 1 -- 172.21.15.6:0/211521186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4880b1060 con 0x7fd4881592b0 2023-07-06T19:59:25.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.738+0000 7fd47a7fc700 1 -- 172.21.15.6:0/211521186 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c0070d0 con 0x7fd4881592b0 2023-07-06T19:59:25.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.738+0000 7fd49015f700 1 -- 172.21.15.6:0/211521186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd488149c60 con 0x7fd4881592b0 2023-07-06T19:59:25.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.739+0000 7fd49015f700 1 -- 172.21.15.6:0/211521186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4880b1820 con 0x7fd4881592b0 2023-07-06T19:59:25.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.739+0000 7fd47a7fc700 1 -- 172.21.15.6:0/211521186 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd47c007230 con 0x7fd4881592b0 2023-07-06T19:59:25.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.740+0000 7fd47a7fc700 1 --2- 172.21.15.6:0/211521186 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd46c06ace0 0x7fd46c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:25.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.740+0000 7fd47a7fc700 1 -- 172.21.15.6:0/211521186 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd47c08bcb0 con 0x7fd4881592b0 2023-07-06T19:59:25.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.740+0000 7fd48defb700 1 --2- 172.21.15.6:0/211521186 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd46c06ace0 0x7fd46c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:25.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.740+0000 7fd48defb700 1 --2- 172.21.15.6:0/211521186 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd46c06ace0 0x7fd46c06d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd4840090b0 tx=0x7fd484008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:25.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.744+0000 7fd47a7fc700 1 -- 172.21.15.6:0/211521186 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd47c056a70 con 0x7fd4881592b0 2023-07-06T19:59:25.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.946+0000 7fd49015f700 1 -- 172.21.15.6:0/211521186 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd48804eb90 con 0x7fd4881592b0 2023-07-06T19:59:25.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.947+0000 7fd47a7fc700 1 -- 172.21.15.6:0/211521186 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd47c0150a0 con 0x7fd4881592b0 2023-07-06T19:59:25.948 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-06T19:59:25.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.949+0000 7fd49015f700 1 -- 172.21.15.6:0/211521186 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd46c06ace0 msgr2=0x7fd46c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:25.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.949+0000 7fd49015f700 1 --2- 172.21.15.6:0/211521186 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd46c06ace0 0x7fd46c06d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd4840090b0 tx=0x7fd484008030 comp rx=0 tx=0).stop 2023-07-06T19:59:25.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.949+0000 7fd49015f700 1 -- 172.21.15.6:0/211521186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4881592b0 msgr2=0x7fd488149720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:25.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.949+0000 7fd49015f700 1 --2- 172.21.15.6:0/211521186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4881592b0 0x7fd488149720 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd47c00e990 tx=0x7fd47c00eca0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.949+0000 7fd49015f700 1 -- 172.21.15.6:0/211521186 shutdown_connections 2023-07-06T19:59:25.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.949+0000 7fd49015f700 1 --2- 172.21.15.6:0/211521186 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd46c06ace0 0x7fd46c06d190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.949+0000 7fd49015f700 1 --2- 172.21.15.6:0/211521186 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd48815cd40 0x7fd4880b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.949+0000 7fd49015f700 1 --2- 172.21.15.6:0/211521186 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd4880cd950 0x7fd488149ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.949+0000 7fd49015f700 1 --2- 172.21.15.6:0/211521186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4881592b0 0x7fd488149720 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:25.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.949+0000 7fd49015f700 1 -- 172.21.15.6:0/211521186 >> 172.21.15.6:0/211521186 conn(0x7fd4880cf960 msgr2=0x7fd48806d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:25.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.949+0000 7fd49015f700 1 -- 172.21.15.6:0/211521186 shutdown_connections 2023-07-06T19:59:25.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:25.949+0000 7fd49015f700 1 -- 172.21.15.6:0/211521186 wait complete. 2023-07-06T19:59:25.962 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T19:59:26.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.089+0000 7fdbbe9a7700 1 Processor -- start 2023-07-06T19:59:26.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.089+0000 7fdbbe9a7700 1 -- start start 2023-07-06T19:59:26.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.090+0000 7fdbbe9a7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdbb8071900 0x7fdbb80ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:26.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.090+0000 7fdbbe9a7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb80cb310 con 0x7fdbb815c660 2023-07-06T19:59:26.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.090+0000 7fdbbe9a7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb80af070 con 0x7fdbb8071cd0 2023-07-06T19:59:26.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.090+0000 7fdbbe9a7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb80cdbf0 con 0x7fdbb8071900 2023-07-06T19:59:26.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.090+0000 7fdbb7fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdbb8071900 0x7fdbb80ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:26.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.090+0000 7fdbbcf44700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdbb815c660 0x7fdbb80ce010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60580/0 (socket says 172.21.15.6:60580) 2023-07-06T19:59:26.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.090+0000 7fdbbcf44700 1 -- 172.21.15.6:0/2660471636 learned_addr learned my addr 172.21.15.6:0/2660471636 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:26.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.090+0000 7fdbb7fff700 1 -- 172.21.15.6:0/2660471636 >> v1:172.21.15.40:6789/0 conn(0x7fdbb8071cd0 legacy=0x7fdbb815bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:26.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.090+0000 7fdbb7fff700 1 -- 172.21.15.6:0/2660471636 >> v1:172.21.15.6:6789/0 conn(0x7fdbb815c660 legacy=0x7fdbb80ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:26.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.090+0000 7fdbb7fff700 1 -- 172.21.15.6:0/2660471636 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb80cad50 con 0x7fdbb8071900 2023-07-06T19:59:26.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.090+0000 7fdbb6ffd700 1 -- 172.21.15.6:0/2660471636 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128020694 0 0) 0x7fdbb80cb310 con 0x7fdbb815c660 2023-07-06T19:59:26.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.090+0000 7fdbb7fff700 1 --2- 172.21.15.6:0/2660471636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb8071900 0x7fdbb80ca140 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009840 tx=0x7fdba8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f406c7b603c011 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:26.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.090+0000 7fdbb6ffd700 1 -- 172.21.15.6:0/2660471636 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba8011830 con 0x7fdbb8071900 2023-07-06T19:59:26.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.090+0000 7fdbb6ffd700 1 -- 172.21.15.6:0/2660471636 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba8011990 con 0x7fdbb8071900 2023-07-06T19:59:26.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.090+0000 7fdbb6ffd700 1 -- 172.21.15.6:0/2660471636 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba8011d20 con 0x7fdbb8071900 2023-07-06T19:59:26.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.091+0000 7fdbbe9a7700 1 -- 172.21.15.6:0/2660471636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb8071900 msgr2=0x7fdbb80ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:26.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.091+0000 7fdbbe9a7700 1 --2- 172.21.15.6:0/2660471636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb8071900 0x7fdbb80ca140 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009840 tx=0x7fdba8009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:26.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.091+0000 7fdbbe9a7700 1 -- 172.21.15.6:0/2660471636 shutdown_connections 2023-07-06T19:59:26.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.091+0000 7fdbbe9a7700 1 --2- 172.21.15.6:0/2660471636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb8071900 0x7fdbb80ca140 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:26.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.091+0000 7fdbbe9a7700 1 -- 172.21.15.6:0/2660471636 >> 172.21.15.6:0/2660471636 conn(0x7fdbb80cf960 msgr2=0x7fdbb80cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:26.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.091+0000 7fdbbe9a7700 1 -- 172.21.15.6:0/2660471636 shutdown_connections 2023-07-06T19:59:26.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.091+0000 7fdbbe9a7700 1 -- 172.21.15.6:0/2660471636 wait complete. 2023-07-06T19:59:26.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.092+0000 7fdbbe9a7700 1 Processor -- start 2023-07-06T19:59:26.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.092+0000 7fdbbe9a7700 1 -- start start 2023-07-06T19:59:26.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.093+0000 7fdbbe9a7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb8071900 0x7fdbb8147e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:26.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.093+0000 7fdbbe9a7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdbb8071cd0 0x7fdbb814c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:26.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.093+0000 7fdbbe9a7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbb815c660 0x7fdbb814fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:26.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.093+0000 7fdbbe9a7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb81483c0 con 0x7fdbb8071900 2023-07-06T19:59:26.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.093+0000 7fdbbe9a7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb80b36c0 con 0x7fdbb815c660 2023-07-06T19:59:26.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.093+0000 7fdbbe9a7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb815dd40 con 0x7fdbb8071cd0 2023-07-06T19:59:26.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.093+0000 7fdbb7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb8071900 0x7fdbb8147e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:26.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.093+0000 7fdbb7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb8071900 0x7fdbb8147e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59374/0 (socket says 172.21.15.6:59374) 2023-07-06T19:59:26.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.093+0000 7fdbb7fff700 1 -- 172.21.15.6:0/712851628 learned_addr learned my addr 172.21.15.6:0/712851628 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:26.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.093+0000 7fdbbcf44700 1 --2- 172.21.15.6:0/712851628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbb815c660 0x7fdbb814fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:26.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.093+0000 7fdbb77fe700 1 --2- 172.21.15.6:0/712851628 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdbb8071cd0 0x7fdbb814c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:26.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.094+0000 7fdbb7fff700 1 -- 172.21.15.6:0/712851628 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdbb8071cd0 msgr2=0x7fdbb814c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:26.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.094+0000 7fdbb7fff700 1 --2- 172.21.15.6:0/712851628 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdbb8071cd0 0x7fdbb814c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:26.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.094+0000 7fdbb7fff700 1 -- 172.21.15.6:0/712851628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbb815c660 msgr2=0x7fdbb814fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:26.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.094+0000 7fdbb7fff700 1 --2- 172.21.15.6:0/712851628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbb815c660 0x7fdbb814fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:26.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.094+0000 7fdbb7fff700 1 -- 172.21.15.6:0/712851628 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba80094a0 con 0x7fdbb8071900 2023-07-06T19:59:26.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.094+0000 7fdbbcf44700 1 --2- 172.21.15.6:0/712851628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbb815c660 0x7fdbb814fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:26.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.094+0000 7fdbb7fff700 1 --2- 172.21.15.6:0/712851628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb8071900 0x7fdbb8147e80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009b90 tx=0x7fdba8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:26.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.094+0000 7fdbb4ff9700 1 -- 172.21.15.6:0/712851628 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba80036a0 con 0x7fdbb8071900 2023-07-06T19:59:26.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.094+0000 7fdbb4ff9700 1 -- 172.21.15.6:0/712851628 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba801e070 con 0x7fdbb8071900 2023-07-06T19:59:26.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.094+0000 7fdbbe9a7700 1 -- 172.21.15.6:0/712851628 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb815e020 con 0x7fdbb8071900 2023-07-06T19:59:26.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.094+0000 7fdbb4ff9700 1 -- 172.21.15.6:0/712851628 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba8003a00 con 0x7fdbb8071900 2023-07-06T19:59:26.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.094+0000 7fdbbe9a7700 1 -- 172.21.15.6:0/712851628 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb814cbb0 con 0x7fdbb8071900 2023-07-06T19:59:26.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.095+0000 7fdbbe9a7700 1 -- 172.21.15.6:0/712851628 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb804eb90 con 0x7fdbb8071900 2023-07-06T19:59:26.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.095+0000 7fdbb4ff9700 1 -- 172.21.15.6:0/712851628 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdba8003b60 con 0x7fdbb8071900 2023-07-06T19:59:26.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.096+0000 7fdbb4ff9700 1 --2- 172.21.15.6:0/712851628 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fdb9806ace0 0x7fdb9806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:26.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.096+0000 7fdbb4ff9700 1 -- 172.21.15.6:0/712851628 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdba8020070 con 0x7fdbb8071900 2023-07-06T19:59:26.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.096+0000 7fdbb77fe700 1 --2- 172.21.15.6:0/712851628 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fdb9806ace0 0x7fdb9806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:26.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.096+0000 7fdbb77fe700 1 --2- 172.21.15.6:0/712851628 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fdb9806ace0 0x7fdb9806d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdbb806bd60 tx=0x7fdba0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:26.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.100+0000 7fdbb4ff9700 1 -- 172.21.15.6:0/712851628 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdba8055ad0 con 0x7fdbb8071900 2023-07-06T19:59:26.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.296+0000 7fdbbe9a7700 1 -- 172.21.15.6:0/712851628 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdbb80b58e0 con 0x7fdbb8071900 2023-07-06T19:59:26.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.296+0000 7fdbb4ff9700 1 -- 172.21.15.6:0/712851628 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdba8015020 con 0x7fdbb8071900 2023-07-06T19:59:26.297 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T19:59:26.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.298+0000 7fdbbe9a7700 1 -- 172.21.15.6:0/712851628 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fdb9806ace0 msgr2=0x7fdb9806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:26.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.298+0000 7fdbbe9a7700 1 --2- 172.21.15.6:0/712851628 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fdb9806ace0 0x7fdb9806d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdbb806bd60 tx=0x7fdba0009040 comp rx=0 tx=0).stop 2023-07-06T19:59:26.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.298+0000 7fdbbe9a7700 1 -- 172.21.15.6:0/712851628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb8071900 msgr2=0x7fdbb8147e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:26.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.298+0000 7fdbbe9a7700 1 --2- 172.21.15.6:0/712851628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb8071900 0x7fdbb8147e80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009b90 tx=0x7fdba8004750 comp rx=0 tx=0).stop 2023-07-06T19:59:26.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.298+0000 7fdbbe9a7700 1 -- 172.21.15.6:0/712851628 shutdown_connections 2023-07-06T19:59:26.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.298+0000 7fdbbe9a7700 1 --2- 172.21.15.6:0/712851628 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fdb9806ace0 0x7fdb9806d190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:26.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.298+0000 7fdbbe9a7700 1 --2- 172.21.15.6:0/712851628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbb8071900 0x7fdbb8147e80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:26.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.298+0000 7fdbbe9a7700 1 --2- 172.21.15.6:0/712851628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbb815c660 0x7fdbb814fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:26.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.298+0000 7fdbbe9a7700 1 --2- 172.21.15.6:0/712851628 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdbb8071cd0 0x7fdbb814c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:26.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.298+0000 7fdbbe9a7700 1 -- 172.21.15.6:0/712851628 >> 172.21.15.6:0/712851628 conn(0x7fdbb80cf960 msgr2=0x7fdbb81486c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:26.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.298+0000 7fdbbe9a7700 1 -- 172.21.15.6:0/712851628 shutdown_connections 2023-07-06T19:59:26.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.298+0000 7fdbbe9a7700 1 -- 172.21.15.6:0/712851628 wait complete. 2023-07-06T19:59:26.312 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T19:59:26.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.439+0000 7fbb368dc700 1 Processor -- start 2023-07-06T19:59:26.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.439+0000 7fbb368dc700 1 -- start start 2023-07-06T19:59:26.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.439+0000 7fbb368dc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbb3015c660 0x7fbb30167420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:26.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.439+0000 7fbb368dc700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb300cb310 con 0x7fbb30071900 2023-07-06T19:59:26.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.439+0000 7fbb368dc700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb300af070 con 0x7fbb300ca850 2023-07-06T19:59:26.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.439+0000 7fbb368dc700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb300cdbf0 con 0x7fbb3015c660 2023-07-06T19:59:26.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.440+0000 7fbb2ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbb30071900 0x7fbb300ca140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60590/0 (socket says 172.21.15.6:60590) 2023-07-06T19:59:26.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.440+0000 7fbb2ffff700 1 -- 172.21.15.6:0/4045318602 learned_addr learned my addr 172.21.15.6:0/4045318602 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:26.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.440+0000 7fbb34e79700 1 --2- 172.21.15.6:0/4045318602 >> v2:172.21.15.40:3300/0 conn(0x7fbb3015c660 0x7fbb30167420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:26.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.440+0000 7fbb2effd700 1 -- 172.21.15.6:0/4045318602 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985529993 0 0) 0x7fbb300cb310 con 0x7fbb30071900 2023-07-06T19:59:26.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.440+0000 7fbb2effd700 1 -- 172.21.15.6:0/4045318602 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb1c0035b0 con 0x7fbb30071900 2023-07-06T19:59:26.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.440+0000 7fbb2effd700 1 -- 172.21.15.6:0/4045318602 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096686687 0 0) 0x7fbb300af070 con 0x7fbb300ca850 2023-07-06T19:59:26.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.440+0000 7fbb2effd700 1 -- 172.21.15.6:0/4045318602 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb300cb310 con 0x7fbb300ca850 2023-07-06T19:59:26.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.440+0000 7fbb34e79700 1 -- 172.21.15.6:0/4045318602 >> v1:172.21.15.40:6789/0 conn(0x7fbb300ca850 legacy=0x7fbb3015bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:26.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.440+0000 7fbb34e79700 1 -- 172.21.15.6:0/4045318602 >> v1:172.21.15.6:6789/0 conn(0x7fbb30071900 legacy=0x7fbb300ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:26.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.440+0000 7fbb34e79700 1 -- 172.21.15.6:0/4045318602 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb300cad50 con 0x7fbb3015c660 2023-07-06T19:59:26.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.440+0000 7fbb34e79700 1 --2- 172.21.15.6:0/4045318602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb3015c660 0x7fbb30167420 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbb28009d90 tx=0x7fbb2800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f511ea31022f4ba server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:26.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.440+0000 7fbb2effd700 1 -- 172.21.15.6:0/4045318602 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2800e070 con 0x7fbb3015c660 2023-07-06T19:59:26.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.440+0000 7fbb2effd700 1 -- 172.21.15.6:0/4045318602 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2800bb20 con 0x7fbb3015c660 2023-07-06T19:59:26.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.440+0000 7fbb2effd700 1 -- 172.21.15.6:0/4045318602 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2800be90 con 0x7fbb3015c660 2023-07-06T19:59:26.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.441+0000 7fbb368dc700 1 -- 172.21.15.6:0/4045318602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb3015c660 msgr2=0x7fbb30167420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:26.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.441+0000 7fbb368dc700 1 --2- 172.21.15.6:0/4045318602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb3015c660 0x7fbb30167420 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbb28009d90 tx=0x7fbb2800b330 comp rx=0 tx=0).stop 2023-07-06T19:59:26.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.441+0000 7fbb368dc700 1 -- 172.21.15.6:0/4045318602 shutdown_connections 2023-07-06T19:59:26.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.441+0000 7fbb368dc700 1 --2- 172.21.15.6:0/4045318602 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb3015c660 0x7fbb30167420 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:26.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.441+0000 7fbb368dc700 1 -- 172.21.15.6:0/4045318602 >> 172.21.15.6:0/4045318602 conn(0x7fbb300cf960 msgr2=0x7fbb300cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:26.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.441+0000 7fbb368dc700 1 -- 172.21.15.6:0/4045318602 shutdown_connections 2023-07-06T19:59:26.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.441+0000 7fbb368dc700 1 -- 172.21.15.6:0/4045318602 wait complete. 2023-07-06T19:59:26.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.442+0000 7fbb368dc700 1 Processor -- start 2023-07-06T19:59:26.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.442+0000 7fbb368dc700 1 -- start start 2023-07-06T19:59:26.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.443+0000 7fbb368dc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb30071900 0x7fbb3014e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:26.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.443+0000 7fbb368dc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb300ca850 0x7fbb30157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:26.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.443+0000 7fbb368dc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb3015c660 0x7fbb30158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:26.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.443+0000 7fbb368dc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb300b5770 con 0x7fbb300ca850 2023-07-06T19:59:26.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.443+0000 7fbb368dc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3014eee0 con 0x7fbb3015c660 2023-07-06T19:59:26.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.443+0000 7fbb368dc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb301563d0 con 0x7fbb30071900 2023-07-06T19:59:26.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.443+0000 7fbb2f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb300ca850 0x7fbb30157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:26.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.443+0000 7fbb2f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb300ca850 0x7fbb30157470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59390/0 (socket says 172.21.15.6:59390) 2023-07-06T19:59:26.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.443+0000 7fbb2f7fe700 1 -- 172.21.15.6:0/1242335451 learned_addr learned my addr 172.21.15.6:0/1242335451 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:26.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.443+0000 7fbb34e79700 1 --2- 172.21.15.6:0/1242335451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb3015c660 0x7fbb30158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:26.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.443+0000 7fbb2ffff700 1 --2- 172.21.15.6:0/1242335451 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb30071900 0x7fbb3014e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:26.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.444+0000 7fbb2f7fe700 1 -- 172.21.15.6:0/1242335451 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb30071900 msgr2=0x7fbb3014e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:26.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.444+0000 7fbb2f7fe700 1 --2- 172.21.15.6:0/1242335451 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb30071900 0x7fbb3014e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:26.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.444+0000 7fbb2f7fe700 1 -- 172.21.15.6:0/1242335451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb3015c660 msgr2=0x7fbb30158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:26.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.444+0000 7fbb2f7fe700 1 --2- 172.21.15.6:0/1242335451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb3015c660 0x7fbb30158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:26.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.444+0000 7fbb2f7fe700 1 -- 172.21.15.6:0/1242335451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb28009a70 con 0x7fbb300ca850 2023-07-06T19:59:26.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.444+0000 7fbb2f7fe700 1 --2- 172.21.15.6:0/1242335451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb300ca850 0x7fbb30157470 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800c500 tx=0x7fbb1800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:26.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.444+0000 7fbb2cff9700 1 -- 172.21.15.6:0/1242335451 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb180052d0 con 0x7fbb300ca850 2023-07-06T19:59:26.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.444+0000 7fbb2cff9700 1 -- 172.21.15.6:0/1242335451 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb18005430 con 0x7fbb300ca850 2023-07-06T19:59:26.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.444+0000 7fbb368dc700 1 -- 172.21.15.6:0/1242335451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb301566b0 con 0x7fbb300ca850 2023-07-06T19:59:26.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.444+0000 7fbb2cff9700 1 -- 172.21.15.6:0/1242335451 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb180038c0 con 0x7fbb300ca850 2023-07-06T19:59:26.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.444+0000 7fbb368dc700 1 -- 172.21.15.6:0/1242335451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb30156c70 con 0x7fbb300ca850 2023-07-06T19:59:26.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.445+0000 7fbb368dc700 1 -- 172.21.15.6:0/1242335451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb3004eb90 con 0x7fbb300ca850 2023-07-06T19:59:26.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.445+0000 7fbb2cff9700 1 -- 172.21.15.6:0/1242335451 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbb18003a20 con 0x7fbb300ca850 2023-07-06T19:59:26.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.446+0000 7fbb2cff9700 1 --2- 172.21.15.6:0/1242335451 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbb1006ace0 0x7fbb1006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:26.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.446+0000 7fbb2ffff700 1 --2- 172.21.15.6:0/1242335451 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbb1006ace0 0x7fbb1006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:26.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.446+0000 7fbb2cff9700 1 -- 172.21.15.6:0/1242335451 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbb18088d50 con 0x7fbb300ca850 2023-07-06T19:59:26.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.446+0000 7fbb2ffff700 1 --2- 172.21.15.6:0/1242335451 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbb1006ace0 0x7fbb1006d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbb200011e0 tx=0x7fbb20009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:26.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.450+0000 7fbb2cff9700 1 -- 172.21.15.6:0/1242335451 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbb1808c030 con 0x7fbb300ca850 2023-07-06T19:59:26.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.647+0000 7fbb368dc700 1 -- 172.21.15.6:0/1242335451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb300b58e0 con 0x7fbb300ca850 2023-07-06T19:59:26.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.648+0000 7fbb2cff9700 1 -- 172.21.15.6:0/1242335451 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbb18053a90 con 0x7fbb300ca850 2023-07-06T19:59:26.650 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-06T19:59:26.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.650+0000 7fbb368dc700 1 -- 172.21.15.6:0/1242335451 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbb1006ace0 msgr2=0x7fbb1006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:26.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.650+0000 7fbb368dc700 1 --2- 172.21.15.6:0/1242335451 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbb1006ace0 0x7fbb1006d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbb200011e0 tx=0x7fbb20009040 comp rx=0 tx=0).stop 2023-07-06T19:59:26.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.650+0000 7fbb368dc700 1 -- 172.21.15.6:0/1242335451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb300ca850 msgr2=0x7fbb30157470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:26.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.650+0000 7fbb368dc700 1 --2- 172.21.15.6:0/1242335451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb300ca850 0x7fbb30157470 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800c500 tx=0x7fbb1800c8c0 comp rx=0 tx=0).stop 2023-07-06T19:59:26.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.650+0000 7fbb368dc700 1 -- 172.21.15.6:0/1242335451 shutdown_connections 2023-07-06T19:59:26.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.650+0000 7fbb368dc700 1 --2- 172.21.15.6:0/1242335451 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbb1006ace0 0x7fbb1006d190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:26.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.650+0000 7fbb368dc700 1 --2- 172.21.15.6:0/1242335451 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbb3015c660 0x7fbb30158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:26.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.650+0000 7fbb368dc700 1 --2- 172.21.15.6:0/1242335451 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbb30071900 0x7fbb3014e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:26.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.650+0000 7fbb368dc700 1 --2- 172.21.15.6:0/1242335451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb300ca850 0x7fbb30157470 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:26.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.650+0000 7fbb368dc700 1 -- 172.21.15.6:0/1242335451 >> 172.21.15.6:0/1242335451 conn(0x7fbb300cf960 msgr2=0x7fbb300cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:26.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.650+0000 7fbb368dc700 1 -- 172.21.15.6:0/1242335451 shutdown_connections 2023-07-06T19:59:26.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.650+0000 7fbb368dc700 1 -- 172.21.15.6:0/1242335451 wait complete. 2023-07-06T19:59:26.664 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T19:59:26.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.792+0000 7fa1856b0700 1 Processor -- start 2023-07-06T19:59:26.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.792+0000 7fa1856b0700 1 -- start start 2023-07-06T19:59:26.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.793+0000 7fa1856b0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa18006c4c0 0x7fa1801675e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:26.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.793+0000 7fa1856b0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa18015d480 con 0x7fa180160e00 2023-07-06T19:59:26.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.793+0000 7fa1856b0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa18015ce70 con 0x7fa1800b1f10 2023-07-06T19:59:26.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.793+0000 7fa1856b0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa18015cc60 con 0x7fa18006c4c0 2023-07-06T19:59:26.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.793+0000 7fa17e7fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa180160e00 0x7fa18006bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60604/0 (socket says 172.21.15.6:60604) 2023-07-06T19:59:26.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.793+0000 7fa17e7fc700 1 -- 172.21.15.6:0/2883589886 learned_addr learned my addr 172.21.15.6:0/2883589886 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:26.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.793+0000 7fa17dffb700 1 -- 172.21.15.6:0/2883589886 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135730079 0 0) 0x7fa18015d480 con 0x7fa180160e00 2023-07-06T19:59:26.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.793+0000 7fa17f7fe700 1 --2- 172.21.15.6:0/2883589886 >> v2:172.21.15.40:3300/0 conn(0x7fa18006c4c0 0x7fa1801675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:26.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.793+0000 7fa17dffb700 1 -- 172.21.15.6:0/2883589886 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1680035b0 con 0x7fa180160e00 2023-07-06T19:59:26.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.793+0000 7fa17dffb700 1 -- 172.21.15.6:0/2883589886 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3081603859 0 0) 0x7fa1680035b0 con 0x7fa180160e00 2023-07-06T19:59:26.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.793+0000 7fa17dffb700 1 -- 172.21.15.6:0/2883589886 >> v2:172.21.15.40:3300/0 conn(0x7fa18006c4c0 msgr2=0x7fa1801675e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:26.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.793+0000 7fa17dffb700 1 --2- 172.21.15.6:0/2883589886 >> v2:172.21.15.40:3300/0 conn(0x7fa18006c4c0 0x7fa1801675e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:26.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.793+0000 7fa17dffb700 1 -- 172.21.15.6:0/2883589886 >> v1:172.21.15.40:6789/0 conn(0x7fa1800b1f10 legacy=0x7fa1800cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:26.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.794+0000 7fa17dffb700 1 -- 172.21.15.6:0/2883589886 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1800cddd0 con 0x7fa180160e00 2023-07-06T19:59:26.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.794+0000 7fa17dffb700 1 -- 172.21.15.6:0/2883589886 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7fa170001670 con 0x7fa180160e00 2023-07-06T19:59:26.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.794+0000 7fa17dffb700 1 -- 172.21.15.6:0/2883589886 >> v1:172.21.15.6:6789/0 conn(0x7fa180160e00 legacy=0x7fa18006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:26.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.794+0000 7fa17dffb700 1 --2- 172.21.15.6:0/2883589886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa168003a00 0x7fa168003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:26.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.794+0000 7fa17dffb700 1 --2- 172.21.15.6:0/2883589886 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa168004850 0x7fa168004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:26.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.794+0000 7fa17dffb700 1 --2- 172.21.15.6:0/2883589886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa168005200 0x7fa16800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:26.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.794+0000 7fa17dffb700 1 -- 172.21.15.6:0/2883589886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18015cc60 con 0x7fa168005200 2023-07-06T19:59:26.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.794+0000 7fa17dffb700 1 -- 172.21.15.6:0/2883589886 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16800c080 con 0x7fa168003a00 2023-07-06T19:59:26.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.794+0000 7fa17dffb700 1 -- 172.21.15.6:0/2883589886 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16800c240 con 0x7fa168004850 2023-07-06T19:59:26.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.794+0000 7fa17f7fe700 1 --2- 172.21.15.6:0/2883589886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa168005200 0x7fa16800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:26.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.794+0000 7fa17effd700 1 --2- 172.21.15.6:0/2883589886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa168003a00 0x7fa168003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:26.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.794+0000 7fa17e7fc700 1 --2- 172.21.15.6:0/2883589886 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa168004850 0x7fa168004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:26.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.794+0000 7fa17f7fe700 1 -- 172.21.15.6:0/2883589886 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa168004850 msgr2=0x7fa168004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:26.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.794+0000 7fa17f7fe700 1 --2- 172.21.15.6:0/2883589886 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa168004850 0x7fa168004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:26.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.794+0000 7fa17f7fe700 1 -- 172.21.15.6:0/2883589886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa168003a00 msgr2=0x7fa168003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:26.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.794+0000 7fa17f7fe700 1 --2- 172.21.15.6:0/2883589886 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa168003a00 0x7fa168003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:26.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.794+0000 7fa17f7fe700 1 -- 172.21.15.6:0/2883589886 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1680035b0 con 0x7fa168005200 2023-07-06T19:59:26.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.794+0000 7fa17f7fe700 1 -- 172.21.15.6:0/2883589886 reap_dead start 2023-07-06T19:59:26.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.794+0000 7fa17f7fe700 1 --2- 172.21.15.6:0/2883589886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa168005200 0x7fa16800ba10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa178009fc0 tx=0x7fa168005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf75315cf04a280 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:26.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.794+0000 7fa17dffb700 1 -- 172.21.15.6:0/2883589886 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa178003a20 con 0x7fa168005200 2023-07-06T19:59:26.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.794+0000 7fa17dffb700 1 -- 172.21.15.6:0/2883589886 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17800f040 con 0x7fa168005200 2023-07-06T19:59:26.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.794+0000 7fa17dffb700 1 -- 172.21.15.6:0/2883589886 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa178003de0 con 0x7fa168005200 2023-07-06T19:59:26.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.795+0000 7fa1856b0700 1 -- 172.21.15.6:0/2883589886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa168005200 msgr2=0x7fa16800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:26.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.795+0000 7fa1856b0700 1 --2- 172.21.15.6:0/2883589886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa168005200 0x7fa16800ba10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa178009fc0 tx=0x7fa168005880 comp rx=0 tx=0).stop 2023-07-06T19:59:26.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.795+0000 7fa1856b0700 1 -- 172.21.15.6:0/2883589886 shutdown_connections 2023-07-06T19:59:26.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.795+0000 7fa1856b0700 1 --2- 172.21.15.6:0/2883589886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa168005200 0x7fa16800ba10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:26.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.795+0000 7fa1856b0700 1 -- 172.21.15.6:0/2883589886 >> 172.21.15.6:0/2883589886 conn(0x7fa1800d2c70 msgr2=0x7fa1800d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:26.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.795+0000 7fa1856b0700 1 -- 172.21.15.6:0/2883589886 shutdown_connections 2023-07-06T19:59:26.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.795+0000 7fa1856b0700 1 -- 172.21.15.6:0/2883589886 wait complete. 2023-07-06T19:59:26.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.797+0000 7fa1856b0700 1 Processor -- start 2023-07-06T19:59:26.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.797+0000 7fa1856b0700 1 -- start start 2023-07-06T19:59:26.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.798+0000 7fa1856b0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa168005200 0x7fa1800b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:26.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.798+0000 7fa1856b0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1800b7870 0x7fa1800b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:26.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.798+0000 7fa1856b0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1800c9fb0 0x7fa1800ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:26.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.798+0000 7fa1856b0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa180157bc0 con 0x7fa1800b7870 2023-07-06T19:59:26.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.798+0000 7fa1856b0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1800b6520 con 0x7fa168005200 2023-07-06T19:59:26.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.798+0000 7fa1856b0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1800b67d0 con 0x7fa1800c9fb0 2023-07-06T19:59:26.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.798+0000 7fa17e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1800b7870 0x7fa1800b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:26.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.798+0000 7fa17e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1800b7870 0x7fa1800b5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59410/0 (socket says 172.21.15.6:59410) 2023-07-06T19:59:26.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.798+0000 7fa17e7fc700 1 -- 172.21.15.6:0/1288773404 learned_addr learned my addr 172.21.15.6:0/1288773404 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:26.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.798+0000 7fa17effd700 1 --2- 172.21.15.6:0/1288773404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa168005200 0x7fa1800b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:26.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.798+0000 7fa17f7fe700 1 --2- 172.21.15.6:0/1288773404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1800c9fb0 0x7fa1800ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:26.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.798+0000 7fa17e7fc700 1 -- 172.21.15.6:0/1288773404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1800c9fb0 msgr2=0x7fa1800ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:26.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.798+0000 7fa17e7fc700 1 --2- 172.21.15.6:0/1288773404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1800c9fb0 0x7fa1800ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:26.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.798+0000 7fa17e7fc700 1 -- 172.21.15.6:0/1288773404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa168005200 msgr2=0x7fa1800b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:26.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.798+0000 7fa17e7fc700 1 --2- 172.21.15.6:0/1288773404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa168005200 0x7fa1800b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:26.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.798+0000 7fa17e7fc700 1 -- 172.21.15.6:0/1288773404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1800b6ab0 con 0x7fa1800b7870 2023-07-06T19:59:26.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.798+0000 7fa17e7fc700 1 --2- 172.21.15.6:0/1288773404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1800b7870 0x7fa1800b5fe0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa170007290 tx=0x7fa1700075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:26.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.798+0000 7fa1677fe700 1 -- 172.21.15.6:0/1288773404 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa170011580 con 0x7fa1800b7870 2023-07-06T19:59:26.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.798+0000 7fa1677fe700 1 -- 172.21.15.6:0/1288773404 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1700116e0 con 0x7fa1800b7870 2023-07-06T19:59:26.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.798+0000 7fa1856b0700 1 -- 172.21.15.6:0/1288773404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1800b6d90 con 0x7fa1800b7870 2023-07-06T19:59:26.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.799+0000 7fa1677fe700 1 -- 172.21.15.6:0/1288773404 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa170011a90 con 0x7fa1800b7870 2023-07-06T19:59:26.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.799+0000 7fa1856b0700 1 -- 172.21.15.6:0/1288773404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1800b7350 con 0x7fa1800b7870 2023-07-06T19:59:26.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.799+0000 7fa1856b0700 1 -- 172.21.15.6:0/1288773404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa18004eb90 con 0x7fa1800b7870 2023-07-06T19:59:26.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.800+0000 7fa1677fe700 1 -- 172.21.15.6:0/1288773404 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa170011bf0 con 0x7fa1800b7870 2023-07-06T19:59:26.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.800+0000 7fa1677fe700 1 --2- 172.21.15.6:0/1288773404 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa16c06ace0 0x7fa16c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.800+0000 7fa1677fe700 1 -- 172.21.15.6:0/1288773404 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa1700897c0 con 0x7fa1800b7870 2023-07-06T19:59:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.800+0000 7fa17effd700 1 --2- 172.21.15.6:0/1288773404 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa16c06ace0 0x7fa16c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.801+0000 7fa17effd700 1 --2- 172.21.15.6:0/1288773404 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa16c06ace0 0x7fa16c06d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa174000c00 tx=0x7fa174009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:26.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:26.805+0000 7fa1677fe700 1 -- 172.21.15.6:0/1288773404 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa170054580 con 0x7fa1800b7870 2023-07-06T19:59:27.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.004+0000 7fa1856b0700 1 -- 172.21.15.6:0/1288773404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa1800cc160 con 0x7fa1800b7870 2023-07-06T19:59:27.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.004+0000 7fa1677fe700 1 -- 172.21.15.6:0/1288773404 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa170057ba0 con 0x7fa1800b7870 2023-07-06T19:59:27.006 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T19:59:27.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.007+0000 7fa1856b0700 1 -- 172.21.15.6:0/1288773404 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa16c06ace0 msgr2=0x7fa16c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:27.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.007+0000 7fa1856b0700 1 --2- 172.21.15.6:0/1288773404 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa16c06ace0 0x7fa16c06d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa174000c00 tx=0x7fa174009040 comp rx=0 tx=0).stop 2023-07-06T19:59:27.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.007+0000 7fa1856b0700 1 -- 172.21.15.6:0/1288773404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1800b7870 msgr2=0x7fa1800b5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:27.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.007+0000 7fa1856b0700 1 --2- 172.21.15.6:0/1288773404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1800b7870 0x7fa1800b5fe0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa170007290 tx=0x7fa1700075a0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.007+0000 7fa1856b0700 1 -- 172.21.15.6:0/1288773404 shutdown_connections 2023-07-06T19:59:27.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.007+0000 7fa1856b0700 1 --2- 172.21.15.6:0/1288773404 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa16c06ace0 0x7fa16c06d190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.007+0000 7fa1856b0700 1 --2- 172.21.15.6:0/1288773404 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa1800c9fb0 0x7fa1800ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.007+0000 7fa1856b0700 1 --2- 172.21.15.6:0/1288773404 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa168005200 0x7fa1800b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.007+0000 7fa1856b0700 1 --2- 172.21.15.6:0/1288773404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa1800b7870 0x7fa1800b5fe0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.007+0000 7fa1856b0700 1 -- 172.21.15.6:0/1288773404 >> 172.21.15.6:0/1288773404 conn(0x7fa1800d2c70 msgr2=0x7fa18015ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:27.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.007+0000 7fa1856b0700 1 -- 172.21.15.6:0/1288773404 shutdown_connections 2023-07-06T19:59:27.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.007+0000 7fa1856b0700 1 -- 172.21.15.6:0/1288773404 wait complete. 2023-07-06T19:59:27.020 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T19:59:27.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.149+0000 7f2aa8852700 1 Processor -- start 2023-07-06T19:59:27.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.149+0000 7f2aa8852700 1 -- start start 2023-07-06T19:59:27.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.150+0000 7f2aa8852700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2aa4071dd0 0x7f2aa40caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:27.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.150+0000 7f2aa8852700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2aa40cee80 0x7f2aa41602c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:27.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.150+0000 7f2aa8852700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa4160ff0 con 0x7f2aa40ceab0 2023-07-06T19:59:27.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.150+0000 7f2aa8852700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa40cb400 con 0x7f2aa40cee80 2023-07-06T19:59:27.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.150+0000 7f2aa8852700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa40ca100 con 0x7f2aa4071dd0 2023-07-06T19:59:27.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.150+0000 7f2aa2d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2aa40cee80 0x7f2aa41602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:27.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.150+0000 7f2aa2d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2aa40cee80 0x7f2aa41602c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59420/0 (socket says 172.21.15.6:59420) 2023-07-06T19:59:27.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.150+0000 7f2aa2d9d700 1 -- 172.21.15.6:0/3963460558 learned_addr learned my addr 172.21.15.6:0/3963460558 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:27.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.150+0000 7f2aa1d9b700 1 --2- 172.21.15.6:0/3963460558 >> v2:172.21.15.40:3300/0 conn(0x7f2aa4071dd0 0x7f2aa40caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:27.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.150+0000 7f2aa2d9d700 1 -- 172.21.15.6:0/3963460558 >> v2:172.21.15.40:3300/0 conn(0x7f2aa4071dd0 msgr2=0x7f2aa40caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:27.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.150+0000 7f2aa2d9d700 1 --2- 172.21.15.6:0/3963460558 >> v2:172.21.15.40:3300/0 conn(0x7f2aa4071dd0 0x7f2aa40caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.150+0000 7f2aa2d9d700 1 -- 172.21.15.6:0/3963460558 >> v1:172.21.15.40:6789/0 conn(0x7f2aa40ceab0 legacy=0x7f2aa40716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:27.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.151+0000 7f2aa2d9d700 1 -- 172.21.15.6:0/3963460558 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa40ca3e0 con 0x7f2aa40cee80 2023-07-06T19:59:27.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.151+0000 7f2aa2d9d700 1 --2- 172.21.15.6:0/3963460558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aa40cee80 0x7f2aa41602c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40d0aa0 tx=0x7f2a9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c210bd7ea9d4288 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:27.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.151+0000 7f2aa159a700 1 -- 172.21.15.6:0/3963460558 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c00e070 con 0x7f2aa40cee80 2023-07-06T19:59:27.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.151+0000 7f2aa159a700 1 -- 172.21.15.6:0/3963460558 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c003a20 con 0x7f2aa40cee80 2023-07-06T19:59:27.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.151+0000 7f2aa159a700 1 -- 172.21.15.6:0/3963460558 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c003dd0 con 0x7f2aa40cee80 2023-07-06T19:59:27.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.151+0000 7f2aa8852700 1 -- 172.21.15.6:0/3963460558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aa40cee80 msgr2=0x7f2aa41602c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:27.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.151+0000 7f2aa8852700 1 --2- 172.21.15.6:0/3963460558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aa40cee80 0x7f2aa41602c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40d0aa0 tx=0x7f2a9c00b330 comp rx=0 tx=0).stop 2023-07-06T19:59:27.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.151+0000 7f2aa8852700 1 -- 172.21.15.6:0/3963460558 shutdown_connections 2023-07-06T19:59:27.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.151+0000 7f2aa8852700 1 --2- 172.21.15.6:0/3963460558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aa40cee80 0x7f2aa41602c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.151+0000 7f2aa8852700 1 --2- 172.21.15.6:0/3963460558 >> v2:172.21.15.40:3300/0 conn(0x7f2aa4071dd0 0x7f2aa40caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.151+0000 7f2aa8852700 1 -- 172.21.15.6:0/3963460558 >> 172.21.15.6:0/3963460558 conn(0x7f2aa40cc420 msgr2=0x7f2aa40cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:27.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.151+0000 7f2aa8852700 1 -- 172.21.15.6:0/3963460558 shutdown_connections 2023-07-06T19:59:27.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.152+0000 7f2aa8852700 1 -- 172.21.15.6:0/3963460558 wait complete. 2023-07-06T19:59:27.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.153+0000 7f2aa8852700 1 Processor -- start 2023-07-06T19:59:27.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.153+0000 7f2aa8852700 1 -- start start 2023-07-06T19:59:27.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.154+0000 7f2aa8852700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aa4071dd0 0x7f2aa41599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:27.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.154+0000 7f2aa8852700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa40ceab0 0x7f2aa41f1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:27.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.154+0000 7f2aa8852700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aa40cee80 0x7f2aa4157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:27.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.154+0000 7f2aa8852700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa40ad540 con 0x7f2aa4071dd0 2023-07-06T19:59:27.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.154+0000 7f2aa8852700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa41575e0 con 0x7f2aa40ceab0 2023-07-06T19:59:27.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.154+0000 7f2aa8852700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa40acf80 con 0x7f2aa40cee80 2023-07-06T19:59:27.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.154+0000 7f2aa259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aa4071dd0 0x7f2aa41599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:27.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.154+0000 7f2aa259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aa4071dd0 0x7f2aa41599d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59422/0 (socket says 172.21.15.6:59422) 2023-07-06T19:59:27.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.154+0000 7f2aa259c700 1 -- 172.21.15.6:0/1338392641 learned_addr learned my addr 172.21.15.6:0/1338392641 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:27.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.154+0000 7f2aa2d9d700 1 --2- 172.21.15.6:0/1338392641 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aa40cee80 0x7f2aa4157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:27.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.154+0000 7f2aa1d9b700 1 --2- 172.21.15.6:0/1338392641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa40ceab0 0x7f2aa41f1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:27.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.154+0000 7f2aa259c700 1 -- 172.21.15.6:0/1338392641 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aa40cee80 msgr2=0x7f2aa4157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:27.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.154+0000 7f2aa259c700 1 --2- 172.21.15.6:0/1338392641 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aa40cee80 0x7f2aa4157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.154+0000 7f2aa259c700 1 -- 172.21.15.6:0/1338392641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa40ceab0 msgr2=0x7f2aa41f1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:27.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.154+0000 7f2aa259c700 1 --2- 172.21.15.6:0/1338392641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa40ceab0 0x7f2aa41f1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.154+0000 7f2aa259c700 1 -- 172.21.15.6:0/1338392641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9c009b30 con 0x7f2aa4071dd0 2023-07-06T19:59:27.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.154+0000 7f2aa1d9b700 1 --2- 172.21.15.6:0/1338392641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa40ceab0 0x7f2aa41f1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:27.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.154+0000 7f2aa2d9d700 1 --2- 172.21.15.6:0/1338392641 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aa40cee80 0x7f2aa4157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:27.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.154+0000 7f2aa259c700 1 --2- 172.21.15.6:0/1338392641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aa4071dd0 0x7f2aa41599d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800c500 tx=0x7f2a9800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:27.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.154+0000 7f2a92ffd700 1 -- 172.21.15.6:0/1338392641 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a98011790 con 0x7f2aa4071dd0 2023-07-06T19:59:27.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.154+0000 7f2a92ffd700 1 -- 172.21.15.6:0/1338392641 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a980118f0 con 0x7f2aa4071dd0 2023-07-06T19:59:27.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.154+0000 7f2aa8852700 1 -- 172.21.15.6:0/1338392641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa40ad260 con 0x7f2aa4071dd0 2023-07-06T19:59:27.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.154+0000 7f2a92ffd700 1 -- 172.21.15.6:0/1338392641 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a98011ca0 con 0x7f2aa4071dd0 2023-07-06T19:59:27.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.154+0000 7f2aa8852700 1 -- 172.21.15.6:0/1338392641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa4159f10 con 0x7f2aa4071dd0 2023-07-06T19:59:27.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.156+0000 7f2aa8852700 1 -- 172.21.15.6:0/1338392641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa4074200 con 0x7f2aa4071dd0 2023-07-06T19:59:27.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.156+0000 7f2a92ffd700 1 -- 172.21.15.6:0/1338392641 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2a9801c460 con 0x7f2aa4071dd0 2023-07-06T19:59:27.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.156+0000 7f2a92ffd700 1 --2- 172.21.15.6:0/1338392641 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2a8406ace0 0x7f2a8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:27.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.156+0000 7f2a92ffd700 1 -- 172.21.15.6:0/1338392641 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2a98089520 con 0x7f2aa4071dd0 2023-07-06T19:59:27.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.156+0000 7f2aa1d9b700 1 --2- 172.21.15.6:0/1338392641 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2a8406ace0 0x7f2a8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:27.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.157+0000 7f2aa1d9b700 1 --2- 172.21.15.6:0/1338392641 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2a8406ace0 0x7f2a8406d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40c6470 tx=0x7f2a94008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:27.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.161+0000 7f2a92ffd700 1 -- 172.21.15.6:0/1338392641 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2a98054370 con 0x7f2aa4071dd0 2023-07-06T19:59:27.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.402+0000 7f2aa8852700 1 -- 172.21.15.6:0/1338392641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2aa40b5920 con 0x7f2aa4071dd0 2023-07-06T19:59:27.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.403+0000 7f2a92ffd700 1 -- 172.21.15.6:0/1338392641 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4652 (secure 0 0 0) 0x7f2a98057990 con 0x7f2aa4071dd0 2023-07-06T19:59:27.406 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:27.406 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3695014381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3695014381},{"type":"v1","addr":"172.21.15.6:6835","nonce":3695014381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/849399781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":849399781},{"type":"v1","addr":"172.21.15.40:6833","nonce":849399781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/512806705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":512806705},{"type":"v1","addr":"172.21.15.40:6835","nonce":512806705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T19:58:53.158966+0000","modified":"2023-07-06T19:59:17.827616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/368324315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":368324315},{"type":"v1","addr":"172.21.15.6:6837","nonce":368324315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-06T19:59:27.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.405+0000 7f2aa8852700 1 -- 172.21.15.6:0/1338392641 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2a8406ace0 msgr2=0x7f2a8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:27.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.405+0000 7f2aa8852700 1 --2- 172.21.15.6:0/1338392641 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2a8406ace0 0x7f2a8406d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40c6470 tx=0x7f2a94008040 comp rx=0 tx=0).stop 2023-07-06T19:59:27.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.405+0000 7f2aa8852700 1 -- 172.21.15.6:0/1338392641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aa4071dd0 msgr2=0x7f2aa41599d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:27.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.405+0000 7f2aa8852700 1 --2- 172.21.15.6:0/1338392641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aa4071dd0 0x7f2aa41599d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2a9800c500 tx=0x7f2a9800c8c0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.405+0000 7f2aa8852700 1 -- 172.21.15.6:0/1338392641 shutdown_connections 2023-07-06T19:59:27.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.405+0000 7f2aa8852700 1 --2- 172.21.15.6:0/1338392641 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2a8406ace0 0x7f2a8406d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.405+0000 7f2aa8852700 1 --2- 172.21.15.6:0/1338392641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aa4071dd0 0x7f2aa41599d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.405+0000 7f2aa8852700 1 --2- 172.21.15.6:0/1338392641 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2aa40cee80 0x7f2aa4157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.405+0000 7f2aa8852700 1 --2- 172.21.15.6:0/1338392641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2aa40ceab0 0x7f2aa41f1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.405+0000 7f2aa8852700 1 -- 172.21.15.6:0/1338392641 >> 172.21.15.6:0/1338392641 conn(0x7f2aa40cc420 msgr2=0x7f2aa40b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.405+0000 7f2aa8852700 1 -- 172.21.15.6:0/1338392641 shutdown_connections 2023-07-06T19:59:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.405+0000 7f2aa8852700 1 -- 172.21.15.6:0/1338392641 wait complete. 2023-07-06T19:59:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 9 2023-07-06T19:59:27.423 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T19:59:27.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.550+0000 7f74df6ce700 1 Processor -- start 2023-07-06T19:59:27.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.551+0000 7f74df6ce700 1 -- start start 2023-07-06T19:59:27.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.551+0000 7f74df6ce700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f74d80ceab0 0x7f74d80caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:27.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.551+0000 7f74df6ce700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f74d80cee80 0x7f74d80716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:27.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.551+0000 7f74df6ce700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d8160ff0 con 0x7f74d8071c00 2023-07-06T19:59:27.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.551+0000 7f74df6ce700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d80cb400 con 0x7f74d80ceab0 2023-07-06T19:59:27.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.551+0000 7f74df6ce700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d8072020 con 0x7f74d80cee80 2023-07-06T19:59:27.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.552+0000 7f74dd46a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f74d80ceab0 0x7f74d80caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:27.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.552+0000 7f74ddc6b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f74d8071c00 0x7f74d81602c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60642/0 (socket says 172.21.15.6:60642) 2023-07-06T19:59:27.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.552+0000 7f74ddc6b700 1 -- 172.21.15.6:0/3779239567 learned_addr learned my addr 172.21.15.6:0/3779239567 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:27.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.552+0000 7f74dcc69700 1 --2- 172.21.15.6:0/3779239567 >> v2:172.21.15.40:3300/0 conn(0x7f74d80cee80 0x7f74d80716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:27.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.552+0000 7f74dd46a700 1 -- 172.21.15.6:0/3779239567 >> v2:172.21.15.40:3300/0 conn(0x7f74d80cee80 msgr2=0x7f74d80716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:27.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.552+0000 7f74dd46a700 1 --2- 172.21.15.6:0/3779239567 >> v2:172.21.15.40:3300/0 conn(0x7f74d80cee80 0x7f74d80716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.552+0000 7f74dd46a700 1 -- 172.21.15.6:0/3779239567 >> v1:172.21.15.6:6789/0 conn(0x7f74d8071c00 legacy=0x7f74d81602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:27.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.552+0000 7f74cbfff700 1 -- 172.21.15.6:0/3779239567 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234349101 0 0) 0x7f74d8160ff0 con 0x7f74d8071c00 2023-07-06T19:59:27.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.552+0000 7f74dd46a700 1 -- 172.21.15.6:0/3779239567 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d80ca100 con 0x7f74d80ceab0 2023-07-06T19:59:27.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.552+0000 7f74dd46a700 1 --2- 172.21.15.6:0/3779239567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74d80ceab0 0x7f74d80caec0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f74d80727a0 tx=0x7f74d4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34eb2cee23f98060 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:27.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.552+0000 7f74cbfff700 1 -- 172.21.15.6:0/3779239567 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d4011830 con 0x7f74d80ceab0 2023-07-06T19:59:27.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.552+0000 7f74cbfff700 1 -- 172.21.15.6:0/3779239567 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d4011990 con 0x7f74d80ceab0 2023-07-06T19:59:27.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.552+0000 7f74cbfff700 1 -- 172.21.15.6:0/3779239567 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d4011d20 con 0x7f74d80ceab0 2023-07-06T19:59:27.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.553+0000 7f74df6ce700 1 -- 172.21.15.6:0/3779239567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74d80ceab0 msgr2=0x7f74d80caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:27.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.553+0000 7f74df6ce700 1 --2- 172.21.15.6:0/3779239567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74d80ceab0 0x7f74d80caec0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f74d80727a0 tx=0x7f74d4009b20 comp rx=0 tx=0).stop 2023-07-06T19:59:27.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.553+0000 7f74df6ce700 1 -- 172.21.15.6:0/3779239567 shutdown_connections 2023-07-06T19:59:27.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.553+0000 7f74df6ce700 1 --2- 172.21.15.6:0/3779239567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74d80ceab0 0x7f74d80caec0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.553+0000 7f74df6ce700 1 --2- 172.21.15.6:0/3779239567 >> v2:172.21.15.40:3300/0 conn(0x7f74d80cee80 0x7f74d80716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.553+0000 7f74df6ce700 1 -- 172.21.15.6:0/3779239567 >> 172.21.15.6:0/3779239567 conn(0x7f74d80cc420 msgr2=0x7f74d80cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:27.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.553+0000 7f74df6ce700 1 -- 172.21.15.6:0/3779239567 shutdown_connections 2023-07-06T19:59:27.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.553+0000 7f74df6ce700 1 -- 172.21.15.6:0/3779239567 wait complete. 2023-07-06T19:59:27.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.554+0000 7f74df6ce700 1 Processor -- start 2023-07-06T19:59:27.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.554+0000 7f74df6ce700 1 -- start start 2023-07-06T19:59:27.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.555+0000 7f74df6ce700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74d8071c00 0x7f74d80c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:27.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.555+0000 7f74df6ce700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74d80ceab0 0x7f74d80aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:27.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.555+0000 7f74df6ce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74d80cee80 0x7f74d80b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:27.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.555+0000 7f74df6ce700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d80ad220 con 0x7f74d80cee80 2023-07-06T19:59:27.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.555+0000 7f74df6ce700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d80c6a70 con 0x7f74d8071c00 2023-07-06T19:59:27.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.555+0000 7f74df6ce700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d80c9980 con 0x7f74d80ceab0 2023-07-06T19:59:27.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.555+0000 7f74ddc6b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74d80cee80 0x7f74d80b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:27.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.555+0000 7f74ddc6b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74d80cee80 0x7f74d80b0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59440/0 (socket says 172.21.15.6:59440) 2023-07-06T19:59:27.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.555+0000 7f74ddc6b700 1 -- 172.21.15.6:0/3404980732 learned_addr learned my addr 172.21.15.6:0/3404980732 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:27.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.555+0000 7f74dd46a700 1 --2- 172.21.15.6:0/3404980732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74d8071c00 0x7f74d80c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:27.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.555+0000 7f74dcc69700 1 --2- 172.21.15.6:0/3404980732 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74d80ceab0 0x7f74d80aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:27.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.555+0000 7f74ddc6b700 1 -- 172.21.15.6:0/3404980732 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74d80ceab0 msgr2=0x7f74d80aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:27.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.555+0000 7f74ddc6b700 1 --2- 172.21.15.6:0/3404980732 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74d80ceab0 0x7f74d80aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.555+0000 7f74ddc6b700 1 -- 172.21.15.6:0/3404980732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74d8071c00 msgr2=0x7f74d80c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:27.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.555+0000 7f74ddc6b700 1 --2- 172.21.15.6:0/3404980732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74d8071c00 0x7f74d80c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.555+0000 7f74ddc6b700 1 -- 172.21.15.6:0/3404980732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d40094a0 con 0x7f74d80cee80 2023-07-06T19:59:27.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.555+0000 7f74ddc6b700 1 --2- 172.21.15.6:0/3404980732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74d80cee80 0x7f74d80b0490 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f74d000cbd0 tx=0x7f74d000cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:27.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.556+0000 7f74c9ffb700 1 -- 172.21.15.6:0/3404980732 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d000aa00 con 0x7f74d80cee80 2023-07-06T19:59:27.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.556+0000 7f74c9ffb700 1 -- 172.21.15.6:0/3404980732 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d000ab80 con 0x7f74d80cee80 2023-07-06T19:59:27.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.556+0000 7f74c9ffb700 1 -- 172.21.15.6:0/3404980732 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d00070d0 con 0x7f74d80cee80 2023-07-06T19:59:27.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.556+0000 7f74df6ce700 1 -- 172.21.15.6:0/3404980732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d80ac350 con 0x7f74d80cee80 2023-07-06T19:59:27.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.556+0000 7f74df6ce700 1 -- 172.21.15.6:0/3404980732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d80ac880 con 0x7f74d80cee80 2023-07-06T19:59:27.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.557+0000 7f74df6ce700 1 -- 172.21.15.6:0/3404980732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d80ad360 con 0x7f74d80cee80 2023-07-06T19:59:27.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.557+0000 7f74c9ffb700 1 -- 172.21.15.6:0/3404980732 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f74d0007230 con 0x7f74d80cee80 2023-07-06T19:59:27.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.557+0000 7f74c9ffb700 1 --2- 172.21.15.6:0/3404980732 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f74bc06ace0 0x7f74bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:27.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.558+0000 7f74dd46a700 1 --2- 172.21.15.6:0/3404980732 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f74bc06ace0 0x7f74bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:27.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.558+0000 7f74c9ffb700 1 -- 172.21.15.6:0/3404980732 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f74d00890a0 con 0x7f74d80cee80 2023-07-06T19:59:27.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.558+0000 7f74dd46a700 1 --2- 172.21.15.6:0/3404980732 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f74bc06ace0 0x7f74bc06d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f74d40090b0 tx=0x7f74d4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:27.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.562+0000 7f74c9ffb700 1 -- 172.21.15.6:0/3404980732 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f74d0053e60 con 0x7f74d80cee80 2023-07-06T19:59:27.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.761+0000 7f74df6ce700 1 -- 172.21.15.6:0/3404980732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74d8074200 con 0x7f74d80cee80 2023-07-06T19:59:27.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.762+0000 7f74c9ffb700 1 -- 172.21.15.6:0/3404980732 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19964 (secure 0 0 0) 0x7f74d0057480 con 0x7f74d80cee80 2023-07-06T19:59:27.763 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:27.764 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:58:58.202291+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T19:58:51.062712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T19:58:52.130350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T19:58:55.785128+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:59:27.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.764+0000 7f74df6ce700 1 -- 172.21.15.6:0/3404980732 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f74bc06ace0 msgr2=0x7f74bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:27.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.764+0000 7f74df6ce700 1 --2- 172.21.15.6:0/3404980732 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f74bc06ace0 0x7f74bc06d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f74d40090b0 tx=0x7f74d4008030 comp rx=0 tx=0).stop 2023-07-06T19:59:27.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.764+0000 7f74df6ce700 1 -- 172.21.15.6:0/3404980732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74d80cee80 msgr2=0x7f74d80b0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:27.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.764+0000 7f74df6ce700 1 --2- 172.21.15.6:0/3404980732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74d80cee80 0x7f74d80b0490 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f74d000cbd0 tx=0x7f74d000cee0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.764+0000 7f74df6ce700 1 -- 172.21.15.6:0/3404980732 shutdown_connections 2023-07-06T19:59:27.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.764+0000 7f74df6ce700 1 --2- 172.21.15.6:0/3404980732 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f74bc06ace0 0x7f74bc06d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.764+0000 7f74df6ce700 1 --2- 172.21.15.6:0/3404980732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74d80cee80 0x7f74d80b0490 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.764+0000 7f74df6ce700 1 --2- 172.21.15.6:0/3404980732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74d8071c00 0x7f74d80c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.764+0000 7f74df6ce700 1 --2- 172.21.15.6:0/3404980732 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74d80ceab0 0x7f74d80aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.765+0000 7f74df6ce700 1 -- 172.21.15.6:0/3404980732 >> 172.21.15.6:0/3404980732 conn(0x7f74d80cc420 msgr2=0x7f74d806d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:27.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.765+0000 7f74df6ce700 1 -- 172.21.15.6:0/3404980732 shutdown_connections 2023-07-06T19:59:27.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.765+0000 7f74df6ce700 1 -- 172.21.15.6:0/3404980732 wait complete. 2023-07-06T19:59:27.778 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T19:58:38.767727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T19:58:45.759808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T19:58:51.062712+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T19:58:52.130350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T19:58:55.785128+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T19:59:27.779 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T19:59:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.906+0000 7f366aafe700 1 Processor -- start 2023-07-06T19:59:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.906+0000 7f366aafe700 1 -- start start 2023-07-06T19:59:27.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.907+0000 7f366aafe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3664071900 0x7f36640ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:27.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.907+0000 7f366aafe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3664071cd0 0x7f36640ca680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:27.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.907+0000 7f366aafe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f366415bf50 0x7f366415c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:27.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.907+0000 7f366aafe700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36640cdbf0 con 0x7f366415bf50 2023-07-06T19:59:27.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.907+0000 7f366aafe700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36640cb310 con 0x7f3664071cd0 2023-07-06T19:59:27.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.907+0000 7f366aafe700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36640af070 con 0x7f3664071900 2023-07-06T19:59:27.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.907+0000 7f366909b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f366415bf50 0x7f366415c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:27.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.907+0000 7f366909b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f366415bf50 0x7f366415c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59444/0 (socket says 172.21.15.6:59444) 2023-07-06T19:59:27.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.907+0000 7f366909b700 1 -- 172.21.15.6:0/2789430100 learned_addr learned my addr 172.21.15.6:0/2789430100 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:27.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.907+0000 7f3663fff700 1 --2- 172.21.15.6:0/2789430100 >> v2:172.21.15.40:3300/0 conn(0x7f3664071cd0 0x7f36640ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:27.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.907+0000 7f366889a700 1 --2- 172.21.15.6:0/2789430100 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3664071900 0x7f36640ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:27.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.907+0000 7f366909b700 1 -- 172.21.15.6:0/2789430100 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3664071900 msgr2=0x7f36640ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:27.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.907+0000 7f366909b700 1 --2- 172.21.15.6:0/2789430100 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3664071900 0x7f36640ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.907+0000 7f366909b700 1 -- 172.21.15.6:0/2789430100 >> v2:172.21.15.40:3300/0 conn(0x7f3664071cd0 msgr2=0x7f36640ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:27.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.907+0000 7f366909b700 1 --2- 172.21.15.6:0/2789430100 >> v2:172.21.15.40:3300/0 conn(0x7f3664071cd0 0x7f36640ca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.907+0000 7f366909b700 1 -- 172.21.15.6:0/2789430100 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366415c8e0 con 0x7f366415bf50 2023-07-06T19:59:27.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.907+0000 7f366889a700 1 --2- 172.21.15.6:0/2789430100 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3664071900 0x7f36640ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:27.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.908+0000 7f366909b700 1 --2- 172.21.15.6:0/2789430100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f366415bf50 0x7f366415c3a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3664071280 tx=0x7f365c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36beff628fe5f56d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:27.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.908+0000 7f36637fe700 1 -- 172.21.15.6:0/2789430100 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c00e070 con 0x7f366415bf50 2023-07-06T19:59:27.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.908+0000 7f36637fe700 1 -- 172.21.15.6:0/2789430100 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365c00b9c0 con 0x7f366415bf50 2023-07-06T19:59:27.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.908+0000 7f36637fe700 1 -- 172.21.15.6:0/2789430100 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c00bd70 con 0x7f366415bf50 2023-07-06T19:59:27.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.908+0000 7f366aafe700 1 -- 172.21.15.6:0/2789430100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f366415bf50 msgr2=0x7f366415c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:27.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.908+0000 7f366aafe700 1 --2- 172.21.15.6:0/2789430100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f366415bf50 0x7f366415c3a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3664071280 tx=0x7f365c00b330 comp rx=0 tx=0).stop 2023-07-06T19:59:27.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.908+0000 7f366aafe700 1 -- 172.21.15.6:0/2789430100 shutdown_connections 2023-07-06T19:59:27.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.908+0000 7f366aafe700 1 --2- 172.21.15.6:0/2789430100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f366415bf50 0x7f366415c3a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.908+0000 7f366aafe700 1 --2- 172.21.15.6:0/2789430100 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3664071900 0x7f36640ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.908+0000 7f366aafe700 1 --2- 172.21.15.6:0/2789430100 >> v2:172.21.15.40:3300/0 conn(0x7f3664071cd0 0x7f36640ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.908+0000 7f366aafe700 1 -- 172.21.15.6:0/2789430100 >> 172.21.15.6:0/2789430100 conn(0x7f36640cf960 msgr2=0x7f36640cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:27.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.908+0000 7f366aafe700 1 -- 172.21.15.6:0/2789430100 shutdown_connections 2023-07-06T19:59:27.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.908+0000 7f366aafe700 1 -- 172.21.15.6:0/2789430100 wait complete. 2023-07-06T19:59:27.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.910+0000 7f366aafe700 1 Processor -- start 2023-07-06T19:59:27.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.910+0000 7f366aafe700 1 -- start start 2023-07-06T19:59:27.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.910+0000 7f366aafe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3664071900 0x7f366415cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:27.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.910+0000 7f366aafe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3664071cd0 0x7f366415e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:27.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.910+0000 7f366aafe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f366415bf50 0x7f3664149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:27.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.911+0000 7f366aafe700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366415df70 con 0x7f366415bf50 2023-07-06T19:59:27.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.911+0000 7f366aafe700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366415d360 con 0x7f3664071900 2023-07-06T19:59:27.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.911+0000 7f366aafe700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366415d640 con 0x7f3664071cd0 2023-07-06T19:59:27.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.911+0000 7f366909b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f366415bf50 0x7f3664149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:27.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.911+0000 7f366909b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f366415bf50 0x7f3664149690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59454/0 (socket says 172.21.15.6:59454) 2023-07-06T19:59:27.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.911+0000 7f366909b700 1 -- 172.21.15.6:0/347433864 learned_addr learned my addr 172.21.15.6:0/347433864 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:27.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.911+0000 7f3663fff700 1 --2- 172.21.15.6:0/347433864 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3664071cd0 0x7f366415e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:27.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.911+0000 7f366889a700 1 --2- 172.21.15.6:0/347433864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3664071900 0x7f366415cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:27.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.911+0000 7f366909b700 1 -- 172.21.15.6:0/347433864 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3664071cd0 msgr2=0x7f366415e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:27.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.911+0000 7f366909b700 1 --2- 172.21.15.6:0/347433864 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3664071cd0 0x7f366415e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.911+0000 7f366909b700 1 -- 172.21.15.6:0/347433864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3664071900 msgr2=0x7f366415cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:27.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.911+0000 7f366909b700 1 --2- 172.21.15.6:0/347433864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3664071900 0x7f366415cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:27.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.911+0000 7f366909b700 1 -- 172.21.15.6:0/347433864 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365c009b30 con 0x7f366415bf50 2023-07-06T19:59:27.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.911+0000 7f366889a700 1 --2- 172.21.15.6:0/347433864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3664071900 0x7f366415cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:27.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.911+0000 7f366909b700 1 --2- 172.21.15.6:0/347433864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f366415bf50 0x7f3664149690 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f366406eb20 tx=0x7f365c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:27.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.911+0000 7f36617fa700 1 -- 172.21.15.6:0/347433864 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c004250 con 0x7f366415bf50 2023-07-06T19:59:27.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.911+0000 7f36617fa700 1 -- 172.21.15.6:0/347433864 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365c0043d0 con 0x7f366415bf50 2023-07-06T19:59:27.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.911+0000 7f366aafe700 1 -- 172.21.15.6:0/347433864 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366415d920 con 0x7f366415bf50 2023-07-06T19:59:27.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.911+0000 7f36617fa700 1 -- 172.21.15.6:0/347433864 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c004780 con 0x7f366415bf50 2023-07-06T19:59:27.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.911+0000 7f366aafe700 1 -- 172.21.15.6:0/347433864 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366415d050 con 0x7f366415bf50 2023-07-06T19:59:27.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.912+0000 7f366aafe700 1 -- 172.21.15.6:0/347433864 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366415e120 con 0x7f366415bf50 2023-07-06T19:59:27.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.913+0000 7f36617fa700 1 -- 172.21.15.6:0/347433864 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f365c01c440 con 0x7f366415bf50 2023-07-06T19:59:27.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.913+0000 7f36617fa700 1 --2- 172.21.15.6:0/347433864 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f364806ace0 0x7f364806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:27.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.913+0000 7f36617fa700 1 -- 172.21.15.6:0/347433864 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f365c08afb0 con 0x7f366415bf50 2023-07-06T19:59:27.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.913+0000 7f366889a700 1 --2- 172.21.15.6:0/347433864 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f364806ace0 0x7f364806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:27.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.914+0000 7f366889a700 1 --2- 172.21.15.6:0/347433864 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f364806ace0 0x7f364806d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3658006fd0 tx=0x7f3658008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:27.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:27.917+0000 7f36617fa700 1 -- 172.21.15.6:0/347433864 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f365c0bd310 con 0x7f366415bf50 2023-07-06T19:59:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.117+0000 7f366aafe700 1 -- 172.21.15.6:0/347433864 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f366404eb90 con 0x7f366415bf50 2023-07-06T19:59:28.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.117+0000 7f36617fa700 1 -- 172.21.15.6:0/347433864 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f365c0200a0 con 0x7f366415bf50 2023-07-06T19:59:28.121 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-06T19:59:28.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.119+0000 7f366aafe700 1 -- 172.21.15.6:0/347433864 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f364806ace0 msgr2=0x7f364806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:28.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.119+0000 7f366aafe700 1 --2- 172.21.15.6:0/347433864 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f364806ace0 0x7f364806d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3658006fd0 tx=0x7f3658008040 comp rx=0 tx=0).stop 2023-07-06T19:59:28.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.119+0000 7f366aafe700 1 -- 172.21.15.6:0/347433864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f366415bf50 msgr2=0x7f3664149690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.119+0000 7f366aafe700 1 --2- 172.21.15.6:0/347433864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f366415bf50 0x7f3664149690 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f366406eb20 tx=0x7f365c004ad0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.119+0000 7f366aafe700 1 -- 172.21.15.6:0/347433864 shutdown_connections 2023-07-06T19:59:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.119+0000 7f366aafe700 1 --2- 172.21.15.6:0/347433864 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f364806ace0 0x7f364806d190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.119+0000 7f366aafe700 1 --2- 172.21.15.6:0/347433864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f366415bf50 0x7f3664149690 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.119+0000 7f366aafe700 1 --2- 172.21.15.6:0/347433864 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3664071900 0x7f366415cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.119+0000 7f366aafe700 1 --2- 172.21.15.6:0/347433864 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3664071cd0 0x7f366415e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.119+0000 7f366aafe700 1 -- 172.21.15.6:0/347433864 >> 172.21.15.6:0/347433864 conn(0x7f36640cf960 msgr2=0x7f36640b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.119+0000 7f366aafe700 1 -- 172.21.15.6:0/347433864 shutdown_connections 2023-07-06T19:59:28.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.119+0000 7f366aafe700 1 -- 172.21.15.6:0/347433864 wait complete. 2023-07-06T19:59:28.132 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T19:59:28.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.259+0000 7f9693520700 1 Processor -- start 2023-07-06T19:59:28.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.259+0000 7f9693520700 1 -- start start 2023-07-06T19:59:28.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f9693520700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f968c071900 0x7f968c0ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:28.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f9693520700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f968c15c660 0x7f968c0ca680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:28.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f9693520700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968c0cb310 con 0x7f968c071cd0 2023-07-06T19:59:28.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f9693520700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968c0cdbf0 con 0x7f968c071900 2023-07-06T19:59:28.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f9693520700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0af070 con 0x7f968c15c660 2023-07-06T19:59:28.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f9690abb700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f968c071cd0 0x7f968c15bf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60666/0 (socket says 172.21.15.6:60666) 2023-07-06T19:59:28.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f9690abb700 1 -- 172.21.15.6:0/1239827157 learned_addr learned my addr 172.21.15.6:0/1239827157 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:28.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f9691abd700 1 --2- 172.21.15.6:0/1239827157 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f968c15c660 0x7f968c0ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:28.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f96912bc700 1 --2- 172.21.15.6:0/1239827157 >> v2:172.21.15.40:3300/0 conn(0x7f968c071900 0x7f968c0ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:28.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f967ffff700 1 -- 172.21.15.6:0/1239827157 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2320156675 0 0) 0x7f968c0cb310 con 0x7f968c071cd0 2023-07-06T19:59:28.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f967ffff700 1 -- 172.21.15.6:0/1239827157 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96780035b0 con 0x7f968c071cd0 2023-07-06T19:59:28.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f967ffff700 1 -- 172.21.15.6:0/1239827157 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3073866009 0 0) 0x7f96780035b0 con 0x7f968c071cd0 2023-07-06T19:59:28.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f967ffff700 1 -- 172.21.15.6:0/1239827157 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f968c15c660 msgr2=0x7f968c0ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:28.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f967ffff700 1 --2- 172.21.15.6:0/1239827157 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f968c15c660 0x7f968c0ca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f967ffff700 1 -- 172.21.15.6:0/1239827157 >> v2:172.21.15.40:3300/0 conn(0x7f968c071900 msgr2=0x7f968c0ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:28.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f967ffff700 1 --2- 172.21.15.6:0/1239827157 >> v2:172.21.15.40:3300/0 conn(0x7f968c071900 0x7f968c0ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f967ffff700 1 -- 172.21.15.6:0/1239827157 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968c0cad50 con 0x7f968c071cd0 2023-07-06T19:59:28.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f967ffff700 1 -- 172.21.15.6:0/1239827157 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f9680001670 con 0x7f968c071cd0 2023-07-06T19:59:28.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f967ffff700 1 -- 172.21.15.6:0/1239827157 >> v1:172.21.15.6:6789/0 conn(0x7f968c071cd0 legacy=0x7f968c15bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:28.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f967ffff700 1 --2- 172.21.15.6:0/1239827157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9678003a00 0x7f9678003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:28.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f967ffff700 1 --2- 172.21.15.6:0/1239827157 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f968c15c660 0x7f9678004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:28.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f967ffff700 1 --2- 172.21.15.6:0/1239827157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9678004d90 0x7f9678005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:28.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f967ffff700 1 -- 172.21.15.6:0/1239827157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0cdbf0 con 0x7f9678004d90 2023-07-06T19:59:28.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f967ffff700 1 -- 172.21.15.6:0/1239827157 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0af070 con 0x7f9678003a00 2023-07-06T19:59:28.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.260+0000 7f967ffff700 1 -- 172.21.15.6:0/1239827157 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f967800ba90 con 0x7f968c15c660 2023-07-06T19:59:28.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.261+0000 7f9691abd700 1 --2- 172.21.15.6:0/1239827157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9678004d90 0x7f9678005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:28.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.261+0000 7f96912bc700 1 --2- 172.21.15.6:0/1239827157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9678003a00 0x7f9678003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:28.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.261+0000 7f9690abb700 1 --2- 172.21.15.6:0/1239827157 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f968c15c660 0x7f9678004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:28.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.261+0000 7f9691abd700 1 -- 172.21.15.6:0/1239827157 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f968c15c660 msgr2=0x7f9678004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:28.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.261+0000 7f9691abd700 1 --2- 172.21.15.6:0/1239827157 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f968c15c660 0x7f9678004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.261+0000 7f9691abd700 1 -- 172.21.15.6:0/1239827157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9678003a00 msgr2=0x7f9678003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:28.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.261+0000 7f9691abd700 1 --2- 172.21.15.6:0/1239827157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9678003a00 0x7f9678003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.261+0000 7f9691abd700 1 -- 172.21.15.6:0/1239827157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96780035b0 con 0x7f9678004d90 2023-07-06T19:59:28.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.261+0000 7f96912bc700 1 --2- 172.21.15.6:0/1239827157 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9678003a00 0x7f9678003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:59:28.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.261+0000 7f9691abd700 1 --2- 172.21.15.6:0/1239827157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9678004d90 0x7f9678005200 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9684009fc0 tx=0x7f9678005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d06eb29865670fdf server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:28.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.261+0000 7f967ffff700 1 -- 172.21.15.6:0/1239827157 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968400ec30 con 0x7f9678004d90 2023-07-06T19:59:28.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.261+0000 7f967ffff700 1 -- 172.21.15.6:0/1239827157 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968400f040 con 0x7f9678004d90 2023-07-06T19:59:28.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.261+0000 7f967ffff700 1 -- 172.21.15.6:0/1239827157 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684014480 con 0x7f9678004d90 2023-07-06T19:59:28.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.262+0000 7f9693520700 1 -- 172.21.15.6:0/1239827157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9678004d90 msgr2=0x7f9678005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:28.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.262+0000 7f9693520700 1 --2- 172.21.15.6:0/1239827157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9678004d90 0x7f9678005200 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9684009fc0 tx=0x7f9678005880 comp rx=0 tx=0).stop 2023-07-06T19:59:28.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.262+0000 7f9691abd700 1 -- 172.21.15.6:0/1239827157 reap_dead start 2023-07-06T19:59:28.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.262+0000 7f9693520700 1 -- 172.21.15.6:0/1239827157 shutdown_connections 2023-07-06T19:59:28.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.262+0000 7f9693520700 1 -- 172.21.15.6:0/1239827157 >> 172.21.15.6:0/1239827157 conn(0x7f968c0cf960 msgr2=0x7f968c0cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:28.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.262+0000 7f9693520700 1 -- 172.21.15.6:0/1239827157 shutdown_connections 2023-07-06T19:59:28.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.262+0000 7f9693520700 1 -- 172.21.15.6:0/1239827157 wait complete. 2023-07-06T19:59:28.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.263+0000 7f9693520700 1 Processor -- start 2023-07-06T19:59:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.263+0000 7f9693520700 1 -- start start 2023-07-06T19:59:28.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.264+0000 7f9693520700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f968c1f1fd0 0x7f968c0b3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:28.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.264+0000 7f9693520700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f968c1f23a0 0x7f968c15a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:28.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.264+0000 7f9693520700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f968c1f6890 0x7f968c15a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:28.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.264+0000 7f9693520700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0c4970 con 0x7f968c1f6890 2023-07-06T19:59:28.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.264+0000 7f9693520700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0b3a50 con 0x7f968c1f1fd0 2023-07-06T19:59:28.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.264+0000 7f9693520700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0b3d30 con 0x7f968c1f23a0 2023-07-06T19:59:28.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.264+0000 7f9691abd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f968c1f6890 0x7f968c15a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:28.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.264+0000 7f9691abd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f968c1f6890 0x7f968c15a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59474/0 (socket says 172.21.15.6:59474) 2023-07-06T19:59:28.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.264+0000 7f9691abd700 1 -- 172.21.15.6:0/4123010557 learned_addr learned my addr 172.21.15.6:0/4123010557 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:28.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.264+0000 7f9690abb700 1 --2- 172.21.15.6:0/4123010557 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f968c1f23a0 0x7f968c15a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:28.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.264+0000 7f96912bc700 1 --2- 172.21.15.6:0/4123010557 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f968c1f1fd0 0x7f968c0b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:28.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.264+0000 7f9691abd700 1 -- 172.21.15.6:0/4123010557 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f968c1f23a0 msgr2=0x7f968c15a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:28.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.264+0000 7f9691abd700 1 --2- 172.21.15.6:0/4123010557 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f968c1f23a0 0x7f968c15a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.264+0000 7f9691abd700 1 -- 172.21.15.6:0/4123010557 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f968c1f1fd0 msgr2=0x7f968c0b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:28.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.264+0000 7f9691abd700 1 --2- 172.21.15.6:0/4123010557 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f968c1f1fd0 0x7f968c0b3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.264+0000 7f9691abd700 1 -- 172.21.15.6:0/4123010557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968c0b4010 con 0x7f968c1f6890 2023-07-06T19:59:28.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.265+0000 7f9691abd700 1 --2- 172.21.15.6:0/4123010557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f968c1f6890 0x7f968c15a680 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9684017040 tx=0x7f9684009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:28.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.265+0000 7f967dffb700 1 -- 172.21.15.6:0/4123010557 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684007000 con 0x7f968c1f6890 2023-07-06T19:59:28.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.265+0000 7f967dffb700 1 -- 172.21.15.6:0/4123010557 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9684003e50 con 0x7f968c1f6890 2023-07-06T19:59:28.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.265+0000 7f967dffb700 1 -- 172.21.15.6:0/4123010557 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9684014b50 con 0x7f968c1f6890 2023-07-06T19:59:28.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.265+0000 7f9693520700 1 -- 172.21.15.6:0/4123010557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f968c0c4bc0 con 0x7f968c1f6890 2023-07-06T19:59:28.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.265+0000 7f9693520700 1 -- 172.21.15.6:0/4123010557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968c0c3450 con 0x7f968c1f6890 2023-07-06T19:59:28.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.266+0000 7f9693520700 1 -- 172.21.15.6:0/4123010557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f968c15c110 con 0x7f968c1f6890 2023-07-06T19:59:28.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.266+0000 7f967dffb700 1 -- 172.21.15.6:0/4123010557 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9684023020 con 0x7f968c1f6890 2023-07-06T19:59:28.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.267+0000 7f967dffb700 1 --2- 172.21.15.6:0/4123010557 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f967006ace0 0x7f967006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:28.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.267+0000 7f967dffb700 1 -- 172.21.15.6:0/4123010557 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f968408aa60 con 0x7f968c1f6890 2023-07-06T19:59:28.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.267+0000 7f96912bc700 1 --2- 172.21.15.6:0/4123010557 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f967006ace0 0x7f967006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:28.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.267+0000 7f96912bc700 1 --2- 172.21.15.6:0/4123010557 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f967006ace0 0x7f967006d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9688009ba0 tx=0x7f9688008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:28.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.271+0000 7f967dffb700 1 -- 172.21.15.6:0/4123010557 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9684055810 con 0x7f968c1f6890 2023-07-06T19:59:28.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.471+0000 7f9693520700 1 -- 172.21.15.6:0/4123010557 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f968c0b09b0 con 0x7f968c1f6890 2023-07-06T19:59:28.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.471+0000 7f967dffb700 1 -- 172.21.15.6:0/4123010557 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9684014cb0 con 0x7f968c1f6890 2023-07-06T19:59:28.476 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-06T19:59:28.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.473+0000 7f9693520700 1 -- 172.21.15.6:0/4123010557 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f967006ace0 msgr2=0x7f967006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:28.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.473+0000 7f9693520700 1 --2- 172.21.15.6:0/4123010557 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f967006ace0 0x7f967006d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9688009ba0 tx=0x7f9688008040 comp rx=0 tx=0).stop 2023-07-06T19:59:28.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.473+0000 7f9693520700 1 -- 172.21.15.6:0/4123010557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f968c1f6890 msgr2=0x7f968c15a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:28.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.473+0000 7f9693520700 1 --2- 172.21.15.6:0/4123010557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f968c1f6890 0x7f968c15a680 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9684017040 tx=0x7f9684009750 comp rx=0 tx=0).stop 2023-07-06T19:59:28.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.473+0000 7f9693520700 1 -- 172.21.15.6:0/4123010557 shutdown_connections 2023-07-06T19:59:28.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.473+0000 7f9693520700 1 --2- 172.21.15.6:0/4123010557 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f967006ace0 0x7f967006d190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.473+0000 7f9693520700 1 --2- 172.21.15.6:0/4123010557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f968c1f6890 0x7f968c15a680 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.473+0000 7f9693520700 1 --2- 172.21.15.6:0/4123010557 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f968c1f1fd0 0x7f968c0b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.473+0000 7f9693520700 1 --2- 172.21.15.6:0/4123010557 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f968c1f23a0 0x7f968c15a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.473+0000 7f9693520700 1 -- 172.21.15.6:0/4123010557 >> 172.21.15.6:0/4123010557 conn(0x7f968c0cf960 msgr2=0x7f968c15ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:28.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.473+0000 7f9693520700 1 -- 172.21.15.6:0/4123010557 shutdown_connections 2023-07-06T19:59:28.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.474+0000 7f9693520700 1 -- 172.21.15.6:0/4123010557 wait complete. 2023-07-06T19:59:28.488 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T19:59:28.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.615+0000 7f2d54662700 1 Processor -- start 2023-07-06T19:59:28.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.615+0000 7f2d54662700 1 -- start start 2023-07-06T19:59:28.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.616+0000 7f2d54662700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2d4c160e00 0x7f2d4c06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:28.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.616+0000 7f2d54662700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d4c15d910 0x7f2d4c06c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:28.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.616+0000 7f2d54662700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d4c15d480 con 0x7f2d4c0b1f10 2023-07-06T19:59:28.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.616+0000 7f2d54662700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d4c15cc60 con 0x7f2d4c160e00 2023-07-06T19:59:28.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.616+0000 7f2d54662700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c15ce70 con 0x7f2d4c15d910 2023-07-06T19:59:28.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.616+0000 7f2d51bfd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2d4c160e00 0x7f2d4c06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:28.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.616+0000 7f2d52bff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d4c15d910 0x7f2d4c06c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:28.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.617+0000 7f2d51bfd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2d4c160e00 0x7f2d4c06bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:38516/0 (socket says 172.21.15.6:38516) 2023-07-06T19:59:28.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.617+0000 7f2d51bfd700 1 -- 172.21.15.6:0/3287850749 learned_addr learned my addr 172.21.15.6:0/3287850749 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:28.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.617+0000 7f2d51bfd700 1 -- 172.21.15.6:0/3287850749 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d4c15d910 msgr2=0x7f2d4c06c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:28.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.617+0000 7f2d51bfd700 1 --2- 172.21.15.6:0/3287850749 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d4c15d910 0x7f2d4c06c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.617+0000 7f2d51bfd700 1 -- 172.21.15.6:0/3287850749 >> v1:172.21.15.40:6789/0 conn(0x7f2d4c0b1f10 legacy=0x7f2d4c0cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:28.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.617+0000 7f2d51bfd700 1 -- 172.21.15.6:0/3287850749 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4c0cddd0 con 0x7f2d4c160e00 2023-07-06T19:59:28.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.617+0000 7f2d513fc700 1 -- 172.21.15.6:0/3287850749 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 872283270 0 0) 0x7f2d4c15d480 con 0x7f2d4c0b1f10 2023-07-06T19:59:28.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.617+0000 7f2d51bfd700 1 --2- 172.21.15.6:0/3287850749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d4c160e00 0x7f2d4c06bdb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2d400098f0 tx=0x7f2d40009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=919bf439e510a7ab server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:28.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.617+0000 7f2d513fc700 1 -- 172.21.15.6:0/3287850749 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d40011830 con 0x7f2d4c160e00 2023-07-06T19:59:28.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.617+0000 7f2d513fc700 1 -- 172.21.15.6:0/3287850749 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d40011990 con 0x7f2d4c160e00 2023-07-06T19:59:28.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.617+0000 7f2d513fc700 1 -- 172.21.15.6:0/3287850749 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d40011d20 con 0x7f2d4c160e00 2023-07-06T19:59:28.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.618+0000 7f2d54662700 1 -- 172.21.15.6:0/3287850749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d4c160e00 msgr2=0x7f2d4c06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:28.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.618+0000 7f2d54662700 1 --2- 172.21.15.6:0/3287850749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d4c160e00 0x7f2d4c06bdb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2d400098f0 tx=0x7f2d40009c00 comp rx=0 tx=0).stop 2023-07-06T19:59:28.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.618+0000 7f2d54662700 1 -- 172.21.15.6:0/3287850749 shutdown_connections 2023-07-06T19:59:28.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.618+0000 7f2d54662700 1 --2- 172.21.15.6:0/3287850749 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d4c15d910 0x7f2d4c06c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.618+0000 7f2d54662700 1 --2- 172.21.15.6:0/3287850749 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d4c160e00 0x7f2d4c06bdb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.618+0000 7f2d54662700 1 -- 172.21.15.6:0/3287850749 >> 172.21.15.6:0/3287850749 conn(0x7f2d4c0d2c70 msgr2=0x7f2d4c0d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.618+0000 7f2d54662700 1 -- 172.21.15.6:0/3287850749 shutdown_connections 2023-07-06T19:59:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.618+0000 7f2d54662700 1 -- 172.21.15.6:0/3287850749 wait complete. 2023-07-06T19:59:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.619+0000 7f2d54662700 1 Processor -- start 2023-07-06T19:59:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.619+0000 7f2d54662700 1 -- start start 2023-07-06T19:59:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.620+0000 7f2d54662700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d4c0b1f10 0x7f2d4c14b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.620+0000 7f2d54662700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d4c15d910 0x7f2d4c14e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.620+0000 7f2d54662700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d4c160e00 0x7f2d4c15dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:28.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.620+0000 7f2d54662700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c0b8430 con 0x7f2d4c160e00 2023-07-06T19:59:28.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.620+0000 7f2d54662700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c14f220 con 0x7f2d4c0b1f10 2023-07-06T19:59:28.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.620+0000 7f2d54662700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c14be00 con 0x7f2d4c15d910 2023-07-06T19:59:28.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.620+0000 7f2d52bff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d4c160e00 0x7f2d4c15dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:28.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.620+0000 7f2d52bff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d4c160e00 0x7f2d4c15dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59488/0 (socket says 172.21.15.6:59488) 2023-07-06T19:59:28.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.620+0000 7f2d52bff700 1 -- 172.21.15.6:0/1520035713 learned_addr learned my addr 172.21.15.6:0/1520035713 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:28.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.620+0000 7f2d51bfd700 1 --2- 172.21.15.6:0/1520035713 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d4c15d910 0x7f2d4c14e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:28.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.620+0000 7f2d523fe700 1 --2- 172.21.15.6:0/1520035713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d4c0b1f10 0x7f2d4c14b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:28.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.621+0000 7f2d52bff700 1 -- 172.21.15.6:0/1520035713 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d4c15d910 msgr2=0x7f2d4c14e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:28.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.621+0000 7f2d52bff700 1 --2- 172.21.15.6:0/1520035713 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d4c15d910 0x7f2d4c14e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.621+0000 7f2d52bff700 1 -- 172.21.15.6:0/1520035713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d4c0b1f10 msgr2=0x7f2d4c14b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:28.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.621+0000 7f2d52bff700 1 --2- 172.21.15.6:0/1520035713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d4c0b1f10 0x7f2d4c14b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.621+0000 7f2d52bff700 1 -- 172.21.15.6:0/1520035713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d40009550 con 0x7f2d4c160e00 2023-07-06T19:59:28.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.621+0000 7f2d52bff700 1 --2- 172.21.15.6:0/1520035713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d4c160e00 0x7f2d4c15dce0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400efc0 tx=0x7f2d4400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:28.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.621+0000 7f2d3effd700 1 -- 172.21.15.6:0/1520035713 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d44009ea0 con 0x7f2d4c160e00 2023-07-06T19:59:28.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.621+0000 7f2d3effd700 1 -- 172.21.15.6:0/1520035713 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4400f040 con 0x7f2d4c160e00 2023-07-06T19:59:28.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.621+0000 7f2d54662700 1 -- 172.21.15.6:0/1520035713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d4c0b7820 con 0x7f2d4c160e00 2023-07-06T19:59:28.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.621+0000 7f2d3effd700 1 -- 172.21.15.6:0/1520035713 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4400ced0 con 0x7f2d4c160e00 2023-07-06T19:59:28.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.621+0000 7f2d54662700 1 -- 172.21.15.6:0/1520035713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d4c0b7de0 con 0x7f2d4c160e00 2023-07-06T19:59:28.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.622+0000 7f2d54662700 1 -- 172.21.15.6:0/1520035713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4c072f20 con 0x7f2d4c160e00 2023-07-06T19:59:28.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.622+0000 7f2d3effd700 1 -- 172.21.15.6:0/1520035713 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2d44014480 con 0x7f2d4c160e00 2023-07-06T19:59:28.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.623+0000 7f2d3effd700 1 --2- 172.21.15.6:0/1520035713 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2d3006ad10 0x7f2d3006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:28.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.623+0000 7f2d3effd700 1 -- 172.21.15.6:0/1520035713 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2d44089ee0 con 0x7f2d4c160e00 2023-07-06T19:59:28.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.623+0000 7f2d523fe700 1 --2- 172.21.15.6:0/1520035713 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2d3006ad10 0x7f2d3006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:28.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.623+0000 7f2d523fe700 1 --2- 172.21.15.6:0/1520035713 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2d3006ad10 0x7f2d3006d1c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2d48007fd0 tx=0x7f2d48009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:28.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.627+0000 7f2d3effd700 1 -- 172.21.15.6:0/1520035713 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2d44054d30 con 0x7f2d4c160e00 2023-07-06T19:59:28.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.826+0000 7f2d54662700 1 -- 172.21.15.6:0/1520035713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2d4c04eb90 con 0x7f2d4c160e00 2023-07-06T19:59:28.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.826+0000 7f2d3effd700 1 -- 172.21.15.6:0/1520035713 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2d44018020 con 0x7f2d4c160e00 2023-07-06T19:59:28.832 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T19:59:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.828+0000 7f2d54662700 1 -- 172.21.15.6:0/1520035713 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2d3006ad10 msgr2=0x7f2d3006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:28.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.828+0000 7f2d54662700 1 --2- 172.21.15.6:0/1520035713 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2d3006ad10 0x7f2d3006d1c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2d48007fd0 tx=0x7f2d48009040 comp rx=0 tx=0).stop 2023-07-06T19:59:28.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.828+0000 7f2d54662700 1 -- 172.21.15.6:0/1520035713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d4c160e00 msgr2=0x7f2d4c15dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:28.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.828+0000 7f2d54662700 1 --2- 172.21.15.6:0/1520035713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d4c160e00 0x7f2d4c15dce0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400efc0 tx=0x7f2d4400c3a0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.828+0000 7f2d54662700 1 -- 172.21.15.6:0/1520035713 shutdown_connections 2023-07-06T19:59:28.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.828+0000 7f2d54662700 1 --2- 172.21.15.6:0/1520035713 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2d3006ad10 0x7f2d3006d1c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.828+0000 7f2d54662700 1 --2- 172.21.15.6:0/1520035713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d4c160e00 0x7f2d4c15dce0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.828+0000 7f2d54662700 1 --2- 172.21.15.6:0/1520035713 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2d4c0b1f10 0x7f2d4c14b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.828+0000 7f2d54662700 1 --2- 172.21.15.6:0/1520035713 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2d4c15d910 0x7f2d4c14e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.828+0000 7f2d54662700 1 -- 172.21.15.6:0/1520035713 >> 172.21.15.6:0/1520035713 conn(0x7f2d4c0d2c70 msgr2=0x7f2d4c06ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:28.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.828+0000 7f2d54662700 1 -- 172.21.15.6:0/1520035713 shutdown_connections 2023-07-06T19:59:28.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.828+0000 7f2d54662700 1 -- 172.21.15.6:0/1520035713 wait complete. 2023-07-06T19:59:28.845 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T19:59:28.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.975+0000 7f3401d5d700 1 Processor -- start 2023-07-06T19:59:28.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.975+0000 7f3401d5d700 1 -- start start 2023-07-06T19:59:28.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f3401d5d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f33fc0cfbf0 0x7f33fc15cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:28.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f3401d5d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33fc0b5e30 con 0x7f33fc1602c0 2023-07-06T19:59:28.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f3401d5d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33fc0b6110 con 0x7f33fc0b3c60 2023-07-06T19:59:28.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f3401d5d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33fc0b63f0 con 0x7f33fc0cfbf0 2023-07-06T19:59:28.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f33fb7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f33fc1602c0 0x7f33fc0b5370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60700/0 (socket says 172.21.15.6:60700) 2023-07-06T19:59:28.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f33fb7fe700 1 -- 172.21.15.6:0/3408419160 learned_addr learned my addr 172.21.15.6:0/3408419160 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:28.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f33fa7fc700 1 -- 172.21.15.6:0/3408419160 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827257676 0 0) 0x7f33fc0b5e30 con 0x7f33fc1602c0 2023-07-06T19:59:28.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f33fa7fc700 1 -- 172.21.15.6:0/3408419160 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33e40035b0 con 0x7f33fc1602c0 2023-07-06T19:59:28.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f33fbfff700 1 --2- 172.21.15.6:0/3408419160 >> v2:172.21.15.40:3300/0 conn(0x7f33fc0cfbf0 0x7f33fc15cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:28.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f33fa7fc700 1 -- 172.21.15.6:0/3408419160 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 881440064 0 0) 0x7f33e40035b0 con 0x7f33fc1602c0 2023-07-06T19:59:28.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f33fa7fc700 1 -- 172.21.15.6:0/3408419160 >> v2:172.21.15.40:3300/0 conn(0x7f33fc0cfbf0 msgr2=0x7f33fc15cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:28.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f33fa7fc700 1 --2- 172.21.15.6:0/3408419160 >> v2:172.21.15.40:3300/0 conn(0x7f33fc0cfbf0 0x7f33fc15cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f33fa7fc700 1 -- 172.21.15.6:0/3408419160 >> v1:172.21.15.40:6789/0 conn(0x7f33fc0b3c60 legacy=0x7f33fc15c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:28.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f33fa7fc700 1 -- 172.21.15.6:0/3408419160 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33fc0b66d0 con 0x7f33fc1602c0 2023-07-06T19:59:28.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f33fa7fc700 1 -- 172.21.15.6:0/3408419160 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f33f0001670 con 0x7f33fc1602c0 2023-07-06T19:59:28.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f33fa7fc700 1 -- 172.21.15.6:0/3408419160 >> v1:172.21.15.6:6789/0 conn(0x7f33fc1602c0 legacy=0x7f33fc0b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:28.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f33fa7fc700 1 --2- 172.21.15.6:0/3408419160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33e4003a00 0x7f33e4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:28.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f33fa7fc700 1 --2- 172.21.15.6:0/3408419160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e4004850 0x7f33e4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:28.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f33fa7fc700 1 --2- 172.21.15.6:0/3408419160 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33e4005200 0x7f33e400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:28.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f33fa7fc700 1 -- 172.21.15.6:0/3408419160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc0b63f0 con 0x7f33e4004850 2023-07-06T19:59:28.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f33fa7fc700 1 -- 172.21.15.6:0/3408419160 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e400c190 con 0x7f33e4003a00 2023-07-06T19:59:28.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f33fa7fc700 1 -- 172.21.15.6:0/3408419160 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e400c350 con 0x7f33e4005200 2023-07-06T19:59:28.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f33fbfff700 1 --2- 172.21.15.6:0/3408419160 >> v2:172.21.15.40:3300/0 conn(0x7f33fc0cfbf0 0x7f33fc15cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:28.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f33faffd700 1 --2- 172.21.15.6:0/3408419160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e4004850 0x7f33e4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:28.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.976+0000 7f33fb7fe700 1 --2- 172.21.15.6:0/3408419160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33e4003a00 0x7f33e4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:28.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.977+0000 7f33fbfff700 1 --2- 172.21.15.6:0/3408419160 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33e4005200 0x7f33e400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:28.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.977+0000 7f33faffd700 1 -- 172.21.15.6:0/3408419160 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33e4005200 msgr2=0x7f33e400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:28.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.977+0000 7f33faffd700 1 --2- 172.21.15.6:0/3408419160 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33e4005200 0x7f33e400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.977+0000 7f33faffd700 1 -- 172.21.15.6:0/3408419160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33e4003a00 msgr2=0x7f33e4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:28.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.977+0000 7f33faffd700 1 --2- 172.21.15.6:0/3408419160 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33e4003a00 0x7f33e4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.977+0000 7f33fbfff700 1 -- 172.21.15.6:0/3408419160 reap_dead start 2023-07-06T19:59:28.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.977+0000 7f33faffd700 1 -- 172.21.15.6:0/3408419160 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e40035b0 con 0x7f33e4004850 2023-07-06T19:59:28.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.977+0000 7f33faffd700 1 --2- 172.21.15.6:0/3408419160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e4004850 0x7f33e4004cc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f33ec007fd0 tx=0x7f33e4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee262e9f60e8df06 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:28.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.977+0000 7f33fa7fc700 1 -- 172.21.15.6:0/3408419160 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec0012f0 con 0x7f33e4004850 2023-07-06T19:59:28.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.977+0000 7f33fa7fc700 1 -- 172.21.15.6:0/3408419160 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ec005310 con 0x7f33e4004850 2023-07-06T19:59:28.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.977+0000 7f33fa7fc700 1 -- 172.21.15.6:0/3408419160 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec006860 con 0x7f33e4004850 2023-07-06T19:59:28.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.978+0000 7f3401d5d700 1 -- 172.21.15.6:0/3408419160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e4004850 msgr2=0x7f33e4004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:28.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.978+0000 7f3401d5d700 1 --2- 172.21.15.6:0/3408419160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e4004850 0x7f33e4004cc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f33ec007fd0 tx=0x7f33e4005880 comp rx=0 tx=0).stop 2023-07-06T19:59:28.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.978+0000 7f3401d5d700 1 -- 172.21.15.6:0/3408419160 shutdown_connections 2023-07-06T19:59:28.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.978+0000 7f3401d5d700 1 --2- 172.21.15.6:0/3408419160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e4004850 0x7f33e4004cc0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:28.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.978+0000 7f3401d5d700 1 -- 172.21.15.6:0/3408419160 >> 172.21.15.6:0/3408419160 conn(0x7f33fc0ce120 msgr2=0x7f33fc0d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:28.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.978+0000 7f3401d5d700 1 -- 172.21.15.6:0/3408419160 shutdown_connections 2023-07-06T19:59:28.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.978+0000 7f3401d5d700 1 -- 172.21.15.6:0/3408419160 wait complete. 2023-07-06T19:59:28.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.979+0000 7f3401d5d700 1 Processor -- start 2023-07-06T19:59:28.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.979+0000 7f3401d5d700 1 -- start start 2023-07-06T19:59:28.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.980+0000 7f3401d5d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e4004850 0x7f33fc153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:28.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.980+0000 7f3401d5d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33fc153930 0x7f33fc1e71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:28.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.980+0000 7f3401d5d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33fc153230 0x7f33fc0cc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:28.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.980+0000 7f3401d5d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc1e6d50 con 0x7f33e4004850 2023-07-06T19:59:28.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.980+0000 7f3401d5d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc1e6140 con 0x7f33fc153230 2023-07-06T19:59:28.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.980+0000 7f3401d5d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33fc1e6420 con 0x7f33fc153930 2023-07-06T19:59:28.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.980+0000 7f33fb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e4004850 0x7f33fc153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:28.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.980+0000 7f33fb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e4004850 0x7f33fc153e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59504/0 (socket says 172.21.15.6:59504) 2023-07-06T19:59:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.980+0000 7f33fb7fe700 1 -- 172.21.15.6:0/2172118062 learned_addr learned my addr 172.21.15.6:0/2172118062 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.980+0000 7f33faffd700 1 --2- 172.21.15.6:0/2172118062 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33fc153930 0x7f33fc1e71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.980+0000 7f33fbfff700 1 --2- 172.21.15.6:0/2172118062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33fc153230 0x7f33fc0cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:29.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.980+0000 7f33fb7fe700 1 -- 172.21.15.6:0/2172118062 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33fc153930 msgr2=0x7f33fc1e71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.980+0000 7f33fb7fe700 1 --2- 172.21.15.6:0/2172118062 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33fc153930 0x7f33fc1e71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.980+0000 7f33fb7fe700 1 -- 172.21.15.6:0/2172118062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33fc153230 msgr2=0x7f33fc0cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.980+0000 7f33fb7fe700 1 --2- 172.21.15.6:0/2172118062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33fc153230 0x7f33fc0cc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.980+0000 7f33fb7fe700 1 -- 172.21.15.6:0/2172118062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33fc1e6700 con 0x7f33e4004850 2023-07-06T19:59:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.980+0000 7f33fb7fe700 1 --2- 172.21.15.6:0/2172118062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e4004850 0x7f33fc153e60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f33f00072c0 tx=0x7f33f00075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.980+0000 7f33e3fff700 1 -- 172.21.15.6:0/2172118062 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0011580 con 0x7f33e4004850 2023-07-06T19:59:29.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.981+0000 7f33e3fff700 1 -- 172.21.15.6:0/2172118062 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f00116e0 con 0x7f33e4004850 2023-07-06T19:59:29.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.981+0000 7f33e3fff700 1 -- 172.21.15.6:0/2172118062 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0011a90 con 0x7f33e4004850 2023-07-06T19:59:29.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.981+0000 7f3401d5d700 1 -- 172.21.15.6:0/2172118062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33fc1e69e0 con 0x7f33e4004850 2023-07-06T19:59:29.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.981+0000 7f3401d5d700 1 -- 172.21.15.6:0/2172118062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33fc0b0440 con 0x7f33e4004850 2023-07-06T19:59:29.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.982+0000 7f3401d5d700 1 -- 172.21.15.6:0/2172118062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33fc0b0660 con 0x7f33e4004850 2023-07-06T19:59:29.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.982+0000 7f33e3fff700 1 -- 172.21.15.6:0/2172118062 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f33f0011bf0 con 0x7f33e4004850 2023-07-06T19:59:29.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.982+0000 7f33e3fff700 1 --2- 172.21.15.6:0/2172118062 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f33e806ace0 0x7f33e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:29.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.982+0000 7f33e3fff700 1 -- 172.21.15.6:0/2172118062 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f33f00895d0 con 0x7f33e4004850 2023-07-06T19:59:29.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.982+0000 7f33faffd700 1 --2- 172.21.15.6:0/2172118062 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f33e806ace0 0x7f33e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:29.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.983+0000 7f33faffd700 1 --2- 172.21.15.6:0/2172118062 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f33e806ace0 0x7f33e806d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f33ec007fd0 tx=0x7f33ec011000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:29.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:28.987+0000 7f33e3fff700 1 -- 172.21.15.6:0/2172118062 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f33f0054420 con 0x7f33e4004850 2023-07-06T19:59:29.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.183+0000 7f3401d5d700 1 -- 172.21.15.6:0/2172118062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f33fc04eb90 con 0x7f33e4004850 2023-07-06T19:59:29.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.183+0000 7f33e3fff700 1 -- 172.21.15.6:0/2172118062 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f33f0057a40 con 0x7f33e4004850 2023-07-06T19:59:29.186 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-06T19:59:29.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.185+0000 7f3401d5d700 1 -- 172.21.15.6:0/2172118062 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f33e806ace0 msgr2=0x7f33e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:29.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.185+0000 7f3401d5d700 1 --2- 172.21.15.6:0/2172118062 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f33e806ace0 0x7f33e806d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f33ec007fd0 tx=0x7f33ec011000 comp rx=0 tx=0).stop 2023-07-06T19:59:29.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.185+0000 7f3401d5d700 1 -- 172.21.15.6:0/2172118062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e4004850 msgr2=0x7f33fc153e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:29.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.185+0000 7f3401d5d700 1 --2- 172.21.15.6:0/2172118062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e4004850 0x7f33fc153e60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f33f00072c0 tx=0x7f33f00075d0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.185+0000 7f3401d5d700 1 -- 172.21.15.6:0/2172118062 shutdown_connections 2023-07-06T19:59:29.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.185+0000 7f3401d5d700 1 --2- 172.21.15.6:0/2172118062 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f33e806ace0 0x7f33e806d190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.185+0000 7f3401d5d700 1 --2- 172.21.15.6:0/2172118062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33e4004850 0x7f33fc153e60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.185+0000 7f3401d5d700 1 --2- 172.21.15.6:0/2172118062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33fc153230 0x7f33fc0cc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.185+0000 7f3401d5d700 1 --2- 172.21.15.6:0/2172118062 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33fc153930 0x7f33fc1e71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.185+0000 7f3401d5d700 1 -- 172.21.15.6:0/2172118062 >> 172.21.15.6:0/2172118062 conn(0x7f33fc0ce120 msgr2=0x7f33fc15c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:29.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.185+0000 7f3401d5d700 1 -- 172.21.15.6:0/2172118062 shutdown_connections 2023-07-06T19:59:29.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.185+0000 7f3401d5d700 1 -- 172.21.15.6:0/2172118062 wait complete. 2023-07-06T19:59:29.200 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T19:59:29.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.325+0000 7fc508225700 1 Processor -- start 2023-07-06T19:59:29.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.326+0000 7fc508225700 1 -- start start 2023-07-06T19:59:29.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.326+0000 7fc508225700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc5001592b0 0x7fc500071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:29.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.326+0000 7fc508225700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc50015cd40 0x7fc500071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:29.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.326+0000 7fc508225700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5000cc160 con 0x7fc5000cd950 2023-07-06T19:59:29.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.326+0000 7fc508225700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc500159680 con 0x7fc5001592b0 2023-07-06T19:59:29.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.326+0000 7fc508225700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50015d2b0 con 0x7fc50015cd40 2023-07-06T19:59:29.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.327+0000 7fc505fc1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc5001592b0 0x7fc500071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:29.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.327+0000 7fc5067c2700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc5000cd950 0x7fc50006d8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60724/0 (socket says 172.21.15.6:60724) 2023-07-06T19:59:29.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.327+0000 7fc5067c2700 1 -- 172.21.15.6:0/1163708177 learned_addr learned my addr 172.21.15.6:0/1163708177 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:29.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.327+0000 7fc5057c0700 1 --2- 172.21.15.6:0/1163708177 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc50015cd40 0x7fc500071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:29.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.327+0000 7fc505fc1700 1 -- 172.21.15.6:0/1163708177 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc50015cd40 msgr2=0x7fc500071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:29.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.327+0000 7fc505fc1700 1 --2- 172.21.15.6:0/1163708177 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc50015cd40 0x7fc500071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.327+0000 7fc505fc1700 1 -- 172.21.15.6:0/1163708177 >> v1:172.21.15.6:6789/0 conn(0x7fc5000cd950 legacy=0x7fc50006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:29.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.327+0000 7fc504fbf700 1 -- 172.21.15.6:0/1163708177 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338504911 0 0) 0x7fc5000cc160 con 0x7fc5000cd950 2023-07-06T19:59:29.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.327+0000 7fc505fc1700 1 -- 172.21.15.6:0/1163708177 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50015d590 con 0x7fc5001592b0 2023-07-06T19:59:29.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.327+0000 7fc505fc1700 1 --2- 172.21.15.6:0/1163708177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5001592b0 0x7fc500071690 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc4f800bfa0 tx=0x7fc4f800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da42a7a833132094 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:29.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.327+0000 7fc504fbf700 1 -- 172.21.15.6:0/1163708177 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8010070 con 0x7fc5001592b0 2023-07-06T19:59:29.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.327+0000 7fc504fbf700 1 -- 172.21.15.6:0/1163708177 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f800b2e0 con 0x7fc5001592b0 2023-07-06T19:59:29.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.327+0000 7fc504fbf700 1 -- 172.21.15.6:0/1163708177 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f800dcf0 con 0x7fc5001592b0 2023-07-06T19:59:29.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.328+0000 7fc508225700 1 -- 172.21.15.6:0/1163708177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5001592b0 msgr2=0x7fc500071690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:29.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.328+0000 7fc508225700 1 --2- 172.21.15.6:0/1163708177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5001592b0 0x7fc500071690 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc4f800bfa0 tx=0x7fc4f800d330 comp rx=0 tx=0).stop 2023-07-06T19:59:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.328+0000 7fc508225700 1 -- 172.21.15.6:0/1163708177 shutdown_connections 2023-07-06T19:59:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.328+0000 7fc508225700 1 --2- 172.21.15.6:0/1163708177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5001592b0 0x7fc500071690 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.328+0000 7fc508225700 1 --2- 172.21.15.6:0/1163708177 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc50015cd40 0x7fc500071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.328+0000 7fc508225700 1 -- 172.21.15.6:0/1163708177 >> 172.21.15.6:0/1163708177 conn(0x7fc5000cf960 msgr2=0x7fc5000cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:29.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.328+0000 7fc508225700 1 -- 172.21.15.6:0/1163708177 shutdown_connections 2023-07-06T19:59:29.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.328+0000 7fc508225700 1 -- 172.21.15.6:0/1163708177 wait complete. 2023-07-06T19:59:29.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.329+0000 7fc508225700 1 Processor -- start 2023-07-06T19:59:29.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.329+0000 7fc508225700 1 -- start start 2023-07-06T19:59:29.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.330+0000 7fc508225700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5000cd950 0x7fc5000b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:29.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.330+0000 7fc508225700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5001592b0 0x7fc5000c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:29.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.330+0000 7fc508225700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc50015cd40 0x7fc5000c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:29.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.330+0000 7fc508225700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5000b3320 con 0x7fc5001592b0 2023-07-06T19:59:29.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.330+0000 7fc508225700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5000b35e0 con 0x7fc5000cd950 2023-07-06T19:59:29.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.330+0000 7fc508225700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5000b38c0 con 0x7fc50015cd40 2023-07-06T19:59:29.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.330+0000 7fc5057c0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5001592b0 0x7fc5000c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:29.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.330+0000 7fc5057c0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5001592b0 0x7fc5000c79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59520/0 (socket says 172.21.15.6:59520) 2023-07-06T19:59:29.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.330+0000 7fc5057c0700 1 -- 172.21.15.6:0/1962799342 learned_addr learned my addr 172.21.15.6:0/1962799342 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:29.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.330+0000 7fc505fc1700 1 --2- 172.21.15.6:0/1962799342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5000cd950 0x7fc5000b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:29.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.330+0000 7fc5067c2700 1 --2- 172.21.15.6:0/1962799342 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc50015cd40 0x7fc5000c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:29.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.330+0000 7fc5057c0700 1 -- 172.21.15.6:0/1962799342 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc50015cd40 msgr2=0x7fc5000c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:29.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.330+0000 7fc5057c0700 1 --2- 172.21.15.6:0/1962799342 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc50015cd40 0x7fc5000c7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.330+0000 7fc5057c0700 1 -- 172.21.15.6:0/1962799342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5000cd950 msgr2=0x7fc5000b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:29.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.330+0000 7fc5057c0700 1 --2- 172.21.15.6:0/1962799342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5000cd950 0x7fc5000b5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.330+0000 7fc5057c0700 1 -- 172.21.15.6:0/1962799342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f800bc80 con 0x7fc5001592b0 2023-07-06T19:59:29.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.330+0000 7fc5057c0700 1 --2- 172.21.15.6:0/1962799342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5001592b0 0x7fc5000c79b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000e810 tx=0x7fc4f000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:29.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.330+0000 7fc4f67fc700 1 -- 172.21.15.6:0/1962799342 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0013610 con 0x7fc5001592b0 2023-07-06T19:59:29.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.331+0000 7fc4f67fc700 1 -- 172.21.15.6:0/1962799342 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f0013770 con 0x7fc5001592b0 2023-07-06T19:59:29.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.331+0000 7fc4f67fc700 1 -- 172.21.15.6:0/1962799342 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0013b20 con 0x7fc5001592b0 2023-07-06T19:59:29.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.331+0000 7fc508225700 1 -- 172.21.15.6:0/1962799342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5000b3ba0 con 0x7fc5001592b0 2023-07-06T19:59:29.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.331+0000 7fc508225700 1 -- 172.21.15.6:0/1962799342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5000c8520 con 0x7fc5001592b0 2023-07-06T19:59:29.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.332+0000 7fc508225700 1 -- 172.21.15.6:0/1962799342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5000676f0 con 0x7fc5001592b0 2023-07-06T19:59:29.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.332+0000 7fc4f67fc700 1 -- 172.21.15.6:0/1962799342 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc4f0013c80 con 0x7fc5001592b0 2023-07-06T19:59:29.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.332+0000 7fc4f67fc700 1 --2- 172.21.15.6:0/1962799342 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc4e406ace0 0x7fc4e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:29.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.333+0000 7fc4f67fc700 1 -- 172.21.15.6:0/1962799342 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc4f0089450 con 0x7fc5001592b0 2023-07-06T19:59:29.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.333+0000 7fc505fc1700 1 --2- 172.21.15.6:0/1962799342 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc4e406ace0 0x7fc4e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:29.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.333+0000 7fc505fc1700 1 --2- 172.21.15.6:0/1962799342 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc4e406ace0 0x7fc4e406d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8000f80 tx=0x7fc4f800b000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:29.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.337+0000 7fc4f67fc700 1 -- 172.21.15.6:0/1962799342 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc4f0054180 con 0x7fc5001592b0 2023-07-06T19:59:29.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.532+0000 7fc508225700 1 -- 172.21.15.6:0/1962799342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc50004eb90 con 0x7fc5001592b0 2023-07-06T19:59:29.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.533+0000 7fc4f67fc700 1 -- 172.21.15.6:0/1962799342 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc4f00577a0 con 0x7fc5001592b0 2023-07-06T19:59:29.535 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T19:59:29.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.535+0000 7fc508225700 1 -- 172.21.15.6:0/1962799342 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc4e406ace0 msgr2=0x7fc4e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:29.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.535+0000 7fc508225700 1 --2- 172.21.15.6:0/1962799342 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc4e406ace0 0x7fc4e406d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8000f80 tx=0x7fc4f800b000 comp rx=0 tx=0).stop 2023-07-06T19:59:29.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.535+0000 7fc508225700 1 -- 172.21.15.6:0/1962799342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5001592b0 msgr2=0x7fc5000c79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:29.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.535+0000 7fc508225700 1 --2- 172.21.15.6:0/1962799342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5001592b0 0x7fc5000c79b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc4f000e810 tx=0x7fc4f000ebd0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.535+0000 7fc508225700 1 -- 172.21.15.6:0/1962799342 shutdown_connections 2023-07-06T19:59:29.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.535+0000 7fc508225700 1 --2- 172.21.15.6:0/1962799342 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc4e406ace0 0x7fc4e406d190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.535+0000 7fc508225700 1 --2- 172.21.15.6:0/1962799342 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc50015cd40 0x7fc5000c7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.535+0000 7fc508225700 1 --2- 172.21.15.6:0/1962799342 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5000cd950 0x7fc5000b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.535+0000 7fc508225700 1 --2- 172.21.15.6:0/1962799342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5001592b0 0x7fc5000c79b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.535+0000 7fc508225700 1 -- 172.21.15.6:0/1962799342 >> 172.21.15.6:0/1962799342 conn(0x7fc5000cf960 msgr2=0x7fc50006be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:29.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.535+0000 7fc508225700 1 -- 172.21.15.6:0/1962799342 shutdown_connections 2023-07-06T19:59:29.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.535+0000 7fc508225700 1 -- 172.21.15.6:0/1962799342 wait complete. 2023-07-06T19:59:29.549 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T19:59:29.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.672+0000 7f88dd76f700 1 Processor -- start 2023-07-06T19:59:29.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.673+0000 7f88dd76f700 1 -- start start 2023-07-06T19:59:29.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.673+0000 7f88dd76f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f88d815ce50 0x7f88d80cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:29.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.673+0000 7f88dd76f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f88d815d220 0x7f88d806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:29.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.673+0000 7f88dd76f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d8160060 con 0x7f88d815d6a0 2023-07-06T19:59:29.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.673+0000 7f88dd76f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d80d1740 con 0x7f88d815d220 2023-07-06T19:59:29.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.673+0000 7f88dd76f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d80cd800 con 0x7f88d815ce50 2023-07-06T19:59:29.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.673+0000 7f88d67fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f88d815d220 0x7f88d806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:29.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.673+0000 7f88d77fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f88d815d6a0 0x7f88d806a060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60738/0 (socket says 172.21.15.6:60738) 2023-07-06T19:59:29.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.673+0000 7f88d77fe700 1 -- 172.21.15.6:0/1285353950 learned_addr learned my addr 172.21.15.6:0/1285353950 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:29.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.674+0000 7f88d6ffd700 1 --2- 172.21.15.6:0/1285353950 >> v2:172.21.15.40:3300/0 conn(0x7f88d815ce50 0x7f88d80cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:29.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.674+0000 7f88d5ffb700 1 -- 172.21.15.6:0/1285353950 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238801185 0 0) 0x7f88d8160060 con 0x7f88d815d6a0 2023-07-06T19:59:29.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.674+0000 7f88d5ffb700 1 -- 172.21.15.6:0/1285353950 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88c40035b0 con 0x7f88d815d6a0 2023-07-06T19:59:29.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.674+0000 7f88d67fc700 1 -- 172.21.15.6:0/1285353950 >> v2:172.21.15.40:3300/0 conn(0x7f88d815ce50 msgr2=0x7f88d80cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:29.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.674+0000 7f88d67fc700 1 --2- 172.21.15.6:0/1285353950 >> v2:172.21.15.40:3300/0 conn(0x7f88d815ce50 0x7f88d80cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.674+0000 7f88d67fc700 1 -- 172.21.15.6:0/1285353950 >> v1:172.21.15.6:6789/0 conn(0x7f88d815d6a0 legacy=0x7f88d806a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:29.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.674+0000 7f88d67fc700 1 -- 172.21.15.6:0/1285353950 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d81602b0 con 0x7f88d815d220 2023-07-06T19:59:29.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.674+0000 7f88d67fc700 1 --2- 172.21.15.6:0/1285353950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88d815d220 0x7f88d806bdb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f88d8072560 tx=0x7f88c0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e342c02f59a755d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:29.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.674+0000 7f88d5ffb700 1 -- 172.21.15.6:0/1285353950 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0011830 con 0x7f88d815d220 2023-07-06T19:59:29.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.674+0000 7f88d5ffb700 1 -- 172.21.15.6:0/1285353950 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c0011990 con 0x7f88d815d220 2023-07-06T19:59:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.674+0000 7f88d5ffb700 1 -- 172.21.15.6:0/1285353950 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0011d20 con 0x7f88d815d220 2023-07-06T19:59:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.675+0000 7f88dd76f700 1 -- 172.21.15.6:0/1285353950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88d815d220 msgr2=0x7f88d806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.675+0000 7f88dd76f700 1 --2- 172.21.15.6:0/1285353950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88d815d220 0x7f88d806bdb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f88d8072560 tx=0x7f88c0009b20 comp rx=0 tx=0).stop 2023-07-06T19:59:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.675+0000 7f88dd76f700 1 -- 172.21.15.6:0/1285353950 shutdown_connections 2023-07-06T19:59:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.675+0000 7f88dd76f700 1 --2- 172.21.15.6:0/1285353950 >> v2:172.21.15.40:3300/0 conn(0x7f88d815ce50 0x7f88d80cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.675+0000 7f88dd76f700 1 --2- 172.21.15.6:0/1285353950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88d815d220 0x7f88d806bdb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.675+0000 7f88dd76f700 1 -- 172.21.15.6:0/1285353950 >> 172.21.15.6:0/1285353950 conn(0x7f88d80d3880 msgr2=0x7f88d80cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:29.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.675+0000 7f88dd76f700 1 -- 172.21.15.6:0/1285353950 shutdown_connections 2023-07-06T19:59:29.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.675+0000 7f88dd76f700 1 -- 172.21.15.6:0/1285353950 wait complete. 2023-07-06T19:59:29.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.676+0000 7f88dd76f700 1 Processor -- start 2023-07-06T19:59:29.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.676+0000 7f88dd76f700 1 -- start start 2023-07-06T19:59:29.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.677+0000 7f88dd76f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88d815ce50 0x7f88d8158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:29.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.677+0000 7f88dd76f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88d815d220 0x7f88d815ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:29.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.677+0000 7f88dd76f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88d815d6a0 0x7f88d814b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:29.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.677+0000 7f88dd76f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d815be50 con 0x7f88d815ce50 2023-07-06T19:59:29.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.677+0000 7f88dd76f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d8159480 con 0x7f88d815d220 2023-07-06T19:59:29.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.677+0000 7f88dd76f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d80b8810 con 0x7f88d815d6a0 2023-07-06T19:59:29.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.677+0000 7f88d6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88d815ce50 0x7f88d8158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:29.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.677+0000 7f88d6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88d815ce50 0x7f88d8158f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59532/0 (socket says 172.21.15.6:59532) 2023-07-06T19:59:29.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.677+0000 7f88d6ffd700 1 -- 172.21.15.6:0/2036268641 learned_addr learned my addr 172.21.15.6:0/2036268641 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:29.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.677+0000 7f88d67fc700 1 --2- 172.21.15.6:0/2036268641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88d815d220 0x7f88d815ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:29.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.677+0000 7f88d77fe700 1 --2- 172.21.15.6:0/2036268641 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88d815d6a0 0x7f88d814b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:29.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.677+0000 7f88d6ffd700 1 -- 172.21.15.6:0/2036268641 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88d815d6a0 msgr2=0x7f88d814b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:29.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.677+0000 7f88d6ffd700 1 --2- 172.21.15.6:0/2036268641 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88d815d6a0 0x7f88d814b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.677+0000 7f88d6ffd700 1 -- 172.21.15.6:0/2036268641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88d815d220 msgr2=0x7f88d815ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:29.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.677+0000 7f88d6ffd700 1 --2- 172.21.15.6:0/2036268641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88d815d220 0x7f88d815ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.677+0000 7f88d6ffd700 1 -- 172.21.15.6:0/2036268641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c00094a0 con 0x7f88d815ce50 2023-07-06T19:59:29.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.677+0000 7f88d67fc700 1 --2- 172.21.15.6:0/2036268641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88d815d220 0x7f88d815ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:29.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.677+0000 7f88d77fe700 1 --2- 172.21.15.6:0/2036268641 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88d815d6a0 0x7f88d814b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:29.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.678+0000 7f88d6ffd700 1 --2- 172.21.15.6:0/2036268641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88d815ce50 0x7f88d8158f40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f88c800e9b0 tx=0x7f88c800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:29.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.678+0000 7f88cf7fe700 1 -- 172.21.15.6:0/2036268641 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c8009710 con 0x7f88d815ce50 2023-07-06T19:59:29.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.678+0000 7f88cf7fe700 1 -- 172.21.15.6:0/2036268641 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c800c850 con 0x7f88d815ce50 2023-07-06T19:59:29.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.678+0000 7f88dd76f700 1 -- 172.21.15.6:0/2036268641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d815b790 con 0x7f88d815ce50 2023-07-06T19:59:29.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.678+0000 7f88cf7fe700 1 -- 172.21.15.6:0/2036268641 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c800cbc0 con 0x7f88d815ce50 2023-07-06T19:59:29.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.678+0000 7f88dd76f700 1 -- 172.21.15.6:0/2036268641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d81560a0 con 0x7f88d815ce50 2023-07-06T19:59:29.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.679+0000 7f88dd76f700 1 -- 172.21.15.6:0/2036268641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d815c0c0 con 0x7f88d815ce50 2023-07-06T19:59:29.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.680+0000 7f88cf7fe700 1 -- 172.21.15.6:0/2036268641 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f88c800cd20 con 0x7f88d815ce50 2023-07-06T19:59:29.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.680+0000 7f88cf7fe700 1 --2- 172.21.15.6:0/2036268641 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f88b806ace0 0x7f88b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:29.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.680+0000 7f88cf7fe700 1 -- 172.21.15.6:0/2036268641 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f88c808a090 con 0x7f88d815ce50 2023-07-06T19:59:29.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.680+0000 7f88d67fc700 1 --2- 172.21.15.6:0/2036268641 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f88b806ace0 0x7f88b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:29.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.681+0000 7f88d67fc700 1 --2- 172.21.15.6:0/2036268641 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f88b806ace0 0x7f88b806d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f88d80b7c20 tx=0x7f88c0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:29.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.684+0000 7f88cf7fe700 1 -- 172.21.15.6:0/2036268641 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f88c8058940 con 0x7f88d815ce50 2023-07-06T19:59:29.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.929+0000 7f88dd76f700 1 -- 172.21.15.6:0/2036268641 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88d8074200 con 0x7f88d815ce50 2023-07-06T19:59:29.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.929+0000 7f88cf7fe700 1 -- 172.21.15.6:0/2036268641 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4652 (secure 0 0 0) 0x7f88c80584d0 con 0x7f88d815ce50 2023-07-06T19:59:29.932 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:29.932 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3695014381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3695014381},{"type":"v1","addr":"172.21.15.6:6835","nonce":3695014381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/849399781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":849399781},{"type":"v1","addr":"172.21.15.40:6833","nonce":849399781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/512806705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":512806705},{"type":"v1","addr":"172.21.15.40:6835","nonce":512806705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T19:58:53.158966+0000","modified":"2023-07-06T19:59:17.827616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/368324315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":368324315},{"type":"v1","addr":"172.21.15.6:6837","nonce":368324315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-06T19:59:29.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.932+0000 7f88dd76f700 1 -- 172.21.15.6:0/2036268641 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f88b806ace0 msgr2=0x7f88b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:29.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.932+0000 7f88dd76f700 1 --2- 172.21.15.6:0/2036268641 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f88b806ace0 0x7f88b806d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f88d80b7c20 tx=0x7f88c0008030 comp rx=0 tx=0).stop 2023-07-06T19:59:29.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.932+0000 7f88dd76f700 1 -- 172.21.15.6:0/2036268641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88d815ce50 msgr2=0x7f88d8158f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:29.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.932+0000 7f88dd76f700 1 --2- 172.21.15.6:0/2036268641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88d815ce50 0x7f88d8158f40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f88c800e9b0 tx=0x7f88c800ed70 comp rx=0 tx=0).stop 2023-07-06T19:59:29.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.932+0000 7f88dd76f700 1 -- 172.21.15.6:0/2036268641 shutdown_connections 2023-07-06T19:59:29.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.932+0000 7f88dd76f700 1 --2- 172.21.15.6:0/2036268641 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f88b806ace0 0x7f88b806d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.932+0000 7f88dd76f700 1 --2- 172.21.15.6:0/2036268641 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88d815ce50 0x7f88d8158f40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.932+0000 7f88dd76f700 1 --2- 172.21.15.6:0/2036268641 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88d815d6a0 0x7f88d814b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.932+0000 7f88dd76f700 1 --2- 172.21.15.6:0/2036268641 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f88d815d220 0x7f88d815ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:29.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.932+0000 7f88dd76f700 1 -- 172.21.15.6:0/2036268641 >> 172.21.15.6:0/2036268641 conn(0x7f88d80d3880 msgr2=0x7f88d80b46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:29.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.932+0000 7f88dd76f700 1 -- 172.21.15.6:0/2036268641 shutdown_connections 2023-07-06T19:59:29.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:29.932+0000 7f88dd76f700 1 -- 172.21.15.6:0/2036268641 wait complete. 2023-07-06T19:59:29.939 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 9 2023-07-06T19:59:29.953 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T19:59:30.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.079+0000 7fba49f14700 1 Processor -- start 2023-07-06T19:59:30.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.079+0000 7fba49f14700 1 -- start start 2023-07-06T19:59:30.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.080+0000 7fba49f14700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba4415ffd0 0x7fba44160420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:30.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.080+0000 7fba49f14700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba44160960 con 0x7fba440cb080 2023-07-06T19:59:30.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.080+0000 7fba49f14700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba440cffe0 con 0x7fba4415c4d0 2023-07-06T19:59:30.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.080+0000 7fba49f14700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba440d0470 con 0x7fba4415ffd0 2023-07-06T19:59:30.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.080+0000 7fba43fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fba440cb080 0x7fba440cb500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60752/0 (socket says 172.21.15.6:60752) 2023-07-06T19:59:30.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.080+0000 7fba43fff700 1 -- 172.21.15.6:0/4259238119 learned_addr learned my addr 172.21.15.6:0/4259238119 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:30.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.080+0000 7fba42ffd700 1 --2- 172.21.15.6:0/4259238119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba4415ffd0 0x7fba44160420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:30.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba427fc700 1 -- 172.21.15.6:0/4259238119 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187982156 0 0) 0x7fba3c001490 con 0x7fba440cb080 2023-07-06T19:59:30.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba427fc700 1 -- 172.21.15.6:0/4259238119 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba300035b0 con 0x7fba440cb080 2023-07-06T19:59:30.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba427fc700 1 -- 172.21.15.6:0/4259238119 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2268472708 0 0) 0x7fba440cffe0 con 0x7fba4415c4d0 2023-07-06T19:59:30.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba427fc700 1 -- 172.21.15.6:0/4259238119 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba3c001490 con 0x7fba4415c4d0 2023-07-06T19:59:30.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba427fc700 1 -- 172.21.15.6:0/4259238119 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2306551525 0 0) 0x7fba300035b0 con 0x7fba440cb080 2023-07-06T19:59:30.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba427fc700 1 -- 172.21.15.6:0/4259238119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba4415ffd0 msgr2=0x7fba44160420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:30.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba427fc700 1 --2- 172.21.15.6:0/4259238119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba4415ffd0 0x7fba44160420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:30.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba427fc700 1 -- 172.21.15.6:0/4259238119 >> v1:172.21.15.40:6789/0 conn(0x7fba4415c4d0 legacy=0x7fba440b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:30.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba427fc700 1 -- 172.21.15.6:0/4259238119 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4415c8a0 con 0x7fba440cb080 2023-07-06T19:59:30.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba427fc700 1 -- 172.21.15.6:0/4259238119 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7fba3c001b00 con 0x7fba440cb080 2023-07-06T19:59:30.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba427fc700 1 -- 172.21.15.6:0/4259238119 >> v1:172.21.15.6:6789/0 conn(0x7fba440cb080 legacy=0x7fba440cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:30.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba427fc700 1 --2- 172.21.15.6:0/4259238119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba30003c30 0x7fba30004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:30.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba427fc700 1 --2- 172.21.15.6:0/4259238119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba30004850 0x7fba30004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:30.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba427fc700 1 --2- 172.21.15.6:0/4259238119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba4415ffd0 0x7fba30005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:30.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba427fc700 1 -- 172.21.15.6:0/4259238119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba440d0470 con 0x7fba30004850 2023-07-06T19:59:30.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba427fc700 1 -- 172.21.15.6:0/4259238119 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3000bb10 con 0x7fba30003c30 2023-07-06T19:59:30.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba427fc700 1 -- 172.21.15.6:0/4259238119 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3000bcd0 con 0x7fba4415ffd0 2023-07-06T19:59:30.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba42ffd700 1 --2- 172.21.15.6:0/4259238119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba30004850 0x7fba30004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:30.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba437fe700 1 --2- 172.21.15.6:0/4259238119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba30003c30 0x7fba30004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:30.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba43fff700 1 --2- 172.21.15.6:0/4259238119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba4415ffd0 0x7fba30005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:30.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba42ffd700 1 -- 172.21.15.6:0/4259238119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba4415ffd0 msgr2=0x7fba30005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:30.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba42ffd700 1 --2- 172.21.15.6:0/4259238119 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba4415ffd0 0x7fba30005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:30.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba42ffd700 1 -- 172.21.15.6:0/4259238119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba30003c30 msgr2=0x7fba30004020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:30.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba42ffd700 1 --2- 172.21.15.6:0/4259238119 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba30003c30 0x7fba30004020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:30.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.081+0000 7fba42ffd700 1 -- 172.21.15.6:0/4259238119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba300035b0 con 0x7fba30004850 2023-07-06T19:59:30.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.082+0000 7fba42ffd700 1 --2- 172.21.15.6:0/4259238119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba30004850 0x7fba30004cc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fba34009b60 tx=0x7fba30005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5d3641a5b8437c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:30.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.082+0000 7fba427fc700 1 -- 172.21.15.6:0/4259238119 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3400e6c0 con 0x7fba30004850 2023-07-06T19:59:30.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.082+0000 7fba427fc700 1 -- 172.21.15.6:0/4259238119 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3400e820 con 0x7fba30004850 2023-07-06T19:59:30.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.082+0000 7fba427fc700 1 -- 172.21.15.6:0/4259238119 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3400eb90 con 0x7fba30004850 2023-07-06T19:59:30.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.082+0000 7fba49f14700 1 -- 172.21.15.6:0/4259238119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba30004850 msgr2=0x7fba30004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:30.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.082+0000 7fba49f14700 1 --2- 172.21.15.6:0/4259238119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba30004850 0x7fba30004cc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fba34009b60 tx=0x7fba30005880 comp rx=0 tx=0).stop 2023-07-06T19:59:30.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.082+0000 7fba43fff700 1 -- 172.21.15.6:0/4259238119 reap_dead start 2023-07-06T19:59:30.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.082+0000 7fba49f14700 1 -- 172.21.15.6:0/4259238119 shutdown_connections 2023-07-06T19:59:30.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.082+0000 7fba49f14700 1 -- 172.21.15.6:0/4259238119 >> 172.21.15.6:0/4259238119 conn(0x7fba440d0a30 msgr2=0x7fba440d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:30.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.082+0000 7fba49f14700 1 -- 172.21.15.6:0/4259238119 shutdown_connections 2023-07-06T19:59:30.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.082+0000 7fba49f14700 1 -- 172.21.15.6:0/4259238119 wait complete. 2023-07-06T19:59:30.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.083+0000 7fba49f14700 1 Processor -- start 2023-07-06T19:59:30.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.084+0000 7fba49f14700 1 -- start start 2023-07-06T19:59:30.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.084+0000 7fba49f14700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba30004850 0x7fba4414ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:30.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.084+0000 7fba49f14700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba4414f840 0x7fba441f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:30.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.084+0000 7fba49f14700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba441f5c40 0x7fba441f60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:30.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.084+0000 7fba49f14700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba440b07c0 con 0x7fba4414f840 2023-07-06T19:59:30.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.084+0000 7fba49f14700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba441f65f0 con 0x7fba30004850 2023-07-06T19:59:30.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.084+0000 7fba49f14700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba440b0470 con 0x7fba441f5c40 2023-07-06T19:59:30.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.084+0000 7fba42ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba4414f840 0x7fba441f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:30.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.084+0000 7fba42ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba4414f840 0x7fba441f5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59554/0 (socket says 172.21.15.6:59554) 2023-07-06T19:59:30.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.085+0000 7fba42ffd700 1 -- 172.21.15.6:0/4178028882 learned_addr learned my addr 172.21.15.6:0/4178028882 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:30.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.085+0000 7fba437fe700 1 --2- 172.21.15.6:0/4178028882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba30004850 0x7fba4414ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:30.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.085+0000 7fba43fff700 1 --2- 172.21.15.6:0/4178028882 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba441f5c40 0x7fba441f60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:30.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.085+0000 7fba42ffd700 1 -- 172.21.15.6:0/4178028882 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba441f5c40 msgr2=0x7fba441f60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:30.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.085+0000 7fba42ffd700 1 --2- 172.21.15.6:0/4178028882 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba441f5c40 0x7fba441f60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:30.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.085+0000 7fba42ffd700 1 -- 172.21.15.6:0/4178028882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba30004850 msgr2=0x7fba4414ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:30.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.085+0000 7fba42ffd700 1 --2- 172.21.15.6:0/4178028882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba30004850 0x7fba4414ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:30.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.085+0000 7fba42ffd700 1 -- 172.21.15.6:0/4178028882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba440b2a30 con 0x7fba4414f840 2023-07-06T19:59:30.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.085+0000 7fba43fff700 1 --2- 172.21.15.6:0/4178028882 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba441f5c40 0x7fba441f60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:30.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.085+0000 7fba42ffd700 1 --2- 172.21.15.6:0/4178028882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba4414f840 0x7fba441f5700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fba3000bae0 tx=0x7fba340047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:30.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.085+0000 7fba3bfff700 1 -- 172.21.15.6:0/4178028882 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3400e6c0 con 0x7fba4414f840 2023-07-06T19:59:30.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.085+0000 7fba3bfff700 1 -- 172.21.15.6:0/4178028882 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba34003ab0 con 0x7fba4414f840 2023-07-06T19:59:30.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.085+0000 7fba49f14700 1 -- 172.21.15.6:0/4178028882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba440b2cd0 con 0x7fba4414f840 2023-07-06T19:59:30.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.085+0000 7fba3bfff700 1 -- 172.21.15.6:0/4178028882 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba34003e60 con 0x7fba4414f840 2023-07-06T19:59:30.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.085+0000 7fba49f14700 1 -- 172.21.15.6:0/4178028882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba440b3290 con 0x7fba4414f840 2023-07-06T19:59:30.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.086+0000 7fba49f14700 1 -- 172.21.15.6:0/4178028882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba440b34b0 con 0x7fba4414f840 2023-07-06T19:59:30.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.087+0000 7fba3bfff700 1 -- 172.21.15.6:0/4178028882 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fba34013470 con 0x7fba4414f840 2023-07-06T19:59:30.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.087+0000 7fba3bfff700 1 --2- 172.21.15.6:0/4178028882 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fba2406ace0 0x7fba2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:30.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.087+0000 7fba3bfff700 1 -- 172.21.15.6:0/4178028882 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fba3408ae40 con 0x7fba4414f840 2023-07-06T19:59:30.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.087+0000 7fba437fe700 1 --2- 172.21.15.6:0/4178028882 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fba2406ace0 0x7fba2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:30.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.088+0000 7fba437fe700 1 --2- 172.21.15.6:0/4178028882 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fba2406ace0 0x7fba2406d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fba2c007fd0 tx=0x7fba2c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:30.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.092+0000 7fba3bfff700 1 -- 172.21.15.6:0/4178028882 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fba440b34b0 con 0x7fba4414f840 2023-07-06T19:59:30.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.290+0000 7fba49f14700 1 -- 172.21.15.6:0/4178028882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba440b34b0 con 0x7fba4414f840 2023-07-06T19:59:30.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.292+0000 7fba3bfff700 1 -- 172.21.15.6:0/4178028882 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19964 (secure 0 0 0) 0x7fba440b34b0 con 0x7fba4414f840 2023-07-06T19:59:30.297 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:30.298 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:58:58.202291+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T19:58:51.062712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T19:58:52.130350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T19:58:55.785128+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:59:30.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.294+0000 7fba49f14700 1 -- 172.21.15.6:0/4178028882 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fba2406ace0 msgr2=0x7fba2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:30.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.294+0000 7fba49f14700 1 --2- 172.21.15.6:0/4178028882 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fba2406ace0 0x7fba2406d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fba2c007fd0 tx=0x7fba2c009040 comp rx=0 tx=0).stop 2023-07-06T19:59:30.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.294+0000 7fba49f14700 1 -- 172.21.15.6:0/4178028882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba4414f840 msgr2=0x7fba441f5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:30.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.294+0000 7fba49f14700 1 --2- 172.21.15.6:0/4178028882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba4414f840 0x7fba441f5700 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fba3000bae0 tx=0x7fba340047c0 comp rx=0 tx=0).stop 2023-07-06T19:59:30.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.294+0000 7fba49f14700 1 -- 172.21.15.6:0/4178028882 shutdown_connections 2023-07-06T19:59:30.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.294+0000 7fba49f14700 1 --2- 172.21.15.6:0/4178028882 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fba2406ace0 0x7fba2406d190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:30.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.294+0000 7fba49f14700 1 --2- 172.21.15.6:0/4178028882 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fba441f5c40 0x7fba441f60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:30.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.294+0000 7fba49f14700 1 --2- 172.21.15.6:0/4178028882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba30004850 0x7fba4414ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:30.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.294+0000 7fba49f14700 1 --2- 172.21.15.6:0/4178028882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba4414f840 0x7fba441f5700 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:30.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.294+0000 7fba49f14700 1 -- 172.21.15.6:0/4178028882 >> 172.21.15.6:0/4178028882 conn(0x7fba440d0a30 msgr2=0x7fba44159e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:30.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.294+0000 7fba49f14700 1 -- 172.21.15.6:0/4178028882 shutdown_connections 2023-07-06T19:59:30.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.294+0000 7fba49f14700 1 -- 172.21.15.6:0/4178028882 wait complete. 2023-07-06T19:59:30.312 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T19:59:30.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.439+0000 7fe3dd76b700 1 Processor -- start 2023-07-06T19:59:30.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.439+0000 7fe3dd76b700 1 -- start start 2023-07-06T19:59:30.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.440+0000 7fe3dd76b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe3d80cd1b0 0x7fe3d806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:30.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.440+0000 7fe3dd76b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d8160060 con 0x7fe3d815ce50 2023-07-06T19:59:30.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.440+0000 7fe3dd76b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d806c6f0 con 0x7fe3d806c2f0 2023-07-06T19:59:30.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.440+0000 7fe3dd76b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d80cd800 con 0x7fe3d80cd1b0 2023-07-06T19:59:30.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.440+0000 7fe3d67fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe3d80cd1b0 0x7fe3d806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:30.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.440+0000 7fe3d6ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe3d815ce50 0x7fe3d815d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60768/0 (socket says 172.21.15.6:60768) 2023-07-06T19:59:30.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.440+0000 7fe3d6ffd700 1 -- 172.21.15.6:0/3871615662 learned_addr learned my addr 172.21.15.6:0/3871615662 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:30.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.440+0000 7fe3d67fc700 1 -- 172.21.15.6:0/3871615662 >> v1:172.21.15.40:6789/0 conn(0x7fe3d806c2f0 legacy=0x7fe3d80d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:30.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.440+0000 7fe3d67fc700 1 -- 172.21.15.6:0/3871615662 >> v1:172.21.15.6:6789/0 conn(0x7fe3d815ce50 legacy=0x7fe3d815d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:30.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.440+0000 7fe3d67fc700 1 -- 172.21.15.6:0/3871615662 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d81602b0 con 0x7fe3d80cd1b0 2023-07-06T19:59:30.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.440+0000 7fe3d5ffb700 1 -- 172.21.15.6:0/3871615662 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454752394 0 0) 0x7fe3d8160060 con 0x7fe3d815ce50 2023-07-06T19:59:30.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.440+0000 7fe3d67fc700 1 --2- 172.21.15.6:0/3871615662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3d80cd1b0 0x7fe3d806bdb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009840 tx=0x7fe3c8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef461e1a0bc69bd server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:30.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.440+0000 7fe3d5ffb700 1 -- 172.21.15.6:0/3871615662 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8004230 con 0x7fe3d80cd1b0 2023-07-06T19:59:30.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.440+0000 7fe3d5ffb700 1 -- 172.21.15.6:0/3871615662 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c8004390 con 0x7fe3d80cd1b0 2023-07-06T19:59:30.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.441+0000 7fe3d5ffb700 1 -- 172.21.15.6:0/3871615662 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c80036a0 con 0x7fe3d80cd1b0 2023-07-06T19:59:30.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.441+0000 7fe3dd76b700 1 -- 172.21.15.6:0/3871615662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3d80cd1b0 msgr2=0x7fe3d806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:30.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.441+0000 7fe3dd76b700 1 --2- 172.21.15.6:0/3871615662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3d80cd1b0 0x7fe3d806bdb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009840 tx=0x7fe3c8009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:30.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.441+0000 7fe3dd76b700 1 -- 172.21.15.6:0/3871615662 shutdown_connections 2023-07-06T19:59:30.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.441+0000 7fe3dd76b700 1 --2- 172.21.15.6:0/3871615662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3d80cd1b0 0x7fe3d806bdb0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:30.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.441+0000 7fe3dd76b700 1 -- 172.21.15.6:0/3871615662 >> 172.21.15.6:0/3871615662 conn(0x7fe3d80d3880 msgr2=0x7fe3d80cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:30.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.441+0000 7fe3dd76b700 1 -- 172.21.15.6:0/3871615662 shutdown_connections 2023-07-06T19:59:30.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.441+0000 7fe3dd76b700 1 -- 172.21.15.6:0/3871615662 wait complete. 2023-07-06T19:59:30.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.442+0000 7fe3dd76b700 1 Processor -- start 2023-07-06T19:59:30.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.442+0000 7fe3dd76b700 1 -- start start 2023-07-06T19:59:30.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.443+0000 7fe3dd76b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d806c2f0 0x7fe3d80cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:30.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.443+0000 7fe3dd76b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3d80cd1b0 0x7fe3d80c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:30.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.443+0000 7fe3dd76b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3d815ce50 0x7fe3d8152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:30.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.443+0000 7fe3dd76b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d80c9660 con 0x7fe3d815ce50 2023-07-06T19:59:30.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.443+0000 7fe3dd76b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d80c8b90 con 0x7fe3d806c2f0 2023-07-06T19:59:30.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.443+0000 7fe3dd76b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d815dce0 con 0x7fe3d80cd1b0 2023-07-06T19:59:30.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.443+0000 7fe3d77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3d815ce50 0x7fe3d8152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:30.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.443+0000 7fe3d77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3d815ce50 0x7fe3d8152f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59570/0 (socket says 172.21.15.6:59570) 2023-07-06T19:59:30.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.443+0000 7fe3d77fe700 1 -- 172.21.15.6:0/787626198 learned_addr learned my addr 172.21.15.6:0/787626198 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:30.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.443+0000 7fe3d6ffd700 1 --2- 172.21.15.6:0/787626198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d806c2f0 0x7fe3d80cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:30.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.443+0000 7fe3d67fc700 1 --2- 172.21.15.6:0/787626198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3d80cd1b0 0x7fe3d80c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:30.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.444+0000 7fe3d77fe700 1 -- 172.21.15.6:0/787626198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3d80cd1b0 msgr2=0x7fe3d80c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:30.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.444+0000 7fe3d77fe700 1 --2- 172.21.15.6:0/787626198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3d80cd1b0 0x7fe3d80c8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:30.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.444+0000 7fe3d77fe700 1 -- 172.21.15.6:0/787626198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d806c2f0 msgr2=0x7fe3d80cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:30.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.444+0000 7fe3d77fe700 1 --2- 172.21.15.6:0/787626198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d806c2f0 0x7fe3d80cad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:30.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.444+0000 7fe3d77fe700 1 -- 172.21.15.6:0/787626198 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c80094a0 con 0x7fe3d815ce50 2023-07-06T19:59:30.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.444+0000 7fe3d77fe700 1 --2- 172.21.15.6:0/787626198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3d815ce50 0x7fe3d8152f40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000cc10 tx=0x7fe3d000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:30.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.444+0000 7fe3bf7fe700 1 -- 172.21.15.6:0/787626198 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d000aa60 con 0x7fe3d815ce50 2023-07-06T19:59:30.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.444+0000 7fe3bf7fe700 1 -- 172.21.15.6:0/787626198 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d000abc0 con 0x7fe3d815ce50 2023-07-06T19:59:30.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.444+0000 7fe3dd76b700 1 -- 172.21.15.6:0/787626198 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d80c8dc0 con 0x7fe3d815ce50 2023-07-06T19:59:30.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.444+0000 7fe3bf7fe700 1 -- 172.21.15.6:0/787626198 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0012420 con 0x7fe3d815ce50 2023-07-06T19:59:30.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.444+0000 7fe3dd76b700 1 -- 172.21.15.6:0/787626198 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d80c9380 con 0x7fe3d815ce50 2023-07-06T19:59:30.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.445+0000 7fe3dd76b700 1 -- 172.21.15.6:0/787626198 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d815db40 con 0x7fe3d815ce50 2023-07-06T19:59:30.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.445+0000 7fe3bf7fe700 1 -- 172.21.15.6:0/787626198 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe3d0012580 con 0x7fe3d815ce50 2023-07-06T19:59:30.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.446+0000 7fe3bf7fe700 1 --2- 172.21.15.6:0/787626198 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe3c406ace0 0x7fe3c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:30.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.446+0000 7fe3bf7fe700 1 -- 172.21.15.6:0/787626198 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe3d0089970 con 0x7fe3d815ce50 2023-07-06T19:59:30.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.446+0000 7fe3d6ffd700 1 --2- 172.21.15.6:0/787626198 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe3c406ace0 0x7fe3c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:30.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.446+0000 7fe3d6ffd700 1 --2- 172.21.15.6:0/787626198 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe3c406ace0 0x7fe3c406d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc000f60 tx=0x7fe3cc007e70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:30.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.450+0000 7fe3bf7fe700 1 -- 172.21.15.6:0/787626198 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe3d815db40 con 0x7fe3d815ce50 2023-07-06T19:59:30.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.693+0000 7fe3dd76b700 1 -- 172.21.15.6:0/787626198 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3d815db40 con 0x7fe3d815ce50 2023-07-06T19:59:30.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.693+0000 7fe3bf7fe700 1 -- 172.21.15.6:0/787626198 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4652 (secure 0 0 0) 0x7fe3d815db40 con 0x7fe3d815ce50 2023-07-06T19:59:30.696 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:30.696 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3695014381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3695014381},{"type":"v1","addr":"172.21.15.6:6835","nonce":3695014381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/849399781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":849399781},{"type":"v1","addr":"172.21.15.40:6833","nonce":849399781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/512806705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":512806705},{"type":"v1","addr":"172.21.15.40:6835","nonce":512806705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T19:58:53.158966+0000","modified":"2023-07-06T19:59:17.827616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/368324315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":368324315},{"type":"v1","addr":"172.21.15.6:6837","nonce":368324315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-06T19:59:30.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.695+0000 7fe3dd76b700 1 -- 172.21.15.6:0/787626198 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe3c406ace0 msgr2=0x7fe3c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:30.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.695+0000 7fe3dd76b700 1 --2- 172.21.15.6:0/787626198 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe3c406ace0 0x7fe3c406d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe3cc000f60 tx=0x7fe3cc007e70 comp rx=0 tx=0).stop 2023-07-06T19:59:30.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.695+0000 7fe3dd76b700 1 -- 172.21.15.6:0/787626198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3d815ce50 msgr2=0x7fe3d8152f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:30.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.695+0000 7fe3dd76b700 1 --2- 172.21.15.6:0/787626198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3d815ce50 0x7fe3d8152f40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000cc10 tx=0x7fe3d000cf20 comp rx=0 tx=0).stop 2023-07-06T19:59:30.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.695+0000 7fe3dd76b700 1 -- 172.21.15.6:0/787626198 shutdown_connections 2023-07-06T19:59:30.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.695+0000 7fe3dd76b700 1 --2- 172.21.15.6:0/787626198 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe3c406ace0 0x7fe3c406d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:30.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.695+0000 7fe3dd76b700 1 --2- 172.21.15.6:0/787626198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3d815ce50 0x7fe3d8152f40 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:30.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.695+0000 7fe3dd76b700 1 --2- 172.21.15.6:0/787626198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3d806c2f0 0x7fe3d80cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:30.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.695+0000 7fe3dd76b700 1 --2- 172.21.15.6:0/787626198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3d80cd1b0 0x7fe3d80c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:30.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.695+0000 7fe3dd76b700 1 -- 172.21.15.6:0/787626198 >> 172.21.15.6:0/787626198 conn(0x7fe3d80d3880 msgr2=0x7fe3d80d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:30.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.696+0000 7fe3dd76b700 1 -- 172.21.15.6:0/787626198 shutdown_connections 2023-07-06T19:59:30.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:30.696+0000 7fe3dd76b700 1 -- 172.21.15.6:0/787626198 wait complete. 2023-07-06T19:59:30.701 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 9 2023-07-06T19:59:31.112 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-06T19:58:53.158966+0000', 'modified': '2023-07-06T19:59:17.827616+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.6:6837/368324315', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6836', 'nonce': 368324315}, {'type': 'v1', 'addr': '172.21.15.6:6837', 'nonce': 368324315}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-06T19:59:31.113 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-06T19:59:31.113 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-06T19:59:31.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.244+0000 7fb5fdfe3700 1 Processor -- start 2023-07-06T19:59:31.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.244+0000 7fb5fdfe3700 1 -- start start 2023-07-06T19:59:31.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.245+0000 7fb5fdfe3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb5f80ca850 0x7fb5f815bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:31.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.245+0000 7fb5fdfe3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f80cb310 con 0x7fb5f8071900 2023-07-06T19:59:31.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.245+0000 7fb5fdfe3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f80af070 con 0x7fb5f8071cd0 2023-07-06T19:59:31.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.245+0000 7fb5fdfe3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5f80cdbf0 con 0x7fb5f80ca850 2023-07-06T19:59:31.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.245+0000 7fb5f6ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb5f80ca850 0x7fb5f815bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:31.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.245+0000 7fb5f77fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb5f8071900 0x7fb5f80ca140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60782/0 (socket says 172.21.15.6:60782) 2023-07-06T19:59:31.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.245+0000 7fb5f77fe700 1 -- 172.21.15.6:0/2400867993 learned_addr learned my addr 172.21.15.6:0/2400867993 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:31.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.245+0000 7fb5f6ffd700 1 -- 172.21.15.6:0/2400867993 >> v1:172.21.15.40:6789/0 conn(0x7fb5f8071cd0 legacy=0x7fb5f80ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:31.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.245+0000 7fb5f6ffd700 1 -- 172.21.15.6:0/2400867993 >> v1:172.21.15.6:6789/0 conn(0x7fb5f8071900 legacy=0x7fb5f80ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:31.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.245+0000 7fb5f67fc700 1 -- 172.21.15.6:0/2400867993 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3550125106 0 0) 0x7fb5f80cb310 con 0x7fb5f8071900 2023-07-06T19:59:31.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.245+0000 7fb5f6ffd700 1 -- 172.21.15.6:0/2400867993 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f80cad50 con 0x7fb5f80ca850 2023-07-06T19:59:31.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.246+0000 7fb5f6ffd700 1 --2- 172.21.15.6:0/2400867993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5f80ca850 0x7fb5f815bf50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb5f806a790 tx=0x7fb5e8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b3c6dc78bd0a73 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:31.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.246+0000 7fb5f67fc700 1 -- 172.21.15.6:0/2400867993 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8004020 con 0x7fb5f80ca850 2023-07-06T19:59:31.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.246+0000 7fb5f67fc700 1 -- 172.21.15.6:0/2400867993 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e8004180 con 0x7fb5f80ca850 2023-07-06T19:59:31.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.246+0000 7fb5f67fc700 1 -- 172.21.15.6:0/2400867993 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8004530 con 0x7fb5f80ca850 2023-07-06T19:59:31.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.246+0000 7fb5fdfe3700 1 -- 172.21.15.6:0/2400867993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5f80ca850 msgr2=0x7fb5f815bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:31.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.246+0000 7fb5fdfe3700 1 --2- 172.21.15.6:0/2400867993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5f80ca850 0x7fb5f815bf50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb5f806a790 tx=0x7fb5e8009b20 comp rx=0 tx=0).stop 2023-07-06T19:59:31.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.246+0000 7fb5fdfe3700 1 -- 172.21.15.6:0/2400867993 shutdown_connections 2023-07-06T19:59:31.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.246+0000 7fb5fdfe3700 1 --2- 172.21.15.6:0/2400867993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5f80ca850 0x7fb5f815bf50 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.246+0000 7fb5fdfe3700 1 -- 172.21.15.6:0/2400867993 >> 172.21.15.6:0/2400867993 conn(0x7fb5f80cf960 msgr2=0x7fb5f80cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:31.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.246+0000 7fb5fdfe3700 1 -- 172.21.15.6:0/2400867993 shutdown_connections 2023-07-06T19:59:31.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.246+0000 7fb5fdfe3700 1 -- 172.21.15.6:0/2400867993 wait complete. 2023-07-06T19:59:31.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.248+0000 7fb5fdfe3700 1 Processor -- start 2023-07-06T19:59:31.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.248+0000 7fb5fdfe3700 1 -- start start 2023-07-06T19:59:31.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.248+0000 7fb5fdfe3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5f8071900 0x7fb5f814b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:31.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.248+0000 7fb5fdfe3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5f8071cd0 0x7fb5f80b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:31.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.248+0000 7fb5fdfe3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5f80ca850 0x7fb5f814d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:31.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.248+0000 7fb5fdfe3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f80b40b0 con 0x7fb5f80ca850 2023-07-06T19:59:31.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.248+0000 7fb5fdfe3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f814bc40 con 0x7fb5f8071cd0 2023-07-06T19:59:31.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.248+0000 7fb5fdfe3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f80b34a0 con 0x7fb5f8071900 2023-07-06T19:59:31.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.249+0000 7fb5f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5f80ca850 0x7fb5f814d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:31.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.249+0000 7fb5f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5f80ca850 0x7fb5f814d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59584/0 (socket says 172.21.15.6:59584) 2023-07-06T19:59:31.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.249+0000 7fb5f7fff700 1 -- 172.21.15.6:0/2333990970 learned_addr learned my addr 172.21.15.6:0/2333990970 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:31.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.249+0000 7fb5f77fe700 1 --2- 172.21.15.6:0/2333990970 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5f8071900 0x7fb5f814b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:31.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.249+0000 7fb5f6ffd700 1 --2- 172.21.15.6:0/2333990970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5f8071cd0 0x7fb5f80b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:31.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.249+0000 7fb5f7fff700 1 -- 172.21.15.6:0/2333990970 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5f8071900 msgr2=0x7fb5f814b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:31.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.249+0000 7fb5f7fff700 1 --2- 172.21.15.6:0/2333990970 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5f8071900 0x7fb5f814b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.249+0000 7fb5f7fff700 1 -- 172.21.15.6:0/2333990970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5f8071cd0 msgr2=0x7fb5f80b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:31.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.249+0000 7fb5f7fff700 1 --2- 172.21.15.6:0/2333990970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5f8071cd0 0x7fb5f80b4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.249+0000 7fb5f7fff700 1 -- 172.21.15.6:0/2333990970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e80094a0 con 0x7fb5f80ca850 2023-07-06T19:59:31.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.249+0000 7fb5f7fff700 1 --2- 172.21.15.6:0/2333990970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5f80ca850 0x7fb5f814d750 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000cb50 tx=0x7fb5f000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:31.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.249+0000 7fb5effff700 1 -- 172.21.15.6:0/2333990970 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0003c00 con 0x7fb5f80ca850 2023-07-06T19:59:31.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.249+0000 7fb5effff700 1 -- 172.21.15.6:0/2333990970 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f0003d60 con 0x7fb5f80ca850 2023-07-06T19:59:31.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.249+0000 7fb5fdfe3700 1 -- 172.21.15.6:0/2333990970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f80b3780 con 0x7fb5f80ca850 2023-07-06T19:59:31.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.249+0000 7fb5effff700 1 -- 172.21.15.6:0/2333990970 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f000ab70 con 0x7fb5f80ca850 2023-07-06T19:59:31.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.249+0000 7fb5fdfe3700 1 -- 172.21.15.6:0/2333990970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f80b3d40 con 0x7fb5f80ca850 2023-07-06T19:59:31.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.251+0000 7fb5effff700 1 -- 172.21.15.6:0/2333990970 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb5f000acd0 con 0x7fb5f80ca850 2023-07-06T19:59:31.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.251+0000 7fb5effff700 1 --2- 172.21.15.6:0/2333990970 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb5d806ace0 0x7fb5d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:31.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.251+0000 7fb5effff700 1 -- 172.21.15.6:0/2333990970 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb5f0089780 con 0x7fb5f80ca850 2023-07-06T19:59:31.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.251+0000 7fb5f77fe700 1 --2- 172.21.15.6:0/2333990970 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb5d806ace0 0x7fb5d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:31.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.252+0000 7fb5f77fe700 1 --2- 172.21.15.6:0/2333990970 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb5d806ace0 0x7fb5d806d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0000f60 tx=0x7fb5e0007d90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:31.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.253+0000 7fb60a168b80 1 Processor -- start 2023-07-06T19:59:31.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.253+0000 7fb60a168b80 1 -- start start 2023-07-06T19:59:31.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.254+0000 7fb60a168b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557b84168470 0x557b84187670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:31.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.254+0000 7fb60a168b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x557b8413e830 0x557b8416b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:31.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.254+0000 7fb60a168b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b84168cd0 0x557b8416b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:31.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.254+0000 7fb60a168b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b84045c60 con 0x557b84168cd0 2023-07-06T19:59:31.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.254+0000 7fb60a168b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b840989f0 con 0x557b84168470 2023-07-06T19:59:31.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.254+0000 7fb60a168b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b84091e80 con 0x557b8413e830 2023-07-06T19:59:31.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.255+0000 7fb5f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b84168cd0 0x557b8416b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:31.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.255+0000 7fb5f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b84168cd0 0x557b8416b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59592/0 (socket says 172.21.15.6:59592) 2023-07-06T19:59:31.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.255+0000 7fb5f7fff700 1 -- 172.21.15.6:0/3916184351 learned_addr learned my addr 172.21.15.6:0/3916184351 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:31.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.255+0000 7fb5f6ffd700 1 --2- 172.21.15.6:0/3916184351 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x557b8413e830 0x557b8416b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:31.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.255+0000 7fb5f77fe700 1 --2- 172.21.15.6:0/3916184351 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557b84168470 0x557b84187670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:31.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.255+0000 7fb5f7fff700 1 -- 172.21.15.6:0/3916184351 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x557b8413e830 msgr2=0x557b8416b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:31.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.255+0000 7fb5f7fff700 1 --2- 172.21.15.6:0/3916184351 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x557b8413e830 0x557b8416b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.255+0000 7fb5f7fff700 1 -- 172.21.15.6:0/3916184351 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557b84168470 msgr2=0x557b84187670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:31.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.255+0000 7fb5f7fff700 1 --2- 172.21.15.6:0/3916184351 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557b84168470 0x557b84187670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.255+0000 7fb5f7fff700 1 -- 172.21.15.6:0/3916184351 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b83ebfd90 con 0x557b84168cd0 2023-07-06T19:59:31.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.255+0000 7fb5f7fff700 1 --2- 172.21.15.6:0/3916184351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b84168cd0 0x557b8416b730 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0054790 tx=0x7fb5f005c250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f43bf40148dc3a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:31.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.255+0000 7fb5ed7fa700 1 -- 172.21.15.6:0/3916184351 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0056630 con 0x557b84168cd0 2023-07-06T19:59:31.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.255+0000 7fb5ed7fa700 1 -- 172.21.15.6:0/3916184351 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f006be90 con 0x557b84168cd0 2023-07-06T19:59:31.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.255+0000 7fb5ed7fa700 1 -- 172.21.15.6:0/3916184351 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00579a0 con 0x557b84168cd0 2023-07-06T19:59:31.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.256+0000 7fb60a168b80 1 -- 172.21.15.6:0/3916184351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b84168cd0 msgr2=0x557b8416b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:31.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.256+0000 7fb60a168b80 1 --2- 172.21.15.6:0/3916184351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b84168cd0 0x557b8416b730 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0054790 tx=0x7fb5f005c250 comp rx=0 tx=0).stop 2023-07-06T19:59:31.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.256+0000 7fb60a168b80 1 -- 172.21.15.6:0/3916184351 shutdown_connections 2023-07-06T19:59:31.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.256+0000 7fb60a168b80 1 --2- 172.21.15.6:0/3916184351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b84168cd0 0x557b8416b730 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.256+0000 7fb60a168b80 1 --2- 172.21.15.6:0/3916184351 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557b84168470 0x557b84187670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.256+0000 7fb60a168b80 1 --2- 172.21.15.6:0/3916184351 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x557b8413e830 0x557b8416b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.256+0000 7fb60a168b80 1 -- 172.21.15.6:0/3916184351 >> 172.21.15.6:0/3916184351 conn(0x557b84135e80 msgr2=0x557b841861f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:31.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.256+0000 7fb60a168b80 1 -- 172.21.15.6:0/3916184351 shutdown_connections 2023-07-06T19:59:31.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.256+0000 7fb60a168b80 1 -- 172.21.15.6:0/3916184351 wait complete. 2023-07-06T19:59:31.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.257+0000 7fb60a168b80 1 -- start start 2023-07-06T19:59:31.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.257+0000 7fb60a168b80 1 Processor -- start 2023-07-06T19:59:31.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.257+0000 7fb60a168b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b8413e830 0x557b8417fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:31.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.257+0000 7fb60a168b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557b84168470 0x557b84153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:31.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.257+0000 7fb60a168b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x557b84168cd0 0x557b84140100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:31.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.257+0000 7fb60a168b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b84031a70 con 0x557b8413e830 2023-07-06T19:59:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.257+0000 7fb60a168b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b84031770 con 0x557b84168470 2023-07-06T19:59:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.257+0000 7fb60a168b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b83f158d0 con 0x557b84168cd0 2023-07-06T19:59:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.258+0000 7fb60a168b80 10 client.0 _ll_register_callbacks cb 0x557b8402f710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T19:59:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.258+0000 7fb5f77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b8413e830 0x557b8417fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.258+0000 7fb5f77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b8413e830 0x557b8417fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59594/0 (socket says 172.21.15.6:59594) 2023-07-06T19:59:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.258+0000 7fb5f77fe700 1 -- 172.21.15.6:0/2674128745 learned_addr learned my addr 172.21.15.6:0/2674128745 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.258+0000 7fb5f6ffd700 1 --2- 172.21.15.6:0/2674128745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557b84168470 0x557b84153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.258+0000 7fb5f7fff700 1 --2- 172.21.15.6:0/2674128745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x557b84168cd0 0x557b84140100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.258+0000 7fb5f77fe700 1 -- 172.21.15.6:0/2674128745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x557b84168cd0 msgr2=0x557b84140100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.258+0000 7fb5f77fe700 1 --2- 172.21.15.6:0/2674128745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x557b84168cd0 0x557b84140100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.258+0000 7fb5f77fe700 1 -- 172.21.15.6:0/2674128745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557b84168470 msgr2=0x557b84153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.258+0000 7fb5f77fe700 1 --2- 172.21.15.6:0/2674128745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557b84168470 0x557b84153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.258+0000 7fb5f77fe700 1 -- 172.21.15.6:0/2674128745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f80b3d40 con 0x557b8413e830 2023-07-06T19:59:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.258+0000 7fb5f77fe700 1 --2- 172.21.15.6:0/2674128745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b8413e830 0x557b8417fe10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0005300 tx=0x7fb5e0007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12a6f664d491e95 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.258+0000 7fb5d67fc700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-06T19:59:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.258+0000 7fb5d67fc700 1 -- 172.21.15.6:0/2674128745 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e00156b0 con 0x557b8413e830 2023-07-06T19:59:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.258+0000 7fb5d67fc700 1 -- 172.21.15.6:0/2674128745 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb5e0014f20 con 0x557b8413e830 2023-07-06T19:59:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.258+0000 7fb60a168b80 1 -- 172.21.15.6:0/2674128745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557b84133490 con 0x557b8413e830 2023-07-06T19:59:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.258+0000 7fb5d67fc700 1 -- 172.21.15.6:0/2674128745 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5e00150e0 con 0x557b8413e830 2023-07-06T19:59:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.258+0000 7fb60a168b80 10 client.4851 fetch_fsmap learned FSMap version 9 2023-07-06T19:59:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.258+0000 7fb60a168b80 1 -- 172.21.15.6:0/2674128745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x557b83ea8c10 con 0x557b8413e830 2023-07-06T19:59:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.259+0000 7fb5d67fc700 1 -- 172.21.15.6:0/2674128745 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557b84133490 con 0x557b8413e830 2023-07-06T19:59:31.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.259+0000 7fb5d67fc700 1 -- 172.21.15.6:0/2674128745 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fb5e0015810 con 0x557b8413e830 2023-07-06T19:59:31.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.259+0000 7fb60a168b80 10 client.4851 fetch_fsmap finished waiting for FSMap version 9 2023-07-06T19:59:31.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.259+0000 7fb60a168b80 10 client.4851 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-06T19:59:31.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.259+0000 7fb60a168b80 20 client.4851 populate_metadata read hostname 'smithi006' 2023-07-06T19:59:31.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.259+0000 7fb60a168b80 1 --2- 172.21.15.6:0/2674128745 >> [v2:172.21.15.6:6836/368324315,v1:172.21.15.6:6837/368324315] conn(0x557b841880f0 0x557b841884c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:31.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.259+0000 7fb60a168b80 4 client.4851 mds_command: new command op to 4284 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-06T19:59:31.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.259+0000 7fb60a168b80 1 -- 172.21.15.6:0/2674128745 --> [v2:172.21.15.6:6836/368324315,v1:172.21.15.6:6837/368324315] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557b8408ae60 con 0x557b841880f0 2023-07-06T19:59:31.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.259+0000 7fb5f6ffd700 1 --2- 172.21.15.6:0/2674128745 >> [v2:172.21.15.6:6836/368324315,v1:172.21.15.6:6837/368324315] conn(0x557b841880f0 0x557b841884c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:31.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.259+0000 7fb5d67fc700 10 client.4851 ms_handle_connect on v2:172.21.15.6:6836/368324315 2023-07-06T19:59:31.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.259+0000 7fb5f6ffd700 1 --2- 172.21.15.6:0/2674128745 >> [v2:172.21.15.6:6836/368324315,v1:172.21.15.6:6837/368324315] conn(0x557b841880f0 0x557b841884c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8659dda95269e334 server_cookie=dfbaf8cdd960cb87 in_seq=0 out_seq=0 2023-07-06T19:59:31.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.260+0000 7fb5d67fc700 1 -- 172.21.15.6:0/2674128745 <== mds.0 v2:172.21.15.6:6836/368324315 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557b8408ae60 con 0x557b841880f0 2023-07-06T19:59:31.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.260+0000 7fb5d67fc700 10 client.4851 handle_command_reply: tid=0 2023-07-06T19:59:31.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.260+0000 7fb60a168b80 1 client.4851 shutdown 2023-07-06T19:59:31.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.260+0000 7fb60a168b80 1 -- 172.21.15.6:0/2674128745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b8413e830 msgr2=0x557b8417fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:31.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.260+0000 7fb60a168b80 1 --2- 172.21.15.6:0/2674128745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b8413e830 0x557b8417fe10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0005300 tx=0x7fb5e0007870 comp rx=0 tx=0).stop 2023-07-06T19:59:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.260+0000 7fb60a168b80 1 -- 172.21.15.6:0/2674128745 shutdown_connections 2023-07-06T19:59:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.260+0000 7fb60a168b80 1 --2- 172.21.15.6:0/2674128745 >> [v2:172.21.15.6:6836/368324315,v1:172.21.15.6:6837/368324315] conn(0x557b841880f0 0x557b841884c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.260+0000 7fb60a168b80 1 --2- 172.21.15.6:0/2674128745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b8413e830 0x557b8417fe10 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.260+0000 7fb60a168b80 1 --2- 172.21.15.6:0/2674128745 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x557b84168cd0 0x557b84140100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.260+0000 7fb5d67fc700 0 client.4851 ms_handle_reset on v2:172.21.15.6:6836/368324315 2023-07-06T19:59:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.260+0000 7fb60a168b80 1 --2- 172.21.15.6:0/2674128745 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557b84168470 0x557b84153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.260+0000 7fb60a168b80 1 -- 172.21.15.6:0/2674128745 >> 172.21.15.6:0/2674128745 conn(0x557b84135e80 msgr2=0x557b8413a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.260+0000 7fb60a168b80 1 -- 172.21.15.6:0/2674128745 shutdown_connections 2023-07-06T19:59:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.260+0000 7fb60a168b80 1 -- 172.21.15.6:0/2674128745 wait complete. 2023-07-06T19:59:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.260+0000 7fb60a168b80 20 client.4851 trim_cache size 0 max 16384 2023-07-06T19:59:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.278+0000 7fb60a168b80 1 Processor -- start 2023-07-06T19:59:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.278+0000 7fb60a168b80 1 -- start start 2023-07-06T19:59:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.279+0000 7fb60a168b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x557b8413e830 0x557b84167140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.279+0000 7fb60a168b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557b84168470 0x557b841e32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:31.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.279+0000 7fb60a168b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b84168cd0 0x557b84182e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:31.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.279+0000 7fb60a168b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b84167b20 con 0x557b84168cd0 2023-07-06T19:59:31.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.279+0000 7fb60a168b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b84180be0 con 0x557b84168470 2023-07-06T19:59:31.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.279+0000 7fb60a168b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b84142ae0 con 0x557b8413e830 2023-07-06T19:59:31.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.279+0000 7fb5f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b84168cd0 0x557b84182e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:31.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.279+0000 7fb5f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b84168cd0 0x557b84182e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59606/0 (socket says 172.21.15.6:59606) 2023-07-06T19:59:31.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.279+0000 7fb5f7fff700 1 -- 172.21.15.6:0/2959770069 learned_addr learned my addr 172.21.15.6:0/2959770069 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:31.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.279+0000 7fb5f6ffd700 1 --2- 172.21.15.6:0/2959770069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557b84168470 0x557b841e32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:31.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.279+0000 7fb5f77fe700 1 --2- 172.21.15.6:0/2959770069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x557b8413e830 0x557b84167140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:31.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.279+0000 7fb5f7fff700 1 -- 172.21.15.6:0/2959770069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x557b8413e830 msgr2=0x557b84167140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:31.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.279+0000 7fb5f7fff700 1 --2- 172.21.15.6:0/2959770069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x557b8413e830 0x557b84167140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.279+0000 7fb5f7fff700 1 -- 172.21.15.6:0/2959770069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557b84168470 msgr2=0x557b841e32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:31.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.279+0000 7fb5f7fff700 1 --2- 172.21.15.6:0/2959770069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557b84168470 0x557b841e32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.279+0000 7fb5f7fff700 1 -- 172.21.15.6:0/2959770069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b83ee6200 con 0x557b84168cd0 2023-07-06T19:59:31.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.279+0000 7fb5f77fe700 1 --2- 172.21.15.6:0/2959770069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x557b8413e830 0x557b84167140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:31.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.279+0000 7fb5f7fff700 1 --2- 172.21.15.6:0/2959770069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b84168cd0 0x557b84182e00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0087940 tx=0x7fb5f005a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a27d7c5d32c88f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:31.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.280+0000 7fb5edffb700 1 -- 172.21.15.6:0/2959770069 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00563d0 con 0x557b84168cd0 2023-07-06T19:59:31.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.280+0000 7fb5edffb700 1 -- 172.21.15.6:0/2959770069 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f0056630 con 0x557b84168cd0 2023-07-06T19:59:31.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.280+0000 7fb5edffb700 1 -- 172.21.15.6:0/2959770069 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f00579a0 con 0x557b84168cd0 2023-07-06T19:59:31.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.280+0000 7fb60a168b80 1 -- 172.21.15.6:0/2959770069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b84168cd0 msgr2=0x557b84182e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:31.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.280+0000 7fb60a168b80 1 --2- 172.21.15.6:0/2959770069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b84168cd0 0x557b84182e00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb5f0087940 tx=0x7fb5f005a000 comp rx=0 tx=0).stop 2023-07-06T19:59:31.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.280+0000 7fb60a168b80 1 -- 172.21.15.6:0/2959770069 shutdown_connections 2023-07-06T19:59:31.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.280+0000 7fb60a168b80 1 --2- 172.21.15.6:0/2959770069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b84168cd0 0x557b84182e00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.280+0000 7fb60a168b80 1 --2- 172.21.15.6:0/2959770069 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x557b8413e830 0x557b84167140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.280+0000 7fb60a168b80 1 --2- 172.21.15.6:0/2959770069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557b84168470 0x557b841e32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.280+0000 7fb60a168b80 1 -- 172.21.15.6:0/2959770069 >> 172.21.15.6:0/2959770069 conn(0x557b84135e80 msgr2=0x557b8417fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:31.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.280+0000 7fb60a168b80 1 -- 172.21.15.6:0/2959770069 shutdown_connections 2023-07-06T19:59:31.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.280+0000 7fb60a168b80 1 -- 172.21.15.6:0/2959770069 wait complete. 2023-07-06T19:59:31.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.281+0000 7fb60a168b80 1 -- start start 2023-07-06T19:59:31.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.281+0000 7fb60a168b80 1 Processor -- start 2023-07-06T19:59:31.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.282+0000 7fb60a168b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x557b8413e830 0x557b8416c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:31.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.282+0000 7fb60a168b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557b84168470 0x557b84164b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:31.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.282+0000 7fb60a168b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b84168cd0 0x557b84152740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:31.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.282+0000 7fb60a168b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b8416ce60 con 0x557b84168cd0 2023-07-06T19:59:31.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.282+0000 7fb60a168b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b841652b0 con 0x557b84168470 2023-07-06T19:59:31.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.282+0000 7fb60a168b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b841657e0 con 0x557b8413e830 2023-07-06T19:59:31.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.282+0000 7fb60a168b80 10 client.0 _ll_register_callbacks cb 0x7fb5e0004a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T19:59:31.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.282+0000 7fb5f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b84168cd0 0x557b84152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:31.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.282+0000 7fb5f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b84168cd0 0x557b84152740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59612/0 (socket says 172.21.15.6:59612) 2023-07-06T19:59:31.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.282+0000 7fb5f7fff700 1 -- 172.21.15.6:0/163914844 learned_addr learned my addr 172.21.15.6:0/163914844 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:31.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.282+0000 7fb5f6ffd700 1 --2- 172.21.15.6:0/163914844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557b84168470 0x557b84164b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:31.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.282+0000 7fb5f77fe700 1 --2- 172.21.15.6:0/163914844 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x557b8413e830 0x557b8416c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:31.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.282+0000 7fb5f7fff700 1 -- 172.21.15.6:0/163914844 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x557b8413e830 msgr2=0x557b8416c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:31.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.282+0000 7fb5f7fff700 1 --2- 172.21.15.6:0/163914844 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x557b8413e830 0x557b8416c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.282+0000 7fb5f7fff700 1 -- 172.21.15.6:0/163914844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557b84168470 msgr2=0x557b84164b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:31.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.282+0000 7fb5f7fff700 1 --2- 172.21.15.6:0/163914844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557b84168470 0x557b84164b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.282+0000 7fb5f7fff700 1 -- 172.21.15.6:0/163914844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b83ebfd90 con 0x557b84168cd0 2023-07-06T19:59:31.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.282+0000 7fb5f7fff700 1 --2- 172.21.15.6:0/163914844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b84168cd0 0x557b84152740 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000a3f0 tx=0x7fb5f005e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6f66beb9cae2d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:31.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.282+0000 7fb5d67fc700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-06T19:59:31.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.282+0000 7fb5d67fc700 1 -- 172.21.15.6:0/163914844 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5f0058060 con 0x557b84168cd0 2023-07-06T19:59:31.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.282+0000 7fb5d67fc700 1 -- 172.21.15.6:0/163914844 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb5f0057990 con 0x557b84168cd0 2023-07-06T19:59:31.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.282+0000 7fb60a168b80 1 -- 172.21.15.6:0/163914844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb5f006be90 con 0x557b84168cd0 2023-07-06T19:59:31.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.283+0000 7fb5d67fc700 1 -- 172.21.15.6:0/163914844 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5f0060150 con 0x557b84168cd0 2023-07-06T19:59:31.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.283+0000 7fb60a168b80 10 client.4857 fetch_fsmap learned FSMap version 9 2023-07-06T19:59:31.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.283+0000 7fb60a168b80 1 -- 172.21.15.6:0/163914844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x557b83ebe260 con 0x557b84168cd0 2023-07-06T19:59:31.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.283+0000 7fb5d67fc700 1 -- 172.21.15.6:0/163914844 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5f006be90 con 0x557b84168cd0 2023-07-06T19:59:31.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.283+0000 7fb5d67fc700 1 -- 172.21.15.6:0/163914844 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fb5f0076030 con 0x557b84168cd0 2023-07-06T19:59:31.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.283+0000 7fb60a168b80 10 client.4857 fetch_fsmap finished waiting for FSMap version 9 2023-07-06T19:59:31.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.283+0000 7fb60a168b80 10 client.4857 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-06T19:59:31.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.283+0000 7fb60a168b80 20 client.4857 populate_metadata read hostname 'smithi006' 2023-07-06T19:59:31.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.283+0000 7fb60a168b80 1 --2- 172.21.15.6:0/163914844 >> [v2:172.21.15.6:6836/368324315,v1:172.21.15.6:6837/368324315] conn(0x557b84152c80 0x557b84167140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:31.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.283+0000 7fb60a168b80 4 client.4857 mds_command: new command op to 4284 tid=0[{"prefix": "status"}] 2023-07-06T19:59:31.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.283+0000 7fb60a168b80 1 -- 172.21.15.6:0/163914844 --> [v2:172.21.15.6:6836/368324315,v1:172.21.15.6:6837/368324315] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557b8404d000 con 0x557b84152c80 2023-07-06T19:59:31.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.283+0000 7fb5f77fe700 1 --2- 172.21.15.6:0/163914844 >> [v2:172.21.15.6:6836/368324315,v1:172.21.15.6:6837/368324315] conn(0x557b84152c80 0x557b84167140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.283+0000 7fb5d67fc700 10 client.4857 ms_handle_connect on v2:172.21.15.6:6836/368324315 2023-07-06T19:59:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.283+0000 7fb5f77fe700 1 --2- 172.21.15.6:0/163914844 >> [v2:172.21.15.6:6836/368324315,v1:172.21.15.6:6837/368324315] conn(0x557b84152c80 0x557b84167140 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bdaee34152e16e7 server_cookie=2c8cf4e78211f26a in_seq=0 out_seq=0 2023-07-06T19:59:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.283+0000 7fb5d67fc700 1 -- 172.21.15.6:0/163914844 <== mds.0 v2:172.21.15.6:6836/368324315 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x557b8404d000 con 0x557b84152c80 2023-07-06T19:59:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.283+0000 7fb5d67fc700 10 client.4857 handle_command_reply: tid=0 2023-07-06T19:59:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.283+0000 7fb60a168b80 1 client.4857 shutdown 2023-07-06T19:59:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.284+0000 7fb60a168b80 1 -- 172.21.15.6:0/163914844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b84168cd0 msgr2=0x557b84152740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:31.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.284+0000 7fb60a168b80 1 --2- 172.21.15.6:0/163914844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b84168cd0 0x557b84152740 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000a3f0 tx=0x7fb5f005e040 comp rx=0 tx=0).stop 2023-07-06T19:59:31.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.284+0000 7fb60a168b80 1 -- 172.21.15.6:0/163914844 shutdown_connections 2023-07-06T19:59:31.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.284+0000 7fb60a168b80 1 --2- 172.21.15.6:0/163914844 >> [v2:172.21.15.6:6836/368324315,v1:172.21.15.6:6837/368324315] conn(0x557b84152c80 0x557b84167140 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.284+0000 7fb60a168b80 1 --2- 172.21.15.6:0/163914844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b84168cd0 0x557b84152740 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.284+0000 7fb60a168b80 1 --2- 172.21.15.6:0/163914844 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x557b8413e830 0x557b8416c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.284+0000 7fb5d67fc700 0 client.4857 ms_handle_reset on v2:172.21.15.6:6836/368324315 2023-07-06T19:59:31.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.284+0000 7fb60a168b80 1 --2- 172.21.15.6:0/163914844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x557b84168470 0x557b84164b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.284+0000 7fb60a168b80 1 -- 172.21.15.6:0/163914844 >> 172.21.15.6:0/163914844 conn(0x557b84135e80 msgr2=0x557b8417fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:31.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.284+0000 7fb60a168b80 1 -- 172.21.15.6:0/163914844 shutdown_connections 2023-07-06T19:59:31.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.284+0000 7fb60a168b80 1 -- 172.21.15.6:0/163914844 wait complete. 2023-07-06T19:59:31.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.284+0000 7fb60a168b80 20 client.4857 trim_cache size 0 max 16384 2023-07-06T19:59:31.305 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-06T19:59:31.306 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "59b158c6-5d9d-4877-b4e7-a584e294fb2e", 2023-07-06T19:59:31.306 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-07-06T19:59:31.306 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 4284, 2023-07-06T19:59:31.306 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-07-06T19:59:31.306 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-07-06T19:59:31.306 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-07-06T19:59:31.306 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 37.557337029000003, 2023-07-06T19:59:31.307 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 9, 2023-07-06T19:59:31.307 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 27, 2023-07-06T19:59:31.307 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 27, 2023-07-06T19:59:31.307 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 43.461565338 2023-07-06T19:59:31.307 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-06T19:59:31.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.284+0000 7fb5fdfe3700 1 -- 172.21.15.6:0/2333990970 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb5d806ace0 msgr2=0x7fb5d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:31.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.284+0000 7fb5fdfe3700 1 --2- 172.21.15.6:0/2333990970 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb5d806ace0 0x7fb5d806d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0000f60 tx=0x7fb5e0007d90 comp rx=0 tx=0).stop 2023-07-06T19:59:31.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.284+0000 7fb5fdfe3700 1 -- 172.21.15.6:0/2333990970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5f80ca850 msgr2=0x7fb5f814d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:31.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.284+0000 7fb5fdfe3700 1 --2- 172.21.15.6:0/2333990970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5f80ca850 0x7fb5f814d750 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb5f000cb50 tx=0x7fb5f000cf10 comp rx=0 tx=0).stop 2023-07-06T19:59:31.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.284+0000 7fb5fdfe3700 1 -- 172.21.15.6:0/2333990970 shutdown_connections 2023-07-06T19:59:31.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.284+0000 7fb5fdfe3700 1 --2- 172.21.15.6:0/2333990970 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb5d806ace0 0x7fb5d806d190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.284+0000 7fb5fdfe3700 1 --2- 172.21.15.6:0/2333990970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5f80ca850 0x7fb5f814d750 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.284+0000 7fb5fdfe3700 1 --2- 172.21.15.6:0/2333990970 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb5f8071900 0x7fb5f814b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.284+0000 7fb5fdfe3700 1 --2- 172.21.15.6:0/2333990970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb5f8071cd0 0x7fb5f80b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:31.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.284+0000 7fb5fdfe3700 1 -- 172.21.15.6:0/2333990970 >> 172.21.15.6:0/2333990970 conn(0x7fb5f80cf960 msgr2=0x7fb5f806c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:31.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.284+0000 7fb5fdfe3700 1 -- 172.21.15.6:0/2333990970 shutdown_connections 2023-07-06T19:59:31.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:31.284+0000 7fb5fdfe3700 1 -- 172.21.15.6:0/2333990970 wait complete. 2023-07-06T19:59:31.311 INFO:teuthology.run_tasks:Running task kclient... 2023-07-06T19:59:31.327 INFO:tasks.kclient:Mounting kernel clients... 2023-07-06T19:59:31.328 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-07-06T19:59:31.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:31.328 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-06T19:59:31.346 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-07-06T19:59:31.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:31.347 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-06T19:59:31.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:31.424 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2023-07-06T19:59:31.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:31.537 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-06T19:59:31.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:31.558 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2023-07-06T19:59:31.629 INFO:teuthology.orchestra.run.smithi006.stderr:Cannot find device "ceph-brx" 2023-07-06T19:59:31.630 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T19:59:31.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:31.633 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-07-06T19:59:31.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:31.664 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2023-07-06T19:59:31.742 INFO:teuthology.orchestra.run.smithi040.stderr:Cannot find device "ceph-brx" 2023-07-06T19:59:31.743 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T19:59:31.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:31.744 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-07-06T19:59:31.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:31.805 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2023-07-06T19:59:31.878 INFO:teuthology.orchestra.run.smithi040.stderr:Cannot find device "ceph-brx" 2023-07-06T19:59:31.879 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-06T19:59:31.880 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-07-06T19:59:31.880 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-06T19:59:31.881 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-06T19:59:31.881 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T19:59:32.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.013+0000 7f02b875f700 1 Processor -- start 2023-07-06T19:59:32.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.013+0000 7f02b875f700 1 -- start start 2023-07-06T19:59:32.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.014+0000 7f02b875f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02b00cd1b0 0x7f02b006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:32.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.014+0000 7f02b875f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f02b006c2f0 0x7f02b00d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:32.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.014+0000 7f02b875f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02b0160060 con 0x7f02b015ce50 2023-07-06T19:59:32.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.014+0000 7f02b875f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02b00cd600 con 0x7f02b006c2f0 2023-07-06T19:59:32.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.014+0000 7f02b875f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b006c730 con 0x7f02b00cd1b0 2023-07-06T19:59:32.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.014+0000 7f02b6cfc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f02b006c2f0 0x7f02b00d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:32.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.014+0000 7f02b6cfc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f02b006c2f0 0x7f02b00d0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59616/0 (socket says 172.21.15.6:59616) 2023-07-06T19:59:32.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.014+0000 7f02b6cfc700 1 -- 172.21.15.6:0/2899442358 learned_addr learned my addr 172.21.15.6:0/2899442358 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:32.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.014+0000 7f02b5cfa700 1 --2- 172.21.15.6:0/2899442358 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02b00cd1b0 0x7f02b006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:32.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.014+0000 7f02b6cfc700 1 -- 172.21.15.6:0/2899442358 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02b00cd1b0 msgr2=0x7f02b006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:32.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.014+0000 7f02b6cfc700 1 --2- 172.21.15.6:0/2899442358 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02b00cd1b0 0x7f02b006bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:32.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.014+0000 7f02b6cfc700 1 -- 172.21.15.6:0/2899442358 >> v1:172.21.15.40:6789/0 conn(0x7f02b015ce50 legacy=0x7f02b015d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:32.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.014+0000 7f02b6cfc700 1 -- 172.21.15.6:0/2899442358 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b00cd800 con 0x7f02b006c2f0 2023-07-06T19:59:32.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.015+0000 7f02b6cfc700 1 --2- 172.21.15.6:0/2899442358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b006c2f0 0x7f02b00d0730 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f02a8009e50 tx=0x7f02a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f7301f5f176743 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:32.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.015+0000 7f02b54f9700 1 -- 172.21.15.6:0/2899442358 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a800e070 con 0x7f02b006c2f0 2023-07-06T19:59:32.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.015+0000 7f02b54f9700 1 -- 172.21.15.6:0/2899442358 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a800b9c0 con 0x7f02b006c2f0 2023-07-06T19:59:32.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.015+0000 7f02b54f9700 1 -- 172.21.15.6:0/2899442358 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a800bd70 con 0x7f02b006c2f0 2023-07-06T19:59:32.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.015+0000 7f02b875f700 1 -- 172.21.15.6:0/2899442358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b006c2f0 msgr2=0x7f02b00d0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:32.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.015+0000 7f02b875f700 1 --2- 172.21.15.6:0/2899442358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b006c2f0 0x7f02b00d0730 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f02a8009e50 tx=0x7f02a800b330 comp rx=0 tx=0).stop 2023-07-06T19:59:32.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.015+0000 7f02b875f700 1 -- 172.21.15.6:0/2899442358 shutdown_connections 2023-07-06T19:59:32.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.015+0000 7f02b875f700 1 --2- 172.21.15.6:0/2899442358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b006c2f0 0x7f02b00d0730 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:32.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.015+0000 7f02b875f700 1 --2- 172.21.15.6:0/2899442358 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02b00cd1b0 0x7f02b006bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:32.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.015+0000 7f02b875f700 1 -- 172.21.15.6:0/2899442358 >> 172.21.15.6:0/2899442358 conn(0x7f02b00d3880 msgr2=0x7f02b00cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:32.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.015+0000 7f02b875f700 1 -- 172.21.15.6:0/2899442358 shutdown_connections 2023-07-06T19:59:32.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.015+0000 7f02b875f700 1 -- 172.21.15.6:0/2899442358 wait complete. 2023-07-06T19:59:32.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.017+0000 7f02b875f700 1 Processor -- start 2023-07-06T19:59:32.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.017+0000 7f02b875f700 1 -- start start 2023-07-06T19:59:32.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.018+0000 7f02b875f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02b006c2f0 0x7f02b00b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:32.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.018+0000 7f02b875f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b00cd1b0 0x7f02b0150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:32.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.018+0000 7f02b875f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02b015ce50 0x7f02b0157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:32.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.018+0000 7f02b875f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00cb6b0 con 0x7f02b00cd1b0 2023-07-06T19:59:32.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.018+0000 7f02b875f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00b6af0 con 0x7f02b015ce50 2023-07-06T19:59:32.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.018+0000 7f02b875f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b00b6250 con 0x7f02b006c2f0 2023-07-06T19:59:32.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.018+0000 7f02b5cfa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b00cd1b0 0x7f02b0150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:32.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.018+0000 7f02b5cfa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b00cd1b0 0x7f02b0150540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59622/0 (socket says 172.21.15.6:59622) 2023-07-06T19:59:32.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.018+0000 7f02b5cfa700 1 -- 172.21.15.6:0/1775970790 learned_addr learned my addr 172.21.15.6:0/1775970790 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:32.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.018+0000 7f02b6cfc700 1 --2- 172.21.15.6:0/1775970790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02b015ce50 0x7f02b0157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:32.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.018+0000 7f02b64fb700 1 --2- 172.21.15.6:0/1775970790 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02b006c2f0 0x7f02b00b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:32.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.018+0000 7f02b5cfa700 1 -- 172.21.15.6:0/1775970790 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02b006c2f0 msgr2=0x7f02b00b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:32.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.018+0000 7f02b5cfa700 1 --2- 172.21.15.6:0/1775970790 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02b006c2f0 0x7f02b00b5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:32.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.018+0000 7f02b5cfa700 1 -- 172.21.15.6:0/1775970790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02b015ce50 msgr2=0x7f02b0157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:32.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.018+0000 7f02b5cfa700 1 --2- 172.21.15.6:0/1775970790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02b015ce50 0x7f02b0157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:32.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.018+0000 7f02b5cfa700 1 -- 172.21.15.6:0/1775970790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a8009b30 con 0x7f02b00cd1b0 2023-07-06T19:59:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.018+0000 7f02b5cfa700 1 --2- 172.21.15.6:0/1775970790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b00cd1b0 0x7f02b0150540 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f02ac00e810 tx=0x7f02ac00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.018+0000 7f02a6ffd700 1 -- 172.21.15.6:0/1775970790 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac00c070 con 0x7f02b00cd1b0 2023-07-06T19:59:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.018+0000 7f02a6ffd700 1 -- 172.21.15.6:0/1775970790 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac013610 con 0x7f02b00cd1b0 2023-07-06T19:59:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.018+0000 7f02b875f700 1 -- 172.21.15.6:0/1775970790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b00b6530 con 0x7f02b00cd1b0 2023-07-06T19:59:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.018+0000 7f02a6ffd700 1 -- 172.21.15.6:0/1775970790 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac0139c0 con 0x7f02b00cd1b0 2023-07-06T19:59:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.018+0000 7f02b875f700 1 -- 172.21.15.6:0/1775970790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b00b5f60 con 0x7f02b00cd1b0 2023-07-06T19:59:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.019+0000 7f02b875f700 1 -- 172.21.15.6:0/1775970790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02b0074200 con 0x7f02b00cd1b0 2023-07-06T19:59:32.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.020+0000 7f02a6ffd700 1 -- 172.21.15.6:0/1775970790 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f02ac013b20 con 0x7f02b00cd1b0 2023-07-06T19:59:32.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.020+0000 7f02a6ffd700 1 --2- 172.21.15.6:0/1775970790 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f029406ace0 0x7f029406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:32.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.020+0000 7f02a6ffd700 1 -- 172.21.15.6:0/1775970790 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f02ac0892c0 con 0x7f02b00cd1b0 2023-07-06T19:59:32.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.020+0000 7f02b64fb700 1 --2- 172.21.15.6:0/1775970790 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f029406ace0 0x7f029406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:32.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.021+0000 7f02b64fb700 1 --2- 172.21.15.6:0/1775970790 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f029406ace0 0x7f029406d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f02a0007fd0 tx=0x7f02a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:32.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.025+0000 7f02a6ffd700 1 -- 172.21.15.6:0/1775970790 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f02ac057a80 con 0x7f02b00cd1b0 2023-07-06T19:59:32.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.268+0000 7f02b875f700 1 -- 172.21.15.6:0/1775970790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f02b00cda40 con 0x7f02b00cd1b0 2023-07-06T19:59:32.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.268+0000 7f02a6ffd700 1 -- 172.21.15.6:0/1775970790 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f02ac017070 con 0x7f02b00cd1b0 2023-07-06T19:59:32.271 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-06T19:59:32.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.271+0000 7f02b875f700 1 -- 172.21.15.6:0/1775970790 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f029406ace0 msgr2=0x7f029406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:32.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.271+0000 7f02b875f700 1 --2- 172.21.15.6:0/1775970790 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f029406ace0 0x7f029406d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f02a0007fd0 tx=0x7f02a0009040 comp rx=0 tx=0).stop 2023-07-06T19:59:32.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.271+0000 7f02b875f700 1 -- 172.21.15.6:0/1775970790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b00cd1b0 msgr2=0x7f02b0150540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:32.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.271+0000 7f02b875f700 1 --2- 172.21.15.6:0/1775970790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b00cd1b0 0x7f02b0150540 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f02ac00e810 tx=0x7f02ac00eb20 comp rx=0 tx=0).stop 2023-07-06T19:59:32.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.271+0000 7f02b875f700 1 -- 172.21.15.6:0/1775970790 shutdown_connections 2023-07-06T19:59:32.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.271+0000 7f02b875f700 1 --2- 172.21.15.6:0/1775970790 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f029406ace0 0x7f029406d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:32.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.271+0000 7f02b875f700 1 --2- 172.21.15.6:0/1775970790 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02b015ce50 0x7f02b0157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:32.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.271+0000 7f02b875f700 1 --2- 172.21.15.6:0/1775970790 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f02b006c2f0 0x7f02b00b5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:32.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.271+0000 7f02b875f700 1 --2- 172.21.15.6:0/1775970790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02b00cd1b0 0x7f02b0150540 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:32.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.271+0000 7f02b875f700 1 -- 172.21.15.6:0/1775970790 >> 172.21.15.6:0/1775970790 conn(0x7f02b00d3880 msgr2=0x7f02b00cf400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:32.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.271+0000 7f02b875f700 1 -- 172.21.15.6:0/1775970790 shutdown_connections 2023-07-06T19:59:32.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:32.271+0000 7f02b875f700 1 -- 172.21.15.6:0/1775970790 wait complete. 2023-07-06T19:59:32.286 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-06T19:59:32.287 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T19:59:32.287 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-07-06T19:59:32.287 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-06T19:59:32.288 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-06T19:59:32.288 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-06T19:59:32.288 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-06T19:59:32.288 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T19:59:32.288 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T19:59:32.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:32.289 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-07-06T19:59:32.317 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T19:59:32.317 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T19:59:32.317 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T19:59:32.318 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:32.318 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-07-06T19:59:32.318 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:32.318 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T19:59:32.318 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-07-06T19:59:32.318 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T19:59:32.318 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-07-06T19:59:32.319 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T19:59:32.319 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-07-06T19:59:32.319 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-06T19:59:32.319 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42215sec preferred_lft 42215sec 2023-07-06T19:59:32.319 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-07-06T19:59:32.319 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:32.319 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T19:59:32.320 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-07-06T19:59:32.320 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-06T19:59:32.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:32.321 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-06T19:59:32.322 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-06T19:59:32.322 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add name ceph-brx type bridge 2023-07-06T19:59:32.322 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr flush dev ceph-brx 2023-07-06T19:59:32.323 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set ceph-brx up 2023-07-06T19:59:32.324 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-06T19:59:32.324 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-06T19:59:32.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:32.436 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T19:59:32.463 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-07-06T19:59:32.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:32.465 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-07-06T19:59:32.527 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-07-06T19:59:32.528 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T19:59:32.528 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-06T19:59:32.528 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-06T19:59:32.529 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T19:59:32.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:32.530 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-06T19:59:32.531 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-06T19:59:32.531 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-06T19:59:32.532 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-06T19:59:32.535 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-06T19:59:32.535 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-06T19:59:32.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:32.635 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-06T19:59:32.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:32.654 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2023-07-06T19:59:32.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:32.710 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-06T19:59:32.710 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-06T19:59:32.711 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-06T19:59:32.711 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-06T19:59:32.712 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-06T19:59:32.805 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-06T19:59:32.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:32.806 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-06T19:59:32.806 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-06T19:59:32.806 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-06T19:59:32.806 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-06T19:59:32.807 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-06T19:59:32.807 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-06T19:59:32.807 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-06T19:59:32.807 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-06T19:59:33.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:33.060 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-06T19:59:33.060 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-06T19:59:33.060 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-07-06T19:59:33.061 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.0 master ceph-brx 2023-07-06T19:59:33.061 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-06T19:59:33.196 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T19:59:33.197 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-06T19:59:33.222 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-06T19:59:33.222 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T19:59:33.223 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-06T19:59:33.280 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-06T19:59:33.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:33.288 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-06T19:59:33.368 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-06T19:59:33.368 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-06T19:59:33.369 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-06T19:59:33.492 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-06T19:59:33.493 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-06T19:59:33.493 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-06T19:59:33.493 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.40:3300,172.21.15.40:3301" 2023-07-06T19:59:33.493 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-06T19:59:33.518 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-06T19:59:33.519 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-06T19:59:33.519 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-06T19:59:33.519 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.40:3300,172.21.15.40:3301" 2023-07-06T19:59:33.519 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-06T19:59:33.519 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.40:6789,172.21.15.40:6790" 2023-07-06T19:59:33.519 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.40:6789,172.21.15.40:6790:/ 2023-07-06T19:59:33.520 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=59b158c6-5d9d-4877-b4e7-a584e294fb2e" will pass to kernel 2023-07-06T19:59:33.531 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T19:59:33.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:33.532 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-06T19:59:33.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:33.565 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T19:59:33.638 INFO:teuthology.orchestra.run.smithi006.stdout:client4866 2023-07-06T19:59:33.639 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:59:33.639 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T19:59:33.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:33.698 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T19:59:33.773 INFO:teuthology.orchestra.run.smithi006.stdout:client4866 2023-07-06T19:59:33.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:33.776 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T19:59:33.847 INFO:teuthology.orchestra.run.smithi006.stdout:client4866 2023-07-06T19:59:33.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:33.848 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/59b158c6-5d9d-4877-b4e7-a584e294fb2e.client4866/status') 2023-07-06T19:59:33.936 INFO:teuthology.orchestra.run.smithi006.stdout:instance: client.4866 (3)192.168.0.1:0/530025213 2023-07-06T19:59:33.937 INFO:teuthology.orchestra.run.smithi006.stdout:blocklisted: false 2023-07-06T19:59:33.938 INFO:teuthology.orchestra.run.smithi006.stderr:0+1 records in 2023-07-06T19:59:33.939 INFO:teuthology.orchestra.run.smithi006.stderr:0+1 records out 2023-07-06T19:59:33.939 INFO:teuthology.orchestra.run.smithi006.stderr:68 bytes copied, 2.4044e-05 s, 2.8 MB/s 2023-07-06T19:59:33.940 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-07-06T19:59:33.941 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-06T19:59:33.941 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-06T19:59:33.949 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T19:59:34.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.102+0000 7f59b8e12700 1 Processor -- start 2023-07-06T19:59:34.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.102+0000 7f59b8e12700 1 -- start start 2023-07-06T19:59:34.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.103+0000 7f59b8e12700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f59b406ce60 0x7f59b4157f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:34.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.103+0000 7f59b8e12700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59b4071d00 0x7f59b40cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:34.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.103+0000 7f59b8e12700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b406a990 con 0x7f59b4071930 2023-07-06T19:59:34.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.103+0000 7f59b8e12700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b406b150 con 0x7f59b406ce60 2023-07-06T19:59:34.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.103+0000 7f59b8e12700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b406ac30 con 0x7f59b4071d00 2023-07-06T19:59:34.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.103+0000 7f59b1d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f59b406ce60 0x7f59b4157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:34.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.103+0000 7f59b1d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f59b406ce60 0x7f59b4157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59638/0 (socket says 172.21.15.6:59638) 2023-07-06T19:59:34.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.103+0000 7f59b259c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f59b4071930 0x7f59b4157800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60844/0 (socket says 172.21.15.6:60844) 2023-07-06T19:59:34.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.103+0000 7f59b1d9b700 1 -- 172.21.15.6:0/1434193502 learned_addr learned my addr 172.21.15.6:0/1434193502 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:34.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.103+0000 7f59b2d9d700 1 --2- 172.21.15.6:0/1434193502 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59b4071d00 0x7f59b40cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:34.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.103+0000 7f59b1d9b700 1 -- 172.21.15.6:0/1434193502 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59b4071d00 msgr2=0x7f59b40cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:34.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.103+0000 7f59b1d9b700 1 --2- 172.21.15.6:0/1434193502 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59b4071d00 0x7f59b40cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:34.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.103+0000 7f59b1d9b700 1 -- 172.21.15.6:0/1434193502 >> v1:172.21.15.6:6789/0 conn(0x7f59b4071930 legacy=0x7f59b4157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:34.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.104+0000 7f59b1d9b700 1 -- 172.21.15.6:0/1434193502 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b406b360 con 0x7f59b406ce60 2023-07-06T19:59:34.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.103+0000 7f59b159a700 1 -- 172.21.15.6:0/1434193502 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2203982526 0 0) 0x7f59b406a990 con 0x7f59b4071930 2023-07-06T19:59:34.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.104+0000 7f59b1d9b700 1 --2- 172.21.15.6:0/1434193502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b406ce60 0x7f59b4157f10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f59b406b290 tx=0x7f59a4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647ebeeae856de9c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:34.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.104+0000 7f59b159a700 1 -- 172.21.15.6:0/1434193502 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a4004230 con 0x7f59b406ce60 2023-07-06T19:59:34.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.104+0000 7f59b159a700 1 -- 172.21.15.6:0/1434193502 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a4004390 con 0x7f59b406ce60 2023-07-06T19:59:34.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.104+0000 7f59b159a700 1 -- 172.21.15.6:0/1434193502 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a40036a0 con 0x7f59b406ce60 2023-07-06T19:59:34.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.104+0000 7f59b8e12700 1 -- 172.21.15.6:0/1434193502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b406ce60 msgr2=0x7f59b4157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:34.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.104+0000 7f59b8e12700 1 --2- 172.21.15.6:0/1434193502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b406ce60 0x7f59b4157f10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f59b406b290 tx=0x7f59a4009bd0 comp rx=0 tx=0).stop 2023-07-06T19:59:34.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.104+0000 7f59b8e12700 1 -- 172.21.15.6:0/1434193502 shutdown_connections 2023-07-06T19:59:34.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.104+0000 7f59b8e12700 1 --2- 172.21.15.6:0/1434193502 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59b4071d00 0x7f59b40cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:34.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.104+0000 7f59b8e12700 1 --2- 172.21.15.6:0/1434193502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b406ce60 0x7f59b4157f10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:34.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.104+0000 7f59b8e12700 1 -- 172.21.15.6:0/1434193502 >> 172.21.15.6:0/1434193502 conn(0x7f59b40cc420 msgr2=0x7f59b40cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:34.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.104+0000 7f59b8e12700 1 -- 172.21.15.6:0/1434193502 shutdown_connections 2023-07-06T19:59:34.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.104+0000 7f59b8e12700 1 -- 172.21.15.6:0/1434193502 wait complete. 2023-07-06T19:59:34.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.106+0000 7f59b8e12700 1 Processor -- start 2023-07-06T19:59:34.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.106+0000 7f59b8e12700 1 -- start start 2023-07-06T19:59:34.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.107+0000 7f59b8e12700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59b406ce60 0x7f59b414cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:34.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.107+0000 7f59b8e12700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b4071930 0x7f59b40c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:34.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.107+0000 7f59b8e12700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59b4071d00 0x7f59b40c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:34.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.107+0000 7f59b8e12700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b40b2960 con 0x7f59b4071930 2023-07-06T19:59:34.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.107+0000 7f59b8e12700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b4159010 con 0x7f59b406ce60 2023-07-06T19:59:34.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.107+0000 7f59b8e12700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b41592f0 con 0x7f59b4071d00 2023-07-06T19:59:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.107+0000 7f59b1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b4071930 0x7f59b40c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.107+0000 7f59b1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b4071930 0x7f59b40c6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59644/0 (socket says 172.21.15.6:59644) 2023-07-06T19:59:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.107+0000 7f59b1d9b700 1 -- 172.21.15.6:0/3463203524 learned_addr learned my addr 172.21.15.6:0/3463203524 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.107+0000 7f59b2d9d700 1 --2- 172.21.15.6:0/3463203524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59b4071d00 0x7f59b40c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.107+0000 7f59b259c700 1 --2- 172.21.15.6:0/3463203524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59b406ce60 0x7f59b414cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.107+0000 7f59b1d9b700 1 -- 172.21.15.6:0/3463203524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59b4071d00 msgr2=0x7f59b40c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.107+0000 7f59b1d9b700 1 --2- 172.21.15.6:0/3463203524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59b4071d00 0x7f59b40c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:34.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.107+0000 7f59b1d9b700 1 -- 172.21.15.6:0/3463203524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59b406ce60 msgr2=0x7f59b414cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:34.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.107+0000 7f59b1d9b700 1 --2- 172.21.15.6:0/3463203524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59b406ce60 0x7f59b414cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:34.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.107+0000 7f59b1d9b700 1 -- 172.21.15.6:0/3463203524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a4009550 con 0x7f59b4071930 2023-07-06T19:59:34.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.107+0000 7f59b1d9b700 1 --2- 172.21.15.6:0/3463203524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b4071930 0x7f59b40c6a70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f59a4009130 tx=0x7f59a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:34.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.107+0000 7f59a2ffd700 1 -- 172.21.15.6:0/3463203524 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a4003e20 con 0x7f59b4071930 2023-07-06T19:59:34.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.107+0000 7f59a2ffd700 1 -- 172.21.15.6:0/3463203524 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a400b670 con 0x7f59b4071930 2023-07-06T19:59:34.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.107+0000 7f59b8e12700 1 -- 172.21.15.6:0/3463203524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b40b2bb0 con 0x7f59b4071930 2023-07-06T19:59:34.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.107+0000 7f59a2ffd700 1 -- 172.21.15.6:0/3463203524 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a400ba00 con 0x7f59b4071930 2023-07-06T19:59:34.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.108+0000 7f59b8e12700 1 -- 172.21.15.6:0/3463203524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b414d2e0 con 0x7f59b4071930 2023-07-06T19:59:34.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.108+0000 7f59b8e12700 1 -- 172.21.15.6:0/3463203524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b40b30d0 con 0x7f59b4071930 2023-07-06T19:59:34.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.109+0000 7f59a2ffd700 1 -- 172.21.15.6:0/3463203524 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f59a4021070 con 0x7f59b4071930 2023-07-06T19:59:34.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.109+0000 7f59a2ffd700 1 --2- 172.21.15.6:0/3463203524 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f599406ace0 0x7f599406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:34.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.109+0000 7f59a2ffd700 1 -- 172.21.15.6:0/3463203524 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f59a408b090 con 0x7f59b4071930 2023-07-06T19:59:34.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.109+0000 7f59b259c700 1 --2- 172.21.15.6:0/3463203524 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f599406ace0 0x7f599406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:34.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.110+0000 7f59b259c700 1 --2- 172.21.15.6:0/3463203524 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f599406ace0 0x7f599406d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f59a8000f60 tx=0x7f59a8007be0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:34.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.114+0000 7f59a2ffd700 1 -- 172.21.15.6:0/3463203524 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f59b40b30d0 con 0x7f59b4071930 2023-07-06T19:59:34.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.356+0000 7f59b8e12700 1 -- 172.21.15.6:0/3463203524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f59b40b30d0 con 0x7f59b4071930 2023-07-06T19:59:34.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.356+0000 7f59a2ffd700 1 -- 172.21.15.6:0/3463203524 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f59b40b30d0 con 0x7f59b4071930 2023-07-06T19:59:34.361 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-06T19:59:34.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.359+0000 7f59b8e12700 1 -- 172.21.15.6:0/3463203524 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f599406ace0 msgr2=0x7f599406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:34.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.359+0000 7f59b8e12700 1 --2- 172.21.15.6:0/3463203524 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f599406ace0 0x7f599406d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f59a8000f60 tx=0x7f59a8007be0 comp rx=0 tx=0).stop 2023-07-06T19:59:34.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.359+0000 7f59b8e12700 1 -- 172.21.15.6:0/3463203524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b4071930 msgr2=0x7f59b40c6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:34.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.359+0000 7f59b8e12700 1 --2- 172.21.15.6:0/3463203524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b4071930 0x7f59b40c6a70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f59a4009130 tx=0x7f59a4004750 comp rx=0 tx=0).stop 2023-07-06T19:59:34.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.359+0000 7f59b8e12700 1 -- 172.21.15.6:0/3463203524 shutdown_connections 2023-07-06T19:59:34.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.359+0000 7f59b8e12700 1 --2- 172.21.15.6:0/3463203524 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f599406ace0 0x7f599406d190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:34.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.359+0000 7f59b8e12700 1 --2- 172.21.15.6:0/3463203524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59b4071d00 0x7f59b40c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:34.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.359+0000 7f59b8e12700 1 --2- 172.21.15.6:0/3463203524 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59b406ce60 0x7f59b414cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:34.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.359+0000 7f59b8e12700 1 --2- 172.21.15.6:0/3463203524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b4071930 0x7f59b40c6a70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:34.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.359+0000 7f59b8e12700 1 -- 172.21.15.6:0/3463203524 >> 172.21.15.6:0/3463203524 conn(0x7f59b40cc420 msgr2=0x7f59b415e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:34.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.359+0000 7f59b8e12700 1 -- 172.21.15.6:0/3463203524 shutdown_connections 2023-07-06T19:59:34.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:34.359+0000 7f59b8e12700 1 -- 172.21.15.6:0/3463203524 wait complete. 2023-07-06T19:59:34.373 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-06T19:59:34.373 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T19:59:34.373 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-07-06T19:59:34.374 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-07-06T19:59:34.374 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-06T19:59:34.375 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-06T19:59:34.375 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-06T19:59:34.375 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T19:59:34.375 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-07-06T19:59:34.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:34.376 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-07-06T19:59:34.395 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T19:59:34.395 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T19:59:34.395 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T19:59:34.395 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:34.396 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-07-06T19:59:34.396 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:34.396 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T19:59:34.396 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-07-06T19:59:34.396 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T19:59:34.396 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-07-06T19:59:34.396 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T19:59:34.397 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-07-06T19:59:34.397 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-06T19:59:34.397 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42213sec preferred_lft 42213sec 2023-07-06T19:59:34.397 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-07-06T19:59:34.397 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:34.397 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T19:59:34.397 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-07-06T19:59:34.397 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T19:59:34.398 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 72:c9:1c:fc:d6:d4 brd ff:ff:ff:ff:ff:ff 2023-07-06T19:59:34.398 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-06T19:59:34.398 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:34.398 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::b894:e0ff:feb6:2237/64 scope link 2023-07-06T19:59:34.398 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:34.398 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T19:59:34.398 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 72:c9:1c:fc:d6:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-06T19:59:34.398 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::70c9:1cff:fefc:d6d4/64 scope link tentative 2023-07-06T19:59:34.399 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:34.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:34.399 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T19:59:34.462 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-07-06T19:59:34.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:34.464 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-07-06T19:59:34.525 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-07-06T19:59:34.525 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T19:59:34.525 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-06T19:59:34.526 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-06T19:59:34.526 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T19:59:34.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:34.530 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-06T19:59:34.531 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-06T19:59:34.531 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-06T19:59:34.536 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-06T19:59:34.536 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-06T19:59:34.536 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-06T19:59:34.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:34.642 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-06T19:59:34.662 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-06T19:59:34.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:34.663 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2023-07-06T19:59:34.722 INFO:teuthology.orchestra.run.smithi006.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-07-06T19:59:34.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:34.726 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-06T19:59:34.726 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-06T19:59:34.727 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-06T19:59:34.727 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-07-06T19:59:34.727 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-06T19:59:34.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:34.823 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-06T19:59:34.861 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T19:59:34.861 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T19:59:34.862 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T19:59:34.862 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:34.862 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-07-06T19:59:34.862 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:34.862 INFO:teuthology.orchestra.run.smithi006.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T19:59:34.862 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 76:57:0f:c8:46:ca brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-06T19:59:34.862 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-06T19:59:34.863 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:34.863 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::7457:fff:fec8:46ca/64 scope link 2023-07-06T19:59:34.863 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:34.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:34.873 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-06T19:59:34.962 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T19:59:34.962 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T19:59:34.962 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T19:59:34.962 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:34.962 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-07-06T19:59:34.963 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:34.963 INFO:teuthology.orchestra.run.smithi006.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T19:59:34.963 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 76:57:0f:c8:46:ca brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-06T19:59:34.963 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-06T19:59:34.963 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:34.963 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::7457:fff:fec8:46ca/64 scope link 2023-07-06T19:59:34.963 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:34.974 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-07-06T19:59:34.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:34.975 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-06T19:59:34.975 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-06T19:59:34.975 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-07-06T19:59:34.976 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-06T19:59:34.977 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-07-06T19:59:34.977 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-07-06T19:59:34.977 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-07-06T19:59:34.977 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-06T19:59:35.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:35.227 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-06T19:59:35.228 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-06T19:59:35.228 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.1 up 2023-07-06T19:59:35.228 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.1 master ceph-brx 2023-07-06T19:59:35.229 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-06T19:59:35.350 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T19:59:35.351 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-07-06T19:59:35.371 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-07-06T19:59:35.372 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T19:59:35.372 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-07-06T19:59:35.433 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-06T19:59:35.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:35.436 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-06T19:59:35.522 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-06T19:59:35.522 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-06T19:59:35.523 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-06T19:59:35.531 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-06T19:59:35.531 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-06T19:59:35.531 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-06T19:59:35.532 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.40:3300,172.21.15.40:3301" 2023-07-06T19:59:35.532 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-06T19:59:35.562 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-07-06T19:59:35.562 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-07-06T19:59:35.562 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-06T19:59:35.562 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.40:3300,172.21.15.40:3301" 2023-07-06T19:59:35.563 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-06T19:59:35.563 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.40:6789,172.21.15.40:6790" 2023-07-06T19:59:35.563 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.40:6789,172.21.15.40:6790:/ 2023-07-06T19:59:35.563 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=59b158c6-5d9d-4877-b4e7-a584e294fb2e" will pass to kernel 2023-07-06T19:59:35.571 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T19:59:35.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:35.573 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-07-06T19:59:35.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:35.642 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T19:59:35.719 INFO:teuthology.orchestra.run.smithi006.stdout:client4878 2023-07-06T19:59:35.720 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:59:35.720 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T19:59:35.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:35.779 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T19:59:35.852 INFO:teuthology.orchestra.run.smithi006.stdout:client4878 2023-07-06T19:59:35.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:35.853 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T19:59:35.929 INFO:teuthology.orchestra.run.smithi006.stdout:client4878 2023-07-06T19:59:35.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:35.929 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/59b158c6-5d9d-4877-b4e7-a584e294fb2e.client4878/status') 2023-07-06T19:59:36.012 INFO:teuthology.orchestra.run.smithi006.stdout:instance: client.4878 (3)192.168.0.2:0/1872324618 2023-07-06T19:59:36.013 INFO:teuthology.orchestra.run.smithi006.stdout:blocklisted: false 2023-07-06T19:59:36.014 INFO:teuthology.orchestra.run.smithi006.stderr:0+1 records in 2023-07-06T19:59:36.014 INFO:teuthology.orchestra.run.smithi006.stderr:0+1 records out 2023-07-06T19:59:36.014 INFO:teuthology.orchestra.run.smithi006.stderr:69 bytes copied, 2.2543e-05 s, 3.1 MB/s 2023-07-06T19:59:36.015 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-07-06T19:59:36.015 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-06T19:59:36.015 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-06T19:59:36.016 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T19:59:36.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.177+0000 7fe7a360b700 1 Processor -- start 2023-07-06T19:59:36.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.177+0000 7fe7a360b700 1 -- start start 2023-07-06T19:59:36.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.178+0000 7fe7a360b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe79c157ed0 0x7fe79c06f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:36.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.178+0000 7fe7a360b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79c06e6c0 con 0x7fe79c15e4c0 2023-07-06T19:59:36.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.178+0000 7fe7a360b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79c0cb080 con 0x7fe79c0ccbe0 2023-07-06T19:59:36.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.178+0000 7fe7a360b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79c06f6a0 con 0x7fe79c157ed0 2023-07-06T19:59:36.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.178+0000 7fe7a13a7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe79c157ed0 0x7fe79c06f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:36.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.178+0000 7fe7a1ba8700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe79c15e4c0 0x7fe79c0ce600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60866/0 (socket says 172.21.15.6:60866) 2023-07-06T19:59:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.178+0000 7fe7a13a7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe79c157ed0 0x7fe79c06f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59654/0 (socket says 172.21.15.6:59654) 2023-07-06T19:59:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.178+0000 7fe7a13a7700 1 -- 172.21.15.6:0/1799459620 learned_addr learned my addr 172.21.15.6:0/1799459620 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.178+0000 7fe7a13a7700 1 -- 172.21.15.6:0/1799459620 >> v1:172.21.15.40:6789/0 conn(0x7fe79c0ccbe0 legacy=0x7fe79c15ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.178+0000 7fe7a13a7700 1 -- 172.21.15.6:0/1799459620 >> v1:172.21.15.6:6789/0 conn(0x7fe79c15e4c0 legacy=0x7fe79c0ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.178+0000 7fe7a13a7700 1 -- 172.21.15.6:0/1799459620 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79c0cb360 con 0x7fe79c157ed0 2023-07-06T19:59:36.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.178+0000 7fe7a13a7700 1 --2- 172.21.15.6:0/1799459620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe79c157ed0 0x7fe79c06f160 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe7980098f0 tx=0x7fe798009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114b3003794dfee7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:36.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.178+0000 7fe78ffff700 1 -- 172.21.15.6:0/1799459620 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe798004230 con 0x7fe79c157ed0 2023-07-06T19:59:36.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.178+0000 7fe78ffff700 1 -- 172.21.15.6:0/1799459620 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe798004390 con 0x7fe79c157ed0 2023-07-06T19:59:36.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.178+0000 7fe78ffff700 1 -- 172.21.15.6:0/1799459620 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7980036a0 con 0x7fe79c157ed0 2023-07-06T19:59:36.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.179+0000 7fe7a360b700 1 -- 172.21.15.6:0/1799459620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe79c157ed0 msgr2=0x7fe79c06f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:36.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.179+0000 7fe7a360b700 1 --2- 172.21.15.6:0/1799459620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe79c157ed0 0x7fe79c06f160 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe7980098f0 tx=0x7fe798009c00 comp rx=0 tx=0).stop 2023-07-06T19:59:36.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.179+0000 7fe7a360b700 1 -- 172.21.15.6:0/1799459620 shutdown_connections 2023-07-06T19:59:36.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.179+0000 7fe7a360b700 1 --2- 172.21.15.6:0/1799459620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe79c157ed0 0x7fe79c06f160 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:36.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.179+0000 7fe7a360b700 1 -- 172.21.15.6:0/1799459620 >> 172.21.15.6:0/1799459620 conn(0x7fe79c0d0a30 msgr2=0x7fe79c0d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:36.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.179+0000 7fe7a360b700 1 -- 172.21.15.6:0/1799459620 shutdown_connections 2023-07-06T19:59:36.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.179+0000 7fe7a360b700 1 -- 172.21.15.6:0/1799459620 wait complete. 2023-07-06T19:59:36.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.180+0000 7fe7a360b700 1 Processor -- start 2023-07-06T19:59:36.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.180+0000 7fe7a360b700 1 -- start start 2023-07-06T19:59:36.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.181+0000 7fe7a360b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe79c0ccbe0 0x7fe79c1ef470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:36.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.181+0000 7fe7a360b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe79c157ed0 0x7fe79c0b1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:36.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.181+0000 7fe7a360b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe79c15e4c0 0x7fe79c0b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:36.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.181+0000 7fe7a360b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c0b0490 con 0x7fe79c15e4c0 2023-07-06T19:59:36.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.181+0000 7fe7a360b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c0b12f0 con 0x7fe79c0ccbe0 2023-07-06T19:59:36.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.181+0000 7fe7a360b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c0b06e0 con 0x7fe79c157ed0 2023-07-06T19:59:36.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.181+0000 7fe7a1ba8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe79c15e4c0 0x7fe79c0b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:36.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.181+0000 7fe7a1ba8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe79c15e4c0 0x7fe79c0b5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59664/0 (socket says 172.21.15.6:59664) 2023-07-06T19:59:36.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.181+0000 7fe7a1ba8700 1 -- 172.21.15.6:0/2987147255 learned_addr learned my addr 172.21.15.6:0/2987147255 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:36.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.181+0000 7fe7a13a7700 1 --2- 172.21.15.6:0/2987147255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe79c0ccbe0 0x7fe79c1ef470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:36.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.181+0000 7fe7a0ba6700 1 --2- 172.21.15.6:0/2987147255 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe79c157ed0 0x7fe79c0b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:36.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.181+0000 7fe7a1ba8700 1 -- 172.21.15.6:0/2987147255 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe79c157ed0 msgr2=0x7fe79c0b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:36.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.181+0000 7fe7a1ba8700 1 --2- 172.21.15.6:0/2987147255 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe79c157ed0 0x7fe79c0b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:36.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.181+0000 7fe7a1ba8700 1 -- 172.21.15.6:0/2987147255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe79c0ccbe0 msgr2=0x7fe79c1ef470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:36.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.181+0000 7fe7a1ba8700 1 --2- 172.21.15.6:0/2987147255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe79c0ccbe0 0x7fe79c1ef470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:36.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.181+0000 7fe7a1ba8700 1 -- 172.21.15.6:0/2987147255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe798009550 con 0x7fe79c15e4c0 2023-07-06T19:59:36.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.182+0000 7fe7a1ba8700 1 --2- 172.21.15.6:0/2987147255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe79c15e4c0 0x7fe79c0b5db0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe79400cb40 tx=0x7fe79400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:36.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.182+0000 7fe78dffb700 1 -- 172.21.15.6:0/2987147255 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79400a960 con 0x7fe79c15e4c0 2023-07-06T19:59:36.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.182+0000 7fe78dffb700 1 -- 172.21.15.6:0/2987147255 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79400aac0 con 0x7fe79c15e4c0 2023-07-06T19:59:36.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.182+0000 7fe7a360b700 1 -- 172.21.15.6:0/2987147255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79c0b09c0 con 0x7fe79c15e4c0 2023-07-06T19:59:36.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.182+0000 7fe78dffb700 1 -- 172.21.15.6:0/2987147255 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79400ae30 con 0x7fe79c15e4c0 2023-07-06T19:59:36.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.182+0000 7fe7a360b700 1 -- 172.21.15.6:0/2987147255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79c0b0f80 con 0x7fe79c15e4c0 2023-07-06T19:59:36.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.183+0000 7fe7a360b700 1 -- 172.21.15.6:0/2987147255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79c0b1430 con 0x7fe79c15e4c0 2023-07-06T19:59:36.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.183+0000 7fe78dffb700 1 -- 172.21.15.6:0/2987147255 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe794007070 con 0x7fe79c15e4c0 2023-07-06T19:59:36.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.184+0000 7fe78dffb700 1 --2- 172.21.15.6:0/2987147255 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe78006ace0 0x7fe78006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:36.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.184+0000 7fe78dffb700 1 -- 172.21.15.6:0/2987147255 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe7940892c0 con 0x7fe79c15e4c0 2023-07-06T19:59:36.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.184+0000 7fe7a13a7700 1 --2- 172.21.15.6:0/2987147255 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe78006ace0 0x7fe78006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:36.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.184+0000 7fe7a13a7700 1 --2- 172.21.15.6:0/2987147255 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe78006ace0 0x7fe78006d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe798009130 tx=0x7fe798008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:36.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.188+0000 7fe78dffb700 1 -- 172.21.15.6:0/2987147255 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe7940540f0 con 0x7fe79c15e4c0 2023-07-06T19:59:36.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.432+0000 7fe7a360b700 1 -- 172.21.15.6:0/2987147255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe79c156710 con 0x7fe79c15e4c0 2023-07-06T19:59:36.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.432+0000 7fe78dffb700 1 -- 172.21.15.6:0/2987147255 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fe794057710 con 0x7fe79c15e4c0 2023-07-06T19:59:36.435 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-06T19:59:36.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.435+0000 7fe7a360b700 1 -- 172.21.15.6:0/2987147255 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe78006ace0 msgr2=0x7fe78006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:36.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.435+0000 7fe7a360b700 1 --2- 172.21.15.6:0/2987147255 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe78006ace0 0x7fe78006d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe798009130 tx=0x7fe798008030 comp rx=0 tx=0).stop 2023-07-06T19:59:36.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.435+0000 7fe7a360b700 1 -- 172.21.15.6:0/2987147255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe79c15e4c0 msgr2=0x7fe79c0b5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:36.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.435+0000 7fe7a360b700 1 --2- 172.21.15.6:0/2987147255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe79c15e4c0 0x7fe79c0b5db0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe79400cb40 tx=0x7fe79400ce50 comp rx=0 tx=0).stop 2023-07-06T19:59:36.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.435+0000 7fe7a360b700 1 -- 172.21.15.6:0/2987147255 shutdown_connections 2023-07-06T19:59:36.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.435+0000 7fe7a360b700 1 --2- 172.21.15.6:0/2987147255 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe78006ace0 0x7fe78006d190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:36.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.435+0000 7fe7a360b700 1 --2- 172.21.15.6:0/2987147255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe79c15e4c0 0x7fe79c0b5db0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:36.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.435+0000 7fe7a360b700 1 --2- 172.21.15.6:0/2987147255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe79c0ccbe0 0x7fe79c1ef470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:36.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.435+0000 7fe7a360b700 1 --2- 172.21.15.6:0/2987147255 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe79c157ed0 0x7fe79c0b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:36.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.435+0000 7fe7a360b700 1 -- 172.21.15.6:0/2987147255 >> 172.21.15.6:0/2987147255 conn(0x7fe79c0d0a30 msgr2=0x7fe79c157070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:36.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.435+0000 7fe7a360b700 1 -- 172.21.15.6:0/2987147255 shutdown_connections 2023-07-06T19:59:36.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:36.435+0000 7fe7a360b700 1 -- 172.21.15.6:0/2987147255 wait complete. 2023-07-06T19:59:36.449 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-06T19:59:36.449 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T19:59:36.449 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-07-06T19:59:36.449 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-06T19:59:36.450 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-06T19:59:36.450 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-06T19:59:36.450 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-06T19:59:36.450 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T19:59:36.450 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-06T19:59:36.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:36.451 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-07-06T19:59:36.479 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T19:59:36.487 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T19:59:36.487 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T19:59:36.487 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:36.488 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-07-06T19:59:36.488 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:36.488 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T19:59:36.488 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-07-06T19:59:36.488 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T19:59:36.488 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-07-06T19:59:36.488 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T19:59:36.489 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-07-06T19:59:36.489 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-06T19:59:36.489 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42345sec preferred_lft 42345sec 2023-07-06T19:59:36.489 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2023-07-06T19:59:36.490 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:36.490 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T19:59:36.490 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-07-06T19:59:36.490 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-06T19:59:36.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:36.491 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-07-06T19:59:36.491 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-07-06T19:59:36.491 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add name ceph-brx type bridge 2023-07-06T19:59:36.492 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr flush dev ceph-brx 2023-07-06T19:59:36.492 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set ceph-brx up 2023-07-06T19:59:36.492 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-06T19:59:36.493 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-07-06T19:59:36.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:36.653 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T19:59:36.692 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-07-06T19:59:36.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:36.694 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-07-06T19:59:36.764 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-07-06T19:59:36.764 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T19:59:36.765 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-06T19:59:36.765 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-06T19:59:36.765 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T19:59:36.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:36.766 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-07-06T19:59:36.766 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-07-06T19:59:36.766 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-06T19:59:36.768 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-06T19:59:36.769 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-06T19:59:36.769 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-07-06T19:59:37.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:37.031 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-07-06T19:59:37.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:37.049 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2023-07-06T19:59:37.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:37.111 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-07-06T19:59:37.112 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-07-06T19:59:37.112 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-06T19:59:37.118 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-07-06T19:59:37.118 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-07-06T19:59:37.206 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-07-06T19:59:37.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:37.207 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-07-06T19:59:37.208 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-07-06T19:59:37.209 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-07-06T19:59:37.209 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-06T19:59:37.210 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-07-06T19:59:37.210 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-07-06T19:59:37.210 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-07-06T19:59:37.210 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-07-06T19:59:37.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:37.398 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-07-06T19:59:37.399 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-07-06T19:59:37.399 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2023-07-06T19:59:37.415 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.0 master ceph-brx 2023-07-06T19:59:37.415 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-07-06T19:59:37.520 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T19:59:37.520 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-06T19:59:37.544 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-06T19:59:37.544 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T19:59:37.545 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-06T19:59:37.602 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-06T19:59:37.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:37.603 DEBUG:teuthology.orchestra.run.smithi040:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-06T19:59:37.702 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-06T19:59:37.703 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-06T19:59:37.703 INFO:teuthology.orchestra.run.smithi040.stdout:invalid new device string format 2023-07-06T19:59:37.809 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-06T19:59:37.809 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-06T19:59:37.809 INFO:teuthology.orchestra.run.smithi040.stdout:invalid new device string format 2023-07-06T19:59:37.809 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.40:3300,172.21.15.40:3301" 2023-07-06T19:59:37.810 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-06T19:59:37.873 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-06T19:59:37.874 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-06T19:59:37.874 INFO:teuthology.orchestra.run.smithi040.stdout:invalid new device string format 2023-07-06T19:59:37.875 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.40:3300,172.21.15.40:3301" 2023-07-06T19:59:37.875 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-06T19:59:37.875 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.40:6789,172.21.15.40:6790" 2023-07-06T19:59:37.875 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.40:6789,172.21.15.40:6790:/ 2023-07-06T19:59:37.875 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=59b158c6-5d9d-4877-b4e7-a584e294fb2e" will pass to kernel 2023-07-06T19:59:37.876 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T19:59:37.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:37.877 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-06T19:59:37.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:37.904 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T19:59:37.980 INFO:teuthology.orchestra.run.smithi040.stdout:client4890 2023-07-06T19:59:37.981 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:59:37.985 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T19:59:38.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:38.042 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T19:59:38.117 INFO:teuthology.orchestra.run.smithi040.stdout:client4890 2023-07-06T19:59:38.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:38.119 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T19:59:38.195 INFO:teuthology.orchestra.run.smithi040.stdout:client4890 2023-07-06T19:59:38.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:38.196 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/59b158c6-5d9d-4877-b4e7-a584e294fb2e.client4890/status') 2023-07-06T19:59:38.277 INFO:teuthology.orchestra.run.smithi040.stdout:instance: client.4890 (3)172.21.15.40:0/2887112035 2023-07-06T19:59:38.278 INFO:teuthology.orchestra.run.smithi040.stdout:blocklisted: false 2023-07-06T19:59:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:0+1 records in 2023-07-06T19:59:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:0+1 records out 2023-07-06T19:59:38.279 INFO:teuthology.orchestra.run.smithi040.stderr:70 bytes copied, 2.4025e-05 s, 2.9 MB/s 2023-07-06T19:59:38.280 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-07-06T19:59:38.280 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-06T19:59:38.280 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-06T19:59:38.281 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T19:59:38.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.418+0000 7fa759717700 1 Processor -- start 2023-07-06T19:59:38.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.418+0000 7fa759717700 1 -- start start 2023-07-06T19:59:38.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.418+0000 7fa759717700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75415ce50 0x7fa7540cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:38.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.418+0000 7fa759717700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa754160060 con 0x7fa75415d220 2023-07-06T19:59:38.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.418+0000 7fa759717700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7540cd800 con 0x7fa75406c4c0 2023-07-06T19:59:38.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.418+0000 7fa759717700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7541602b0 con 0x7fa75415ce50 2023-07-06T19:59:38.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.419+0000 7fa7527fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa75415d220 0x7fa75406bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60880/0 (socket says 172.21.15.6:60880) 2023-07-06T19:59:38.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.419+0000 7fa7527fc700 1 -- 172.21.15.6:0/897313645 learned_addr learned my addr 172.21.15.6:0/897313645 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:38.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.419+0000 7fa752ffd700 1 --2- 172.21.15.6:0/897313645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75415ce50 0x7fa7540cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:38.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.419+0000 7fa751ffb700 1 -- 172.21.15.6:0/897313645 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237565253 0 0) 0x7fa754160060 con 0x7fa75415d220 2023-07-06T19:59:38.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.419+0000 7fa751ffb700 1 -- 172.21.15.6:0/897313645 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa73c0035b0 con 0x7fa75415d220 2023-07-06T19:59:38.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.419+0000 7fa751ffb700 1 -- 172.21.15.6:0/897313645 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261486086 0 0) 0x7fa7540cd800 con 0x7fa75406c4c0 2023-07-06T19:59:38.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.419+0000 7fa751ffb700 1 -- 172.21.15.6:0/897313645 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa754160060 con 0x7fa75406c4c0 2023-07-06T19:59:38.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.419+0000 7fa751ffb700 1 -- 172.21.15.6:0/897313645 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2518457328 0 0) 0x7fa73c0035b0 con 0x7fa75415d220 2023-07-06T19:59:38.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.419+0000 7fa751ffb700 1 -- 172.21.15.6:0/897313645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75415ce50 msgr2=0x7fa7540cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:38.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.419+0000 7fa751ffb700 1 --2- 172.21.15.6:0/897313645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75415ce50 0x7fa7540cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:38.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.419+0000 7fa751ffb700 1 -- 172.21.15.6:0/897313645 >> v1:172.21.15.40:6789/0 conn(0x7fa75406c4c0 legacy=0x7fa7540d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:38.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.419+0000 7fa751ffb700 1 -- 172.21.15.6:0/897313645 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa754160590 con 0x7fa75415d220 2023-07-06T19:59:38.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.419+0000 7fa751ffb700 1 -- 172.21.15.6:0/897313645 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7fa748001670 con 0x7fa75415d220 2023-07-06T19:59:38.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.419+0000 7fa751ffb700 1 -- 172.21.15.6:0/897313645 >> v1:172.21.15.6:6789/0 conn(0x7fa75415d220 legacy=0x7fa75406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:38.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.419+0000 7fa751ffb700 1 --2- 172.21.15.6:0/897313645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c003c30 0x7fa73c004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:38.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.419+0000 7fa751ffb700 1 --2- 172.21.15.6:0/897313645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75415ce50 0x7fa73c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:38.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.419+0000 7fa751ffb700 1 --2- 172.21.15.6:0/897313645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c004d90 0x7fa73c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:38.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.419+0000 7fa751ffb700 1 -- 172.21.15.6:0/897313645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7541602b0 con 0x7fa73c003c30 2023-07-06T19:59:38.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.419+0000 7fa751ffb700 1 -- 172.21.15.6:0/897313645 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c00baf0 con 0x7fa73c004d90 2023-07-06T19:59:38.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.419+0000 7fa751ffb700 1 -- 172.21.15.6:0/897313645 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c00bcb0 con 0x7fa75415ce50 2023-07-06T19:59:38.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.419+0000 7fa752ffd700 1 --2- 172.21.15.6:0/897313645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c003c30 0x7fa73c004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:38.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.419+0000 7fa7527fc700 1 --2- 172.21.15.6:0/897313645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75415ce50 0x7fa73c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:38.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.419+0000 7fa7537fe700 1 --2- 172.21.15.6:0/897313645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c004d90 0x7fa73c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:38.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.420+0000 7fa752ffd700 1 -- 172.21.15.6:0/897313645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75415ce50 msgr2=0x7fa73c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:38.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.420+0000 7fa752ffd700 1 --2- 172.21.15.6:0/897313645 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75415ce50 0x7fa73c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:38.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.420+0000 7fa752ffd700 1 -- 172.21.15.6:0/897313645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c004d90 msgr2=0x7fa73c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:38.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.420+0000 7fa752ffd700 1 --2- 172.21.15.6:0/897313645 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c004d90 0x7fa73c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:38.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.420+0000 7fa752ffd700 1 -- 172.21.15.6:0/897313645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c0035b0 con 0x7fa73c003c30 2023-07-06T19:59:38.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.420+0000 7fa752ffd700 1 --2- 172.21.15.6:0/897313645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c003c30 0x7fa73c004020 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa744009b60 tx=0x7fa73c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f8e5b7f7815071 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:38.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.420+0000 7fa751ffb700 1 -- 172.21.15.6:0/897313645 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74400e6c0 con 0x7fa73c003c30 2023-07-06T19:59:38.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.420+0000 7fa751ffb700 1 -- 172.21.15.6:0/897313645 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74400e820 con 0x7fa73c003c30 2023-07-06T19:59:38.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.420+0000 7fa751ffb700 1 -- 172.21.15.6:0/897313645 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74400eb90 con 0x7fa73c003c30 2023-07-06T19:59:38.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.420+0000 7fa759717700 1 -- 172.21.15.6:0/897313645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c003c30 msgr2=0x7fa73c004020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:38.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.420+0000 7fa759717700 1 --2- 172.21.15.6:0/897313645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa73c003c30 0x7fa73c004020 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa744009b60 tx=0x7fa73c005880 comp rx=0 tx=0).stop 2023-07-06T19:59:38.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.420+0000 7fa7537fe700 1 -- 172.21.15.6:0/897313645 reap_dead start 2023-07-06T19:59:38.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.421+0000 7fa759717700 1 -- 172.21.15.6:0/897313645 shutdown_connections 2023-07-06T19:59:38.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.421+0000 7fa759717700 1 -- 172.21.15.6:0/897313645 >> 172.21.15.6:0/897313645 conn(0x7fa7540d3880 msgr2=0x7fa7540cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:38.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.421+0000 7fa759717700 1 -- 172.21.15.6:0/897313645 shutdown_connections 2023-07-06T19:59:38.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.421+0000 7fa759717700 1 -- 172.21.15.6:0/897313645 wait complete. 2023-07-06T19:59:38.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.422+0000 7fa759717700 1 Processor -- start 2023-07-06T19:59:38.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.422+0000 7fa759717700 1 -- start start 2023-07-06T19:59:38.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.423+0000 7fa759717700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c003c30 0x7fa7540cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:38.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.423+0000 7fa759717700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7540c9e60 0x7fa7540ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:38.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.423+0000 7fa759717700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75415a600 0x7fa75415aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:38.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.423+0000 7fa759717700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7540cabd0 con 0x7fa7540c9e60 2023-07-06T19:59:38.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.423+0000 7fa759717700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7540caeb0 con 0x7fa73c003c30 2023-07-06T19:59:38.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.423+0000 7fa759717700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7540cb190 con 0x7fa75415a600 2023-07-06T19:59:38.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.423+0000 7fa7527fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7540c9e60 0x7fa7540ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:38.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.423+0000 7fa7527fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7540c9e60 0x7fa7540ca2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59684/0 (socket says 172.21.15.6:59684) 2023-07-06T19:59:38.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.423+0000 7fa752ffd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c003c30 0x7fa7540cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:38.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.423+0000 7fa7527fc700 1 -- 172.21.15.6:0/2709587828 learned_addr learned my addr 172.21.15.6:0/2709587828 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:38.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.423+0000 7fa7537fe700 1 --2- 172.21.15.6:0/2709587828 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75415a600 0x7fa75415aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:38.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.423+0000 7fa752ffd700 1 -- 172.21.15.6:0/2709587828 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75415a600 msgr2=0x7fa75415aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:38.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.423+0000 7fa752ffd700 1 --2- 172.21.15.6:0/2709587828 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75415a600 0x7fa75415aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:38.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.423+0000 7fa752ffd700 1 -- 172.21.15.6:0/2709587828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7540c9e60 msgr2=0x7fa7540ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.423+0000 7fa752ffd700 1 --2- 172.21.15.6:0/2709587828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7540c9e60 0x7fa7540ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.423+0000 7fa752ffd700 1 -- 172.21.15.6:0/2709587828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa754160f10 con 0x7fa73c003c30 2023-07-06T19:59:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.423+0000 7fa7527fc700 1 --2- 172.21.15.6:0/2709587828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7540c9e60 0x7fa7540ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:59:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.423+0000 7fa752ffd700 1 --2- 172.21.15.6:0/2709587828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c003c30 0x7fa7540cc590 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa744019000 tx=0x7fa7440047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.424+0000 7fa73b7fe700 1 -- 172.21.15.6:0/2709587828 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74400e6c0 con 0x7fa73c003c30 2023-07-06T19:59:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.424+0000 7fa73b7fe700 1 -- 172.21.15.6:0/2709587828 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa744003ad0 con 0x7fa73c003c30 2023-07-06T19:59:38.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.424+0000 7fa759717700 1 -- 172.21.15.6:0/2709587828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7540cb470 con 0x7fa73c003c30 2023-07-06T19:59:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.424+0000 7fa73b7fe700 1 -- 172.21.15.6:0/2709587828 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa744003e80 con 0x7fa73c003c30 2023-07-06T19:59:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.424+0000 7fa759717700 1 -- 172.21.15.6:0/2709587828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7540ccad0 con 0x7fa73c003c30 2023-07-06T19:59:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.425+0000 7fa759717700 1 -- 172.21.15.6:0/2709587828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7540cb7e0 con 0x7fa73c003c30 2023-07-06T19:59:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.425+0000 7fa73b7fe700 1 -- 172.21.15.6:0/2709587828 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa744013470 con 0x7fa73c003c30 2023-07-06T19:59:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.426+0000 7fa73b7fe700 1 --2- 172.21.15.6:0/2709587828 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa74006ace0 0x7fa74006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.426+0000 7fa73b7fe700 1 -- 172.21.15.6:0/2709587828 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa74408af90 con 0x7fa73c003c30 2023-07-06T19:59:38.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.426+0000 7fa7527fc700 1 --2- 172.21.15.6:0/2709587828 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa74006ace0 0x7fa74006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:38.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.426+0000 7fa7527fc700 1 --2- 172.21.15.6:0/2709587828 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa74006ace0 0x7fa74006d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa7540b6320 tx=0x7fa748001e10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:38.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.431+0000 7fa73b7fe700 1 -- 172.21.15.6:0/2709587828 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa7440bd310 con 0x7fa73c003c30 2023-07-06T19:59:38.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.675+0000 7fa759717700 1 -- 172.21.15.6:0/2709587828 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa7540b1f30 con 0x7fa73c003c30 2023-07-06T19:59:38.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.676+0000 7fa73b7fe700 1 -- 172.21.15.6:0/2709587828 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fa744055e40 con 0x7fa73c003c30 2023-07-06T19:59:38.678 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-06T19:59:38.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.678+0000 7fa759717700 1 -- 172.21.15.6:0/2709587828 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa74006ace0 msgr2=0x7fa74006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:38.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.678+0000 7fa759717700 1 --2- 172.21.15.6:0/2709587828 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa74006ace0 0x7fa74006d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa7540b6320 tx=0x7fa748001e10 comp rx=0 tx=0).stop 2023-07-06T19:59:38.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.678+0000 7fa759717700 1 -- 172.21.15.6:0/2709587828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c003c30 msgr2=0x7fa7540cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:38.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.678+0000 7fa759717700 1 --2- 172.21.15.6:0/2709587828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c003c30 0x7fa7540cc590 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa744019000 tx=0x7fa7440047c0 comp rx=0 tx=0).stop 2023-07-06T19:59:38.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.678+0000 7fa759717700 1 -- 172.21.15.6:0/2709587828 shutdown_connections 2023-07-06T19:59:38.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.678+0000 7fa759717700 1 --2- 172.21.15.6:0/2709587828 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa74006ace0 0x7fa74006d190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:38.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.678+0000 7fa759717700 1 --2- 172.21.15.6:0/2709587828 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa75415a600 0x7fa75415aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:38.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.678+0000 7fa759717700 1 --2- 172.21.15.6:0/2709587828 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa73c003c30 0x7fa7540cc590 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:38.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.678+0000 7fa759717700 1 --2- 172.21.15.6:0/2709587828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7540c9e60 0x7fa7540ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:38.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.678+0000 7fa759717700 1 -- 172.21.15.6:0/2709587828 >> 172.21.15.6:0/2709587828 conn(0x7fa7540d3880 msgr2=0x7fa75415f600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:38.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.678+0000 7fa759717700 1 -- 172.21.15.6:0/2709587828 shutdown_connections 2023-07-06T19:59:38.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:38.678+0000 7fa759717700 1 -- 172.21.15.6:0/2709587828 wait complete. 2023-07-06T19:59:38.692 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-06T19:59:38.693 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T19:59:38.693 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2023-07-06T19:59:38.693 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-07-06T19:59:38.694 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-06T19:59:38.694 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-06T19:59:38.694 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-06T19:59:38.694 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T19:59:38.694 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-07-06T19:59:38.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:38.695 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2023-07-06T19:59:38.716 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T19:59:38.717 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T19:59:38.717 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T19:59:38.718 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:38.718 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-07-06T19:59:38.718 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:38.718 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T19:59:38.719 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2023-07-06T19:59:38.719 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T19:59:38.719 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2023-07-06T19:59:38.719 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T19:59:38.721 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2023-07-06T19:59:38.722 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-06T19:59:38.722 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42343sec preferred_lft 42343sec 2023-07-06T19:59:38.722 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link 2023-07-06T19:59:38.722 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:38.722 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T19:59:38.722 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2023-07-06T19:59:38.722 INFO:teuthology.orchestra.run.smithi040.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T19:59:38.723 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 16:70:1d:53:fd:d5 brd ff:ff:ff:ff:ff:ff 2023-07-06T19:59:38.723 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-06T19:59:38.723 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:38.723 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::8c8:20ff:fe62:7487/64 scope link 2023-07-06T19:59:38.723 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:38.723 INFO:teuthology.orchestra.run.smithi040.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T19:59:38.723 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 16:70:1d:53:fd:d5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-06T19:59:38.723 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::1470:1dff:fe53:fdd5/64 scope link 2023-07-06T19:59:38.724 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:38.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:38.724 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T19:59:38.786 INFO:teuthology.orchestra.run.smithi040.stdout:1 2023-07-06T19:59:38.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:38.788 DEBUG:teuthology.orchestra.run.smithi040:> route 2023-07-06T19:59:38.849 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2023-07-06T19:59:38.850 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T19:59:38.850 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-06T19:59:38.850 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-06T19:59:38.850 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T19:59:38.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:38.851 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-07-06T19:59:38.851 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-07-06T19:59:38.851 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-06T19:59:38.851 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-06T19:59:38.853 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-06T19:59:38.854 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-07-06T19:59:38.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:38.964 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-07-06T19:59:38.989 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-06T19:59:38.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:38.990 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2023-07-06T19:59:39.047 INFO:teuthology.orchestra.run.smithi040.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-07-06T19:59:39.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:39.049 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-07-06T19:59:39.049 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-07-06T19:59:39.050 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-06T19:59:39.050 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-07-06T19:59:39.051 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-07-06T19:59:39.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:39.145 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-06T19:59:39.180 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T19:59:39.181 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T19:59:39.181 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T19:59:39.181 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:39.181 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-07-06T19:59:39.181 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:39.182 INFO:teuthology.orchestra.run.smithi040.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T19:59:39.182 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether ee:58:33:87:04:90 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-06T19:59:39.182 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-06T19:59:39.182 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:39.182 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec58:33ff:fe87:490/64 scope link tentative 2023-07-06T19:59:39.186 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:39.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:39.195 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-06T19:59:39.272 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T19:59:39.273 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T19:59:39.273 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T19:59:39.274 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:39.274 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2023-07-06T19:59:39.275 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:39.275 INFO:teuthology.orchestra.run.smithi040.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T19:59:39.275 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether ee:58:33:87:04:90 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-06T19:59:39.275 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-06T19:59:39.275 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:39.275 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec58:33ff:fe87:490/64 scope link 2023-07-06T19:59:39.275 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2023-07-06T19:59:39.284 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-07-06T19:59:39.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:39.285 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-07-06T19:59:39.285 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-07-06T19:59:39.285 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-07-06T19:59:39.286 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-06T19:59:39.286 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-07-06T19:59:39.286 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-07-06T19:59:39.286 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-07-06T19:59:39.287 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-07-06T19:59:39.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:39.542 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec bash -c ' 2023-07-06T19:59:39.543 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2023-07-06T19:59:39.543 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.1 up 2023-07-06T19:59:39.543 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.1 master ceph-brx 2023-07-06T19:59:39.543 DEBUG:teuthology.orchestra.run.smithi040:> ') 2023-07-06T19:59:39.678 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T19:59:39.678 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-07-06T19:59:39.701 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-07-06T19:59:39.701 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T19:59:39.702 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-07-06T19:59:39.758 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-06T19:59:39.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:39.759 DEBUG:teuthology.orchestra.run.smithi040:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-06T19:59:39.848 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-06T19:59:39.848 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-06T19:59:39.848 INFO:teuthology.orchestra.run.smithi040.stdout:invalid new device string format 2023-07-06T19:59:39.855 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-06T19:59:39.855 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-06T19:59:39.855 INFO:teuthology.orchestra.run.smithi040.stdout:invalid new device string format 2023-07-06T19:59:39.856 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.40:3300,172.21.15.40:3301" 2023-07-06T19:59:39.856 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-06T19:59:39.921 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-07-06T19:59:39.921 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-07-06T19:59:39.922 INFO:teuthology.orchestra.run.smithi040.stdout:invalid new device string format 2023-07-06T19:59:39.922 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.40:3300,172.21.15.40:3301" 2023-07-06T19:59:39.925 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-06T19:59:39.926 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.40:6789,172.21.15.40:6790" 2023-07-06T19:59:39.926 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.40:6789,172.21.15.40:6790:/ 2023-07-06T19:59:39.927 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=59b158c6-5d9d-4877-b4e7-a584e294fb2e" will pass to kernel 2023-07-06T19:59:39.931 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T19:59:39.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:39.932 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-07-06T19:59:39.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:39.968 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T19:59:40.045 INFO:teuthology.orchestra.run.smithi040.stdout:client4899 2023-07-06T19:59:40.046 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:59:40.046 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T19:59:40.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:40.108 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T19:59:40.181 INFO:teuthology.orchestra.run.smithi040.stdout:client4899 2023-07-06T19:59:40.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:40.182 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T19:59:40.254 INFO:teuthology.orchestra.run.smithi040.stdout:client4899 2023-07-06T19:59:40.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:40.256 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/59b158c6-5d9d-4877-b4e7-a584e294fb2e.client4899/status') 2023-07-06T19:59:40.339 INFO:teuthology.orchestra.run.smithi040.stdout:instance: client.4899 (3)172.21.15.40:0/477737314 2023-07-06T19:59:40.339 INFO:teuthology.orchestra.run.smithi040.stdout:blocklisted: false 2023-07-06T19:59:40.341 INFO:teuthology.orchestra.run.smithi040.stderr:0+1 records in 2023-07-06T19:59:40.342 INFO:teuthology.orchestra.run.smithi040.stderr:0+1 records out 2023-07-06T19:59:40.343 INFO:teuthology.orchestra.run.smithi040.stderr:69 bytes copied, 2.3744e-05 s, 2.9 MB/s 2023-07-06T19:59:40.343 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-06T19:59:40.448 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T19:59:40.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.586+0000 7f50dd26b700 1 Processor -- start 2023-07-06T19:59:40.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.586+0000 7f50dd26b700 1 -- start start 2023-07-06T19:59:40.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.587+0000 7f50dd26b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50d80cccf0 0x7f50d80ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:40.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.587+0000 7f50dd26b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d80b5850 con 0x7f50d80cc8a0 2023-07-06T19:59:40.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.587+0000 7f50dd26b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d80b43a0 con 0x7f50d815c700 2023-07-06T19:59:40.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.587+0000 7f50dd26b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50d80b6490 con 0x7f50d80cccf0 2023-07-06T19:59:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.587+0000 7f50d77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50d80cccf0 0x7f50d80ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.587+0000 7f50d77fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50d80cccf0 0x7f50d80ced70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59694/0 (socket says 172.21.15.6:59694) 2023-07-06T19:59:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.587+0000 7f50d77fe700 1 -- 172.21.15.6:0/1154386337 learned_addr learned my addr 172.21.15.6:0/1154386337 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:40.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.587+0000 7f50d77fe700 1 -- 172.21.15.6:0/1154386337 >> v1:172.21.15.40:6789/0 conn(0x7f50d815c700 legacy=0x7f50d80b38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.587+0000 7f50d77fe700 1 -- 172.21.15.6:0/1154386337 >> v1:172.21.15.6:6789/0 conn(0x7f50d80cc8a0 legacy=0x7f50d80ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.587+0000 7f50d77fe700 1 -- 172.21.15.6:0/1154386337 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d80b5af0 con 0x7f50d80cccf0 2023-07-06T19:59:40.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.587+0000 7f50d5ffb700 1 -- 172.21.15.6:0/1154386337 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 128979282 0 0) 0x7f50d80b5850 con 0x7f50d80cc8a0 2023-07-06T19:59:40.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.588+0000 7f50d77fe700 1 --2- 172.21.15.6:0/1154386337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50d80cccf0 0x7f50d80ced70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009e50 tx=0x7f50d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a814943d1e549a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:40.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.588+0000 7f50d5ffb700 1 -- 172.21.15.6:0/1154386337 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d000e070 con 0x7f50d80cccf0 2023-07-06T19:59:40.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.588+0000 7f50d5ffb700 1 -- 172.21.15.6:0/1154386337 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d0003a20 con 0x7f50d80cccf0 2023-07-06T19:59:40.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.588+0000 7f50d5ffb700 1 -- 172.21.15.6:0/1154386337 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d0003dd0 con 0x7f50d80cccf0 2023-07-06T19:59:40.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.588+0000 7f50dd26b700 1 -- 172.21.15.6:0/1154386337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50d80cccf0 msgr2=0x7f50d80ced70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:40.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.588+0000 7f50dd26b700 1 --2- 172.21.15.6:0/1154386337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50d80cccf0 0x7f50d80ced70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f50d0009e50 tx=0x7f50d000b330 comp rx=0 tx=0).stop 2023-07-06T19:59:40.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.588+0000 7f50dd26b700 1 -- 172.21.15.6:0/1154386337 shutdown_connections 2023-07-06T19:59:40.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.588+0000 7f50dd26b700 1 --2- 172.21.15.6:0/1154386337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50d80cccf0 0x7f50d80ced70 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:40.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.588+0000 7f50dd26b700 1 -- 172.21.15.6:0/1154386337 >> 172.21.15.6:0/1154386337 conn(0x7f50d80ce1a0 msgr2=0x7f50d80d0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:40.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.588+0000 7f50dd26b700 1 -- 172.21.15.6:0/1154386337 shutdown_connections 2023-07-06T19:59:40.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.588+0000 7f50dd26b700 1 -- 172.21.15.6:0/1154386337 wait complete. 2023-07-06T19:59:40.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.590+0000 7f50dd26b700 1 Processor -- start 2023-07-06T19:59:40.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.590+0000 7f50dd26b700 1 -- start start 2023-07-06T19:59:40.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.591+0000 7f50dd26b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50d80cc8a0 0x7f50d806f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:40.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.591+0000 7f50dd26b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50d80cccf0 0x7f50d80ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:40.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.591+0000 7f50dd26b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50d815c700 0x7f50d80ac950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:40.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.591+0000 7f50dd26b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d815b420 con 0x7f50d80cc8a0 2023-07-06T19:59:40.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.591+0000 7f50dd26b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d80abfa0 con 0x7f50d80cccf0 2023-07-06T19:59:40.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.591+0000 7f50dd26b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d80ae690 con 0x7f50d815c700 2023-07-06T19:59:40.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.591+0000 7f50d6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50d80cc8a0 0x7f50d806f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:40.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.591+0000 7f50d6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50d80cc8a0 0x7f50d806f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59696/0 (socket says 172.21.15.6:59696) 2023-07-06T19:59:40.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.591+0000 7f50d6ffd700 1 -- 172.21.15.6:0/1230072784 learned_addr learned my addr 172.21.15.6:0/1230072784 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:40.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.592+0000 7f50d67fc700 1 --2- 172.21.15.6:0/1230072784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50d80cccf0 0x7f50d80ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:40.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.592+0000 7f50d77fe700 1 --2- 172.21.15.6:0/1230072784 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50d815c700 0x7f50d80ac950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:40.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.592+0000 7f50d6ffd700 1 -- 172.21.15.6:0/1230072784 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50d815c700 msgr2=0x7f50d80ac950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:40.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.592+0000 7f50d6ffd700 1 --2- 172.21.15.6:0/1230072784 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50d815c700 0x7f50d80ac950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:40.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.592+0000 7f50d6ffd700 1 -- 172.21.15.6:0/1230072784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50d80cccf0 msgr2=0x7f50d80ab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:40.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.592+0000 7f50d6ffd700 1 --2- 172.21.15.6:0/1230072784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50d80cccf0 0x7f50d80ab8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:40.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.592+0000 7f50d6ffd700 1 -- 172.21.15.6:0/1230072784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d0009b30 con 0x7f50d80cc8a0 2023-07-06T19:59:40.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.592+0000 7f50d67fc700 1 --2- 172.21.15.6:0/1230072784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50d80cccf0 0x7f50d80ab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:40.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.592+0000 7f50d6ffd700 1 --2- 172.21.15.6:0/1230072784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50d80cc8a0 0x7f50d806f2b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00c4d0 tx=0x7f50cc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:40.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.592+0000 7f50bf7fe700 1 -- 172.21.15.6:0/1230072784 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc011790 con 0x7f50d80cc8a0 2023-07-06T19:59:40.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.592+0000 7f50bf7fe700 1 -- 172.21.15.6:0/1230072784 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50cc0118f0 con 0x7f50d80cc8a0 2023-07-06T19:59:40.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.592+0000 7f50bf7fe700 1 -- 172.21.15.6:0/1230072784 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc011ca0 con 0x7f50d80cc8a0 2023-07-06T19:59:40.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.592+0000 7f50dd26b700 1 -- 172.21.15.6:0/1230072784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d80ae970 con 0x7f50d80cc8a0 2023-07-06T19:59:40.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.592+0000 7f50dd26b700 1 -- 172.21.15.6:0/1230072784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d80aef30 con 0x7f50d80cc8a0 2023-07-06T19:59:40.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.593+0000 7f50dd26b700 1 -- 172.21.15.6:0/1230072784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d80d16d0 con 0x7f50d80cc8a0 2023-07-06T19:59:40.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.594+0000 7f50bf7fe700 1 -- 172.21.15.6:0/1230072784 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f50cc01c460 con 0x7f50d80cc8a0 2023-07-06T19:59:40.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.594+0000 7f50bf7fe700 1 --2- 172.21.15.6:0/1230072784 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f50c406ace0 0x7f50c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:40.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.594+0000 7f50bf7fe700 1 -- 172.21.15.6:0/1230072784 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f50cc089660 con 0x7f50d80cc8a0 2023-07-06T19:59:40.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.594+0000 7f50d67fc700 1 --2- 172.21.15.6:0/1230072784 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f50c406ace0 0x7f50c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:40.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.594+0000 7f50d67fc700 1 --2- 172.21.15.6:0/1230072784 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f50c406ace0 0x7f50c406d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f50d80b1670 tx=0x7f50c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:40.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.599+0000 7f50bf7fe700 1 -- 172.21.15.6:0/1230072784 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f50cc0543e0 con 0x7f50d80cc8a0 2023-07-06T19:59:40.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.799+0000 7f50dd26b700 1 -- 172.21.15.6:0/1230072784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50d80b3ec0 con 0x7f50d80cc8a0 2023-07-06T19:59:40.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.800+0000 7f50bf7fe700 1 -- 172.21.15.6:0/1230072784 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20059 (secure 0 0 0) 0x7f50cc057a00 con 0x7f50d80cc8a0 2023-07-06T19:59:40.803 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:40.804 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":29,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:59:33.917851+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T19:58:51.062712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T19:58:52.130350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T19:58:55.785128+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:59:40.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.802+0000 7f50dd26b700 1 -- 172.21.15.6:0/1230072784 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f50c406ace0 msgr2=0x7f50c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:40.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.802+0000 7f50dd26b700 1 --2- 172.21.15.6:0/1230072784 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f50c406ace0 0x7f50c406d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f50d80b1670 tx=0x7f50c8009040 comp rx=0 tx=0).stop 2023-07-06T19:59:40.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.802+0000 7f50dd26b700 1 -- 172.21.15.6:0/1230072784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50d80cc8a0 msgr2=0x7f50d806f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:40.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.802+0000 7f50dd26b700 1 --2- 172.21.15.6:0/1230072784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50d80cc8a0 0x7f50d806f2b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00c4d0 tx=0x7f50cc00c890 comp rx=0 tx=0).stop 2023-07-06T19:59:40.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.802+0000 7f50dd26b700 1 -- 172.21.15.6:0/1230072784 shutdown_connections 2023-07-06T19:59:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.802+0000 7f50dd26b700 1 --2- 172.21.15.6:0/1230072784 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f50c406ace0 0x7f50c406d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.802+0000 7f50dd26b700 1 --2- 172.21.15.6:0/1230072784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50d80cc8a0 0x7f50d806f2b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.802+0000 7f50dd26b700 1 --2- 172.21.15.6:0/1230072784 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50d815c700 0x7f50d80ac950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.802+0000 7f50dd26b700 1 --2- 172.21.15.6:0/1230072784 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50d80cccf0 0x7f50d80ab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.802+0000 7f50dd26b700 1 -- 172.21.15.6:0/1230072784 >> 172.21.15.6:0/1230072784 conn(0x7f50d80ce1a0 msgr2=0x7f50d80c7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.802+0000 7f50dd26b700 1 -- 172.21.15.6:0/1230072784 shutdown_connections 2023-07-06T19:59:40.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.802+0000 7f50dd26b700 1 -- 172.21.15.6:0/1230072784 wait complete. 2023-07-06T19:59:40.817 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T19:58:38.767727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T19:58:45.759808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T19:58:51.062712+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T19:58:52.130350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T19:58:55.785128+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T19:59:40.818 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T19:59:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.946+0000 7f0ac85f6700 1 Processor -- start 2023-07-06T19:59:40.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.946+0000 7f0ac85f6700 1 -- start start 2023-07-06T19:59:40.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.947+0000 7f0ac85f6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac00d15e0 0x7f0ac006e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:40.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.947+0000 7f0ac85f6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0ac00ce860 0x7f0ac00cece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:40.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.947+0000 7f0ac85f6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac00cd300 con 0x7f0ac015a520 2023-07-06T19:59:40.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.947+0000 7f0ac85f6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac00b0290 con 0x7f0ac00ce860 2023-07-06T19:59:40.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.947+0000 7f0ac85f6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac00ccd80 con 0x7f0ac00d15e0 2023-07-06T19:59:40.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.947+0000 7f0ac6392700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0ac015a520 0x7f0ac006dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60912/0 (socket says 172.21.15.6:60912) 2023-07-06T19:59:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.947+0000 7f0ac6392700 1 -- 172.21.15.6:0/449394622 learned_addr learned my addr 172.21.15.6:0/449394622 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.947+0000 7f0ac6b93700 1 --2- 172.21.15.6:0/449394622 >> v2:172.21.15.6:3300/0 conn(0x7f0ac00ce860 0x7f0ac00cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.947+0000 7f0ac5b91700 1 --2- 172.21.15.6:0/449394622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac00d15e0 0x7f0ac006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.947+0000 7f0ac6b93700 1 -- 172.21.15.6:0/449394622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac00d15e0 msgr2=0x7f0ac006e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.947+0000 7f0ac6b93700 1 --2- 172.21.15.6:0/449394622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac00d15e0 0x7f0ac006e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:40.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.947+0000 7f0ac6b93700 1 -- 172.21.15.6:0/449394622 >> v1:172.21.15.6:6789/0 conn(0x7f0ac015a520 legacy=0x7f0ac006dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.948+0000 7f0ac6b93700 1 -- 172.21.15.6:0/449394622 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac00cd020 con 0x7f0ac00ce860 2023-07-06T19:59:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.948+0000 7f0ac6b93700 1 --2- 172.21.15.6:0/449394622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ac00ce860 0x7f0ac00cece0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8009d90 tx=0x7f0ab800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=914d640a1a92697a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.949+0000 7f0ac5390700 1 -- 172.21.15.6:0/449394622 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab800e070 con 0x7f0ac00ce860 2023-07-06T19:59:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.949+0000 7f0ac5390700 1 -- 172.21.15.6:0/449394622 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab800bb20 con 0x7f0ac00ce860 2023-07-06T19:59:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.949+0000 7f0ac5390700 1 -- 172.21.15.6:0/449394622 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8012430 con 0x7f0ac00ce860 2023-07-06T19:59:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.950+0000 7f0ac85f6700 1 -- 172.21.15.6:0/449394622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ac00ce860 msgr2=0x7f0ac00cece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:40.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.950+0000 7f0ac85f6700 1 --2- 172.21.15.6:0/449394622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ac00ce860 0x7f0ac00cece0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8009d90 tx=0x7f0ab800b330 comp rx=0 tx=0).stop 2023-07-06T19:59:40.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.950+0000 7f0ac85f6700 1 -- 172.21.15.6:0/449394622 shutdown_connections 2023-07-06T19:59:40.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.950+0000 7f0ac85f6700 1 --2- 172.21.15.6:0/449394622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ac00ce860 0x7f0ac00cece0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:40.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.950+0000 7f0ac85f6700 1 --2- 172.21.15.6:0/449394622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac00d15e0 0x7f0ac006e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.950+0000 7f0ac85f6700 1 -- 172.21.15.6:0/449394622 >> 172.21.15.6:0/449394622 conn(0x7f0ac00ce120 msgr2=0x7f0ac00d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.950+0000 7f0ac85f6700 1 -- 172.21.15.6:0/449394622 shutdown_connections 2023-07-06T19:59:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.950+0000 7f0ac85f6700 1 -- 172.21.15.6:0/449394622 wait complete. 2023-07-06T19:59:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.952+0000 7f0ac85f6700 1 Processor -- start 2023-07-06T19:59:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.952+0000 7f0ac85f6700 1 -- start start 2023-07-06T19:59:40.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.952+0000 7f0ac85f6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ac00ce860 0x7f0ac0152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:40.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.953+0000 7f0ac85f6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac00d15e0 0x7f0ac00b1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:40.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.953+0000 7f0ac85f6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac015a520 0x7f0ac00b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:40.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.953+0000 7f0ac85f6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac006d0a0 con 0x7f0ac00ce860 2023-07-06T19:59:40.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.953+0000 7f0ac85f6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac006d380 con 0x7f0ac015a520 2023-07-06T19:59:40.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.953+0000 7f0ac85f6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac006d660 con 0x7f0ac00d15e0 2023-07-06T19:59:40.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.953+0000 7f0ac6392700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ac00ce860 0x7f0ac0152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:40.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.953+0000 7f0ac6392700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ac00ce860 0x7f0ac0152ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59710/0 (socket says 172.21.15.6:59710) 2023-07-06T19:59:40.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.953+0000 7f0ac6392700 1 -- 172.21.15.6:0/159391877 learned_addr learned my addr 172.21.15.6:0/159391877 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:40.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.953+0000 7f0ac5b91700 1 --2- 172.21.15.6:0/159391877 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac00d15e0 0x7f0ac00b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:40.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.953+0000 7f0ac6b93700 1 --2- 172.21.15.6:0/159391877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac015a520 0x7f0ac00b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:40.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.953+0000 7f0ac6392700 1 -- 172.21.15.6:0/159391877 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac00d15e0 msgr2=0x7f0ac00b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:40.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.953+0000 7f0ac6392700 1 --2- 172.21.15.6:0/159391877 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac00d15e0 0x7f0ac00b1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:40.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.953+0000 7f0ac6392700 1 -- 172.21.15.6:0/159391877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac015a520 msgr2=0x7f0ac00b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:40.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.953+0000 7f0ac6392700 1 --2- 172.21.15.6:0/159391877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac015a520 0x7f0ac00b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:40.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.953+0000 7f0ac6392700 1 -- 172.21.15.6:0/159391877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab8009a70 con 0x7f0ac00ce860 2023-07-06T19:59:40.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.953+0000 7f0ac6392700 1 --2- 172.21.15.6:0/159391877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ac00ce860 0x7f0ac0152ea0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0abc00c520 tx=0x7f0abc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:40.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.953+0000 7f0ab6ffd700 1 -- 172.21.15.6:0/159391877 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc005d70 con 0x7f0ac00ce860 2023-07-06T19:59:40.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.953+0000 7f0ab6ffd700 1 -- 172.21.15.6:0/159391877 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc0070d0 con 0x7f0ac00ce860 2023-07-06T19:59:40.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.953+0000 7f0ac85f6700 1 -- 172.21.15.6:0/159391877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac006d940 con 0x7f0ac00ce860 2023-07-06T19:59:40.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.953+0000 7f0ab6ffd700 1 -- 172.21.15.6:0/159391877 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc007440 con 0x7f0ac00ce860 2023-07-06T19:59:40.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.953+0000 7f0ac85f6700 1 -- 172.21.15.6:0/159391877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac01533e0 con 0x7f0ac00ce860 2023-07-06T19:59:40.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.955+0000 7f0ac85f6700 1 -- 172.21.15.6:0/159391877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac004eb90 con 0x7f0ac00ce860 2023-07-06T19:59:40.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.955+0000 7f0ab6ffd700 1 -- 172.21.15.6:0/159391877 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0abc0075a0 con 0x7f0ac00ce860 2023-07-06T19:59:40.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.955+0000 7f0ab6ffd700 1 --2- 172.21.15.6:0/159391877 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0aa406ace0 0x7f0aa406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:40.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.956+0000 7f0ab6ffd700 1 -- 172.21.15.6:0/159391877 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0abc088ae0 con 0x7f0ac00ce860 2023-07-06T19:59:40.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.956+0000 7f0ac5b91700 1 --2- 172.21.15.6:0/159391877 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0aa406ace0 0x7f0aa406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:40.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.956+0000 7f0ac5b91700 1 --2- 172.21.15.6:0/159391877 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0aa406ace0 0x7f0aa406d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0ac01f6b10 tx=0x7f0ab0009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:40.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:40.960+0000 7f0ab6ffd700 1 -- 172.21.15.6:0/159391877 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0abc053890 con 0x7f0ac00ce860 2023-07-06T19:59:41.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.158+0000 7f0ac85f6700 1 -- 172.21.15.6:0/159391877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0ac00d13c0 con 0x7f0ac00ce860 2023-07-06T19:59:41.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.158+0000 7f0ab6ffd700 1 -- 172.21.15.6:0/159391877 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0abc056eb0 con 0x7f0ac00ce860 2023-07-06T19:59:41.161 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-06T19:59:41.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.160+0000 7f0ac85f6700 1 -- 172.21.15.6:0/159391877 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0aa406ace0 msgr2=0x7f0aa406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:41.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.160+0000 7f0ac85f6700 1 --2- 172.21.15.6:0/159391877 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0aa406ace0 0x7f0aa406d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0ac01f6b10 tx=0x7f0ab0009210 comp rx=0 tx=0).stop 2023-07-06T19:59:41.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.160+0000 7f0ac85f6700 1 -- 172.21.15.6:0/159391877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ac00ce860 msgr2=0x7f0ac0152ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:41.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.160+0000 7f0ac85f6700 1 --2- 172.21.15.6:0/159391877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ac00ce860 0x7f0ac0152ea0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0abc00c520 tx=0x7f0abc00c830 comp rx=0 tx=0).stop 2023-07-06T19:59:41.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.160+0000 7f0ac85f6700 1 -- 172.21.15.6:0/159391877 shutdown_connections 2023-07-06T19:59:41.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.160+0000 7f0ac85f6700 1 --2- 172.21.15.6:0/159391877 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0aa406ace0 0x7f0aa406d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.160+0000 7f0ac85f6700 1 --2- 172.21.15.6:0/159391877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ac00ce860 0x7f0ac0152ea0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.160+0000 7f0ac85f6700 1 --2- 172.21.15.6:0/159391877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ac015a520 0x7f0ac00b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.160+0000 7f0ac85f6700 1 --2- 172.21.15.6:0/159391877 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0ac00d15e0 0x7f0ac00b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.160+0000 7f0ac85f6700 1 -- 172.21.15.6:0/159391877 >> 172.21.15.6:0/159391877 conn(0x7f0ac00ce120 msgr2=0x7f0ac00cf550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:41.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.160+0000 7f0ac85f6700 1 -- 172.21.15.6:0/159391877 shutdown_connections 2023-07-06T19:59:41.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.160+0000 7f0ac85f6700 1 -- 172.21.15.6:0/159391877 wait complete. 2023-07-06T19:59:41.174 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T19:59:41.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.312+0000 7f3362d99700 1 Processor -- start 2023-07-06T19:59:41.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.312+0000 7f3362d99700 1 -- start start 2023-07-06T19:59:41.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.313+0000 7f3362d99700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f335c1602c0 0x7f335c0b5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:41.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.313+0000 7f3362d99700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f335c0b58b0 0x7f335c15d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:41.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.313+0000 7f3362d99700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f335c0b5e30 con 0x7f335c0b3c60 2023-07-06T19:59:41.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.313+0000 7f3362d99700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f335c15d960 con 0x7f335c0b58b0 2023-07-06T19:59:41.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.313+0000 7f3362d99700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335c0b6110 con 0x7f335c1602c0 2023-07-06T19:59:41.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.313+0000 7f3361336700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f335c0b58b0 0x7f335c15d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:41.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.313+0000 7f3361336700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f335c0b58b0 0x7f335c15d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59722/0 (socket says 172.21.15.6:59722) 2023-07-06T19:59:41.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.313+0000 7f335bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f335c0b3c60 0x7f335c0cebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60928/0 (socket says 172.21.15.6:60928) 2023-07-06T19:59:41.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.313+0000 7f3361336700 1 -- 172.21.15.6:0/2934826629 learned_addr learned my addr 172.21.15.6:0/2934826629 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:41.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.314+0000 7f3360b35700 1 --2- 172.21.15.6:0/2934826629 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f335c1602c0 0x7f335c0b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:41.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.314+0000 7f3361336700 1 -- 172.21.15.6:0/2934826629 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f335c1602c0 msgr2=0x7f335c0b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:41.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.314+0000 7f3361336700 1 --2- 172.21.15.6:0/2934826629 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f335c1602c0 0x7f335c0b5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.314+0000 7f3361336700 1 -- 172.21.15.6:0/2934826629 >> v1:172.21.15.6:6789/0 conn(0x7f335c0b3c60 legacy=0x7f335c0cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:41.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.314+0000 7f335b7fe700 1 -- 172.21.15.6:0/2934826629 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226583562 0 0) 0x7f335c0b5e30 con 0x7f335c0b3c60 2023-07-06T19:59:41.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.314+0000 7f3361336700 1 -- 172.21.15.6:0/2934826629 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c0b63f0 con 0x7f335c0b58b0 2023-07-06T19:59:41.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.314+0000 7f3361336700 1 --2- 172.21.15.6:0/2934826629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f335c0b58b0 0x7f335c15d420 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3354009e50 tx=0x7f335400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2160aba21f58c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:41.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.314+0000 7f335b7fe700 1 -- 172.21.15.6:0/2934826629 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335400e070 con 0x7f335c0b58b0 2023-07-06T19:59:41.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.314+0000 7f335b7fe700 1 -- 172.21.15.6:0/2934826629 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335400b9c0 con 0x7f335c0b58b0 2023-07-06T19:59:41.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.314+0000 7f335b7fe700 1 -- 172.21.15.6:0/2934826629 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335400bd70 con 0x7f335c0b58b0 2023-07-06T19:59:41.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.315+0000 7f3362d99700 1 -- 172.21.15.6:0/2934826629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f335c0b58b0 msgr2=0x7f335c15d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:41.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.315+0000 7f3362d99700 1 --2- 172.21.15.6:0/2934826629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f335c0b58b0 0x7f335c15d420 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3354009e50 tx=0x7f335400b330 comp rx=0 tx=0).stop 2023-07-06T19:59:41.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.315+0000 7f3362d99700 1 -- 172.21.15.6:0/2934826629 shutdown_connections 2023-07-06T19:59:41.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.315+0000 7f3362d99700 1 --2- 172.21.15.6:0/2934826629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f335c0b58b0 0x7f335c15d420 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.315+0000 7f3362d99700 1 --2- 172.21.15.6:0/2934826629 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f335c1602c0 0x7f335c0b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.315+0000 7f3362d99700 1 -- 172.21.15.6:0/2934826629 >> 172.21.15.6:0/2934826629 conn(0x7f335c0ce120 msgr2=0x7f335c0d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.315+0000 7f3362d99700 1 -- 172.21.15.6:0/2934826629 shutdown_connections 2023-07-06T19:59:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.315+0000 7f3362d99700 1 -- 172.21.15.6:0/2934826629 wait complete. 2023-07-06T19:59:41.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.316+0000 7f3362d99700 1 Processor -- start 2023-07-06T19:59:41.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.316+0000 7f3362d99700 1 -- start start 2023-07-06T19:59:41.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.317+0000 7f3362d99700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f335c0b3c60 0x7f335c0b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:41.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.317+0000 7f3362d99700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f335c0b58b0 0x7f335c0ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:41.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.317+0000 7f3362d99700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f335c1602c0 0x7f335c0c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:41.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.317+0000 7f3362d99700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c0c9a60 con 0x7f335c1602c0 2023-07-06T19:59:41.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.317+0000 7f3362d99700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c1f2e20 con 0x7f335c0b3c60 2023-07-06T19:59:41.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.317+0000 7f3362d99700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335c0b3280 con 0x7f335c0b58b0 2023-07-06T19:59:41.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.317+0000 7f3361336700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f335c1602c0 0x7f335c0c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:41.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.317+0000 7f3361336700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f335c1602c0 0x7f335c0c7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59728/0 (socket says 172.21.15.6:59728) 2023-07-06T19:59:41.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.317+0000 7f3361336700 1 -- 172.21.15.6:0/189680586 learned_addr learned my addr 172.21.15.6:0/189680586 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:41.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.317+0000 7f335bfff700 1 --2- 172.21.15.6:0/189680586 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f335c0b58b0 0x7f335c0ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:41.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.317+0000 7f3360b35700 1 --2- 172.21.15.6:0/189680586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f335c0b3c60 0x7f335c0b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:41.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.317+0000 7f3361336700 1 -- 172.21.15.6:0/189680586 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f335c0b58b0 msgr2=0x7f335c0ca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:41.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.317+0000 7f3361336700 1 --2- 172.21.15.6:0/189680586 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f335c0b58b0 0x7f335c0ca750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.317+0000 7f3361336700 1 -- 172.21.15.6:0/189680586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f335c0b3c60 msgr2=0x7f335c0b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:41.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.317+0000 7f3361336700 1 --2- 172.21.15.6:0/189680586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f335c0b3c60 0x7f335c0b27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.317+0000 7f3361336700 1 -- 172.21.15.6:0/189680586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3354009b30 con 0x7f335c1602c0 2023-07-06T19:59:41.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.317+0000 7f3360b35700 1 --2- 172.21.15.6:0/189680586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f335c0b3c60 0x7f335c0b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:41.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.317+0000 7f3361336700 1 --2- 172.21.15.6:0/189680586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f335c1602c0 0x7f335c0c7b20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3354004270 tx=0x7f3354004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:41.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.318+0000 7f33597fa700 1 -- 172.21.15.6:0/189680586 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33540099b0 con 0x7f335c1602c0 2023-07-06T19:59:41.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.318+0000 7f33597fa700 1 -- 172.21.15.6:0/189680586 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33540092e0 con 0x7f335c1602c0 2023-07-06T19:59:41.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.318+0000 7f3362d99700 1 -- 172.21.15.6:0/189680586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f335c0b2d00 con 0x7f335c1602c0 2023-07-06T19:59:41.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.318+0000 7f33597fa700 1 -- 172.21.15.6:0/189680586 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335401c660 con 0x7f335c1602c0 2023-07-06T19:59:41.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.318+0000 7f3362d99700 1 -- 172.21.15.6:0/189680586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335c1f2bf0 con 0x7f335c1602c0 2023-07-06T19:59:41.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.319+0000 7f3362d99700 1 -- 172.21.15.6:0/189680586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f335c04eb90 con 0x7f335c1602c0 2023-07-06T19:59:41.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.319+0000 7f33597fa700 1 -- 172.21.15.6:0/189680586 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f335401c7c0 con 0x7f335c1602c0 2023-07-06T19:59:41.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.320+0000 7f33597fa700 1 --2- 172.21.15.6:0/189680586 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f334006ace0 0x7f334006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:41.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.320+0000 7f3360b35700 1 --2- 172.21.15.6:0/189680586 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f334006ace0 0x7f334006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:41.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.320+0000 7f33597fa700 1 -- 172.21.15.6:0/189680586 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f335408b300 con 0x7f335c1602c0 2023-07-06T19:59:41.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.320+0000 7f3360b35700 1 --2- 172.21.15.6:0/189680586 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f334006ace0 0x7f334006d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3350006fd0 tx=0x7f3350008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:41.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.324+0000 7f33597fa700 1 -- 172.21.15.6:0/189680586 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3354056070 con 0x7f335c1602c0 2023-07-06T19:59:41.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.522+0000 7f3362d99700 1 -- 172.21.15.6:0/189680586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f335c0b5e30 con 0x7f335c1602c0 2023-07-06T19:59:41.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.523+0000 7f33597fa700 1 -- 172.21.15.6:0/189680586 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3354059690 con 0x7f335c1602c0 2023-07-06T19:59:41.526 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-06T19:59:41.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.525+0000 7f3362d99700 1 -- 172.21.15.6:0/189680586 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f334006ace0 msgr2=0x7f334006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:41.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.525+0000 7f3362d99700 1 --2- 172.21.15.6:0/189680586 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f334006ace0 0x7f334006d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3350006fd0 tx=0x7f3350008040 comp rx=0 tx=0).stop 2023-07-06T19:59:41.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.525+0000 7f3362d99700 1 -- 172.21.15.6:0/189680586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f335c1602c0 msgr2=0x7f335c0c7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:41.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.525+0000 7f3362d99700 1 --2- 172.21.15.6:0/189680586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f335c1602c0 0x7f335c0c7b20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3354004270 tx=0x7f3354004ad0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.525+0000 7f3362d99700 1 -- 172.21.15.6:0/189680586 shutdown_connections 2023-07-06T19:59:41.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.525+0000 7f3362d99700 1 --2- 172.21.15.6:0/189680586 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f334006ace0 0x7f334006d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.525+0000 7f3362d99700 1 --2- 172.21.15.6:0/189680586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f335c1602c0 0x7f335c0c7b20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.525+0000 7f3362d99700 1 --2- 172.21.15.6:0/189680586 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f335c0b3c60 0x7f335c0b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.525+0000 7f3362d99700 1 --2- 172.21.15.6:0/189680586 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f335c0b58b0 0x7f335c0ca750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.525+0000 7f3362d99700 1 -- 172.21.15.6:0/189680586 >> 172.21.15.6:0/189680586 conn(0x7f335c0ce120 msgr2=0x7f335c0cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:41.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.525+0000 7f3362d99700 1 -- 172.21.15.6:0/189680586 shutdown_connections 2023-07-06T19:59:41.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.525+0000 7f3362d99700 1 -- 172.21.15.6:0/189680586 wait complete. 2023-07-06T19:59:41.545 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T19:59:41.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.672+0000 7f7e97be3700 1 Processor -- start 2023-07-06T19:59:41.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.672+0000 7f7e97be3700 1 -- start start 2023-07-06T19:59:41.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.673+0000 7f7e97be3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7e900b4940 0x7f7e9006a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:41.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.673+0000 7f7e97be3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7e9015e930 0x7f7e900cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:41.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.673+0000 7f7e97be3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e900cf520 0x7f7e900cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:41.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.673+0000 7f7e97be3700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e900cf9a0 con 0x7f7e9015e930 2023-07-06T19:59:41.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.673+0000 7f7e97be3700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9006a840 con 0x7f7e900b4940 2023-07-06T19:59:41.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.673+0000 7f7e97be3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9006a5a0 con 0x7f7e900cf520 2023-07-06T19:59:41.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.673+0000 7f7e9517e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7e9015e930 0x7f7e900cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:41.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.673+0000 7f7e9517e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7e9015e930 0x7f7e900cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59732/0 (socket says 172.21.15.6:59732) 2023-07-06T19:59:41.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.673+0000 7f7e9517e700 1 -- 172.21.15.6:0/2884788238 learned_addr learned my addr 172.21.15.6:0/2884788238 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:41.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.674+0000 7f7e9597f700 1 --2- 172.21.15.6:0/2884788238 >> v2:172.21.15.40:3300/0 conn(0x7f7e900b4940 0x7f7e9006a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:41.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.674+0000 7f7e96180700 1 --2- 172.21.15.6:0/2884788238 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e900cf520 0x7f7e900cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:41.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.674+0000 7f7e9517e700 1 -- 172.21.15.6:0/2884788238 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e900cf520 msgr2=0x7f7e900cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:41.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.674+0000 7f7e9517e700 1 --2- 172.21.15.6:0/2884788238 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e900cf520 0x7f7e900cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.674+0000 7f7e9517e700 1 -- 172.21.15.6:0/2884788238 >> v2:172.21.15.40:3300/0 conn(0x7f7e900b4940 msgr2=0x7f7e9006a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:41.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.674+0000 7f7e9517e700 1 --2- 172.21.15.6:0/2884788238 >> v2:172.21.15.40:3300/0 conn(0x7f7e900b4940 0x7f7e9006a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.674+0000 7f7e9517e700 1 -- 172.21.15.6:0/2884788238 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9015b700 con 0x7f7e9015e930 2023-07-06T19:59:41.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.674+0000 7f7e9597f700 1 --2- 172.21.15.6:0/2884788238 >> v2:172.21.15.40:3300/0 conn(0x7f7e900b4940 0x7f7e9006a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:41.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.674+0000 7f7e9517e700 1 --2- 172.21.15.6:0/2884788238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e9015e930 0x7f7e900cefe0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7e900711a0 tx=0x7f7e8c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4b48ff001ee984 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:41.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.674+0000 7f7e9497d700 1 -- 172.21.15.6:0/2884788238 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c00b870 con 0x7f7e9015e930 2023-07-06T19:59:41.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.674+0000 7f7e9497d700 1 -- 172.21.15.6:0/2884788238 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c00b9d0 con 0x7f7e9015e930 2023-07-06T19:59:41.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.674+0000 7f7e9497d700 1 -- 172.21.15.6:0/2884788238 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c00bd60 con 0x7f7e9015e930 2023-07-06T19:59:41.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.675+0000 7f7e97be3700 1 -- 172.21.15.6:0/2884788238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e9015e930 msgr2=0x7f7e900cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:41.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.675+0000 7f7e97be3700 1 --2- 172.21.15.6:0/2884788238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e9015e930 0x7f7e900cefe0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7e900711a0 tx=0x7f7e8c009bd0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.675+0000 7f7e97be3700 1 -- 172.21.15.6:0/2884788238 shutdown_connections 2023-07-06T19:59:41.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.675+0000 7f7e97be3700 1 --2- 172.21.15.6:0/2884788238 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e900cf520 0x7f7e900cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.675+0000 7f7e97be3700 1 --2- 172.21.15.6:0/2884788238 >> v2:172.21.15.40:3300/0 conn(0x7f7e900b4940 0x7f7e9006a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.675+0000 7f7e97be3700 1 --2- 172.21.15.6:0/2884788238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e9015e930 0x7f7e900cefe0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.675+0000 7f7e97be3700 1 -- 172.21.15.6:0/2884788238 >> 172.21.15.6:0/2884788238 conn(0x7f7e900b0b60 msgr2=0x7f7e900b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:41.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.675+0000 7f7e97be3700 1 -- 172.21.15.6:0/2884788238 shutdown_connections 2023-07-06T19:59:41.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.675+0000 7f7e97be3700 1 -- 172.21.15.6:0/2884788238 wait complete. 2023-07-06T19:59:41.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.676+0000 7f7e97be3700 1 Processor -- start 2023-07-06T19:59:41.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.676+0000 7f7e97be3700 1 -- start start 2023-07-06T19:59:41.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.677+0000 7f7e97be3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e900b4940 0x7f7e900aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:41.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.677+0000 7f7e97be3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e900cf520 0x7f7e900c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:41.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.677+0000 7f7e97be3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e9015e930 0x7f7e900c4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:41.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.677+0000 7f7e97be3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e900c93c0 con 0x7f7e900cf520 2023-07-06T19:59:41.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.677+0000 7f7e97be3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e900c4eb0 con 0x7f7e9015e930 2023-07-06T19:59:41.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.677+0000 7f7e97be3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e900c2b60 con 0x7f7e900b4940 2023-07-06T19:59:41.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.677+0000 7f7e9517e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e900cf520 0x7f7e900c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:41.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.677+0000 7f7e9517e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e900cf520 0x7f7e900c3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59740/0 (socket says 172.21.15.6:59740) 2023-07-06T19:59:41.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.677+0000 7f7e9517e700 1 -- 172.21.15.6:0/3756367538 learned_addr learned my addr 172.21.15.6:0/3756367538 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:41.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.677+0000 7f7e96180700 1 --2- 172.21.15.6:0/3756367538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e9015e930 0x7f7e900c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:41.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.677+0000 7f7e9597f700 1 --2- 172.21.15.6:0/3756367538 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e900b4940 0x7f7e900aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:41.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.677+0000 7f7e9517e700 1 -- 172.21.15.6:0/3756367538 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e900b4940 msgr2=0x7f7e900aed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:41.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.677+0000 7f7e9517e700 1 --2- 172.21.15.6:0/3756367538 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e900b4940 0x7f7e900aed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.677+0000 7f7e9517e700 1 -- 172.21.15.6:0/3756367538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e9015e930 msgr2=0x7f7e900c4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:41.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.677+0000 7f7e9517e700 1 --2- 172.21.15.6:0/3756367538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e9015e930 0x7f7e900c4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.677+0000 7f7e9517e700 1 -- 172.21.15.6:0/3756367538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c009550 con 0x7f7e900cf520 2023-07-06T19:59:41.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.677+0000 7f7e9597f700 1 --2- 172.21.15.6:0/3756367538 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e900b4940 0x7f7e900aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:41.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.677+0000 7f7e9517e700 1 --2- 172.21.15.6:0/3756367538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e900cf520 0x7f7e900c3fc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c000c00 tx=0x7f7e8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:41.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.677+0000 7f7e867fc700 1 -- 172.21.15.6:0/3756367538 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c004590 con 0x7f7e900cf520 2023-07-06T19:59:41.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.678+0000 7f7e867fc700 1 -- 172.21.15.6:0/3756367538 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c0036a0 con 0x7f7e900cf520 2023-07-06T19:59:41.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.678+0000 7f7e97be3700 1 -- 172.21.15.6:0/3756367538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e900c4bd0 con 0x7f7e900cf520 2023-07-06T19:59:41.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.678+0000 7f7e867fc700 1 -- 172.21.15.6:0/3756367538 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c003a30 con 0x7f7e900cf520 2023-07-06T19:59:41.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.678+0000 7f7e97be3700 1 -- 172.21.15.6:0/3756367538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e900c3050 con 0x7f7e900cf520 2023-07-06T19:59:41.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.678+0000 7f7e97be3700 1 -- 172.21.15.6:0/3756367538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9004eb90 con 0x7f7e900cf520 2023-07-06T19:59:41.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.679+0000 7f7e867fc700 1 -- 172.21.15.6:0/3756367538 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7e8c003b90 con 0x7f7e900cf520 2023-07-06T19:59:41.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.679+0000 7f7e867fc700 1 --2- 172.21.15.6:0/3756367538 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7e7406ace0 0x7f7e7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:41.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.679+0000 7f7e867fc700 1 -- 172.21.15.6:0/3756367538 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7e8c08ad10 con 0x7f7e900cf520 2023-07-06T19:59:41.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.680+0000 7f7e9597f700 1 --2- 172.21.15.6:0/3756367538 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7e7406ace0 0x7f7e7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:41.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.680+0000 7f7e9597f700 1 --2- 172.21.15.6:0/3756367538 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7e7406ace0 0x7f7e7406d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7e8000aa20 tx=0x7f7e80008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:41.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.684+0000 7f7e867fc700 1 -- 172.21.15.6:0/3756367538 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7e8c055aa0 con 0x7f7e900cf520 2023-07-06T19:59:41.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.884+0000 7f7e97be3700 1 -- 172.21.15.6:0/3756367538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7e90071b40 con 0x7f7e900cf520 2023-07-06T19:59:41.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.884+0000 7f7e867fc700 1 -- 172.21.15.6:0/3756367538 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7e8c0590c0 con 0x7f7e900cf520 2023-07-06T19:59:41.887 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T19:59:41.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.887+0000 7f7e97be3700 1 -- 172.21.15.6:0/3756367538 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7e7406ace0 msgr2=0x7f7e7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:41.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.887+0000 7f7e97be3700 1 --2- 172.21.15.6:0/3756367538 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7e7406ace0 0x7f7e7406d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7e8000aa20 tx=0x7f7e80008040 comp rx=0 tx=0).stop 2023-07-06T19:59:41.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.887+0000 7f7e97be3700 1 -- 172.21.15.6:0/3756367538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e900cf520 msgr2=0x7f7e900c3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:41.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.887+0000 7f7e97be3700 1 --2- 172.21.15.6:0/3756367538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e900cf520 0x7f7e900c3fc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c000c00 tx=0x7f7e8c004750 comp rx=0 tx=0).stop 2023-07-06T19:59:41.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.887+0000 7f7e97be3700 1 -- 172.21.15.6:0/3756367538 shutdown_connections 2023-07-06T19:59:41.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.887+0000 7f7e97be3700 1 --2- 172.21.15.6:0/3756367538 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7e7406ace0 0x7f7e7406d190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.887+0000 7f7e97be3700 1 --2- 172.21.15.6:0/3756367538 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7e9015e930 0x7f7e900c4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.887+0000 7f7e97be3700 1 --2- 172.21.15.6:0/3756367538 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7e900b4940 0x7f7e900aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.887+0000 7f7e97be3700 1 --2- 172.21.15.6:0/3756367538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e900cf520 0x7f7e900c3fc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:41.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.887+0000 7f7e97be3700 1 -- 172.21.15.6:0/3756367538 >> 172.21.15.6:0/3756367538 conn(0x7f7e900b0b60 msgr2=0x7f7e9015b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:41.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.887+0000 7f7e97be3700 1 -- 172.21.15.6:0/3756367538 shutdown_connections 2023-07-06T19:59:41.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:41.887+0000 7f7e97be3700 1 -- 172.21.15.6:0/3756367538 wait complete. 2023-07-06T19:59:41.901 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T19:59:42.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.028+0000 7f0702757700 1 Processor -- start 2023-07-06T19:59:42.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.028+0000 7f0702757700 1 -- start start 2023-07-06T19:59:42.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.030+0000 7f0702757700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06fc0d15e0 0x7f06fc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:42.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.030+0000 7f0702757700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f06fc0ce860 0x7f06fc0cece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:42.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.030+0000 7f0702757700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06fc0cd300 con 0x7f06fc15a520 2023-07-06T19:59:42.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.030+0000 7f0702757700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06fc0b0290 con 0x7f06fc0ce860 2023-07-06T19:59:42.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.030+0000 7f0702757700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc0ccd80 con 0x7f06fc0d15e0 2023-07-06T19:59:42.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.030+0000 7f0700cf4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f06fc0ce860 0x7f06fc0cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.030+0000 7f0700cf4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f06fc0ce860 0x7f06fc0cece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59750/0 (socket says 172.21.15.6:59750) 2023-07-06T19:59:42.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.030+0000 7f06fbfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f06fc15a520 0x7f06fc06dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60954/0 (socket says 172.21.15.6:60954) 2023-07-06T19:59:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.030+0000 7f0700cf4700 1 -- 172.21.15.6:0/2523055142 learned_addr learned my addr 172.21.15.6:0/2523055142 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.030+0000 7f06fb7fe700 1 --2- 172.21.15.6:0/2523055142 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06fc0d15e0 0x7f06fc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:42.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.030+0000 7f0700cf4700 1 -- 172.21.15.6:0/2523055142 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06fc0d15e0 msgr2=0x7f06fc06e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:42.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.030+0000 7f0700cf4700 1 --2- 172.21.15.6:0/2523055142 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06fc0d15e0 0x7f06fc06e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.030+0000 7f0700cf4700 1 -- 172.21.15.6:0/2523055142 >> v1:172.21.15.6:6789/0 conn(0x7f06fc15a520 legacy=0x7f06fc06dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:42.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.030+0000 7f0700cf4700 1 -- 172.21.15.6:0/2523055142 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc0cd020 con 0x7f06fc0ce860 2023-07-06T19:59:42.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.030+0000 7f06fb7fe700 1 --2- 172.21.15.6:0/2523055142 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06fc0d15e0 0x7f06fc06e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:42.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.030+0000 7f0700cf4700 1 --2- 172.21.15.6:0/2523055142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06fc0ce860 0x7f06fc0cece0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009e50 tx=0x7f06f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df47bef9417a5624 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:42.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.030+0000 7f06faffd700 1 -- 172.21.15.6:0/2523055142 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f400e070 con 0x7f06fc0ce860 2023-07-06T19:59:42.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.030+0000 7f06faffd700 1 -- 172.21.15.6:0/2523055142 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f400b9c0 con 0x7f06fc0ce860 2023-07-06T19:59:42.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.030+0000 7f06faffd700 1 -- 172.21.15.6:0/2523055142 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f400bd70 con 0x7f06fc0ce860 2023-07-06T19:59:42.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.031+0000 7f0702757700 1 -- 172.21.15.6:0/2523055142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06fc0ce860 msgr2=0x7f06fc0cece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:42.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.031+0000 7f0702757700 1 --2- 172.21.15.6:0/2523055142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06fc0ce860 0x7f06fc0cece0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009e50 tx=0x7f06f400b330 comp rx=0 tx=0).stop 2023-07-06T19:59:42.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.031+0000 7f0702757700 1 -- 172.21.15.6:0/2523055142 shutdown_connections 2023-07-06T19:59:42.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.031+0000 7f0702757700 1 --2- 172.21.15.6:0/2523055142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06fc0ce860 0x7f06fc0cece0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.031+0000 7f0702757700 1 --2- 172.21.15.6:0/2523055142 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06fc0d15e0 0x7f06fc06e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.031+0000 7f0702757700 1 -- 172.21.15.6:0/2523055142 >> 172.21.15.6:0/2523055142 conn(0x7f06fc0ce120 msgr2=0x7f06fc0d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:42.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.031+0000 7f0702757700 1 -- 172.21.15.6:0/2523055142 shutdown_connections 2023-07-06T19:59:42.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.031+0000 7f0702757700 1 -- 172.21.15.6:0/2523055142 wait complete. 2023-07-06T19:59:42.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.032+0000 7f0702757700 1 Processor -- start 2023-07-06T19:59:42.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.032+0000 7f0702757700 1 -- start start 2023-07-06T19:59:42.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.033+0000 7f0702757700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06fc0ce860 0x7f06fc149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:42.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.033+0000 7f0702757700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06fc0d15e0 0x7f06fc0b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:42.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.033+0000 7f0702757700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06fc15a520 0x7f06fc15caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:42.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.033+0000 7f0702757700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc0b1aa0 con 0x7f06fc15a520 2023-07-06T19:59:42.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.033+0000 7f0702757700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc14a200 con 0x7f06fc0ce860 2023-07-06T19:59:42.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.033+0000 7f0702757700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc0b0e90 con 0x7f06fc0d15e0 2023-07-06T19:59:42.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.033+0000 7f0700cf4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06fc15a520 0x7f06fc15caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.033+0000 7f0700cf4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06fc15a520 0x7f06fc15caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59756/0 (socket says 172.21.15.6:59756) 2023-07-06T19:59:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.033+0000 7f0700cf4700 1 -- 172.21.15.6:0/3048313199 learned_addr learned my addr 172.21.15.6:0/3048313199 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.033+0000 7f0700cf4700 1 -- 172.21.15.6:0/3048313199 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06fc0d15e0 msgr2=0x7f06fc0b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.033+0000 7f0700cf4700 1 --2- 172.21.15.6:0/3048313199 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06fc0d15e0 0x7f06fc0b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.034+0000 7f0700cf4700 1 -- 172.21.15.6:0/3048313199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06fc0ce860 msgr2=0x7f06fc149cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:42.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.034+0000 7f0700cf4700 1 --2- 172.21.15.6:0/3048313199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06fc0ce860 0x7f06fc149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.034+0000 7f0700cf4700 1 -- 172.21.15.6:0/3048313199 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f4009b30 con 0x7f06fc15a520 2023-07-06T19:59:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.034+0000 7f0700cf4700 1 --2- 172.21.15.6:0/3048313199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06fc15a520 0x7f06fc15caf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f06fc066bd0 tx=0x7f06f4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.034+0000 7f06f8ff9700 1 -- 172.21.15.6:0/3048313199 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f40092e0 con 0x7f06fc15a520 2023-07-06T19:59:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.034+0000 7f06f8ff9700 1 -- 172.21.15.6:0/3048313199 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f40099b0 con 0x7f06fc15a520 2023-07-06T19:59:42.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.034+0000 7f0702757700 1 -- 172.21.15.6:0/3048313199 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06fc0b1170 con 0x7f06fc15a520 2023-07-06T19:59:42.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.034+0000 7f06f8ff9700 1 -- 172.21.15.6:0/3048313199 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f401c680 con 0x7f06fc15a520 2023-07-06T19:59:42.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.034+0000 7f0702757700 1 -- 172.21.15.6:0/3048313199 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06fc0b1730 con 0x7f06fc15a520 2023-07-06T19:59:42.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.035+0000 7f0702757700 1 -- 172.21.15.6:0/3048313199 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06fc0b18f0 con 0x7f06fc15a520 2023-07-06T19:59:42.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.035+0000 7f06f8ff9700 1 -- 172.21.15.6:0/3048313199 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f06f401c7e0 con 0x7f06fc15a520 2023-07-06T19:59:42.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.036+0000 7f06f8ff9700 1 --2- 172.21.15.6:0/3048313199 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f06dc06ace0 0x7f06dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:42.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.036+0000 7f06f8ff9700 1 -- 172.21.15.6:0/3048313199 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f06f408b4d0 con 0x7f06fc15a520 2023-07-06T19:59:42.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.036+0000 7f06fbfff700 1 --2- 172.21.15.6:0/3048313199 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f06dc06ace0 0x7f06dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:42.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.036+0000 7f06fbfff700 1 --2- 172.21.15.6:0/3048313199 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f06dc06ace0 0x7f06dc06d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f06ec001660 tx=0x7f06ec007a50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:42.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.040+0000 7f06f8ff9700 1 -- 172.21.15.6:0/3048313199 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f06f40562e0 con 0x7f06fc15a520 2023-07-06T19:59:42.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.239+0000 7f0702757700 1 -- 172.21.15.6:0/3048313199 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f06fc04eb90 con 0x7f06fc15a520 2023-07-06T19:59:42.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.239+0000 7f06f8ff9700 1 -- 172.21.15.6:0/3048313199 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f06f4059900 con 0x7f06fc15a520 2023-07-06T19:59:42.246 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-06T19:59:42.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.241+0000 7f0702757700 1 -- 172.21.15.6:0/3048313199 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f06dc06ace0 msgr2=0x7f06dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:42.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.241+0000 7f0702757700 1 --2- 172.21.15.6:0/3048313199 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f06dc06ace0 0x7f06dc06d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f06ec001660 tx=0x7f06ec007a50 comp rx=0 tx=0).stop 2023-07-06T19:59:42.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.241+0000 7f0702757700 1 -- 172.21.15.6:0/3048313199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06fc15a520 msgr2=0x7f06fc15caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:42.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.241+0000 7f0702757700 1 --2- 172.21.15.6:0/3048313199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06fc15a520 0x7f06fc15caf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f06fc066bd0 tx=0x7f06f4004ad0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.241+0000 7f0702757700 1 -- 172.21.15.6:0/3048313199 shutdown_connections 2023-07-06T19:59:42.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.241+0000 7f0702757700 1 --2- 172.21.15.6:0/3048313199 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f06dc06ace0 0x7f06dc06d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.241+0000 7f0702757700 1 --2- 172.21.15.6:0/3048313199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06fc15a520 0x7f06fc15caf0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.241+0000 7f0702757700 1 --2- 172.21.15.6:0/3048313199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f06fc0ce860 0x7f06fc149cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.241+0000 7f0702757700 1 --2- 172.21.15.6:0/3048313199 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f06fc0d15e0 0x7f06fc0b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.241+0000 7f0702757700 1 -- 172.21.15.6:0/3048313199 >> 172.21.15.6:0/3048313199 conn(0x7f06fc0ce120 msgr2=0x7f06fc0ca1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:42.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.241+0000 7f0702757700 1 -- 172.21.15.6:0/3048313199 shutdown_connections 2023-07-06T19:59:42.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.241+0000 7f0702757700 1 -- 172.21.15.6:0/3048313199 wait complete. 2023-07-06T19:59:42.256 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T19:59:42.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.385+0000 7f72db01a700 1 Processor -- start 2023-07-06T19:59:42.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.385+0000 7f72db01a700 1 -- start start 2023-07-06T19:59:42.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.386+0000 7f72db01a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f72d40ca850 0x7f72d415bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.386+0000 7f72db01a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d40cb310 con 0x7f72d4071cd0 2023-07-06T19:59:42.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.386+0000 7f72db01a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d40af070 con 0x7f72d4071900 2023-07-06T19:59:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.386+0000 7f72db01a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72d40cdbf0 con 0x7f72d40ca850 2023-07-06T19:59:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.386+0000 7f72d95b7700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f72d4071cd0 0x7f72d40ce010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60972/0 (socket says 172.21.15.6:60972) 2023-07-06T19:59:42.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.386+0000 7f72d95b7700 1 -- 172.21.15.6:0/2459716043 learned_addr learned my addr 172.21.15.6:0/2459716043 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.386+0000 7f72d3fff700 1 --2- 172.21.15.6:0/2459716043 >> v2:172.21.15.40:3300/0 conn(0x7f72d40ca850 0x7f72d415bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.386+0000 7f72d37fe700 1 -- 172.21.15.6:0/2459716043 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 903107527 0 0) 0x7f72d40cb310 con 0x7f72d4071cd0 2023-07-06T19:59:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.386+0000 7f72d37fe700 1 -- 172.21.15.6:0/2459716043 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72c40035b0 con 0x7f72d4071cd0 2023-07-06T19:59:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.386+0000 7f72d37fe700 1 -- 172.21.15.6:0/2459716043 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 640624133 0 0) 0x7f72c40035b0 con 0x7f72d4071cd0 2023-07-06T19:59:42.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.386+0000 7f72d37fe700 1 -- 172.21.15.6:0/2459716043 >> v2:172.21.15.40:3300/0 conn(0x7f72d40ca850 msgr2=0x7f72d415bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.386+0000 7f72d37fe700 1 --2- 172.21.15.6:0/2459716043 >> v2:172.21.15.40:3300/0 conn(0x7f72d40ca850 0x7f72d415bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.387+0000 7f72d37fe700 1 -- 172.21.15.6:0/2459716043 >> v1:172.21.15.40:6789/0 conn(0x7f72d4071900 legacy=0x7f72d40ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.387+0000 7f72d37fe700 1 -- 172.21.15.6:0/2459716043 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d40cad50 con 0x7f72d4071cd0 2023-07-06T19:59:42.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.387+0000 7f72d37fe700 1 -- 172.21.15.6:0/2459716043 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f72cc0019f0 con 0x7f72d4071cd0 2023-07-06T19:59:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.387+0000 7f72d37fe700 1 -- 172.21.15.6:0/2459716043 >> v1:172.21.15.6:6789/0 conn(0x7f72d4071cd0 legacy=0x7f72d40ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.387+0000 7f72d37fe700 1 --2- 172.21.15.6:0/2459716043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72c4003a00 0x7f72c4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.387+0000 7f72d37fe700 1 --2- 172.21.15.6:0/2459716043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72c4004850 0x7f72c4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.387+0000 7f72d37fe700 1 --2- 172.21.15.6:0/2459716043 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72c4005320 0x7f72c400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.387+0000 7f72d37fe700 1 -- 172.21.15.6:0/2459716043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d40cdbf0 con 0x7f72c4003a00 2023-07-06T19:59:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.387+0000 7f72d37fe700 1 -- 172.21.15.6:0/2459716043 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c400c1e0 con 0x7f72c4004850 2023-07-06T19:59:42.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.387+0000 7f72d37fe700 1 -- 172.21.15.6:0/2459716043 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c400c3a0 con 0x7f72c4005320 2023-07-06T19:59:42.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.387+0000 7f72d8db6700 1 --2- 172.21.15.6:0/2459716043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72c4003a00 0x7f72c4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:42.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.387+0000 7f72d3fff700 1 --2- 172.21.15.6:0/2459716043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72c4004850 0x7f72c4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:42.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.387+0000 7f72d95b7700 1 --2- 172.21.15.6:0/2459716043 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72c4005320 0x7f72c400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:42.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.387+0000 7f72d8db6700 1 -- 172.21.15.6:0/2459716043 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72c4005320 msgr2=0x7f72c400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:42.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.387+0000 7f72d8db6700 1 --2- 172.21.15.6:0/2459716043 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72c4005320 0x7f72c400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.387+0000 7f72d8db6700 1 -- 172.21.15.6:0/2459716043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72c4004850 msgr2=0x7f72c4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:42.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.387+0000 7f72d8db6700 1 --2- 172.21.15.6:0/2459716043 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72c4004850 0x7f72c4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.387+0000 7f72d8db6700 1 -- 172.21.15.6:0/2459716043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c40035b0 con 0x7f72c4003a00 2023-07-06T19:59:42.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.387+0000 7f72d95b7700 1 --2- 172.21.15.6:0/2459716043 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72c4005320 0x7f72c400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:42.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.387+0000 7f72d95b7700 1 -- 172.21.15.6:0/2459716043 reap_dead start 2023-07-06T19:59:42.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.387+0000 7f72d8db6700 1 --2- 172.21.15.6:0/2459716043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72c4003a00 0x7f72c4003e30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f72c8007fd0 tx=0x7f72c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89331224cb0e446 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:42.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.387+0000 7f72d37fe700 1 -- 172.21.15.6:0/2459716043 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c80052d0 con 0x7f72c4003a00 2023-07-06T19:59:42.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.387+0000 7f72d37fe700 1 -- 172.21.15.6:0/2459716043 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c8005430 con 0x7f72c4003a00 2023-07-06T19:59:42.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.387+0000 7f72d37fe700 1 -- 172.21.15.6:0/2459716043 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c80038c0 con 0x7f72c4003a00 2023-07-06T19:59:42.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.388+0000 7f72db01a700 1 -- 172.21.15.6:0/2459716043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72c4003a00 msgr2=0x7f72c4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:42.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.388+0000 7f72db01a700 1 --2- 172.21.15.6:0/2459716043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72c4003a00 0x7f72c4003e30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f72c8007fd0 tx=0x7f72c4005880 comp rx=0 tx=0).stop 2023-07-06T19:59:42.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.388+0000 7f72db01a700 1 -- 172.21.15.6:0/2459716043 shutdown_connections 2023-07-06T19:59:42.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.388+0000 7f72db01a700 1 --2- 172.21.15.6:0/2459716043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72c4003a00 0x7f72c4003e30 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.388+0000 7f72db01a700 1 -- 172.21.15.6:0/2459716043 >> 172.21.15.6:0/2459716043 conn(0x7f72d40cf960 msgr2=0x7f72d40cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:42.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.388+0000 7f72db01a700 1 -- 172.21.15.6:0/2459716043 shutdown_connections 2023-07-06T19:59:42.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.388+0000 7f72db01a700 1 -- 172.21.15.6:0/2459716043 wait complete. 2023-07-06T19:59:42.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.390+0000 7f72db01a700 1 Processor -- start 2023-07-06T19:59:42.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.390+0000 7f72db01a700 1 -- start start 2023-07-06T19:59:42.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.391+0000 7f72db01a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72c4003a00 0x7f72d41f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.391+0000 7f72db01a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72d40ad9d0 0x7f72d40c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.391+0000 7f72db01a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72d40ade40 0x7f72d40c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.391+0000 7f72db01a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d40ae6b0 con 0x7f72d40ade40 2023-07-06T19:59:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.391+0000 7f72db01a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d40ac620 con 0x7f72c4003a00 2023-07-06T19:59:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.391+0000 7f72db01a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d40ac900 con 0x7f72d40ad9d0 2023-07-06T19:59:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.391+0000 7f72d95b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72d40ade40 0x7f72d40c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.391+0000 7f72d95b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72d40ade40 0x7f72d40c8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59776/0 (socket says 172.21.15.6:59776) 2023-07-06T19:59:42.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.391+0000 7f72d95b7700 1 -- 172.21.15.6:0/1386577087 learned_addr learned my addr 172.21.15.6:0/1386577087 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:42.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.391+0000 7f72d8db6700 1 --2- 172.21.15.6:0/1386577087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72c4003a00 0x7f72d41f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:42.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.391+0000 7f72d3fff700 1 --2- 172.21.15.6:0/1386577087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72d40ad9d0 0x7f72d40c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:42.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.391+0000 7f72d95b7700 1 -- 172.21.15.6:0/1386577087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72d40ad9d0 msgr2=0x7f72d40c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:42.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.391+0000 7f72d95b7700 1 --2- 172.21.15.6:0/1386577087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72d40ad9d0 0x7f72d40c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.391+0000 7f72d95b7700 1 -- 172.21.15.6:0/1386577087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72c4003a00 msgr2=0x7f72d41f50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:42.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.391+0000 7f72d95b7700 1 --2- 172.21.15.6:0/1386577087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72c4003a00 0x7f72d41f50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.391+0000 7f72d95b7700 1 -- 172.21.15.6:0/1386577087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d40acbe0 con 0x7f72d40ade40 2023-07-06T19:59:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.391+0000 7f72d95b7700 1 --2- 172.21.15.6:0/1386577087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72d40ade40 0x7f72d40c8650 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f72cc001460 tx=0x7f72cc00e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.391+0000 7f72d17fa700 1 -- 172.21.15.6:0/1386577087 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc00ec70 con 0x7f72d40ade40 2023-07-06T19:59:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.392+0000 7f72d17fa700 1 -- 172.21.15.6:0/1386577087 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72cc00ee10 con 0x7f72d40ade40 2023-07-06T19:59:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.392+0000 7f72db01a700 1 -- 172.21.15.6:0/1386577087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d40acec0 con 0x7f72d40ade40 2023-07-06T19:59:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.392+0000 7f72d17fa700 1 -- 172.21.15.6:0/1386577087 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72cc013660 con 0x7f72d40ade40 2023-07-06T19:59:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.392+0000 7f72db01a700 1 -- 172.21.15.6:0/1386577087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d40ac2d0 con 0x7f72d40ade40 2023-07-06T19:59:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.392+0000 7f72db01a700 1 -- 172.21.15.6:0/1386577087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72d404eb90 con 0x7f72d40ade40 2023-07-06T19:59:42.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.393+0000 7f72d17fa700 1 -- 172.21.15.6:0/1386577087 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f72cc0137c0 con 0x7f72d40ade40 2023-07-06T19:59:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.394+0000 7f72d17fa700 1 --2- 172.21.15.6:0/1386577087 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f72b806ace0 0x7f72b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.394+0000 7f72d8db6700 1 --2- 172.21.15.6:0/1386577087 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f72b806ace0 0x7f72b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:42.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.394+0000 7f72d17fa700 1 -- 172.21.15.6:0/1386577087 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f72cc089b80 con 0x7f72d40ade40 2023-07-06T19:59:42.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.394+0000 7f72d8db6700 1 --2- 172.21.15.6:0/1386577087 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f72b806ace0 0x7f72b806d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f72c8015040 tx=0x7f72c8009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:42.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.398+0000 7f72d17fa700 1 -- 172.21.15.6:0/1386577087 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f72cc054990 con 0x7f72d40ade40 2023-07-06T19:59:42.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.596+0000 7f72db01a700 1 -- 172.21.15.6:0/1386577087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f72d415ab90 con 0x7f72d40ade40 2023-07-06T19:59:42.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.596+0000 7f72d17fa700 1 -- 172.21.15.6:0/1386577087 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f72cc057fb0 con 0x7f72d40ade40 2023-07-06T19:59:42.599 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T19:59:42.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.598+0000 7f72db01a700 1 -- 172.21.15.6:0/1386577087 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f72b806ace0 msgr2=0x7f72b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:42.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.598+0000 7f72db01a700 1 --2- 172.21.15.6:0/1386577087 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f72b806ace0 0x7f72b806d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f72c8015040 tx=0x7f72c8009030 comp rx=0 tx=0).stop 2023-07-06T19:59:42.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.598+0000 7f72db01a700 1 -- 172.21.15.6:0/1386577087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72d40ade40 msgr2=0x7f72d40c8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:42.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.598+0000 7f72db01a700 1 --2- 172.21.15.6:0/1386577087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72d40ade40 0x7f72d40c8650 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f72cc001460 tx=0x7f72cc00e440 comp rx=0 tx=0).stop 2023-07-06T19:59:42.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.598+0000 7f72db01a700 1 -- 172.21.15.6:0/1386577087 shutdown_connections 2023-07-06T19:59:42.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.599+0000 7f72db01a700 1 --2- 172.21.15.6:0/1386577087 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f72b806ace0 0x7f72b806d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.599+0000 7f72db01a700 1 --2- 172.21.15.6:0/1386577087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72d40ade40 0x7f72d40c8650 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.599+0000 7f72db01a700 1 --2- 172.21.15.6:0/1386577087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f72c4003a00 0x7f72d41f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.599+0000 7f72db01a700 1 --2- 172.21.15.6:0/1386577087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f72d40ad9d0 0x7f72d40c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.599+0000 7f72db01a700 1 -- 172.21.15.6:0/1386577087 >> 172.21.15.6:0/1386577087 conn(0x7f72d40cf960 msgr2=0x7f72d406ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:42.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.599+0000 7f72db01a700 1 -- 172.21.15.6:0/1386577087 shutdown_connections 2023-07-06T19:59:42.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.599+0000 7f72db01a700 1 -- 172.21.15.6:0/1386577087 wait complete. 2023-07-06T19:59:42.613 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T19:59:42.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.737+0000 7f869e206700 1 Processor -- start 2023-07-06T19:59:42.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.737+0000 7f869e206700 1 -- start start 2023-07-06T19:59:42.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.738+0000 7f869e206700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8698159ae0 0x7f8698070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:42.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.738+0000 7f869e206700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86980b2d80 con 0x7f8698158860 2023-07-06T19:59:42.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.738+0000 7f869e206700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8698159000 con 0x7f8698071420 2023-07-06T19:59:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.738+0000 7f869e206700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86980718a0 con 0x7f8698159ae0 2023-07-06T19:59:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.738+0000 7f8696ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8698159ae0 0x7f8698070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.738+0000 7f86977fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8698158860 0x7f86980b2330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:60988/0 (socket says 172.21.15.6:60988) 2023-07-06T19:59:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.738+0000 7f8696ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8698159ae0 0x7f8698070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59782/0 (socket says 172.21.15.6:59782) 2023-07-06T19:59:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.738+0000 7f86977fe700 1 -- 172.21.15.6:0/706508947 learned_addr learned my addr 172.21.15.6:0/706508947 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.738+0000 7f8696ffd700 1 -- 172.21.15.6:0/706508947 >> v1:172.21.15.40:6789/0 conn(0x7f8698071420 legacy=0x7f869815c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.738+0000 7f8696ffd700 1 -- 172.21.15.6:0/706508947 >> v1:172.21.15.6:6789/0 conn(0x7f8698158860 legacy=0x7f86980b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.738+0000 7f8696ffd700 1 -- 172.21.15.6:0/706508947 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86981592e0 con 0x7f8698159ae0 2023-07-06T19:59:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.738+0000 7f86967fc700 1 -- 172.21.15.6:0/706508947 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2817660801 0 0) 0x7f86980b2d80 con 0x7f8698158860 2023-07-06T19:59:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.738+0000 7f8696ffd700 1 --2- 172.21.15.6:0/706508947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8698159ae0 0x7f8698070ee0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f868c00a9e0 tx=0x7f868c00acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d705884ffc8127b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.738+0000 7f86967fc700 1 -- 172.21.15.6:0/706508947 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c00cb30 con 0x7f8698159ae0 2023-07-06T19:59:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.738+0000 7f86967fc700 1 -- 172.21.15.6:0/706508947 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868c00cc90 con 0x7f8698159ae0 2023-07-06T19:59:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.738+0000 7f86967fc700 1 -- 172.21.15.6:0/706508947 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c004030 con 0x7f8698159ae0 2023-07-06T19:59:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.739+0000 7f869e206700 1 -- 172.21.15.6:0/706508947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8698159ae0 msgr2=0x7f8698070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.739+0000 7f869e206700 1 --2- 172.21.15.6:0/706508947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8698159ae0 0x7f8698070ee0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f868c00a9e0 tx=0x7f868c00acf0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.739+0000 7f869e206700 1 -- 172.21.15.6:0/706508947 shutdown_connections 2023-07-06T19:59:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.739+0000 7f869e206700 1 --2- 172.21.15.6:0/706508947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8698159ae0 0x7f8698070ee0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.739+0000 7f869e206700 1 -- 172.21.15.6:0/706508947 >> 172.21.15.6:0/706508947 conn(0x7f86980b05b0 msgr2=0x7f86980b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:42.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.739+0000 7f869e206700 1 -- 172.21.15.6:0/706508947 shutdown_connections 2023-07-06T19:59:42.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.739+0000 7f869e206700 1 -- 172.21.15.6:0/706508947 wait complete. 2023-07-06T19:59:42.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.741+0000 7f869e206700 1 Processor -- start 2023-07-06T19:59:42.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.741+0000 7f869e206700 1 -- start start 2023-07-06T19:59:42.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.742+0000 7f869e206700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8698071420 0x7f869814af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:42.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.742+0000 7f869e206700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8698158860 0x7f86981f39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:42.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.742+0000 7f869e206700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8698159ae0 0x7f86981f3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:42.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.742+0000 7f869e206700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869814e9a0 con 0x7f8698158860 2023-07-06T19:59:42.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.742+0000 7f869e206700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869814dd90 con 0x7f8698071420 2023-07-06T19:59:42.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.742+0000 7f869e206700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f869814e070 con 0x7f8698159ae0 2023-07-06T19:59:42.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.742+0000 7f8696ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8698158860 0x7f86981f39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:42.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.742+0000 7f8696ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8698158860 0x7f86981f39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59788/0 (socket says 172.21.15.6:59788) 2023-07-06T19:59:42.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.742+0000 7f8696ffd700 1 -- 172.21.15.6:0/2094989340 learned_addr learned my addr 172.21.15.6:0/2094989340 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:42.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.742+0000 7f86977fe700 1 --2- 172.21.15.6:0/2094989340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8698071420 0x7f869814af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:42.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.742+0000 7f8697fff700 1 --2- 172.21.15.6:0/2094989340 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8698159ae0 0x7f86981f3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:42.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.742+0000 7f8696ffd700 1 -- 172.21.15.6:0/2094989340 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8698159ae0 msgr2=0x7f86981f3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:42.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.742+0000 7f8696ffd700 1 --2- 172.21.15.6:0/2094989340 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8698159ae0 0x7f86981f3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.742+0000 7f8696ffd700 1 -- 172.21.15.6:0/2094989340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8698071420 msgr2=0x7f869814af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:42.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.742+0000 7f8696ffd700 1 --2- 172.21.15.6:0/2094989340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8698071420 0x7f869814af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.742+0000 7f8696ffd700 1 -- 172.21.15.6:0/2094989340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868c00a640 con 0x7f8698158860 2023-07-06T19:59:42.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.742+0000 7f8696ffd700 1 --2- 172.21.15.6:0/2094989340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8698158860 0x7f86981f39f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f868c006ec0 tx=0x7f868c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:42.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.742+0000 7f867ffff700 1 -- 172.21.15.6:0/2094989340 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c01d070 con 0x7f8698158860 2023-07-06T19:59:42.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.743+0000 7f867ffff700 1 -- 172.21.15.6:0/2094989340 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868c003a30 con 0x7f8698158860 2023-07-06T19:59:42.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.743+0000 7f867ffff700 1 -- 172.21.15.6:0/2094989340 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c003dc0 con 0x7f8698158860 2023-07-06T19:59:42.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.743+0000 7f869e206700 1 -- 172.21.15.6:0/2094989340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f869814e350 con 0x7f8698158860 2023-07-06T19:59:42.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.743+0000 7f869e206700 1 -- 172.21.15.6:0/2094989340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8698142cf0 con 0x7f8698158860 2023-07-06T19:59:42.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.743+0000 7f869e206700 1 -- 172.21.15.6:0/2094989340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f869814eb50 con 0x7f8698158860 2023-07-06T19:59:42.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.744+0000 7f867ffff700 1 -- 172.21.15.6:0/2094989340 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f868c0183f0 con 0x7f8698158860 2023-07-06T19:59:42.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.744+0000 7f867ffff700 1 --2- 172.21.15.6:0/2094989340 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f868406ace0 0x7f868406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:42.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.744+0000 7f867ffff700 1 -- 172.21.15.6:0/2094989340 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f868c08a9a0 con 0x7f8698158860 2023-07-06T19:59:42.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.745+0000 7f86977fe700 1 --2- 172.21.15.6:0/2094989340 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f868406ace0 0x7f868406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:42.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.745+0000 7f86977fe700 1 --2- 172.21.15.6:0/2094989340 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f868406ace0 0x7f868406d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8688007fd0 tx=0x7f8688007de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:42.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.749+0000 7f867ffff700 1 -- 172.21.15.6:0/2094989340 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f869814eb50 con 0x7f8698158860 2023-07-06T19:59:42.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.946+0000 7f869e206700 1 -- 172.21.15.6:0/2094989340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8698067760 con 0x7f8698158860 2023-07-06T19:59:42.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.947+0000 7f867ffff700 1 -- 172.21.15.6:0/2094989340 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20059 (secure 0 0 0) 0x7f868c088e60 con 0x7f8698158860 2023-07-06T19:59:42.949 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:42.949 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":29,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:59:33.917851+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T19:58:51.062712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T19:58:52.130350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T19:58:55.785128+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:59:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.949+0000 7f869e206700 1 -- 172.21.15.6:0/2094989340 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f868406ace0 msgr2=0x7f868406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.949+0000 7f869e206700 1 --2- 172.21.15.6:0/2094989340 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f868406ace0 0x7f868406d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8688007fd0 tx=0x7f8688007de0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.949+0000 7f869e206700 1 -- 172.21.15.6:0/2094989340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8698158860 msgr2=0x7f86981f39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:42.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.949+0000 7f869e206700 1 --2- 172.21.15.6:0/2094989340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8698158860 0x7f86981f39f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f868c006ec0 tx=0x7f868c004750 comp rx=0 tx=0).stop 2023-07-06T19:59:42.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.949+0000 7f869e206700 1 -- 172.21.15.6:0/2094989340 shutdown_connections 2023-07-06T19:59:42.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.949+0000 7f869e206700 1 --2- 172.21.15.6:0/2094989340 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f868406ace0 0x7f868406d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.949+0000 7f869e206700 1 --2- 172.21.15.6:0/2094989340 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8698159ae0 0x7f86981f3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.949+0000 7f869e206700 1 --2- 172.21.15.6:0/2094989340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8698071420 0x7f869814af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.949+0000 7f869e206700 1 --2- 172.21.15.6:0/2094989340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8698158860 0x7f86981f39f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:42.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.949+0000 7f869e206700 1 -- 172.21.15.6:0/2094989340 >> 172.21.15.6:0/2094989340 conn(0x7f86980b05b0 msgr2=0x7f869815ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:42.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.949+0000 7f869e206700 1 -- 172.21.15.6:0/2094989340 shutdown_connections 2023-07-06T19:59:42.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:42.949+0000 7f869e206700 1 -- 172.21.15.6:0/2094989340 wait complete. 2023-07-06T19:59:42.967 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T19:58:38.767727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T19:58:45.759808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T19:58:51.062712+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T19:58:52.130350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T19:58:55.785128+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T19:59:42.968 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T19:59:43.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.097+0000 7fc98dae0700 1 Processor -- start 2023-07-06T19:59:43.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.097+0000 7fc98dae0700 1 -- start start 2023-07-06T19:59:43.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.097+0000 7fc98dae0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc988071da0 0x7fc9880ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:43.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.097+0000 7fc98dae0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc98815e890 con 0x7fc9880aef10 2023-07-06T19:59:43.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.097+0000 7fc98dae0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc98815eb70 con 0x7fc98815b370 2023-07-06T19:59:43.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.097+0000 7fc98dae0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc988151750 con 0x7fc988071da0 2023-07-06T19:59:43.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.098+0000 7fc9877fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc9880aef10 0x7fc98815de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:32770/0 (socket says 172.21.15.6:32770) 2023-07-06T19:59:43.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.098+0000 7fc9877fe700 1 -- 172.21.15.6:0/1996527051 learned_addr learned my addr 172.21.15.6:0/1996527051 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:43.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.098+0000 7fc987fff700 1 --2- 172.21.15.6:0/1996527051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc988071da0 0x7fc9880ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:43.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.098+0000 7fc9867fc700 1 -- 172.21.15.6:0/1996527051 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1237308978 0 0) 0x7fc98815e890 con 0x7fc9880aef10 2023-07-06T19:59:43.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.098+0000 7fc9867fc700 1 -- 172.21.15.6:0/1996527051 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9700035b0 con 0x7fc9880aef10 2023-07-06T19:59:43.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.098+0000 7fc9867fc700 1 -- 172.21.15.6:0/1996527051 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1489612155 0 0) 0x7fc9700035b0 con 0x7fc9880aef10 2023-07-06T19:59:43.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.098+0000 7fc9867fc700 1 -- 172.21.15.6:0/1996527051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc988071da0 msgr2=0x7fc9880ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:43.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.098+0000 7fc9867fc700 1 --2- 172.21.15.6:0/1996527051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc988071da0 0x7fc9880ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.098+0000 7fc9867fc700 1 -- 172.21.15.6:0/1996527051 >> v1:172.21.15.40:6789/0 conn(0x7fc98815b370 legacy=0x7fc988071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:43.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.098+0000 7fc9867fc700 1 -- 172.21.15.6:0/1996527051 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98815ab70 con 0x7fc9880aef10 2023-07-06T19:59:43.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.098+0000 7fc9867fc700 1 -- 172.21.15.6:0/1996527051 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7fc978001670 con 0x7fc9880aef10 2023-07-06T19:59:43.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.098+0000 7fc9867fc700 1 -- 172.21.15.6:0/1996527051 >> v1:172.21.15.6:6789/0 conn(0x7fc9880aef10 legacy=0x7fc98815de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:43.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.098+0000 7fc9867fc700 1 --2- 172.21.15.6:0/1996527051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc970003a30 0x7fc970003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:43.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.098+0000 7fc9867fc700 1 --2- 172.21.15.6:0/1996527051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc988071da0 0x7fc970004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:43.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.098+0000 7fc9867fc700 1 --2- 172.21.15.6:0/1996527051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc970004d90 0x7fc970005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:43.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.098+0000 7fc9867fc700 1 -- 172.21.15.6:0/1996527051 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc988151750 con 0x7fc970003a30 2023-07-06T19:59:43.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.098+0000 7fc9867fc700 1 -- 172.21.15.6:0/1996527051 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97000bac0 con 0x7fc970004d90 2023-07-06T19:59:43.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.098+0000 7fc9867fc700 1 -- 172.21.15.6:0/1996527051 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97000bc00 con 0x7fc988071da0 2023-07-06T19:59:43.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.098+0000 7fc9877fe700 1 --2- 172.21.15.6:0/1996527051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc970003a30 0x7fc970003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:43.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.098+0000 7fc986ffd700 1 --2- 172.21.15.6:0/1996527051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc988071da0 0x7fc970004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:43.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.098+0000 7fc987fff700 1 --2- 172.21.15.6:0/1996527051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc970004d90 0x7fc970005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:43.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.099+0000 7fc9877fe700 1 -- 172.21.15.6:0/1996527051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc988071da0 msgr2=0x7fc970004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:43.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.099+0000 7fc9877fe700 1 --2- 172.21.15.6:0/1996527051 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc988071da0 0x7fc970004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.099+0000 7fc9877fe700 1 -- 172.21.15.6:0/1996527051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc970004d90 msgr2=0x7fc970005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:43.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.099+0000 7fc9877fe700 1 --2- 172.21.15.6:0/1996527051 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc970004d90 0x7fc970005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.099+0000 7fc9877fe700 1 -- 172.21.15.6:0/1996527051 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9700035b0 con 0x7fc970003a30 2023-07-06T19:59:43.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.099+0000 7fc9877fe700 1 --2- 172.21.15.6:0/1996527051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc970003a30 0x7fc970003e00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc97800c210 tx=0x7fc970005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e7aa3503106deb1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:43.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.099+0000 7fc9867fc700 1 -- 172.21.15.6:0/1996527051 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc978007b70 con 0x7fc970003a30 2023-07-06T19:59:43.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.099+0000 7fc9867fc700 1 -- 172.21.15.6:0/1996527051 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97800cdb0 con 0x7fc970003a30 2023-07-06T19:59:43.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.099+0000 7fc9867fc700 1 -- 172.21.15.6:0/1996527051 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc978005ba0 con 0x7fc970003a30 2023-07-06T19:59:43.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.099+0000 7fc98dae0700 1 -- 172.21.15.6:0/1996527051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc970003a30 msgr2=0x7fc970003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:43.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.099+0000 7fc98dae0700 1 --2- 172.21.15.6:0/1996527051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc970003a30 0x7fc970003e00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc97800c210 tx=0x7fc970005880 comp rx=0 tx=0).stop 2023-07-06T19:59:43.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.099+0000 7fc987fff700 1 -- 172.21.15.6:0/1996527051 reap_dead start 2023-07-06T19:59:43.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.100+0000 7fc98dae0700 1 -- 172.21.15.6:0/1996527051 shutdown_connections 2023-07-06T19:59:43.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.100+0000 7fc98dae0700 1 -- 172.21.15.6:0/1996527051 >> 172.21.15.6:0/1996527051 conn(0x7fc9880cf960 msgr2=0x7fc9880cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:43.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.100+0000 7fc98dae0700 1 -- 172.21.15.6:0/1996527051 shutdown_connections 2023-07-06T19:59:43.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.100+0000 7fc98dae0700 1 -- 172.21.15.6:0/1996527051 wait complete. 2023-07-06T19:59:43.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.101+0000 7fc98dae0700 1 Processor -- start 2023-07-06T19:59:43.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.101+0000 7fc98dae0700 1 -- start start 2023-07-06T19:59:43.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.102+0000 7fc98dae0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc970003a30 0x7fc98814cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:43.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.102+0000 7fc98dae0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9880af350 0x7fc98814d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:43.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.102+0000 7fc98dae0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9880afe90 0x7fc9880b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:43.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.102+0000 7fc98dae0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9880b0840 con 0x7fc9880afe90 2023-07-06T19:59:43.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.102+0000 7fc98dae0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98814dfd0 con 0x7fc9880af350 2023-07-06T19:59:43.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.102+0000 7fc98dae0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98814e2b0 con 0x7fc970003a30 2023-07-06T19:59:43.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.102+0000 7fc987fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9880afe90 0x7fc9880b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:43.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.102+0000 7fc987fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9880afe90 0x7fc9880b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59808/0 (socket says 172.21.15.6:59808) 2023-07-06T19:59:43.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.102+0000 7fc987fff700 1 -- 172.21.15.6:0/2283805966 learned_addr learned my addr 172.21.15.6:0/2283805966 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:43.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.102+0000 7fc9877fe700 1 --2- 172.21.15.6:0/2283805966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc970003a30 0x7fc98814cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:43.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.102+0000 7fc986ffd700 1 --2- 172.21.15.6:0/2283805966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9880af350 0x7fc98814d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:43.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.102+0000 7fc987fff700 1 -- 172.21.15.6:0/2283805966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc970003a30 msgr2=0x7fc98814cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:43.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.102+0000 7fc987fff700 1 --2- 172.21.15.6:0/2283805966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc970003a30 0x7fc98814cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.102+0000 7fc987fff700 1 -- 172.21.15.6:0/2283805966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9880af350 msgr2=0x7fc98814d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:43.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.102+0000 7fc987fff700 1 --2- 172.21.15.6:0/2283805966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9880af350 0x7fc98814d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.102+0000 7fc987fff700 1 -- 172.21.15.6:0/2283805966 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98814e590 con 0x7fc9880afe90 2023-07-06T19:59:43.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.102+0000 7fc9877fe700 1 --2- 172.21.15.6:0/2283805966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc970003a30 0x7fc98814cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:43.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.102+0000 7fc986ffd700 1 --2- 172.21.15.6:0/2283805966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9880af350 0x7fc98814d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:43.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.102+0000 7fc987fff700 1 --2- 172.21.15.6:0/2283805966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9880afe90 0x7fc9880b0300 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc988071460 tx=0x7fc980011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:43.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.102+0000 7fc96ffff700 1 -- 172.21.15.6:0/2283805966 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98000e040 con 0x7fc9880afe90 2023-07-06T19:59:43.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.102+0000 7fc96ffff700 1 -- 172.21.15.6:0/2283805966 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98000f040 con 0x7fc9880afe90 2023-07-06T19:59:43.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.102+0000 7fc98dae0700 1 -- 172.21.15.6:0/2283805966 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc98814e870 con 0x7fc9880afe90 2023-07-06T19:59:43.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.103+0000 7fc96ffff700 1 -- 172.21.15.6:0/2283805966 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98000fa00 con 0x7fc9880afe90 2023-07-06T19:59:43.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.103+0000 7fc98dae0700 1 -- 172.21.15.6:0/2283805966 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc98814dc50 con 0x7fc9880afe90 2023-07-06T19:59:43.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.104+0000 7fc98dae0700 1 -- 172.21.15.6:0/2283805966 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc98814ea60 con 0x7fc9880afe90 2023-07-06T19:59:43.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.104+0000 7fc96ffff700 1 -- 172.21.15.6:0/2283805966 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc98000fb60 con 0x7fc9880afe90 2023-07-06T19:59:43.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.104+0000 7fc96ffff700 1 --2- 172.21.15.6:0/2283805966 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc97406ad10 0x7fc97406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:43.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.104+0000 7fc96ffff700 1 -- 172.21.15.6:0/2283805966 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc980089ca0 con 0x7fc9880afe90 2023-07-06T19:59:43.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.104+0000 7fc9877fe700 1 --2- 172.21.15.6:0/2283805966 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc97406ad10 0x7fc97406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:43.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.105+0000 7fc9877fe700 1 --2- 172.21.15.6:0/2283805966 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc97406ad10 0x7fc97406d1c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc978015040 tx=0x7fc978007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:43.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.109+0000 7fc96ffff700 1 -- 172.21.15.6:0/2283805966 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc980054a20 con 0x7fc9880afe90 2023-07-06T19:59:43.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.305+0000 7fc98dae0700 1 -- 172.21.15.6:0/2283805966 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc98804eb90 con 0x7fc9880afe90 2023-07-06T19:59:43.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.305+0000 7fc96ffff700 1 -- 172.21.15.6:0/2283805966 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc980058040 con 0x7fc9880afe90 2023-07-06T19:59:43.308 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-06T19:59:43.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.307+0000 7fc98dae0700 1 -- 172.21.15.6:0/2283805966 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc97406ad10 msgr2=0x7fc97406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:43.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.307+0000 7fc98dae0700 1 --2- 172.21.15.6:0/2283805966 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc97406ad10 0x7fc97406d1c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc978015040 tx=0x7fc978007000 comp rx=0 tx=0).stop 2023-07-06T19:59:43.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.307+0000 7fc98dae0700 1 -- 172.21.15.6:0/2283805966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9880afe90 msgr2=0x7fc9880b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:43.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.307+0000 7fc98dae0700 1 --2- 172.21.15.6:0/2283805966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9880afe90 0x7fc9880b0300 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc988071460 tx=0x7fc980011f80 comp rx=0 tx=0).stop 2023-07-06T19:59:43.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.307+0000 7fc98dae0700 1 -- 172.21.15.6:0/2283805966 shutdown_connections 2023-07-06T19:59:43.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.307+0000 7fc98dae0700 1 --2- 172.21.15.6:0/2283805966 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc97406ad10 0x7fc97406d1c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.307+0000 7fc98dae0700 1 --2- 172.21.15.6:0/2283805966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9880afe90 0x7fc9880b0300 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.307+0000 7fc98dae0700 1 --2- 172.21.15.6:0/2283805966 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc970003a30 0x7fc98814cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.307+0000 7fc98dae0700 1 --2- 172.21.15.6:0/2283805966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc9880af350 0x7fc98814d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.307+0000 7fc98dae0700 1 -- 172.21.15.6:0/2283805966 >> 172.21.15.6:0/2283805966 conn(0x7fc9880cf960 msgr2=0x7fc9880cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:43.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.307+0000 7fc98dae0700 1 -- 172.21.15.6:0/2283805966 shutdown_connections 2023-07-06T19:59:43.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.308+0000 7fc98dae0700 1 -- 172.21.15.6:0/2283805966 wait complete. 2023-07-06T19:59:43.322 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T19:59:43.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.448+0000 7fd07f510700 1 Processor -- start 2023-07-06T19:59:43.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.449+0000 7fd07f510700 1 -- start start 2023-07-06T19:59:43.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.449+0000 7fd07f510700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd078071900 0x7fd0780ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:43.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.449+0000 7fd07f510700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd078071cd0 0x7fd0780ca680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:43.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.449+0000 7fd07f510700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd07815bf50 0x7fd07815c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:43.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.449+0000 7fd07f510700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0780cdbf0 con 0x7fd078071900 2023-07-06T19:59:43.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.449+0000 7fd07f510700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0780cb310 con 0x7fd078071cd0 2023-07-06T19:59:43.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.449+0000 7fd07f510700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0780af070 con 0x7fd07815bf50 2023-07-06T19:59:43.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.450+0000 7fd07d2ac700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd078071900 0x7fd0780ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:43.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.450+0000 7fd07d2ac700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd078071900 0x7fd0780ca140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59812/0 (socket says 172.21.15.6:59812) 2023-07-06T19:59:43.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.450+0000 7fd07d2ac700 1 -- 172.21.15.6:0/1531503365 learned_addr learned my addr 172.21.15.6:0/1531503365 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:43.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.450+0000 7fd07caab700 1 --2- 172.21.15.6:0/1531503365 >> v2:172.21.15.40:3300/0 conn(0x7fd078071cd0 0x7fd0780ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:43.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.450+0000 7fd07daad700 1 --2- 172.21.15.6:0/1531503365 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd07815bf50 0x7fd07815c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:43.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.450+0000 7fd07d2ac700 1 -- 172.21.15.6:0/1531503365 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd07815bf50 msgr2=0x7fd07815c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:43.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.450+0000 7fd07d2ac700 1 --2- 172.21.15.6:0/1531503365 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd07815bf50 0x7fd07815c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.450+0000 7fd07d2ac700 1 -- 172.21.15.6:0/1531503365 >> v2:172.21.15.40:3300/0 conn(0x7fd078071cd0 msgr2=0x7fd0780ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:43.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.450+0000 7fd07d2ac700 1 --2- 172.21.15.6:0/1531503365 >> v2:172.21.15.40:3300/0 conn(0x7fd078071cd0 0x7fd0780ca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.450+0000 7fd07d2ac700 1 -- 172.21.15.6:0/1531503365 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd07815c8f0 con 0x7fd078071900 2023-07-06T19:59:43.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.450+0000 7fd07daad700 1 --2- 172.21.15.6:0/1531503365 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd07815bf50 0x7fd07815c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:43.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.450+0000 7fd07caab700 1 --2- 172.21.15.6:0/1531503365 >> v2:172.21.15.40:3300/0 conn(0x7fd078071cd0 0x7fd0780ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:43.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.450+0000 7fd07d2ac700 1 --2- 172.21.15.6:0/1531503365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd078071900 0x7fd0780ca140 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd07806e9b0 tx=0x7fd068009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83276146102b424f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:43.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.450+0000 7fd06ffff700 1 -- 172.21.15.6:0/1531503365 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06800b870 con 0x7fd078071900 2023-07-06T19:59:43.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.450+0000 7fd06ffff700 1 -- 172.21.15.6:0/1531503365 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06800b9d0 con 0x7fd078071900 2023-07-06T19:59:43.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.450+0000 7fd06ffff700 1 -- 172.21.15.6:0/1531503365 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06800bd60 con 0x7fd078071900 2023-07-06T19:59:43.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.451+0000 7fd07f510700 1 -- 172.21.15.6:0/1531503365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd078071900 msgr2=0x7fd0780ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:43.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.451+0000 7fd07f510700 1 --2- 172.21.15.6:0/1531503365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd078071900 0x7fd0780ca140 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd07806e9b0 tx=0x7fd068009bd0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.451+0000 7fd07f510700 1 -- 172.21.15.6:0/1531503365 shutdown_connections 2023-07-06T19:59:43.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.451+0000 7fd07f510700 1 --2- 172.21.15.6:0/1531503365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd078071900 0x7fd0780ca140 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.451+0000 7fd07f510700 1 --2- 172.21.15.6:0/1531503365 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd07815bf50 0x7fd07815c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.451+0000 7fd07f510700 1 --2- 172.21.15.6:0/1531503365 >> v2:172.21.15.40:3300/0 conn(0x7fd078071cd0 0x7fd0780ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.451+0000 7fd07f510700 1 -- 172.21.15.6:0/1531503365 >> 172.21.15.6:0/1531503365 conn(0x7fd0780cf960 msgr2=0x7fd0780cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:43.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.451+0000 7fd07f510700 1 -- 172.21.15.6:0/1531503365 shutdown_connections 2023-07-06T19:59:43.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.451+0000 7fd07f510700 1 -- 172.21.15.6:0/1531503365 wait complete. 2023-07-06T19:59:43.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.453+0000 7fd07f510700 1 Processor -- start 2023-07-06T19:59:43.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.453+0000 7fd07f510700 1 -- start start 2023-07-06T19:59:43.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.453+0000 7fd07f510700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd078071900 0x7fd0780b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:43.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.454+0000 7fd07f510700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd078071cd0 0x7fd07815ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:43.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.454+0000 7fd07f510700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd07815bf50 0x7fd07815f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:43.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.454+0000 7fd07f510700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0780b42b0 con 0x7fd07815bf50 2023-07-06T19:59:43.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.454+0000 7fd07f510700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0780b44e0 con 0x7fd078071900 2023-07-06T19:59:43.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.454+0000 7fd07f510700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0780b47c0 con 0x7fd078071cd0 2023-07-06T19:59:43.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.454+0000 7fd07daad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd07815bf50 0x7fd07815f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:43.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.454+0000 7fd07daad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd07815bf50 0x7fd07815f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59822/0 (socket says 172.21.15.6:59822) 2023-07-06T19:59:43.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.454+0000 7fd07daad700 1 -- 172.21.15.6:0/519570850 learned_addr learned my addr 172.21.15.6:0/519570850 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:43.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.454+0000 7fd07caab700 1 --2- 172.21.15.6:0/519570850 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd078071cd0 0x7fd07815ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:43.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.454+0000 7fd07d2ac700 1 --2- 172.21.15.6:0/519570850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd078071900 0x7fd0780b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:43.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.454+0000 7fd07daad700 1 -- 172.21.15.6:0/519570850 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd078071cd0 msgr2=0x7fd07815ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:43.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.454+0000 7fd07daad700 1 --2- 172.21.15.6:0/519570850 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd078071cd0 0x7fd07815ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.454+0000 7fd07daad700 1 -- 172.21.15.6:0/519570850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd078071900 msgr2=0x7fd0780b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:43.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.454+0000 7fd07daad700 1 --2- 172.21.15.6:0/519570850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd078071900 0x7fd0780b3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.454+0000 7fd07daad700 1 -- 172.21.15.6:0/519570850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd068009550 con 0x7fd07815bf50 2023-07-06T19:59:43.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.454+0000 7fd07daad700 1 --2- 172.21.15.6:0/519570850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd07815bf50 0x7fd07815f220 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd070007df0 tx=0x7fd07000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:43.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.454+0000 7fd06dffb700 1 -- 172.21.15.6:0/519570850 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07000ddd0 con 0x7fd07815bf50 2023-07-06T19:59:43.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.454+0000 7fd06dffb700 1 -- 172.21.15.6:0/519570850 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07000f040 con 0x7fd07815bf50 2023-07-06T19:59:43.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.454+0000 7fd06dffb700 1 -- 172.21.15.6:0/519570850 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd070003c60 con 0x7fd07815bf50 2023-07-06T19:59:43.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.454+0000 7fd07f510700 1 -- 172.21.15.6:0/519570850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0780b4aa0 con 0x7fd07815bf50 2023-07-06T19:59:43.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.455+0000 7fd07f510700 1 -- 172.21.15.6:0/519570850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0780b5060 con 0x7fd07815bf50 2023-07-06T19:59:43.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.456+0000 7fd07f510700 1 -- 172.21.15.6:0/519570850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd07804eb90 con 0x7fd07815bf50 2023-07-06T19:59:43.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.456+0000 7fd06dffb700 1 -- 172.21.15.6:0/519570850 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd070004030 con 0x7fd07815bf50 2023-07-06T19:59:43.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.456+0000 7fd06dffb700 1 --2- 172.21.15.6:0/519570850 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd05c06ace0 0x7fd05c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:43.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.457+0000 7fd06dffb700 1 -- 172.21.15.6:0/519570850 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd070089930 con 0x7fd07815bf50 2023-07-06T19:59:43.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.457+0000 7fd07d2ac700 1 --2- 172.21.15.6:0/519570850 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd05c06ace0 0x7fd05c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:43.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.457+0000 7fd07d2ac700 1 --2- 172.21.15.6:0/519570850 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd05c06ace0 0x7fd05c06d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd068014040 tx=0x7fd068008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:43.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.461+0000 7fd06dffb700 1 -- 172.21.15.6:0/519570850 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd070054740 con 0x7fd07815bf50 2023-07-06T19:59:43.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.661+0000 7fd07f510700 1 -- 172.21.15.6:0/519570850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd0780b58e0 con 0x7fd07815bf50 2023-07-06T19:59:43.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.661+0000 7fd06dffb700 1 -- 172.21.15.6:0/519570850 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd070057d60 con 0x7fd07815bf50 2023-07-06T19:59:43.664 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-06T19:59:43.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.663+0000 7fd07f510700 1 -- 172.21.15.6:0/519570850 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd05c06ace0 msgr2=0x7fd05c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:43.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.663+0000 7fd07f510700 1 --2- 172.21.15.6:0/519570850 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd05c06ace0 0x7fd05c06d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd068014040 tx=0x7fd068008030 comp rx=0 tx=0).stop 2023-07-06T19:59:43.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.663+0000 7fd07f510700 1 -- 172.21.15.6:0/519570850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd07815bf50 msgr2=0x7fd07815f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:43.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.663+0000 7fd07f510700 1 --2- 172.21.15.6:0/519570850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd07815bf50 0x7fd07815f220 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd070007df0 tx=0x7fd07000d3b0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.663+0000 7fd07f510700 1 -- 172.21.15.6:0/519570850 shutdown_connections 2023-07-06T19:59:43.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.663+0000 7fd07f510700 1 --2- 172.21.15.6:0/519570850 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd05c06ace0 0x7fd05c06d190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.663+0000 7fd07f510700 1 --2- 172.21.15.6:0/519570850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd07815bf50 0x7fd07815f220 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.663+0000 7fd07f510700 1 --2- 172.21.15.6:0/519570850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd078071900 0x7fd0780b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.663+0000 7fd07f510700 1 --2- 172.21.15.6:0/519570850 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd078071cd0 0x7fd07815ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.663+0000 7fd07f510700 1 -- 172.21.15.6:0/519570850 >> 172.21.15.6:0/519570850 conn(0x7fd0780cf960 msgr2=0x7fd0780b0190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:43.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.664+0000 7fd07f510700 1 -- 172.21.15.6:0/519570850 shutdown_connections 2023-07-06T19:59:43.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.664+0000 7fd07f510700 1 -- 172.21.15.6:0/519570850 wait complete. 2023-07-06T19:59:43.681 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T19:59:43.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.810+0000 7f4fcb57b700 1 Processor -- start 2023-07-06T19:59:43.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.810+0000 7f4fcb57b700 1 -- start start 2023-07-06T19:59:43.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.810+0000 7f4fcb57b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc4071900 0x7f4fc40ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:43.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.811+0000 7f4fcb57b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc40cb310 con 0x7f4fc415c660 2023-07-06T19:59:43.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.811+0000 7f4fcb57b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc40af070 con 0x7f4fc4071cd0 2023-07-06T19:59:43.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.811+0000 7f4fcb57b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc40cdbf0 con 0x7f4fc4071900 2023-07-06T19:59:43.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.811+0000 7f4fc9b18700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4fc415c660 0x7f4fc40ce010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:32806/0 (socket says 172.21.15.6:32806) 2023-07-06T19:59:43.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.811+0000 7f4fc9b18700 1 -- 172.21.15.6:0/3954673366 learned_addr learned my addr 172.21.15.6:0/3954673366 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:43.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.811+0000 7f4fc9317700 1 --2- 172.21.15.6:0/3954673366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc4071900 0x7f4fc40ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:43.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.811+0000 7f4fb7fff700 1 -- 172.21.15.6:0/3954673366 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2207266557 0 0) 0x7f4fc40cb310 con 0x7f4fc415c660 2023-07-06T19:59:43.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.811+0000 7f4fb7fff700 1 -- 172.21.15.6:0/3954673366 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fb00035b0 con 0x7f4fc415c660 2023-07-06T19:59:43.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.811+0000 7f4fb7fff700 1 -- 172.21.15.6:0/3954673366 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1049484831 0 0) 0x7f4fc40af070 con 0x7f4fc4071cd0 2023-07-06T19:59:43.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.811+0000 7f4fb7fff700 1 -- 172.21.15.6:0/3954673366 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fc40cb310 con 0x7f4fc4071cd0 2023-07-06T19:59:43.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.811+0000 7f4fb7fff700 1 -- 172.21.15.6:0/3954673366 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2322893750 0 0) 0x7f4fb00035b0 con 0x7f4fc415c660 2023-07-06T19:59:43.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.811+0000 7f4fb7fff700 1 -- 172.21.15.6:0/3954673366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc4071900 msgr2=0x7f4fc40ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:43.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.811+0000 7f4fb7fff700 1 --2- 172.21.15.6:0/3954673366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc4071900 0x7f4fc40ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.811+0000 7f4fb7fff700 1 -- 172.21.15.6:0/3954673366 >> v1:172.21.15.40:6789/0 conn(0x7f4fc4071cd0 legacy=0x7f4fc415bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:43.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.811+0000 7f4fb7fff700 1 -- 172.21.15.6:0/3954673366 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc40cad50 con 0x7f4fc415c660 2023-07-06T19:59:43.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.811+0000 7f4fb7fff700 1 -- 172.21.15.6:0/3954673366 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f4fbc0019f0 con 0x7f4fc415c660 2023-07-06T19:59:43.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.811+0000 7f4fc9317700 1 --2- 172.21.15.6:0/3954673366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc4071900 0x7f4fc40ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:59:43.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.811+0000 7f4fb7fff700 1 -- 172.21.15.6:0/3954673366 >> v1:172.21.15.6:6789/0 conn(0x7f4fc415c660 legacy=0x7f4fc40ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:43.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.811+0000 7f4fb7fff700 1 --2- 172.21.15.6:0/3954673366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fb0003bc0 0x7f4fb0003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:43.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.811+0000 7f4fb7fff700 1 --2- 172.21.15.6:0/3954673366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb0004850 0x7f4fb0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:43.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.811+0000 7f4fb7fff700 1 --2- 172.21.15.6:0/3954673366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc4071900 0x7f4fb0005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:43.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.811+0000 7f4fb7fff700 1 -- 172.21.15.6:0/3954673366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc40cdbf0 con 0x7f4fb0004850 2023-07-06T19:59:43.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.811+0000 7f4fb7fff700 1 -- 172.21.15.6:0/3954673366 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb000bba0 con 0x7f4fb0003bc0 2023-07-06T19:59:43.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.811+0000 7f4fb7fff700 1 -- 172.21.15.6:0/3954673366 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb000bd30 con 0x7f4fc4071900 2023-07-06T19:59:43.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.812+0000 7f4fc8b16700 1 --2- 172.21.15.6:0/3954673366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb0004850 0x7f4fb0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:43.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.812+0000 7f4fc9317700 1 --2- 172.21.15.6:0/3954673366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fb0003bc0 0x7f4fb0003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:43.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.812+0000 7f4fc9b18700 1 --2- 172.21.15.6:0/3954673366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc4071900 0x7f4fb0005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:43.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.812+0000 7f4fc8b16700 1 -- 172.21.15.6:0/3954673366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc4071900 msgr2=0x7f4fb0005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:43.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.812+0000 7f4fc8b16700 1 --2- 172.21.15.6:0/3954673366 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc4071900 0x7f4fb0005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.812+0000 7f4fc8b16700 1 -- 172.21.15.6:0/3954673366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fb0003bc0 msgr2=0x7f4fb0003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:43.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.812+0000 7f4fc8b16700 1 --2- 172.21.15.6:0/3954673366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fb0003bc0 0x7f4fb0003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.812+0000 7f4fc8b16700 1 -- 172.21.15.6:0/3954673366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc00094a0 con 0x7f4fb0004850 2023-07-06T19:59:43.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.812+0000 7f4fc8b16700 1 --2- 172.21.15.6:0/3954673366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb0004850 0x7f4fb0004cc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8001940 tx=0x7f4fb0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f97c884ad7e22a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:43.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.812+0000 7f4fb7fff700 1 -- 172.21.15.6:0/3954673366 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb80052d0 con 0x7f4fb0004850 2023-07-06T19:59:43.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.812+0000 7f4fb7fff700 1 -- 172.21.15.6:0/3954673366 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb8001d70 con 0x7f4fb0004850 2023-07-06T19:59:43.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.812+0000 7f4fb7fff700 1 -- 172.21.15.6:0/3954673366 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb8003680 con 0x7f4fb0004850 2023-07-06T19:59:43.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.813+0000 7f4fcb57b700 1 -- 172.21.15.6:0/3954673366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb0004850 msgr2=0x7f4fb0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:43.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.813+0000 7f4fcb57b700 1 --2- 172.21.15.6:0/3954673366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fb0004850 0x7f4fb0004cc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4fb8001940 tx=0x7f4fb0005880 comp rx=0 tx=0).stop 2023-07-06T19:59:43.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.813+0000 7f4fc9b18700 1 -- 172.21.15.6:0/3954673366 reap_dead start 2023-07-06T19:59:43.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.813+0000 7f4fcb57b700 1 -- 172.21.15.6:0/3954673366 shutdown_connections 2023-07-06T19:59:43.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.813+0000 7f4fcb57b700 1 -- 172.21.15.6:0/3954673366 >> 172.21.15.6:0/3954673366 conn(0x7f4fc40cf960 msgr2=0x7f4fc40cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:43.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.813+0000 7f4fcb57b700 1 -- 172.21.15.6:0/3954673366 shutdown_connections 2023-07-06T19:59:43.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.813+0000 7f4fcb57b700 1 -- 172.21.15.6:0/3954673366 wait complete. 2023-07-06T19:59:43.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.814+0000 7f4fcb57b700 1 Processor -- start 2023-07-06T19:59:43.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.814+0000 7f4fcb57b700 1 -- start start 2023-07-06T19:59:43.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.815+0000 7f4fcb57b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fb0004850 0x7f4fc4155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:43.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.815+0000 7f4fcb57b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc4148d20 0x7f4fc40b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:43.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.815+0000 7f4fcb57b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc40c4010 0x7f4fc40c4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:43.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.815+0000 7f4fcb57b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc40b4e60 con 0x7f4fc40c4010 2023-07-06T19:59:43.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.815+0000 7f4fcb57b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc40b5630 con 0x7f4fc4148d20 2023-07-06T19:59:43.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.815+0000 7f4fcb57b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc40b5070 con 0x7f4fb0004850 2023-07-06T19:59:43.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.815+0000 7f4fc9b18700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc40c4010 0x7f4fc40c4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.815+0000 7f4fc9b18700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc40c4010 0x7f4fc40c4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59842/0 (socket says 172.21.15.6:59842) 2023-07-06T19:59:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.815+0000 7f4fc9b18700 1 -- 172.21.15.6:0/3394931171 learned_addr learned my addr 172.21.15.6:0/3394931171 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.815+0000 7f4fc8b16700 1 --2- 172.21.15.6:0/3394931171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc4148d20 0x7f4fc40b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.815+0000 7f4fc9317700 1 --2- 172.21.15.6:0/3394931171 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fb0004850 0x7f4fc4155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.815+0000 7f4fc9b18700 1 -- 172.21.15.6:0/3394931171 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fb0004850 msgr2=0x7f4fc4155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:43.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.815+0000 7f4fc9b18700 1 --2- 172.21.15.6:0/3394931171 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fb0004850 0x7f4fc4155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.815+0000 7f4fc9b18700 1 -- 172.21.15.6:0/3394931171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc4148d20 msgr2=0x7f4fc40b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:43.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.815+0000 7f4fc9b18700 1 --2- 172.21.15.6:0/3394931171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc4148d20 0x7f4fc40b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:43.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.815+0000 7f4fc9b18700 1 -- 172.21.15.6:0/3394931171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc40b5350 con 0x7f4fc40c4010 2023-07-06T19:59:43.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.815+0000 7f4fc8b16700 1 --2- 172.21.15.6:0/3394931171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc4148d20 0x7f4fc40b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:43.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.815+0000 7f4fc9317700 1 --2- 172.21.15.6:0/3394931171 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fb0004850 0x7f4fc4155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:43.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.815+0000 7f4fc9b18700 1 --2- 172.21.15.6:0/3394931171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc40c4010 0x7f4fc40c4480 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc000f80 tx=0x7f4fbc00e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:43.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.815+0000 7f4fb5ffb700 1 -- 172.21.15.6:0/3394931171 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc00ed50 con 0x7f4fc40c4010 2023-07-06T19:59:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.815+0000 7f4fb5ffb700 1 -- 172.21.15.6:0/3394931171 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fbc00eeb0 con 0x7f4fc40c4010 2023-07-06T19:59:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.815+0000 7f4fcb57b700 1 -- 172.21.15.6:0/3394931171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc40b3240 con 0x7f4fc40c4010 2023-07-06T19:59:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.816+0000 7f4fb5ffb700 1 -- 172.21.15.6:0/3394931171 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc013640 con 0x7f4fc40c4010 2023-07-06T19:59:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.816+0000 7f4fcb57b700 1 -- 172.21.15.6:0/3394931171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc4149190 con 0x7f4fc40c4010 2023-07-06T19:59:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.817+0000 7f4fcb57b700 1 -- 172.21.15.6:0/3394931171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc404eb90 con 0x7f4fc40c4010 2023-07-06T19:59:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.817+0000 7f4fb5ffb700 1 -- 172.21.15.6:0/3394931171 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4fbc0137a0 con 0x7f4fc40c4010 2023-07-06T19:59:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.817+0000 7f4fb5ffb700 1 --2- 172.21.15.6:0/3394931171 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4fa806ace0 0x7f4fa806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:43.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.817+0000 7f4fb5ffb700 1 -- 172.21.15.6:0/3394931171 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4fbc089dd0 con 0x7f4fc40c4010 2023-07-06T19:59:43.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.817+0000 7f4fc9317700 1 --2- 172.21.15.6:0/3394931171 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4fa806ace0 0x7f4fa806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:43.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.818+0000 7f4fc9317700 1 --2- 172.21.15.6:0/3394931171 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4fa806ace0 0x7f4fa806d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4fc40aced0 tx=0x7f4fc0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:43.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:43.822+0000 7f4fb5ffb700 1 -- 172.21.15.6:0/3394931171 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4fbc054b50 con 0x7f4fc40c4010 2023-07-06T19:59:44.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.019+0000 7f4fcb57b700 1 -- 172.21.15.6:0/3394931171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4fc40c9f00 con 0x7f4fc40c4010 2023-07-06T19:59:44.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.020+0000 7f4fb5ffb700 1 -- 172.21.15.6:0/3394931171 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4fbc08b0a0 con 0x7f4fc40c4010 2023-07-06T19:59:44.022 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T19:59:44.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.022+0000 7f4fcb57b700 1 -- 172.21.15.6:0/3394931171 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4fa806ace0 msgr2=0x7f4fa806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:44.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.022+0000 7f4fcb57b700 1 --2- 172.21.15.6:0/3394931171 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4fa806ace0 0x7f4fa806d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4fc40aced0 tx=0x7f4fc0008040 comp rx=0 tx=0).stop 2023-07-06T19:59:44.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.022+0000 7f4fcb57b700 1 -- 172.21.15.6:0/3394931171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc40c4010 msgr2=0x7f4fc40c4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:44.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.022+0000 7f4fcb57b700 1 --2- 172.21.15.6:0/3394931171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc40c4010 0x7f4fc40c4480 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc000f80 tx=0x7f4fbc00e440 comp rx=0 tx=0).stop 2023-07-06T19:59:44.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.022+0000 7f4fcb57b700 1 -- 172.21.15.6:0/3394931171 shutdown_connections 2023-07-06T19:59:44.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.022+0000 7f4fcb57b700 1 --2- 172.21.15.6:0/3394931171 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4fa806ace0 0x7f4fa806d190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.022+0000 7f4fcb57b700 1 --2- 172.21.15.6:0/3394931171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc40c4010 0x7f4fc40c4480 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.022+0000 7f4fcb57b700 1 --2- 172.21.15.6:0/3394931171 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fb0004850 0x7f4fc4155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.022+0000 7f4fcb57b700 1 --2- 172.21.15.6:0/3394931171 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc4148d20 0x7f4fc40b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.022+0000 7f4fcb57b700 1 -- 172.21.15.6:0/3394931171 >> 172.21.15.6:0/3394931171 conn(0x7f4fc40cf960 msgr2=0x7f4fc415ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:44.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.022+0000 7f4fcb57b700 1 -- 172.21.15.6:0/3394931171 shutdown_connections 2023-07-06T19:59:44.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.022+0000 7f4fcb57b700 1 -- 172.21.15.6:0/3394931171 wait complete. 2023-07-06T19:59:44.036 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T19:59:44.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.163+0000 7fc6c7a8e700 1 Processor -- start 2023-07-06T19:59:44.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.163+0000 7fc6c7a8e700 1 -- start start 2023-07-06T19:59:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.164+0000 7fc6c7a8e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6c00d15e0 0x7fc6c006e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.164+0000 7fc6c7a8e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6c00ce860 0x7fc6c00cece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.164+0000 7fc6c7a8e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6c00cd300 con 0x7fc6c015a520 2023-07-06T19:59:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.164+0000 7fc6c7a8e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c00b0290 con 0x7fc6c00d15e0 2023-07-06T19:59:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.164+0000 7fc6c7a8e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c00ccd80 con 0x7fc6c00ce860 2023-07-06T19:59:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.164+0000 7fc6c5029700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6c00d15e0 0x7fc6c006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.164+0000 7fc6c5029700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6c00d15e0 0x7fc6c006e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59848/0 (socket says 172.21.15.6:59848) 2023-07-06T19:59:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.164+0000 7fc6c5029700 1 -- 172.21.15.6:0/647512185 learned_addr learned my addr 172.21.15.6:0/647512185 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.164+0000 7fc6c602b700 1 --2- 172.21.15.6:0/647512185 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6c00ce860 0x7fc6c00cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:44.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.164+0000 7fc6c5029700 1 -- 172.21.15.6:0/647512185 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6c00ce860 msgr2=0x7fc6c00cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:44.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.164+0000 7fc6c5029700 1 --2- 172.21.15.6:0/647512185 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6c00ce860 0x7fc6c00cece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.164+0000 7fc6c5029700 1 -- 172.21.15.6:0/647512185 >> v1:172.21.15.40:6789/0 conn(0x7fc6c015a520 legacy=0x7fc6c006dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:44.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.164+0000 7fc6c5029700 1 -- 172.21.15.6:0/647512185 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c00cd020 con 0x7fc6c00d15e0 2023-07-06T19:59:44.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.164+0000 7fc6c5029700 1 --2- 172.21.15.6:0/647512185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c00d15e0 0x7fc6c006e320 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00098f0 tx=0x7fc6b0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4090dcc2cb12d6c server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:44.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.165+0000 7fc6c4828700 1 -- 172.21.15.6:0/647512185 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0004230 con 0x7fc6c00d15e0 2023-07-06T19:59:44.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.165+0000 7fc6c4828700 1 -- 172.21.15.6:0/647512185 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b0004390 con 0x7fc6c00d15e0 2023-07-06T19:59:44.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.165+0000 7fc6c4828700 1 -- 172.21.15.6:0/647512185 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b00036a0 con 0x7fc6c00d15e0 2023-07-06T19:59:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.165+0000 7fc6c7a8e700 1 -- 172.21.15.6:0/647512185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c00d15e0 msgr2=0x7fc6c006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.165+0000 7fc6c7a8e700 1 --2- 172.21.15.6:0/647512185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c00d15e0 0x7fc6c006e320 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00098f0 tx=0x7fc6b0009c00 comp rx=0 tx=0).stop 2023-07-06T19:59:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.165+0000 7fc6c7a8e700 1 -- 172.21.15.6:0/647512185 shutdown_connections 2023-07-06T19:59:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.165+0000 7fc6c7a8e700 1 --2- 172.21.15.6:0/647512185 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6c00ce860 0x7fc6c00cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.165+0000 7fc6c7a8e700 1 --2- 172.21.15.6:0/647512185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c00d15e0 0x7fc6c006e320 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.165+0000 7fc6c7a8e700 1 -- 172.21.15.6:0/647512185 >> 172.21.15.6:0/647512185 conn(0x7fc6c00ce120 msgr2=0x7fc6c00d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.165+0000 7fc6c7a8e700 1 -- 172.21.15.6:0/647512185 shutdown_connections 2023-07-06T19:59:44.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.165+0000 7fc6c7a8e700 1 -- 172.21.15.6:0/647512185 wait complete. 2023-07-06T19:59:44.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.166+0000 7fc6c7a8e700 1 Processor -- start 2023-07-06T19:59:44.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.166+0000 7fc6c7a8e700 1 -- start start 2023-07-06T19:59:44.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.167+0000 7fc6c7a8e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6c00ce860 0x7fc6c00b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:44.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.167+0000 7fc6c7a8e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c00d15e0 0x7fc6c00aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:44.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.167+0000 7fc6c7a8e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6c015a520 0x7fc6c0155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:44.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.167+0000 7fc6c7a8e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c00caa90 con 0x7fc6c00d15e0 2023-07-06T19:59:44.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.167+0000 7fc6c7a8e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c006be40 con 0x7fc6c00ce860 2023-07-06T19:59:44.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.167+0000 7fc6c7a8e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c006c120 con 0x7fc6c015a520 2023-07-06T19:59:44.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.167+0000 7fc6c5029700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c00d15e0 0x7fc6c00aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:44.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.167+0000 7fc6c5029700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c00d15e0 0x7fc6c00aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59854/0 (socket says 172.21.15.6:59854) 2023-07-06T19:59:44.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.167+0000 7fc6c5029700 1 -- 172.21.15.6:0/3422359758 learned_addr learned my addr 172.21.15.6:0/3422359758 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:44.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.168+0000 7fc6c602b700 1 --2- 172.21.15.6:0/3422359758 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6c015a520 0x7fc6c0155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:44.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.168+0000 7fc6c5029700 1 -- 172.21.15.6:0/3422359758 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6c015a520 msgr2=0x7fc6c0155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:44.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.168+0000 7fc6c5029700 1 --2- 172.21.15.6:0/3422359758 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6c015a520 0x7fc6c0155310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.168+0000 7fc6c582a700 1 --2- 172.21.15.6:0/3422359758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6c00ce860 0x7fc6c00b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:44.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.168+0000 7fc6c5029700 1 -- 172.21.15.6:0/3422359758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6c00ce860 msgr2=0x7fc6c00b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:44.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.168+0000 7fc6c5029700 1 --2- 172.21.15.6:0/3422359758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6c00ce860 0x7fc6c00b0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.168+0000 7fc6c5029700 1 -- 172.21.15.6:0/3422359758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b0009550 con 0x7fc6c00d15e0 2023-07-06T19:59:44.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.168+0000 7fc6c582a700 1 --2- 172.21.15.6:0/3422359758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6c00ce860 0x7fc6c00b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:44.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.168+0000 7fc6c5029700 1 --2- 172.21.15.6:0/3422359758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c00d15e0 0x7fc6c00aed90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009130 tx=0x7fc6b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:44.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.168+0000 7fc6b67fc700 1 -- 172.21.15.6:0/3422359758 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b0003e30 con 0x7fc6c00d15e0 2023-07-06T19:59:44.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.168+0000 7fc6b67fc700 1 -- 172.21.15.6:0/3422359758 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b001f070 con 0x7fc6c00d15e0 2023-07-06T19:59:44.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.168+0000 7fc6c7a8e700 1 -- 172.21.15.6:0/3422359758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c006c400 con 0x7fc6c00d15e0 2023-07-06T19:59:44.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.168+0000 7fc6b67fc700 1 -- 172.21.15.6:0/3422359758 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000b8a0 con 0x7fc6c00d15e0 2023-07-06T19:59:44.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.168+0000 7fc6c7a8e700 1 -- 172.21.15.6:0/3422359758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c00c9100 con 0x7fc6c00d15e0 2023-07-06T19:59:44.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.169+0000 7fc6c7a8e700 1 -- 172.21.15.6:0/3422359758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c006c920 con 0x7fc6c00d15e0 2023-07-06T19:59:44.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.170+0000 7fc6b67fc700 1 -- 172.21.15.6:0/3422359758 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc6b0021030 con 0x7fc6c00d15e0 2023-07-06T19:59:44.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.170+0000 7fc6b67fc700 1 --2- 172.21.15.6:0/3422359758 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc6a406ace0 0x7fc6a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:44.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.170+0000 7fc6b67fc700 1 -- 172.21.15.6:0/3422359758 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc6b008ae30 con 0x7fc6c00d15e0 2023-07-06T19:59:44.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.170+0000 7fc6c582a700 1 --2- 172.21.15.6:0/3422359758 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc6a406ace0 0x7fc6a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:44.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.170+0000 7fc6c582a700 1 --2- 172.21.15.6:0/3422359758 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc6a406ace0 0x7fc6a406d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc006fd0 tx=0x7fc6bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:44.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.174+0000 7fc6b67fc700 1 -- 172.21.15.6:0/3422359758 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc6c006c920 con 0x7fc6c00d15e0 2023-07-06T19:59:44.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.371+0000 7fc6c7a8e700 1 -- 172.21.15.6:0/3422359758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc6c006c920 con 0x7fc6c00d15e0 2023-07-06T19:59:44.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.372+0000 7fc6b67fc700 1 -- 172.21.15.6:0/3422359758 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc6c006c920 con 0x7fc6c00d15e0 2023-07-06T19:59:44.383 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-06T19:59:44.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.374+0000 7fc6c7a8e700 1 -- 172.21.15.6:0/3422359758 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc6a406ace0 msgr2=0x7fc6a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:44.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.374+0000 7fc6c7a8e700 1 --2- 172.21.15.6:0/3422359758 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc6a406ace0 0x7fc6a406d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc006fd0 tx=0x7fc6bc008040 comp rx=0 tx=0).stop 2023-07-06T19:59:44.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.374+0000 7fc6c7a8e700 1 -- 172.21.15.6:0/3422359758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c00d15e0 msgr2=0x7fc6c00aed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:44.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.374+0000 7fc6c7a8e700 1 --2- 172.21.15.6:0/3422359758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c00d15e0 0x7fc6c00aed90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009130 tx=0x7fc6b0004750 comp rx=0 tx=0).stop 2023-07-06T19:59:44.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.374+0000 7fc6c7a8e700 1 -- 172.21.15.6:0/3422359758 shutdown_connections 2023-07-06T19:59:44.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.374+0000 7fc6c7a8e700 1 --2- 172.21.15.6:0/3422359758 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc6a406ace0 0x7fc6a406d190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.374+0000 7fc6c7a8e700 1 --2- 172.21.15.6:0/3422359758 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc6c015a520 0x7fc6c0155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.374+0000 7fc6c7a8e700 1 --2- 172.21.15.6:0/3422359758 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6c00ce860 0x7fc6c00b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.374+0000 7fc6c7a8e700 1 --2- 172.21.15.6:0/3422359758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c00d15e0 0x7fc6c00aed90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.374+0000 7fc6c7a8e700 1 -- 172.21.15.6:0/3422359758 >> 172.21.15.6:0/3422359758 conn(0x7fc6c00ce120 msgr2=0x7fc6c0156640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:44.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.374+0000 7fc6c7a8e700 1 -- 172.21.15.6:0/3422359758 shutdown_connections 2023-07-06T19:59:44.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.374+0000 7fc6c7a8e700 1 -- 172.21.15.6:0/3422359758 wait complete. 2023-07-06T19:59:44.390 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T19:59:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.515+0000 7f92c71a6700 1 Processor -- start 2023-07-06T19:59:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.515+0000 7f92c71a6700 1 -- start start 2023-07-06T19:59:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.516+0000 7f92c71a6700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f92c00b1f10 0x7f92c00cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.516+0000 7f92c71a6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f92c0160e00 0x7f92c006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.516+0000 7f92c71a6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92c015d910 0x7f92c006c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.516+0000 7f92c71a6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c015cc60 con 0x7f92c0160e00 2023-07-06T19:59:44.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.516+0000 7f92c71a6700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c015d480 con 0x7f92c00b1f10 2023-07-06T19:59:44.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.516+0000 7f92c71a6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c015ce70 con 0x7f92c015d910 2023-07-06T19:59:44.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.516+0000 7f92bffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f92c0160e00 0x7f92c006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:44.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.516+0000 7f92bffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f92c0160e00 0x7f92c006bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59860/0 (socket says 172.21.15.6:59860) 2023-07-06T19:59:44.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.516+0000 7f92bffff700 1 -- 172.21.15.6:0/466339791 learned_addr learned my addr 172.21.15.6:0/466339791 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:44.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.516+0000 7f92c5743700 1 --2- 172.21.15.6:0/466339791 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92c015d910 0x7f92c006c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:44.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.516+0000 7f92c4f42700 1 --2- 172.21.15.6:0/466339791 >> v2:172.21.15.40:3300/0 conn(0x7f92c00b1f10 0x7f92c00cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:44.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.517+0000 7f92bffff700 1 -- 172.21.15.6:0/466339791 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92c015d910 msgr2=0x7f92c006c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:44.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.517+0000 7f92bffff700 1 --2- 172.21.15.6:0/466339791 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92c015d910 0x7f92c006c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.517+0000 7f92bffff700 1 -- 172.21.15.6:0/466339791 >> v2:172.21.15.40:3300/0 conn(0x7f92c00b1f10 msgr2=0x7f92c00cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:44.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.517+0000 7f92bffff700 1 --2- 172.21.15.6:0/466339791 >> v2:172.21.15.40:3300/0 conn(0x7f92c00b1f10 0x7f92c00cd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.517+0000 7f92bffff700 1 -- 172.21.15.6:0/466339791 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c00cddd0 con 0x7f92c0160e00 2023-07-06T19:59:44.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.517+0000 7f92bffff700 1 --2- 172.21.15.6:0/466339791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92c0160e00 0x7f92c006bdb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f92c006d860 tx=0x7f92ac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875806532ab0a35d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:44.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.517+0000 7f92bf7fe700 1 -- 172.21.15.6:0/466339791 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac011830 con 0x7f92c0160e00 2023-07-06T19:59:44.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.517+0000 7f92bf7fe700 1 -- 172.21.15.6:0/466339791 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ac011990 con 0x7f92c0160e00 2023-07-06T19:59:44.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.517+0000 7f92bf7fe700 1 -- 172.21.15.6:0/466339791 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac011d20 con 0x7f92c0160e00 2023-07-06T19:59:44.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.518+0000 7f92c71a6700 1 -- 172.21.15.6:0/466339791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92c0160e00 msgr2=0x7f92c006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:44.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.518+0000 7f92c71a6700 1 --2- 172.21.15.6:0/466339791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92c0160e00 0x7f92c006bdb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f92c006d860 tx=0x7f92ac009bd0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.518+0000 7f92c71a6700 1 -- 172.21.15.6:0/466339791 shutdown_connections 2023-07-06T19:59:44.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.518+0000 7f92c71a6700 1 --2- 172.21.15.6:0/466339791 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92c015d910 0x7f92c006c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.518+0000 7f92c71a6700 1 --2- 172.21.15.6:0/466339791 >> v2:172.21.15.40:3300/0 conn(0x7f92c00b1f10 0x7f92c00cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.518+0000 7f92c71a6700 1 --2- 172.21.15.6:0/466339791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92c0160e00 0x7f92c006bdb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.518+0000 7f92c71a6700 1 -- 172.21.15.6:0/466339791 >> 172.21.15.6:0/466339791 conn(0x7f92c00d2c70 msgr2=0x7f92c00d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:44.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.518+0000 7f92c71a6700 1 -- 172.21.15.6:0/466339791 shutdown_connections 2023-07-06T19:59:44.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.518+0000 7f92c71a6700 1 -- 172.21.15.6:0/466339791 wait complete. 2023-07-06T19:59:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.519+0000 7f92c71a6700 1 Processor -- start 2023-07-06T19:59:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.519+0000 7f92c71a6700 1 -- start start 2023-07-06T19:59:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.520+0000 7f92c71a6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92c00b1f10 0x7f92c0149290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.520+0000 7f92c71a6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c015d910 0x7f92c00c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.520+0000 7f92c71a6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92c0160e00 0x7f92c015ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:44.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.520+0000 7f92c71a6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c00b6d10 con 0x7f92c0160e00 2023-07-06T19:59:44.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.520+0000 7f92c71a6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c00c7240 con 0x7f92c015d910 2023-07-06T19:59:44.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.520+0000 7f92c71a6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c00c7520 con 0x7f92c00b1f10 2023-07-06T19:59:44.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.520+0000 7f92c5743700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92c0160e00 0x7f92c015ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:44.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.520+0000 7f92c5743700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92c0160e00 0x7f92c015ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59870/0 (socket says 172.21.15.6:59870) 2023-07-06T19:59:44.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.520+0000 7f92c5743700 1 -- 172.21.15.6:0/1067916835 learned_addr learned my addr 172.21.15.6:0/1067916835 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:44.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.520+0000 7f92bffff700 1 --2- 172.21.15.6:0/1067916835 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c015d910 0x7f92c00c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:44.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.520+0000 7f92c4f42700 1 --2- 172.21.15.6:0/1067916835 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92c00b1f10 0x7f92c0149290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:44.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.520+0000 7f92c5743700 1 -- 172.21.15.6:0/1067916835 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92c00b1f10 msgr2=0x7f92c0149290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:44.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.520+0000 7f92c5743700 1 --2- 172.21.15.6:0/1067916835 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92c00b1f10 0x7f92c0149290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.520+0000 7f92c5743700 1 -- 172.21.15.6:0/1067916835 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c015d910 msgr2=0x7f92c00c67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:44.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.520+0000 7f92c5743700 1 --2- 172.21.15.6:0/1067916835 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c015d910 0x7f92c00c67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.520+0000 7f92c5743700 1 -- 172.21.15.6:0/1067916835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ac009550 con 0x7f92c0160e00 2023-07-06T19:59:44.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.520+0000 7f92c5743700 1 --2- 172.21.15.6:0/1067916835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92c0160e00 0x7f92c015ee90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f92b800efc0 tx=0x7f92b800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.521+0000 7f92bd7fa700 1 -- 172.21.15.6:0/1067916835 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b8009ea0 con 0x7f92c0160e00 2023-07-06T19:59:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.521+0000 7f92bd7fa700 1 -- 172.21.15.6:0/1067916835 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b800f040 con 0x7f92c0160e00 2023-07-06T19:59:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.521+0000 7f92bd7fa700 1 -- 172.21.15.6:0/1067916835 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b800ced0 con 0x7f92c0160e00 2023-07-06T19:59:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.521+0000 7f92c71a6700 1 -- 172.21.15.6:0/1067916835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c00b6650 con 0x7f92c0160e00 2023-07-06T19:59:44.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.521+0000 7f92c71a6700 1 -- 172.21.15.6:0/1067916835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c01497d0 con 0x7f92c0160e00 2023-07-06T19:59:44.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.522+0000 7f92c71a6700 1 -- 172.21.15.6:0/1067916835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c004eb90 con 0x7f92c0160e00 2023-07-06T19:59:44.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.522+0000 7f92bd7fa700 1 -- 172.21.15.6:0/1067916835 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f92b8014480 con 0x7f92c0160e00 2023-07-06T19:59:44.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.522+0000 7f92bd7fa700 1 --2- 172.21.15.6:0/1067916835 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f92a406ace0 0x7f92a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:44.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.522+0000 7f92bd7fa700 1 -- 172.21.15.6:0/1067916835 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f92b8089ea0 con 0x7f92c0160e00 2023-07-06T19:59:44.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.523+0000 7f92c4f42700 1 --2- 172.21.15.6:0/1067916835 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f92a406ace0 0x7f92a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:44.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.523+0000 7f92c4f42700 1 --2- 172.21.15.6:0/1067916835 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f92a406ace0 0x7f92a406d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f92b4009be0 tx=0x7f92b4009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:44.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.527+0000 7f92bd7fa700 1 -- 172.21.15.6:0/1067916835 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f92b8054cb0 con 0x7f92c0160e00 2023-07-06T19:59:44.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.722+0000 7f92c71a6700 1 -- 172.21.15.6:0/1067916835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f92c00c6540 con 0x7f92c0160e00 2023-07-06T19:59:44.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.722+0000 7f92bd7fa700 1 -- 172.21.15.6:0/1067916835 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f92b80180a0 con 0x7f92c0160e00 2023-07-06T19:59:44.725 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T19:59:44.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.725+0000 7f92c71a6700 1 -- 172.21.15.6:0/1067916835 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f92a406ace0 msgr2=0x7f92a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:44.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.725+0000 7f92c71a6700 1 --2- 172.21.15.6:0/1067916835 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f92a406ace0 0x7f92a406d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f92b4009be0 tx=0x7f92b4009210 comp rx=0 tx=0).stop 2023-07-06T19:59:44.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.725+0000 7f92c71a6700 1 -- 172.21.15.6:0/1067916835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92c0160e00 msgr2=0x7f92c015ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:44.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.725+0000 7f92c71a6700 1 --2- 172.21.15.6:0/1067916835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92c0160e00 0x7f92c015ee90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f92b800efc0 tx=0x7f92b800c3a0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.725+0000 7f92c71a6700 1 -- 172.21.15.6:0/1067916835 shutdown_connections 2023-07-06T19:59:44.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.725+0000 7f92c71a6700 1 --2- 172.21.15.6:0/1067916835 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f92a406ace0 0x7f92a406d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.725+0000 7f92c71a6700 1 --2- 172.21.15.6:0/1067916835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92c0160e00 0x7f92c015ee90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.725+0000 7f92c71a6700 1 --2- 172.21.15.6:0/1067916835 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92c00b1f10 0x7f92c0149290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.725+0000 7f92c71a6700 1 --2- 172.21.15.6:0/1067916835 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92c015d910 0x7f92c00c67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.725+0000 7f92c71a6700 1 -- 172.21.15.6:0/1067916835 >> 172.21.15.6:0/1067916835 conn(0x7f92c00d2c70 msgr2=0x7f92c006bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:44.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.725+0000 7f92c71a6700 1 -- 172.21.15.6:0/1067916835 shutdown_connections 2023-07-06T19:59:44.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.725+0000 7f92c71a6700 1 -- 172.21.15.6:0/1067916835 wait complete. 2023-07-06T19:59:44.739 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T19:59:44.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.862+0000 7fa0d5433700 1 Processor -- start 2023-07-06T19:59:44.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.862+0000 7fa0d5433700 1 -- start start 2023-07-06T19:59:44.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.863+0000 7fa0d5433700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa0d015ce50 0x7fa0d00cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:44.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.863+0000 7fa0d5433700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0d015d220 0x7fa0d006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:44.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.863+0000 7fa0d5433700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d0160060 con 0x7fa0d015d670 2023-07-06T19:59:44.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.863+0000 7fa0d5433700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d00d1740 con 0x7fa0d015ce50 2023-07-06T19:59:44.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.863+0000 7fa0d5433700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d00cd800 con 0x7fa0d015d220 2023-07-06T19:59:44.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.863+0000 7fa0ceffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa0d015ce50 0x7fa0d00cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:44.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.863+0000 7fa0ce7fc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0d015d220 0x7fa0d006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:44.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.863+0000 7fa0ceffd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa0d015ce50 0x7fa0d00cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:38910/0 (socket says 172.21.15.6:38910) 2023-07-06T19:59:44.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.863+0000 7fa0ceffd700 1 -- 172.21.15.6:0/2845486265 learned_addr learned my addr 172.21.15.6:0/2845486265 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:44.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.863+0000 7fa0cf7fe700 1 --1- 172.21.15.6:0/2845486265 >> v1:172.21.15.40:6789/0 conn(0x7fa0d015d670 0x7fa0d006a060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:50958/0 (socket says 172.21.15.6:50958) 2023-07-06T19:59:44.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.863+0000 7fa0ce7fc700 1 -- 172.21.15.6:0/2845486265 >> v2:172.21.15.40:3300/0 conn(0x7fa0d015ce50 msgr2=0x7fa0d00cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:44.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.863+0000 7fa0ce7fc700 1 --2- 172.21.15.6:0/2845486265 >> v2:172.21.15.40:3300/0 conn(0x7fa0d015ce50 0x7fa0d00cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.863+0000 7fa0ce7fc700 1 -- 172.21.15.6:0/2845486265 >> v1:172.21.15.40:6789/0 conn(0x7fa0d015d670 legacy=0x7fa0d006a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:44.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.863+0000 7fa0ce7fc700 1 -- 172.21.15.6:0/2845486265 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d01602b0 con 0x7fa0d015d220 2023-07-06T19:59:44.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.863+0000 7fa0ceffd700 1 --2- 172.21.15.6:0/2845486265 >> v2:172.21.15.40:3300/0 conn(0x7fa0d015ce50 0x7fa0d00cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:59:44.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.864+0000 7fa0ce7fc700 1 --2- 172.21.15.6:0/2845486265 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0d015d220 0x7fa0d006bdb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4009840 tx=0x7fa0c4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=178b6e2c27aef82b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:44.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.864+0000 7fa0cdffb700 1 -- 172.21.15.6:0/2845486265 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4011830 con 0x7fa0d015d220 2023-07-06T19:59:44.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.864+0000 7fa0cdffb700 1 -- 172.21.15.6:0/2845486265 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c4011990 con 0x7fa0d015d220 2023-07-06T19:59:44.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.864+0000 7fa0cdffb700 1 -- 172.21.15.6:0/2845486265 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c4011d20 con 0x7fa0d015d220 2023-07-06T19:59:44.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.864+0000 7fa0d5433700 1 -- 172.21.15.6:0/2845486265 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0d015d220 msgr2=0x7fa0d006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:44.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.864+0000 7fa0d5433700 1 --2- 172.21.15.6:0/2845486265 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0d015d220 0x7fa0d006bdb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4009840 tx=0x7fa0c4009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:44.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.864+0000 7fa0d5433700 1 -- 172.21.15.6:0/2845486265 shutdown_connections 2023-07-06T19:59:44.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.864+0000 7fa0d5433700 1 --2- 172.21.15.6:0/2845486265 >> v2:172.21.15.40:3300/0 conn(0x7fa0d015ce50 0x7fa0d00cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.864+0000 7fa0d5433700 1 --2- 172.21.15.6:0/2845486265 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0d015d220 0x7fa0d006bdb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.864+0000 7fa0d5433700 1 -- 172.21.15.6:0/2845486265 >> 172.21.15.6:0/2845486265 conn(0x7fa0d00d3880 msgr2=0x7fa0d00cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.865+0000 7fa0d5433700 1 -- 172.21.15.6:0/2845486265 shutdown_connections 2023-07-06T19:59:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.865+0000 7fa0d5433700 1 -- 172.21.15.6:0/2845486265 wait complete. 2023-07-06T19:59:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.866+0000 7fa0d5433700 1 Processor -- start 2023-07-06T19:59:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.866+0000 7fa0d5433700 1 -- start start 2023-07-06T19:59:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.867+0000 7fa0d5433700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0d015ce50 0x7fa0d0156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:44.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.867+0000 7fa0d5433700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0d015d220 0x7fa0d01578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:44.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.867+0000 7fa0d5433700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0d015d670 0x7fa0d01f1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:44.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.867+0000 7fa0d5433700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d0151920 con 0x7fa0d015d670 2023-07-06T19:59:44.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.867+0000 7fa0d5433700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d0158870 con 0x7fa0d015ce50 2023-07-06T19:59:44.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.867+0000 7fa0d5433700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d0157fd0 con 0x7fa0d015d220 2023-07-06T19:59:44.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.867+0000 7fa0cf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0d015d670 0x7fa0d01f1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.867+0000 7fa0cf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0d015d670 0x7fa0d01f1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59884/0 (socket says 172.21.15.6:59884) 2023-07-06T19:59:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.867+0000 7fa0cf7fe700 1 -- 172.21.15.6:0/3235856503 learned_addr learned my addr 172.21.15.6:0/3235856503 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.867+0000 7fa0ce7fc700 1 --2- 172.21.15.6:0/3235856503 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0d015d220 0x7fa0d01578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.867+0000 7fa0ceffd700 1 --2- 172.21.15.6:0/3235856503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0d015ce50 0x7fa0d0156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.867+0000 7fa0cf7fe700 1 -- 172.21.15.6:0/3235856503 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0d015d220 msgr2=0x7fa0d01578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.867+0000 7fa0cf7fe700 1 --2- 172.21.15.6:0/3235856503 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0d015d220 0x7fa0d01578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.867+0000 7fa0cf7fe700 1 -- 172.21.15.6:0/3235856503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0d015ce50 msgr2=0x7fa0d0156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.867+0000 7fa0cf7fe700 1 --2- 172.21.15.6:0/3235856503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0d015ce50 0x7fa0d0156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.867+0000 7fa0cf7fe700 1 -- 172.21.15.6:0/3235856503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c0009550 con 0x7fa0d015d670 2023-07-06T19:59:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.867+0000 7fa0cf7fe700 1 --2- 172.21.15.6:0/3235856503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0d015d670 0x7fa0d01f1510 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800cbd0 tx=0x7fa0c800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.867+0000 7fa0b77fe700 1 -- 172.21.15.6:0/3235856503 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c800abb0 con 0x7fa0d015d670 2023-07-06T19:59:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.868+0000 7fa0b77fe700 1 -- 172.21.15.6:0/3235856503 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c800ad10 con 0x7fa0d015d670 2023-07-06T19:59:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.868+0000 7fa0b77fe700 1 -- 172.21.15.6:0/3235856503 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8007270 con 0x7fa0d015d670 2023-07-06T19:59:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.868+0000 7fa0d5433700 1 -- 172.21.15.6:0/3235856503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0c40094a0 con 0x7fa0d015d670 2023-07-06T19:59:44.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.868+0000 7fa0d5433700 1 -- 172.21.15.6:0/3235856503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d0158590 con 0x7fa0d015d670 2023-07-06T19:59:44.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.868+0000 7fa0d5433700 1 -- 172.21.15.6:0/3235856503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d0074200 con 0x7fa0d015d670 2023-07-06T19:59:44.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.869+0000 7fa0b77fe700 1 -- 172.21.15.6:0/3235856503 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa0c80073d0 con 0x7fa0d015d670 2023-07-06T19:59:44.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.869+0000 7fa0b77fe700 1 --2- 172.21.15.6:0/3235856503 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa0bc06ace0 0x7fa0bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:44.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.869+0000 7fa0b77fe700 1 -- 172.21.15.6:0/3235856503 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa0c80895c0 con 0x7fa0d015d670 2023-07-06T19:59:44.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.869+0000 7fa0ceffd700 1 --2- 172.21.15.6:0/3235856503 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa0bc06ace0 0x7fa0bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:44.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.870+0000 7fa0ceffd700 1 --2- 172.21.15.6:0/3235856503 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa0bc06ace0 0x7fa0bc06d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0009c50 tx=0x7fa0c0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:44.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:44.874+0000 7fa0b77fe700 1 -- 172.21.15.6:0/3235856503 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa0c8054350 con 0x7fa0d015d670 2023-07-06T19:59:45.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.076+0000 7fa0d5433700 1 -- 172.21.15.6:0/3235856503 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0d006b4e0 con 0x7fa0d015d670 2023-07-06T19:59:45.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.077+0000 7fa0b77fe700 1 -- 172.21.15.6:0/3235856503 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20059 (secure 0 0 0) 0x7fa0c8017090 con 0x7fa0d015d670 2023-07-06T19:59:45.079 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:45.080 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":29,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:59:33.917851+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T19:58:51.062712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T19:58:52.130350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T19:58:55.785128+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:59:45.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.079+0000 7fa0d5433700 1 -- 172.21.15.6:0/3235856503 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa0bc06ace0 msgr2=0x7fa0bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:45.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.079+0000 7fa0d5433700 1 --2- 172.21.15.6:0/3235856503 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa0bc06ace0 0x7fa0bc06d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0009c50 tx=0x7fa0c0008040 comp rx=0 tx=0).stop 2023-07-06T19:59:45.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.079+0000 7fa0d5433700 1 -- 172.21.15.6:0/3235856503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0d015d670 msgr2=0x7fa0d01f1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:45.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.079+0000 7fa0d5433700 1 --2- 172.21.15.6:0/3235856503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0d015d670 0x7fa0d01f1510 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800cbd0 tx=0x7fa0c800cf90 comp rx=0 tx=0).stop 2023-07-06T19:59:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.079+0000 7fa0d5433700 1 -- 172.21.15.6:0/3235856503 shutdown_connections 2023-07-06T19:59:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.079+0000 7fa0d5433700 1 --2- 172.21.15.6:0/3235856503 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa0bc06ace0 0x7fa0bc06d190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.079+0000 7fa0d5433700 1 --2- 172.21.15.6:0/3235856503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0d015d670 0x7fa0d01f1510 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.079+0000 7fa0d5433700 1 --2- 172.21.15.6:0/3235856503 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0d015ce50 0x7fa0d0156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.079+0000 7fa0d5433700 1 --2- 172.21.15.6:0/3235856503 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0d015d220 0x7fa0d01578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.079+0000 7fa0d5433700 1 -- 172.21.15.6:0/3235856503 >> 172.21.15.6:0/3235856503 conn(0x7fa0d00d3880 msgr2=0x7fa0d0158fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:45.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.079+0000 7fa0d5433700 1 -- 172.21.15.6:0/3235856503 shutdown_connections 2023-07-06T19:59:45.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.079+0000 7fa0d5433700 1 -- 172.21.15.6:0/3235856503 wait complete. 2023-07-06T19:59:45.094 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T19:58:38.767727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T19:58:45.759808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T19:58:51.062712+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T19:58:52.130350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T19:58:55.785128+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T19:59:45.095 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T19:59:45.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.221+0000 7f35e18b2700 1 Processor -- start 2023-07-06T19:59:45.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.221+0000 7f35e18b2700 1 -- start start 2023-07-06T19:59:45.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.222+0000 7f35e18b2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f35dc160e00 0x7f35dc06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:45.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.222+0000 7f35e18b2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f35dc15d910 0x7f35dc06c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:45.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.222+0000 7f35e18b2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35dc15d480 con 0x7f35dc0b1f10 2023-07-06T19:59:45.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.222+0000 7f35e18b2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35dc15cc60 con 0x7f35dc160e00 2023-07-06T19:59:45.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.222+0000 7f35e18b2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35dc15ce70 con 0x7f35dc15d910 2023-07-06T19:59:45.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.222+0000 7f35da7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f35dc160e00 0x7f35dc06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:45.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.222+0000 7f35da7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f35dc160e00 0x7f35dc06bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59888/0 (socket says 172.21.15.6:59888) 2023-07-06T19:59:45.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.222+0000 7f35da7fc700 1 -- 172.21.15.6:0/40243466 learned_addr learned my addr 172.21.15.6:0/40243466 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:45.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.222+0000 7f35db7fe700 1 --2- 172.21.15.6:0/40243466 >> v2:172.21.15.40:3300/0 conn(0x7f35dc15d910 0x7f35dc06c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:45.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.222+0000 7f35da7fc700 1 -- 172.21.15.6:0/40243466 >> v2:172.21.15.40:3300/0 conn(0x7f35dc15d910 msgr2=0x7f35dc06c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:45.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.222+0000 7f35da7fc700 1 --2- 172.21.15.6:0/40243466 >> v2:172.21.15.40:3300/0 conn(0x7f35dc15d910 0x7f35dc06c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.222+0000 7f35da7fc700 1 -- 172.21.15.6:0/40243466 >> v1:172.21.15.40:6789/0 conn(0x7f35dc0b1f10 legacy=0x7f35dc0cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:45.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.222+0000 7f35da7fc700 1 -- 172.21.15.6:0/40243466 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35dc0cddd0 con 0x7f35dc160e00 2023-07-06T19:59:45.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.223+0000 7f35da7fc700 1 --2- 172.21.15.6:0/40243466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35dc160e00 0x7f35dc06bdb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f35dc08be80 tx=0x7f35cc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f93b8e8f85db4d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:45.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.223+0000 7f35d9ffb700 1 -- 172.21.15.6:0/40243466 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc004230 con 0x7f35dc160e00 2023-07-06T19:59:45.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.223+0000 7f35d9ffb700 1 -- 172.21.15.6:0/40243466 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35cc004390 con 0x7f35dc160e00 2023-07-06T19:59:45.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.223+0000 7f35d9ffb700 1 -- 172.21.15.6:0/40243466 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc0036a0 con 0x7f35dc160e00 2023-07-06T19:59:45.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.223+0000 7f35e18b2700 1 -- 172.21.15.6:0/40243466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35dc160e00 msgr2=0x7f35dc06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:45.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.223+0000 7f35e18b2700 1 --2- 172.21.15.6:0/40243466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35dc160e00 0x7f35dc06bdb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f35dc08be80 tx=0x7f35cc009bd0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.223+0000 7f35e18b2700 1 -- 172.21.15.6:0/40243466 shutdown_connections 2023-07-06T19:59:45.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.223+0000 7f35e18b2700 1 --2- 172.21.15.6:0/40243466 >> v2:172.21.15.40:3300/0 conn(0x7f35dc15d910 0x7f35dc06c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.223+0000 7f35e18b2700 1 --2- 172.21.15.6:0/40243466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35dc160e00 0x7f35dc06bdb0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.223+0000 7f35e18b2700 1 -- 172.21.15.6:0/40243466 >> 172.21.15.6:0/40243466 conn(0x7f35dc0d2c70 msgr2=0x7f35dc0d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:45.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.223+0000 7f35e18b2700 1 -- 172.21.15.6:0/40243466 shutdown_connections 2023-07-06T19:59:45.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.223+0000 7f35e18b2700 1 -- 172.21.15.6:0/40243466 wait complete. 2023-07-06T19:59:45.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.225+0000 7f35e18b2700 1 Processor -- start 2023-07-06T19:59:45.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.225+0000 7f35e18b2700 1 -- start start 2023-07-06T19:59:45.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.226+0000 7f35e18b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35dc0b1f10 0x7f35dc0cc600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:45.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.226+0000 7f35e18b2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35dc15d910 0x7f35dc0cb780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:45.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.226+0000 7f35e18b2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35dc160e00 0x7f35dc157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:45.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.226+0000 7f35e18b2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc0ccc50 con 0x7f35dc0b1f10 2023-07-06T19:59:45.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.226+0000 7f35e18b2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc0cbcc0 con 0x7f35dc160e00 2023-07-06T19:59:45.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.226+0000 7f35e18b2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc1e6c20 con 0x7f35dc15d910 2023-07-06T19:59:45.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.226+0000 7f35daffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35dc0b1f10 0x7f35dc0cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:45.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.226+0000 7f35daffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35dc0b1f10 0x7f35dc0cc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59894/0 (socket says 172.21.15.6:59894) 2023-07-06T19:59:45.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.226+0000 7f35daffd700 1 -- 172.21.15.6:0/974131002 learned_addr learned my addr 172.21.15.6:0/974131002 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:45.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.226+0000 7f35da7fc700 1 --2- 172.21.15.6:0/974131002 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35dc15d910 0x7f35dc0cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:45.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.226+0000 7f35db7fe700 1 --2- 172.21.15.6:0/974131002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35dc160e00 0x7f35dc157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:45.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.227+0000 7f35daffd700 1 -- 172.21.15.6:0/974131002 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35dc15d910 msgr2=0x7f35dc0cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:45.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.227+0000 7f35daffd700 1 --2- 172.21.15.6:0/974131002 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35dc15d910 0x7f35dc0cb780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.227+0000 7f35daffd700 1 -- 172.21.15.6:0/974131002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35dc160e00 msgr2=0x7f35dc157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:45.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.227+0000 7f35daffd700 1 --2- 172.21.15.6:0/974131002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35dc160e00 0x7f35dc157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.227+0000 7f35daffd700 1 -- 172.21.15.6:0/974131002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc009550 con 0x7f35dc0b1f10 2023-07-06T19:59:45.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.227+0000 7f35db7fe700 1 --2- 172.21.15.6:0/974131002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35dc160e00 0x7f35dc157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:45.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.227+0000 7f35daffd700 1 --2- 172.21.15.6:0/974131002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35dc0b1f10 0x7f35dc0cc600 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f35d000b4a0 tx=0x7f35d000b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:45.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.227+0000 7f35c3fff700 1 -- 172.21.15.6:0/974131002 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d0011830 con 0x7f35dc0b1f10 2023-07-06T19:59:45.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.227+0000 7f35c3fff700 1 -- 172.21.15.6:0/974131002 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d0011990 con 0x7f35dc0b1f10 2023-07-06T19:59:45.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.227+0000 7f35e18b2700 1 -- 172.21.15.6:0/974131002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35dc1e6f00 con 0x7f35dc0b1f10 2023-07-06T19:59:45.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.227+0000 7f35c3fff700 1 -- 172.21.15.6:0/974131002 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d0011d40 con 0x7f35dc0b1f10 2023-07-06T19:59:45.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.227+0000 7f35e18b2700 1 -- 172.21.15.6:0/974131002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35dc1e74c0 con 0x7f35dc0b1f10 2023-07-06T19:59:45.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.228+0000 7f35e18b2700 1 -- 172.21.15.6:0/974131002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35dc08a570 con 0x7f35dc0b1f10 2023-07-06T19:59:45.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.228+0000 7f35c3fff700 1 -- 172.21.15.6:0/974131002 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f35d001a400 con 0x7f35dc0b1f10 2023-07-06T19:59:45.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.229+0000 7f35c3fff700 1 --2- 172.21.15.6:0/974131002 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f35c806ace0 0x7f35c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:45.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.229+0000 7f35c3fff700 1 -- 172.21.15.6:0/974131002 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f35d00893c0 con 0x7f35dc0b1f10 2023-07-06T19:59:45.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.229+0000 7f35da7fc700 1 --2- 172.21.15.6:0/974131002 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f35c806ace0 0x7f35c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:45.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.229+0000 7f35da7fc700 1 --2- 172.21.15.6:0/974131002 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f35c806ace0 0x7f35c806d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f35dc161240 tx=0x7f35cc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:45.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.233+0000 7f35c3fff700 1 -- 172.21.15.6:0/974131002 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f35d00541d0 con 0x7f35dc0b1f10 2023-07-06T19:59:45.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.428+0000 7f35e18b2700 1 -- 172.21.15.6:0/974131002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f35dc04eb90 con 0x7f35dc0b1f10 2023-07-06T19:59:45.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.429+0000 7f35c3fff700 1 -- 172.21.15.6:0/974131002 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f35d00577f0 con 0x7f35dc0b1f10 2023-07-06T19:59:45.431 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-06T19:59:45.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.431+0000 7f35e18b2700 1 -- 172.21.15.6:0/974131002 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f35c806ace0 msgr2=0x7f35c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.431+0000 7f35e18b2700 1 --2- 172.21.15.6:0/974131002 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f35c806ace0 0x7f35c806d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f35dc161240 tx=0x7f35cc008030 comp rx=0 tx=0).stop 2023-07-06T19:59:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.431+0000 7f35e18b2700 1 -- 172.21.15.6:0/974131002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35dc0b1f10 msgr2=0x7f35dc0cc600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.431+0000 7f35e18b2700 1 --2- 172.21.15.6:0/974131002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35dc0b1f10 0x7f35dc0cc600 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f35d000b4a0 tx=0x7f35d000b7b0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.431+0000 7f35e18b2700 1 -- 172.21.15.6:0/974131002 shutdown_connections 2023-07-06T19:59:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.431+0000 7f35e18b2700 1 --2- 172.21.15.6:0/974131002 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f35c806ace0 0x7f35c806d190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.431+0000 7f35e18b2700 1 --2- 172.21.15.6:0/974131002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35dc0b1f10 0x7f35dc0cc600 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.431+0000 7f35e18b2700 1 --2- 172.21.15.6:0/974131002 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35dc160e00 0x7f35dc157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.431+0000 7f35e18b2700 1 --2- 172.21.15.6:0/974131002 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f35dc15d910 0x7f35dc0cb780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.431+0000 7f35e18b2700 1 -- 172.21.15.6:0/974131002 >> 172.21.15.6:0/974131002 conn(0x7f35dc0d2c70 msgr2=0x7f35dc06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:45.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.431+0000 7f35e18b2700 1 -- 172.21.15.6:0/974131002 shutdown_connections 2023-07-06T19:59:45.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.431+0000 7f35e18b2700 1 -- 172.21.15.6:0/974131002 wait complete. 2023-07-06T19:59:45.448 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T19:59:45.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.576+0000 7f4918838700 1 Processor -- start 2023-07-06T19:59:45.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.576+0000 7f4918838700 1 -- start start 2023-07-06T19:59:45.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.577+0000 7f4918838700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f49141592b0 0x7f4914071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:45.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.577+0000 7f4918838700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49140cd950 0x7f4914071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:45.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.577+0000 7f4918838700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49140cc160 con 0x7f491415cd40 2023-07-06T19:59:45.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.577+0000 7f4918838700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4914159680 con 0x7f49140cd950 2023-07-06T19:59:45.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.577+0000 7f4918838700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f491415d2b0 con 0x7f49141592b0 2023-07-06T19:59:45.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.577+0000 7f4912d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49140cd950 0x7f4914071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:45.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.577+0000 7f4912d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49140cd950 0x7f4914071bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59906/0 (socket says 172.21.15.6:59906) 2023-07-06T19:59:45.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.577+0000 7f4912d9d700 1 -- 172.21.15.6:0/3061526375 learned_addr learned my addr 172.21.15.6:0/3061526375 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:45.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.577+0000 7f491259c700 1 --2- 172.21.15.6:0/3061526375 >> v2:172.21.15.40:3300/0 conn(0x7f49141592b0 0x7f4914071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:45.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.577+0000 7f4912d9d700 1 -- 172.21.15.6:0/3061526375 >> v2:172.21.15.40:3300/0 conn(0x7f49141592b0 msgr2=0x7f4914071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:45.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.577+0000 7f4912d9d700 1 --2- 172.21.15.6:0/3061526375 >> v2:172.21.15.40:3300/0 conn(0x7f49141592b0 0x7f4914071690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.577+0000 7f4912d9d700 1 -- 172.21.15.6:0/3061526375 >> v1:172.21.15.40:6789/0 conn(0x7f491415cd40 legacy=0x7f491406d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:45.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.577+0000 7f4912d9d700 1 -- 172.21.15.6:0/3061526375 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491415d590 con 0x7f49140cd950 2023-07-06T19:59:45.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.577+0000 7f491259c700 1 --2- 172.21.15.6:0/3061526375 >> v2:172.21.15.40:3300/0 conn(0x7f49141592b0 0x7f4914071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:45.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.577+0000 7f4912d9d700 1 --2- 172.21.15.6:0/3061526375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140cd950 0x7f4914071bd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f491406a800 tx=0x7f490c00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8ad52a9f3a76aa server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:45.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.577+0000 7f491159a700 1 -- 172.21.15.6:0/3061526375 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c010070 con 0x7f49140cd950 2023-07-06T19:59:45.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.577+0000 7f491159a700 1 -- 172.21.15.6:0/3061526375 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490c00dd50 con 0x7f49140cd950 2023-07-06T19:59:45.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.577+0000 7f491159a700 1 -- 172.21.15.6:0/3061526375 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c00b310 con 0x7f49140cd950 2023-07-06T19:59:45.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.578+0000 7f4918838700 1 -- 172.21.15.6:0/3061526375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140cd950 msgr2=0x7f4914071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:45.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.578+0000 7f4918838700 1 --2- 172.21.15.6:0/3061526375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140cd950 0x7f4914071bd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f491406a800 tx=0x7f490c00d430 comp rx=0 tx=0).stop 2023-07-06T19:59:45.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.578+0000 7f4918838700 1 -- 172.21.15.6:0/3061526375 shutdown_connections 2023-07-06T19:59:45.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.578+0000 7f4918838700 1 --2- 172.21.15.6:0/3061526375 >> v2:172.21.15.40:3300/0 conn(0x7f49141592b0 0x7f4914071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.578+0000 7f4918838700 1 --2- 172.21.15.6:0/3061526375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140cd950 0x7f4914071bd0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.578+0000 7f4918838700 1 -- 172.21.15.6:0/3061526375 >> 172.21.15.6:0/3061526375 conn(0x7f49140cf960 msgr2=0x7f49140cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:45.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.578+0000 7f4918838700 1 -- 172.21.15.6:0/3061526375 shutdown_connections 2023-07-06T19:59:45.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.578+0000 7f4918838700 1 -- 172.21.15.6:0/3061526375 wait complete. 2023-07-06T19:59:45.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.579+0000 7f4918838700 1 Processor -- start 2023-07-06T19:59:45.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.579+0000 7f4918838700 1 -- start start 2023-07-06T19:59:45.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.580+0000 7f4918838700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140cd950 0x7f4914148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:45.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.580+0000 7f4918838700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49141592b0 0x7f49140c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:45.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.580+0000 7f4918838700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f491415cd40 0x7f49140b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:45.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.580+0000 7f4918838700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4914149140 con 0x7f49140cd950 2023-07-06T19:59:45.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.580+0000 7f4918838700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4914149420 con 0x7f49141592b0 2023-07-06T19:59:45.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.580+0000 7f4918838700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4914156940 con 0x7f491415cd40 2023-07-06T19:59:45.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.580+0000 7f491259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140cd950 0x7f4914148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:45.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.580+0000 7f491259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140cd950 0x7f4914148b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59908/0 (socket says 172.21.15.6:59908) 2023-07-06T19:59:45.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.580+0000 7f491259c700 1 -- 172.21.15.6:0/3514856697 learned_addr learned my addr 172.21.15.6:0/3514856697 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:45.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.580+0000 7f4912d9d700 1 --2- 172.21.15.6:0/3514856697 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f491415cd40 0x7f49140b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:45.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.580+0000 7f4911d9b700 1 --2- 172.21.15.6:0/3514856697 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49141592b0 0x7f49140c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:45.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.581+0000 7f491259c700 1 -- 172.21.15.6:0/3514856697 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f491415cd40 msgr2=0x7f49140b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:45.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.581+0000 7f491259c700 1 --2- 172.21.15.6:0/3514856697 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f491415cd40 0x7f49140b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.581+0000 7f491259c700 1 -- 172.21.15.6:0/3514856697 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49141592b0 msgr2=0x7f49140c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:45.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.581+0000 7f491259c700 1 --2- 172.21.15.6:0/3514856697 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49141592b0 0x7f49140c6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.581+0000 7f491259c700 1 -- 172.21.15.6:0/3514856697 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490c00bd40 con 0x7f49140cd950 2023-07-06T19:59:45.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.581+0000 7f491259c700 1 --2- 172.21.15.6:0/3514856697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140cd950 0x7f4914148b30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f490400c7f0 tx=0x7f490400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:45.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.581+0000 7f4902ffd700 1 -- 172.21.15.6:0/3514856697 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4904011800 con 0x7f49140cd950 2023-07-06T19:59:45.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.581+0000 7f4902ffd700 1 -- 172.21.15.6:0/3514856697 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4904011960 con 0x7f49140cd950 2023-07-06T19:59:45.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.581+0000 7f4918838700 1 -- 172.21.15.6:0/3514856697 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4914156c20 con 0x7f49140cd950 2023-07-06T19:59:45.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.581+0000 7f4902ffd700 1 -- 172.21.15.6:0/3514856697 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4904011d10 con 0x7f49140cd950 2023-07-06T19:59:45.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.581+0000 7f4918838700 1 -- 172.21.15.6:0/3514856697 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49140b3000 con 0x7f49140cd950 2023-07-06T19:59:45.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.582+0000 7f4918838700 1 -- 172.21.15.6:0/3514856697 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4914157140 con 0x7f49140cd950 2023-07-06T19:59:45.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.582+0000 7f4902ffd700 1 -- 172.21.15.6:0/3514856697 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4904018360 con 0x7f49140cd950 2023-07-06T19:59:45.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.583+0000 7f4902ffd700 1 --2- 172.21.15.6:0/3514856697 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f48f406ace0 0x7f48f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:45.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.583+0000 7f4902ffd700 1 -- 172.21.15.6:0/3514856697 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4904089750 con 0x7f49140cd950 2023-07-06T19:59:45.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.583+0000 7f4911d9b700 1 --2- 172.21.15.6:0/3514856697 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f48f406ace0 0x7f48f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:45.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.583+0000 7f4911d9b700 1 --2- 172.21.15.6:0/3514856697 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f48f406ace0 0x7f48f406d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4914149070 tx=0x7f4908009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:45.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.587+0000 7f4902ffd700 1 -- 172.21.15.6:0/3514856697 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4904054560 con 0x7f49140cd950 2023-07-06T19:59:45.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.784+0000 7f4918838700 1 -- 172.21.15.6:0/3514856697 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f491404eb90 con 0x7f49140cd950 2023-07-06T19:59:45.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.784+0000 7f4902ffd700 1 -- 172.21.15.6:0/3514856697 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4904057b80 con 0x7f49140cd950 2023-07-06T19:59:45.787 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-06T19:59:45.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.786+0000 7f4918838700 1 -- 172.21.15.6:0/3514856697 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f48f406ace0 msgr2=0x7f48f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:45.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.786+0000 7f4918838700 1 --2- 172.21.15.6:0/3514856697 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f48f406ace0 0x7f48f406d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4914149070 tx=0x7f4908009040 comp rx=0 tx=0).stop 2023-07-06T19:59:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.786+0000 7f4918838700 1 -- 172.21.15.6:0/3514856697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140cd950 msgr2=0x7f4914148b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.786+0000 7f4918838700 1 --2- 172.21.15.6:0/3514856697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140cd950 0x7f4914148b30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f490400c7f0 tx=0x7f490400cbb0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.786+0000 7f4918838700 1 -- 172.21.15.6:0/3514856697 shutdown_connections 2023-07-06T19:59:45.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.786+0000 7f4918838700 1 --2- 172.21.15.6:0/3514856697 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f48f406ace0 0x7f48f406d190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.786+0000 7f4918838700 1 --2- 172.21.15.6:0/3514856697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140cd950 0x7f4914148b30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.786+0000 7f4918838700 1 --2- 172.21.15.6:0/3514856697 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f491415cd40 0x7f49140b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.786+0000 7f4918838700 1 --2- 172.21.15.6:0/3514856697 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49141592b0 0x7f49140c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.786+0000 7f4918838700 1 -- 172.21.15.6:0/3514856697 >> 172.21.15.6:0/3514856697 conn(0x7f49140cf960 msgr2=0x7f49140ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:45.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.786+0000 7f4918838700 1 -- 172.21.15.6:0/3514856697 shutdown_connections 2023-07-06T19:59:45.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.786+0000 7f4918838700 1 -- 172.21.15.6:0/3514856697 wait complete. 2023-07-06T19:59:45.803 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T19:59:45.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.929+0000 7f94e9b04700 1 Processor -- start 2023-07-06T19:59:45.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.929+0000 7f94e9b04700 1 -- start start 2023-07-06T19:59:45.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.930+0000 7f94e9b04700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94e40ca850 0x7f94e415bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:45.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.930+0000 7f94e9b04700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94e4071cd0 0x7f94e415c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:45.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.930+0000 7f94e9b04700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e40cb310 con 0x7f94e4071900 2023-07-06T19:59:45.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.930+0000 7f94e9b04700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e40cdbf0 con 0x7f94e40ca850 2023-07-06T19:59:45.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.930+0000 7f94e9b04700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e415c9d0 con 0x7f94e4071cd0 2023-07-06T19:59:45.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.930+0000 7f94e2ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94e40ca850 0x7f94e415bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:45.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.930+0000 7f94e2ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94e40ca850 0x7f94e415bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59918/0 (socket says 172.21.15.6:59918) 2023-07-06T19:59:45.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.931+0000 7f94e2ffd700 1 -- 172.21.15.6:0/1208033066 learned_addr learned my addr 172.21.15.6:0/1208033066 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:45.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.931+0000 7f94e3fff700 1 --2- 172.21.15.6:0/1208033066 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94e4071cd0 0x7f94e415c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:45.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.931+0000 7f94e2ffd700 1 -- 172.21.15.6:0/1208033066 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94e4071cd0 msgr2=0x7f94e415c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:45.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.931+0000 7f94e2ffd700 1 --2- 172.21.15.6:0/1208033066 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94e4071cd0 0x7f94e415c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.931+0000 7f94e2ffd700 1 -- 172.21.15.6:0/1208033066 >> v1:172.21.15.40:6789/0 conn(0x7f94e4071900 legacy=0x7f94e40ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:45.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.931+0000 7f94e2ffd700 1 -- 172.21.15.6:0/1208033066 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e40af070 con 0x7f94e40ca850 2023-07-06T19:59:45.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.931+0000 7f94e2ffd700 1 --2- 172.21.15.6:0/1208033066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e40ca850 0x7f94e415bf50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f94d80098f0 tx=0x7f94d8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c204607c56643b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:45.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.931+0000 7f94e27fc700 1 -- 172.21.15.6:0/1208033066 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d8011830 con 0x7f94e40ca850 2023-07-06T19:59:45.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.931+0000 7f94e27fc700 1 -- 172.21.15.6:0/1208033066 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d8011990 con 0x7f94e40ca850 2023-07-06T19:59:45.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.931+0000 7f94e27fc700 1 -- 172.21.15.6:0/1208033066 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d8011d20 con 0x7f94e40ca850 2023-07-06T19:59:45.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.932+0000 7f94e9b04700 1 -- 172.21.15.6:0/1208033066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e40ca850 msgr2=0x7f94e415bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:45.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.932+0000 7f94e9b04700 1 --2- 172.21.15.6:0/1208033066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e40ca850 0x7f94e415bf50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f94d80098f0 tx=0x7f94d8009c00 comp rx=0 tx=0).stop 2023-07-06T19:59:45.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.932+0000 7f94e9b04700 1 -- 172.21.15.6:0/1208033066 shutdown_connections 2023-07-06T19:59:45.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.932+0000 7f94e9b04700 1 --2- 172.21.15.6:0/1208033066 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94e4071cd0 0x7f94e415c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.932+0000 7f94e9b04700 1 --2- 172.21.15.6:0/1208033066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e40ca850 0x7f94e415bf50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.932+0000 7f94e9b04700 1 -- 172.21.15.6:0/1208033066 >> 172.21.15.6:0/1208033066 conn(0x7f94e40cf960 msgr2=0x7f94e40cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:45.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.932+0000 7f94e9b04700 1 -- 172.21.15.6:0/1208033066 shutdown_connections 2023-07-06T19:59:45.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.932+0000 7f94e9b04700 1 -- 172.21.15.6:0/1208033066 wait complete. 2023-07-06T19:59:45.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.933+0000 7f94e9b04700 1 Processor -- start 2023-07-06T19:59:45.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.933+0000 7f94e9b04700 1 -- start start 2023-07-06T19:59:45.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.934+0000 7f94e9b04700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e4071900 0x7f94e40c4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:45.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.934+0000 7f94e9b04700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e4071cd0 0x7f94e40c3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:45.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.934+0000 7f94e9b04700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94e40ca850 0x7f94e41512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:45.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.934+0000 7f94e9b04700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e40c3f10 con 0x7f94e4071900 2023-07-06T19:59:45.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.934+0000 7f94e9b04700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e40c41f0 con 0x7f94e4071cd0 2023-07-06T19:59:45.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.934+0000 7f94e9b04700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e40c44d0 con 0x7f94e40ca850 2023-07-06T19:59:45.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.934+0000 7f94e37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e4071900 0x7f94e40c4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:45.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.934+0000 7f94e37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e4071900 0x7f94e40c4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59922/0 (socket says 172.21.15.6:59922) 2023-07-06T19:59:45.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.934+0000 7f94e37fe700 1 -- 172.21.15.6:0/1172468522 learned_addr learned my addr 172.21.15.6:0/1172468522 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:45.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.934+0000 7f94e3fff700 1 --2- 172.21.15.6:0/1172468522 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94e40ca850 0x7f94e41512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:45.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.934+0000 7f94e2ffd700 1 --2- 172.21.15.6:0/1172468522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e4071cd0 0x7f94e40c3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:45.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.934+0000 7f94e37fe700 1 -- 172.21.15.6:0/1172468522 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94e40ca850 msgr2=0x7f94e41512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:45.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.934+0000 7f94e37fe700 1 --2- 172.21.15.6:0/1172468522 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94e40ca850 0x7f94e41512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.934+0000 7f94e37fe700 1 -- 172.21.15.6:0/1172468522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e4071cd0 msgr2=0x7f94e40c3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:45.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.934+0000 7f94e37fe700 1 --2- 172.21.15.6:0/1172468522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e4071cd0 0x7f94e40c3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:45.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.934+0000 7f94e37fe700 1 -- 172.21.15.6:0/1172468522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d8009550 con 0x7f94e4071900 2023-07-06T19:59:45.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.934+0000 7f94e37fe700 1 --2- 172.21.15.6:0/1172468522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e4071900 0x7f94e40c4fb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f94d400c450 tx=0x7f94d400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:45.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.935+0000 7f94cbfff700 1 -- 172.21.15.6:0/1172468522 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d40052d0 con 0x7f94e4071900 2023-07-06T19:59:45.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.935+0000 7f94cbfff700 1 -- 172.21.15.6:0/1172468522 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d4005430 con 0x7f94e4071900 2023-07-06T19:59:45.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.935+0000 7f94e9b04700 1 -- 172.21.15.6:0/1172468522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e40c47b0 con 0x7f94e4071900 2023-07-06T19:59:45.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.935+0000 7f94cbfff700 1 -- 172.21.15.6:0/1172468522 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d40038c0 con 0x7f94e4071900 2023-07-06T19:59:45.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.935+0000 7f94e9b04700 1 -- 172.21.15.6:0/1172468522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e4154c50 con 0x7f94e4071900 2023-07-06T19:59:45.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.936+0000 7f94e9b04700 1 -- 172.21.15.6:0/1172468522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e40c4cd0 con 0x7f94e4071900 2023-07-06T19:59:45.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.936+0000 7f94cbfff700 1 -- 172.21.15.6:0/1172468522 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f94d4003a20 con 0x7f94e4071900 2023-07-06T19:59:45.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.936+0000 7f94cbfff700 1 --2- 172.21.15.6:0/1172468522 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f94d006ace0 0x7f94d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:45.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.937+0000 7f94cbfff700 1 -- 172.21.15.6:0/1172468522 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f94d4088ad0 con 0x7f94e4071900 2023-07-06T19:59:45.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.937+0000 7f94e2ffd700 1 --2- 172.21.15.6:0/1172468522 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f94d006ace0 0x7f94d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:45.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.937+0000 7f94e2ffd700 1 --2- 172.21.15.6:0/1172468522 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f94d006ace0 0x7f94d006d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009c40 tx=0x7f94d8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:45.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:45.941+0000 7f94cbfff700 1 -- 172.21.15.6:0/1172468522 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f94e40c4cd0 con 0x7f94e4071900 2023-07-06T19:59:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.139+0000 7f94e9b04700 1 -- 172.21.15.6:0/1172468522 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f94e40c4cd0 con 0x7f94e4071900 2023-07-06T19:59:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.140+0000 7f94cbfff700 1 -- 172.21.15.6:0/1172468522 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f94e40c4cd0 con 0x7f94e4071900 2023-07-06T19:59:46.143 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T19:59:46.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.142+0000 7f94e9b04700 1 -- 172.21.15.6:0/1172468522 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f94d006ace0 msgr2=0x7f94d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:46.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.142+0000 7f94e9b04700 1 --2- 172.21.15.6:0/1172468522 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f94d006ace0 0x7f94d006d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f94d8009c40 tx=0x7f94d8008030 comp rx=0 tx=0).stop 2023-07-06T19:59:46.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.142+0000 7f94e9b04700 1 -- 172.21.15.6:0/1172468522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e4071900 msgr2=0x7f94e40c4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:46.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.142+0000 7f94e9b04700 1 --2- 172.21.15.6:0/1172468522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e4071900 0x7f94e40c4fb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f94d400c450 tx=0x7f94d400c760 comp rx=0 tx=0).stop 2023-07-06T19:59:46.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.142+0000 7f94e9b04700 1 -- 172.21.15.6:0/1172468522 shutdown_connections 2023-07-06T19:59:46.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.142+0000 7f94e9b04700 1 --2- 172.21.15.6:0/1172468522 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f94d006ace0 0x7f94d006d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.142+0000 7f94e9b04700 1 --2- 172.21.15.6:0/1172468522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94e4071900 0x7f94e40c4fb0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.142+0000 7f94e9b04700 1 --2- 172.21.15.6:0/1172468522 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94e40ca850 0x7f94e41512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.142+0000 7f94e9b04700 1 --2- 172.21.15.6:0/1172468522 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94e4071cd0 0x7f94e40c3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.142+0000 7f94e9b04700 1 -- 172.21.15.6:0/1172468522 >> 172.21.15.6:0/1172468522 conn(0x7f94e40cf960 msgr2=0x7f94e40cdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.142+0000 7f94e9b04700 1 -- 172.21.15.6:0/1172468522 shutdown_connections 2023-07-06T19:59:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.142+0000 7f94e9b04700 1 -- 172.21.15.6:0/1172468522 wait complete. 2023-07-06T19:59:46.158 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T19:59:46.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.288+0000 7f2312f2b700 1 Processor -- start 2023-07-06T19:59:46.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.288+0000 7f2312f2b700 1 -- start start 2023-07-06T19:59:46.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.289+0000 7f2312f2b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f230c15a520 0x7f230c06dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:46.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.289+0000 7f2312f2b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f230c0d15e0 0x7f230c06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:46.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.289+0000 7f2312f2b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f230c0cd300 con 0x7f230c06e690 2023-07-06T19:59:46.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.289+0000 7f2312f2b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230c0b0290 con 0x7f230c15a520 2023-07-06T19:59:46.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.289+0000 7f2312f2b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230c0ccd80 con 0x7f230c0d15e0 2023-07-06T19:59:46.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.289+0000 7f2310cc7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f230c15a520 0x7f230c06dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:46.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.289+0000 7f2310cc7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f230c15a520 0x7f230c06dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59930/0 (socket says 172.21.15.6:59930) 2023-07-06T19:59:46.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.289+0000 7f2310cc7700 1 -- 172.21.15.6:0/2435242310 learned_addr learned my addr 172.21.15.6:0/2435242310 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:46.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.289+0000 7f230bfff700 1 --2- 172.21.15.6:0/2435242310 >> v2:172.21.15.40:3300/0 conn(0x7f230c0d15e0 0x7f230c06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:46.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.289+0000 7f2310cc7700 1 -- 172.21.15.6:0/2435242310 >> v2:172.21.15.40:3300/0 conn(0x7f230c0d15e0 msgr2=0x7f230c06e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:46.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.289+0000 7f2310cc7700 1 --2- 172.21.15.6:0/2435242310 >> v2:172.21.15.40:3300/0 conn(0x7f230c0d15e0 0x7f230c06e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.289+0000 7f2310cc7700 1 -- 172.21.15.6:0/2435242310 >> v1:172.21.15.40:6789/0 conn(0x7f230c06e690 legacy=0x7f230c15ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:46.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.289+0000 7f2310cc7700 1 -- 172.21.15.6:0/2435242310 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230c0cd020 con 0x7f230c15a520 2023-07-06T19:59:46.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.289+0000 7f2310cc7700 1 --2- 172.21.15.6:0/2435242310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230c15a520 0x7f230c06dc10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f230c0ce560 tx=0x7f2300009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cd95a50900cf441 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:46.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.290+0000 7f230b7fe700 1 -- 172.21.15.6:0/2435242310 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230000b870 con 0x7f230c15a520 2023-07-06T19:59:46.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.290+0000 7f230b7fe700 1 -- 172.21.15.6:0/2435242310 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230000b9d0 con 0x7f230c15a520 2023-07-06T19:59:46.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.290+0000 7f230b7fe700 1 -- 172.21.15.6:0/2435242310 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230000bd60 con 0x7f230c15a520 2023-07-06T19:59:46.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.290+0000 7f2312f2b700 1 -- 172.21.15.6:0/2435242310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230c15a520 msgr2=0x7f230c06dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:46.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.290+0000 7f2312f2b700 1 --2- 172.21.15.6:0/2435242310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230c15a520 0x7f230c06dc10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f230c0ce560 tx=0x7f2300009bd0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.290+0000 7f2312f2b700 1 -- 172.21.15.6:0/2435242310 shutdown_connections 2023-07-06T19:59:46.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.290+0000 7f2312f2b700 1 --2- 172.21.15.6:0/2435242310 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230c15a520 0x7f230c06dc10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.290+0000 7f2312f2b700 1 --2- 172.21.15.6:0/2435242310 >> v2:172.21.15.40:3300/0 conn(0x7f230c0d15e0 0x7f230c06e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.290+0000 7f2312f2b700 1 -- 172.21.15.6:0/2435242310 >> 172.21.15.6:0/2435242310 conn(0x7f230c0ce120 msgr2=0x7f230c0d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:46.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.290+0000 7f2312f2b700 1 -- 172.21.15.6:0/2435242310 shutdown_connections 2023-07-06T19:59:46.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.290+0000 7f2312f2b700 1 -- 172.21.15.6:0/2435242310 wait complete. 2023-07-06T19:59:46.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.291+0000 7f2312f2b700 1 Processor -- start 2023-07-06T19:59:46.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.291+0000 7f2312f2b700 1 -- start start 2023-07-06T19:59:46.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.292+0000 7f2312f2b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f230c06e690 0x7f230c1557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:46.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.292+0000 7f2312f2b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f230c0d15e0 0x7f230c0ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:46.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.292+0000 7f2312f2b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230c15a520 0x7f230c0c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:46.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.292+0000 7f2312f2b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c0caae0 con 0x7f230c15a520 2023-07-06T19:59:46.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.292+0000 7f2312f2b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c0c5ae0 con 0x7f230c06e690 2023-07-06T19:59:46.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.292+0000 7f2312f2b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230c0c5dc0 con 0x7f230c0d15e0 2023-07-06T19:59:46.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.292+0000 7f23114c8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230c15a520 0x7f230c0c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:46.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.292+0000 7f23114c8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230c15a520 0x7f230c0c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59940/0 (socket says 172.21.15.6:59940) 2023-07-06T19:59:46.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.292+0000 7f23114c8700 1 -- 172.21.15.6:0/2010948436 learned_addr learned my addr 172.21.15.6:0/2010948436 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:46.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.293+0000 7f2310cc7700 1 --2- 172.21.15.6:0/2010948436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f230c06e690 0x7f230c1557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:46.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.293+0000 7f23114c8700 1 -- 172.21.15.6:0/2010948436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f230c0d15e0 msgr2=0x7f230c0ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:46.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.293+0000 7f23114c8700 1 --2- 172.21.15.6:0/2010948436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f230c0d15e0 0x7f230c0ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.293+0000 7f23114c8700 1 -- 172.21.15.6:0/2010948436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f230c06e690 msgr2=0x7f230c1557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:46.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.293+0000 7f23114c8700 1 --2- 172.21.15.6:0/2010948436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f230c06e690 0x7f230c1557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.293+0000 7f23114c8700 1 -- 172.21.15.6:0/2010948436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2300009550 con 0x7f230c15a520 2023-07-06T19:59:46.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.293+0000 7f23114c8700 1 --2- 172.21.15.6:0/2010948436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230c15a520 0x7f230c0c8dd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f230400cc50 tx=0x7f230400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:46.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.293+0000 7f23097fa700 1 -- 172.21.15.6:0/2010948436 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230400ad80 con 0x7f230c15a520 2023-07-06T19:59:46.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.293+0000 7f23097fa700 1 -- 172.21.15.6:0/2010948436 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230400ce50 con 0x7f230c15a520 2023-07-06T19:59:46.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.293+0000 7f2312f2b700 1 -- 172.21.15.6:0/2010948436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230c0c60a0 con 0x7f230c15a520 2023-07-06T19:59:46.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.293+0000 7f23097fa700 1 -- 172.21.15.6:0/2010948436 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2304003c40 con 0x7f230c15a520 2023-07-06T19:59:46.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.293+0000 7f2312f2b700 1 -- 172.21.15.6:0/2010948436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230c0c88b0 con 0x7f230c15a520 2023-07-06T19:59:46.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.294+0000 7f2312f2b700 1 -- 172.21.15.6:0/2010948436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230c04eb90 con 0x7f230c15a520 2023-07-06T19:59:46.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.294+0000 7f23097fa700 1 -- 172.21.15.6:0/2010948436 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f23040050d0 con 0x7f230c15a520 2023-07-06T19:59:46.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.295+0000 7f23097fa700 1 --2- 172.21.15.6:0/2010948436 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f22f006ace0 0x7f22f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:46.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.295+0000 7f23097fa700 1 -- 172.21.15.6:0/2010948436 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2304089880 con 0x7f230c15a520 2023-07-06T19:59:46.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.295+0000 7f2310cc7700 1 --2- 172.21.15.6:0/2010948436 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f22f006ace0 0x7f22f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:46.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.295+0000 7f2310cc7700 1 --2- 172.21.15.6:0/2010948436 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f22f006ace0 0x7f22f006d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2300009c10 tx=0x7f2300008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:46.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.299+0000 7f23097fa700 1 -- 172.21.15.6:0/2010948436 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2304054600 con 0x7f230c15a520 2023-07-06T19:59:46.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.497+0000 7f2312f2b700 1 -- 172.21.15.6:0/2010948436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f230c0d13c0 con 0x7f230c15a520 2023-07-06T19:59:46.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.497+0000 7f23097fa700 1 -- 172.21.15.6:0/2010948436 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2304057c20 con 0x7f230c15a520 2023-07-06T19:59:46.500 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-06T19:59:46.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.499+0000 7f2312f2b700 1 -- 172.21.15.6:0/2010948436 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f22f006ace0 msgr2=0x7f22f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:46.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.499+0000 7f2312f2b700 1 --2- 172.21.15.6:0/2010948436 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f22f006ace0 0x7f22f006d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2300009c10 tx=0x7f2300008030 comp rx=0 tx=0).stop 2023-07-06T19:59:46.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.499+0000 7f2312f2b700 1 -- 172.21.15.6:0/2010948436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230c15a520 msgr2=0x7f230c0c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:46.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.499+0000 7f2312f2b700 1 --2- 172.21.15.6:0/2010948436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230c15a520 0x7f230c0c8dd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f230400cc50 tx=0x7f230400a340 comp rx=0 tx=0).stop 2023-07-06T19:59:46.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.499+0000 7f2312f2b700 1 -- 172.21.15.6:0/2010948436 shutdown_connections 2023-07-06T19:59:46.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.499+0000 7f2312f2b700 1 --2- 172.21.15.6:0/2010948436 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f22f006ace0 0x7f22f006d190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.499+0000 7f2312f2b700 1 --2- 172.21.15.6:0/2010948436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f230c15a520 0x7f230c0c8dd0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.500+0000 7f2312f2b700 1 --2- 172.21.15.6:0/2010948436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f230c06e690 0x7f230c1557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.500+0000 7f2312f2b700 1 --2- 172.21.15.6:0/2010948436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f230c0d15e0 0x7f230c0ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.500+0000 7f2312f2b700 1 -- 172.21.15.6:0/2010948436 >> 172.21.15.6:0/2010948436 conn(0x7f230c0ce120 msgr2=0x7f230c0cf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:46.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.500+0000 7f2312f2b700 1 -- 172.21.15.6:0/2010948436 shutdown_connections 2023-07-06T19:59:46.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.500+0000 7f2312f2b700 1 -- 172.21.15.6:0/2010948436 wait complete. 2023-07-06T19:59:46.514 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T19:59:46.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.640+0000 7f14942be700 1 Processor -- start 2023-07-06T19:59:46.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.640+0000 7f14942be700 1 -- start start 2023-07-06T19:59:46.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.641+0000 7f14942be700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f148c15e930 0x7f148c0cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:46.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.641+0000 7f14942be700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f148c0cf520 0x7f148c0c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:46.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.641+0000 7f14942be700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148c06a840 con 0x7f148c0b4940 2023-07-06T19:59:46.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.641+0000 7f14942be700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148c0cf9a0 con 0x7f148c0cf520 2023-07-06T19:59:46.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.641+0000 7f14942be700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c15b700 con 0x7f148c15e930 2023-07-06T19:59:46.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.642+0000 7f149285b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f148c0cf520 0x7f148c0c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:46.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.642+0000 7f1491859700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f148c15e930 0x7f148c0cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:46.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.642+0000 7f149205a700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f148c0b4940 0x7f148c06a060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:51024/0 (socket says 172.21.15.6:51024) 2023-07-06T19:59:46.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.642+0000 7f149205a700 1 -- 172.21.15.6:0/583595479 learned_addr learned my addr 172.21.15.6:0/583595479 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:46.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.642+0000 7f1491859700 1 -- 172.21.15.6:0/583595479 >> v2:172.21.15.40:3300/0 conn(0x7f148c0cf520 msgr2=0x7f148c0c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:46.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.642+0000 7f1491859700 1 --2- 172.21.15.6:0/583595479 >> v2:172.21.15.40:3300/0 conn(0x7f148c0cf520 0x7f148c0c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.642+0000 7f1491859700 1 -- 172.21.15.6:0/583595479 >> v1:172.21.15.40:6789/0 conn(0x7f148c0b4940 legacy=0x7f148c06a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:46.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.642+0000 7f1491859700 1 -- 172.21.15.6:0/583595479 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c15a940 con 0x7f148c15e930 2023-07-06T19:59:46.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.642+0000 7f1491058700 1 -- 172.21.15.6:0/583595479 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115491536 0 0) 0x7f148c06a840 con 0x7f148c0b4940 2023-07-06T19:59:46.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.642+0000 7f149285b700 1 --2- 172.21.15.6:0/583595479 >> v2:172.21.15.40:3300/0 conn(0x7f148c0cf520 0x7f148c0c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:59:46.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.642+0000 7f1491859700 1 --2- 172.21.15.6:0/583595479 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f148c15e930 0x7f148c0cefe0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1480009840 tx=0x7f1480009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca8de8cfab2adabd server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:46.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.642+0000 7f1491058700 1 -- 172.21.15.6:0/583595479 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1480011830 con 0x7f148c15e930 2023-07-06T19:59:46.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.643+0000 7f1491058700 1 -- 172.21.15.6:0/583595479 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1480011990 con 0x7f148c15e930 2023-07-06T19:59:46.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.643+0000 7f1491058700 1 -- 172.21.15.6:0/583595479 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1480011d20 con 0x7f148c15e930 2023-07-06T19:59:46.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.643+0000 7f14942be700 1 -- 172.21.15.6:0/583595479 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f148c15e930 msgr2=0x7f148c0cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:46.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.643+0000 7f14942be700 1 --2- 172.21.15.6:0/583595479 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f148c15e930 0x7f148c0cefe0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1480009840 tx=0x7f1480009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:46.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.643+0000 7f14942be700 1 -- 172.21.15.6:0/583595479 shutdown_connections 2023-07-06T19:59:46.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.643+0000 7f14942be700 1 --2- 172.21.15.6:0/583595479 >> v2:172.21.15.40:3300/0 conn(0x7f148c0cf520 0x7f148c0c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.643+0000 7f14942be700 1 --2- 172.21.15.6:0/583595479 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f148c15e930 0x7f148c0cefe0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.643+0000 7f14942be700 1 -- 172.21.15.6:0/583595479 >> 172.21.15.6:0/583595479 conn(0x7f148c0b0b60 msgr2=0x7f148c0b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:46.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.643+0000 7f14942be700 1 -- 172.21.15.6:0/583595479 shutdown_connections 2023-07-06T19:59:46.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.643+0000 7f14942be700 1 -- 172.21.15.6:0/583595479 wait complete. 2023-07-06T19:59:46.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.644+0000 7f14942be700 1 Processor -- start 2023-07-06T19:59:46.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.644+0000 7f14942be700 1 -- start start 2023-07-06T19:59:46.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.645+0000 7f14942be700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148c0b4940 0x7f148c1519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:46.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.645+0000 7f14942be700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f148c0cf520 0x7f148c150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:46.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.645+0000 7f14942be700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f148c15e930 0x7f148c1e4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:46.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.645+0000 7f14942be700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c1e67c0 con 0x7f148c0b4940 2023-07-06T19:59:46.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.645+0000 7f14942be700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c155ce0 con 0x7f148c0cf520 2023-07-06T19:59:46.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.645+0000 7f14942be700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c155fc0 con 0x7f148c15e930 2023-07-06T19:59:46.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.645+0000 7f149205a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148c0b4940 0x7f148c1519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:46.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.645+0000 7f149205a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148c0b4940 0x7f148c1519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59950/0 (socket says 172.21.15.6:59950) 2023-07-06T19:59:46.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.645+0000 7f149205a700 1 -- 172.21.15.6:0/3596055397 learned_addr learned my addr 172.21.15.6:0/3596055397 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:46.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.645+0000 7f1491859700 1 --2- 172.21.15.6:0/3596055397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f148c0cf520 0x7f148c150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:46.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.645+0000 7f149285b700 1 --2- 172.21.15.6:0/3596055397 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f148c15e930 0x7f148c1e4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:46.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.646+0000 7f149205a700 1 -- 172.21.15.6:0/3596055397 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f148c15e930 msgr2=0x7f148c1e4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:46.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.646+0000 7f149205a700 1 --2- 172.21.15.6:0/3596055397 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f148c15e930 0x7f148c1e4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.646+0000 7f149205a700 1 -- 172.21.15.6:0/3596055397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f148c0cf520 msgr2=0x7f148c150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:46.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.646+0000 7f149205a700 1 --2- 172.21.15.6:0/3596055397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f148c0cf520 0x7f148c150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.646+0000 7f149205a700 1 -- 172.21.15.6:0/3596055397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1484009a70 con 0x7f148c0b4940 2023-07-06T19:59:46.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.646+0000 7f149205a700 1 --2- 172.21.15.6:0/3596055397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148c0b4940 0x7f148c1519e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f14880011e0 tx=0x7f148800cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:46.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.646+0000 7f147effd700 1 -- 172.21.15.6:0/3596055397 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488004c80 con 0x7f148c0b4940 2023-07-06T19:59:46.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.646+0000 7f147effd700 1 -- 172.21.15.6:0/3596055397 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1488004e00 con 0x7f148c0b4940 2023-07-06T19:59:46.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.646+0000 7f14942be700 1 -- 172.21.15.6:0/3596055397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14800094a0 con 0x7f148c0b4940 2023-07-06T19:59:46.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.646+0000 7f147effd700 1 -- 172.21.15.6:0/3596055397 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488007310 con 0x7f148c0b4940 2023-07-06T19:59:46.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.646+0000 7f14942be700 1 -- 172.21.15.6:0/3596055397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148c1511a0 con 0x7f148c0b4940 2023-07-06T19:59:46.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.647+0000 7f14942be700 1 -- 172.21.15.6:0/3596055397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148c1564e0 con 0x7f148c0b4940 2023-07-06T19:59:46.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.647+0000 7f147effd700 1 -- 172.21.15.6:0/3596055397 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1488007470 con 0x7f148c0b4940 2023-07-06T19:59:46.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.648+0000 7f147effd700 1 --2- 172.21.15.6:0/3596055397 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f147006ace0 0x7f147006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:46.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.648+0000 7f147effd700 1 -- 172.21.15.6:0/3596055397 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f14880895e0 con 0x7f148c0b4940 2023-07-06T19:59:46.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.648+0000 7f1491859700 1 --2- 172.21.15.6:0/3596055397 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f147006ace0 0x7f147006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:46.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.648+0000 7f1491859700 1 --2- 172.21.15.6:0/3596055397 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f147006ace0 0x7f147006d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1480000c00 tx=0x7f148001c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:46.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.652+0000 7f147effd700 1 -- 172.21.15.6:0/3596055397 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f148c1564e0 con 0x7f148c0b4940 2023-07-06T19:59:46.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.850+0000 7f14942be700 1 -- 172.21.15.6:0/3596055397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f148c1564e0 con 0x7f148c0b4940 2023-07-06T19:59:46.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.850+0000 7f147effd700 1 -- 172.21.15.6:0/3596055397 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f148c1564e0 con 0x7f148c0b4940 2023-07-06T19:59:46.853 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T19:59:46.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.853+0000 7f14942be700 1 -- 172.21.15.6:0/3596055397 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f147006ace0 msgr2=0x7f147006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:46.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.853+0000 7f14942be700 1 --2- 172.21.15.6:0/3596055397 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f147006ace0 0x7f147006d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1480000c00 tx=0x7f148001c040 comp rx=0 tx=0).stop 2023-07-06T19:59:46.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.853+0000 7f14942be700 1 -- 172.21.15.6:0/3596055397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148c0b4940 msgr2=0x7f148c1519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:46.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.853+0000 7f14942be700 1 --2- 172.21.15.6:0/3596055397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148c0b4940 0x7f148c1519e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f14880011e0 tx=0x7f148800cae0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.853+0000 7f14942be700 1 -- 172.21.15.6:0/3596055397 shutdown_connections 2023-07-06T19:59:46.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.853+0000 7f14942be700 1 --2- 172.21.15.6:0/3596055397 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f147006ace0 0x7f147006d190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.853+0000 7f14942be700 1 --2- 172.21.15.6:0/3596055397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f148c0b4940 0x7f148c1519e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.853+0000 7f14942be700 1 --2- 172.21.15.6:0/3596055397 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f148c15e930 0x7f148c1e4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.853+0000 7f14942be700 1 --2- 172.21.15.6:0/3596055397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f148c0cf520 0x7f148c150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.853+0000 7f14942be700 1 -- 172.21.15.6:0/3596055397 >> 172.21.15.6:0/3596055397 conn(0x7f148c0b0b60 msgr2=0x7f148c0b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:46.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.853+0000 7f14942be700 1 -- 172.21.15.6:0/3596055397 shutdown_connections 2023-07-06T19:59:46.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.853+0000 7f14942be700 1 -- 172.21.15.6:0/3596055397 wait complete. 2023-07-06T19:59:46.867 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T19:59:46.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.991+0000 7f8965eee700 1 Processor -- start 2023-07-06T19:59:46.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.991+0000 7f8965eee700 1 -- start start 2023-07-06T19:59:46.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.992+0000 7f8965eee700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89600ceab0 0x7f89600caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:46.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.992+0000 7f8965eee700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8960071dd0 0x7f89601602c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:46.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.992+0000 7f8965eee700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8960160ff0 con 0x7f89600cee80 2023-07-06T19:59:46.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.992+0000 7f8965eee700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89600cb400 con 0x7f8960071dd0 2023-07-06T19:59:46.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.992+0000 7f8965eee700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89600ca100 con 0x7f89600ceab0 2023-07-06T19:59:46.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.992+0000 7f895ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8960071dd0 0x7f89601602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:46.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.992+0000 7f895effd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f89600cee80 0x7f89600716c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:32936/0 (socket says 172.21.15.6:32936) 2023-07-06T19:59:46.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.992+0000 7f895effd700 1 -- 172.21.15.6:0/3156270657 learned_addr learned my addr 172.21.15.6:0/3156270657 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:46.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.992+0000 7f895f7fe700 1 --2- 172.21.15.6:0/3156270657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89600ceab0 0x7f89600caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:46.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.992+0000 7f895ffff700 1 -- 172.21.15.6:0/3156270657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89600ceab0 msgr2=0x7f89600caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:46.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.992+0000 7f895ffff700 1 --2- 172.21.15.6:0/3156270657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89600ceab0 0x7f89600caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:46.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.992+0000 7f895ffff700 1 -- 172.21.15.6:0/3156270657 >> v1:172.21.15.6:6789/0 conn(0x7f89600cee80 legacy=0x7f89600716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:46.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.992+0000 7f895e7fc700 1 -- 172.21.15.6:0/3156270657 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260920550 0 0) 0x7f8960160ff0 con 0x7f89600cee80 2023-07-06T19:59:46.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.992+0000 7f895ffff700 1 -- 172.21.15.6:0/3156270657 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89600ca3e0 con 0x7f8960071dd0 2023-07-06T19:59:46.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.992+0000 7f895f7fe700 1 --2- 172.21.15.6:0/3156270657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89600ceab0 0x7f89600caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:46.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.993+0000 7f895ffff700 1 --2- 172.21.15.6:0/3156270657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8960071dd0 0x7f89601602c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8958009d90 tx=0x7f895800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dff3fb38963d2e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:46.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.993+0000 7f895e7fc700 1 -- 172.21.15.6:0/3156270657 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895800e070 con 0x7f8960071dd0 2023-07-06T19:59:46.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.993+0000 7f895e7fc700 1 -- 172.21.15.6:0/3156270657 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895800bbd0 con 0x7f8960071dd0 2023-07-06T19:59:47.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.993+0000 7f895e7fc700 1 -- 172.21.15.6:0/3156270657 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8958012430 con 0x7f8960071dd0 2023-07-06T19:59:47.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.993+0000 7f8965eee700 1 -- 172.21.15.6:0/3156270657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8960071dd0 msgr2=0x7f89601602c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:47.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.993+0000 7f8965eee700 1 --2- 172.21.15.6:0/3156270657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8960071dd0 0x7f89601602c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8958009d90 tx=0x7f895800b330 comp rx=0 tx=0).stop 2023-07-06T19:59:47.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.993+0000 7f8965eee700 1 -- 172.21.15.6:0/3156270657 shutdown_connections 2023-07-06T19:59:47.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.993+0000 7f8965eee700 1 --2- 172.21.15.6:0/3156270657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8960071dd0 0x7f89601602c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.993+0000 7f8965eee700 1 --2- 172.21.15.6:0/3156270657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89600ceab0 0x7f89600caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.993+0000 7f8965eee700 1 -- 172.21.15.6:0/3156270657 >> 172.21.15.6:0/3156270657 conn(0x7f89600cc420 msgr2=0x7f89600cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:47.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.993+0000 7f8965eee700 1 -- 172.21.15.6:0/3156270657 shutdown_connections 2023-07-06T19:59:47.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.993+0000 7f8965eee700 1 -- 172.21.15.6:0/3156270657 wait complete. 2023-07-06T19:59:47.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.995+0000 7f8965eee700 1 Processor -- start 2023-07-06T19:59:47.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.995+0000 7f8965eee700 1 -- start start 2023-07-06T19:59:47.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.995+0000 7f8965eee700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8960071dd0 0x7f8960151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:47.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.995+0000 7f8965eee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89600ceab0 0x7f8960151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:47.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.995+0000 7f8965eee700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89600cee80 0x7f89600b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:47.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.995+0000 7f8965eee700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896006c3d0 con 0x7f89600ceab0 2023-07-06T19:59:47.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.995+0000 7f8965eee700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896006c6b0 con 0x7f8960071dd0 2023-07-06T19:59:47.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.996+0000 7f8965eee700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89600ab960 con 0x7f89600cee80 2023-07-06T19:59:47.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.996+0000 7f895effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89600ceab0 0x7f8960151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:47.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.996+0000 7f895effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89600ceab0 0x7f8960151bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59966/0 (socket says 172.21.15.6:59966) 2023-07-06T19:59:47.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.996+0000 7f895effd700 1 -- 172.21.15.6:0/967222869 learned_addr learned my addr 172.21.15.6:0/967222869 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:47.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.996+0000 7f895ffff700 1 --2- 172.21.15.6:0/967222869 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89600cee80 0x7f89600b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:47.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.996+0000 7f895effd700 1 -- 172.21.15.6:0/967222869 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89600cee80 msgr2=0x7f89600b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:47.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.996+0000 7f895f7fe700 1 --2- 172.21.15.6:0/967222869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8960071dd0 0x7f8960151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:47.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.996+0000 7f895effd700 1 --2- 172.21.15.6:0/967222869 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89600cee80 0x7f89600b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.996+0000 7f895effd700 1 -- 172.21.15.6:0/967222869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8960071dd0 msgr2=0x7f8960151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:47.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.996+0000 7f895effd700 1 --2- 172.21.15.6:0/967222869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8960071dd0 0x7f8960151690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.996+0000 7f895effd700 1 -- 172.21.15.6:0/967222869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8958009a70 con 0x7f89600ceab0 2023-07-06T19:59:47.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.996+0000 7f895effd700 1 --2- 172.21.15.6:0/967222869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89600ceab0 0x7f8960151bd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f89500011e0 tx=0x7f895000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:47.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.996+0000 7f8957fff700 1 -- 172.21.15.6:0/967222869 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950004c80 con 0x7f89600ceab0 2023-07-06T19:59:47.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.996+0000 7f8957fff700 1 -- 172.21.15.6:0/967222869 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8950004e00 con 0x7f89600ceab0 2023-07-06T19:59:47.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.996+0000 7f8965eee700 1 -- 172.21.15.6:0/967222869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89600abc40 con 0x7f89600ceab0 2023-07-06T19:59:47.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.996+0000 7f8957fff700 1 -- 172.21.15.6:0/967222869 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950007310 con 0x7f89600ceab0 2023-07-06T19:59:47.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.996+0000 7f8965eee700 1 -- 172.21.15.6:0/967222869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89600b2d10 con 0x7f89600ceab0 2023-07-06T19:59:47.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.997+0000 7f8965eee700 1 -- 172.21.15.6:0/967222869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89600ac160 con 0x7f89600ceab0 2023-07-06T19:59:47.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.998+0000 7f8957fff700 1 -- 172.21.15.6:0/967222869 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8950007470 con 0x7f89600ceab0 2023-07-06T19:59:47.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.998+0000 7f8957fff700 1 --2- 172.21.15.6:0/967222869 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f894006ace0 0x7f894006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:47.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.998+0000 7f8957fff700 1 -- 172.21.15.6:0/967222869 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f89500894c0 con 0x7f89600ceab0 2023-07-06T19:59:47.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.998+0000 7f895f7fe700 1 --2- 172.21.15.6:0/967222869 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f894006ace0 0x7f894006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:47.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:46.999+0000 7f895f7fe700 1 --2- 172.21.15.6:0/967222869 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f894006ace0 0x7f894006d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8948006fd0 tx=0x7f8948008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:47.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.003+0000 7f8957fff700 1 -- 172.21.15.6:0/967222869 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f89600ac160 con 0x7f89600ceab0 2023-07-06T19:59:47.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.202+0000 7f8965eee700 1 -- 172.21.15.6:0/967222869 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89600ac160 con 0x7f89600ceab0 2023-07-06T19:59:47.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.203+0000 7f8957fff700 1 -- 172.21.15.6:0/967222869 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20059 (secure 0 0 0) 0x7f89600ac160 con 0x7f89600ceab0 2023-07-06T19:59:47.205 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:47.206 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":29,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:59:33.917851+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T19:58:51.062712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T19:58:52.130350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T19:58:55.785128+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:59:47.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.205+0000 7f8965eee700 1 -- 172.21.15.6:0/967222869 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f894006ace0 msgr2=0x7f894006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:47.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.205+0000 7f8965eee700 1 --2- 172.21.15.6:0/967222869 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f894006ace0 0x7f894006d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8948006fd0 tx=0x7f8948008040 comp rx=0 tx=0).stop 2023-07-06T19:59:47.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.205+0000 7f8965eee700 1 -- 172.21.15.6:0/967222869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89600ceab0 msgr2=0x7f8960151bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:47.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.205+0000 7f8965eee700 1 --2- 172.21.15.6:0/967222869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89600ceab0 0x7f8960151bd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f89500011e0 tx=0x7f895000cae0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.205+0000 7f8965eee700 1 -- 172.21.15.6:0/967222869 shutdown_connections 2023-07-06T19:59:47.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.205+0000 7f8965eee700 1 --2- 172.21.15.6:0/967222869 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f894006ace0 0x7f894006d190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.205+0000 7f8965eee700 1 --2- 172.21.15.6:0/967222869 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f89600cee80 0x7f89600b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.205+0000 7f8965eee700 1 --2- 172.21.15.6:0/967222869 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8960071dd0 0x7f8960151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.205+0000 7f8965eee700 1 --2- 172.21.15.6:0/967222869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89600ceab0 0x7f8960151bd0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.205+0000 7f8965eee700 1 -- 172.21.15.6:0/967222869 >> 172.21.15.6:0/967222869 conn(0x7f89600cc420 msgr2=0x7f8960152960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:47.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.205+0000 7f8965eee700 1 -- 172.21.15.6:0/967222869 shutdown_connections 2023-07-06T19:59:47.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.205+0000 7f8965eee700 1 -- 172.21.15.6:0/967222869 wait complete. 2023-07-06T19:59:47.220 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T19:58:38.767727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T19:58:45.759808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T19:58:51.062712+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T19:58:52.130350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T19:58:55.785128+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T19:59:47.222 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T19:59:47.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.348+0000 7f0368d67700 1 Processor -- start 2023-07-06T19:59:47.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.348+0000 7f0368d67700 1 -- start start 2023-07-06T19:59:47.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.349+0000 7f0368d67700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f03640ca850 0x7f036415bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:47.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.349+0000 7f0368d67700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0364071cd0 0x7f036415c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:47.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.349+0000 7f0368d67700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03640cb310 con 0x7f0364071900 2023-07-06T19:59:47.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.349+0000 7f0368d67700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03640cdbf0 con 0x7f0364071cd0 2023-07-06T19:59:47.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.349+0000 7f0368d67700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f036415c9d0 con 0x7f03640ca850 2023-07-06T19:59:47.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.349+0000 7f0362d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0364071cd0 0x7f036415c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:47.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.349+0000 7f036259c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0364071900 0x7f03640ca140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:32948/0 (socket says 172.21.15.6:32948) 2023-07-06T19:59:47.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.349+0000 7f036259c700 1 -- 172.21.15.6:0/4221512447 learned_addr learned my addr 172.21.15.6:0/4221512447 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:47.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.350+0000 7f0361d9b700 1 --2- 172.21.15.6:0/4221512447 >> v2:172.21.15.40:3300/0 conn(0x7f03640ca850 0x7f036415bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:47.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.350+0000 7f0362d9d700 1 -- 172.21.15.6:0/4221512447 >> v2:172.21.15.40:3300/0 conn(0x7f03640ca850 msgr2=0x7f036415bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:47.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.350+0000 7f0362d9d700 1 --2- 172.21.15.6:0/4221512447 >> v2:172.21.15.40:3300/0 conn(0x7f03640ca850 0x7f036415bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.350+0000 7f0362d9d700 1 -- 172.21.15.6:0/4221512447 >> v1:172.21.15.6:6789/0 conn(0x7f0364071900 legacy=0x7f03640ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:47.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.350+0000 7f036159a700 1 -- 172.21.15.6:0/4221512447 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464560676 0 0) 0x7f03640cb310 con 0x7f0364071900 2023-07-06T19:59:47.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.350+0000 7f0362d9d700 1 -- 172.21.15.6:0/4221512447 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03640af070 con 0x7f0364071cd0 2023-07-06T19:59:47.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.350+0000 7f0362d9d700 1 --2- 172.21.15.6:0/4221512447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0364071cd0 0x7f036415c490 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f036406e9b0 tx=0x7f035c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf4608ef80fd2e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:47.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.350+0000 7f036159a700 1 -- 172.21.15.6:0/4221512447 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c00e070 con 0x7f0364071cd0 2023-07-06T19:59:47.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.350+0000 7f036159a700 1 -- 172.21.15.6:0/4221512447 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035c00bbd0 con 0x7f0364071cd0 2023-07-06T19:59:47.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.350+0000 7f036159a700 1 -- 172.21.15.6:0/4221512447 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c012430 con 0x7f0364071cd0 2023-07-06T19:59:47.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.351+0000 7f0368d67700 1 -- 172.21.15.6:0/4221512447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0364071cd0 msgr2=0x7f036415c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:47.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.351+0000 7f0368d67700 1 --2- 172.21.15.6:0/4221512447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0364071cd0 0x7f036415c490 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f036406e9b0 tx=0x7f035c00b330 comp rx=0 tx=0).stop 2023-07-06T19:59:47.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.351+0000 7f0368d67700 1 -- 172.21.15.6:0/4221512447 shutdown_connections 2023-07-06T19:59:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.351+0000 7f0368d67700 1 --2- 172.21.15.6:0/4221512447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0364071cd0 0x7f036415c490 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.351+0000 7f0368d67700 1 --2- 172.21.15.6:0/4221512447 >> v2:172.21.15.40:3300/0 conn(0x7f03640ca850 0x7f036415bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.351+0000 7f0368d67700 1 -- 172.21.15.6:0/4221512447 >> 172.21.15.6:0/4221512447 conn(0x7f03640cf960 msgr2=0x7f03640cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.351+0000 7f0368d67700 1 -- 172.21.15.6:0/4221512447 shutdown_connections 2023-07-06T19:59:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.351+0000 7f0368d67700 1 -- 172.21.15.6:0/4221512447 wait complete. 2023-07-06T19:59:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.352+0000 7f0368d67700 1 Processor -- start 2023-07-06T19:59:47.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.352+0000 7f0368d67700 1 -- start start 2023-07-06T19:59:47.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.353+0000 7f0368d67700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0364071900 0x7f036415e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:47.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.353+0000 7f0368d67700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0364071cd0 0x7f036414b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:47.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.353+0000 7f0368d67700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03640ca850 0x7f036414db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:47.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.353+0000 7f0368d67700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036415ebe0 con 0x7f0364071900 2023-07-06T19:59:47.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.353+0000 7f0368d67700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0364151490 con 0x7f0364071cd0 2023-07-06T19:59:47.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.353+0000 7f0368d67700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0364151770 con 0x7f03640ca850 2023-07-06T19:59:47.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.353+0000 7f036259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0364071900 0x7f036415e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:47.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.353+0000 7f036259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0364071900 0x7f036415e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59978/0 (socket says 172.21.15.6:59978) 2023-07-06T19:59:47.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.353+0000 7f036259c700 1 -- 172.21.15.6:0/1285299601 learned_addr learned my addr 172.21.15.6:0/1285299601 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:47.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.353+0000 7f0361d9b700 1 --2- 172.21.15.6:0/1285299601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0364071cd0 0x7f036414b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:47.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.353+0000 7f0362d9d700 1 --2- 172.21.15.6:0/1285299601 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03640ca850 0x7f036414db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:47.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.353+0000 7f036259c700 1 -- 172.21.15.6:0/1285299601 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03640ca850 msgr2=0x7f036414db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:47.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.353+0000 7f036259c700 1 --2- 172.21.15.6:0/1285299601 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03640ca850 0x7f036414db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.353+0000 7f036259c700 1 -- 172.21.15.6:0/1285299601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0364071cd0 msgr2=0x7f036414b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:47.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.353+0000 7f036259c700 1 --2- 172.21.15.6:0/1285299601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0364071cd0 0x7f036414b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.353+0000 7f036259c700 1 -- 172.21.15.6:0/1285299601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c009a70 con 0x7f0364071900 2023-07-06T19:59:47.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.353+0000 7f0362d9d700 1 --2- 172.21.15.6:0/1285299601 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03640ca850 0x7f036414db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:47.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.354+0000 7f036259c700 1 --2- 172.21.15.6:0/1285299601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0364071900 0x7f036415e330 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f035800c550 tx=0x7f035800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:47.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.354+0000 7f0352ffd700 1 -- 172.21.15.6:0/1285299601 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0358004c80 con 0x7f0364071900 2023-07-06T19:59:47.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.354+0000 7f0352ffd700 1 -- 172.21.15.6:0/1285299601 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0358004e00 con 0x7f0364071900 2023-07-06T19:59:47.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.354+0000 7f0368d67700 1 -- 172.21.15.6:0/1285299601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0364151a50 con 0x7f0364071900 2023-07-06T19:59:47.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.354+0000 7f0352ffd700 1 -- 172.21.15.6:0/1285299601 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0358007310 con 0x7f0364071900 2023-07-06T19:59:47.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.354+0000 7f0368d67700 1 -- 172.21.15.6:0/1285299601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f036415e870 con 0x7f0364071900 2023-07-06T19:59:47.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.355+0000 7f0368d67700 1 -- 172.21.15.6:0/1285299601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f036404eb90 con 0x7f0364071900 2023-07-06T19:59:47.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.355+0000 7f0352ffd700 1 -- 172.21.15.6:0/1285299601 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0358007470 con 0x7f0364071900 2023-07-06T19:59:47.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.356+0000 7f0352ffd700 1 --2- 172.21.15.6:0/1285299601 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f034406ace0 0x7f034406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:47.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.356+0000 7f0352ffd700 1 -- 172.21.15.6:0/1285299601 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0358089440 con 0x7f0364071900 2023-07-06T19:59:47.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.356+0000 7f0361d9b700 1 --2- 172.21.15.6:0/1285299601 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f034406ace0 0x7f034406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:47.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.356+0000 7f0361d9b700 1 --2- 172.21.15.6:0/1285299601 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f034406ace0 0x7f034406d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f03640cf060 tx=0x7f0354008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:47.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.360+0000 7f0352ffd700 1 -- 172.21.15.6:0/1285299601 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f03580541b0 con 0x7f0364071900 2023-07-06T19:59:47.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.557+0000 7f0368d67700 1 -- 172.21.15.6:0/1285299601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f03640c9f20 con 0x7f0364071900 2023-07-06T19:59:47.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.557+0000 7f0352ffd700 1 -- 172.21.15.6:0/1285299601 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f03580577d0 con 0x7f0364071900 2023-07-06T19:59:47.561 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-06T19:59:47.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.559+0000 7f0368d67700 1 -- 172.21.15.6:0/1285299601 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f034406ace0 msgr2=0x7f034406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:47.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.559+0000 7f0368d67700 1 --2- 172.21.15.6:0/1285299601 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f034406ace0 0x7f034406d190 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f03640cf060 tx=0x7f0354008040 comp rx=0 tx=0).stop 2023-07-06T19:59:47.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.559+0000 7f0368d67700 1 -- 172.21.15.6:0/1285299601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0364071900 msgr2=0x7f036415e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:47.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.559+0000 7f0368d67700 1 --2- 172.21.15.6:0/1285299601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0364071900 0x7f036415e330 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f035800c550 tx=0x7f035800c860 comp rx=0 tx=0).stop 2023-07-06T19:59:47.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.559+0000 7f0368d67700 1 -- 172.21.15.6:0/1285299601 shutdown_connections 2023-07-06T19:59:47.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.559+0000 7f0368d67700 1 --2- 172.21.15.6:0/1285299601 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f034406ace0 0x7f034406d190 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.559+0000 7f0368d67700 1 --2- 172.21.15.6:0/1285299601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0364071900 0x7f036415e330 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.559+0000 7f0368d67700 1 --2- 172.21.15.6:0/1285299601 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f03640ca850 0x7f036414db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.559+0000 7f0368d67700 1 --2- 172.21.15.6:0/1285299601 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0364071cd0 0x7f036414b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.559+0000 7f0368d67700 1 -- 172.21.15.6:0/1285299601 >> 172.21.15.6:0/1285299601 conn(0x7f03640cf960 msgr2=0x7f036406af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:47.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.559+0000 7f0368d67700 1 -- 172.21.15.6:0/1285299601 shutdown_connections 2023-07-06T19:59:47.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.559+0000 7f0368d67700 1 -- 172.21.15.6:0/1285299601 wait complete. 2023-07-06T19:59:47.585 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T19:59:47.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.716+0000 7f8b8c4a7700 1 Processor -- start 2023-07-06T19:59:47.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.716+0000 7f8b8c4a7700 1 -- start start 2023-07-06T19:59:47.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.717+0000 7f8b8c4a7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8b84071900 0x7f8b840ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:47.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.717+0000 7f8b8c4a7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b8415c660 0x7f8b840ca680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:47.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.717+0000 7f8b8c4a7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b840cb310 con 0x7f8b84071cd0 2023-07-06T19:59:47.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.717+0000 7f8b8c4a7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b840cdbf0 con 0x7f8b84071900 2023-07-06T19:59:47.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.717+0000 7f8b8c4a7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b840af070 con 0x7f8b8415c660 2023-07-06T19:59:47.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.717+0000 7f8b89a42700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8b84071cd0 0x7f8b8415bf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:32962/0 (socket says 172.21.15.6:32962) 2023-07-06T19:59:47.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.717+0000 7f8b89a42700 1 -- 172.21.15.6:0/574159583 learned_addr learned my addr 172.21.15.6:0/574159583 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.717+0000 7f8b8aa44700 1 --2- 172.21.15.6:0/574159583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b8415c660 0x7f8b840ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.717+0000 7f8b8a243700 1 --2- 172.21.15.6:0/574159583 >> v2:172.21.15.40:3300/0 conn(0x7f8b84071900 0x7f8b840ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:47.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.717+0000 7f8b89241700 1 -- 172.21.15.6:0/574159583 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679212119 0 0) 0x7f8b840cb310 con 0x7f8b84071cd0 2023-07-06T19:59:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.717+0000 7f8b89241700 1 -- 172.21.15.6:0/574159583 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b700035b0 con 0x7f8b84071cd0 2023-07-06T19:59:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.718+0000 7f8b8a243700 1 -- 172.21.15.6:0/574159583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b8415c660 msgr2=0x7f8b840ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.718+0000 7f8b8a243700 1 --2- 172.21.15.6:0/574159583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b8415c660 0x7f8b840ca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.718+0000 7f8b8a243700 1 -- 172.21.15.6:0/574159583 >> v1:172.21.15.6:6789/0 conn(0x7f8b84071cd0 legacy=0x7f8b8415bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:47.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.718+0000 7f8b8a243700 1 -- 172.21.15.6:0/574159583 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b840cad50 con 0x7f8b84071900 2023-07-06T19:59:47.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.718+0000 7f8b8a243700 1 --2- 172.21.15.6:0/574159583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b84071900 0x7f8b840ca140 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009840 tx=0x7f8b74009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e6db4c9ef3a0141 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:47.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.718+0000 7f8b89241700 1 -- 172.21.15.6:0/574159583 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74011830 con 0x7f8b84071900 2023-07-06T19:59:47.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.718+0000 7f8b89241700 1 -- 172.21.15.6:0/574159583 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b74011990 con 0x7f8b84071900 2023-07-06T19:59:47.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.718+0000 7f8b89241700 1 -- 172.21.15.6:0/574159583 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74011d20 con 0x7f8b84071900 2023-07-06T19:59:47.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.718+0000 7f8b8c4a7700 1 -- 172.21.15.6:0/574159583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b84071900 msgr2=0x7f8b840ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:47.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.719+0000 7f8b8c4a7700 1 --2- 172.21.15.6:0/574159583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b84071900 0x7f8b840ca140 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009840 tx=0x7f8b74009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:47.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.719+0000 7f8b8c4a7700 1 -- 172.21.15.6:0/574159583 shutdown_connections 2023-07-06T19:59:47.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.719+0000 7f8b8c4a7700 1 --2- 172.21.15.6:0/574159583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b8415c660 0x7f8b840ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.719+0000 7f8b8c4a7700 1 --2- 172.21.15.6:0/574159583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b84071900 0x7f8b840ca140 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.719+0000 7f8b8c4a7700 1 -- 172.21.15.6:0/574159583 >> 172.21.15.6:0/574159583 conn(0x7f8b840cf960 msgr2=0x7f8b840cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:47.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.719+0000 7f8b8c4a7700 1 -- 172.21.15.6:0/574159583 shutdown_connections 2023-07-06T19:59:47.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.719+0000 7f8b8c4a7700 1 -- 172.21.15.6:0/574159583 wait complete. 2023-07-06T19:59:47.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.720+0000 7f8b8c4a7700 1 Processor -- start 2023-07-06T19:59:47.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.720+0000 7f8b8c4a7700 1 -- start start 2023-07-06T19:59:47.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.721+0000 7f8b8c4a7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b84071900 0x7f8b841e8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:47.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.721+0000 7f8b8c4a7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b84071cd0 0x7f8b840afac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:47.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.721+0000 7f8b8c4a7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b8415c660 0x7f8b840b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:47.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.721+0000 7f8b8c4a7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b841e8850 con 0x7f8b8415c660 2023-07-06T19:59:47.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.721+0000 7f8b8c4a7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b841f2430 con 0x7f8b84071900 2023-07-06T19:59:47.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.721+0000 7f8b8c4a7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b841f2710 con 0x7f8b84071cd0 2023-07-06T19:59:47.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.721+0000 7f8b8aa44700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b8415c660 0x7f8b840b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:47.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.721+0000 7f8b8aa44700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b8415c660 0x7f8b840b0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59994/0 (socket says 172.21.15.6:59994) 2023-07-06T19:59:47.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.721+0000 7f8b8aa44700 1 -- 172.21.15.6:0/2036835851 learned_addr learned my addr 172.21.15.6:0/2036835851 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:47.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.721+0000 7f8b8a243700 1 --2- 172.21.15.6:0/2036835851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b84071900 0x7f8b841e8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:47.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.721+0000 7f8b89a42700 1 --2- 172.21.15.6:0/2036835851 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b84071cd0 0x7f8b840afac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:47.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.721+0000 7f8b8aa44700 1 -- 172.21.15.6:0/2036835851 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b84071cd0 msgr2=0x7f8b840afac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:47.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.721+0000 7f8b8aa44700 1 --2- 172.21.15.6:0/2036835851 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b84071cd0 0x7f8b840afac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.721+0000 7f8b8aa44700 1 -- 172.21.15.6:0/2036835851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b84071900 msgr2=0x7f8b841e8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:47.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.721+0000 7f8b8aa44700 1 --2- 172.21.15.6:0/2036835851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b84071900 0x7f8b841e8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.721+0000 7f8b8aa44700 1 -- 172.21.15.6:0/2036835851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b740094a0 con 0x7f8b8415c660 2023-07-06T19:59:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.721+0000 7f8b89a42700 1 --2- 172.21.15.6:0/2036835851 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b84071cd0 0x7f8b840afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.721+0000 7f8b8aa44700 1 --2- 172.21.15.6:0/2036835851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b8415c660 0x7f8b840b0000 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c00efc0 tx=0x7f8b7c00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.721+0000 7f8b7affd700 1 -- 172.21.15.6:0/2036835851 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c00cb80 con 0x7f8b8415c660 2023-07-06T19:59:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.721+0000 7f8b7affd700 1 -- 172.21.15.6:0/2036835851 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7c00f040 con 0x7f8b8415c660 2023-07-06T19:59:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.722+0000 7f8b8c4a7700 1 -- 172.21.15.6:0/2036835851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b841f29f0 con 0x7f8b8415c660 2023-07-06T19:59:47.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.722+0000 7f8b7affd700 1 -- 172.21.15.6:0/2036835851 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7c014480 con 0x7f8b8415c660 2023-07-06T19:59:47.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.722+0000 7f8b8c4a7700 1 -- 172.21.15.6:0/2036835851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b841f2080 con 0x7f8b8415c660 2023-07-06T19:59:47.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.722+0000 7f8b8c4a7700 1 -- 172.21.15.6:0/2036835851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b841f31f0 con 0x7f8b8415c660 2023-07-06T19:59:47.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.723+0000 7f8b7affd700 1 -- 172.21.15.6:0/2036835851 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b7c0145e0 con 0x7f8b8415c660 2023-07-06T19:59:47.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.723+0000 7f8b7affd700 1 --2- 172.21.15.6:0/2036835851 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f8b6806ace0 0x7f8b6806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:47.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.724+0000 7f8b7affd700 1 -- 172.21.15.6:0/2036835851 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8b7c089fb0 con 0x7f8b8415c660 2023-07-06T19:59:47.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.724+0000 7f8b8a243700 1 --2- 172.21.15.6:0/2036835851 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f8b6806ace0 0x7f8b6806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:47.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.724+0000 7f8b8a243700 1 --2- 172.21.15.6:0/2036835851 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f8b6806ace0 0x7f8b6806d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8b74000c00 tx=0x7f8b7401c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:47.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.728+0000 7f8b7affd700 1 -- 172.21.15.6:0/2036835851 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8b7c0bc310 con 0x7f8b8415c660 2023-07-06T19:59:47.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.924+0000 7f8b8c4a7700 1 -- 172.21.15.6:0/2036835851 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8b8404eb90 con 0x7f8b8415c660 2023-07-06T19:59:47.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.925+0000 7f8b7affd700 1 -- 172.21.15.6:0/2036835851 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8b7c018020 con 0x7f8b8415c660 2023-07-06T19:59:47.927 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-06T19:59:47.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.927+0000 7f8b8c4a7700 1 -- 172.21.15.6:0/2036835851 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f8b6806ace0 msgr2=0x7f8b6806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:47.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.927+0000 7f8b8c4a7700 1 --2- 172.21.15.6:0/2036835851 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f8b6806ace0 0x7f8b6806d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8b74000c00 tx=0x7f8b7401c040 comp rx=0 tx=0).stop 2023-07-06T19:59:47.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.927+0000 7f8b8c4a7700 1 -- 172.21.15.6:0/2036835851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b8415c660 msgr2=0x7f8b840b0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.927+0000 7f8b8c4a7700 1 --2- 172.21.15.6:0/2036835851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b8415c660 0x7f8b840b0000 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c00efc0 tx=0x7f8b7c00c0c0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.927+0000 7f8b8c4a7700 1 -- 172.21.15.6:0/2036835851 shutdown_connections 2023-07-06T19:59:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.927+0000 7f8b8c4a7700 1 --2- 172.21.15.6:0/2036835851 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f8b6806ace0 0x7f8b6806d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.927+0000 7f8b8c4a7700 1 --2- 172.21.15.6:0/2036835851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b8415c660 0x7f8b840b0000 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.927+0000 7f8b8c4a7700 1 --2- 172.21.15.6:0/2036835851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b84071900 0x7f8b841e8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.927+0000 7f8b8c4a7700 1 --2- 172.21.15.6:0/2036835851 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8b84071cd0 0x7f8b840afac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:47.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.927+0000 7f8b8c4a7700 1 -- 172.21.15.6:0/2036835851 >> 172.21.15.6:0/2036835851 conn(0x7f8b840cf960 msgr2=0x7f8b840b47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.927+0000 7f8b8c4a7700 1 -- 172.21.15.6:0/2036835851 shutdown_connections 2023-07-06T19:59:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:47.927+0000 7f8b8c4a7700 1 -- 172.21.15.6:0/2036835851 wait complete. 2023-07-06T19:59:47.941 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T19:59:48.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.069+0000 7efdbe520700 1 Processor -- start 2023-07-06T19:59:48.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.069+0000 7efdbe520700 1 -- start start 2023-07-06T19:59:48.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.070+0000 7efdbe520700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdb8071900 0x7efdb80ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:48.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.070+0000 7efdbe520700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efdb8071cd0 0x7efdb80ca680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:48.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.070+0000 7efdbe520700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efdb815bf50 0x7efdb815c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:48.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.070+0000 7efdbe520700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb80cdbf0 con 0x7efdb815bf50 2023-07-06T19:59:48.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.070+0000 7efdbe520700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb80cb310 con 0x7efdb8071cd0 2023-07-06T19:59:48.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.070+0000 7efdbe520700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb80af070 con 0x7efdb8071900 2023-07-06T19:59:48.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.070+0000 7efdbcabd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efdb815bf50 0x7efdb815c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:48.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.070+0000 7efdbcabd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efdb815bf50 0x7efdb815c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60002/0 (socket says 172.21.15.6:60002) 2023-07-06T19:59:48.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.070+0000 7efdbcabd700 1 -- 172.21.15.6:0/2288487215 learned_addr learned my addr 172.21.15.6:0/2288487215 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:48.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.071+0000 7efdb7fff700 1 --2- 172.21.15.6:0/2288487215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdb8071900 0x7efdb80ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.071+0000 7efdb77fe700 1 --2- 172.21.15.6:0/2288487215 >> v2:172.21.15.40:3300/0 conn(0x7efdb8071cd0 0x7efdb80ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.071+0000 7efdbcabd700 1 -- 172.21.15.6:0/2288487215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdb8071900 msgr2=0x7efdb80ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.071+0000 7efdbcabd700 1 --2- 172.21.15.6:0/2288487215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdb8071900 0x7efdb80ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.071+0000 7efdbcabd700 1 -- 172.21.15.6:0/2288487215 >> v2:172.21.15.40:3300/0 conn(0x7efdb8071cd0 msgr2=0x7efdb80ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.071+0000 7efdbcabd700 1 --2- 172.21.15.6:0/2288487215 >> v2:172.21.15.40:3300/0 conn(0x7efdb8071cd0 0x7efdb80ca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.071+0000 7efdbcabd700 1 -- 172.21.15.6:0/2288487215 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb815c8e0 con 0x7efdb815bf50 2023-07-06T19:59:48.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.071+0000 7efdbcabd700 1 --2- 172.21.15.6:0/2288487215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb815bf50 0x7efdb815c3a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7efdb8071280 tx=0x7efdb000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03fbbac6f78fbe0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:48.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.071+0000 7efdb6ffd700 1 -- 172.21.15.6:0/2288487215 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb000e070 con 0x7efdb815bf50 2023-07-06T19:59:48.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.071+0000 7efdb6ffd700 1 -- 172.21.15.6:0/2288487215 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb000b9c0 con 0x7efdb815bf50 2023-07-06T19:59:48.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.071+0000 7efdb6ffd700 1 -- 172.21.15.6:0/2288487215 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb000bd70 con 0x7efdb815bf50 2023-07-06T19:59:48.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.072+0000 7efdbe520700 1 -- 172.21.15.6:0/2288487215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb815bf50 msgr2=0x7efdb815c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:48.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.072+0000 7efdbe520700 1 --2- 172.21.15.6:0/2288487215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb815bf50 0x7efdb815c3a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7efdb8071280 tx=0x7efdb000b330 comp rx=0 tx=0).stop 2023-07-06T19:59:48.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.072+0000 7efdbe520700 1 -- 172.21.15.6:0/2288487215 shutdown_connections 2023-07-06T19:59:48.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.072+0000 7efdbe520700 1 --2- 172.21.15.6:0/2288487215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb815bf50 0x7efdb815c3a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.072+0000 7efdbe520700 1 --2- 172.21.15.6:0/2288487215 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdb8071900 0x7efdb80ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.072+0000 7efdbe520700 1 --2- 172.21.15.6:0/2288487215 >> v2:172.21.15.40:3300/0 conn(0x7efdb8071cd0 0x7efdb80ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.072+0000 7efdbe520700 1 -- 172.21.15.6:0/2288487215 >> 172.21.15.6:0/2288487215 conn(0x7efdb80cf960 msgr2=0x7efdb80cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.072+0000 7efdbe520700 1 -- 172.21.15.6:0/2288487215 shutdown_connections 2023-07-06T19:59:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.072+0000 7efdbe520700 1 -- 172.21.15.6:0/2288487215 wait complete. 2023-07-06T19:59:48.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.073+0000 7efdbe520700 1 Processor -- start 2023-07-06T19:59:48.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.073+0000 7efdbe520700 1 -- start start 2023-07-06T19:59:48.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.074+0000 7efdbe520700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdb8071900 0x7efdb8145ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:48.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.074+0000 7efdbe520700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdb8071cd0 0x7efdb81f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:48.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.074+0000 7efdbe520700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb815bf50 0x7efdb80b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:48.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.074+0000 7efdbe520700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb80c34f0 con 0x7efdb815bf50 2023-07-06T19:59:48.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.074+0000 7efdbe520700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb80b34e0 con 0x7efdb8071cd0 2023-07-06T19:59:48.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.074+0000 7efdbe520700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb80b37c0 con 0x7efdb8071900 2023-07-06T19:59:48.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.074+0000 7efdbcabd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb815bf50 0x7efdb80b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:48.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.074+0000 7efdbcabd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb815bf50 0x7efdb80b5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60008/0 (socket says 172.21.15.6:60008) 2023-07-06T19:59:48.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.074+0000 7efdbcabd700 1 -- 172.21.15.6:0/1971558860 learned_addr learned my addr 172.21.15.6:0/1971558860 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:48.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.074+0000 7efdb7fff700 1 --2- 172.21.15.6:0/1971558860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdb8071900 0x7efdb8145ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:48.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.074+0000 7efdb77fe700 1 --2- 172.21.15.6:0/1971558860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdb8071cd0 0x7efdb81f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:48.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.074+0000 7efdbcabd700 1 -- 172.21.15.6:0/1971558860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdb8071900 msgr2=0x7efdb8145ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:48.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.074+0000 7efdbcabd700 1 --2- 172.21.15.6:0/1971558860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdb8071900 0x7efdb8145ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.074+0000 7efdbcabd700 1 -- 172.21.15.6:0/1971558860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdb8071cd0 msgr2=0x7efdb81f1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:48.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.074+0000 7efdbcabd700 1 --2- 172.21.15.6:0/1971558860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdb8071cd0 0x7efdb81f1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.074+0000 7efdbcabd700 1 -- 172.21.15.6:0/1971558860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb0009b30 con 0x7efdb815bf50 2023-07-06T19:59:48.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.074+0000 7efdb77fe700 1 --2- 172.21.15.6:0/1971558860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdb8071cd0 0x7efdb81f1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:48.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.074+0000 7efdbcabd700 1 --2- 172.21.15.6:0/1971558860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb815bf50 0x7efdb80b5070 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efdb806eb20 tx=0x7efdb0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:48.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.075+0000 7efdb4ff9700 1 -- 172.21.15.6:0/1971558860 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb0004250 con 0x7efdb815bf50 2023-07-06T19:59:48.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.075+0000 7efdb4ff9700 1 -- 172.21.15.6:0/1971558860 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb00043d0 con 0x7efdb815bf50 2023-07-06T19:59:48.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.075+0000 7efdbe520700 1 -- 172.21.15.6:0/1971558860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb80c3760 con 0x7efdb815bf50 2023-07-06T19:59:48.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.075+0000 7efdb4ff9700 1 -- 172.21.15.6:0/1971558860 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb0004780 con 0x7efdb815bf50 2023-07-06T19:59:48.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.075+0000 7efdbe520700 1 -- 172.21.15.6:0/1971558860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb80b3aa0 con 0x7efdb815bf50 2023-07-06T19:59:48.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.076+0000 7efdbe520700 1 -- 172.21.15.6:0/1971558860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb80c39a0 con 0x7efdb815bf50 2023-07-06T19:59:48.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.076+0000 7efdb4ff9700 1 -- 172.21.15.6:0/1971558860 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efdb001c440 con 0x7efdb815bf50 2023-07-06T19:59:48.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.076+0000 7efdb4ff9700 1 --2- 172.21.15.6:0/1971558860 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efda406ace0 0x7efda406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:48.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.077+0000 7efdb4ff9700 1 -- 172.21.15.6:0/1971558860 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7efdb008acd0 con 0x7efdb815bf50 2023-07-06T19:59:48.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.077+0000 7efdb7fff700 1 --2- 172.21.15.6:0/1971558860 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efda406ace0 0x7efda406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:48.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.077+0000 7efdb7fff700 1 --2- 172.21.15.6:0/1971558860 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efda406ace0 0x7efda406d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efda80096f0 tx=0x7efda8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:48.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.081+0000 7efdb4ff9700 1 -- 172.21.15.6:0/1971558860 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efdb80c39a0 con 0x7efdb815bf50 2023-07-06T19:59:48.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.276+0000 7efdbe520700 1 -- 172.21.15.6:0/1971558860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efdb80c39a0 con 0x7efdb815bf50 2023-07-06T19:59:48.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.276+0000 7efdb4ff9700 1 -- 172.21.15.6:0/1971558860 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7efdb0020020 con 0x7efdb815bf50 2023-07-06T19:59:48.279 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T19:59:48.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.279+0000 7efdbe520700 1 -- 172.21.15.6:0/1971558860 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efda406ace0 msgr2=0x7efda406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:48.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.279+0000 7efdbe520700 1 --2- 172.21.15.6:0/1971558860 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efda406ace0 0x7efda406d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efda80096f0 tx=0x7efda8008040 comp rx=0 tx=0).stop 2023-07-06T19:59:48.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.279+0000 7efdbe520700 1 -- 172.21.15.6:0/1971558860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb815bf50 msgr2=0x7efdb80b5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:48.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.279+0000 7efdbe520700 1 --2- 172.21.15.6:0/1971558860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb815bf50 0x7efdb80b5070 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efdb806eb20 tx=0x7efdb0004ad0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.279+0000 7efdbe520700 1 -- 172.21.15.6:0/1971558860 shutdown_connections 2023-07-06T19:59:48.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.279+0000 7efdbe520700 1 --2- 172.21.15.6:0/1971558860 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efda406ace0 0x7efda406d190 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.279+0000 7efdbe520700 1 --2- 172.21.15.6:0/1971558860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdb815bf50 0x7efdb80b5070 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.279+0000 7efdbe520700 1 --2- 172.21.15.6:0/1971558860 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdb8071900 0x7efdb8145ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.279+0000 7efdbe520700 1 --2- 172.21.15.6:0/1971558860 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdb8071cd0 0x7efdb81f1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.279+0000 7efdbe520700 1 -- 172.21.15.6:0/1971558860 >> 172.21.15.6:0/1971558860 conn(0x7efdb80cf960 msgr2=0x7efdb8155920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:48.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.279+0000 7efdbe520700 1 -- 172.21.15.6:0/1971558860 shutdown_connections 2023-07-06T19:59:48.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.279+0000 7efdbe520700 1 -- 172.21.15.6:0/1971558860 wait complete. 2023-07-06T19:59:48.293 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T19:59:48.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.422+0000 7f22a6d12700 1 Processor -- start 2023-07-06T19:59:48.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.422+0000 7f22a6d12700 1 -- start start 2023-07-06T19:59:48.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.423+0000 7f22a6d12700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22a00aef10 0x7f22a015b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:48.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.423+0000 7f22a6d12700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f22a015de10 0x7f22a015e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:48.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.423+0000 7f22a6d12700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a015e890 con 0x7f22a0071690 2023-07-06T19:59:48.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.423+0000 7f22a6d12700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a0151750 con 0x7f22a015de10 2023-07-06T19:59:48.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.423+0000 7f22a6d12700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a015eb70 con 0x7f22a00aef10 2023-07-06T19:59:48.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.423+0000 7f229ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f22a015de10 0x7f22a015e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:48.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.423+0000 7f22a4aae700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22a00aef10 0x7f22a015b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:48.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.423+0000 7f229ffff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f22a015de10 0x7f22a015e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:39050/0 (socket says 172.21.15.6:39050) 2023-07-06T19:59:48.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.423+0000 7f22a52af700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f22a0071690 0x7f22a00ca470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:51094/0 (socket says 172.21.15.6:51094) 2023-07-06T19:59:48.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.424+0000 7f229ffff700 1 -- 172.21.15.6:0/1128047524 learned_addr learned my addr 172.21.15.6:0/1128047524 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:48.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.424+0000 7f22a4aae700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22a00aef10 0x7f22a015b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:52656/0 (socket says 172.21.15.6:52656) 2023-07-06T19:59:48.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.424+0000 7f22a4aae700 1 -- 172.21.15.6:0/1128047524 >> v2:172.21.15.40:3300/0 conn(0x7f22a015de10 msgr2=0x7f22a015e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:48.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.424+0000 7f22a4aae700 1 --2- 172.21.15.6:0/1128047524 >> v2:172.21.15.40:3300/0 conn(0x7f22a015de10 0x7f22a015e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.424+0000 7f22a4aae700 1 -- 172.21.15.6:0/1128047524 >> v1:172.21.15.40:6789/0 conn(0x7f22a0071690 legacy=0x7f22a00ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:48.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.424+0000 7f22a4aae700 1 -- 172.21.15.6:0/1128047524 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a015ab70 con 0x7f22a00aef10 2023-07-06T19:59:48.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.424+0000 7f229ffff700 1 --2- 172.21.15.6:0/1128047524 >> v2:172.21.15.40:3300/0 conn(0x7f22a015de10 0x7f22a015e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:59:48.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.424+0000 7f22a4aae700 1 --2- 172.21.15.6:0/1128047524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22a00aef10 0x7f22a015b370 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2294009840 tx=0x7f2294009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c98413995638546b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:48.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.424+0000 7f229f7fe700 1 -- 172.21.15.6:0/1128047524 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294011830 con 0x7f22a00aef10 2023-07-06T19:59:48.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.424+0000 7f229f7fe700 1 -- 172.21.15.6:0/1128047524 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2294011990 con 0x7f22a00aef10 2023-07-06T19:59:48.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.424+0000 7f229f7fe700 1 -- 172.21.15.6:0/1128047524 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294011d20 con 0x7f22a00aef10 2023-07-06T19:59:48.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.425+0000 7f22a6d12700 1 -- 172.21.15.6:0/1128047524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22a00aef10 msgr2=0x7f22a015b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:48.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.425+0000 7f22a6d12700 1 --2- 172.21.15.6:0/1128047524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22a00aef10 0x7f22a015b370 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2294009840 tx=0x7f2294009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:48.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.425+0000 7f22a6d12700 1 -- 172.21.15.6:0/1128047524 shutdown_connections 2023-07-06T19:59:48.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.425+0000 7f22a6d12700 1 --2- 172.21.15.6:0/1128047524 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22a00aef10 0x7f22a015b370 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.425+0000 7f22a6d12700 1 --2- 172.21.15.6:0/1128047524 >> v2:172.21.15.40:3300/0 conn(0x7f22a015de10 0x7f22a015e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.425+0000 7f22a6d12700 1 -- 172.21.15.6:0/1128047524 >> 172.21.15.6:0/1128047524 conn(0x7f22a00cf960 msgr2=0x7f22a00cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:48.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.425+0000 7f22a6d12700 1 -- 172.21.15.6:0/1128047524 shutdown_connections 2023-07-06T19:59:48.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.425+0000 7f22a6d12700 1 -- 172.21.15.6:0/1128047524 wait complete. 2023-07-06T19:59:48.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.426+0000 7f22a6d12700 1 Processor -- start 2023-07-06T19:59:48.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.427+0000 7f22a6d12700 1 -- start start 2023-07-06T19:59:48.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.428+0000 7f22a6d12700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a0071690 0x7f22a00c3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:48.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.428+0000 7f22a6d12700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22a00aef10 0x7f22a014dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:48.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.428+0000 7f22a6d12700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22a015de10 0x7f22a00c5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:48.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.428+0000 7f22a6d12700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a00c4440 con 0x7f22a0071690 2023-07-06T19:59:48.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.428+0000 7f22a6d12700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a01546a0 con 0x7f22a015de10 2023-07-06T19:59:48.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.428+0000 7f22a6d12700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a00c3ea0 con 0x7f22a00aef10 2023-07-06T19:59:48.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.428+0000 7f22a4aae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a0071690 0x7f22a00c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:48.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.428+0000 7f22a4aae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a0071690 0x7f22a00c3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60018/0 (socket says 172.21.15.6:60018) 2023-07-06T19:59:48.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.428+0000 7f22a4aae700 1 -- 172.21.15.6:0/3294437970 learned_addr learned my addr 172.21.15.6:0/3294437970 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:48.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.428+0000 7f229ffff700 1 --2- 172.21.15.6:0/3294437970 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22a00aef10 0x7f22a014dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:48.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.428+0000 7f22a52af700 1 --2- 172.21.15.6:0/3294437970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22a015de10 0x7f22a00c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:48.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.428+0000 7f22a4aae700 1 -- 172.21.15.6:0/3294437970 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22a00aef10 msgr2=0x7f22a014dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:48.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.428+0000 7f22a4aae700 1 --2- 172.21.15.6:0/3294437970 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22a00aef10 0x7f22a014dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.428+0000 7f22a4aae700 1 -- 172.21.15.6:0/3294437970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22a015de10 msgr2=0x7f22a00c5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:48.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.428+0000 7f22a4aae700 1 --2- 172.21.15.6:0/3294437970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22a015de10 0x7f22a00c5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.428+0000 7f22a4aae700 1 -- 172.21.15.6:0/3294437970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228c009550 con 0x7f22a0071690 2023-07-06T19:59:48.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.428+0000 7f22a4aae700 1 --2- 172.21.15.6:0/3294437970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a0071690 0x7f22a00c3930 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2294000c00 tx=0x7f2294004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:48.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.428+0000 7f229d7fa700 1 -- 172.21.15.6:0/3294437970 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22940045d0 con 0x7f22a0071690 2023-07-06T19:59:48.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.428+0000 7f229d7fa700 1 -- 172.21.15.6:0/3294437970 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229401f070 con 0x7f22a0071690 2023-07-06T19:59:48.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.428+0000 7f22a6d12700 1 -- 172.21.15.6:0/3294437970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22940094a0 con 0x7f22a0071690 2023-07-06T19:59:48.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.428+0000 7f229d7fa700 1 -- 172.21.15.6:0/3294437970 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22940038c0 con 0x7f22a0071690 2023-07-06T19:59:48.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.429+0000 7f22a6d12700 1 -- 172.21.15.6:0/3294437970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a0150180 con 0x7f22a0071690 2023-07-06T19:59:48.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.430+0000 7f22a6d12700 1 -- 172.21.15.6:0/3294437970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a006b980 con 0x7f22a0071690 2023-07-06T19:59:48.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.430+0000 7f229d7fa700 1 -- 172.21.15.6:0/3294437970 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2294003a20 con 0x7f22a0071690 2023-07-06T19:59:48.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.430+0000 7f229d7fa700 1 --2- 172.21.15.6:0/3294437970 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f228406ace0 0x7f228406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:48.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.431+0000 7f229d7fa700 1 -- 172.21.15.6:0/3294437970 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2294021070 con 0x7f22a0071690 2023-07-06T19:59:48.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.431+0000 7f229ffff700 1 --2- 172.21.15.6:0/3294437970 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f228406ace0 0x7f228406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:48.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.431+0000 7f229ffff700 1 --2- 172.21.15.6:0/3294437970 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f228406ace0 0x7f228406d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f228c006d50 tx=0x7f228c0092c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:48.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.435+0000 7f229d7fa700 1 -- 172.21.15.6:0/3294437970 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2294055d20 con 0x7f22a0071690 2023-07-06T19:59:48.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.632+0000 7f22a6d12700 1 -- 172.21.15.6:0/3294437970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f22a015a3a0 con 0x7f22a0071690 2023-07-06T19:59:48.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.632+0000 7f229d7fa700 1 -- 172.21.15.6:0/3294437970 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2294059340 con 0x7f22a0071690 2023-07-06T19:59:48.634 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-06T19:59:48.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.634+0000 7f22a6d12700 1 -- 172.21.15.6:0/3294437970 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f228406ace0 msgr2=0x7f228406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:48.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.634+0000 7f22a6d12700 1 --2- 172.21.15.6:0/3294437970 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f228406ace0 0x7f228406d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f228c006d50 tx=0x7f228c0092c0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.634+0000 7f22a6d12700 1 -- 172.21.15.6:0/3294437970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a0071690 msgr2=0x7f22a00c3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:48.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.634+0000 7f22a6d12700 1 --2- 172.21.15.6:0/3294437970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a0071690 0x7f22a00c3930 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2294000c00 tx=0x7f2294004750 comp rx=0 tx=0).stop 2023-07-06T19:59:48.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.635+0000 7f22a6d12700 1 -- 172.21.15.6:0/3294437970 shutdown_connections 2023-07-06T19:59:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.635+0000 7f22a6d12700 1 --2- 172.21.15.6:0/3294437970 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f228406ace0 0x7f228406d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.635+0000 7f22a6d12700 1 --2- 172.21.15.6:0/3294437970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22a0071690 0x7f22a00c3930 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.635+0000 7f22a6d12700 1 --2- 172.21.15.6:0/3294437970 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22a015de10 0x7f22a00c5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.635+0000 7f22a6d12700 1 --2- 172.21.15.6:0/3294437970 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f22a00aef10 0x7f22a014dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.635+0000 7f22a6d12700 1 -- 172.21.15.6:0/3294437970 >> 172.21.15.6:0/3294437970 conn(0x7f22a00cf960 msgr2=0x7f22a0159060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.635+0000 7f22a6d12700 1 -- 172.21.15.6:0/3294437970 shutdown_connections 2023-07-06T19:59:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.635+0000 7f22a6d12700 1 -- 172.21.15.6:0/3294437970 wait complete. 2023-07-06T19:59:48.649 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T19:59:48.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.778+0000 7fedaa263700 1 Processor -- start 2023-07-06T19:59:48.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.779+0000 7fedaa263700 1 -- start start 2023-07-06T19:59:48.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.779+0000 7fedaa263700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feda4071900 0x7feda40ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:48.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.779+0000 7fedaa263700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda40cb310 con 0x7feda4071cd0 2023-07-06T19:59:48.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.779+0000 7fedaa263700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda40af070 con 0x7feda415c660 2023-07-06T19:59:48.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.779+0000 7fedaa263700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda40cdbf0 con 0x7feda4071900 2023-07-06T19:59:48.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.779+0000 7feda37fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7feda4071cd0 0x7feda415bf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33002/0 (socket says 172.21.15.6:33002) 2023-07-06T19:59:48.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.780+0000 7feda37fe700 1 -- 172.21.15.6:0/1830551465 learned_addr learned my addr 172.21.15.6:0/1830551465 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:48.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.780+0000 7feda3fff700 1 --2- 172.21.15.6:0/1830551465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feda4071900 0x7feda40ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:48.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.780+0000 7feda2ffd700 1 -- 172.21.15.6:0/1830551465 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172968710 0 0) 0x7feda40cb310 con 0x7feda4071cd0 2023-07-06T19:59:48.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.780+0000 7feda2ffd700 1 -- 172.21.15.6:0/1830551465 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed900035b0 con 0x7feda4071cd0 2023-07-06T19:59:48.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.780+0000 7feda2ffd700 1 -- 172.21.15.6:0/1830551465 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3361097615 0 0) 0x7fed900035b0 con 0x7feda4071cd0 2023-07-06T19:59:48.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.780+0000 7feda2ffd700 1 -- 172.21.15.6:0/1830551465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feda4071900 msgr2=0x7feda40ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:48.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.780+0000 7feda2ffd700 1 --2- 172.21.15.6:0/1830551465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feda4071900 0x7feda40ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.780+0000 7feda2ffd700 1 -- 172.21.15.6:0/1830551465 >> v1:172.21.15.40:6789/0 conn(0x7feda415c660 legacy=0x7feda40ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:48.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.780+0000 7feda2ffd700 1 -- 172.21.15.6:0/1830551465 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda40cad50 con 0x7feda4071cd0 2023-07-06T19:59:48.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.780+0000 7feda2ffd700 1 -- 172.21.15.6:0/1830551465 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7fed8c001670 con 0x7feda4071cd0 2023-07-06T19:59:48.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.780+0000 7feda2ffd700 1 -- 172.21.15.6:0/1830551465 >> v1:172.21.15.6:6789/0 conn(0x7feda4071cd0 legacy=0x7feda415bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:48.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.780+0000 7feda2ffd700 1 --2- 172.21.15.6:0/1830551465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed90003a30 0x7fed90003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:48.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.780+0000 7feda2ffd700 1 --2- 172.21.15.6:0/1830551465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feda4071900 0x7fed90004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:48.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.780+0000 7feda2ffd700 1 --2- 172.21.15.6:0/1830551465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed90004d90 0x7fed90005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:48.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.780+0000 7feda2ffd700 1 -- 172.21.15.6:0/1830551465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda40cdbf0 con 0x7fed90003a30 2023-07-06T19:59:48.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.780+0000 7feda2ffd700 1 -- 172.21.15.6:0/1830551465 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9000bbd0 con 0x7fed90004d90 2023-07-06T19:59:48.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.780+0000 7feda2ffd700 1 -- 172.21.15.6:0/1830551465 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9000bd90 con 0x7feda4071900 2023-07-06T19:59:48.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.780+0000 7feda3fff700 1 --2- 172.21.15.6:0/1830551465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed90003a30 0x7fed90003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:48.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.780+0000 7feda37fe700 1 --2- 172.21.15.6:0/1830551465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feda4071900 0x7fed90004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:48.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.780+0000 7feda8800700 1 --2- 172.21.15.6:0/1830551465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed90004d90 0x7fed90005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:48.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.781+0000 7feda3fff700 1 -- 172.21.15.6:0/1830551465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feda4071900 msgr2=0x7fed90004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:48.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.781+0000 7feda3fff700 1 --2- 172.21.15.6:0/1830551465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feda4071900 0x7fed90004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.781+0000 7feda3fff700 1 -- 172.21.15.6:0/1830551465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed90004d90 msgr2=0x7fed90005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:48.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.781+0000 7feda3fff700 1 --2- 172.21.15.6:0/1830551465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed90004d90 0x7fed90005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.781+0000 7feda3fff700 1 -- 172.21.15.6:0/1830551465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed900035b0 con 0x7fed90003a30 2023-07-06T19:59:48.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.781+0000 7feda37fe700 1 --2- 172.21.15.6:0/1830551465 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feda4071900 0x7fed90004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:48.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.781+0000 7feda3fff700 1 --2- 172.21.15.6:0/1830551465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed90003a30 0x7fed90003e40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fed94009b30 tx=0x7fed90005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f438e1e9b425a47 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:48.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.781+0000 7feda2ffd700 1 -- 172.21.15.6:0/1830551465 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9400e6c0 con 0x7fed90003a30 2023-07-06T19:59:48.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.781+0000 7feda2ffd700 1 -- 172.21.15.6:0/1830551465 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9400e820 con 0x7fed90003a30 2023-07-06T19:59:48.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.781+0000 7feda2ffd700 1 -- 172.21.15.6:0/1830551465 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9400eb90 con 0x7fed90003a30 2023-07-06T19:59:48.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.782+0000 7fedaa263700 1 -- 172.21.15.6:0/1830551465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed90003a30 msgr2=0x7fed90003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:48.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.782+0000 7fedaa263700 1 --2- 172.21.15.6:0/1830551465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed90003a30 0x7fed90003e40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fed94009b30 tx=0x7fed90005880 comp rx=0 tx=0).stop 2023-07-06T19:59:48.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.782+0000 7feda8800700 1 -- 172.21.15.6:0/1830551465 reap_dead start 2023-07-06T19:59:48.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.782+0000 7fedaa263700 1 -- 172.21.15.6:0/1830551465 shutdown_connections 2023-07-06T19:59:48.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.782+0000 7fedaa263700 1 -- 172.21.15.6:0/1830551465 >> 172.21.15.6:0/1830551465 conn(0x7feda40cf960 msgr2=0x7feda40cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:48.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.782+0000 7fedaa263700 1 -- 172.21.15.6:0/1830551465 shutdown_connections 2023-07-06T19:59:48.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.782+0000 7fedaa263700 1 -- 172.21.15.6:0/1830551465 wait complete. 2023-07-06T19:59:48.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.783+0000 7fedaa263700 1 Processor -- start 2023-07-06T19:59:48.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.783+0000 7fedaa263700 1 -- start start 2023-07-06T19:59:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.784+0000 7fedaa263700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed90003a30 0x7feda41592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.784+0000 7fedaa263700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feda40c5b10 0x7feda40c4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:48.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.784+0000 7fedaa263700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feda40c4c60 0x7feda40c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.784+0000 7fedaa263700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda40b1320 con 0x7feda40c4c60 2023-07-06T19:59:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.784+0000 7fedaa263700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda41597f0 con 0x7fed90003a30 2023-07-06T19:59:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.784+0000 7fedaa263700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda40b05b0 con 0x7feda40c5b10 2023-07-06T19:59:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.784+0000 7feda8800700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feda40c4c60 0x7feda40c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.784+0000 7feda8800700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feda40c4c60 0x7feda40c5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60038/0 (socket says 172.21.15.6:60038) 2023-07-06T19:59:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.784+0000 7feda8800700 1 -- 172.21.15.6:0/189858102 learned_addr learned my addr 172.21.15.6:0/189858102 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.784+0000 7feda3fff700 1 --2- 172.21.15.6:0/189858102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed90003a30 0x7feda41592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.784+0000 7feda37fe700 1 --2- 172.21.15.6:0/189858102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feda40c5b10 0x7feda40c4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.784+0000 7feda8800700 1 -- 172.21.15.6:0/189858102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feda40c5b10 msgr2=0x7feda40c4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:48.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.784+0000 7feda8800700 1 --2- 172.21.15.6:0/189858102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feda40c5b10 0x7feda40c4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.784+0000 7feda8800700 1 -- 172.21.15.6:0/189858102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed90003a30 msgr2=0x7feda41592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:48.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.784+0000 7feda8800700 1 --2- 172.21.15.6:0/189858102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed90003a30 0x7feda41592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.784+0000 7feda8800700 1 -- 172.21.15.6:0/189858102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda40b1510 con 0x7feda40c4c60 2023-07-06T19:59:48.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.784+0000 7feda3fff700 1 --2- 172.21.15.6:0/189858102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed90003a30 0x7feda41592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:48.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.784+0000 7feda8800700 1 --2- 172.21.15.6:0/189858102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feda40c4c60 0x7feda40c5100 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7feda40cc390 tx=0x7fed9c00d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:48.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.785+0000 7feda0ff9700 1 -- 172.21.15.6:0/189858102 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c003c10 con 0x7feda40c4c60 2023-07-06T19:59:48.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.785+0000 7feda0ff9700 1 -- 172.21.15.6:0/189858102 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9c003d90 con 0x7feda40c4c60 2023-07-06T19:59:48.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.785+0000 7fedaa263700 1 -- 172.21.15.6:0/189858102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda40b17f0 con 0x7feda40c4c60 2023-07-06T19:59:48.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.785+0000 7feda0ff9700 1 -- 172.21.15.6:0/189858102 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c00db70 con 0x7feda40c4c60 2023-07-06T19:59:48.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.785+0000 7fedaa263700 1 -- 172.21.15.6:0/189858102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda40b1db0 con 0x7feda40c4c60 2023-07-06T19:59:48.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.786+0000 7fedaa263700 1 -- 172.21.15.6:0/189858102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda40b21b0 con 0x7feda40c4c60 2023-07-06T19:59:48.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.786+0000 7feda0ff9700 1 -- 172.21.15.6:0/189858102 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fed9c00dcd0 con 0x7feda40c4c60 2023-07-06T19:59:48.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.786+0000 7feda0ff9700 1 --2- 172.21.15.6:0/189858102 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fed8406ace0 0x7fed8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:48.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.787+0000 7feda0ff9700 1 -- 172.21.15.6:0/189858102 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fed9c089880 con 0x7feda40c4c60 2023-07-06T19:59:48.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.787+0000 7feda3fff700 1 --2- 172.21.15.6:0/189858102 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fed8406ace0 0x7fed8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:48.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.787+0000 7feda3fff700 1 --2- 172.21.15.6:0/189858102 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fed8406ace0 0x7fed8406d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7feda41f5600 tx=0x7fed94008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:48.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.791+0000 7feda0ff9700 1 -- 172.21.15.6:0/189858102 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fed9c054690 con 0x7feda40c4c60 2023-07-06T19:59:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.990+0000 7fedaa263700 1 -- 172.21.15.6:0/189858102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7feda404eb90 con 0x7feda40c4c60 2023-07-06T19:59:48.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.991+0000 7feda0ff9700 1 -- 172.21.15.6:0/189858102 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fed9c057cb0 con 0x7feda40c4c60 2023-07-06T19:59:48.993 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T19:59:48.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.993+0000 7fedaa263700 1 -- 172.21.15.6:0/189858102 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fed8406ace0 msgr2=0x7fed8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:48.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.993+0000 7fedaa263700 1 --2- 172.21.15.6:0/189858102 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fed8406ace0 0x7fed8406d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7feda41f5600 tx=0x7fed94008030 comp rx=0 tx=0).stop 2023-07-06T19:59:48.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.993+0000 7fedaa263700 1 -- 172.21.15.6:0/189858102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feda40c4c60 msgr2=0x7feda40c5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:48.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.993+0000 7fedaa263700 1 --2- 172.21.15.6:0/189858102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feda40c4c60 0x7feda40c5100 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7feda40cc390 tx=0x7fed9c00d430 comp rx=0 tx=0).stop 2023-07-06T19:59:48.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.993+0000 7fedaa263700 1 -- 172.21.15.6:0/189858102 shutdown_connections 2023-07-06T19:59:48.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.993+0000 7fedaa263700 1 --2- 172.21.15.6:0/189858102 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fed8406ace0 0x7fed8406d190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.993+0000 7fedaa263700 1 --2- 172.21.15.6:0/189858102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feda40c4c60 0x7feda40c5100 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.993+0000 7fedaa263700 1 --2- 172.21.15.6:0/189858102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fed90003a30 0x7feda41592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.993+0000 7fedaa263700 1 --2- 172.21.15.6:0/189858102 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feda40c5b10 0x7feda40c4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:48.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.993+0000 7fedaa263700 1 -- 172.21.15.6:0/189858102 >> 172.21.15.6:0/189858102 conn(0x7feda40cf960 msgr2=0x7feda415ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:48.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.993+0000 7fedaa263700 1 -- 172.21.15.6:0/189858102 shutdown_connections 2023-07-06T19:59:48.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:48.993+0000 7fedaa263700 1 -- 172.21.15.6:0/189858102 wait complete. 2023-07-06T19:59:49.017 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-07-06T19:59:49.086 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-07-06T19:59:49.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.211+0000 7f59ba7b2700 1 Processor -- start 2023-07-06T19:59:49.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.211+0000 7f59ba7b2700 1 -- start start 2023-07-06T19:59:49.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.212+0000 7f59ba7b2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f59b4071dd0 0x7f59b40caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:49.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.212+0000 7f59ba7b2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b4160ff0 con 0x7f59b40ceab0 2023-07-06T19:59:49.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.212+0000 7f59ba7b2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b40ca100 con 0x7f59b40cee80 2023-07-06T19:59:49.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.212+0000 7f59ba7b2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b40cb400 con 0x7f59b4071dd0 2023-07-06T19:59:49.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.212+0000 7f59b3fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f59b40ceab0 0x7f59b40716c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33018/0 (socket says 172.21.15.6:33018) 2023-07-06T19:59:49.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.212+0000 7f59b3fff700 1 -- 172.21.15.6:0/3633283361 learned_addr learned my addr 172.21.15.6:0/3633283361 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b37fe700 1 --2- 172.21.15.6:0/3633283361 >> v2:172.21.15.40:3300/0 conn(0x7f59b4071dd0 0x7f59b40caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b2ffd700 1 -- 172.21.15.6:0/3633283361 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3241905628 0 0) 0x7f59b4160ff0 con 0x7f59b40ceab0 2023-07-06T19:59:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b2ffd700 1 -- 172.21.15.6:0/3633283361 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59a00035b0 con 0x7f59b40ceab0 2023-07-06T19:59:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b2ffd700 1 -- 172.21.15.6:0/3633283361 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4274124821 0 0) 0x7f59a00035b0 con 0x7f59b40ceab0 2023-07-06T19:59:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b2ffd700 1 -- 172.21.15.6:0/3633283361 >> v2:172.21.15.40:3300/0 conn(0x7f59b4071dd0 msgr2=0x7f59b40caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b2ffd700 1 --2- 172.21.15.6:0/3633283361 >> v2:172.21.15.40:3300/0 conn(0x7f59b4071dd0 0x7f59b40caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b2ffd700 1 -- 172.21.15.6:0/3633283361 >> v1:172.21.15.40:6789/0 conn(0x7f59b40cee80 legacy=0x7f59b41602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:49.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b2ffd700 1 -- 172.21.15.6:0/3633283361 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b40ca3e0 con 0x7f59b40ceab0 2023-07-06T19:59:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b2ffd700 1 -- 172.21.15.6:0/3633283361 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f59a4001670 con 0x7f59b40ceab0 2023-07-06T19:59:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b2ffd700 1 -- 172.21.15.6:0/3633283361 >> v1:172.21.15.6:6789/0 conn(0x7f59b40ceab0 legacy=0x7f59b40716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b2ffd700 1 --2- 172.21.15.6:0/3633283361 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59a0003a70 0x7f59a0003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b2ffd700 1 --2- 172.21.15.6:0/3633283361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a0004850 0x7f59a0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b2ffd700 1 --2- 172.21.15.6:0/3633283361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59a0005200 0x7f59a000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b2ffd700 1 -- 172.21.15.6:0/3633283361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b40cb400 con 0x7f59a0004850 2023-07-06T19:59:49.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b2ffd700 1 -- 172.21.15.6:0/3633283361 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a000c0e0 con 0x7f59a0005200 2023-07-06T19:59:49.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b2ffd700 1 -- 172.21.15.6:0/3633283361 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a000c2a0 con 0x7f59a0003a70 2023-07-06T19:59:49.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b37fe700 1 --2- 172.21.15.6:0/3633283361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a0004850 0x7f59a0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:49.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b3fff700 1 --2- 172.21.15.6:0/3633283361 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59a0003a70 0x7f59a0003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:49.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b8d4f700 1 --2- 172.21.15.6:0/3633283361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59a0005200 0x7f59a000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:49.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b37fe700 1 -- 172.21.15.6:0/3633283361 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59a0003a70 msgr2=0x7f59a0003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:49.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b37fe700 1 --2- 172.21.15.6:0/3633283361 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59a0003a70 0x7f59a0003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:49.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b37fe700 1 -- 172.21.15.6:0/3633283361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59a0005200 msgr2=0x7f59a000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:49.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b37fe700 1 --2- 172.21.15.6:0/3633283361 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59a0005200 0x7f59a000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:49.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b37fe700 1 -- 172.21.15.6:0/3633283361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a00035b0 con 0x7f59a0004850 2023-07-06T19:59:49.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b8d4f700 1 -- 172.21.15.6:0/3633283361 reap_dead start 2023-07-06T19:59:49.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.213+0000 7f59b37fe700 1 --2- 172.21.15.6:0/3633283361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a0004850 0x7f59a0004cc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f59b40aeac0 tx=0x7f59a0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d1e9fdcd6bfe1a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:49.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.214+0000 7f59b2ffd700 1 -- 172.21.15.6:0/3633283361 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c00e6c0 con 0x7f59a0004850 2023-07-06T19:59:49.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.214+0000 7f59b2ffd700 1 -- 172.21.15.6:0/3633283361 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599c00e820 con 0x7f59a0004850 2023-07-06T19:59:49.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.214+0000 7f59b2ffd700 1 -- 172.21.15.6:0/3633283361 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c00eb90 con 0x7f59a0004850 2023-07-06T19:59:49.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.214+0000 7f59ba7b2700 1 -- 172.21.15.6:0/3633283361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a0004850 msgr2=0x7f59a0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:49.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.214+0000 7f59ba7b2700 1 --2- 172.21.15.6:0/3633283361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a0004850 0x7f59a0004cc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f59b40aeac0 tx=0x7f59a0005880 comp rx=0 tx=0).stop 2023-07-06T19:59:49.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.214+0000 7f59ba7b2700 1 -- 172.21.15.6:0/3633283361 shutdown_connections 2023-07-06T19:59:49.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.214+0000 7f59ba7b2700 1 --2- 172.21.15.6:0/3633283361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59a0004850 0x7f59a0004cc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.214+0000 7f59ba7b2700 1 -- 172.21.15.6:0/3633283361 >> 172.21.15.6:0/3633283361 conn(0x7f59b40cc420 msgr2=0x7f59b40cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.214+0000 7f59ba7b2700 1 -- 172.21.15.6:0/3633283361 shutdown_connections 2023-07-06T19:59:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.214+0000 7f59ba7b2700 1 -- 172.21.15.6:0/3633283361 wait complete. 2023-07-06T19:59:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.215+0000 7f59ba7b2700 1 Processor -- start 2023-07-06T19:59:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.216+0000 7f59ba7b2700 1 -- start start 2023-07-06T19:59:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.216+0000 7f59ba7b2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59a0004850 0x7f59b4150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.216+0000 7f59ba7b2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59b40ad980 0x7f59b40acce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:49.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.216+0000 7f59ba7b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b40addf0 0x7f59b40ad220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.216+0000 7f59ba7b2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b40ad760 con 0x7f59b40addf0 2023-07-06T19:59:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.216+0000 7f59ba7b2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b40b2bb0 con 0x7f59b40ad980 2023-07-06T19:59:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.216+0000 7f59ba7b2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b40b2e90 con 0x7f59a0004850 2023-07-06T19:59:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.216+0000 7f59b8d4f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b40addf0 0x7f59b40ad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.216+0000 7f59b8d4f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b40addf0 0x7f59b40ad220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60056/0 (socket says 172.21.15.6:60056) 2023-07-06T19:59:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.217+0000 7f59b8d4f700 1 -- 172.21.15.6:0/746126562 learned_addr learned my addr 172.21.15.6:0/746126562 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.217+0000 7f59b8d4f700 1 -- 172.21.15.6:0/746126562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59a0004850 msgr2=0x7f59b4150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:49.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.217+0000 7f59b8d4f700 1 --2- 172.21.15.6:0/746126562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59a0004850 0x7f59b4150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:49.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.217+0000 7f59b8d4f700 1 -- 172.21.15.6:0/746126562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59b40ad980 msgr2=0x7f59b40acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:49.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.217+0000 7f59b8d4f700 1 --2- 172.21.15.6:0/746126562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59b40ad980 0x7f59b40acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:49.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.217+0000 7f59b8d4f700 1 -- 172.21.15.6:0/746126562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b40b3170 con 0x7f59b40addf0 2023-07-06T19:59:49.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.217+0000 7f59b8d4f700 1 --2- 172.21.15.6:0/746126562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b40addf0 0x7f59b40ad220 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f59b40cbd80 tx=0x7f59ac00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:49.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.217+0000 7f59b0ff9700 1 -- 172.21.15.6:0/746126562 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac003c10 con 0x7f59b40addf0 2023-07-06T19:59:49.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.217+0000 7f59b0ff9700 1 -- 172.21.15.6:0/746126562 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ac003d90 con 0x7f59b40addf0 2023-07-06T19:59:49.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.217+0000 7f59ba7b2700 1 -- 172.21.15.6:0/746126562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b40b3450 con 0x7f59b40addf0 2023-07-06T19:59:49.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.217+0000 7f59b0ff9700 1 -- 172.21.15.6:0/746126562 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac005310 con 0x7f59b40addf0 2023-07-06T19:59:49.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.217+0000 7f59ba7b2700 1 -- 172.21.15.6:0/746126562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b4150e80 con 0x7f59b40addf0 2023-07-06T19:59:49.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.218+0000 7f59ba7b2700 1 -- 172.21.15.6:0/746126562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b40b5920 con 0x7f59b40addf0 2023-07-06T19:59:49.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.219+0000 7f59b0ff9700 1 -- 172.21.15.6:0/746126562 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f59ac005470 con 0x7f59b40addf0 2023-07-06T19:59:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.219+0000 7f59b0ff9700 1 --2- 172.21.15.6:0/746126562 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f599406ace0 0x7f599406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.219+0000 7f59b0ff9700 1 -- 172.21.15.6:0/746126562 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f59ac089820 con 0x7f59b40addf0 2023-07-06T19:59:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.219+0000 7f59b3fff700 1 --2- 172.21.15.6:0/746126562 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f599406ace0 0x7f599406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.219+0000 7f59b3fff700 1 --2- 172.21.15.6:0/746126562 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f599406ace0 0x7f599406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f59a4001200 tx=0x7f59a4001190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:49.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.223+0000 7f59b0ff9700 1 -- 172.21.15.6:0/746126562 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f59ac0545a0 con 0x7f59b40addf0 2023-07-06T19:59:49.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.505+0000 7f59ba7b2700 1 -- 172.21.15.6:0/746126562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f59b4151d40 con 0x7f59b40addf0 2023-07-06T19:59:49.798 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T19:59:49.801 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T19:59:49.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.976+0000 7f59b0ff9700 1 -- 172.21.15.6:0/746126562 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v79) v1 ==== 147+0+0 (secure 0 0 0) 0x7f59ac057bc0 con 0x7f59b40addf0 2023-07-06T19:59:49.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.978+0000 7f59ba7b2700 1 -- 172.21.15.6:0/746126562 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f599406ace0 msgr2=0x7f599406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:49.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.978+0000 7f59ba7b2700 1 --2- 172.21.15.6:0/746126562 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f599406ace0 0x7f599406d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f59a4001200 tx=0x7f59a4001190 comp rx=0 tx=0).stop 2023-07-06T19:59:49.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.978+0000 7f59ba7b2700 1 -- 172.21.15.6:0/746126562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b40addf0 msgr2=0x7f59b40ad220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:49.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.978+0000 7f59ba7b2700 1 --2- 172.21.15.6:0/746126562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b40addf0 0x7f59b40ad220 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f59b40cbd80 tx=0x7f59ac00ee80 comp rx=0 tx=0).stop 2023-07-06T19:59:49.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.978+0000 7f59ba7b2700 1 -- 172.21.15.6:0/746126562 shutdown_connections 2023-07-06T19:59:49.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.978+0000 7f59ba7b2700 1 --2- 172.21.15.6:0/746126562 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f599406ace0 0x7f599406d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:49.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.978+0000 7f59ba7b2700 1 --2- 172.21.15.6:0/746126562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59b40addf0 0x7f59b40ad220 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:49.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.978+0000 7f59ba7b2700 1 --2- 172.21.15.6:0/746126562 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f59a0004850 0x7f59b4150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:49.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.978+0000 7f59ba7b2700 1 --2- 172.21.15.6:0/746126562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f59b40ad980 0x7f59b40acce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:49.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.978+0000 7f59ba7b2700 1 -- 172.21.15.6:0/746126562 >> 172.21.15.6:0/746126562 conn(0x7f59b40cc420 msgr2=0x7f59b415e920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:49.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.979+0000 7f59ba7b2700 1 -- 172.21.15.6:0/746126562 shutdown_connections 2023-07-06T19:59:49.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:49.979+0000 7f59ba7b2700 1 -- 172.21.15.6:0/746126562 wait complete. 2023-07-06T19:59:49.994 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-06T19:59:50.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.124+0000 7f40cb5e8700 1 Processor -- start 2023-07-06T19:59:50.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.124+0000 7f40cb5e8700 1 -- start start 2023-07-06T19:59:50.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.125+0000 7f40cb5e8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f40c41592b0 0x7f40c4071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:50.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.125+0000 7f40cb5e8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40c40cd950 0x7f40c4071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:50.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.125+0000 7f40cb5e8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c40cc160 con 0x7f40c415cd40 2023-07-06T19:59:50.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.125+0000 7f40cb5e8700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c4159680 con 0x7f40c41592b0 2023-07-06T19:59:50.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.125+0000 7f40cb5e8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c415d2b0 con 0x7f40c40cd950 2023-07-06T19:59:50.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.125+0000 7f40c9384700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f40c41592b0 0x7f40c4071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:50.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.125+0000 7f40c8b83700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f40c415cd40 0x7f40c406d8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33038/0 (socket says 172.21.15.6:33038) 2023-07-06T19:59:50.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.125+0000 7f40c8b83700 1 -- 172.21.15.6:0/3841342930 learned_addr learned my addr 172.21.15.6:0/3841342930 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:50.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.125+0000 7f40c9b85700 1 --2- 172.21.15.6:0/3841342930 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40c40cd950 0x7f40c4071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:50.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.125+0000 7f40c9384700 1 -- 172.21.15.6:0/3841342930 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40c40cd950 msgr2=0x7f40c4071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:50.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.125+0000 7f40c9384700 1 --2- 172.21.15.6:0/3841342930 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40c40cd950 0x7f40c4071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:50.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.125+0000 7f40c9384700 1 -- 172.21.15.6:0/3841342930 >> v1:172.21.15.6:6789/0 conn(0x7f40c415cd40 legacy=0x7f40c406d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:50.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.125+0000 7f40c9384700 1 -- 172.21.15.6:0/3841342930 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c415d590 con 0x7f40c41592b0 2023-07-06T19:59:50.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.125+0000 7f40bbfff700 1 -- 172.21.15.6:0/3841342930 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1219699188 0 0) 0x7f40c40cc160 con 0x7f40c415cd40 2023-07-06T19:59:50.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.125+0000 7f40c9384700 1 --2- 172.21.15.6:0/3841342930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40c41592b0 0x7f40c4071690 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f40c000bae0 tx=0x7f40c000bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fa8d59dec29f8e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:50.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.125+0000 7f40bbfff700 1 -- 172.21.15.6:0/3841342930 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c000dd30 con 0x7f40c41592b0 2023-07-06T19:59:50.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.125+0000 7f40bbfff700 1 -- 172.21.15.6:0/3841342930 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c000de90 con 0x7f40c41592b0 2023-07-06T19:59:50.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.125+0000 7f40bbfff700 1 -- 172.21.15.6:0/3841342930 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c0010690 con 0x7f40c41592b0 2023-07-06T19:59:50.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.126+0000 7f40cb5e8700 1 -- 172.21.15.6:0/3841342930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40c41592b0 msgr2=0x7f40c4071690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:50.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.126+0000 7f40cb5e8700 1 --2- 172.21.15.6:0/3841342930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40c41592b0 0x7f40c4071690 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f40c000bae0 tx=0x7f40c000bdf0 comp rx=0 tx=0).stop 2023-07-06T19:59:50.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.126+0000 7f40cb5e8700 1 -- 172.21.15.6:0/3841342930 shutdown_connections 2023-07-06T19:59:50.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.126+0000 7f40cb5e8700 1 --2- 172.21.15.6:0/3841342930 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40c40cd950 0x7f40c4071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:50.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.126+0000 7f40cb5e8700 1 --2- 172.21.15.6:0/3841342930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40c41592b0 0x7f40c4071690 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:50.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.126+0000 7f40cb5e8700 1 -- 172.21.15.6:0/3841342930 >> 172.21.15.6:0/3841342930 conn(0x7f40c40cf960 msgr2=0x7f40c40cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:50.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.126+0000 7f40cb5e8700 1 -- 172.21.15.6:0/3841342930 shutdown_connections 2023-07-06T19:59:50.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.126+0000 7f40cb5e8700 1 -- 172.21.15.6:0/3841342930 wait complete. 2023-07-06T19:59:50.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.127+0000 7f40cb5e8700 1 Processor -- start 2023-07-06T19:59:50.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.127+0000 7f40cb5e8700 1 -- start start 2023-07-06T19:59:50.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.128+0000 7f40cb5e8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40c40cd950 0x7f40c41ed1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:50.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.128+0000 7f40cb5e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40c41592b0 0x7f40c40b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:50.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.128+0000 7f40cb5e8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40c415cd40 0x7f40c4071590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:50.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.128+0000 7f40cb5e8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c41f1f10 con 0x7f40c41592b0 2023-07-06T19:59:50.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.128+0000 7f40cb5e8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c41f1390 con 0x7f40c415cd40 2023-07-06T19:59:50.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.128+0000 7f40cb5e8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c41f1670 con 0x7f40c40cd950 2023-07-06T19:59:50.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.128+0000 7f40c8b83700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40c41592b0 0x7f40c40b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:50.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.128+0000 7f40c8b83700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40c41592b0 0x7f40c40b2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60068/0 (socket says 172.21.15.6:60068) 2023-07-06T19:59:50.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.128+0000 7f40c8b83700 1 -- 172.21.15.6:0/2513771399 learned_addr learned my addr 172.21.15.6:0/2513771399 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:50.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.128+0000 7f40c9384700 1 --2- 172.21.15.6:0/2513771399 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40c40cd950 0x7f40c41ed1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:50.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.128+0000 7f40c9b85700 1 --2- 172.21.15.6:0/2513771399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40c415cd40 0x7f40c4071590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:50.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.128+0000 7f40c8b83700 1 -- 172.21.15.6:0/2513771399 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40c40cd950 msgr2=0x7f40c41ed1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:50.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.128+0000 7f40c8b83700 1 --2- 172.21.15.6:0/2513771399 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40c40cd950 0x7f40c41ed1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:50.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.128+0000 7f40c8b83700 1 -- 172.21.15.6:0/2513771399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40c415cd40 msgr2=0x7f40c4071590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:50.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.128+0000 7f40c8b83700 1 --2- 172.21.15.6:0/2513771399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40c415cd40 0x7f40c4071590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:50.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.128+0000 7f40c8b83700 1 -- 172.21.15.6:0/2513771399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c000b740 con 0x7f40c41592b0 2023-07-06T19:59:50.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.128+0000 7f40c9384700 1 --2- 172.21.15.6:0/2513771399 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40c40cd950 0x7f40c41ed1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:50.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.128+0000 7f40c9b85700 1 --2- 172.21.15.6:0/2513771399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40c415cd40 0x7f40c4071590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:50.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.129+0000 7f40c8b83700 1 --2- 172.21.15.6:0/2513771399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40c41592b0 0x7f40c40b2ae0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f40b400c540 tx=0x7f40b400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:50.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.129+0000 7f40b9ffb700 1 -- 172.21.15.6:0/2513771399 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4004c80 con 0x7f40c41592b0 2023-07-06T19:59:50.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.129+0000 7f40b9ffb700 1 -- 172.21.15.6:0/2513771399 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b4004de0 con 0x7f40c41592b0 2023-07-06T19:59:50.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.129+0000 7f40cb5e8700 1 -- 172.21.15.6:0/2513771399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c41f1950 con 0x7f40c41592b0 2023-07-06T19:59:50.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.129+0000 7f40b9ffb700 1 -- 172.21.15.6:0/2513771399 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b4007310 con 0x7f40c41592b0 2023-07-06T19:59:50.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.129+0000 7f40cb5e8700 1 -- 172.21.15.6:0/2513771399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c41f0fb0 con 0x7f40c41592b0 2023-07-06T19:59:50.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.130+0000 7f40cb5e8700 1 -- 172.21.15.6:0/2513771399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c404eb90 con 0x7f40c41592b0 2023-07-06T19:59:50.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.130+0000 7f40b9ffb700 1 -- 172.21.15.6:0/2513771399 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f40b4007470 con 0x7f40c41592b0 2023-07-06T19:59:50.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.131+0000 7f40b9ffb700 1 --2- 172.21.15.6:0/2513771399 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f40a806ace0 0x7f40a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:50.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.131+0000 7f40b9ffb700 1 -- 172.21.15.6:0/2513771399 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f40b4089510 con 0x7f40c41592b0 2023-07-06T19:59:50.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.131+0000 7f40c9384700 1 --2- 172.21.15.6:0/2513771399 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f40a806ace0 0x7f40a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:50.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.131+0000 7f40c9384700 1 --2- 172.21.15.6:0/2513771399 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f40a806ace0 0x7f40a806d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f40c000be30 tx=0x7f40c0013000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:50.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.135+0000 7f40b9ffb700 1 -- 172.21.15.6:0/2513771399 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f40b4054290 con 0x7f40c41592b0 2023-07-06T19:59:50.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.334+0000 7f40cb5e8700 1 -- 172.21.15.6:0/2513771399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f40c40b58e0 con 0x7f40c41592b0 2023-07-06T19:59:50.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.338+0000 7f40b9ffb700 1 -- 172.21.15.6:0/2513771399 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f40b40578b0 con 0x7f40c41592b0 2023-07-06T19:59:50.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.340+0000 7f40cb5e8700 1 -- 172.21.15.6:0/2513771399 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f40a806ace0 msgr2=0x7f40a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:50.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.340+0000 7f40cb5e8700 1 --2- 172.21.15.6:0/2513771399 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f40a806ace0 0x7f40a806d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f40c000be30 tx=0x7f40c0013000 comp rx=0 tx=0).stop 2023-07-06T19:59:50.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.340+0000 7f40cb5e8700 1 -- 172.21.15.6:0/2513771399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40c41592b0 msgr2=0x7f40c40b2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:50.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.340+0000 7f40cb5e8700 1 --2- 172.21.15.6:0/2513771399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40c41592b0 0x7f40c40b2ae0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f40b400c540 tx=0x7f40b400c900 comp rx=0 tx=0).stop 2023-07-06T19:59:50.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.340+0000 7f40cb5e8700 1 -- 172.21.15.6:0/2513771399 shutdown_connections 2023-07-06T19:59:50.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.340+0000 7f40cb5e8700 1 --2- 172.21.15.6:0/2513771399 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f40a806ace0 0x7f40a806d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:50.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.340+0000 7f40cb5e8700 1 --2- 172.21.15.6:0/2513771399 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40c415cd40 0x7f40c4071590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:50.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.340+0000 7f40cb5e8700 1 --2- 172.21.15.6:0/2513771399 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f40c40cd950 0x7f40c41ed1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:50.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.340+0000 7f40cb5e8700 1 --2- 172.21.15.6:0/2513771399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40c41592b0 0x7f40c40b2ae0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:50.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.340+0000 7f40cb5e8700 1 -- 172.21.15.6:0/2513771399 >> 172.21.15.6:0/2513771399 conn(0x7f40c40cf960 msgr2=0x7f40c4152490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:50.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.340+0000 7f40cb5e8700 1 -- 172.21.15.6:0/2513771399 shutdown_connections 2023-07-06T19:59:50.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.340+0000 7f40cb5e8700 1 -- 172.21.15.6:0/2513771399 wait complete. 2023-07-06T19:59:50.354 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-06T19:59:50.355 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T19:59:50.400 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-06T19:59:50.453 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-06T19:59:50.454 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:59:50.454 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T19:59:50.488 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:59:50.489 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T19:59:50.548 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:59:50.549 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T19:59:50.610 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T19:59:50.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.770+0000 7f845ecb5700 1 Processor -- start 2023-07-06T19:59:50.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.770+0000 7f845ecb5700 1 -- start start 2023-07-06T19:59:50.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.771+0000 7f845ecb5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8458071d00 0x7f8458157f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:50.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.771+0000 7f845ecb5700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845806a990 con 0x7f8458071930 2023-07-06T19:59:50.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.771+0000 7f845ecb5700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845806ac30 con 0x7f845806ce60 2023-07-06T19:59:50.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.771+0000 7f845ecb5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845806b150 con 0x7f8458071d00 2023-07-06T19:59:50.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.771+0000 7f845d252700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8458071d00 0x7f8458157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:50.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.771+0000 7f845ca51700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8458071930 0x7f8458157800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33050/0 (socket says 172.21.15.6:33050) 2023-07-06T19:59:50.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.771+0000 7f845d252700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8458071d00 0x7f8458157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60078/0 (socket says 172.21.15.6:60078) 2023-07-06T19:59:50.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.771+0000 7f845ca51700 1 -- 172.21.15.6:0/510800114 learned_addr learned my addr 172.21.15.6:0/510800114 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:50.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.771+0000 7f845d252700 1 -- 172.21.15.6:0/510800114 >> v1:172.21.15.40:6789/0 conn(0x7f845806ce60 legacy=0x7f84580b4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:50.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.771+0000 7f845d252700 1 -- 172.21.15.6:0/510800114 >> v1:172.21.15.6:6789/0 conn(0x7f8458071930 legacy=0x7f8458157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:50.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.771+0000 7f84577fe700 1 -- 172.21.15.6:0/510800114 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2635173277 0 0) 0x7f845806a990 con 0x7f8458071930 2023-07-06T19:59:50.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.771+0000 7f845d252700 1 -- 172.21.15.6:0/510800114 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845806b360 con 0x7f8458071d00 2023-07-06T19:59:50.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.771+0000 7f845d252700 1 --2- 172.21.15.6:0/510800114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8458071d00 0x7f8458157f10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8450009d90 tx=0x7f845000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac11fc7671665b72 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:50.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.772+0000 7f84577fe700 1 -- 172.21.15.6:0/510800114 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845000e070 con 0x7f8458071d00 2023-07-06T19:59:50.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.772+0000 7f84577fe700 1 -- 172.21.15.6:0/510800114 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845000bb90 con 0x7f8458071d00 2023-07-06T19:59:50.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.772+0000 7f84577fe700 1 -- 172.21.15.6:0/510800114 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8450003a20 con 0x7f8458071d00 2023-07-06T19:59:50.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.772+0000 7f845ecb5700 1 -- 172.21.15.6:0/510800114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8458071d00 msgr2=0x7f8458157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:50.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.772+0000 7f845ecb5700 1 --2- 172.21.15.6:0/510800114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8458071d00 0x7f8458157f10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8450009d90 tx=0x7f845000b330 comp rx=0 tx=0).stop 2023-07-06T19:59:50.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.772+0000 7f845ecb5700 1 -- 172.21.15.6:0/510800114 shutdown_connections 2023-07-06T19:59:50.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.772+0000 7f845ecb5700 1 --2- 172.21.15.6:0/510800114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8458071d00 0x7f8458157f10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:50.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.772+0000 7f845ecb5700 1 -- 172.21.15.6:0/510800114 >> 172.21.15.6:0/510800114 conn(0x7f84580cc420 msgr2=0x7f84580cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:50.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.772+0000 7f845ecb5700 1 -- 172.21.15.6:0/510800114 shutdown_connections 2023-07-06T19:59:50.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.772+0000 7f845ecb5700 1 -- 172.21.15.6:0/510800114 wait complete. 2023-07-06T19:59:50.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.773+0000 7f845ecb5700 1 Processor -- start 2023-07-06T19:59:50.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.773+0000 7f845ecb5700 1 -- start start 2023-07-06T19:59:50.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.774+0000 7f845ecb5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f845806ce60 0x7f84581f36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:50.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.774+0000 7f845ecb5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8458071930 0x7f84581ef5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:50.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.774+0000 7f845ecb5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8458071d00 0x7f84581efb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:50.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.774+0000 7f845ecb5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8458153720 con 0x7f8458071930 2023-07-06T19:59:50.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.774+0000 7f845ecb5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84581f09a0 con 0x7f8458071d00 2023-07-06T19:59:50.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.774+0000 7f845ecb5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84581f3240 con 0x7f845806ce60 2023-07-06T19:59:50.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.774+0000 7f8457fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8458071930 0x7f84581ef5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:50.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.774+0000 7f8457fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8458071930 0x7f84581ef5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60082/0 (socket says 172.21.15.6:60082) 2023-07-06T19:59:50.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.774+0000 7f8457fff700 1 -- 172.21.15.6:0/4065960746 learned_addr learned my addr 172.21.15.6:0/4065960746 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:50.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.775+0000 7f845d252700 1 --2- 172.21.15.6:0/4065960746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8458071d00 0x7f84581efb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:50.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.775+0000 7f8457fff700 1 -- 172.21.15.6:0/4065960746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f845806ce60 msgr2=0x7f84581f36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:50.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.775+0000 7f8457fff700 1 --2- 172.21.15.6:0/4065960746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f845806ce60 0x7f84581f36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:50.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.775+0000 7f8457fff700 1 -- 172.21.15.6:0/4065960746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8458071d00 msgr2=0x7f84581efb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:50.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.775+0000 7f8457fff700 1 --2- 172.21.15.6:0/4065960746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8458071d00 0x7f84581efb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:50.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.775+0000 7f8457fff700 1 -- 172.21.15.6:0/4065960746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8450009a70 con 0x7f8458071930 2023-07-06T19:59:50.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.775+0000 7f8457fff700 1 --2- 172.21.15.6:0/4065960746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8458071930 0x7f84581ef5d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f844400c500 tx=0x7f844400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:50.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.775+0000 7f84557fa700 1 -- 172.21.15.6:0/4065960746 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8444011790 con 0x7f8458071930 2023-07-06T19:59:50.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.775+0000 7f84557fa700 1 -- 172.21.15.6:0/4065960746 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84440118f0 con 0x7f8458071930 2023-07-06T19:59:50.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.775+0000 7f84557fa700 1 -- 172.21.15.6:0/4065960746 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8444011ca0 con 0x7f8458071930 2023-07-06T19:59:50.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.775+0000 7f845ecb5700 1 -- 172.21.15.6:0/4065960746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84581f0100 con 0x7f8458071930 2023-07-06T19:59:50.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.775+0000 7f845ecb5700 1 -- 172.21.15.6:0/4065960746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84581f06c0 con 0x7f8458071930 2023-07-06T19:59:50.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.776+0000 7f845ecb5700 1 -- 172.21.15.6:0/4065960746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84580c9af0 con 0x7f8458071930 2023-07-06T19:59:50.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.777+0000 7f84557fa700 1 -- 172.21.15.6:0/4065960746 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f844401c460 con 0x7f8458071930 2023-07-06T19:59:50.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.777+0000 7f84557fa700 1 --2- 172.21.15.6:0/4065960746 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f843c06ace0 0x7f843c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:50.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.777+0000 7f84557fa700 1 -- 172.21.15.6:0/4065960746 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f84440895c0 con 0x7f8458071930 2023-07-06T19:59:50.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.777+0000 7f845ca51700 1 --2- 172.21.15.6:0/4065960746 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f843c06ace0 0x7f843c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:50.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.777+0000 7f845ca51700 1 --2- 172.21.15.6:0/4065960746 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f843c06ace0 0x7f843c06d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f844c0011e0 tx=0x7f844c0079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:50.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.781+0000 7f84557fa700 1 -- 172.21.15.6:0/4065960746 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f84440543d0 con 0x7f8458071930 2023-07-06T19:59:50.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.981+0000 7f845ecb5700 1 -- 172.21.15.6:0/4065960746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84581f3380 con 0x7f8458071930 2023-07-06T19:59:50.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.982+0000 7f84557fa700 1 -- 172.21.15.6:0/4065960746 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20059 (secure 0 0 0) 0x7f84581f3380 con 0x7f8458071930 2023-07-06T19:59:50.986 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:50.986 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":29,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:59:33.917851+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T19:58:51.062712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T19:58:52.130350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T19:58:55.785128+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:59:50.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.985+0000 7f845ecb5700 1 -- 172.21.15.6:0/4065960746 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f843c06ace0 msgr2=0x7f843c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:50.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.985+0000 7f845ecb5700 1 --2- 172.21.15.6:0/4065960746 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f843c06ace0 0x7f843c06d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f844c0011e0 tx=0x7f844c0079b0 comp rx=0 tx=0).stop 2023-07-06T19:59:50.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.985+0000 7f845ecb5700 1 -- 172.21.15.6:0/4065960746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8458071930 msgr2=0x7f84581ef5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:50.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.985+0000 7f845ecb5700 1 --2- 172.21.15.6:0/4065960746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8458071930 0x7f84581ef5d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f844400c500 tx=0x7f844400c8c0 comp rx=0 tx=0).stop 2023-07-06T19:59:50.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.985+0000 7f845ecb5700 1 -- 172.21.15.6:0/4065960746 shutdown_connections 2023-07-06T19:59:50.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.985+0000 7f845ecb5700 1 --2- 172.21.15.6:0/4065960746 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f843c06ace0 0x7f843c06d190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:50.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.985+0000 7f845ecb5700 1 --2- 172.21.15.6:0/4065960746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8458071d00 0x7f84581efb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:50.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.985+0000 7f845ecb5700 1 --2- 172.21.15.6:0/4065960746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f845806ce60 0x7f84581f36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:50.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.985+0000 7f845ecb5700 1 --2- 172.21.15.6:0/4065960746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8458071930 0x7f84581ef5d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:50.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.985+0000 7f845ecb5700 1 -- 172.21.15.6:0/4065960746 >> 172.21.15.6:0/4065960746 conn(0x7f84580cc420 msgr2=0x7f845815ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:50.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.985+0000 7f845ecb5700 1 -- 172.21.15.6:0/4065960746 shutdown_connections 2023-07-06T19:59:50.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:50.985+0000 7f845ecb5700 1 -- 172.21.15.6:0/4065960746 wait complete. 2023-07-06T19:59:51.000 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T19:58:38.767727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T19:58:45.759808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T19:58:51.062712+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T19:58:52.130350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T19:58:55.785128+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T19:59:51.002 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T19:59:51.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.141+0000 7fa331fcf700 1 Processor -- start 2023-07-06T19:59:51.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.141+0000 7fa331fcf700 1 -- start start 2023-07-06T19:59:51.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.142+0000 7fa331fcf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa32c15a520 0x7fa32c06dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:51.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.142+0000 7fa331fcf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa32c0d15e0 0x7fa32c06e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:51.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.142+0000 7fa331fcf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa32c0cd300 con 0x7fa32c06e690 2023-07-06T19:59:51.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.142+0000 7fa331fcf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa32c0b0290 con 0x7fa32c15a520 2023-07-06T19:59:51.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.142+0000 7fa331fcf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0ccd80 con 0x7fa32c0d15e0 2023-07-06T19:59:51.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.143+0000 7fa32b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa32c15a520 0x7fa32c06dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:51.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.143+0000 7fa32b7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa32c15a520 0x7fa32c06dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:39124/0 (socket says 172.21.15.6:39124) 2023-07-06T19:59:51.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.143+0000 7fa32bfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa32c06e690 0x7fa32c15ded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:51172/0 (socket says 172.21.15.6:51172) 2023-07-06T19:59:51.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.143+0000 7fa32b7fe700 1 -- 172.21.15.6:0/1302458695 learned_addr learned my addr 172.21.15.6:0/1302458695 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:51.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.143+0000 7fa32affd700 1 --2- 172.21.15.6:0/1302458695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa32c0d15e0 0x7fa32c06e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:51.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.143+0000 7fa32affd700 1 -- 172.21.15.6:0/1302458695 >> v2:172.21.15.40:3300/0 conn(0x7fa32c15a520 msgr2=0x7fa32c06dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:51.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.143+0000 7fa32affd700 1 --2- 172.21.15.6:0/1302458695 >> v2:172.21.15.40:3300/0 conn(0x7fa32c15a520 0x7fa32c06dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:51.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.143+0000 7fa32affd700 1 -- 172.21.15.6:0/1302458695 >> v1:172.21.15.40:6789/0 conn(0x7fa32c06e690 legacy=0x7fa32c15ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:51.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.143+0000 7fa32affd700 1 -- 172.21.15.6:0/1302458695 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c0cd020 con 0x7fa32c0d15e0 2023-07-06T19:59:51.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.143+0000 7fa32b7fe700 1 --2- 172.21.15.6:0/1302458695 >> v2:172.21.15.40:3300/0 conn(0x7fa32c15a520 0x7fa32c06dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:59:51.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.144+0000 7fa32affd700 1 --2- 172.21.15.6:0/1302458695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa32c0d15e0 0x7fa32c06e150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa320009840 tx=0x7fa320009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eade4685225a347f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:51.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.144+0000 7fa32a7fc700 1 -- 172.21.15.6:0/1302458695 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa320011830 con 0x7fa32c0d15e0 2023-07-06T19:59:51.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.144+0000 7fa32a7fc700 1 -- 172.21.15.6:0/1302458695 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa320011990 con 0x7fa32c0d15e0 2023-07-06T19:59:51.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.144+0000 7fa32a7fc700 1 -- 172.21.15.6:0/1302458695 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa320011d20 con 0x7fa32c0d15e0 2023-07-06T19:59:51.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.144+0000 7fa331fcf700 1 -- 172.21.15.6:0/1302458695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa32c0d15e0 msgr2=0x7fa32c06e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:51.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.144+0000 7fa331fcf700 1 --2- 172.21.15.6:0/1302458695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa32c0d15e0 0x7fa32c06e150 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa320009840 tx=0x7fa320009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:51.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.144+0000 7fa331fcf700 1 -- 172.21.15.6:0/1302458695 shutdown_connections 2023-07-06T19:59:51.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.144+0000 7fa331fcf700 1 --2- 172.21.15.6:0/1302458695 >> v2:172.21.15.40:3300/0 conn(0x7fa32c15a520 0x7fa32c06dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:51.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.144+0000 7fa331fcf700 1 --2- 172.21.15.6:0/1302458695 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa32c0d15e0 0x7fa32c06e150 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:51.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.144+0000 7fa331fcf700 1 -- 172.21.15.6:0/1302458695 >> 172.21.15.6:0/1302458695 conn(0x7fa32c0ce120 msgr2=0x7fa32c0d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:51.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.144+0000 7fa331fcf700 1 -- 172.21.15.6:0/1302458695 shutdown_connections 2023-07-06T19:59:51.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.144+0000 7fa331fcf700 1 -- 172.21.15.6:0/1302458695 wait complete. 2023-07-06T19:59:51.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.146+0000 7fa331fcf700 1 Processor -- start 2023-07-06T19:59:51.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.146+0000 7fa331fcf700 1 -- start start 2023-07-06T19:59:51.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.146+0000 7fa331fcf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa32c06e690 0x7fa32c159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:51.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.146+0000 7fa331fcf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa32c0d15e0 0x7fa32c06cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:51.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.146+0000 7fa331fcf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa32c15a520 0x7fa32c1564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:51.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.146+0000 7fa331fcf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0c6ba0 con 0x7fa32c0d15e0 2023-07-06T19:59:51.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.146+0000 7fa331fcf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c159dc0 con 0x7fa32c06e690 2023-07-06T19:59:51.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.146+0000 7fa331fcf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c0b1f60 con 0x7fa32c15a520 2023-07-06T19:59:51.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.147+0000 7fa32affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa32c0d15e0 0x7fa32c06cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.147+0000 7fa32affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa32c0d15e0 0x7fa32c06cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60096/0 (socket says 172.21.15.6:60096) 2023-07-06T19:59:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.147+0000 7fa32affd700 1 -- 172.21.15.6:0/698242061 learned_addr learned my addr 172.21.15.6:0/698242061 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.147+0000 7fa32b7fe700 1 --2- 172.21.15.6:0/698242061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa32c06e690 0x7fa32c159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.147+0000 7fa32bfff700 1 --2- 172.21.15.6:0/698242061 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa32c15a520 0x7fa32c1564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.147+0000 7fa32affd700 1 -- 172.21.15.6:0/698242061 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa32c15a520 msgr2=0x7fa32c1564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.147+0000 7fa32affd700 1 --2- 172.21.15.6:0/698242061 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa32c15a520 0x7fa32c1564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.147+0000 7fa32affd700 1 -- 172.21.15.6:0/698242061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa32c06e690 msgr2=0x7fa32c159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.147+0000 7fa32affd700 1 --2- 172.21.15.6:0/698242061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa32c06e690 0x7fa32c159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.147+0000 7fa32affd700 1 -- 172.21.15.6:0/698242061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31c009550 con 0x7fa32c0d15e0 2023-07-06T19:59:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.147+0000 7fa32b7fe700 1 --2- 172.21.15.6:0/698242061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa32c06e690 0x7fa32c159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:51.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.147+0000 7fa32affd700 1 --2- 172.21.15.6:0/698242061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa32c0d15e0 0x7fa32c06cdc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa3200090b0 tx=0x7fa320004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:51.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.147+0000 7fa313fff700 1 -- 172.21.15.6:0/698242061 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3200036a0 con 0x7fa32c0d15e0 2023-07-06T19:59:51.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.147+0000 7fa313fff700 1 -- 172.21.15.6:0/698242061 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32001f070 con 0x7fa32c0d15e0 2023-07-06T19:59:51.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.147+0000 7fa331fcf700 1 -- 172.21.15.6:0/698242061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3200094a0 con 0x7fa32c0d15e0 2023-07-06T19:59:51.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.147+0000 7fa313fff700 1 -- 172.21.15.6:0/698242061 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa320003a20 con 0x7fa32c0d15e0 2023-07-06T19:59:51.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.147+0000 7fa331fcf700 1 -- 172.21.15.6:0/698242061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32c0b1630 con 0x7fa32c0d15e0 2023-07-06T19:59:51.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.148+0000 7fa331fcf700 1 -- 172.21.15.6:0/698242061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32c0b2110 con 0x7fa32c0d15e0 2023-07-06T19:59:51.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.149+0000 7fa313fff700 1 -- 172.21.15.6:0/698242061 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa320003b80 con 0x7fa32c0d15e0 2023-07-06T19:59:51.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.149+0000 7fa313fff700 1 --2- 172.21.15.6:0/698242061 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa31806ace0 0x7fa31806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:51.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.149+0000 7fa313fff700 1 -- 172.21.15.6:0/698242061 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa320021070 con 0x7fa32c0d15e0 2023-07-06T19:59:51.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.149+0000 7fa32b7fe700 1 --2- 172.21.15.6:0/698242061 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa31806ace0 0x7fa31806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:51.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.150+0000 7fa32b7fe700 1 --2- 172.21.15.6:0/698242061 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa31806ace0 0x7fa31806d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa31c009db0 tx=0x7fa31c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:51.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.154+0000 7fa313fff700 1 -- 172.21.15.6:0/698242061 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa32c0b2110 con 0x7fa32c0d15e0 2023-07-06T19:59:51.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.350+0000 7fa331fcf700 1 -- 172.21.15.6:0/698242061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa32c155580 con 0x7fa32c0d15e0 2023-07-06T19:59:51.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.351+0000 7fa313fff700 1 -- 172.21.15.6:0/698242061 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa320059a10 con 0x7fa32c0d15e0 2023-07-06T19:59:51.356 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-06T19:59:51.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.353+0000 7fa331fcf700 1 -- 172.21.15.6:0/698242061 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa31806ace0 msgr2=0x7fa31806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:51.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.353+0000 7fa331fcf700 1 --2- 172.21.15.6:0/698242061 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa31806ace0 0x7fa31806d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa31c009db0 tx=0x7fa31c008040 comp rx=0 tx=0).stop 2023-07-06T19:59:51.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.353+0000 7fa331fcf700 1 -- 172.21.15.6:0/698242061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa32c0d15e0 msgr2=0x7fa32c06cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:51.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.353+0000 7fa331fcf700 1 --2- 172.21.15.6:0/698242061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa32c0d15e0 0x7fa32c06cdc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa3200090b0 tx=0x7fa320004750 comp rx=0 tx=0).stop 2023-07-06T19:59:51.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.353+0000 7fa331fcf700 1 -- 172.21.15.6:0/698242061 shutdown_connections 2023-07-06T19:59:51.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.353+0000 7fa331fcf700 1 --2- 172.21.15.6:0/698242061 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa31806ace0 0x7fa31806d190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:51.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.353+0000 7fa331fcf700 1 --2- 172.21.15.6:0/698242061 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa32c15a520 0x7fa32c1564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:51.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.353+0000 7fa331fcf700 1 --2- 172.21.15.6:0/698242061 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa32c06e690 0x7fa32c159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:51.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.353+0000 7fa331fcf700 1 --2- 172.21.15.6:0/698242061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa32c0d15e0 0x7fa32c06cdc0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:51.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.353+0000 7fa331fcf700 1 -- 172.21.15.6:0/698242061 >> 172.21.15.6:0/698242061 conn(0x7fa32c0ce120 msgr2=0x7fa32c0ca1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:51.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.353+0000 7fa331fcf700 1 -- 172.21.15.6:0/698242061 shutdown_connections 2023-07-06T19:59:51.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.353+0000 7fa331fcf700 1 -- 172.21.15.6:0/698242061 wait complete. 2023-07-06T19:59:51.367 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T19:59:51.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.494+0000 7f67c1629700 1 Processor -- start 2023-07-06T19:59:51.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.494+0000 7f67c1629700 1 -- start start 2023-07-06T19:59:51.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.495+0000 7f67c1629700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67bc0b1f10 0x7f67bc0cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:51.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.495+0000 7f67c1629700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67bc160e00 0x7f67bc06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:51.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.495+0000 7f67c1629700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67bc15d480 con 0x7f67bc15d910 2023-07-06T19:59:51.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.495+0000 7f67c1629700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67bc15cc60 con 0x7f67bc160e00 2023-07-06T19:59:51.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.495+0000 7f67c1629700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc15ce70 con 0x7f67bc0b1f10 2023-07-06T19:59:51.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.495+0000 7f67ba7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67bc160e00 0x7f67bc06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:51.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.495+0000 7f67ba7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f67bc160e00 0x7f67bc06bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60104/0 (socket says 172.21.15.6:60104) 2023-07-06T19:59:51.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.495+0000 7f67ba7fc700 1 -- 172.21.15.6:0/170929454 learned_addr learned my addr 172.21.15.6:0/170929454 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:51.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.495+0000 7f67baffd700 1 --2- 172.21.15.6:0/170929454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67bc0b1f10 0x7f67bc0cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:51.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.495+0000 7f67ba7fc700 1 -- 172.21.15.6:0/170929454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67bc0b1f10 msgr2=0x7f67bc0cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:51.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.495+0000 7f67ba7fc700 1 --2- 172.21.15.6:0/170929454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67bc0b1f10 0x7f67bc0cd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:51.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.495+0000 7f67ba7fc700 1 -- 172.21.15.6:0/170929454 >> v1:172.21.15.40:6789/0 conn(0x7f67bc15d910 legacy=0x7f67bc06a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:51.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.495+0000 7f67ba7fc700 1 -- 172.21.15.6:0/170929454 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67bc0cddd0 con 0x7f67bc160e00 2023-07-06T19:59:51.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.495+0000 7f67baffd700 1 --2- 172.21.15.6:0/170929454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67bc0b1f10 0x7f67bc0cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:51.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.495+0000 7f67ba7fc700 1 --2- 172.21.15.6:0/170929454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67bc160e00 0x7f67bc06bdb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f67b00098f0 tx=0x7f67b0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76e74828b904529 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:51.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.495+0000 7f67b9ffb700 1 -- 172.21.15.6:0/170929454 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b0004230 con 0x7f67bc160e00 2023-07-06T19:59:51.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.495+0000 7f67b9ffb700 1 -- 172.21.15.6:0/170929454 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b0004390 con 0x7f67bc160e00 2023-07-06T19:59:51.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.495+0000 7f67b9ffb700 1 -- 172.21.15.6:0/170929454 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b00036a0 con 0x7f67bc160e00 2023-07-06T19:59:51.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.496+0000 7f67c1629700 1 -- 172.21.15.6:0/170929454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67bc160e00 msgr2=0x7f67bc06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:51.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.496+0000 7f67c1629700 1 --2- 172.21.15.6:0/170929454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67bc160e00 0x7f67bc06bdb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f67b00098f0 tx=0x7f67b0009c00 comp rx=0 tx=0).stop 2023-07-06T19:59:51.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.496+0000 7f67c1629700 1 -- 172.21.15.6:0/170929454 shutdown_connections 2023-07-06T19:59:51.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.496+0000 7f67c1629700 1 --2- 172.21.15.6:0/170929454 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67bc0b1f10 0x7f67bc0cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:51.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.496+0000 7f67c1629700 1 --2- 172.21.15.6:0/170929454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67bc160e00 0x7f67bc06bdb0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:51.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.496+0000 7f67c1629700 1 -- 172.21.15.6:0/170929454 >> 172.21.15.6:0/170929454 conn(0x7f67bc0d2c70 msgr2=0x7f67bc0d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:51.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.496+0000 7f67c1629700 1 -- 172.21.15.6:0/170929454 shutdown_connections 2023-07-06T19:59:51.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.496+0000 7f67c1629700 1 -- 172.21.15.6:0/170929454 wait complete. 2023-07-06T19:59:51.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.497+0000 7f67c1629700 1 Processor -- start 2023-07-06T19:59:51.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.497+0000 7f67c1629700 1 -- start start 2023-07-06T19:59:51.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.498+0000 7f67c1629700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67bc0b1f10 0x7f67bc153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:51.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.498+0000 7f67c1629700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67bc15d910 0x7f67bc0b86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:51.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.498+0000 7f67c1629700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67bc160e00 0x7f67bc1537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:51.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.498+0000 7f67c1629700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc154810 con 0x7f67bc0b1f10 2023-07-06T19:59:51.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.498+0000 7f67c1629700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc0c7ac0 con 0x7f67bc160e00 2023-07-06T19:59:51.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.498+0000 7f67c1629700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc0c8450 con 0x7f67bc15d910 2023-07-06T19:59:51.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.498+0000 7f67baffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67bc0b1f10 0x7f67bc153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:51.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.498+0000 7f67baffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67bc0b1f10 0x7f67bc153f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60108/0 (socket says 172.21.15.6:60108) 2023-07-06T19:59:51.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.498+0000 7f67baffd700 1 -- 172.21.15.6:0/1350035314 learned_addr learned my addr 172.21.15.6:0/1350035314 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:51.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.498+0000 7f67ba7fc700 1 --2- 172.21.15.6:0/1350035314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67bc15d910 0x7f67bc0b86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:51.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.498+0000 7f67bb7fe700 1 --2- 172.21.15.6:0/1350035314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67bc160e00 0x7f67bc1537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:51.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.498+0000 7f67baffd700 1 -- 172.21.15.6:0/1350035314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67bc15d910 msgr2=0x7f67bc0b86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:51.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.498+0000 7f67baffd700 1 --2- 172.21.15.6:0/1350035314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67bc15d910 0x7f67bc0b86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:51.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.498+0000 7f67baffd700 1 -- 172.21.15.6:0/1350035314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67bc160e00 msgr2=0x7f67bc1537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:51.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.498+0000 7f67baffd700 1 --2- 172.21.15.6:0/1350035314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67bc160e00 0x7f67bc1537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:51.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.499+0000 7f67baffd700 1 -- 172.21.15.6:0/1350035314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b0009550 con 0x7f67bc0b1f10 2023-07-06T19:59:51.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.499+0000 7f67baffd700 1 --2- 172.21.15.6:0/1350035314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67bc0b1f10 0x7f67bc153f00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00c750 tx=0x7f67ac00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:51.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.499+0000 7f67a37fe700 1 -- 172.21.15.6:0/1350035314 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac011800 con 0x7f67bc0b1f10 2023-07-06T19:59:51.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.499+0000 7f67a37fe700 1 -- 172.21.15.6:0/1350035314 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ac011960 con 0x7f67bc0b1f10 2023-07-06T19:59:51.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.499+0000 7f67c1629700 1 -- 172.21.15.6:0/1350035314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67bc153d30 con 0x7f67bc0b1f10 2023-07-06T19:59:51.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.499+0000 7f67a37fe700 1 -- 172.21.15.6:0/1350035314 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ac011cd0 con 0x7f67bc0b1f10 2023-07-06T19:59:51.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.499+0000 7f67c1629700 1 -- 172.21.15.6:0/1350035314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67bc0c7fb0 con 0x7f67bc0b1f10 2023-07-06T19:59:51.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.500+0000 7f67c1629700 1 -- 172.21.15.6:0/1350035314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67bc04eb90 con 0x7f67bc0b1f10 2023-07-06T19:59:51.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.500+0000 7f67a37fe700 1 -- 172.21.15.6:0/1350035314 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f67ac021350 con 0x7f67bc0b1f10 2023-07-06T19:59:51.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.501+0000 7f67a37fe700 1 --2- 172.21.15.6:0/1350035314 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f67a806ace0 0x7f67a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:51.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.501+0000 7f67a37fe700 1 -- 172.21.15.6:0/1350035314 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f67ac089700 con 0x7f67bc0b1f10 2023-07-06T19:59:51.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.501+0000 7f67ba7fc700 1 --2- 172.21.15.6:0/1350035314 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f67a806ace0 0x7f67a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:51.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.501+0000 7f67ba7fc700 1 --2- 172.21.15.6:0/1350035314 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f67a806ace0 0x7f67a806d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f67b0009130 tx=0x7f67b0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:51.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.505+0000 7f67a37fe700 1 -- 172.21.15.6:0/1350035314 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f67ac057fa0 con 0x7f67bc0b1f10 2023-07-06T19:59:51.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.702+0000 7f67c1629700 1 -- 172.21.15.6:0/1350035314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f67bc06b730 con 0x7f67bc0b1f10 2023-07-06T19:59:51.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.702+0000 7f67a37fe700 1 -- 172.21.15.6:0/1350035314 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f67ac057b30 con 0x7f67bc0b1f10 2023-07-06T19:59:51.705 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-06T19:59:51.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.704+0000 7f67c1629700 1 -- 172.21.15.6:0/1350035314 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f67a806ace0 msgr2=0x7f67a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:51.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.704+0000 7f67c1629700 1 --2- 172.21.15.6:0/1350035314 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f67a806ace0 0x7f67a806d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f67b0009130 tx=0x7f67b0008030 comp rx=0 tx=0).stop 2023-07-06T19:59:51.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.704+0000 7f67c1629700 1 -- 172.21.15.6:0/1350035314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67bc0b1f10 msgr2=0x7f67bc153f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:51.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.704+0000 7f67c1629700 1 --2- 172.21.15.6:0/1350035314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67bc0b1f10 0x7f67bc153f00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00c750 tx=0x7f67ac00cb10 comp rx=0 tx=0).stop 2023-07-06T19:59:51.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.705+0000 7f67c1629700 1 -- 172.21.15.6:0/1350035314 shutdown_connections 2023-07-06T19:59:51.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.705+0000 7f67c1629700 1 --2- 172.21.15.6:0/1350035314 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f67a806ace0 0x7f67a806d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:51.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.705+0000 7f67c1629700 1 --2- 172.21.15.6:0/1350035314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67bc0b1f10 0x7f67bc153f00 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:51.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.705+0000 7f67c1629700 1 --2- 172.21.15.6:0/1350035314 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67bc160e00 0x7f67bc1537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:51.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.705+0000 7f67c1629700 1 --2- 172.21.15.6:0/1350035314 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f67bc15d910 0x7f67bc0b86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:51.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.705+0000 7f67c1629700 1 -- 172.21.15.6:0/1350035314 >> 172.21.15.6:0/1350035314 conn(0x7f67bc0d2c70 msgr2=0x7f67bc06c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:51.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.705+0000 7f67c1629700 1 -- 172.21.15.6:0/1350035314 shutdown_connections 2023-07-06T19:59:51.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.705+0000 7f67c1629700 1 -- 172.21.15.6:0/1350035314 wait complete. 2023-07-06T19:59:51.720 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T19:59:51.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.848+0000 7f4fcb1b8700 1 Processor -- start 2023-07-06T19:59:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.848+0000 7f4fcb1b8700 1 -- start start 2023-07-06T19:59:51.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.849+0000 7f4fcb1b8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4fc4071900 0x7f4fc40ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.849+0000 7f4fcb1b8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc415c660 0x7f4fc40ca680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.849+0000 7f4fcb1b8700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc40cb310 con 0x7f4fc4071cd0 2023-07-06T19:59:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.849+0000 7f4fcb1b8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc40cdbf0 con 0x7f4fc4071900 2023-07-06T19:59:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.849+0000 7f4fcb1b8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc40af070 con 0x7f4fc415c660 2023-07-06T19:59:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.850+0000 7f4fc9755700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc415c660 0x7f4fc40ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:51.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.850+0000 7f4fc8f54700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4fc4071900 0x7f4fc40ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.850+0000 7f4fc9755700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc415c660 0x7f4fc40ca680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:52764/0 (socket says 172.21.15.6:52764) 2023-07-06T19:59:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.850+0000 7f4fc9755700 1 -- 172.21.15.6:0/801326232 learned_addr learned my addr 172.21.15.6:0/801326232 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.850+0000 7f4fc9755700 1 -- 172.21.15.6:0/801326232 >> v2:172.21.15.40:3300/0 conn(0x7f4fc4071900 msgr2=0x7f4fc40ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.850+0000 7f4fc9755700 1 --2- 172.21.15.6:0/801326232 >> v2:172.21.15.40:3300/0 conn(0x7f4fc4071900 0x7f4fc40ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.850+0000 7f4fc9755700 1 -- 172.21.15.6:0/801326232 >> v1:172.21.15.40:6789/0 conn(0x7f4fc4071cd0 legacy=0x7f4fc415bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.850+0000 7f4fc9755700 1 -- 172.21.15.6:0/801326232 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc40cad50 con 0x7f4fc415c660 2023-07-06T19:59:51.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.850+0000 7f4fc8f54700 1 --2- 172.21.15.6:0/801326232 >> v2:172.21.15.40:3300/0 conn(0x7f4fc4071900 0x7f4fc40ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:59:51.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.850+0000 7f4fc9755700 1 --2- 172.21.15.6:0/801326232 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc415c660 0x7f4fc40ca680 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009e50 tx=0x7f4fbc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=134e79753cd691ec server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:51.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.850+0000 7f4fc37fe700 1 -- 172.21.15.6:0/801326232 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc00e070 con 0x7f4fc415c660 2023-07-06T19:59:51.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.850+0000 7f4fc37fe700 1 -- 172.21.15.6:0/801326232 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fbc00b910 con 0x7f4fc415c660 2023-07-06T19:59:51.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.850+0000 7f4fc37fe700 1 -- 172.21.15.6:0/801326232 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc00bcc0 con 0x7f4fc415c660 2023-07-06T19:59:51.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.851+0000 7f4fcb1b8700 1 -- 172.21.15.6:0/801326232 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc415c660 msgr2=0x7f4fc40ca680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:51.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.851+0000 7f4fcb1b8700 1 --2- 172.21.15.6:0/801326232 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc415c660 0x7f4fc40ca680 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc009e50 tx=0x7f4fbc00b330 comp rx=0 tx=0).stop 2023-07-06T19:59:51.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.851+0000 7f4fcb1b8700 1 -- 172.21.15.6:0/801326232 shutdown_connections 2023-07-06T19:59:51.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.851+0000 7f4fcb1b8700 1 --2- 172.21.15.6:0/801326232 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc415c660 0x7f4fc40ca680 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:51.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.851+0000 7f4fcb1b8700 1 --2- 172.21.15.6:0/801326232 >> v2:172.21.15.40:3300/0 conn(0x7f4fc4071900 0x7f4fc40ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:51.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.851+0000 7f4fcb1b8700 1 -- 172.21.15.6:0/801326232 >> 172.21.15.6:0/801326232 conn(0x7f4fc40cf960 msgr2=0x7f4fc40cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:51.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.851+0000 7f4fcb1b8700 1 -- 172.21.15.6:0/801326232 shutdown_connections 2023-07-06T19:59:51.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.851+0000 7f4fcb1b8700 1 -- 172.21.15.6:0/801326232 wait complete. 2023-07-06T19:59:51.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.852+0000 7f4fcb1b8700 1 Processor -- start 2023-07-06T19:59:51.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.852+0000 7f4fcb1b8700 1 -- start start 2023-07-06T19:59:51.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.853+0000 7f4fcb1b8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc4071900 0x7f4fc41f4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:51.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.853+0000 7f4fcb1b8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc4071cd0 0x7f4fc406bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:51.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.853+0000 7f4fcb1b8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc415c660 0x7f4fc4153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:51.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.853+0000 7f4fcb1b8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc41f50f0 con 0x7f4fc415c660 2023-07-06T19:59:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.853+0000 7f4fcb1b8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc4151bb0 con 0x7f4fc4071cd0 2023-07-06T19:59:51.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.853+0000 7f4fcb1b8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc4151e90 con 0x7f4fc4071900 2023-07-06T19:59:51.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.853+0000 7f4fc9755700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc415c660 0x7f4fc4153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:51.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.853+0000 7f4fc9755700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc415c660 0x7f4fc4153d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60126/0 (socket says 172.21.15.6:60126) 2023-07-06T19:59:51.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.853+0000 7f4fc9755700 1 -- 172.21.15.6:0/2582308941 learned_addr learned my addr 172.21.15.6:0/2582308941 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:51.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.853+0000 7f4fc8f54700 1 --2- 172.21.15.6:0/2582308941 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc4071900 0x7f4fc41f4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:51.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.853+0000 7f4fc3fff700 1 --2- 172.21.15.6:0/2582308941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc4071cd0 0x7f4fc406bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:51.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.853+0000 7f4fc9755700 1 -- 172.21.15.6:0/2582308941 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc4071900 msgr2=0x7f4fc41f4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:51.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.853+0000 7f4fc9755700 1 --2- 172.21.15.6:0/2582308941 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc4071900 0x7f4fc41f4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:51.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.853+0000 7f4fc9755700 1 -- 172.21.15.6:0/2582308941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc4071cd0 msgr2=0x7f4fc406bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:51.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.853+0000 7f4fc9755700 1 --2- 172.21.15.6:0/2582308941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc4071cd0 0x7f4fc406bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:51.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.853+0000 7f4fc9755700 1 -- 172.21.15.6:0/2582308941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb80094a0 con 0x7f4fc415c660 2023-07-06T19:59:51.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.853+0000 7f4fc3fff700 1 --2- 172.21.15.6:0/2582308941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc4071cd0 0x7f4fc406bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:51.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.854+0000 7f4fc9755700 1 --2- 172.21.15.6:0/2582308941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc415c660 0x7f4fc4153d80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4fc40cbfe0 tx=0x7f4fbc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:51.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.854+0000 7f4fc17fa700 1 -- 172.21.15.6:0/2582308941 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc004750 con 0x7f4fc415c660 2023-07-06T19:59:51.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.854+0000 7f4fc17fa700 1 -- 172.21.15.6:0/2582308941 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fbc0048b0 con 0x7f4fc415c660 2023-07-06T19:59:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.854+0000 7f4fc17fa700 1 -- 172.21.15.6:0/2582308941 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc01b670 con 0x7f4fc415c660 2023-07-06T19:59:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.854+0000 7f4fcb1b8700 1 -- 172.21.15.6:0/2582308941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fbc009b30 con 0x7f4fc415c660 2023-07-06T19:59:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.854+0000 7f4fcb1b8700 1 -- 172.21.15.6:0/2582308941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc415cb10 con 0x7f4fc415c660 2023-07-06T19:59:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.855+0000 7f4fcb1b8700 1 -- 172.21.15.6:0/2582308941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc404eb90 con 0x7f4fc415c660 2023-07-06T19:59:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.855+0000 7f4fc17fa700 1 -- 172.21.15.6:0/2582308941 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4fbc01b7d0 con 0x7f4fc415c660 2023-07-06T19:59:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.856+0000 7f4fc17fa700 1 --2- 172.21.15.6:0/2582308941 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4fa806ace0 0x7f4fa806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.856+0000 7f4fc8f54700 1 --2- 172.21.15.6:0/2582308941 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4fa806ace0 0x7f4fa806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:51.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.856+0000 7f4fc17fa700 1 -- 172.21.15.6:0/2582308941 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4fbc08afa0 con 0x7f4fc415c660 2023-07-06T19:59:51.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.856+0000 7f4fc8f54700 1 --2- 172.21.15.6:0/2582308941 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4fa806ace0 0x7f4fa806d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4fc414cf20 tx=0x7f4fb8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:51.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:51.860+0000 7f4fc17fa700 1 -- 172.21.15.6:0/2582308941 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4fbc0bd310 con 0x7f4fc415c660 2023-07-06T19:59:52.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.057+0000 7f4fcb1b8700 1 -- 172.21.15.6:0/2582308941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4fc40b58e0 con 0x7f4fc415c660 2023-07-06T19:59:52.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.057+0000 7f4fc17fa700 1 -- 172.21.15.6:0/2582308941 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4fbc055db0 con 0x7f4fc415c660 2023-07-06T19:59:52.067 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T19:59:52.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.059+0000 7f4fcb1b8700 1 -- 172.21.15.6:0/2582308941 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4fa806ace0 msgr2=0x7f4fa806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:52.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.059+0000 7f4fcb1b8700 1 --2- 172.21.15.6:0/2582308941 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4fa806ace0 0x7f4fa806d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4fc414cf20 tx=0x7f4fb8008040 comp rx=0 tx=0).stop 2023-07-06T19:59:52.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.059+0000 7f4fcb1b8700 1 -- 172.21.15.6:0/2582308941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc415c660 msgr2=0x7f4fc4153d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:52.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.059+0000 7f4fcb1b8700 1 --2- 172.21.15.6:0/2582308941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc415c660 0x7f4fc4153d80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4fc40cbfe0 tx=0x7f4fbc004ad0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.059+0000 7f4fcb1b8700 1 -- 172.21.15.6:0/2582308941 shutdown_connections 2023-07-06T19:59:52.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.059+0000 7f4fcb1b8700 1 --2- 172.21.15.6:0/2582308941 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4fa806ace0 0x7f4fa806d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.059+0000 7f4fcb1b8700 1 --2- 172.21.15.6:0/2582308941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fc415c660 0x7f4fc4153d80 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.059+0000 7f4fcb1b8700 1 --2- 172.21.15.6:0/2582308941 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4fc4071900 0x7f4fc41f4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.059+0000 7f4fcb1b8700 1 --2- 172.21.15.6:0/2582308941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4fc4071cd0 0x7f4fc406bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.059+0000 7f4fcb1b8700 1 -- 172.21.15.6:0/2582308941 >> 172.21.15.6:0/2582308941 conn(0x7f4fc40cf960 msgr2=0x7f4fc40cdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:52.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.059+0000 7f4fcb1b8700 1 -- 172.21.15.6:0/2582308941 shutdown_connections 2023-07-06T19:59:52.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.059+0000 7f4fcb1b8700 1 -- 172.21.15.6:0/2582308941 wait complete. 2023-07-06T19:59:52.077 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T19:59:52.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.215+0000 7f2c9ab14700 1 Processor -- start 2023-07-06T19:59:52.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.215+0000 7f2c9ab14700 1 -- start start 2023-07-06T19:59:52.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.215+0000 7f2c9ab14700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2c940ca850 0x7f2c9415bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:52.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.215+0000 7f2c9ab14700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c940cb310 con 0x7f2c94071900 2023-07-06T19:59:52.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.216+0000 7f2c9ab14700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c940af070 con 0x7f2c94071cd0 2023-07-06T19:59:52.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.216+0000 7f2c9ab14700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c940cdbf0 con 0x7f2c940ca850 2023-07-06T19:59:52.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.216+0000 7f2c988b0700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2c94071900 0x7f2c940ca140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33106/0 (socket says 172.21.15.6:33106) 2023-07-06T19:59:52.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.216+0000 7f2c988b0700 1 -- 172.21.15.6:0/2703168647 learned_addr learned my addr 172.21.15.6:0/2703168647 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:52.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.216+0000 7f2c93fff700 1 --2- 172.21.15.6:0/2703168647 >> v2:172.21.15.40:3300/0 conn(0x7f2c940ca850 0x7f2c9415bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:52.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.216+0000 7f2c937fe700 1 -- 172.21.15.6:0/2703168647 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 784991938 0 0) 0x7f2c940cb310 con 0x7f2c94071900 2023-07-06T19:59:52.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.216+0000 7f2c937fe700 1 -- 172.21.15.6:0/2703168647 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c840035b0 con 0x7f2c94071900 2023-07-06T19:59:52.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.216+0000 7f2c937fe700 1 -- 172.21.15.6:0/2703168647 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 811675098 0 0) 0x7f2c840035b0 con 0x7f2c94071900 2023-07-06T19:59:52.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.216+0000 7f2c937fe700 1 -- 172.21.15.6:0/2703168647 >> v2:172.21.15.40:3300/0 conn(0x7f2c940ca850 msgr2=0x7f2c9415bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:52.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.216+0000 7f2c937fe700 1 --2- 172.21.15.6:0/2703168647 >> v2:172.21.15.40:3300/0 conn(0x7f2c940ca850 0x7f2c9415bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.216+0000 7f2c937fe700 1 -- 172.21.15.6:0/2703168647 >> v1:172.21.15.40:6789/0 conn(0x7f2c94071cd0 legacy=0x7f2c940ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:52.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.216+0000 7f2c937fe700 1 -- 172.21.15.6:0/2703168647 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c940cad50 con 0x7f2c94071900 2023-07-06T19:59:52.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.216+0000 7f2c937fe700 1 -- 172.21.15.6:0/2703168647 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f2c88001670 con 0x7f2c94071900 2023-07-06T19:59:52.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.216+0000 7f2c937fe700 1 -- 172.21.15.6:0/2703168647 >> v1:172.21.15.6:6789/0 conn(0x7f2c94071900 legacy=0x7f2c940ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:52.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.216+0000 7f2c937fe700 1 --2- 172.21.15.6:0/2703168647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c84003a00 0x7f2c84003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:52.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.216+0000 7f2c937fe700 1 --2- 172.21.15.6:0/2703168647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c84004850 0x7f2c84004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:52.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.216+0000 7f2c937fe700 1 --2- 172.21.15.6:0/2703168647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c84005250 0x7f2c8400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:52.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.216+0000 7f2c937fe700 1 -- 172.21.15.6:0/2703168647 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940cdbf0 con 0x7f2c84003a00 2023-07-06T19:59:52.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.216+0000 7f2c937fe700 1 -- 172.21.15.6:0/2703168647 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8400c160 con 0x7f2c84004850 2023-07-06T19:59:52.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.216+0000 7f2c937fe700 1 -- 172.21.15.6:0/2703168647 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8400c320 con 0x7f2c84005250 2023-07-06T19:59:52.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.216+0000 7f2c988b0700 1 --2- 172.21.15.6:0/2703168647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c84003a00 0x7f2c84003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:52.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.217+0000 7f2c93fff700 1 --2- 172.21.15.6:0/2703168647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c84004850 0x7f2c84004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:52.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.217+0000 7f2c990b1700 1 --2- 172.21.15.6:0/2703168647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c84005250 0x7f2c8400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:52.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.217+0000 7f2c988b0700 1 -- 172.21.15.6:0/2703168647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c84005250 msgr2=0x7f2c8400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:52.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.217+0000 7f2c988b0700 1 --2- 172.21.15.6:0/2703168647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c84005250 0x7f2c8400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.217+0000 7f2c988b0700 1 -- 172.21.15.6:0/2703168647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c84004850 msgr2=0x7f2c84004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:52.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.217+0000 7f2c988b0700 1 --2- 172.21.15.6:0/2703168647 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c84004850 0x7f2c84004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.217+0000 7f2c988b0700 1 -- 172.21.15.6:0/2703168647 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c840035b0 con 0x7f2c84003a00 2023-07-06T19:59:52.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.217+0000 7f2c990b1700 1 --2- 172.21.15.6:0/2703168647 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c84005250 0x7f2c8400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:52.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.217+0000 7f2c990b1700 1 -- 172.21.15.6:0/2703168647 reap_dead start 2023-07-06T19:59:52.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.217+0000 7f2c988b0700 1 --2- 172.21.15.6:0/2703168647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c84003a00 0x7f2c84003df0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2c88001eb0 tx=0x7f2c84005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1201e5002ce6597 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:52.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.217+0000 7f2c937fe700 1 -- 172.21.15.6:0/2703168647 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8800ce00 con 0x7f2c84003a00 2023-07-06T19:59:52.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.217+0000 7f2c937fe700 1 -- 172.21.15.6:0/2703168647 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c88005960 con 0x7f2c84003a00 2023-07-06T19:59:52.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.217+0000 7f2c937fe700 1 -- 172.21.15.6:0/2703168647 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c88005cf0 con 0x7f2c84003a00 2023-07-06T19:59:52.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.218+0000 7f2c9ab14700 1 -- 172.21.15.6:0/2703168647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c84003a00 msgr2=0x7f2c84003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:52.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.218+0000 7f2c9ab14700 1 --2- 172.21.15.6:0/2703168647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c84003a00 0x7f2c84003df0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2c88001eb0 tx=0x7f2c84005880 comp rx=0 tx=0).stop 2023-07-06T19:59:52.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.218+0000 7f2c9ab14700 1 -- 172.21.15.6:0/2703168647 shutdown_connections 2023-07-06T19:59:52.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.218+0000 7f2c9ab14700 1 --2- 172.21.15.6:0/2703168647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c84003a00 0x7f2c84003df0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.218+0000 7f2c9ab14700 1 -- 172.21.15.6:0/2703168647 >> 172.21.15.6:0/2703168647 conn(0x7f2c940cf960 msgr2=0x7f2c940cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:52.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.218+0000 7f2c9ab14700 1 -- 172.21.15.6:0/2703168647 shutdown_connections 2023-07-06T19:59:52.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.218+0000 7f2c9ab14700 1 -- 172.21.15.6:0/2703168647 wait complete. 2023-07-06T19:59:52.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.219+0000 7f2c9ab14700 1 Processor -- start 2023-07-06T19:59:52.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.219+0000 7f2c9ab14700 1 -- start start 2023-07-06T19:59:52.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.220+0000 7f2c9ab14700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c84003a00 0x7f2c9415bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:52.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.220+0000 7f2c9ab14700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c941f57f0 0x7f2c940ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:52.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.220+0000 7f2c9ab14700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c940abf80 0x7f2c941f4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:52.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.220+0000 7f2c9ab14700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940b4280 con 0x7f2c941f57f0 2023-07-06T19:59:52.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.220+0000 7f2c9ab14700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9415c260 con 0x7f2c84003a00 2023-07-06T19:59:52.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.220+0000 7f2c9ab14700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c940aea90 con 0x7f2c940abf80 2023-07-06T19:59:52.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.220+0000 7f2c93fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c941f57f0 0x7f2c940ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:52.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.221+0000 7f2c93fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c941f57f0 0x7f2c940ae170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60144/0 (socket says 172.21.15.6:60144) 2023-07-06T19:59:52.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.221+0000 7f2c93fff700 1 -- 172.21.15.6:0/2999354281 learned_addr learned my addr 172.21.15.6:0/2999354281 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:52.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.221+0000 7f2c988b0700 1 --2- 172.21.15.6:0/2999354281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c84003a00 0x7f2c9415bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:52.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.221+0000 7f2c990b1700 1 --2- 172.21.15.6:0/2999354281 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c940abf80 0x7f2c941f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:52.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.221+0000 7f2c93fff700 1 -- 172.21.15.6:0/2999354281 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c940abf80 msgr2=0x7f2c941f4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:52.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.221+0000 7f2c93fff700 1 --2- 172.21.15.6:0/2999354281 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c940abf80 0x7f2c941f4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.221+0000 7f2c93fff700 1 -- 172.21.15.6:0/2999354281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c84003a00 msgr2=0x7f2c9415bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:52.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.221+0000 7f2c93fff700 1 --2- 172.21.15.6:0/2999354281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c84003a00 0x7f2c9415bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.221+0000 7f2c93fff700 1 -- 172.21.15.6:0/2999354281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c9415e8f0 con 0x7f2c941f57f0 2023-07-06T19:59:52.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.221+0000 7f2c988b0700 1 --2- 172.21.15.6:0/2999354281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c84003a00 0x7f2c9415bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:52.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.221+0000 7f2c990b1700 1 --2- 172.21.15.6:0/2999354281 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c940abf80 0x7f2c941f4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:52.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.221+0000 7f2c93fff700 1 --2- 172.21.15.6:0/2999354281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c941f57f0 0x7f2c940ae170 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2c80011aa0 tx=0x7f2c80011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:52.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.221+0000 7f2c917fa700 1 -- 172.21.15.6:0/2999354281 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8000f980 con 0x7f2c941f57f0 2023-07-06T19:59:52.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.221+0000 7f2c917fa700 1 -- 172.21.15.6:0/2999354281 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8000fae0 con 0x7f2c941f57f0 2023-07-06T19:59:52.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.221+0000 7f2c9ab14700 1 -- 172.21.15.6:0/2999354281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c9415ebd0 con 0x7f2c941f57f0 2023-07-06T19:59:52.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.221+0000 7f2c917fa700 1 -- 172.21.15.6:0/2999354281 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8000fe90 con 0x7f2c941f57f0 2023-07-06T19:59:52.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.221+0000 7f2c9ab14700 1 -- 172.21.15.6:0/2999354281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c940ac420 con 0x7f2c941f57f0 2023-07-06T19:59:52.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.222+0000 7f2c9ab14700 1 -- 172.21.15.6:0/2999354281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c940b43f0 con 0x7f2c941f57f0 2023-07-06T19:59:52.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.223+0000 7f2c917fa700 1 -- 172.21.15.6:0/2999354281 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2c80014440 con 0x7f2c941f57f0 2023-07-06T19:59:52.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.223+0000 7f2c917fa700 1 --2- 172.21.15.6:0/2999354281 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2c7806ace0 0x7f2c7806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:52.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.223+0000 7f2c917fa700 1 -- 172.21.15.6:0/2999354281 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2c80089ec0 con 0x7f2c941f57f0 2023-07-06T19:59:52.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.223+0000 7f2c988b0700 1 --2- 172.21.15.6:0/2999354281 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2c7806ace0 0x7f2c7806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:52.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.224+0000 7f2c988b0700 1 --2- 172.21.15.6:0/2999354281 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2c7806ace0 0x7f2c7806d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2c941f4b00 tx=0x7f2c88007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:52.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.227+0000 7f2c917fa700 1 -- 172.21.15.6:0/2999354281 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2c940b43f0 con 0x7f2c941f57f0 2023-07-06T19:59:52.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.426+0000 7f2c9ab14700 1 -- 172.21.15.6:0/2999354281 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2c940b43f0 con 0x7f2c941f57f0 2023-07-06T19:59:52.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.426+0000 7f2c917fa700 1 -- 172.21.15.6:0/2999354281 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2c940b43f0 con 0x7f2c941f57f0 2023-07-06T19:59:52.430 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-06T19:59:52.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.428+0000 7f2c9ab14700 1 -- 172.21.15.6:0/2999354281 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2c7806ace0 msgr2=0x7f2c7806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:52.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.428+0000 7f2c9ab14700 1 --2- 172.21.15.6:0/2999354281 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2c7806ace0 0x7f2c7806d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2c941f4b00 tx=0x7f2c88007000 comp rx=0 tx=0).stop 2023-07-06T19:59:52.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.428+0000 7f2c9ab14700 1 -- 172.21.15.6:0/2999354281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c941f57f0 msgr2=0x7f2c940ae170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:52.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.428+0000 7f2c9ab14700 1 --2- 172.21.15.6:0/2999354281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c941f57f0 0x7f2c940ae170 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2c80011aa0 tx=0x7f2c80011e60 comp rx=0 tx=0).stop 2023-07-06T19:59:52.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.428+0000 7f2c9ab14700 1 -- 172.21.15.6:0/2999354281 shutdown_connections 2023-07-06T19:59:52.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.428+0000 7f2c9ab14700 1 --2- 172.21.15.6:0/2999354281 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2c7806ace0 0x7f2c7806d190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.428+0000 7f2c9ab14700 1 --2- 172.21.15.6:0/2999354281 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2c940abf80 0x7f2c941f4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.428+0000 7f2c9ab14700 1 --2- 172.21.15.6:0/2999354281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c84003a00 0x7f2c9415bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.428+0000 7f2c9ab14700 1 --2- 172.21.15.6:0/2999354281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c941f57f0 0x7f2c940ae170 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.428+0000 7f2c9ab14700 1 -- 172.21.15.6:0/2999354281 >> 172.21.15.6:0/2999354281 conn(0x7f2c940cf960 msgr2=0x7f2c940cdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:52.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.429+0000 7f2c9ab14700 1 -- 172.21.15.6:0/2999354281 shutdown_connections 2023-07-06T19:59:52.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.429+0000 7f2c9ab14700 1 -- 172.21.15.6:0/2999354281 wait complete. 2023-07-06T19:59:52.454 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T19:59:52.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.584+0000 7f981f2c7700 1 Processor -- start 2023-07-06T19:59:52.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.585+0000 7f981f2c7700 1 -- start start 2023-07-06T19:59:52.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.585+0000 7f981f2c7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f98180ca850 0x7f981815bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:52.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.585+0000 7f981f2c7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9818071cd0 0x7f981815c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:52.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.585+0000 7f981f2c7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98180cb310 con 0x7f9818071900 2023-07-06T19:59:52.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.585+0000 7f981f2c7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98180cdbf0 con 0x7f9818071cd0 2023-07-06T19:59:52.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.585+0000 7f981f2c7700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981815c9d0 con 0x7f98180ca850 2023-07-06T19:59:52.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.586+0000 7f981d864700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9818071cd0 0x7f981815c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:52.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.586+0000 7f981d864700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f9818071cd0 0x7f981815c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60154/0 (socket says 172.21.15.6:60154) 2023-07-06T19:59:52.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.586+0000 7f981d864700 1 -- 172.21.15.6:0/1470766226 learned_addr learned my addr 172.21.15.6:0/1470766226 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:52.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.586+0000 7f981c862700 1 --2- 172.21.15.6:0/1470766226 >> v2:172.21.15.40:3300/0 conn(0x7f98180ca850 0x7f981815bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:52.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.586+0000 7f981d864700 1 -- 172.21.15.6:0/1470766226 >> v2:172.21.15.40:3300/0 conn(0x7f98180ca850 msgr2=0x7f981815bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:52.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.586+0000 7f981d864700 1 --2- 172.21.15.6:0/1470766226 >> v2:172.21.15.40:3300/0 conn(0x7f98180ca850 0x7f981815bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.586+0000 7f981d864700 1 -- 172.21.15.6:0/1470766226 >> v1:172.21.15.40:6789/0 conn(0x7f9818071900 legacy=0x7f98180ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:52.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.586+0000 7f981d864700 1 -- 172.21.15.6:0/1470766226 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98180af070 con 0x7f9818071cd0 2023-07-06T19:59:52.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.586+0000 7f981d864700 1 --2- 172.21.15.6:0/1470766226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9818071cd0 0x7f981815c490 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f981806e9b0 tx=0x7f981000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c2345dd8f0a705 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:52.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.586+0000 7f980ffff700 1 -- 172.21.15.6:0/1470766226 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981000e070 con 0x7f9818071cd0 2023-07-06T19:59:52.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.586+0000 7f980ffff700 1 -- 172.21.15.6:0/1470766226 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9810003a20 con 0x7f9818071cd0 2023-07-06T19:59:52.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.586+0000 7f980ffff700 1 -- 172.21.15.6:0/1470766226 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810003dd0 con 0x7f9818071cd0 2023-07-06T19:59:52.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.587+0000 7f981f2c7700 1 -- 172.21.15.6:0/1470766226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9818071cd0 msgr2=0x7f981815c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:52.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.587+0000 7f981f2c7700 1 --2- 172.21.15.6:0/1470766226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9818071cd0 0x7f981815c490 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f981806e9b0 tx=0x7f981000b330 comp rx=0 tx=0).stop 2023-07-06T19:59:52.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.587+0000 7f981f2c7700 1 -- 172.21.15.6:0/1470766226 shutdown_connections 2023-07-06T19:59:52.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.587+0000 7f981f2c7700 1 --2- 172.21.15.6:0/1470766226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9818071cd0 0x7f981815c490 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.587+0000 7f981f2c7700 1 --2- 172.21.15.6:0/1470766226 >> v2:172.21.15.40:3300/0 conn(0x7f98180ca850 0x7f981815bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.587+0000 7f981f2c7700 1 -- 172.21.15.6:0/1470766226 >> 172.21.15.6:0/1470766226 conn(0x7f98180cf960 msgr2=0x7f98180cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:52.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.587+0000 7f981f2c7700 1 -- 172.21.15.6:0/1470766226 shutdown_connections 2023-07-06T19:59:52.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.587+0000 7f981f2c7700 1 -- 172.21.15.6:0/1470766226 wait complete. 2023-07-06T19:59:52.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.588+0000 7f981f2c7700 1 Processor -- start 2023-07-06T19:59:52.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.588+0000 7f981f2c7700 1 -- start start 2023-07-06T19:59:52.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.589+0000 7f981f2c7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9818071900 0x7f98180c3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:52.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.589+0000 7f981f2c7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9818071cd0 0x7f981814e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:52.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.589+0000 7f981f2c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98180ca850 0x7f981815edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:52.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.589+0000 7f981f2c7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981814e5d0 con 0x7f98180ca850 2023-07-06T19:59:52.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.589+0000 7f981f2c7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981815dd50 con 0x7f9818071cd0 2023-07-06T19:59:52.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.589+0000 7f981f2c7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981815e030 con 0x7f9818071900 2023-07-06T19:59:52.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.589+0000 7f981d864700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98180ca850 0x7f981815edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:52.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.589+0000 7f981d864700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98180ca850 0x7f981815edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60160/0 (socket says 172.21.15.6:60160) 2023-07-06T19:59:52.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.589+0000 7f981d864700 1 -- 172.21.15.6:0/3348125469 learned_addr learned my addr 172.21.15.6:0/3348125469 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:52.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.589+0000 7f981d063700 1 --2- 172.21.15.6:0/3348125469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9818071900 0x7f98180c3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:52.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.589+0000 7f981c862700 1 --2- 172.21.15.6:0/3348125469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9818071cd0 0x7f981814e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:52.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.589+0000 7f981d864700 1 -- 172.21.15.6:0/3348125469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9818071900 msgr2=0x7f98180c3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:52.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.589+0000 7f981d864700 1 --2- 172.21.15.6:0/3348125469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9818071900 0x7f98180c3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.589+0000 7f981d864700 1 -- 172.21.15.6:0/3348125469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9818071cd0 msgr2=0x7f981814e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.589+0000 7f981d864700 1 --2- 172.21.15.6:0/3348125469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9818071cd0 0x7f981814e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.589+0000 7f981d864700 1 -- 172.21.15.6:0/3348125469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9810009b30 con 0x7f98180ca850 2023-07-06T19:59:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.589+0000 7f981d864700 1 --2- 172.21.15.6:0/3348125469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98180ca850 0x7f981815edf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9810015040 tx=0x7f9810004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.590+0000 7f980dffb700 1 -- 172.21.15.6:0/3348125469 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810004440 con 0x7f98180ca850 2023-07-06T19:59:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.590+0000 7f980dffb700 1 -- 172.21.15.6:0/3348125469 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98100045a0 con 0x7f98180ca850 2023-07-06T19:59:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.590+0000 7f981f2c7700 1 -- 172.21.15.6:0/3348125469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981815e310 con 0x7f98180ca850 2023-07-06T19:59:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.590+0000 7f980dffb700 1 -- 172.21.15.6:0/3348125469 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810004950 con 0x7f98180ca850 2023-07-06T19:59:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.590+0000 7f981f2c7700 1 -- 172.21.15.6:0/3348125469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981815e8d0 con 0x7f98180ca850 2023-07-06T19:59:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.591+0000 7f981f2c7700 1 -- 172.21.15.6:0/3348125469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981815eaf0 con 0x7f98180ca850 2023-07-06T19:59:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.591+0000 7f980dffb700 1 -- 172.21.15.6:0/3348125469 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9810012430 con 0x7f98180ca850 2023-07-06T19:59:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.592+0000 7f980dffb700 1 --2- 172.21.15.6:0/3348125469 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f97fc06ace0 0x7f97fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:52.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.592+0000 7f980dffb700 1 -- 172.21.15.6:0/3348125469 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f981008aa20 con 0x7f98180ca850 2023-07-06T19:59:52.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.592+0000 7f981d063700 1 --2- 172.21.15.6:0/3348125469 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f97fc06ace0 0x7f97fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:52.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.592+0000 7f981d063700 1 --2- 172.21.15.6:0/3348125469 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f97fc06ace0 0x7f97fc06d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9808009960 tx=0x7f98080090e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:52.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.596+0000 7f980dffb700 1 -- 172.21.15.6:0/3348125469 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f98100592c0 con 0x7f98180ca850 2023-07-06T19:59:52.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.795+0000 7f981f2c7700 1 -- 172.21.15.6:0/3348125469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f981804eb90 con 0x7f98180ca850 2023-07-06T19:59:52.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.795+0000 7f980dffb700 1 -- 172.21.15.6:0/3348125469 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9810058e50 con 0x7f98180ca850 2023-07-06T19:59:52.800 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T19:59:52.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.797+0000 7f981f2c7700 1 -- 172.21.15.6:0/3348125469 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f97fc06ace0 msgr2=0x7f97fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:52.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.797+0000 7f981f2c7700 1 --2- 172.21.15.6:0/3348125469 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f97fc06ace0 0x7f97fc06d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9808009960 tx=0x7f98080090e0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.797+0000 7f981f2c7700 1 -- 172.21.15.6:0/3348125469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98180ca850 msgr2=0x7f981815edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:52.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.797+0000 7f981f2c7700 1 --2- 172.21.15.6:0/3348125469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98180ca850 0x7f981815edf0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9810015040 tx=0x7f9810004ad0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.797+0000 7f981f2c7700 1 -- 172.21.15.6:0/3348125469 shutdown_connections 2023-07-06T19:59:52.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.797+0000 7f981f2c7700 1 --2- 172.21.15.6:0/3348125469 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f97fc06ace0 0x7f97fc06d190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.797+0000 7f981f2c7700 1 --2- 172.21.15.6:0/3348125469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98180ca850 0x7f981815edf0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.797+0000 7f981f2c7700 1 --2- 172.21.15.6:0/3348125469 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f9818071900 0x7f98180c3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.797+0000 7f981f2c7700 1 --2- 172.21.15.6:0/3348125469 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9818071cd0 0x7f981814e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.797+0000 7f981f2c7700 1 -- 172.21.15.6:0/3348125469 >> 172.21.15.6:0/3348125469 conn(0x7f98180cf960 msgr2=0x7f981806be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.797+0000 7f981f2c7700 1 -- 172.21.15.6:0/3348125469 shutdown_connections 2023-07-06T19:59:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.797+0000 7f981f2c7700 1 -- 172.21.15.6:0/3348125469 wait complete. 2023-07-06T19:59:52.816 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T19:59:52.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.941+0000 7f6936ef7700 1 Processor -- start 2023-07-06T19:59:52.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.941+0000 7f6936ef7700 1 -- start start 2023-07-06T19:59:52.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.942+0000 7f6936ef7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f693015e930 0x7f69300cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:52.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.942+0000 7f6936ef7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69300cf520 0x7f69300c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:52.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.942+0000 7f6936ef7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f693006a840 con 0x7f69300b4940 2023-07-06T19:59:52.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.942+0000 7f6936ef7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69300cf9a0 con 0x7f693015e930 2023-07-06T19:59:52.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.942+0000 7f6936ef7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693015b700 con 0x7f69300cf520 2023-07-06T19:59:52.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.942+0000 7f692ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f693015e930 0x7f69300cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:52.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.942+0000 7f6934c93700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f69300b4940 0x7f693006a060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33140/0 (socket says 172.21.15.6:33140) 2023-07-06T19:59:52.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.942+0000 7f6934c93700 1 -- 172.21.15.6:0/611433894 learned_addr learned my addr 172.21.15.6:0/611433894 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:52.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.942+0000 7f6935494700 1 --2- 172.21.15.6:0/611433894 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69300cf520 0x7f69300c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:52.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.942+0000 7f692ffff700 1 -- 172.21.15.6:0/611433894 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69300cf520 msgr2=0x7f69300c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:52.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.942+0000 7f692ffff700 1 --2- 172.21.15.6:0/611433894 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69300cf520 0x7f69300c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.942+0000 7f692ffff700 1 -- 172.21.15.6:0/611433894 >> v1:172.21.15.6:6789/0 conn(0x7f69300b4940 legacy=0x7f693006a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:52.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.942+0000 7f692ffff700 1 -- 172.21.15.6:0/611433894 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693015a940 con 0x7f693015e930 2023-07-06T19:59:52.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.942+0000 7f692f7fe700 1 -- 172.21.15.6:0/611433894 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235567754 0 0) 0x7f693006a840 con 0x7f69300b4940 2023-07-06T19:59:52.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.942+0000 7f692ffff700 1 --2- 172.21.15.6:0/611433894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f693015e930 0x7f69300cefe0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f691c009840 tx=0x7f691c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6957e8296f380ccc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:52.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.943+0000 7f692f7fe700 1 -- 172.21.15.6:0/611433894 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c011830 con 0x7f693015e930 2023-07-06T19:59:52.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.943+0000 7f692f7fe700 1 -- 172.21.15.6:0/611433894 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691c011990 con 0x7f693015e930 2023-07-06T19:59:52.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.943+0000 7f692f7fe700 1 -- 172.21.15.6:0/611433894 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c011d20 con 0x7f693015e930 2023-07-06T19:59:52.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.943+0000 7f6936ef7700 1 -- 172.21.15.6:0/611433894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f693015e930 msgr2=0x7f69300cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:52.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.943+0000 7f6936ef7700 1 --2- 172.21.15.6:0/611433894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f693015e930 0x7f69300cefe0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f691c009840 tx=0x7f691c009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:52.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.943+0000 7f6936ef7700 1 -- 172.21.15.6:0/611433894 shutdown_connections 2023-07-06T19:59:52.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.943+0000 7f6936ef7700 1 --2- 172.21.15.6:0/611433894 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f69300cf520 0x7f69300c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.943+0000 7f6936ef7700 1 --2- 172.21.15.6:0/611433894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f693015e930 0x7f69300cefe0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.943+0000 7f6936ef7700 1 -- 172.21.15.6:0/611433894 >> 172.21.15.6:0/611433894 conn(0x7f69300b0b60 msgr2=0x7f69300b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:52.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.943+0000 7f6936ef7700 1 -- 172.21.15.6:0/611433894 shutdown_connections 2023-07-06T19:59:52.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.943+0000 7f6936ef7700 1 -- 172.21.15.6:0/611433894 wait complete. 2023-07-06T19:59:52.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.944+0000 7f6936ef7700 1 Processor -- start 2023-07-06T19:59:52.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.944+0000 7f6936ef7700 1 -- start start 2023-07-06T19:59:52.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.945+0000 7f6936ef7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69300b4940 0x7f69300c2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:52.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.945+0000 7f6936ef7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69300cf520 0x7f69300c4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:52.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.945+0000 7f6936ef7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f693015e930 0x7f6930143290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:52.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.945+0000 7f6936ef7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6930143cc0 con 0x7f69300b4940 2023-07-06T19:59:52.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.945+0000 7f6936ef7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69300c3260 con 0x7f69300cf520 2023-07-06T19:59:52.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.945+0000 7f6936ef7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69300c3540 con 0x7f693015e930 2023-07-06T19:59:52.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.945+0000 7f6934c93700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69300b4940 0x7f69300c2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.945+0000 7f6934c93700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69300b4940 0x7f69300c2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60170/0 (socket says 172.21.15.6:60170) 2023-07-06T19:59:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.945+0000 7f6934c93700 1 -- 172.21.15.6:0/3600011305 learned_addr learned my addr 172.21.15.6:0/3600011305 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.946+0000 7f6934c93700 1 -- 172.21.15.6:0/3600011305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f693015e930 msgr2=0x7f6930143290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.946+0000 7f6934c93700 1 --2- 172.21.15.6:0/3600011305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f693015e930 0x7f6930143290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.946+0000 7f6934c93700 1 -- 172.21.15.6:0/3600011305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69300cf520 msgr2=0x7f69300c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:52.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.946+0000 7f6934c93700 1 --2- 172.21.15.6:0/3600011305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69300cf520 0x7f69300c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:52.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.946+0000 7f6934c93700 1 -- 172.21.15.6:0/3600011305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691c0094a0 con 0x7f69300b4940 2023-07-06T19:59:52.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.946+0000 7f6934c93700 1 --2- 172.21.15.6:0/3600011305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69300b4940 0x7f69300c2b60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f69240011e0 tx=0x7f692400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:52.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.946+0000 7f692d7fa700 1 -- 172.21.15.6:0/3600011305 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924004c80 con 0x7f69300b4940 2023-07-06T19:59:52.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.946+0000 7f692d7fa700 1 -- 172.21.15.6:0/3600011305 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6924004e00 con 0x7f69300b4940 2023-07-06T19:59:53.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.946+0000 7f692d7fa700 1 -- 172.21.15.6:0/3600011305 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924007310 con 0x7f69300b4940 2023-07-06T19:59:53.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.946+0000 7f6936ef7700 1 -- 172.21.15.6:0/3600011305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69300c3820 con 0x7f69300b4940 2023-07-06T19:59:53.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.946+0000 7f6936ef7700 1 -- 172.21.15.6:0/3600011305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69300c3de0 con 0x7f69300b4940 2023-07-06T19:59:53.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.947+0000 7f6936ef7700 1 -- 172.21.15.6:0/3600011305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69300cefe0 con 0x7f69300b4940 2023-07-06T19:59:53.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.947+0000 7f692d7fa700 1 -- 172.21.15.6:0/3600011305 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6924007470 con 0x7f69300b4940 2023-07-06T19:59:53.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.948+0000 7f692d7fa700 1 --2- 172.21.15.6:0/3600011305 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f691406ad10 0x7f691406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:53.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.948+0000 7f692ffff700 1 --2- 172.21.15.6:0/3600011305 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f691406ad10 0x7f691406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:53.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.948+0000 7f692d7fa700 1 -- 172.21.15.6:0/3600011305 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f69240894b0 con 0x7f69300b4940 2023-07-06T19:59:53.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.948+0000 7f692ffff700 1 --2- 172.21.15.6:0/3600011305 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f691406ad10 0x7f691406d1c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f691c000c00 tx=0x7f691c010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:53.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:52.953+0000 7f692d7fa700 1 -- 172.21.15.6:0/3600011305 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f69240542c0 con 0x7f69300b4940 2023-07-06T19:59:53.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.167+0000 7f6936ef7700 1 -- 172.21.15.6:0/3600011305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f693004eb90 con 0x7f69300b4940 2023-07-06T19:59:53.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.167+0000 7f692d7fa700 1 -- 172.21.15.6:0/3600011305 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f69240578e0 con 0x7f69300b4940 2023-07-06T19:59:53.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.169+0000 7f6936ef7700 1 -- 172.21.15.6:0/3600011305 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f691406ad10 msgr2=0x7f691406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:53.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.169+0000 7f6936ef7700 1 --2- 172.21.15.6:0/3600011305 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f691406ad10 0x7f691406d1c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f691c000c00 tx=0x7f691c010000 comp rx=0 tx=0).stop 2023-07-06T19:59:53.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.169+0000 7f6936ef7700 1 -- 172.21.15.6:0/3600011305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69300b4940 msgr2=0x7f69300c2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:53.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.169+0000 7f6936ef7700 1 --2- 172.21.15.6:0/3600011305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69300b4940 0x7f69300c2b60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f69240011e0 tx=0x7f692400cae0 comp rx=0 tx=0).stop 2023-07-06T19:59:53.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.169+0000 7f6936ef7700 1 -- 172.21.15.6:0/3600011305 shutdown_connections 2023-07-06T19:59:53.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.169+0000 7f6936ef7700 1 --2- 172.21.15.6:0/3600011305 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f691406ad10 0x7f691406d1c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:53.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.169+0000 7f6936ef7700 1 --2- 172.21.15.6:0/3600011305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69300b4940 0x7f69300c2b60 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:53.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.169+0000 7f6936ef7700 1 --2- 172.21.15.6:0/3600011305 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f693015e930 0x7f6930143290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:53.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.169+0000 7f6936ef7700 1 --2- 172.21.15.6:0/3600011305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f69300cf520 0x7f69300c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:53.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.169+0000 7f6936ef7700 1 -- 172.21.15.6:0/3600011305 >> 172.21.15.6:0/3600011305 conn(0x7f69300b0b60 msgr2=0x7f69300b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:53.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.169+0000 7f6936ef7700 1 -- 172.21.15.6:0/3600011305 shutdown_connections 2023-07-06T19:59:53.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.169+0000 7f6936ef7700 1 -- 172.21.15.6:0/3600011305 wait complete. 2023-07-06T19:59:53.181 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-07-06T19:59:53.185 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-06T19:59:53.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:53.188 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-06T19:59:53.269 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-07-06T19:59:53.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:53.270 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-06T19:59:53.293 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:59:53.293 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T19:59:53.318 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:59:53.319 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T19:59:53.381 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:59:53.382 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T19:59:53.448 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T19:59:53.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.594+0000 7f51f5174700 1 Processor -- start 2023-07-06T19:59:53.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.594+0000 7f51f5174700 1 -- start start 2023-07-06T19:59:53.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.595+0000 7f51f5174700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f51f00ceab0 0x7f51f00caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:53.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.595+0000 7f51f5174700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51f00cee80 0x7f51f00716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:53.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.595+0000 7f51f5174700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51f0160ff0 con 0x7f51f0071c00 2023-07-06T19:59:53.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.595+0000 7f51f5174700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f00cb400 con 0x7f51f00cee80 2023-07-06T19:59:53.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.595+0000 7f51f5174700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51f0072020 con 0x7f51f00ceab0 2023-07-06T19:59:53.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.595+0000 7f51ee59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f51f00cee80 0x7f51f00716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:53.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.595+0000 7f51ef59e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f51f0071c00 0x7f51f01602c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33158/0 (socket says 172.21.15.6:33158) 2023-07-06T19:59:53.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.595+0000 7f51ef59e700 1 -- 172.21.15.6:0/2213607184 learned_addr learned my addr 172.21.15.6:0/2213607184 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:53.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.596+0000 7f51eed9d700 1 --2- 172.21.15.6:0/2213607184 >> v2:172.21.15.40:3300/0 conn(0x7f51f00ceab0 0x7f51f00caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:53.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.596+0000 7f51ee59c700 1 -- 172.21.15.6:0/2213607184 >> v2:172.21.15.40:3300/0 conn(0x7f51f00ceab0 msgr2=0x7f51f00caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:53.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.596+0000 7f51ee59c700 1 --2- 172.21.15.6:0/2213607184 >> v2:172.21.15.40:3300/0 conn(0x7f51f00ceab0 0x7f51f00caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:53.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.596+0000 7f51ee59c700 1 -- 172.21.15.6:0/2213607184 >> v1:172.21.15.6:6789/0 conn(0x7f51f0071c00 legacy=0x7f51f01602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:53.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.596+0000 7f51edd9b700 1 -- 172.21.15.6:0/2213607184 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718475377 0 0) 0x7f51f0160ff0 con 0x7f51f0071c00 2023-07-06T19:59:53.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.596+0000 7f51ee59c700 1 -- 172.21.15.6:0/2213607184 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f00ca100 con 0x7f51f00cee80 2023-07-06T19:59:53.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.596+0000 7f51ee59c700 1 --2- 172.21.15.6:0/2213607184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f00cee80 0x7f51f00716c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f51f00731c0 tx=0x7f51d8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c757588c5192996e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:53.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.596+0000 7f51edd9b700 1 -- 172.21.15.6:0/2213607184 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8011830 con 0x7f51f00cee80 2023-07-06T19:59:53.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.596+0000 7f51edd9b700 1 -- 172.21.15.6:0/2213607184 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d8011990 con 0x7f51f00cee80 2023-07-06T19:59:53.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.596+0000 7f51edd9b700 1 -- 172.21.15.6:0/2213607184 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8011d20 con 0x7f51f00cee80 2023-07-06T19:59:53.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.597+0000 7f51f5174700 1 -- 172.21.15.6:0/2213607184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f00cee80 msgr2=0x7f51f00716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:53.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.597+0000 7f51f5174700 1 --2- 172.21.15.6:0/2213607184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f00cee80 0x7f51f00716c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f51f00731c0 tx=0x7f51d8009b20 comp rx=0 tx=0).stop 2023-07-06T19:59:53.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.597+0000 7f51f5174700 1 -- 172.21.15.6:0/2213607184 shutdown_connections 2023-07-06T19:59:53.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.597+0000 7f51f5174700 1 --2- 172.21.15.6:0/2213607184 >> v2:172.21.15.40:3300/0 conn(0x7f51f00ceab0 0x7f51f00caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:53.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.597+0000 7f51f5174700 1 --2- 172.21.15.6:0/2213607184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f00cee80 0x7f51f00716c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:53.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.597+0000 7f51f5174700 1 -- 172.21.15.6:0/2213607184 >> 172.21.15.6:0/2213607184 conn(0x7f51f00cc420 msgr2=0x7f51f00cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:53.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.597+0000 7f51f5174700 1 -- 172.21.15.6:0/2213607184 shutdown_connections 2023-07-06T19:59:53.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.597+0000 7f51f5174700 1 -- 172.21.15.6:0/2213607184 wait complete. 2023-07-06T19:59:53.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.598+0000 7f51f5174700 1 Processor -- start 2023-07-06T19:59:53.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.598+0000 7f51f5174700 1 -- start start 2023-07-06T19:59:53.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.599+0000 7f51f5174700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51f0071c00 0x7f51f00c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:53.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.599+0000 7f51f5174700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51f00ceab0 0x7f51f0144f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:53.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.599+0000 7f51f5174700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f00cee80 0x7f51f00c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:53.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.599+0000 7f51f5174700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f00b0d50 con 0x7f51f00cee80 2023-07-06T19:59:53.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.599+0000 7f51f5174700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51f0145460 con 0x7f51f00ceab0 2023-07-06T19:59:53.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.599+0000 7f51f5174700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f00c7170 con 0x7f51f0071c00 2023-07-06T19:59:53.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.599+0000 7f51ef59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f00cee80 0x7f51f00c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:53.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.599+0000 7f51ef59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f00cee80 0x7f51f00c8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60188/0 (socket says 172.21.15.6:60188) 2023-07-06T19:59:53.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.599+0000 7f51ef59e700 1 -- 172.21.15.6:0/885399646 learned_addr learned my addr 172.21.15.6:0/885399646 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:53.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.599+0000 7f51eed9d700 1 --2- 172.21.15.6:0/885399646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51f0071c00 0x7f51f00c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:53.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.599+0000 7f51ee59c700 1 --2- 172.21.15.6:0/885399646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51f00ceab0 0x7f51f0144f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:53.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.599+0000 7f51ef59e700 1 -- 172.21.15.6:0/885399646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51f0071c00 msgr2=0x7f51f00c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:53.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.599+0000 7f51ef59e700 1 --2- 172.21.15.6:0/885399646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51f0071c00 0x7f51f00c6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:53.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.599+0000 7f51ef59e700 1 -- 172.21.15.6:0/885399646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51f00ceab0 msgr2=0x7f51f0144f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:53.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.599+0000 7f51ef59e700 1 --2- 172.21.15.6:0/885399646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51f00ceab0 0x7f51f0144f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:53.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.599+0000 7f51ef59e700 1 -- 172.21.15.6:0/885399646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d80094a0 con 0x7f51f00cee80 2023-07-06T19:59:53.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.599+0000 7f51eed9d700 1 --2- 172.21.15.6:0/885399646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51f0071c00 0x7f51f00c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:53.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.600+0000 7f51ef59e700 1 --2- 172.21.15.6:0/885399646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f00cee80 0x7f51f00c8bf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f51e800cba0 tx=0x7f51e800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:53.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.600+0000 7f51e77fe700 1 -- 172.21.15.6:0/885399646 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e800aad0 con 0x7f51f00cee80 2023-07-06T19:59:53.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.600+0000 7f51e77fe700 1 -- 172.21.15.6:0/885399646 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e800ac50 con 0x7f51f00cee80 2023-07-06T19:59:53.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.600+0000 7f51e77fe700 1 -- 172.21.15.6:0/885399646 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e80070d0 con 0x7f51f00cee80 2023-07-06T19:59:53.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.600+0000 7f51f5174700 1 -- 172.21.15.6:0/885399646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51f00c7450 con 0x7f51f00cee80 2023-07-06T19:59:53.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.600+0000 7f51f5174700 1 -- 172.21.15.6:0/885399646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51f014fbb0 con 0x7f51f00cee80 2023-07-06T19:59:53.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.601+0000 7f51f5174700 1 -- 172.21.15.6:0/885399646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f014fa10 con 0x7f51f00cee80 2023-07-06T19:59:53.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.601+0000 7f51e77fe700 1 -- 172.21.15.6:0/885399646 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f51e8007230 con 0x7f51f00cee80 2023-07-06T19:59:53.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.602+0000 7f51e77fe700 1 --2- 172.21.15.6:0/885399646 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f51d006ace0 0x7f51d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:53.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.602+0000 7f51e77fe700 1 -- 172.21.15.6:0/885399646 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f51e8089210 con 0x7f51f00cee80 2023-07-06T19:59:53.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.602+0000 7f51eed9d700 1 --2- 172.21.15.6:0/885399646 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f51d006ace0 0x7f51d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:53.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.602+0000 7f51eed9d700 1 --2- 172.21.15.6:0/885399646 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f51d006ace0 0x7f51d006d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f51e00099f0 tx=0x7f51e0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:53.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.606+0000 7f51e77fe700 1 -- 172.21.15.6:0/885399646 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f51f014fa10 con 0x7f51f00cee80 2023-07-06T19:59:53.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.811+0000 7f51f5174700 1 -- 172.21.15.6:0/885399646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51f014fa10 con 0x7f51f00cee80 2023-07-06T19:59:53.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.812+0000 7f51e77fe700 1 -- 172.21.15.6:0/885399646 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20059 (secure 0 0 0) 0x7f51f014fa10 con 0x7f51f00cee80 2023-07-06T19:59:53.819 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:53.820 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":29,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:59:33.917851+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T19:58:51.062712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T19:58:52.130350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T19:58:55.785128+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:59:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.814+0000 7f51f5174700 1 -- 172.21.15.6:0/885399646 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f51d006ace0 msgr2=0x7f51d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.814+0000 7f51f5174700 1 --2- 172.21.15.6:0/885399646 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f51d006ace0 0x7f51d006d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f51e00099f0 tx=0x7f51e0008040 comp rx=0 tx=0).stop 2023-07-06T19:59:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.814+0000 7f51f5174700 1 -- 172.21.15.6:0/885399646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f00cee80 msgr2=0x7f51f00c8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:53.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.814+0000 7f51f5174700 1 --2- 172.21.15.6:0/885399646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f00cee80 0x7f51f00c8bf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f51e800cba0 tx=0x7f51e800ceb0 comp rx=0 tx=0).stop 2023-07-06T19:59:53.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.814+0000 7f51f5174700 1 -- 172.21.15.6:0/885399646 shutdown_connections 2023-07-06T19:59:53.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.814+0000 7f51f5174700 1 --2- 172.21.15.6:0/885399646 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f51d006ace0 0x7f51d006d190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:53.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.814+0000 7f51f5174700 1 --2- 172.21.15.6:0/885399646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51f00cee80 0x7f51f00c8bf0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:53.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.814+0000 7f51f5174700 1 --2- 172.21.15.6:0/885399646 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51f0071c00 0x7f51f00c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:53.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.814+0000 7f51f5174700 1 --2- 172.21.15.6:0/885399646 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51f00ceab0 0x7f51f0144f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:53.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.815+0000 7f51f5174700 1 -- 172.21.15.6:0/885399646 >> 172.21.15.6:0/885399646 conn(0x7f51f00cc420 msgr2=0x7f51f0152ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:53.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.815+0000 7f51f5174700 1 -- 172.21.15.6:0/885399646 shutdown_connections 2023-07-06T19:59:53.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.815+0000 7f51f5174700 1 -- 172.21.15.6:0/885399646 wait complete. 2023-07-06T19:59:53.830 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T19:58:38.767727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T19:58:45.759808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T19:58:51.062712+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T19:58:52.130350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T19:58:55.785128+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T19:59:53.831 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T19:59:53.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.969+0000 7f194d9d4700 1 Processor -- start 2023-07-06T19:59:53.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.969+0000 7f194d9d4700 1 -- start start 2023-07-06T19:59:53.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.970+0000 7f194d9d4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19480b1f10 0x7f19480cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:53.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.970+0000 7f194d9d4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1948160e00 0x7f194806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:53.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.970+0000 7f194d9d4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f194815d480 con 0x7f194815d910 2023-07-06T19:59:53.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.970+0000 7f194d9d4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f194815cc60 con 0x7f1948160e00 2023-07-06T19:59:53.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.970+0000 7f194d9d4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194815ce70 con 0x7f19480b1f10 2023-07-06T19:59:53.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.970+0000 7f19467fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1948160e00 0x7f194806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:53.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.970+0000 7f19477fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f194815d910 0x7f194806a060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33172/0 (socket says 172.21.15.6:33172) 2023-07-06T19:59:53.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.970+0000 7f19477fe700 1 -- 172.21.15.6:0/1243374227 learned_addr learned my addr 172.21.15.6:0/1243374227 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:53.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.970+0000 7f1946ffd700 1 --2- 172.21.15.6:0/1243374227 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19480b1f10 0x7f19480cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:53.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.970+0000 7f19467fc700 1 -- 172.21.15.6:0/1243374227 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19480b1f10 msgr2=0x7f19480cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:53.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.970+0000 7f19467fc700 1 --2- 172.21.15.6:0/1243374227 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19480b1f10 0x7f19480cd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:53.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.970+0000 7f19467fc700 1 -- 172.21.15.6:0/1243374227 >> v1:172.21.15.6:6789/0 conn(0x7f194815d910 legacy=0x7f194806a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:53.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.970+0000 7f19467fc700 1 -- 172.21.15.6:0/1243374227 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19480cddd0 con 0x7f1948160e00 2023-07-06T19:59:53.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.970+0000 7f1945ffb700 1 -- 172.21.15.6:0/1243374227 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2689372528 0 0) 0x7f194815d480 con 0x7f194815d910 2023-07-06T19:59:53.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.970+0000 7f19467fc700 1 --2- 172.21.15.6:0/1243374227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1948160e00 0x7f194806bdb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f193c009840 tx=0x7f193c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a9890fc4268f90 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:53.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.970+0000 7f1945ffb700 1 -- 172.21.15.6:0/1243374227 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c011830 con 0x7f1948160e00 2023-07-06T19:59:53.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.970+0000 7f1945ffb700 1 -- 172.21.15.6:0/1243374227 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193c011990 con 0x7f1948160e00 2023-07-06T19:59:53.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.970+0000 7f1945ffb700 1 -- 172.21.15.6:0/1243374227 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c011d20 con 0x7f1948160e00 2023-07-06T19:59:53.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.971+0000 7f194d9d4700 1 -- 172.21.15.6:0/1243374227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1948160e00 msgr2=0x7f194806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:53.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.971+0000 7f194d9d4700 1 --2- 172.21.15.6:0/1243374227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1948160e00 0x7f194806bdb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f193c009840 tx=0x7f193c009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:53.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.971+0000 7f194d9d4700 1 -- 172.21.15.6:0/1243374227 shutdown_connections 2023-07-06T19:59:53.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.971+0000 7f194d9d4700 1 --2- 172.21.15.6:0/1243374227 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19480b1f10 0x7f19480cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:53.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.971+0000 7f194d9d4700 1 --2- 172.21.15.6:0/1243374227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1948160e00 0x7f194806bdb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:53.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.971+0000 7f194d9d4700 1 -- 172.21.15.6:0/1243374227 >> 172.21.15.6:0/1243374227 conn(0x7f19480d2c70 msgr2=0x7f19480d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:53.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.971+0000 7f194d9d4700 1 -- 172.21.15.6:0/1243374227 shutdown_connections 2023-07-06T19:59:53.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.971+0000 7f194d9d4700 1 -- 172.21.15.6:0/1243374227 wait complete. 2023-07-06T19:59:53.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.972+0000 7f194d9d4700 1 Processor -- start 2023-07-06T19:59:53.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.972+0000 7f194d9d4700 1 -- start start 2023-07-06T19:59:53.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.973+0000 7f194d9d4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19480b1f10 0x7f19481f2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:53.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.973+0000 7f194d9d4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f194815d910 0x7f19481583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:53.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.973+0000 7f194d9d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1948160e00 0x7f19480b8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:53.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.973+0000 7f194d9d4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1948155c30 con 0x7f1948160e00 2023-07-06T19:59:53.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.973+0000 7f194d9d4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19480b73c0 con 0x7f194815d910 2023-07-06T19:59:53.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.973+0000 7f194d9d4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19480b6f70 con 0x7f19480b1f10 2023-07-06T19:59:53.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.973+0000 7f19477fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1948160e00 0x7f19480b8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:53.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.973+0000 7f19477fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1948160e00 0x7f19480b8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60202/0 (socket says 172.21.15.6:60202) 2023-07-06T19:59:53.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.973+0000 7f19477fe700 1 -- 172.21.15.6:0/2291913841 learned_addr learned my addr 172.21.15.6:0/2291913841 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:53.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.973+0000 7f1946ffd700 1 --2- 172.21.15.6:0/2291913841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19480b1f10 0x7f19481f2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:53.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.973+0000 7f19467fc700 1 --2- 172.21.15.6:0/2291913841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f194815d910 0x7f19481583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:53.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.974+0000 7f19477fe700 1 -- 172.21.15.6:0/2291913841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19480b1f10 msgr2=0x7f19481f2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:53.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.974+0000 7f19477fe700 1 --2- 172.21.15.6:0/2291913841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19480b1f10 0x7f19481f2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:53.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.974+0000 7f19477fe700 1 -- 172.21.15.6:0/2291913841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f194815d910 msgr2=0x7f19481583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:53.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.974+0000 7f19477fe700 1 --2- 172.21.15.6:0/2291913841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f194815d910 0x7f19481583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:53.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.974+0000 7f19477fe700 1 -- 172.21.15.6:0/2291913841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c0094a0 con 0x7f1948160e00 2023-07-06T19:59:53.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.974+0000 7f19477fe700 1 --2- 172.21.15.6:0/2291913841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1948160e00 0x7f19480b8390 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1940002230 tx=0x7f194000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:53.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.974+0000 7f192ffff700 1 -- 172.21.15.6:0/2291913841 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194000aac0 con 0x7f1948160e00 2023-07-06T19:59:53.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.974+0000 7f192ffff700 1 -- 172.21.15.6:0/2291913841 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194000ac40 con 0x7f1948160e00 2023-07-06T19:59:53.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.974+0000 7f194d9d4700 1 -- 172.21.15.6:0/2291913841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19480b75d0 con 0x7f1948160e00 2023-07-06T19:59:53.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.974+0000 7f192ffff700 1 -- 172.21.15.6:0/2291913841 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19400070d0 con 0x7f1948160e00 2023-07-06T19:59:53.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.974+0000 7f194d9d4700 1 -- 172.21.15.6:0/2291913841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19480b7b90 con 0x7f1948160e00 2023-07-06T19:59:53.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.975+0000 7f194d9d4700 1 -- 172.21.15.6:0/2291913841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19480c9a90 con 0x7f1948160e00 2023-07-06T19:59:53.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.975+0000 7f192ffff700 1 -- 172.21.15.6:0/2291913841 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1940007250 con 0x7f1948160e00 2023-07-06T19:59:53.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.976+0000 7f192ffff700 1 --2- 172.21.15.6:0/2291913841 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f193406ace0 0x7f193406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:53.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.976+0000 7f1946ffd700 1 --2- 172.21.15.6:0/2291913841 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f193406ace0 0x7f193406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:53.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.976+0000 7f192ffff700 1 -- 172.21.15.6:0/2291913841 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1940089500 con 0x7f1948160e00 2023-07-06T19:59:53.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.976+0000 7f1946ffd700 1 --2- 172.21.15.6:0/2291913841 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f193406ace0 0x7f193406d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f19480ca110 tx=0x7f1938008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:53.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:53.980+0000 7f192ffff700 1 -- 172.21.15.6:0/2291913841 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1940054310 con 0x7f1948160e00 2023-07-06T19:59:54.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.179+0000 7f194d9d4700 1 -- 172.21.15.6:0/2291913841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f194804eb90 con 0x7f1948160e00 2023-07-06T19:59:54.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.180+0000 7f192ffff700 1 -- 172.21.15.6:0/2291913841 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1940057930 con 0x7f1948160e00 2023-07-06T19:59:54.182 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-06T19:59:54.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.182+0000 7f194d9d4700 1 -- 172.21.15.6:0/2291913841 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f193406ace0 msgr2=0x7f193406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:54.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.182+0000 7f194d9d4700 1 --2- 172.21.15.6:0/2291913841 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f193406ace0 0x7f193406d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f19480ca110 tx=0x7f1938008040 comp rx=0 tx=0).stop 2023-07-06T19:59:54.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.182+0000 7f194d9d4700 1 -- 172.21.15.6:0/2291913841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1948160e00 msgr2=0x7f19480b8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:54.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.182+0000 7f194d9d4700 1 --2- 172.21.15.6:0/2291913841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1948160e00 0x7f19480b8390 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1940002230 tx=0x7f194000cf50 comp rx=0 tx=0).stop 2023-07-06T19:59:54.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.182+0000 7f194d9d4700 1 -- 172.21.15.6:0/2291913841 shutdown_connections 2023-07-06T19:59:54.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.182+0000 7f194d9d4700 1 --2- 172.21.15.6:0/2291913841 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f193406ace0 0x7f193406d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.182+0000 7f194d9d4700 1 --2- 172.21.15.6:0/2291913841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1948160e00 0x7f19480b8390 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.182+0000 7f194d9d4700 1 --2- 172.21.15.6:0/2291913841 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f19480b1f10 0x7f19481f2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.182+0000 7f194d9d4700 1 --2- 172.21.15.6:0/2291913841 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f194815d910 0x7f19481583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.182+0000 7f194d9d4700 1 -- 172.21.15.6:0/2291913841 >> 172.21.15.6:0/2291913841 conn(0x7f19480d2c70 msgr2=0x7f194806bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.182+0000 7f194d9d4700 1 -- 172.21.15.6:0/2291913841 shutdown_connections 2023-07-06T19:59:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.182+0000 7f194d9d4700 1 -- 172.21.15.6:0/2291913841 wait complete. 2023-07-06T19:59:54.196 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T19:59:54.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.325+0000 7fe2dca39700 1 Processor -- start 2023-07-06T19:59:54.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.325+0000 7fe2dca39700 1 -- start start 2023-07-06T19:59:54.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.326+0000 7fe2dca39700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe2d815a520 0x7fe2d806dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:54.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.326+0000 7fe2dca39700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe2d80d15e0 0x7fe2d806e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:54.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.326+0000 7fe2dca39700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d80cd300 con 0x7fe2d806e690 2023-07-06T19:59:54.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.326+0000 7fe2dca39700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d80b0290 con 0x7fe2d815a520 2023-07-06T19:59:54.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.326+0000 7fe2dca39700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d80ccd80 con 0x7fe2d80d15e0 2023-07-06T19:59:54.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.326+0000 7fe2d659c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe2d815a520 0x7fe2d806dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:54.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.326+0000 7fe2d6d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe2d806e690 0x7fe2d815ded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33186/0 (socket says 172.21.15.6:33186) 2023-07-06T19:59:54.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.326+0000 7fe2d6d9d700 1 -- 172.21.15.6:0/1655546702 learned_addr learned my addr 172.21.15.6:0/1655546702 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:54.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.326+0000 7fe2d5d9b700 1 --2- 172.21.15.6:0/1655546702 >> v2:172.21.15.40:3300/0 conn(0x7fe2d80d15e0 0x7fe2d806e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:54.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.327+0000 7fe2d659c700 1 -- 172.21.15.6:0/1655546702 >> v2:172.21.15.40:3300/0 conn(0x7fe2d80d15e0 msgr2=0x7fe2d806e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:54.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.327+0000 7fe2d659c700 1 --2- 172.21.15.6:0/1655546702 >> v2:172.21.15.40:3300/0 conn(0x7fe2d80d15e0 0x7fe2d806e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:54.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.327+0000 7fe2d659c700 1 -- 172.21.15.6:0/1655546702 >> v1:172.21.15.6:6789/0 conn(0x7fe2d806e690 legacy=0x7fe2d815ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:54.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.327+0000 7fe2d659c700 1 -- 172.21.15.6:0/1655546702 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d80cd020 con 0x7fe2d815a520 2023-07-06T19:59:54.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.327+0000 7fe2d5d9b700 1 --2- 172.21.15.6:0/1655546702 >> v2:172.21.15.40:3300/0 conn(0x7fe2d80d15e0 0x7fe2d806e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:54.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.327+0000 7fe2d659c700 1 --2- 172.21.15.6:0/1655546702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d815a520 0x7fe2d806dc10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80ce560 tx=0x7fe2c8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdbbae110256676f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:54.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.327+0000 7fe2d559a700 1 -- 172.21.15.6:0/1655546702 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8011830 con 0x7fe2d815a520 2023-07-06T19:59:54.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.327+0000 7fe2d559a700 1 -- 172.21.15.6:0/1655546702 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c8011990 con 0x7fe2d815a520 2023-07-06T19:59:54.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.327+0000 7fe2d559a700 1 -- 172.21.15.6:0/1655546702 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8011d20 con 0x7fe2d815a520 2023-07-06T19:59:54.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.327+0000 7fe2dca39700 1 -- 172.21.15.6:0/1655546702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d815a520 msgr2=0x7fe2d806dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:54.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.327+0000 7fe2dca39700 1 --2- 172.21.15.6:0/1655546702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d815a520 0x7fe2d806dc10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe2d80ce560 tx=0x7fe2c8009b20 comp rx=0 tx=0).stop 2023-07-06T19:59:54.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.328+0000 7fe2dca39700 1 -- 172.21.15.6:0/1655546702 shutdown_connections 2023-07-06T19:59:54.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.328+0000 7fe2dca39700 1 --2- 172.21.15.6:0/1655546702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d815a520 0x7fe2d806dc10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:54.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.328+0000 7fe2dca39700 1 --2- 172.21.15.6:0/1655546702 >> v2:172.21.15.40:3300/0 conn(0x7fe2d80d15e0 0x7fe2d806e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:54.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.328+0000 7fe2dca39700 1 -- 172.21.15.6:0/1655546702 >> 172.21.15.6:0/1655546702 conn(0x7fe2d80ce120 msgr2=0x7fe2d80d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:54.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.328+0000 7fe2dca39700 1 -- 172.21.15.6:0/1655546702 shutdown_connections 2023-07-06T19:59:54.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.328+0000 7fe2dca39700 1 -- 172.21.15.6:0/1655546702 wait complete. 2023-07-06T19:59:54.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.329+0000 7fe2dca39700 1 Processor -- start 2023-07-06T19:59:54.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.329+0000 7fe2dca39700 1 -- start start 2023-07-06T19:59:54.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.330+0000 7fe2dca39700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2d806e690 0x7fe2d80ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:54.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.330+0000 7fe2dca39700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d80d15e0 0x7fe2d80c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:54.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.330+0000 7fe2dca39700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2d815a520 0x7fe2d80c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:54.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.330+0000 7fe2dca39700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d80b6220 con 0x7fe2d80d15e0 2023-07-06T19:59:54.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.330+0000 7fe2dca39700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d80c7f40 con 0x7fe2d806e690 2023-07-06T19:59:54.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.330+0000 7fe2dca39700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d80b5980 con 0x7fe2d815a520 2023-07-06T19:59:54.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.330+0000 7fe2d5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d80d15e0 0x7fe2d80c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:54.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.330+0000 7fe2d5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d80d15e0 0x7fe2d80c6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60214/0 (socket says 172.21.15.6:60214) 2023-07-06T19:59:54.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.330+0000 7fe2d5d9b700 1 -- 172.21.15.6:0/3425580351 learned_addr learned my addr 172.21.15.6:0/3425580351 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:54.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.330+0000 7fe2d659c700 1 --2- 172.21.15.6:0/3425580351 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2d806e690 0x7fe2d80ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:54.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.330+0000 7fe2d6d9d700 1 --2- 172.21.15.6:0/3425580351 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2d815a520 0x7fe2d80c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:54.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.330+0000 7fe2d5d9b700 1 -- 172.21.15.6:0/3425580351 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2d815a520 msgr2=0x7fe2d80c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:54.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.330+0000 7fe2d5d9b700 1 --2- 172.21.15.6:0/3425580351 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2d815a520 0x7fe2d80c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:54.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.330+0000 7fe2d5d9b700 1 -- 172.21.15.6:0/3425580351 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2d806e690 msgr2=0x7fe2d80ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:54.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.330+0000 7fe2d5d9b700 1 --2- 172.21.15.6:0/3425580351 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2d806e690 0x7fe2d80ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:54.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.330+0000 7fe2d5d9b700 1 -- 172.21.15.6:0/3425580351 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c80094a0 con 0x7fe2d80d15e0 2023-07-06T19:59:54.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.330+0000 7fe2d6d9d700 1 --2- 172.21.15.6:0/3425580351 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2d815a520 0x7fe2d80c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:54.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.330+0000 7fe2d5d9b700 1 --2- 172.21.15.6:0/3425580351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d80d15e0 0x7fe2d80c6450 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00c750 tx=0x7fe2cc00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:54.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.330+0000 7fe2c6ffd700 1 -- 172.21.15.6:0/3425580351 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc011800 con 0x7fe2d80d15e0 2023-07-06T19:59:54.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.330+0000 7fe2c6ffd700 1 -- 172.21.15.6:0/3425580351 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc011960 con 0x7fe2d80d15e0 2023-07-06T19:59:54.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.331+0000 7fe2dca39700 1 -- 172.21.15.6:0/3425580351 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d80b5c60 con 0x7fe2d80d15e0 2023-07-06T19:59:54.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.331+0000 7fe2c6ffd700 1 -- 172.21.15.6:0/3425580351 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc011cd0 con 0x7fe2d80d15e0 2023-07-06T19:59:54.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.331+0000 7fe2dca39700 1 -- 172.21.15.6:0/3425580351 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d80c6990 con 0x7fe2d80d15e0 2023-07-06T19:59:54.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.332+0000 7fe2dca39700 1 -- 172.21.15.6:0/3425580351 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d80c8140 con 0x7fe2d80d15e0 2023-07-06T19:59:54.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.332+0000 7fe2c6ffd700 1 -- 172.21.15.6:0/3425580351 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe2cc021350 con 0x7fe2d80d15e0 2023-07-06T19:59:54.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.332+0000 7fe2c6ffd700 1 --2- 172.21.15.6:0/3425580351 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe2b806ace0 0x7fe2b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:54.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.332+0000 7fe2c6ffd700 1 -- 172.21.15.6:0/3425580351 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe2cc089640 con 0x7fe2d80d15e0 2023-07-06T19:59:54.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.332+0000 7fe2d659c700 1 --2- 172.21.15.6:0/3425580351 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe2b806ace0 0x7fe2b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:54.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.333+0000 7fe2d659c700 1 --2- 172.21.15.6:0/3425580351 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe2b806ace0 0x7fe2b806d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80090b0 tx=0x7fe2c801c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:54.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.337+0000 7fe2c6ffd700 1 -- 172.21.15.6:0/3425580351 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe2d80c8140 con 0x7fe2d80d15e0 2023-07-06T19:59:54.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.531+0000 7fe2dca39700 1 -- 172.21.15.6:0/3425580351 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe2d804eb90 con 0x7fe2d80d15e0 2023-07-06T19:59:54.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.532+0000 7fe2c6ffd700 1 -- 172.21.15.6:0/3425580351 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe2cc057ee0 con 0x7fe2d80d15e0 2023-07-06T19:59:54.548 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-06T19:59:54.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.534+0000 7fe2dca39700 1 -- 172.21.15.6:0/3425580351 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe2b806ace0 msgr2=0x7fe2b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:54.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.534+0000 7fe2dca39700 1 --2- 172.21.15.6:0/3425580351 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe2b806ace0 0x7fe2b806d190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe2c80090b0 tx=0x7fe2c801c040 comp rx=0 tx=0).stop 2023-07-06T19:59:54.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.534+0000 7fe2dca39700 1 -- 172.21.15.6:0/3425580351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d80d15e0 msgr2=0x7fe2d80c6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:54.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.534+0000 7fe2dca39700 1 --2- 172.21.15.6:0/3425580351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d80d15e0 0x7fe2d80c6450 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc00c750 tx=0x7fe2cc00ca60 comp rx=0 tx=0).stop 2023-07-06T19:59:54.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.534+0000 7fe2dca39700 1 -- 172.21.15.6:0/3425580351 shutdown_connections 2023-07-06T19:59:54.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.534+0000 7fe2dca39700 1 --2- 172.21.15.6:0/3425580351 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe2b806ace0 0x7fe2b806d190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:54.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.534+0000 7fe2dca39700 1 --2- 172.21.15.6:0/3425580351 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe2d815a520 0x7fe2d80c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:54.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.534+0000 7fe2dca39700 1 --2- 172.21.15.6:0/3425580351 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2d806e690 0x7fe2d80ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:54.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.534+0000 7fe2dca39700 1 --2- 172.21.15.6:0/3425580351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe2d80d15e0 0x7fe2d80c6450 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:54.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.534+0000 7fe2dca39700 1 -- 172.21.15.6:0/3425580351 >> 172.21.15.6:0/3425580351 conn(0x7fe2d80ce120 msgr2=0x7fe2d80b0460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:54.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.534+0000 7fe2dca39700 1 -- 172.21.15.6:0/3425580351 shutdown_connections 2023-07-06T19:59:54.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.534+0000 7fe2dca39700 1 -- 172.21.15.6:0/3425580351 wait complete. 2023-07-06T19:59:54.567 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T19:59:54.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.694+0000 7f20ff1f0700 1 Processor -- start 2023-07-06T19:59:54.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.695+0000 7f20ff1f0700 1 -- start start 2023-07-06T19:59:54.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.695+0000 7f20ff1f0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20f81592b0 0x7f20f8071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:54.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.695+0000 7f20ff1f0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f806e700 con 0x7f20f80cd950 2023-07-06T19:59:54.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.695+0000 7f20ff1f0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f80cc160 con 0x7f20f815cd40 2023-07-06T19:59:54.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.695+0000 7f20ff1f0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f8159680 con 0x7f20f81592b0 2023-07-06T19:59:54.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.695+0000 7f20fd78d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f20f80cd950 0x7f20f806dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33200/0 (socket says 172.21.15.6:33200) 2023-07-06T19:59:54.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.695+0000 7f20fd78d700 1 -- 172.21.15.6:0/2026681168 learned_addr learned my addr 172.21.15.6:0/2026681168 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:54.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.696+0000 7f20fcf8c700 1 --2- 172.21.15.6:0/2026681168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20f81592b0 0x7f20f8071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:54.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.696+0000 7f20f77fe700 1 -- 172.21.15.6:0/2026681168 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441687207 0 0) 0x7f20f806e700 con 0x7f20f80cd950 2023-07-06T19:59:54.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.696+0000 7f20f77fe700 1 -- 172.21.15.6:0/2026681168 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20e80035b0 con 0x7f20f80cd950 2023-07-06T19:59:54.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.696+0000 7f20f77fe700 1 -- 172.21.15.6:0/2026681168 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2718220133 0 0) 0x7f20f80cc160 con 0x7f20f815cd40 2023-07-06T19:59:54.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.696+0000 7f20f77fe700 1 -- 172.21.15.6:0/2026681168 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20f806e700 con 0x7f20f815cd40 2023-07-06T19:59:54.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.696+0000 7f20f77fe700 1 -- 172.21.15.6:0/2026681168 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 536184033 0 0) 0x7f20e80035b0 con 0x7f20f80cd950 2023-07-06T19:59:54.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.696+0000 7f20fcf8c700 1 -- 172.21.15.6:0/2026681168 >> v1:172.21.15.40:6789/0 conn(0x7f20f815cd40 legacy=0x7f20f806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:54.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.696+0000 7f20fcf8c700 1 -- 172.21.15.6:0/2026681168 >> v1:172.21.15.6:6789/0 conn(0x7f20f80cd950 legacy=0x7f20f806dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:54.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.696+0000 7f20fcf8c700 1 -- 172.21.15.6:0/2026681168 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f815d2b0 con 0x7f20f81592b0 2023-07-06T19:59:54.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.696+0000 7f20fcf8c700 1 --2- 172.21.15.6:0/2026681168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20f81592b0 0x7f20f8071690 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009870 tx=0x7f20ec009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5220c60282f6a53 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:54.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.696+0000 7f20f77fe700 1 -- 172.21.15.6:0/2026681168 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f00019f0 con 0x7f20f81592b0 2023-07-06T19:59:54.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.696+0000 7f20f77fe700 1 -- 172.21.15.6:0/2026681168 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ec004030 con 0x7f20f81592b0 2023-07-06T19:59:54.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.697+0000 7f20f77fe700 1 -- 172.21.15.6:0/2026681168 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ec0043c0 con 0x7f20f81592b0 2023-07-06T19:59:54.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.697+0000 7f20ff1f0700 1 -- 172.21.15.6:0/2026681168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20f81592b0 msgr2=0x7f20f8071690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:54.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.697+0000 7f20ff1f0700 1 --2- 172.21.15.6:0/2026681168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20f81592b0 0x7f20f8071690 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f20ec009870 tx=0x7f20ec009b80 comp rx=0 tx=0).stop 2023-07-06T19:59:54.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.697+0000 7f20ff1f0700 1 -- 172.21.15.6:0/2026681168 shutdown_connections 2023-07-06T19:59:54.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.697+0000 7f20ff1f0700 1 --2- 172.21.15.6:0/2026681168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20f81592b0 0x7f20f8071690 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:54.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.697+0000 7f20ff1f0700 1 -- 172.21.15.6:0/2026681168 >> 172.21.15.6:0/2026681168 conn(0x7f20f80cf960 msgr2=0x7f20f80cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:54.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.697+0000 7f20ff1f0700 1 -- 172.21.15.6:0/2026681168 shutdown_connections 2023-07-06T19:59:54.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.697+0000 7f20ff1f0700 1 -- 172.21.15.6:0/2026681168 wait complete. 2023-07-06T19:59:54.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.698+0000 7f20ff1f0700 1 Processor -- start 2023-07-06T19:59:54.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.698+0000 7f20ff1f0700 1 -- start start 2023-07-06T19:59:54.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.699+0000 7f20ff1f0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20f80cd950 0x7f20f80cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:54.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.699+0000 7f20ff1f0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f81592b0 0x7f20f81580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:54.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.699+0000 7f20ff1f0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20f815cd40 0x7f20f81585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:54.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.699+0000 7f20ff1f0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f80b4a70 con 0x7f20f81592b0 2023-07-06T19:59:54.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.699+0000 7f20ff1f0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f80b3e60 con 0x7f20f815cd40 2023-07-06T19:59:54.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.699+0000 7f20ff1f0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f80b4140 con 0x7f20f80cd950 2023-07-06T19:59:54.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.699+0000 7f20f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f81592b0 0x7f20f81580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:54.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.699+0000 7f20f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f81592b0 0x7f20f81580b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60228/0 (socket says 172.21.15.6:60228) 2023-07-06T19:59:54.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.699+0000 7f20f7fff700 1 -- 172.21.15.6:0/3434183764 learned_addr learned my addr 172.21.15.6:0/3434183764 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:54.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.700+0000 7f20fcf8c700 1 --2- 172.21.15.6:0/3434183764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20f80cd950 0x7f20f80cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:54.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.700+0000 7f20fd78d700 1 --2- 172.21.15.6:0/3434183764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20f815cd40 0x7f20f81585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:54.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.700+0000 7f20f7fff700 1 -- 172.21.15.6:0/3434183764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20f80cd950 msgr2=0x7f20f80cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:54.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.700+0000 7f20f7fff700 1 --2- 172.21.15.6:0/3434183764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20f80cd950 0x7f20f80cb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:54.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.700+0000 7f20f7fff700 1 -- 172.21.15.6:0/3434183764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20f815cd40 msgr2=0x7f20f81585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:54.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.700+0000 7f20f7fff700 1 --2- 172.21.15.6:0/3434183764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20f815cd40 0x7f20f81585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:54.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.700+0000 7f20f7fff700 1 -- 172.21.15.6:0/3434183764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec0094a0 con 0x7f20f81592b0 2023-07-06T19:59:54.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.700+0000 7f20f7fff700 1 --2- 172.21.15.6:0/3434183764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f81592b0 0x7f20f81580b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f20e400c520 tx=0x7f20e400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:54.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.700+0000 7f20f57fa700 1 -- 172.21.15.6:0/3434183764 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e40052d0 con 0x7f20f81592b0 2023-07-06T19:59:54.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.700+0000 7f20ff1f0700 1 -- 172.21.15.6:0/3434183764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f80b4420 con 0x7f20f81592b0 2023-07-06T19:59:54.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.700+0000 7f20f57fa700 1 -- 172.21.15.6:0/3434183764 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20e4005430 con 0x7f20f81592b0 2023-07-06T19:59:54.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.700+0000 7f20f57fa700 1 -- 172.21.15.6:0/3434183764 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20e40038c0 con 0x7f20f81592b0 2023-07-06T19:59:54.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.700+0000 7f20ff1f0700 1 -- 172.21.15.6:0/3434183764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f80cbd20 con 0x7f20f81592b0 2023-07-06T19:59:54.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.701+0000 7f20ff1f0700 1 -- 172.21.15.6:0/3434183764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f804eb90 con 0x7f20f81592b0 2023-07-06T19:59:54.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.701+0000 7f20f57fa700 1 -- 172.21.15.6:0/3434183764 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f20e4003a20 con 0x7f20f81592b0 2023-07-06T19:59:54.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.702+0000 7f20f57fa700 1 --2- 172.21.15.6:0/3434183764 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f20dc06ace0 0x7f20dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:54.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.702+0000 7f20f57fa700 1 -- 172.21.15.6:0/3434183764 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f20e4088ea0 con 0x7f20f81592b0 2023-07-06T19:59:54.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.702+0000 7f20fcf8c700 1 --2- 172.21.15.6:0/3434183764 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f20dc06ace0 0x7f20dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:54.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.702+0000 7f20fcf8c700 1 --2- 172.21.15.6:0/3434183764 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f20dc06ace0 0x7f20dc06d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0097c0 tx=0x7f20ec013040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:54.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.706+0000 7f20f57fa700 1 -- 172.21.15.6:0/3434183764 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f20e4053b10 con 0x7f20f81592b0 2023-07-06T19:59:54.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.905+0000 7f20ff1f0700 1 -- 172.21.15.6:0/3434183764 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f20f80d04d0 con 0x7f20f81592b0 2023-07-06T19:59:54.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.906+0000 7f20f57fa700 1 -- 172.21.15.6:0/3434183764 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f20e4057130 con 0x7f20f81592b0 2023-07-06T19:59:54.912 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T19:59:54.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.908+0000 7f20ff1f0700 1 -- 172.21.15.6:0/3434183764 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f20dc06ace0 msgr2=0x7f20dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:54.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.908+0000 7f20ff1f0700 1 --2- 172.21.15.6:0/3434183764 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f20dc06ace0 0x7f20dc06d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f20ec0097c0 tx=0x7f20ec013040 comp rx=0 tx=0).stop 2023-07-06T19:59:54.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.908+0000 7f20ff1f0700 1 -- 172.21.15.6:0/3434183764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f81592b0 msgr2=0x7f20f81580b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:54.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.908+0000 7f20ff1f0700 1 --2- 172.21.15.6:0/3434183764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f81592b0 0x7f20f81580b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f20e400c520 tx=0x7f20e400c8e0 comp rx=0 tx=0).stop 2023-07-06T19:59:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.908+0000 7f20ff1f0700 1 -- 172.21.15.6:0/3434183764 shutdown_connections 2023-07-06T19:59:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.908+0000 7f20ff1f0700 1 --2- 172.21.15.6:0/3434183764 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f20dc06ace0 0x7f20dc06d190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.908+0000 7f20ff1f0700 1 --2- 172.21.15.6:0/3434183764 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20f815cd40 0x7f20f81585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.908+0000 7f20ff1f0700 1 --2- 172.21.15.6:0/3434183764 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20f80cd950 0x7f20f80cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.908+0000 7f20ff1f0700 1 --2- 172.21.15.6:0/3434183764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20f81592b0 0x7f20f81580b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.908+0000 7f20ff1f0700 1 -- 172.21.15.6:0/3434183764 >> 172.21.15.6:0/3434183764 conn(0x7f20f80cf960 msgr2=0x7f20f806b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:54.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.908+0000 7f20ff1f0700 1 -- 172.21.15.6:0/3434183764 shutdown_connections 2023-07-06T19:59:54.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:54.908+0000 7f20ff1f0700 1 -- 172.21.15.6:0/3434183764 wait complete. 2023-07-06T19:59:54.929 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T19:59:55.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.058+0000 7ff4b78cd700 1 Processor -- start 2023-07-06T19:59:55.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.059+0000 7ff4b78cd700 1 -- start start 2023-07-06T19:59:55.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.059+0000 7ff4b78cd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4b00ca850 0x7ff4b015bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:55.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.059+0000 7ff4b78cd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff4b0071cd0 0x7ff4b015c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:55.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.060+0000 7ff4b78cd700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b00cb310 con 0x7ff4b0071900 2023-07-06T19:59:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.060+0000 7ff4b78cd700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b00cdbf0 con 0x7ff4b0071cd0 2023-07-06T19:59:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.060+0000 7ff4b78cd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b015c9d0 con 0x7ff4b00ca850 2023-07-06T19:59:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.060+0000 7ff4b5e6a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff4b0071cd0 0x7ff4b015c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.060+0000 7ff4b5e6a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff4b0071cd0 0x7ff4b015c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60238/0 (socket says 172.21.15.6:60238) 2023-07-06T19:59:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.060+0000 7ff4b5e6a700 1 -- 172.21.15.6:0/15804002 learned_addr learned my addr 172.21.15.6:0/15804002 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.060+0000 7ff4b4e68700 1 --2- 172.21.15.6:0/15804002 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4b00ca850 0x7ff4b015bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:55.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.060+0000 7ff4b5e6a700 1 -- 172.21.15.6:0/15804002 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4b00ca850 msgr2=0x7ff4b015bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.060+0000 7ff4b5e6a700 1 --2- 172.21.15.6:0/15804002 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4b00ca850 0x7ff4b015bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.060+0000 7ff4b5e6a700 1 -- 172.21.15.6:0/15804002 >> v1:172.21.15.40:6789/0 conn(0x7ff4b0071900 legacy=0x7ff4b00ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.060+0000 7ff4b5e6a700 1 -- 172.21.15.6:0/15804002 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b00af070 con 0x7ff4b0071cd0 2023-07-06T19:59:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.060+0000 7ff4b5e6a700 1 --2- 172.21.15.6:0/15804002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b0071cd0 0x7ff4b015c490 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009e50 tx=0x7ff4a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a97be4dd63f497a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.060+0000 7ff4a7fff700 1 -- 172.21.15.6:0/15804002 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a800e070 con 0x7ff4b0071cd0 2023-07-06T19:59:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.060+0000 7ff4a7fff700 1 -- 172.21.15.6:0/15804002 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a8003a20 con 0x7ff4b0071cd0 2023-07-06T19:59:55.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.060+0000 7ff4a7fff700 1 -- 172.21.15.6:0/15804002 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8003dd0 con 0x7ff4b0071cd0 2023-07-06T19:59:55.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.061+0000 7ff4b78cd700 1 -- 172.21.15.6:0/15804002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b0071cd0 msgr2=0x7ff4b015c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:55.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.061+0000 7ff4b78cd700 1 --2- 172.21.15.6:0/15804002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b0071cd0 0x7ff4b015c490 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009e50 tx=0x7ff4a800b330 comp rx=0 tx=0).stop 2023-07-06T19:59:55.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.061+0000 7ff4b78cd700 1 -- 172.21.15.6:0/15804002 shutdown_connections 2023-07-06T19:59:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.061+0000 7ff4b78cd700 1 --2- 172.21.15.6:0/15804002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b0071cd0 0x7ff4b015c490 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.061+0000 7ff4b78cd700 1 --2- 172.21.15.6:0/15804002 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4b00ca850 0x7ff4b015bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.061+0000 7ff4b78cd700 1 -- 172.21.15.6:0/15804002 >> 172.21.15.6:0/15804002 conn(0x7ff4b00cf960 msgr2=0x7ff4b00cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.061+0000 7ff4b78cd700 1 -- 172.21.15.6:0/15804002 shutdown_connections 2023-07-06T19:59:55.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.061+0000 7ff4b78cd700 1 -- 172.21.15.6:0/15804002 wait complete. 2023-07-06T19:59:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.062+0000 7ff4b78cd700 1 Processor -- start 2023-07-06T19:59:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.062+0000 7ff4b78cd700 1 -- start start 2023-07-06T19:59:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.063+0000 7ff4b78cd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4b0071900 0x7ff4b015d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.063+0000 7ff4b78cd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4b0071cd0 0x7ff4b00ad960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.063+0000 7ff4b78cd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b00ca850 0x7ff4b014e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.063+0000 7ff4b78cd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b00ae040 con 0x7ff4b00ca850 2023-07-06T19:59:55.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.063+0000 7ff4b78cd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b00ae320 con 0x7ff4b0071900 2023-07-06T19:59:55.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.063+0000 7ff4b78cd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b00ae600 con 0x7ff4b0071cd0 2023-07-06T19:59:55.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.063+0000 7ff4b5e6a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b00ca850 0x7ff4b014e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.063+0000 7ff4b5e6a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b00ca850 0x7ff4b014e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60244/0 (socket says 172.21.15.6:60244) 2023-07-06T19:59:55.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.063+0000 7ff4b5e6a700 1 -- 172.21.15.6:0/2486622911 learned_addr learned my addr 172.21.15.6:0/2486622911 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:55.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.063+0000 7ff4b5669700 1 --2- 172.21.15.6:0/2486622911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4b0071900 0x7ff4b015d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:55.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.063+0000 7ff4b4e68700 1 --2- 172.21.15.6:0/2486622911 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4b0071cd0 0x7ff4b00ad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:55.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.063+0000 7ff4b5e6a700 1 -- 172.21.15.6:0/2486622911 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4b0071cd0 msgr2=0x7ff4b00ad960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:55.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.063+0000 7ff4b5e6a700 1 --2- 172.21.15.6:0/2486622911 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4b0071cd0 0x7ff4b00ad960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.063+0000 7ff4b5e6a700 1 -- 172.21.15.6:0/2486622911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4b0071900 msgr2=0x7ff4b015d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:55.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.063+0000 7ff4b5e6a700 1 --2- 172.21.15.6:0/2486622911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4b0071900 0x7ff4b015d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.063+0000 7ff4b5e6a700 1 -- 172.21.15.6:0/2486622911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a8009b30 con 0x7ff4b00ca850 2023-07-06T19:59:55.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.064+0000 7ff4b5e6a700 1 --2- 172.21.15.6:0/2486622911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b00ca850 0x7ff4b014e070 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff4b006eb20 tx=0x7ff4a8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:55.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.064+0000 7ff4a5ffb700 1 -- 172.21.15.6:0/2486622911 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8004440 con 0x7ff4b00ca850 2023-07-06T19:59:55.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.064+0000 7ff4a5ffb700 1 -- 172.21.15.6:0/2486622911 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a80045a0 con 0x7ff4b00ca850 2023-07-06T19:59:55.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.064+0000 7ff4b78cd700 1 -- 172.21.15.6:0/2486622911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b00b3940 con 0x7ff4b00ca850 2023-07-06T19:59:55.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.064+0000 7ff4a5ffb700 1 -- 172.21.15.6:0/2486622911 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8004930 con 0x7ff4b00ca850 2023-07-06T19:59:55.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.064+0000 7ff4b78cd700 1 -- 172.21.15.6:0/2486622911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b014ef90 con 0x7ff4b00ca850 2023-07-06T19:59:55.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.065+0000 7ff4b78cd700 1 -- 172.21.15.6:0/2486622911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b004eb90 con 0x7ff4b00ca850 2023-07-06T19:59:55.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.065+0000 7ff4a5ffb700 1 -- 172.21.15.6:0/2486622911 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff4a8012430 con 0x7ff4b00ca850 2023-07-06T19:59:55.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.066+0000 7ff4a5ffb700 1 --2- 172.21.15.6:0/2486622911 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7ff49406ace0 0x7ff49406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:55.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.066+0000 7ff4a5ffb700 1 -- 172.21.15.6:0/2486622911 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff4a808ace0 con 0x7ff4b00ca850 2023-07-06T19:59:55.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.066+0000 7ff4b5669700 1 --2- 172.21.15.6:0/2486622911 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7ff49406ace0 0x7ff49406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:55.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.066+0000 7ff4b5669700 1 --2- 172.21.15.6:0/2486622911 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7ff49406ace0 0x7ff49406d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0009960 tx=0x7ff4a00090e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:55.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.070+0000 7ff4a5ffb700 1 -- 172.21.15.6:0/2486622911 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff4a8059580 con 0x7ff4b00ca850 2023-07-06T19:59:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.266+0000 7ff4b78cd700 1 -- 172.21.15.6:0/2486622911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff4b00aea80 con 0x7ff4b00ca850 2023-07-06T19:59:55.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.266+0000 7ff4a5ffb700 1 -- 172.21.15.6:0/2486622911 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff4a8059110 con 0x7ff4b00ca850 2023-07-06T19:59:55.271 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-06T19:59:55.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.268+0000 7ff4b78cd700 1 -- 172.21.15.6:0/2486622911 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7ff49406ace0 msgr2=0x7ff49406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:55.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.268+0000 7ff4b78cd700 1 --2- 172.21.15.6:0/2486622911 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7ff49406ace0 0x7ff49406d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0009960 tx=0x7ff4a00090e0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.268+0000 7ff4b78cd700 1 -- 172.21.15.6:0/2486622911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b00ca850 msgr2=0x7ff4b014e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.268+0000 7ff4b78cd700 1 --2- 172.21.15.6:0/2486622911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b00ca850 0x7ff4b014e070 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff4b006eb20 tx=0x7ff4a8004ad0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.268+0000 7ff4b78cd700 1 -- 172.21.15.6:0/2486622911 shutdown_connections 2023-07-06T19:59:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.268+0000 7ff4b78cd700 1 --2- 172.21.15.6:0/2486622911 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7ff49406ace0 0x7ff49406d190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.268+0000 7ff4b78cd700 1 --2- 172.21.15.6:0/2486622911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4b00ca850 0x7ff4b014e070 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.268+0000 7ff4b78cd700 1 --2- 172.21.15.6:0/2486622911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff4b0071900 0x7ff4b015d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.268+0000 7ff4b78cd700 1 --2- 172.21.15.6:0/2486622911 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff4b0071cd0 0x7ff4b00ad960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.268+0000 7ff4b78cd700 1 -- 172.21.15.6:0/2486622911 >> 172.21.15.6:0/2486622911 conn(0x7ff4b00cf960 msgr2=0x7ff4b00afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.268+0000 7ff4b78cd700 1 -- 172.21.15.6:0/2486622911 shutdown_connections 2023-07-06T19:59:55.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.268+0000 7ff4b78cd700 1 -- 172.21.15.6:0/2486622911 wait complete. 2023-07-06T19:59:55.292 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T19:59:55.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.422+0000 7f3bd0b50700 1 Processor -- start 2023-07-06T19:59:55.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.422+0000 7f3bd0b50700 1 -- start start 2023-07-06T19:59:55.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.423+0000 7f3bd0b50700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3bcc06c4c0 0x7f3bcc1675e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:55.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.424+0000 7f3bd0b50700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bcc15d480 con 0x7f3bcc0b1f10 2023-07-06T19:59:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.424+0000 7f3bd0b50700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bcc15ce70 con 0x7f3bcc160e00 2023-07-06T19:59:55.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.424+0000 7f3bd0b50700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bcc15cc60 con 0x7f3bcc06c4c0 2023-07-06T19:59:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.424+0000 7f3bca59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3bcc0b1f10 0x7f3bcc0cd2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33224/0 (socket says 172.21.15.6:33224) 2023-07-06T19:59:55.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.424+0000 7f3bca59c700 1 -- 172.21.15.6:0/734042279 learned_addr learned my addr 172.21.15.6:0/734042279 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:55.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.424+0000 7f3bc959a700 1 -- 172.21.15.6:0/734042279 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3883385958 0 0) 0x7f3bcc15d480 con 0x7f3bcc0b1f10 2023-07-06T19:59:55.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.424+0000 7f3bcad9d700 1 --2- 172.21.15.6:0/734042279 >> v2:172.21.15.40:3300/0 conn(0x7f3bcc06c4c0 0x7f3bcc1675e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:55.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.424+0000 7f3bc959a700 1 -- 172.21.15.6:0/734042279 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bb80035b0 con 0x7f3bcc0b1f10 2023-07-06T19:59:55.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.424+0000 7f3bc959a700 1 -- 172.21.15.6:0/734042279 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1333975782 0 0) 0x7f3bb80035b0 con 0x7f3bcc0b1f10 2023-07-06T19:59:55.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.424+0000 7f3bc959a700 1 -- 172.21.15.6:0/734042279 >> v2:172.21.15.40:3300/0 conn(0x7f3bcc06c4c0 msgr2=0x7f3bcc1675e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:55.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.424+0000 7f3bc959a700 1 --2- 172.21.15.6:0/734042279 >> v2:172.21.15.40:3300/0 conn(0x7f3bcc06c4c0 0x7f3bcc1675e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.424+0000 7f3bc959a700 1 -- 172.21.15.6:0/734042279 >> v1:172.21.15.40:6789/0 conn(0x7f3bcc160e00 legacy=0x7f3bcc06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:55.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.424+0000 7f3bc959a700 1 -- 172.21.15.6:0/734042279 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc0cddd0 con 0x7f3bcc0b1f10 2023-07-06T19:59:55.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.424+0000 7f3bc959a700 1 -- 172.21.15.6:0/734042279 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f3bbc001670 con 0x7f3bcc0b1f10 2023-07-06T19:59:55.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.424+0000 7f3bc959a700 1 -- 172.21.15.6:0/734042279 >> v1:172.21.15.6:6789/0 conn(0x7f3bcc0b1f10 legacy=0x7f3bcc0cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:55.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.424+0000 7f3bc959a700 1 --2- 172.21.15.6:0/734042279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bb8003a00 0x7f3bb8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:55.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.424+0000 7f3bc959a700 1 --2- 172.21.15.6:0/734042279 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bb8004850 0x7f3bb8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:55.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.424+0000 7f3bc959a700 1 --2- 172.21.15.6:0/734042279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bb8005200 0x7f3bb800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:55.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.424+0000 7f3bc959a700 1 -- 172.21.15.6:0/734042279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc15cc60 con 0x7f3bb8005200 2023-07-06T19:59:55.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.424+0000 7f3bc959a700 1 -- 172.21.15.6:0/734042279 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb800c080 con 0x7f3bb8003a00 2023-07-06T19:59:55.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.424+0000 7f3bc959a700 1 -- 172.21.15.6:0/734042279 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb800c240 con 0x7f3bb8004850 2023-07-06T19:59:55.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.424+0000 7f3bcad9d700 1 --2- 172.21.15.6:0/734042279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bb8005200 0x7f3bb800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:55.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.425+0000 7f3bca59c700 1 --2- 172.21.15.6:0/734042279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bb8003a00 0x7f3bb8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:55.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.425+0000 7f3bc9d9b700 1 --2- 172.21.15.6:0/734042279 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bb8004850 0x7f3bb8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:55.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.425+0000 7f3bcad9d700 1 -- 172.21.15.6:0/734042279 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bb8004850 msgr2=0x7f3bb8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:55.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.425+0000 7f3bcad9d700 1 --2- 172.21.15.6:0/734042279 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bb8004850 0x7f3bb8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.425+0000 7f3bcad9d700 1 -- 172.21.15.6:0/734042279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bb8003a00 msgr2=0x7f3bb8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:55.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.425+0000 7f3bcad9d700 1 --2- 172.21.15.6:0/734042279 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bb8003a00 0x7f3bb8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.425+0000 7f3bcad9d700 1 -- 172.21.15.6:0/734042279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb80035b0 con 0x7f3bb8005200 2023-07-06T19:59:55.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.425+0000 7f3bc9d9b700 1 --2- 172.21.15.6:0/734042279 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bb8004850 0x7f3bb8004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:55.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.425+0000 7f3bcad9d700 1 -- 172.21.15.6:0/734042279 reap_dead start 2023-07-06T19:59:55.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.425+0000 7f3bcad9d700 1 --2- 172.21.15.6:0/734042279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bb8005200 0x7f3bb800ba10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4009fc0 tx=0x7f3bb8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de009c6c7c408d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:55.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.425+0000 7f3bc959a700 1 -- 172.21.15.6:0/734042279 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4003a20 con 0x7f3bb8005200 2023-07-06T19:59:55.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.425+0000 7f3bc959a700 1 -- 172.21.15.6:0/734042279 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc400f040 con 0x7f3bb8005200 2023-07-06T19:59:55.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.425+0000 7f3bc959a700 1 -- 172.21.15.6:0/734042279 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4003de0 con 0x7f3bb8005200 2023-07-06T19:59:55.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.425+0000 7f3bd0b50700 1 -- 172.21.15.6:0/734042279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bb8005200 msgr2=0x7f3bb800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:55.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.425+0000 7f3bd0b50700 1 --2- 172.21.15.6:0/734042279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bb8005200 0x7f3bb800ba10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4009fc0 tx=0x7f3bb8005880 comp rx=0 tx=0).stop 2023-07-06T19:59:55.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.426+0000 7f3bd0b50700 1 -- 172.21.15.6:0/734042279 shutdown_connections 2023-07-06T19:59:55.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.426+0000 7f3bd0b50700 1 --2- 172.21.15.6:0/734042279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bb8005200 0x7f3bb800ba10 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.426+0000 7f3bd0b50700 1 -- 172.21.15.6:0/734042279 >> 172.21.15.6:0/734042279 conn(0x7f3bcc0d2c70 msgr2=0x7f3bcc0d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:55.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.426+0000 7f3bd0b50700 1 -- 172.21.15.6:0/734042279 shutdown_connections 2023-07-06T19:59:55.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.426+0000 7f3bd0b50700 1 -- 172.21.15.6:0/734042279 wait complete. 2023-07-06T19:59:55.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.427+0000 7f3bd0b50700 1 Processor -- start 2023-07-06T19:59:55.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.427+0000 7f3bd0b50700 1 -- start start 2023-07-06T19:59:55.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.428+0000 7f3bd0b50700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bb8005200 0x7f3bcc1f1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:55.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.428+0000 7f3bd0b50700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bcc1f6120 0x7f3bcc0b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:55.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.428+0000 7f3bd0b50700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bcc0b3d40 0x7f3bcc0b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:55.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.428+0000 7f3bd0b50700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc0b6a00 con 0x7f3bcc0b3d40 2023-07-06T19:59:55.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.428+0000 7f3bd0b50700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc0b41e0 con 0x7f3bcc1f6120 2023-07-06T19:59:55.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.428+0000 7f3bd0b50700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc0b6720 con 0x7f3bb8005200 2023-07-06T19:59:55.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.428+0000 7f3bcad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bcc0b3d40 0x7f3bcc0b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:55.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.428+0000 7f3bcad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bcc0b3d40 0x7f3bcc0b5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60264/0 (socket says 172.21.15.6:60264) 2023-07-06T19:59:55.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.428+0000 7f3bcad9d700 1 -- 172.21.15.6:0/895313701 learned_addr learned my addr 172.21.15.6:0/895313701 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:55.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.428+0000 7f3bca59c700 1 --2- 172.21.15.6:0/895313701 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bb8005200 0x7f3bcc1f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:55.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.428+0000 7f3bc9d9b700 1 --2- 172.21.15.6:0/895313701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bcc1f6120 0x7f3bcc0b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:55.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.428+0000 7f3bcad9d700 1 -- 172.21.15.6:0/895313701 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bb8005200 msgr2=0x7f3bcc1f1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:55.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.428+0000 7f3bcad9d700 1 --2- 172.21.15.6:0/895313701 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bb8005200 0x7f3bcc1f1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.428+0000 7f3bcad9d700 1 -- 172.21.15.6:0/895313701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bcc1f6120 msgr2=0x7f3bcc0b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:55.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.428+0000 7f3bcad9d700 1 --2- 172.21.15.6:0/895313701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bcc1f6120 0x7f3bcc0b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.428+0000 7f3bcad9d700 1 -- 172.21.15.6:0/895313701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc1f5640 con 0x7f3bcc0b3d40 2023-07-06T19:59:55.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.428+0000 7f3bcad9d700 1 --2- 172.21.15.6:0/895313701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bcc0b3d40 0x7f3bcc0b5aa0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3bc400e700 tx=0x7f3bc4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:55.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.428+0000 7f3bc2ffd700 1 -- 172.21.15.6:0/895313701 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4003e10 con 0x7f3bcc0b3d40 2023-07-06T19:59:55.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.428+0000 7f3bc2ffd700 1 -- 172.21.15.6:0/895313701 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc4004230 con 0x7f3bcc0b3d40 2023-07-06T19:59:55.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.428+0000 7f3bd0b50700 1 -- 172.21.15.6:0/895313701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bcc1f5920 con 0x7f3bcc0b3d40 2023-07-06T19:59:55.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.429+0000 7f3bc2ffd700 1 -- 172.21.15.6:0/895313701 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc40045e0 con 0x7f3bcc0b3d40 2023-07-06T19:59:55.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.429+0000 7f3bd0b50700 1 -- 172.21.15.6:0/895313701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bcc1f1b70 con 0x7f3bcc0b3d40 2023-07-06T19:59:55.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.429+0000 7f3bd0b50700 1 -- 172.21.15.6:0/895313701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bcc1f54a0 con 0x7f3bcc0b3d40 2023-07-06T19:59:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.430+0000 7f3bc2ffd700 1 -- 172.21.15.6:0/895313701 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3bc4004740 con 0x7f3bcc0b3d40 2023-07-06T19:59:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.430+0000 7f3bc2ffd700 1 --2- 172.21.15.6:0/895313701 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3bac06ace0 0x7f3bac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:55.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.430+0000 7f3bc2ffd700 1 -- 172.21.15.6:0/895313701 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3bc408ab40 con 0x7f3bcc0b3d40 2023-07-06T19:59:55.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.430+0000 7f3bca59c700 1 --2- 172.21.15.6:0/895313701 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3bac06ace0 0x7f3bac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:55.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.431+0000 7f3bca59c700 1 --2- 172.21.15.6:0/895313701 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3bac06ace0 0x7f3bac06d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc007cd0 tx=0x7f3bbc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:55.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.435+0000 7f3bc2ffd700 1 -- 172.21.15.6:0/895313701 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3bcc1f54a0 con 0x7f3bcc0b3d40 2023-07-06T19:59:55.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.633+0000 7f3bd0b50700 1 -- 172.21.15.6:0/895313701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3bcc1f5e40 con 0x7f3bcc0b3d40 2023-07-06T19:59:55.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.633+0000 7f3bc2ffd700 1 -- 172.21.15.6:0/895313701 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3bcc1f5e40 con 0x7f3bcc0b3d40 2023-07-06T19:59:55.637 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T19:59:55.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.635+0000 7f3bd0b50700 1 -- 172.21.15.6:0/895313701 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3bac06ace0 msgr2=0x7f3bac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:55.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.635+0000 7f3bd0b50700 1 --2- 172.21.15.6:0/895313701 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3bac06ace0 0x7f3bac06d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc007cd0 tx=0x7f3bbc009040 comp rx=0 tx=0).stop 2023-07-06T19:59:55.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.635+0000 7f3bd0b50700 1 -- 172.21.15.6:0/895313701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bcc0b3d40 msgr2=0x7f3bcc0b5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:55.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.635+0000 7f3bd0b50700 1 --2- 172.21.15.6:0/895313701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bcc0b3d40 0x7f3bcc0b5aa0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3bc400e700 tx=0x7f3bc4009750 comp rx=0 tx=0).stop 2023-07-06T19:59:55.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.635+0000 7f3bd0b50700 1 -- 172.21.15.6:0/895313701 shutdown_connections 2023-07-06T19:59:55.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.635+0000 7f3bd0b50700 1 --2- 172.21.15.6:0/895313701 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3bac06ace0 0x7f3bac06d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.635+0000 7f3bd0b50700 1 --2- 172.21.15.6:0/895313701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3bcc0b3d40 0x7f3bcc0b5aa0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.635+0000 7f3bd0b50700 1 --2- 172.21.15.6:0/895313701 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3bb8005200 0x7f3bcc1f1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.635+0000 7f3bd0b50700 1 --2- 172.21.15.6:0/895313701 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3bcc1f6120 0x7f3bcc0b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.635+0000 7f3bd0b50700 1 -- 172.21.15.6:0/895313701 >> 172.21.15.6:0/895313701 conn(0x7f3bcc0d2c70 msgr2=0x7f3bcc0d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:55.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.636+0000 7f3bd0b50700 1 -- 172.21.15.6:0/895313701 shutdown_connections 2023-07-06T19:59:55.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.636+0000 7f3bd0b50700 1 -- 172.21.15.6:0/895313701 wait complete. 2023-07-06T19:59:55.652 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T19:59:55.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.777+0000 7fbc2d39a700 1 Processor -- start 2023-07-06T19:59:55.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.777+0000 7fbc2d39a700 1 -- start start 2023-07-06T19:59:55.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.777+0000 7fbc2d39a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc280b1f10 0x7fbc280cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:55.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.777+0000 7fbc2d39a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc28160e00 0x7fbc2806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:55.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.777+0000 7fbc2d39a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc2815d480 con 0x7fbc2815d910 2023-07-06T19:59:55.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.778+0000 7fbc2d39a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc2815cc60 con 0x7fbc28160e00 2023-07-06T19:59:55.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.778+0000 7fbc2d39a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2815ce70 con 0x7fbc280b1f10 2023-07-06T19:59:55.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.778+0000 7fbc267fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc28160e00 0x7fbc2806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:55.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.778+0000 7fbc26ffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc280b1f10 0x7fbc280cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:55.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.778+0000 7fbc267fc700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc28160e00 0x7fbc2806bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:39306/0 (socket says 172.21.15.6:39306) 2023-07-06T19:59:55.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.778+0000 7fbc267fc700 1 -- 172.21.15.6:0/2756451410 learned_addr learned my addr 172.21.15.6:0/2756451410 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:55.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.778+0000 7fbc277fe700 1 --1- 172.21.15.6:0/2756451410 >> v1:172.21.15.40:6789/0 conn(0x7fbc2815d910 0x7fbc2806a060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:51352/0 (socket says 172.21.15.6:51352) 2023-07-06T19:59:55.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.778+0000 7fbc267fc700 1 -- 172.21.15.6:0/2756451410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc280b1f10 msgr2=0x7fbc280cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:55.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.778+0000 7fbc267fc700 1 --2- 172.21.15.6:0/2756451410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc280b1f10 0x7fbc280cd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.778+0000 7fbc267fc700 1 -- 172.21.15.6:0/2756451410 >> v1:172.21.15.40:6789/0 conn(0x7fbc2815d910 legacy=0x7fbc2806a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:55.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.778+0000 7fbc267fc700 1 -- 172.21.15.6:0/2756451410 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc280cddd0 con 0x7fbc28160e00 2023-07-06T19:59:55.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.778+0000 7fbc25ffb700 1 -- 172.21.15.6:0/2756451410 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455566798 0 0) 0x7fbc2815d480 con 0x7fbc2815d910 2023-07-06T19:59:55.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.778+0000 7fbc267fc700 1 --2- 172.21.15.6:0/2756451410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc28160e00 0x7fbc2806bdb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbc180098f0 tx=0x7fbc18009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fc89f03395dd84d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:55.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.779+0000 7fbc25ffb700 1 -- 172.21.15.6:0/2756451410 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc18011830 con 0x7fbc28160e00 2023-07-06T19:59:55.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.779+0000 7fbc25ffb700 1 -- 172.21.15.6:0/2756451410 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc18011990 con 0x7fbc28160e00 2023-07-06T19:59:55.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.779+0000 7fbc25ffb700 1 -- 172.21.15.6:0/2756451410 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc18011d20 con 0x7fbc28160e00 2023-07-06T19:59:55.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.779+0000 7fbc2d39a700 1 -- 172.21.15.6:0/2756451410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc28160e00 msgr2=0x7fbc2806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:55.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.779+0000 7fbc2d39a700 1 --2- 172.21.15.6:0/2756451410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc28160e00 0x7fbc2806bdb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbc180098f0 tx=0x7fbc18009c00 comp rx=0 tx=0).stop 2023-07-06T19:59:55.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.779+0000 7fbc2d39a700 1 -- 172.21.15.6:0/2756451410 shutdown_connections 2023-07-06T19:59:55.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.779+0000 7fbc2d39a700 1 --2- 172.21.15.6:0/2756451410 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc280b1f10 0x7fbc280cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.779+0000 7fbc2d39a700 1 --2- 172.21.15.6:0/2756451410 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc28160e00 0x7fbc2806bdb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.779+0000 7fbc2d39a700 1 -- 172.21.15.6:0/2756451410 >> 172.21.15.6:0/2756451410 conn(0x7fbc280d2c70 msgr2=0x7fbc280d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:55.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.779+0000 7fbc2d39a700 1 -- 172.21.15.6:0/2756451410 shutdown_connections 2023-07-06T19:59:55.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.779+0000 7fbc2d39a700 1 -- 172.21.15.6:0/2756451410 wait complete. 2023-07-06T19:59:55.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.781+0000 7fbc2d39a700 1 Processor -- start 2023-07-06T19:59:55.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.781+0000 7fbc2d39a700 1 -- start start 2023-07-06T19:59:55.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.781+0000 7fbc2d39a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc280b1f10 0x7fbc281f2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:55.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.781+0000 7fbc2d39a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc2815d910 0x7fbc281583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:55.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.781+0000 7fbc2d39a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc28160e00 0x7fbc280b8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:55.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.781+0000 7fbc2d39a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc28155c30 con 0x7fbc280b1f10 2023-07-06T19:59:55.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.781+0000 7fbc2d39a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc280b73c0 con 0x7fbc2815d910 2023-07-06T19:59:55.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.781+0000 7fbc2d39a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc280b6f70 con 0x7fbc28160e00 2023-07-06T19:59:55.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.781+0000 7fbc26ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc280b1f10 0x7fbc281f2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:55.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.781+0000 7fbc26ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc280b1f10 0x7fbc281f2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60274/0 (socket says 172.21.15.6:60274) 2023-07-06T19:59:55.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.782+0000 7fbc26ffd700 1 -- 172.21.15.6:0/551458747 learned_addr learned my addr 172.21.15.6:0/551458747 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:55.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.782+0000 7fbc277fe700 1 --2- 172.21.15.6:0/551458747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc28160e00 0x7fbc280b8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:55.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.782+0000 7fbc267fc700 1 --2- 172.21.15.6:0/551458747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc2815d910 0x7fbc281583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:55.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.782+0000 7fbc26ffd700 1 -- 172.21.15.6:0/551458747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc28160e00 msgr2=0x7fbc280b8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:55.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.782+0000 7fbc26ffd700 1 --2- 172.21.15.6:0/551458747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc28160e00 0x7fbc280b8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.782+0000 7fbc26ffd700 1 -- 172.21.15.6:0/551458747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc2815d910 msgr2=0x7fbc281583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:55.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.782+0000 7fbc26ffd700 1 --2- 172.21.15.6:0/551458747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc2815d910 0x7fbc281583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:55.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.782+0000 7fbc26ffd700 1 -- 172.21.15.6:0/551458747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc18009550 con 0x7fbc280b1f10 2023-07-06T19:59:55.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.782+0000 7fbc277fe700 1 --2- 172.21.15.6:0/551458747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc28160e00 0x7fbc280b8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:55.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.782+0000 7fbc267fc700 1 --2- 172.21.15.6:0/551458747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc2815d910 0x7fbc281583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:55.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.782+0000 7fbc26ffd700 1 --2- 172.21.15.6:0/551458747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc280b1f10 0x7fbc281f2cf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbc1400e9b0 tx=0x7fbc1400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:55.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.782+0000 7fbc1f7fe700 1 -- 172.21.15.6:0/551458747 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc14009710 con 0x7fbc280b1f10 2023-07-06T19:59:55.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.782+0000 7fbc1f7fe700 1 -- 172.21.15.6:0/551458747 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1400c850 con 0x7fbc280b1f10 2023-07-06T19:59:55.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.782+0000 7fbc2d39a700 1 -- 172.21.15.6:0/551458747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc280b75d0 con 0x7fbc280b1f10 2023-07-06T19:59:55.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.782+0000 7fbc1f7fe700 1 -- 172.21.15.6:0/551458747 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1400cbc0 con 0x7fbc280b1f10 2023-07-06T19:59:55.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.782+0000 7fbc2d39a700 1 -- 172.21.15.6:0/551458747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc280b7b90 con 0x7fbc280b1f10 2023-07-06T19:59:55.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.783+0000 7fbc2d39a700 1 -- 172.21.15.6:0/551458747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc280c9a90 con 0x7fbc280b1f10 2023-07-06T19:59:55.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.784+0000 7fbc1f7fe700 1 -- 172.21.15.6:0/551458747 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbc1400cd20 con 0x7fbc280b1f10 2023-07-06T19:59:55.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.784+0000 7fbc1f7fe700 1 --2- 172.21.15.6:0/551458747 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbc1006ace0 0x7fbc1006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:55.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.784+0000 7fbc1f7fe700 1 -- 172.21.15.6:0/551458747 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbc140898d0 con 0x7fbc280b1f10 2023-07-06T19:59:55.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.784+0000 7fbc267fc700 1 --2- 172.21.15.6:0/551458747 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbc1006ace0 0x7fbc1006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:55.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.785+0000 7fbc267fc700 1 --2- 172.21.15.6:0/551458747 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbc1006ace0 0x7fbc1006d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbc28159230 tx=0x7fbc18008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:55.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:55.789+0000 7fbc1f7fe700 1 -- 172.21.15.6:0/551458747 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbc140580d0 con 0x7fbc280b1f10 2023-07-06T19:59:56.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.004+0000 7fbc2d39a700 1 -- 172.21.15.6:0/551458747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbc2804eb90 con 0x7fbc280b1f10 2023-07-06T19:59:56.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.005+0000 7fbc1f7fe700 1 -- 172.21.15.6:0/551458747 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbc14057c60 con 0x7fbc280b1f10 2023-07-06T19:59:56.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.007+0000 7fbc2d39a700 1 -- 172.21.15.6:0/551458747 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbc1006ace0 msgr2=0x7fbc1006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:56.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.007+0000 7fbc2d39a700 1 --2- 172.21.15.6:0/551458747 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbc1006ace0 0x7fbc1006d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbc28159230 tx=0x7fbc18008030 comp rx=0 tx=0).stop 2023-07-06T19:59:56.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.007+0000 7fbc2d39a700 1 -- 172.21.15.6:0/551458747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc280b1f10 msgr2=0x7fbc281f2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:56.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.007+0000 7fbc2d39a700 1 --2- 172.21.15.6:0/551458747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc280b1f10 0x7fbc281f2cf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fbc1400e9b0 tx=0x7fbc1400ed70 comp rx=0 tx=0).stop 2023-07-06T19:59:56.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.007+0000 7fbc2d39a700 1 -- 172.21.15.6:0/551458747 shutdown_connections 2023-07-06T19:59:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.007+0000 7fbc2d39a700 1 --2- 172.21.15.6:0/551458747 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbc1006ace0 0x7fbc1006d190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.007+0000 7fbc2d39a700 1 --2- 172.21.15.6:0/551458747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc280b1f10 0x7fbc281f2cf0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.007+0000 7fbc2d39a700 1 --2- 172.21.15.6:0/551458747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc28160e00 0x7fbc280b8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.007+0000 7fbc2d39a700 1 --2- 172.21.15.6:0/551458747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc2815d910 0x7fbc281583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.007+0000 7fbc2d39a700 1 -- 172.21.15.6:0/551458747 >> 172.21.15.6:0/551458747 conn(0x7fbc280d2c70 msgr2=0x7fbc2806bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.007+0000 7fbc2d39a700 1 -- 172.21.15.6:0/551458747 shutdown_connections 2023-07-06T19:59:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.007+0000 7fbc2d39a700 1 -- 172.21.15.6:0/551458747 wait complete. 2023-07-06T19:59:56.013 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-07-06T19:59:56.026 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-06T19:59:56.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:56.029 DEBUG:teuthology.orchestra.run.smithi040:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-07-06T19:59:56.077 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-07-06T19:59:56.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:56.079 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-06T19:59:56.146 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:59:56.146 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T19:59:56.166 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:59:56.170 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T19:59:56.243 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T19:59:56.245 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T19:59:56.302 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T19:59:56.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.466+0000 7ff114b3e700 1 Processor -- start 2023-07-06T19:59:56.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.466+0000 7ff114b3e700 1 -- start start 2023-07-06T19:59:56.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.467+0000 7ff114b3e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff11015ce50 0x7ff1100cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:56.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.467+0000 7ff114b3e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff110160060 con 0x7ff11006c4c0 2023-07-06T19:59:56.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.467+0000 7ff114b3e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1100cd800 con 0x7ff11015d220 2023-07-06T19:59:56.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.467+0000 7ff114b3e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1101602b0 con 0x7ff11015ce50 2023-07-06T19:59:56.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.467+0000 7ff10e59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7ff11015ce50 0x7ff1100cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:56.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.467+0000 7ff10ed9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff11006c4c0 0x7ff1100d0730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33262/0 (socket says 172.21.15.6:33262) 2023-07-06T19:59:56.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.467+0000 7ff10ed9d700 1 -- 172.21.15.6:0/3761921927 learned_addr learned my addr 172.21.15.6:0/3761921927 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:56.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.467+0000 7ff10e59c700 1 -- 172.21.15.6:0/3761921927 >> v1:172.21.15.40:6789/0 conn(0x7ff11015d220 legacy=0x7ff11006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:56.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.467+0000 7ff10e59c700 1 -- 172.21.15.6:0/3761921927 >> v1:172.21.15.6:6789/0 conn(0x7ff11006c4c0 legacy=0x7ff1100d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:56.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.467+0000 7ff10e59c700 1 -- 172.21.15.6:0/3761921927 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff110160590 con 0x7ff11015ce50 2023-07-06T19:59:56.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.467+0000 7ff10e59c700 1 --2- 172.21.15.6:0/3761921927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff11015ce50 0x7ff1100cd1b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff104009840 tx=0x7ff104009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a8259fdddbd6774 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:56.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.468+0000 7ff10d59a700 1 -- 172.21.15.6:0/3761921927 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104004230 con 0x7ff11015ce50 2023-07-06T19:59:56.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.468+0000 7ff10d59a700 1 -- 172.21.15.6:0/3761921927 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff104004390 con 0x7ff11015ce50 2023-07-06T19:59:56.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.468+0000 7ff10d59a700 1 -- 172.21.15.6:0/3761921927 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1040036a0 con 0x7ff11015ce50 2023-07-06T19:59:56.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.468+0000 7ff114b3e700 1 -- 172.21.15.6:0/3761921927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff11015ce50 msgr2=0x7ff1100cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:56.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.468+0000 7ff114b3e700 1 --2- 172.21.15.6:0/3761921927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff11015ce50 0x7ff1100cd1b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff104009840 tx=0x7ff104009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:56.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.468+0000 7ff114b3e700 1 -- 172.21.15.6:0/3761921927 shutdown_connections 2023-07-06T19:59:56.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.468+0000 7ff114b3e700 1 --2- 172.21.15.6:0/3761921927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff11015ce50 0x7ff1100cd1b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:56.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.468+0000 7ff114b3e700 1 -- 172.21.15.6:0/3761921927 >> 172.21.15.6:0/3761921927 conn(0x7ff1100d3880 msgr2=0x7ff1100cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:56.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.468+0000 7ff114b3e700 1 -- 172.21.15.6:0/3761921927 shutdown_connections 2023-07-06T19:59:56.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.468+0000 7ff114b3e700 1 -- 172.21.15.6:0/3761921927 wait complete. 2023-07-06T19:59:56.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.470+0000 7ff114b3e700 1 Processor -- start 2023-07-06T19:59:56.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.470+0000 7ff114b3e700 1 -- start start 2023-07-06T19:59:56.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.471+0000 7ff114b3e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff11006c4c0 0x7ff1100b6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:56.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.471+0000 7ff114b3e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11015ce50 0x7ff1100b83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:56.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.471+0000 7ff114b3e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff11015d220 0x7ff1101f59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:56.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.471+0000 7ff114b3e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11014d350 con 0x7ff11015d220 2023-07-06T19:59:56.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.471+0000 7ff114b3e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1100b7f30 con 0x7ff11006c4c0 2023-07-06T19:59:56.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.471+0000 7ff114b3e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1100b6e50 con 0x7ff11015ce50 2023-07-06T19:59:56.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.471+0000 7ff10ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff11015d220 0x7ff1101f59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:56.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.471+0000 7ff10ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff11015d220 0x7ff1101f59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60292/0 (socket says 172.21.15.6:60292) 2023-07-06T19:59:56.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.471+0000 7ff10ed9d700 1 -- 172.21.15.6:0/407513671 learned_addr learned my addr 172.21.15.6:0/407513671 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:56.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.471+0000 7ff10e59c700 1 --2- 172.21.15.6:0/407513671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff11006c4c0 0x7ff1100b6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:56.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.471+0000 7ff10dd9b700 1 --2- 172.21.15.6:0/407513671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11015ce50 0x7ff1100b83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:56.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.471+0000 7ff10ed9d700 1 -- 172.21.15.6:0/407513671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11015ce50 msgr2=0x7ff1100b83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:56.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.471+0000 7ff10ed9d700 1 --2- 172.21.15.6:0/407513671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11015ce50 0x7ff1100b83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:56.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.471+0000 7ff10ed9d700 1 -- 172.21.15.6:0/407513671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff11006c4c0 msgr2=0x7ff1100b6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:56.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.471+0000 7ff10ed9d700 1 --2- 172.21.15.6:0/407513671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff11006c4c0 0x7ff1100b6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:56.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.471+0000 7ff10ed9d700 1 -- 172.21.15.6:0/407513671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1040094a0 con 0x7ff11015d220 2023-07-06T19:59:56.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.472+0000 7ff10ed9d700 1 --2- 172.21.15.6:0/407513671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff11015d220 0x7ff1101f59c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff10800cbc0 tx=0x7ff10800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:56.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.472+0000 7ff0feffd700 1 -- 172.21.15.6:0/407513671 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10800ab50 con 0x7ff11015d220 2023-07-06T19:59:56.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.472+0000 7ff0feffd700 1 -- 172.21.15.6:0/407513671 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10800acb0 con 0x7ff11015d220 2023-07-06T19:59:56.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.472+0000 7ff0feffd700 1 -- 172.21.15.6:0/407513671 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff108012600 con 0x7ff11015d220 2023-07-06T19:59:56.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.472+0000 7ff114b3e700 1 -- 172.21.15.6:0/407513671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff110160f10 con 0x7ff11015d220 2023-07-06T19:59:56.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.472+0000 7ff114b3e700 1 -- 172.21.15.6:0/407513671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1100b7600 con 0x7ff11015d220 2023-07-06T19:59:56.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.473+0000 7ff114b3e700 1 -- 172.21.15.6:0/407513671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff11006cd20 con 0x7ff11015d220 2023-07-06T19:59:56.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.473+0000 7ff0feffd700 1 -- 172.21.15.6:0/407513671 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff10801b3b0 con 0x7ff11015d220 2023-07-06T19:59:56.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.473+0000 7ff0feffd700 1 --2- 172.21.15.6:0/407513671 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7ff0f006ace0 0x7ff0f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:56.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.474+0000 7ff0feffd700 1 -- 172.21.15.6:0/407513671 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff108089440 con 0x7ff11015d220 2023-07-06T19:59:56.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.474+0000 7ff10e59c700 1 --2- 172.21.15.6:0/407513671 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7ff0f006ace0 0x7ff0f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:56.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.474+0000 7ff10e59c700 1 --2- 172.21.15.6:0/407513671 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7ff0f006ace0 0x7ff0f006d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff104009b90 tx=0x7ff104008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:56.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.478+0000 7ff0feffd700 1 -- 172.21.15.6:0/407513671 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff108054270 con 0x7ff11015d220 2023-07-06T19:59:56.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.677+0000 7ff114b3e700 1 -- 172.21.15.6:0/407513671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1100b1f30 con 0x7ff11015d220 2023-07-06T19:59:56.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.679+0000 7ff0feffd700 1 -- 172.21.15.6:0/407513671 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20059 (secure 0 0 0) 0x7ff108057890 con 0x7ff11015d220 2023-07-06T19:59:56.684 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:56.684 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":29,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:59:33.917851+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T19:58:51.062712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T19:58:52.130350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T19:58:55.785128+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:59:56.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.681+0000 7ff114b3e700 1 -- 172.21.15.6:0/407513671 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7ff0f006ace0 msgr2=0x7ff0f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:56.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.681+0000 7ff114b3e700 1 --2- 172.21.15.6:0/407513671 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7ff0f006ace0 0x7ff0f006d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff104009b90 tx=0x7ff104008030 comp rx=0 tx=0).stop 2023-07-06T19:59:56.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.681+0000 7ff114b3e700 1 -- 172.21.15.6:0/407513671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff11015d220 msgr2=0x7ff1101f59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:56.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.681+0000 7ff114b3e700 1 --2- 172.21.15.6:0/407513671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff11015d220 0x7ff1101f59c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff10800cbc0 tx=0x7ff10800cf80 comp rx=0 tx=0).stop 2023-07-06T19:59:56.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.681+0000 7ff114b3e700 1 -- 172.21.15.6:0/407513671 shutdown_connections 2023-07-06T19:59:56.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.681+0000 7ff114b3e700 1 --2- 172.21.15.6:0/407513671 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7ff0f006ace0 0x7ff0f006d190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:56.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.681+0000 7ff114b3e700 1 --2- 172.21.15.6:0/407513671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff11015d220 0x7ff1101f59c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:56.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.681+0000 7ff114b3e700 1 --2- 172.21.15.6:0/407513671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff11006c4c0 0x7ff1100b6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:56.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.681+0000 7ff114b3e700 1 --2- 172.21.15.6:0/407513671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff11015ce50 0x7ff1100b83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:56.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.681+0000 7ff114b3e700 1 -- 172.21.15.6:0/407513671 >> 172.21.15.6:0/407513671 conn(0x7ff1100d3880 msgr2=0x7ff1100d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:56.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.681+0000 7ff114b3e700 1 -- 172.21.15.6:0/407513671 shutdown_connections 2023-07-06T19:59:56.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.681+0000 7ff114b3e700 1 -- 172.21.15.6:0/407513671 wait complete. 2023-07-06T19:59:56.696 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T19:58:38.767727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T19:58:45.759808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T19:58:51.062712+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T19:58:52.130350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T19:58:55.785128+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T19:59:56.697 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T19:59:56.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.825+0000 7feb13d9f700 1 Processor -- start 2023-07-06T19:59:56.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.825+0000 7feb13d9f700 1 -- start start 2023-07-06T19:59:56.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.826+0000 7feb13d9f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7feb0c0cefe0 0x7feb0c0cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:56.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.826+0000 7feb13d9f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb0c0c9d70 con 0x7feb0c0cd630 2023-07-06T19:59:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.826+0000 7feb13d9f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb0c06bdf0 con 0x7feb0c0cb210 2023-07-06T19:59:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.826+0000 7feb13d9f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb0c0c9810 con 0x7feb0c0cefe0 2023-07-06T19:59:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.826+0000 7feb1133a700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7feb0c0cd630 0x7feb0c15c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33272/0 (socket says 172.21.15.6:33272) 2023-07-06T19:59:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.826+0000 7feb1133a700 1 -- 172.21.15.6:0/1923326074 learned_addr learned my addr 172.21.15.6:0/1923326074 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:56.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.826+0000 7feb11b3b700 1 --2- 172.21.15.6:0/1923326074 >> v2:172.21.15.40:3300/0 conn(0x7feb0c0cefe0 0x7feb0c0cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:56.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.826+0000 7feb10b39700 1 -- 172.21.15.6:0/1923326074 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1605295770 0 0) 0x7feb0c0c9d70 con 0x7feb0c0cd630 2023-07-06T19:59:56.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.826+0000 7feb10b39700 1 -- 172.21.15.6:0/1923326074 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaf80046c0 con 0x7feb0c0cd630 2023-07-06T19:59:56.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb10b39700 1 -- 172.21.15.6:0/1923326074 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1997134206 0 0) 0x7feaf80046c0 con 0x7feb0c0cd630 2023-07-06T19:59:56.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb10b39700 1 -- 172.21.15.6:0/1923326074 >> v2:172.21.15.40:3300/0 conn(0x7feb0c0cefe0 msgr2=0x7feb0c0cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:56.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb10b39700 1 --2- 172.21.15.6:0/1923326074 >> v2:172.21.15.40:3300/0 conn(0x7feb0c0cefe0 0x7feb0c0cf3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:56.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb10b39700 1 -- 172.21.15.6:0/1923326074 >> v1:172.21.15.40:6789/0 conn(0x7feb0c0cb210 legacy=0x7feb0c15cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:56.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb10b39700 1 -- 172.21.15.6:0/1923326074 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0c15d2f0 con 0x7feb0c0cd630 2023-07-06T19:59:56.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb10b39700 1 -- 172.21.15.6:0/1923326074 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7feafc001670 con 0x7feb0c0cd630 2023-07-06T19:59:56.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb10b39700 1 -- 172.21.15.6:0/1923326074 >> v1:172.21.15.6:6789/0 conn(0x7feb0c0cd630 legacy=0x7feb0c15c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:56.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb10b39700 1 --2- 172.21.15.6:0/1923326074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaf8004b10 0x7feaf8004f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:56.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb10b39700 1 --2- 172.21.15.6:0/1923326074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaf8005960 0x7feaf8005dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:56.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb10b39700 1 --2- 172.21.15.6:0/1923326074 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaf8006430 0x7feaf80034d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:56.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb10b39700 1 -- 172.21.15.6:0/1923326074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8003ce0 con 0x7feaf8004b10 2023-07-06T19:59:56.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb10b39700 1 -- 172.21.15.6:0/1923326074 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8003e50 con 0x7feaf8005960 2023-07-06T19:59:56.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb10b39700 1 -- 172.21.15.6:0/1923326074 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf8004010 con 0x7feaf8006430 2023-07-06T19:59:56.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb11b3b700 1 --2- 172.21.15.6:0/1923326074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaf8004b10 0x7feaf8004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:56.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb1233c700 1 --2- 172.21.15.6:0/1923326074 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaf8006430 0x7feaf80034d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:56.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb1133a700 1 --2- 172.21.15.6:0/1923326074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaf8005960 0x7feaf8005dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb11b3b700 1 -- 172.21.15.6:0/1923326074 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaf8006430 msgr2=0x7feaf80034d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb11b3b700 1 --2- 172.21.15.6:0/1923326074 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaf8006430 0x7feaf80034d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb11b3b700 1 -- 172.21.15.6:0/1923326074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaf8005960 msgr2=0x7feaf8005dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb11b3b700 1 --2- 172.21.15.6:0/1923326074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaf8005960 0x7feaf8005dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb11b3b700 1 -- 172.21.15.6:0/1923326074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf80046c0 con 0x7feaf8004b10 2023-07-06T19:59:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb1233c700 1 -- 172.21.15.6:0/1923326074 reap_dead start 2023-07-06T19:59:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb1133a700 1 --2- 172.21.15.6:0/1923326074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feaf8005960 0x7feaf8005dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb11b3b700 1 --2- 172.21.15.6:0/1923326074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaf8004b10 0x7feaf8004f20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7feb08009b60 tx=0x7feaf8006990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136f2d9882788d2b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.827+0000 7feb10b39700 1 -- 172.21.15.6:0/1923326074 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0800e6c0 con 0x7feaf8004b10 2023-07-06T19:59:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.828+0000 7feb10b39700 1 -- 172.21.15.6:0/1923326074 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0800e820 con 0x7feaf8004b10 2023-07-06T19:59:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.828+0000 7feb10b39700 1 -- 172.21.15.6:0/1923326074 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0800ebb0 con 0x7feaf8004b10 2023-07-06T19:59:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.828+0000 7feb13d9f700 1 -- 172.21.15.6:0/1923326074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaf8004b10 msgr2=0x7feaf8004f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.828+0000 7feb13d9f700 1 --2- 172.21.15.6:0/1923326074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaf8004b10 0x7feaf8004f20 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7feb08009b60 tx=0x7feaf8006990 comp rx=0 tx=0).stop 2023-07-06T19:59:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.828+0000 7feb13d9f700 1 -- 172.21.15.6:0/1923326074 shutdown_connections 2023-07-06T19:59:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.828+0000 7feb13d9f700 1 --2- 172.21.15.6:0/1923326074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaf8004b10 0x7feaf8004f20 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.828+0000 7feb13d9f700 1 -- 172.21.15.6:0/1923326074 >> 172.21.15.6:0/1923326074 conn(0x7feb0c0b0b60 msgr2=0x7feb0c0b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.828+0000 7feb13d9f700 1 -- 172.21.15.6:0/1923326074 shutdown_connections 2023-07-06T19:59:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.828+0000 7feb13d9f700 1 -- 172.21.15.6:0/1923326074 wait complete. 2023-07-06T19:59:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.829+0000 7feb13d9f700 1 Processor -- start 2023-07-06T19:59:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.829+0000 7feb13d9f700 1 -- start start 2023-07-06T19:59:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.830+0000 7feb13d9f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaf8004b10 0x7feb0c1f06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.830+0000 7feb13d9f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb0c0b2490 0x7feb0c0c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:56.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.830+0000 7feb13d9f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb0c0c51d0 0x7feb0c0c5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:56.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.830+0000 7feb13d9f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c153c00 con 0x7feb0c0b2490 2023-07-06T19:59:56.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.830+0000 7feb13d9f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c1f0c00 con 0x7feb0c0c51d0 2023-07-06T19:59:56.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.830+0000 7feb13d9f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c0c5b80 con 0x7feaf8004b10 2023-07-06T19:59:56.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.830+0000 7feb1133a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb0c0b2490 0x7feb0c0c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:56.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.830+0000 7feb1133a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb0c0b2490 0x7feb0c0c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60310/0 (socket says 172.21.15.6:60310) 2023-07-06T19:59:56.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.830+0000 7feb1133a700 1 -- 172.21.15.6:0/1163165340 learned_addr learned my addr 172.21.15.6:0/1163165340 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:56.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.830+0000 7feb11b3b700 1 --2- 172.21.15.6:0/1163165340 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaf8004b10 0x7feb0c1f06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:56.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.830+0000 7feb1233c700 1 --2- 172.21.15.6:0/1163165340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb0c0c51d0 0x7feb0c0c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:56.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.831+0000 7feb1133a700 1 -- 172.21.15.6:0/1163165340 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaf8004b10 msgr2=0x7feb0c1f06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:56.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.831+0000 7feb1133a700 1 --2- 172.21.15.6:0/1163165340 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaf8004b10 0x7feb0c1f06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:56.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.831+0000 7feb1133a700 1 -- 172.21.15.6:0/1163165340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb0c0c51d0 msgr2=0x7feb0c0c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:56.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.831+0000 7feb1133a700 1 --2- 172.21.15.6:0/1163165340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb0c0c51d0 0x7feb0c0c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:56.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.831+0000 7feb1133a700 1 -- 172.21.15.6:0/1163165340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0c156bd0 con 0x7feb0c0b2490 2023-07-06T19:59:56.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.831+0000 7feb1133a700 1 --2- 172.21.15.6:0/1163165340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb0c0b2490 0x7feb0c0c8a40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7feafc00e700 tx=0x7feafc00ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:56.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.831+0000 7feb027fc700 1 -- 172.21.15.6:0/1163165340 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc010510 con 0x7feb0c0b2490 2023-07-06T19:59:56.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.831+0000 7feb027fc700 1 -- 172.21.15.6:0/1163165340 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feafc010670 con 0x7feb0c0b2490 2023-07-06T19:59:56.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.831+0000 7feb027fc700 1 -- 172.21.15.6:0/1163165340 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc010a20 con 0x7feb0c0b2490 2023-07-06T19:59:56.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.831+0000 7feb13d9f700 1 -- 172.21.15.6:0/1163165340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0c155fc0 con 0x7feb0c0b2490 2023-07-06T19:59:56.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.831+0000 7feb13d9f700 1 -- 172.21.15.6:0/1163165340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb0c156580 con 0x7feb0c0b2490 2023-07-06T19:59:56.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.832+0000 7feb13d9f700 1 -- 172.21.15.6:0/1163165340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb0c156d60 con 0x7feb0c0b2490 2023-07-06T19:59:56.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.832+0000 7feb027fc700 1 -- 172.21.15.6:0/1163165340 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feafc010b80 con 0x7feb0c0b2490 2023-07-06T19:59:56.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.833+0000 7feb027fc700 1 --2- 172.21.15.6:0/1163165340 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7feaf006ace0 0x7feaf006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:56.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.833+0000 7feb027fc700 1 -- 172.21.15.6:0/1163165340 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7feafc088da0 con 0x7feb0c0b2490 2023-07-06T19:59:56.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.833+0000 7feb11b3b700 1 --2- 172.21.15.6:0/1163165340 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7feaf006ace0 0x7feaf006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:56.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.833+0000 7feb11b3b700 1 --2- 172.21.15.6:0/1163165340 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7feaf006ace0 0x7feaf006d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7feb080090b0 tx=0x7feb0801e040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:56.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:56.837+0000 7feb027fc700 1 -- 172.21.15.6:0/1163165340 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feafc053c60 con 0x7feb0c0b2490 2023-07-06T19:59:57.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.034+0000 7feb13d9f700 1 -- 172.21.15.6:0/1163165340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb0c04eb90 con 0x7feb0c0b2490 2023-07-06T19:59:57.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.034+0000 7feb027fc700 1 -- 172.21.15.6:0/1163165340 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7feafc019020 con 0x7feb0c0b2490 2023-07-06T19:59:57.037 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-06T19:59:57.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.036+0000 7feb13d9f700 1 -- 172.21.15.6:0/1163165340 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7feaf006ace0 msgr2=0x7feaf006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:57.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.036+0000 7feb13d9f700 1 --2- 172.21.15.6:0/1163165340 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7feaf006ace0 0x7feaf006d190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7feb080090b0 tx=0x7feb0801e040 comp rx=0 tx=0).stop 2023-07-06T19:59:57.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.036+0000 7feb13d9f700 1 -- 172.21.15.6:0/1163165340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb0c0b2490 msgr2=0x7feb0c0c8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:57.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.036+0000 7feb13d9f700 1 --2- 172.21.15.6:0/1163165340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb0c0b2490 0x7feb0c0c8a40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7feafc00e700 tx=0x7feafc00ea10 comp rx=0 tx=0).stop 2023-07-06T19:59:57.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.036+0000 7feb13d9f700 1 -- 172.21.15.6:0/1163165340 shutdown_connections 2023-07-06T19:59:57.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.036+0000 7feb13d9f700 1 --2- 172.21.15.6:0/1163165340 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7feaf006ace0 0x7feaf006d190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.036+0000 7feb13d9f700 1 --2- 172.21.15.6:0/1163165340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feb0c0c51d0 0x7feb0c0c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.036+0000 7feb13d9f700 1 --2- 172.21.15.6:0/1163165340 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7feaf8004b10 0x7feb0c1f06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.036+0000 7feb13d9f700 1 --2- 172.21.15.6:0/1163165340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb0c0b2490 0x7feb0c0c8a40 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.036+0000 7feb13d9f700 1 -- 172.21.15.6:0/1163165340 >> 172.21.15.6:0/1163165340 conn(0x7feb0c0b0b60 msgr2=0x7feb0c1543c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:57.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.036+0000 7feb13d9f700 1 -- 172.21.15.6:0/1163165340 shutdown_connections 2023-07-06T19:59:57.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.036+0000 7feb13d9f700 1 -- 172.21.15.6:0/1163165340 wait complete. 2023-07-06T19:59:57.054 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T19:59:57.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.180+0000 7fdf9b739700 1 Processor -- start 2023-07-06T19:59:57.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.180+0000 7fdf9b739700 1 -- start start 2023-07-06T19:59:57.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.182+0000 7fdf9b739700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdf94071da0 0x7fdf940cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:57.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.182+0000 7fdf9b739700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdf9415cd40 0x7fdf940cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:57.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.182+0000 7fdf9b739700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf9415d2b0 con 0x7fdf941592b0 2023-07-06T19:59:57.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.182+0000 7fdf9b739700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf94159680 con 0x7fdf94071da0 2023-07-06T19:59:57.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.182+0000 7fdf9b739700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf9415d590 con 0x7fdf9415cd40 2023-07-06T19:59:57.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.182+0000 7fdf98cd4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdf94071da0 0x7fdf940cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:57.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.182+0000 7fdf98cd4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdf94071da0 0x7fdf940cb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60318/0 (socket says 172.21.15.6:60318) 2023-07-06T19:59:57.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.182+0000 7fdf98cd4700 1 -- 172.21.15.6:0/1842535889 learned_addr learned my addr 172.21.15.6:0/1842535889 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:57.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.182+0000 7fdf99cd6700 1 --2- 172.21.15.6:0/1842535889 >> v2:172.21.15.40:3300/0 conn(0x7fdf9415cd40 0x7fdf940cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:57.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.182+0000 7fdf98cd4700 1 -- 172.21.15.6:0/1842535889 >> v2:172.21.15.40:3300/0 conn(0x7fdf9415cd40 msgr2=0x7fdf940cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:57.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.182+0000 7fdf98cd4700 1 --2- 172.21.15.6:0/1842535889 >> v2:172.21.15.40:3300/0 conn(0x7fdf9415cd40 0x7fdf940cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.182+0000 7fdf98cd4700 1 -- 172.21.15.6:0/1842535889 >> v1:172.21.15.40:6789/0 conn(0x7fdf941592b0 legacy=0x7fdf94071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:57.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.182+0000 7fdf98cd4700 1 -- 172.21.15.6:0/1842535889 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9415d870 con 0x7fdf94071da0 2023-07-06T19:59:57.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.182+0000 7fdf98cd4700 1 --2- 172.21.15.6:0/1842535889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf94071da0 0x7fdf940cb150 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdf9415de30 tx=0x7fdf90009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e1edab51f14159 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:57.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.182+0000 7fdf8bfff700 1 -- 172.21.15.6:0/1842535889 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9000b870 con 0x7fdf94071da0 2023-07-06T19:59:57.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.182+0000 7fdf8bfff700 1 -- 172.21.15.6:0/1842535889 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9000b9d0 con 0x7fdf94071da0 2023-07-06T19:59:57.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.182+0000 7fdf8bfff700 1 -- 172.21.15.6:0/1842535889 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9000bd60 con 0x7fdf94071da0 2023-07-06T19:59:57.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.183+0000 7fdf9b739700 1 -- 172.21.15.6:0/1842535889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf94071da0 msgr2=0x7fdf940cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:57.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.183+0000 7fdf9b739700 1 --2- 172.21.15.6:0/1842535889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf94071da0 0x7fdf940cb150 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdf9415de30 tx=0x7fdf90009bd0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.183+0000 7fdf9b739700 1 -- 172.21.15.6:0/1842535889 shutdown_connections 2023-07-06T19:59:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.183+0000 7fdf9b739700 1 --2- 172.21.15.6:0/1842535889 >> v2:172.21.15.40:3300/0 conn(0x7fdf9415cd40 0x7fdf940cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.183+0000 7fdf9b739700 1 --2- 172.21.15.6:0/1842535889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf94071da0 0x7fdf940cb150 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.183+0000 7fdf9b739700 1 -- 172.21.15.6:0/1842535889 >> 172.21.15.6:0/1842535889 conn(0x7fdf940cf960 msgr2=0x7fdf940cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.183+0000 7fdf9b739700 1 -- 172.21.15.6:0/1842535889 shutdown_connections 2023-07-06T19:59:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.183+0000 7fdf9b739700 1 -- 172.21.15.6:0/1842535889 wait complete. 2023-07-06T19:59:57.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.184+0000 7fdf9b739700 1 Processor -- start 2023-07-06T19:59:57.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.184+0000 7fdf9b739700 1 -- start start 2023-07-06T19:59:57.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.185+0000 7fdf9b739700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf94071da0 0x7fdf9415c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:57.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.185+0000 7fdf9b739700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf941592b0 0x7fdf94152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:57.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.185+0000 7fdf9b739700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf9415cd40 0x7fdf94157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:57.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.185+0000 7fdf9b739700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf94157bd0 con 0x7fdf9415cd40 2023-07-06T19:59:57.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.185+0000 7fdf9b739700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf94156f00 con 0x7fdf94071da0 2023-07-06T19:59:57.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.185+0000 7fdf9b739700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf94157230 con 0x7fdf941592b0 2023-07-06T19:59:57.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.185+0000 7fdf99cd6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf9415cd40 0x7fdf94157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:57.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.185+0000 7fdf99cd6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf9415cd40 0x7fdf94157ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60326/0 (socket says 172.21.15.6:60326) 2023-07-06T19:59:57.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.185+0000 7fdf99cd6700 1 -- 172.21.15.6:0/1042136179 learned_addr learned my addr 172.21.15.6:0/1042136179 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:57.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.185+0000 7fdf994d5700 1 --2- 172.21.15.6:0/1042136179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf94071da0 0x7fdf9415c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:57.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.186+0000 7fdf98cd4700 1 --2- 172.21.15.6:0/1042136179 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf941592b0 0x7fdf94152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:57.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.186+0000 7fdf99cd6700 1 -- 172.21.15.6:0/1042136179 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf941592b0 msgr2=0x7fdf94152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:57.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.186+0000 7fdf99cd6700 1 --2- 172.21.15.6:0/1042136179 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf941592b0 0x7fdf94152470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.186+0000 7fdf99cd6700 1 -- 172.21.15.6:0/1042136179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf94071da0 msgr2=0x7fdf9415c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:57.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.186+0000 7fdf99cd6700 1 --2- 172.21.15.6:0/1042136179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf94071da0 0x7fdf9415c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.186+0000 7fdf99cd6700 1 -- 172.21.15.6:0/1042136179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf90009550 con 0x7fdf9415cd40 2023-07-06T19:59:57.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.186+0000 7fdf99cd6700 1 --2- 172.21.15.6:0/1042136179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf9415cd40 0x7fdf94157ff0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c007e40 tx=0x7fdf8c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:57.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.186+0000 7fdf89ffb700 1 -- 172.21.15.6:0/1042136179 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c00eea0 con 0x7fdf9415cd40 2023-07-06T19:59:57.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.186+0000 7fdf89ffb700 1 -- 172.21.15.6:0/1042136179 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8c014420 con 0x7fdf9415cd40 2023-07-06T19:59:57.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.186+0000 7fdf9b739700 1 -- 172.21.15.6:0/1042136179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf94157510 con 0x7fdf9415cd40 2023-07-06T19:59:57.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.186+0000 7fdf89ffb700 1 -- 172.21.15.6:0/1042136179 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c0147b0 con 0x7fdf9415cd40 2023-07-06T19:59:57.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.186+0000 7fdf9b739700 1 -- 172.21.15.6:0/1042136179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf941529b0 con 0x7fdf9415cd40 2023-07-06T19:59:57.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.187+0000 7fdf9b739700 1 -- 172.21.15.6:0/1042136179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf94157d10 con 0x7fdf9415cd40 2023-07-06T19:59:57.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.188+0000 7fdf89ffb700 1 -- 172.21.15.6:0/1042136179 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdf8c014910 con 0x7fdf9415cd40 2023-07-06T19:59:57.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.188+0000 7fdf89ffb700 1 --2- 172.21.15.6:0/1042136179 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fdf7806ace0 0x7fdf7806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:57.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.188+0000 7fdf89ffb700 1 -- 172.21.15.6:0/1042136179 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdf8c089ff0 con 0x7fdf9415cd40 2023-07-06T19:59:57.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.188+0000 7fdf994d5700 1 --2- 172.21.15.6:0/1042136179 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fdf7806ace0 0x7fdf7806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:57.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.188+0000 7fdf994d5700 1 --2- 172.21.15.6:0/1042136179 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fdf7806ace0 0x7fdf7806d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdf84000f60 tx=0x7fdf84009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:57.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.192+0000 7fdf89ffb700 1 -- 172.21.15.6:0/1042136179 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdf94157d10 con 0x7fdf9415cd40 2023-07-06T19:59:57.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.390+0000 7fdf9b739700 1 -- 172.21.15.6:0/1042136179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdf94157d10 con 0x7fdf9415cd40 2023-07-06T19:59:57.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.390+0000 7fdf89ffb700 1 -- 172.21.15.6:0/1042136179 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdf94157d10 con 0x7fdf9415cd40 2023-07-06T19:59:57.393 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-06T19:59:57.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.392+0000 7fdf9b739700 1 -- 172.21.15.6:0/1042136179 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fdf7806ace0 msgr2=0x7fdf7806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:57.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.392+0000 7fdf9b739700 1 --2- 172.21.15.6:0/1042136179 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fdf7806ace0 0x7fdf7806d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdf84000f60 tx=0x7fdf84009040 comp rx=0 tx=0).stop 2023-07-06T19:59:57.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.392+0000 7fdf9b739700 1 -- 172.21.15.6:0/1042136179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf9415cd40 msgr2=0x7fdf94157ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:57.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.392+0000 7fdf9b739700 1 --2- 172.21.15.6:0/1042136179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf9415cd40 0x7fdf94157ff0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c007e40 tx=0x7fdf8c00e3c0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.392+0000 7fdf9b739700 1 -- 172.21.15.6:0/1042136179 shutdown_connections 2023-07-06T19:59:57.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.392+0000 7fdf9b739700 1 --2- 172.21.15.6:0/1042136179 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fdf7806ace0 0x7fdf7806d190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.392+0000 7fdf9b739700 1 --2- 172.21.15.6:0/1042136179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf9415cd40 0x7fdf94157ff0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.392+0000 7fdf9b739700 1 --2- 172.21.15.6:0/1042136179 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf94071da0 0x7fdf9415c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.392+0000 7fdf9b739700 1 --2- 172.21.15.6:0/1042136179 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdf941592b0 0x7fdf94152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.392+0000 7fdf9b739700 1 -- 172.21.15.6:0/1042136179 >> 172.21.15.6:0/1042136179 conn(0x7fdf940cf960 msgr2=0x7fdf940cb050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:57.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.392+0000 7fdf9b739700 1 -- 172.21.15.6:0/1042136179 shutdown_connections 2023-07-06T19:59:57.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.392+0000 7fdf9b739700 1 -- 172.21.15.6:0/1042136179 wait complete. 2023-07-06T19:59:57.406 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T19:59:57.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.532+0000 7f8d3ef92700 1 Processor -- start 2023-07-06T19:59:57.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.533+0000 7f8d3ef92700 1 -- start start 2023-07-06T19:59:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.534+0000 7f8d3ef92700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8d380d15e0 0x7f8d3806e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.534+0000 7f8d3ef92700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8d380ce860 0x7f8d380cece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.534+0000 7f8d3ef92700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d380cd300 con 0x7f8d3815a520 2023-07-06T19:59:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.534+0000 7f8d3ef92700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d380b0290 con 0x7f8d380d15e0 2023-07-06T19:59:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.534+0000 7f8d3ef92700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d380ccd80 con 0x7f8d380ce860 2023-07-06T19:59:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.534+0000 7f8d3d52f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8d380ce860 0x7f8d380cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.534+0000 7f8d37fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8d380d15e0 0x7f8d3806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:57.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.534+0000 7f8d3d52f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8d380ce860 0x7f8d380cece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:52978/0 (socket says 172.21.15.6:52978) 2023-07-06T19:59:57.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.534+0000 7f8d37fff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8d380d15e0 0x7f8d3806e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:39368/0 (socket says 172.21.15.6:39368) 2023-07-06T19:59:57.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.534+0000 7f8d3cd2e700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8d3815a520 0x7f8d3806dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:51410/0 (socket says 172.21.15.6:51410) 2023-07-06T19:59:57.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.534+0000 7f8d3d52f700 1 -- 172.21.15.6:0/2270451656 learned_addr learned my addr 172.21.15.6:0/2270451656 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:57.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.534+0000 7f8d3d52f700 1 -- 172.21.15.6:0/2270451656 >> v2:172.21.15.40:3300/0 conn(0x7f8d380d15e0 msgr2=0x7f8d3806e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:57.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.534+0000 7f8d3d52f700 1 --2- 172.21.15.6:0/2270451656 >> v2:172.21.15.40:3300/0 conn(0x7f8d380d15e0 0x7f8d3806e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.534+0000 7f8d3d52f700 1 -- 172.21.15.6:0/2270451656 >> v1:172.21.15.40:6789/0 conn(0x7f8d3815a520 legacy=0x7f8d3806dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:57.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.534+0000 7f8d3d52f700 1 -- 172.21.15.6:0/2270451656 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d380cd020 con 0x7f8d380ce860 2023-07-06T19:59:57.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.534+0000 7f8d3d52f700 1 --2- 172.21.15.6:0/2270451656 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8d380ce860 0x7f8d380cece0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009e50 tx=0x7f8d3000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ee6cc6be953b2c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.535+0000 7f8d377fe700 1 -- 172.21.15.6:0/2270451656 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3000e070 con 0x7f8d380ce860 2023-07-06T19:59:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.535+0000 7f8d377fe700 1 -- 172.21.15.6:0/2270451656 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3000b910 con 0x7f8d380ce860 2023-07-06T19:59:57.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.535+0000 7f8d377fe700 1 -- 172.21.15.6:0/2270451656 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3000bcc0 con 0x7f8d380ce860 2023-07-06T19:59:57.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.535+0000 7f8d3ef92700 1 -- 172.21.15.6:0/2270451656 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8d380ce860 msgr2=0x7f8d380cece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:57.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.535+0000 7f8d3ef92700 1 --2- 172.21.15.6:0/2270451656 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8d380ce860 0x7f8d380cece0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8d30009e50 tx=0x7f8d3000b330 comp rx=0 tx=0).stop 2023-07-06T19:59:57.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.535+0000 7f8d3ef92700 1 -- 172.21.15.6:0/2270451656 shutdown_connections 2023-07-06T19:59:57.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.535+0000 7f8d3ef92700 1 --2- 172.21.15.6:0/2270451656 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8d380ce860 0x7f8d380cece0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.535+0000 7f8d3ef92700 1 --2- 172.21.15.6:0/2270451656 >> v2:172.21.15.40:3300/0 conn(0x7f8d380d15e0 0x7f8d3806e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.535+0000 7f8d3ef92700 1 -- 172.21.15.6:0/2270451656 >> 172.21.15.6:0/2270451656 conn(0x7f8d380ce120 msgr2=0x7f8d380d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:57.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.535+0000 7f8d3ef92700 1 -- 172.21.15.6:0/2270451656 shutdown_connections 2023-07-06T19:59:57.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.535+0000 7f8d3ef92700 1 -- 172.21.15.6:0/2270451656 wait complete. 2023-07-06T19:59:57.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.536+0000 7f8d3ef92700 1 Processor -- start 2023-07-06T19:59:57.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.536+0000 7f8d3ef92700 1 -- start start 2023-07-06T19:59:57.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.537+0000 7f8d3ef92700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8d380ce860 0x7f8d38148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:57.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.537+0000 7f8d3ef92700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d380d15e0 0x7f8d380c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:57.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.537+0000 7f8d3ef92700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3815a520 0x7f8d380c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:57.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.537+0000 7f8d3ef92700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d380c5150 con 0x7f8d3815a520 2023-07-06T19:59:57.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.537+0000 7f8d3ef92700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d380b0770 con 0x7f8d380d15e0 2023-07-06T19:59:57.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.537+0000 7f8d3ef92700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d380c4580 con 0x7f8d380ce860 2023-07-06T19:59:57.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.537+0000 7f8d3d52f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3815a520 0x7f8d380c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:57.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.537+0000 7f8d3d52f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3815a520 0x7f8d380c6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60340/0 (socket says 172.21.15.6:60340) 2023-07-06T19:59:57.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.537+0000 7f8d3d52f700 1 -- 172.21.15.6:0/3181823952 learned_addr learned my addr 172.21.15.6:0/3181823952 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:57.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.538+0000 7f8d3cd2e700 1 --2- 172.21.15.6:0/3181823952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8d380ce860 0x7f8d38148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:57.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.538+0000 7f8d37fff700 1 --2- 172.21.15.6:0/3181823952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d380d15e0 0x7f8d380c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:57.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.538+0000 7f8d3d52f700 1 -- 172.21.15.6:0/3181823952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8d380ce860 msgr2=0x7f8d38148f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:57.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.538+0000 7f8d3d52f700 1 --2- 172.21.15.6:0/3181823952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8d380ce860 0x7f8d38148f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.538+0000 7f8d3d52f700 1 -- 172.21.15.6:0/3181823952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d380d15e0 msgr2=0x7f8d380c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:57.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.538+0000 7f8d3d52f700 1 --2- 172.21.15.6:0/3181823952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d380d15e0 0x7f8d380c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.538+0000 7f8d3d52f700 1 -- 172.21.15.6:0/3181823952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d30009b30 con 0x7f8d3815a520 2023-07-06T19:59:57.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.538+0000 7f8d37fff700 1 --2- 172.21.15.6:0/3181823952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d380d15e0 0x7f8d380c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:57.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.538+0000 7f8d3d52f700 1 --2- 172.21.15.6:0/3181823952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3815a520 0x7f8d380c6f40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8d380ccec0 tx=0x7f8d30004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:57.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.538+0000 7f8d357fa700 1 -- 172.21.15.6:0/3181823952 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d30004960 con 0x7f8d3815a520 2023-07-06T19:59:57.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.538+0000 7f8d357fa700 1 -- 172.21.15.6:0/3181823952 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d300099b0 con 0x7f8d3815a520 2023-07-06T19:59:57.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.538+0000 7f8d3ef92700 1 -- 172.21.15.6:0/3181823952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d380c4820 con 0x7f8d3815a520 2023-07-06T19:59:57.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.538+0000 7f8d357fa700 1 -- 172.21.15.6:0/3181823952 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3001c680 con 0x7f8d3815a520 2023-07-06T19:59:57.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.538+0000 7f8d3ef92700 1 -- 172.21.15.6:0/3181823952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d380c4de0 con 0x7f8d3815a520 2023-07-06T19:59:57.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.539+0000 7f8d3ef92700 1 -- 172.21.15.6:0/3181823952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d380c5300 con 0x7f8d3815a520 2023-07-06T19:59:57.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.540+0000 7f8d357fa700 1 -- 172.21.15.6:0/3181823952 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8d3001c7e0 con 0x7f8d3815a520 2023-07-06T19:59:57.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.540+0000 7f8d357fa700 1 --2- 172.21.15.6:0/3181823952 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f8d1c06ace0 0x7f8d1c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:57.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.540+0000 7f8d357fa700 1 -- 172.21.15.6:0/3181823952 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8d3008b450 con 0x7f8d3815a520 2023-07-06T19:59:57.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.540+0000 7f8d3cd2e700 1 --2- 172.21.15.6:0/3181823952 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f8d1c06ace0 0x7f8d1c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:57.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.540+0000 7f8d3cd2e700 1 --2- 172.21.15.6:0/3181823952 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f8d1c06ace0 0x7f8d1c06d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c000f60 tx=0x7f8d2c007d10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:57.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.544+0000 7f8d357fa700 1 -- 172.21.15.6:0/3181823952 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8d380c5300 con 0x7f8d3815a520 2023-07-06T19:59:57.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.741+0000 7f8d3ef92700 1 -- 172.21.15.6:0/3181823952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8d380cb180 con 0x7f8d3815a520 2023-07-06T19:59:57.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.741+0000 7f8d357fa700 1 -- 172.21.15.6:0/3181823952 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8d30056260 con 0x7f8d3815a520 2023-07-06T19:59:57.745 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T19:59:57.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.743+0000 7f8d3ef92700 1 -- 172.21.15.6:0/3181823952 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f8d1c06ace0 msgr2=0x7f8d1c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:57.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.743+0000 7f8d3ef92700 1 --2- 172.21.15.6:0/3181823952 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f8d1c06ace0 0x7f8d1c06d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c000f60 tx=0x7f8d2c007d10 comp rx=0 tx=0).stop 2023-07-06T19:59:57.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.743+0000 7f8d3ef92700 1 -- 172.21.15.6:0/3181823952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3815a520 msgr2=0x7f8d380c6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:57.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.743+0000 7f8d3ef92700 1 --2- 172.21.15.6:0/3181823952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3815a520 0x7f8d380c6f40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8d380ccec0 tx=0x7f8d30004ad0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.743+0000 7f8d3ef92700 1 -- 172.21.15.6:0/3181823952 shutdown_connections 2023-07-06T19:59:57.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.743+0000 7f8d3ef92700 1 --2- 172.21.15.6:0/3181823952 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f8d1c06ace0 0x7f8d1c06d190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.743+0000 7f8d3ef92700 1 --2- 172.21.15.6:0/3181823952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d3815a520 0x7f8d380c6f40 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.743+0000 7f8d3ef92700 1 --2- 172.21.15.6:0/3181823952 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8d380ce860 0x7f8d38148f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.743+0000 7f8d3ef92700 1 --2- 172.21.15.6:0/3181823952 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8d380d15e0 0x7f8d380c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.743+0000 7f8d3ef92700 1 -- 172.21.15.6:0/3181823952 >> 172.21.15.6:0/3181823952 conn(0x7f8d380ce120 msgr2=0x7f8d38155a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:57.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.743+0000 7f8d3ef92700 1 -- 172.21.15.6:0/3181823952 shutdown_connections 2023-07-06T19:59:57.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.743+0000 7f8d3ef92700 1 -- 172.21.15.6:0/3181823952 wait complete. 2023-07-06T19:59:57.762 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T19:59:57.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.891+0000 7fe56b144700 1 Processor -- start 2023-07-06T19:59:57.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.891+0000 7fe56b144700 1 -- start start 2023-07-06T19:59:57.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.892+0000 7fe56b144700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5641602c0 0x7fe5640b5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:57.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.892+0000 7fe56b144700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe5640b58b0 0x7fe56415d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:57.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.892+0000 7fe56b144700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5640b5e30 con 0x7fe5640b3c60 2023-07-06T19:59:57.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.892+0000 7fe56b144700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe56415d960 con 0x7fe5640b58b0 2023-07-06T19:59:57.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.892+0000 7fe56b144700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5640b6110 con 0x7fe5641602c0 2023-07-06T19:59:57.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.892+0000 7fe568ee0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5641602c0 0x7fe5640b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:57.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.892+0000 7fe5696e1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe5640b58b0 0x7fe56415d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:57.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.893+0000 7fe568ee0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5641602c0 0x7fe5640b5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:52988/0 (socket says 172.21.15.6:52988) 2023-07-06T19:59:57.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.893+0000 7fe563fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe5640b3c60 0x7fe5640cebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:51424/0 (socket says 172.21.15.6:51424) 2023-07-06T19:59:57.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.893+0000 7fe568ee0700 1 -- 172.21.15.6:0/981642118 learned_addr learned my addr 172.21.15.6:0/981642118 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:57.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.893+0000 7fe5696e1700 1 --2- 172.21.15.6:0/981642118 >> v2:172.21.15.40:3300/0 conn(0x7fe5640b58b0 0x7fe56415d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:39382/0 (socket says 172.21.15.6:39382) 2023-07-06T19:59:57.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.893+0000 7fe568ee0700 1 -- 172.21.15.6:0/981642118 >> v2:172.21.15.40:3300/0 conn(0x7fe5640b58b0 msgr2=0x7fe56415d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:57.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.893+0000 7fe568ee0700 1 --2- 172.21.15.6:0/981642118 >> v2:172.21.15.40:3300/0 conn(0x7fe5640b58b0 0x7fe56415d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.893+0000 7fe568ee0700 1 -- 172.21.15.6:0/981642118 >> v1:172.21.15.40:6789/0 conn(0x7fe5640b3c60 legacy=0x7fe5640cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:57.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.893+0000 7fe568ee0700 1 -- 172.21.15.6:0/981642118 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5640b63f0 con 0x7fe5641602c0 2023-07-06T19:59:57.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.893+0000 7fe5696e1700 1 --2- 172.21.15.6:0/981642118 >> v2:172.21.15.40:3300/0 conn(0x7fe5640b58b0 0x7fe56415d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T19:59:57.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.893+0000 7fe568ee0700 1 --2- 172.21.15.6:0/981642118 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5641602c0 0x7fe5640b5370 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe5580098f0 tx=0x7fe558009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f0985c55836656 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:57.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.893+0000 7fe5637fe700 1 -- 172.21.15.6:0/981642118 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe558011830 con 0x7fe5641602c0 2023-07-06T19:59:57.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.893+0000 7fe5637fe700 1 -- 172.21.15.6:0/981642118 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe558011990 con 0x7fe5641602c0 2023-07-06T19:59:57.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.893+0000 7fe5637fe700 1 -- 172.21.15.6:0/981642118 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe558011d20 con 0x7fe5641602c0 2023-07-06T19:59:57.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.894+0000 7fe56b144700 1 -- 172.21.15.6:0/981642118 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5641602c0 msgr2=0x7fe5640b5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:57.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.894+0000 7fe56b144700 1 --2- 172.21.15.6:0/981642118 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5641602c0 0x7fe5640b5370 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe5580098f0 tx=0x7fe558009c00 comp rx=0 tx=0).stop 2023-07-06T19:59:57.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.894+0000 7fe56b144700 1 -- 172.21.15.6:0/981642118 shutdown_connections 2023-07-06T19:59:57.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.894+0000 7fe56b144700 1 --2- 172.21.15.6:0/981642118 >> v2:172.21.15.40:3300/0 conn(0x7fe5640b58b0 0x7fe56415d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.894+0000 7fe56b144700 1 --2- 172.21.15.6:0/981642118 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5641602c0 0x7fe5640b5370 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.894+0000 7fe56b144700 1 -- 172.21.15.6:0/981642118 >> 172.21.15.6:0/981642118 conn(0x7fe5640ce120 msgr2=0x7fe5640d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:57.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.894+0000 7fe56b144700 1 -- 172.21.15.6:0/981642118 shutdown_connections 2023-07-06T19:59:57.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.894+0000 7fe56b144700 1 -- 172.21.15.6:0/981642118 wait complete. 2023-07-06T19:59:57.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.895+0000 7fe56b144700 1 Processor -- start 2023-07-06T19:59:57.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.895+0000 7fe56b144700 1 -- start start 2023-07-06T19:59:57.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.896+0000 7fe56b144700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5640b3c60 0x7fe5640c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:57.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.896+0000 7fe56b144700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5640b58b0 0x7fe5640ca870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:57.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.896+0000 7fe56b144700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5641602c0 0x7fe5641f5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:57.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.896+0000 7fe56b144700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5640c8d80 con 0x7fe5641602c0 2023-07-06T19:59:57.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.896+0000 7fe56b144700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5640c8100 con 0x7fe5640b3c60 2023-07-06T19:59:57.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.896+0000 7fe56b144700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5640c83e0 con 0x7fe5640b58b0 2023-07-06T19:59:57.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.896+0000 7fe5696e1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5641602c0 0x7fe5641f5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:57.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.896+0000 7fe5696e1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5641602c0 0x7fe5641f5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60352/0 (socket says 172.21.15.6:60352) 2023-07-06T19:59:57.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.896+0000 7fe5696e1700 1 -- 172.21.15.6:0/2830325250 learned_addr learned my addr 172.21.15.6:0/2830325250 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:57.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.897+0000 7fe563fff700 1 --2- 172.21.15.6:0/2830325250 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5640b58b0 0x7fe5640ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:57.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.897+0000 7fe568ee0700 1 --2- 172.21.15.6:0/2830325250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5640b3c60 0x7fe5640c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:57.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.897+0000 7fe5696e1700 1 -- 172.21.15.6:0/2830325250 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5640b58b0 msgr2=0x7fe5640ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:57.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.897+0000 7fe5696e1700 1 --2- 172.21.15.6:0/2830325250 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5640b58b0 0x7fe5640ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.897+0000 7fe5696e1700 1 -- 172.21.15.6:0/2830325250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5640b3c60 msgr2=0x7fe5640c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:57.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.897+0000 7fe5696e1700 1 --2- 172.21.15.6:0/2830325250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5640b3c60 0x7fe5640c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:57.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.897+0000 7fe5696e1700 1 -- 172.21.15.6:0/2830325250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c009a70 con 0x7fe5641602c0 2023-07-06T19:59:57.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.897+0000 7fe5696e1700 1 --2- 172.21.15.6:0/2830325250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5641602c0 0x7fe5641f5380 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00efc0 tx=0x7fe55c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:57.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.897+0000 7fe5617fa700 1 -- 172.21.15.6:0/2830325250 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c009d70 con 0x7fe5641602c0 2023-07-06T19:59:57.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.897+0000 7fe5617fa700 1 -- 172.21.15.6:0/2830325250 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55c00f040 con 0x7fe5641602c0 2023-07-06T19:59:57.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.897+0000 7fe56b144700 1 -- 172.21.15.6:0/2830325250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe558009550 con 0x7fe5641602c0 2023-07-06T19:59:57.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.897+0000 7fe5617fa700 1 -- 172.21.15.6:0/2830325250 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c00ce00 con 0x7fe5641602c0 2023-07-06T19:59:57.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.897+0000 7fe56b144700 1 -- 172.21.15.6:0/2830325250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5640c89a0 con 0x7fe5641602c0 2023-07-06T19:59:57.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.898+0000 7fe56b144700 1 -- 172.21.15.6:0/2830325250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe56404eb90 con 0x7fe5641602c0 2023-07-06T19:59:57.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.899+0000 7fe5617fa700 1 -- 172.21.15.6:0/2830325250 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe55c014480 con 0x7fe5641602c0 2023-07-06T19:59:57.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.899+0000 7fe5617fa700 1 --2- 172.21.15.6:0/2830325250 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe54806ace0 0x7fe54806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:57.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.899+0000 7fe5617fa700 1 -- 172.21.15.6:0/2830325250 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe55c089ed0 con 0x7fe5641602c0 2023-07-06T19:59:57.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.899+0000 7fe568ee0700 1 --2- 172.21.15.6:0/2830325250 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe54806ace0 0x7fe54806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:57.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.900+0000 7fe568ee0700 1 --2- 172.21.15.6:0/2830325250 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe54806ace0 0x7fe54806d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe558000c00 tx=0x7fe558008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:57.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:57.903+0000 7fe5617fa700 1 -- 172.21.15.6:0/2830325250 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe55c054ce0 con 0x7fe5641602c0 2023-07-06T19:59:58.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.102+0000 7fe56b144700 1 -- 172.21.15.6:0/2830325250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe5640ce6c0 con 0x7fe5641602c0 2023-07-06T19:59:58.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.103+0000 7fe5617fa700 1 -- 172.21.15.6:0/2830325250 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe55c058300 con 0x7fe5641602c0 2023-07-06T19:59:58.105 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-06T19:59:58.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.105+0000 7fe56b144700 1 -- 172.21.15.6:0/2830325250 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe54806ace0 msgr2=0x7fe54806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:58.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.105+0000 7fe56b144700 1 --2- 172.21.15.6:0/2830325250 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe54806ace0 0x7fe54806d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe558000c00 tx=0x7fe558008030 comp rx=0 tx=0).stop 2023-07-06T19:59:58.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.105+0000 7fe56b144700 1 -- 172.21.15.6:0/2830325250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5641602c0 msgr2=0x7fe5641f5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:58.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.105+0000 7fe56b144700 1 --2- 172.21.15.6:0/2830325250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5641602c0 0x7fe5641f5380 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00efc0 tx=0x7fe55c00c3a0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.105+0000 7fe56b144700 1 -- 172.21.15.6:0/2830325250 shutdown_connections 2023-07-06T19:59:58.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.105+0000 7fe56b144700 1 --2- 172.21.15.6:0/2830325250 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe54806ace0 0x7fe54806d190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.105+0000 7fe56b144700 1 --2- 172.21.15.6:0/2830325250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5641602c0 0x7fe5641f5380 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.105+0000 7fe56b144700 1 --2- 172.21.15.6:0/2830325250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5640b3c60 0x7fe5640c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.105+0000 7fe56b144700 1 --2- 172.21.15.6:0/2830325250 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe5640b58b0 0x7fe5640ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.105+0000 7fe56b144700 1 -- 172.21.15.6:0/2830325250 >> 172.21.15.6:0/2830325250 conn(0x7fe5640ce120 msgr2=0x7fe56415f400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:58.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.105+0000 7fe56b144700 1 -- 172.21.15.6:0/2830325250 shutdown_connections 2023-07-06T19:59:58.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.105+0000 7fe56b144700 1 -- 172.21.15.6:0/2830325250 wait complete. 2023-07-06T19:59:58.119 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T19:59:58.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.249+0000 7f6cafb71700 1 Processor -- start 2023-07-06T19:59:58.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.250+0000 7f6cafb71700 1 -- start start 2023-07-06T19:59:58.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.250+0000 7f6cafb71700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ca80b4940 0x7f6ca806a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:58.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.250+0000 7f6cafb71700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ca815e930 0x7f6ca80cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:58.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.250+0000 7f6cafb71700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6ca80cf520 0x7f6ca80cba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:58.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.250+0000 7f6cafb71700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca80cf9a0 con 0x7f6ca815e930 2023-07-06T19:59:58.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.250+0000 7f6cafb71700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca806a840 con 0x7f6ca80cf520 2023-07-06T19:59:58.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.250+0000 7f6cafb71700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca806a5a0 con 0x7f6ca80b4940 2023-07-06T19:59:58.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.250+0000 7f6cad10c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ca815e930 0x7f6ca80cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:58.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.251+0000 7f6cad10c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6ca815e930 0x7f6ca80cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60358/0 (socket says 172.21.15.6:60358) 2023-07-06T19:59:58.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.251+0000 7f6cad10c700 1 -- 172.21.15.6:0/2490232708 learned_addr learned my addr 172.21.15.6:0/2490232708 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:58.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.251+0000 7f6cad90d700 1 --2- 172.21.15.6:0/2490232708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ca80b4940 0x7f6ca806a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:58.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.251+0000 7f6cae10e700 1 --2- 172.21.15.6:0/2490232708 >> v2:172.21.15.40:3300/0 conn(0x7f6ca80cf520 0x7f6ca80cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:58.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.251+0000 7f6cad10c700 1 -- 172.21.15.6:0/2490232708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ca80b4940 msgr2=0x7f6ca806a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:58.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.251+0000 7f6cad10c700 1 --2- 172.21.15.6:0/2490232708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ca80b4940 0x7f6ca806a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.251+0000 7f6cad10c700 1 -- 172.21.15.6:0/2490232708 >> v2:172.21.15.40:3300/0 conn(0x7f6ca80cf520 msgr2=0x7f6ca80cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:58.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.251+0000 7f6cad10c700 1 --2- 172.21.15.6:0/2490232708 >> v2:172.21.15.40:3300/0 conn(0x7f6ca80cf520 0x7f6ca80cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.251+0000 7f6cad10c700 1 -- 172.21.15.6:0/2490232708 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca815b700 con 0x7f6ca815e930 2023-07-06T19:59:58.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.251+0000 7f6cae10e700 1 --2- 172.21.15.6:0/2490232708 >> v2:172.21.15.40:3300/0 conn(0x7f6ca80cf520 0x7f6ca80cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.251+0000 7f6cad10c700 1 --2- 172.21.15.6:0/2490232708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ca815e930 0x7f6ca80cefe0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80d0150 tx=0x7f6c98009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96404d99d64ea22e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:58.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.251+0000 7f6cac90b700 1 -- 172.21.15.6:0/2490232708 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98011830 con 0x7f6ca815e930 2023-07-06T19:59:58.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.251+0000 7f6cac90b700 1 -- 172.21.15.6:0/2490232708 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c98011990 con 0x7f6ca815e930 2023-07-06T19:59:58.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.251+0000 7f6cac90b700 1 -- 172.21.15.6:0/2490232708 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98011d20 con 0x7f6ca815e930 2023-07-06T19:59:58.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.252+0000 7f6cafb71700 1 -- 172.21.15.6:0/2490232708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ca815e930 msgr2=0x7f6ca80cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:58.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.252+0000 7f6cafb71700 1 --2- 172.21.15.6:0/2490232708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ca815e930 0x7f6ca80cefe0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6ca80d0150 tx=0x7f6c98009bd0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.252+0000 7f6cafb71700 1 -- 172.21.15.6:0/2490232708 shutdown_connections 2023-07-06T19:59:58.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.252+0000 7f6cafb71700 1 --2- 172.21.15.6:0/2490232708 >> v2:172.21.15.40:3300/0 conn(0x7f6ca80cf520 0x7f6ca80cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.252+0000 7f6cafb71700 1 --2- 172.21.15.6:0/2490232708 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ca80b4940 0x7f6ca806a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.252+0000 7f6cafb71700 1 --2- 172.21.15.6:0/2490232708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ca815e930 0x7f6ca80cefe0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.252+0000 7f6cafb71700 1 -- 172.21.15.6:0/2490232708 >> 172.21.15.6:0/2490232708 conn(0x7f6ca80b0b60 msgr2=0x7f6ca80b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:58.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.252+0000 7f6cafb71700 1 -- 172.21.15.6:0/2490232708 shutdown_connections 2023-07-06T19:59:58.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.252+0000 7f6cafb71700 1 -- 172.21.15.6:0/2490232708 wait complete. 2023-07-06T19:59:58.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.253+0000 7f6cafb71700 1 Processor -- start 2023-07-06T19:59:58.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.253+0000 7f6cafb71700 1 -- start start 2023-07-06T19:59:58.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.254+0000 7f6cafb71700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ca80b4940 0x7f6ca80c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:58.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.254+0000 7f6cafb71700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ca80cf520 0x7f6ca80b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:58.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.254+0000 7f6cafb71700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ca815e930 0x7f6ca815da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:58.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.254+0000 7f6cafb71700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca8157e40 con 0x7f6ca80cf520 2023-07-06T19:59:58.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.254+0000 7f6cafb71700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca8157510 con 0x7f6ca80b4940 2023-07-06T19:59:58.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.254+0000 7f6cafb71700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca81577f0 con 0x7f6ca815e930 2023-07-06T19:59:58.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.254+0000 7f6cad10c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ca80cf520 0x7f6ca80b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:58.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.254+0000 7f6cad10c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ca80cf520 0x7f6ca80b33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60364/0 (socket says 172.21.15.6:60364) 2023-07-06T19:59:58.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.254+0000 7f6cad10c700 1 -- 172.21.15.6:0/719128427 learned_addr learned my addr 172.21.15.6:0/719128427 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:58.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.254+0000 7f6cad90d700 1 --2- 172.21.15.6:0/719128427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ca80b4940 0x7f6ca80c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:58.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.254+0000 7f6cae10e700 1 --2- 172.21.15.6:0/719128427 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ca815e930 0x7f6ca815da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:58.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.254+0000 7f6cad10c700 1 -- 172.21.15.6:0/719128427 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ca815e930 msgr2=0x7f6ca815da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:58.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.254+0000 7f6cad10c700 1 --2- 172.21.15.6:0/719128427 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ca815e930 0x7f6ca815da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.254+0000 7f6cad10c700 1 -- 172.21.15.6:0/719128427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ca80b4940 msgr2=0x7f6ca80c4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:58.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.254+0000 7f6cad10c700 1 --2- 172.21.15.6:0/719128427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ca80b4940 0x7f6ca80c4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.254+0000 7f6cad10c700 1 -- 172.21.15.6:0/719128427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c98009550 con 0x7f6ca80cf520 2023-07-06T19:59:58.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.254+0000 7f6cae10e700 1 --2- 172.21.15.6:0/719128427 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ca815e930 0x7f6ca815da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:58.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.254+0000 7f6cad10c700 1 --2- 172.21.15.6:0/719128427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ca80cf520 0x7f6ca80b33a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6c98000c00 tx=0x7f6c98004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:58.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.255+0000 7f6c9e7fc700 1 -- 172.21.15.6:0/719128427 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98004590 con 0x7f6ca80cf520 2023-07-06T19:59:58.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.255+0000 7f6c9e7fc700 1 -- 172.21.15.6:0/719128427 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c980036a0 con 0x7f6ca80cf520 2023-07-06T19:59:58.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.255+0000 7f6cafb71700 1 -- 172.21.15.6:0/719128427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca8157ad0 con 0x7f6ca80cf520 2023-07-06T19:59:58.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.255+0000 7f6c9e7fc700 1 -- 172.21.15.6:0/719128427 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98003a50 con 0x7f6ca80cf520 2023-07-06T19:59:58.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.255+0000 7f6cafb71700 1 -- 172.21.15.6:0/719128427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca80c5290 con 0x7f6ca80cf520 2023-07-06T19:59:58.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.256+0000 7f6cafb71700 1 -- 172.21.15.6:0/719128427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca8157fb0 con 0x7f6ca80cf520 2023-07-06T19:59:58.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.256+0000 7f6c9e7fc700 1 -- 172.21.15.6:0/719128427 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6c98003bb0 con 0x7f6ca80cf520 2023-07-06T19:59:58.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.256+0000 7f6c9e7fc700 1 --2- 172.21.15.6:0/719128427 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f6c8c06ace0 0x7f6c8c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:58.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.257+0000 7f6c9e7fc700 1 -- 172.21.15.6:0/719128427 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6c9808a800 con 0x7f6ca80cf520 2023-07-06T19:59:58.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.257+0000 7f6cad90d700 1 --2- 172.21.15.6:0/719128427 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f6c8c06ace0 0x7f6c8c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:58.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.257+0000 7f6cad90d700 1 --2- 172.21.15.6:0/719128427 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f6c8c06ace0 0x7f6c8c06d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0011340 tx=0x7f6ca000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:58.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.261+0000 7f6c9e7fc700 1 -- 172.21.15.6:0/719128427 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6c98055610 con 0x7f6ca80cf520 2023-07-06T19:59:58.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.464+0000 7f6cafb71700 1 -- 172.21.15.6:0/719128427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6ca804eb90 con 0x7f6ca80cf520 2023-07-06T19:59:58.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.464+0000 7f6c9e7fc700 1 -- 172.21.15.6:0/719128427 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6c98003e60 con 0x7f6ca80cf520 2023-07-06T19:59:58.467 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T19:59:58.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.466+0000 7f6cafb71700 1 -- 172.21.15.6:0/719128427 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f6c8c06ace0 msgr2=0x7f6c8c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:58.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.466+0000 7f6cafb71700 1 --2- 172.21.15.6:0/719128427 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f6c8c06ace0 0x7f6c8c06d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0011340 tx=0x7f6ca000b040 comp rx=0 tx=0).stop 2023-07-06T19:59:58.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.466+0000 7f6cafb71700 1 -- 172.21.15.6:0/719128427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ca80cf520 msgr2=0x7f6ca80b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:58.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.466+0000 7f6cafb71700 1 --2- 172.21.15.6:0/719128427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ca80cf520 0x7f6ca80b33a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6c98000c00 tx=0x7f6c98004750 comp rx=0 tx=0).stop 2023-07-06T19:59:58.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.466+0000 7f6cafb71700 1 -- 172.21.15.6:0/719128427 shutdown_connections 2023-07-06T19:59:58.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.466+0000 7f6cafb71700 1 --2- 172.21.15.6:0/719128427 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f6c8c06ace0 0x7f6c8c06d190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.466+0000 7f6cafb71700 1 --2- 172.21.15.6:0/719128427 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f6ca815e930 0x7f6ca815da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.466+0000 7f6cafb71700 1 --2- 172.21.15.6:0/719128427 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ca80b4940 0x7f6ca80c4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.466+0000 7f6cafb71700 1 --2- 172.21.15.6:0/719128427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ca80cf520 0x7f6ca80b33a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.466+0000 7f6cafb71700 1 -- 172.21.15.6:0/719128427 >> 172.21.15.6:0/719128427 conn(0x7f6ca80b0b60 msgr2=0x7f6ca80b0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:58.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.466+0000 7f6cafb71700 1 -- 172.21.15.6:0/719128427 shutdown_connections 2023-07-06T19:59:58.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.466+0000 7f6cafb71700 1 -- 172.21.15.6:0/719128427 wait complete. 2023-07-06T19:59:58.488 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T19:59:58.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.617+0000 7fe75842c700 1 Processor -- start 2023-07-06T19:59:58.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.617+0000 7fe75842c700 1 -- start start 2023-07-06T19:59:58.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.618+0000 7fe75842c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7501592b0 0x7fe750071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:58.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.618+0000 7fe75842c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe75015cd40 0x7fe750071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:58.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.618+0000 7fe75842c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7500cc160 con 0x7fe7500cd950 2023-07-06T19:59:58.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.618+0000 7fe75842c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe750159680 con 0x7fe75015cd40 2023-07-06T19:59:58.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.618+0000 7fe75842c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe75015d2b0 con 0x7fe7501592b0 2023-07-06T19:59:58.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.619+0000 7fe7559c7700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe75015cd40 0x7fe750071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:58.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.619+0000 7fe7561c8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7501592b0 0x7fe750071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:58.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.619+0000 7fe7569c9700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe7500cd950 0x7fe75006d8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:51454/0 (socket says 172.21.15.6:51454) 2023-07-06T19:59:58.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.619+0000 7fe7569c9700 1 -- 172.21.15.6:0/2294480168 learned_addr learned my addr 172.21.15.6:0/2294480168 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:58.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.619+0000 7fe7551c6700 1 -- 172.21.15.6:0/2294480168 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637545036 0 0) 0x7fe7500cc160 con 0x7fe7500cd950 2023-07-06T19:59:58.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.619+0000 7fe7551c6700 1 -- 172.21.15.6:0/2294480168 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe73c0035b0 con 0x7fe7500cd950 2023-07-06T19:59:58.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.619+0000 7fe7561c8700 1 -- 172.21.15.6:0/2294480168 >> v2:172.21.15.40:3300/0 conn(0x7fe75015cd40 msgr2=0x7fe750071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:58.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.619+0000 7fe7561c8700 1 --2- 172.21.15.6:0/2294480168 >> v2:172.21.15.40:3300/0 conn(0x7fe75015cd40 0x7fe750071bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.619+0000 7fe7561c8700 1 -- 172.21.15.6:0/2294480168 >> v1:172.21.15.40:6789/0 conn(0x7fe7500cd950 legacy=0x7fe75006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:58.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.619+0000 7fe7561c8700 1 -- 172.21.15.6:0/2294480168 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75015d590 con 0x7fe7501592b0 2023-07-06T19:59:58.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.619+0000 7fe7561c8700 1 --2- 172.21.15.6:0/2294480168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7501592b0 0x7fe750071690 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe740009840 tx=0x7fe740009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddab078d18510b45 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:58.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.619+0000 7fe7551c6700 1 -- 172.21.15.6:0/2294480168 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe740011830 con 0x7fe7501592b0 2023-07-06T19:59:58.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.619+0000 7fe7551c6700 1 -- 172.21.15.6:0/2294480168 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe740011990 con 0x7fe7501592b0 2023-07-06T19:59:58.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.619+0000 7fe7551c6700 1 -- 172.21.15.6:0/2294480168 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe740011d20 con 0x7fe7501592b0 2023-07-06T19:59:58.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.620+0000 7fe75842c700 1 -- 172.21.15.6:0/2294480168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7501592b0 msgr2=0x7fe750071690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:58.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.620+0000 7fe75842c700 1 --2- 172.21.15.6:0/2294480168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7501592b0 0x7fe750071690 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe740009840 tx=0x7fe740009b50 comp rx=0 tx=0).stop 2023-07-06T19:59:58.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.620+0000 7fe75842c700 1 -- 172.21.15.6:0/2294480168 shutdown_connections 2023-07-06T19:59:58.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.620+0000 7fe75842c700 1 --2- 172.21.15.6:0/2294480168 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7501592b0 0x7fe750071690 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.620+0000 7fe75842c700 1 --2- 172.21.15.6:0/2294480168 >> v2:172.21.15.40:3300/0 conn(0x7fe75015cd40 0x7fe750071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.620+0000 7fe75842c700 1 -- 172.21.15.6:0/2294480168 >> 172.21.15.6:0/2294480168 conn(0x7fe7500cf960 msgr2=0x7fe7500cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:58.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.620+0000 7fe75842c700 1 -- 172.21.15.6:0/2294480168 shutdown_connections 2023-07-06T19:59:58.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.620+0000 7fe75842c700 1 -- 172.21.15.6:0/2294480168 wait complete. 2023-07-06T19:59:58.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.621+0000 7fe75842c700 1 Processor -- start 2023-07-06T19:59:58.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.621+0000 7fe75842c700 1 -- start start 2023-07-06T19:59:58.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.622+0000 7fe75842c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7500cd950 0x7fe750147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:58.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.622+0000 7fe75842c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7501592b0 0x7fe75015b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:58.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.622+0000 7fe75842c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe75015cd40 0x7fe75015bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:58.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.622+0000 7fe75842c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75015b830 con 0x7fe7500cd950 2023-07-06T19:59:58.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.622+0000 7fe75842c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7500b0580 con 0x7fe75015cd40 2023-07-06T19:59:58.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.622+0000 7fe75842c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7500b00f0 con 0x7fe7501592b0 2023-07-06T19:59:58.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.622+0000 7fe7561c8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7500cd950 0x7fe750147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:58.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.622+0000 7fe7561c8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7500cd950 0x7fe750147190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60376/0 (socket says 172.21.15.6:60376) 2023-07-06T19:59:58.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.622+0000 7fe7561c8700 1 -- 172.21.15.6:0/3029801700 learned_addr learned my addr 172.21.15.6:0/3029801700 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:58.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.622+0000 7fe7559c7700 1 --2- 172.21.15.6:0/3029801700 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7501592b0 0x7fe75015b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:58.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.622+0000 7fe7569c9700 1 --2- 172.21.15.6:0/3029801700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe75015cd40 0x7fe75015bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:58.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.622+0000 7fe7561c8700 1 -- 172.21.15.6:0/3029801700 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7501592b0 msgr2=0x7fe75015b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:58.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.622+0000 7fe7561c8700 1 --2- 172.21.15.6:0/3029801700 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7501592b0 0x7fe75015b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.623+0000 7fe7561c8700 1 -- 172.21.15.6:0/3029801700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe75015cd40 msgr2=0x7fe75015bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:58.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.623+0000 7fe7561c8700 1 --2- 172.21.15.6:0/3029801700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe75015cd40 0x7fe75015bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.623+0000 7fe7561c8700 1 -- 172.21.15.6:0/3029801700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7400094a0 con 0x7fe7500cd950 2023-07-06T19:59:58.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.623+0000 7fe7569c9700 1 --2- 172.21.15.6:0/3029801700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe75015cd40 0x7fe75015bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:58.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.623+0000 7fe7561c8700 1 --2- 172.21.15.6:0/3029801700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7500cd950 0x7fe750147190 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe7400090b0 tx=0x7fe740004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:58.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.623+0000 7fe746ffd700 1 -- 172.21.15.6:0/3029801700 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7400036a0 con 0x7fe7500cd950 2023-07-06T19:59:58.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.623+0000 7fe746ffd700 1 -- 172.21.15.6:0/3029801700 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74001e070 con 0x7fe7500cd950 2023-07-06T19:59:58.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.623+0000 7fe75842c700 1 -- 172.21.15.6:0/3029801700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7500af200 con 0x7fe7500cd950 2023-07-06T19:59:58.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.623+0000 7fe746ffd700 1 -- 172.21.15.6:0/3029801700 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe740003a60 con 0x7fe7500cd950 2023-07-06T19:59:58.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.623+0000 7fe75842c700 1 -- 172.21.15.6:0/3029801700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7500af7c0 con 0x7fe7500cd950 2023-07-06T19:59:58.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.624+0000 7fe75842c700 1 -- 172.21.15.6:0/3029801700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe75004eb90 con 0x7fe7500cd950 2023-07-06T19:59:58.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.624+0000 7fe746ffd700 1 -- 172.21.15.6:0/3029801700 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe740003bc0 con 0x7fe7500cd950 2023-07-06T19:59:58.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.625+0000 7fe746ffd700 1 --2- 172.21.15.6:0/3029801700 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe73406ace0 0x7fe73406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:58.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.625+0000 7fe746ffd700 1 -- 172.21.15.6:0/3029801700 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe74008a780 con 0x7fe7500cd950 2023-07-06T19:59:58.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.625+0000 7fe7559c7700 1 --2- 172.21.15.6:0/3029801700 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe73406ace0 0x7fe73406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:58.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.625+0000 7fe7559c7700 1 --2- 172.21.15.6:0/3029801700 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe73406ace0 0x7fe73406d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe750148dc0 tx=0x7fe74c00b420 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:58.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.629+0000 7fe746ffd700 1 -- 172.21.15.6:0/3029801700 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe7400554f0 con 0x7fe7500cd950 2023-07-06T19:59:58.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.843+0000 7fe75842c700 1 -- 172.21.15.6:0/3029801700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe75015b9d0 con 0x7fe7500cd950 2023-07-06T19:59:58.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.844+0000 7fe746ffd700 1 -- 172.21.15.6:0/3029801700 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe740058b10 con 0x7fe7500cd950 2023-07-06T19:59:58.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.845+0000 7fe75842c700 1 -- 172.21.15.6:0/3029801700 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe73406ace0 msgr2=0x7fe73406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:58.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.846+0000 7fe75842c700 1 --2- 172.21.15.6:0/3029801700 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe73406ace0 0x7fe73406d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe750148dc0 tx=0x7fe74c00b420 comp rx=0 tx=0).stop 2023-07-06T19:59:58.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.846+0000 7fe75842c700 1 -- 172.21.15.6:0/3029801700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7500cd950 msgr2=0x7fe750147190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:58.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.846+0000 7fe75842c700 1 --2- 172.21.15.6:0/3029801700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7500cd950 0x7fe750147190 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe7400090b0 tx=0x7fe740004750 comp rx=0 tx=0).stop 2023-07-06T19:59:58.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.846+0000 7fe75842c700 1 -- 172.21.15.6:0/3029801700 shutdown_connections 2023-07-06T19:59:58.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.846+0000 7fe75842c700 1 --2- 172.21.15.6:0/3029801700 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe73406ace0 0x7fe73406d190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.846+0000 7fe75842c700 1 --2- 172.21.15.6:0/3029801700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7500cd950 0x7fe750147190 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.846+0000 7fe75842c700 1 --2- 172.21.15.6:0/3029801700 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe75015cd40 0x7fe75015bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.846+0000 7fe75842c700 1 --2- 172.21.15.6:0/3029801700 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe7501592b0 0x7fe75015b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:58.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.846+0000 7fe75842c700 1 -- 172.21.15.6:0/3029801700 >> 172.21.15.6:0/3029801700 conn(0x7fe7500cf960 msgr2=0x7fe75006bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:58.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.846+0000 7fe75842c700 1 -- 172.21.15.6:0/3029801700 shutdown_connections 2023-07-06T19:59:58.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:58.846+0000 7fe75842c700 1 -- 172.21.15.6:0/3029801700 wait complete. 2023-07-06T19:59:58.857 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-07-06T19:59:58.860 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-07-06T19:59:58.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:58.862 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-07-06T19:59:58.911 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-07-06T19:59:58.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T19:59:58.914 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-06T19:59:58.973 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:59:58.973 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T19:59:58.995 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:59:58.996 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T19:59:59.057 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-06T19:59:59.057 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T19:59:59.120 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T19:59:59.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.249+0000 7f18ace5e700 1 Processor -- start 2023-07-06T19:59:59.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.249+0000 7f18ace5e700 1 -- start start 2023-07-06T19:59:59.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.250+0000 7f18ace5e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f18a80ceab0 0x7f18a80caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:59.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.250+0000 7f18ace5e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18a80cee80 0x7f18a80716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:59.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.250+0000 7f18ace5e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a8160ff0 con 0x7f18a8071c00 2023-07-06T19:59:59.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.250+0000 7f18ace5e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a80cb400 con 0x7f18a80cee80 2023-07-06T19:59:59.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.250+0000 7f18ace5e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a8072020 con 0x7f18a80ceab0 2023-07-06T19:59:59.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.250+0000 7f18a5d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18a80cee80 0x7f18a80716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:59.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.250+0000 7f18a6d9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f18a8071c00 0x7f18a81602c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33360/0 (socket says 172.21.15.6:33360) 2023-07-06T19:59:59.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.250+0000 7f18a6d9d700 1 -- 172.21.15.6:0/2139583328 learned_addr learned my addr 172.21.15.6:0/2139583328 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:59.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.250+0000 7f18a5d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18a80cee80 0x7f18a80716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60384/0 (socket says 172.21.15.6:60384) 2023-07-06T19:59:59.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.251+0000 7f18a5d9b700 1 -- 172.21.15.6:0/2139583328 >> v2:172.21.15.40:3300/0 conn(0x7f18a80ceab0 msgr2=0x7f18a80caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:59.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.251+0000 7f18a5d9b700 1 --2- 172.21.15.6:0/2139583328 >> v2:172.21.15.40:3300/0 conn(0x7f18a80ceab0 0x7f18a80caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:59.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.251+0000 7f18a5d9b700 1 -- 172.21.15.6:0/2139583328 >> v1:172.21.15.6:6789/0 conn(0x7f18a8071c00 legacy=0x7f18a81602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:59.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.251+0000 7f18a5d9b700 1 -- 172.21.15.6:0/2139583328 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a80ca100 con 0x7f18a80cee80 2023-07-06T19:59:59.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.251+0000 7f18a559a700 1 -- 172.21.15.6:0/2139583328 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4045410884 0 0) 0x7f18a8160ff0 con 0x7f18a8071c00 2023-07-06T19:59:59.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.251+0000 7f18a5d9b700 1 --2- 172.21.15.6:0/2139583328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a80cee80 0x7f18a80716c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f18a80731c0 tx=0x7f1898009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7be612ac9010a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:59.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.251+0000 7f18a559a700 1 -- 172.21.15.6:0/2139583328 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898011830 con 0x7f18a80cee80 2023-07-06T19:59:59.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.251+0000 7f18a559a700 1 -- 172.21.15.6:0/2139583328 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1898011990 con 0x7f18a80cee80 2023-07-06T19:59:59.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.251+0000 7f18a559a700 1 -- 172.21.15.6:0/2139583328 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898011d20 con 0x7f18a80cee80 2023-07-06T19:59:59.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.251+0000 7f18ace5e700 1 -- 172.21.15.6:0/2139583328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a80cee80 msgr2=0x7f18a80716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:59.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.251+0000 7f18ace5e700 1 --2- 172.21.15.6:0/2139583328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a80cee80 0x7f18a80716c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f18a80731c0 tx=0x7f1898009b20 comp rx=0 tx=0).stop 2023-07-06T19:59:59.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.251+0000 7f18ace5e700 1 -- 172.21.15.6:0/2139583328 shutdown_connections 2023-07-06T19:59:59.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.251+0000 7f18ace5e700 1 --2- 172.21.15.6:0/2139583328 >> v2:172.21.15.40:3300/0 conn(0x7f18a80ceab0 0x7f18a80caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:59.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.251+0000 7f18ace5e700 1 --2- 172.21.15.6:0/2139583328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a80cee80 0x7f18a80716c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:59.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.251+0000 7f18ace5e700 1 -- 172.21.15.6:0/2139583328 >> 172.21.15.6:0/2139583328 conn(0x7f18a80cc420 msgr2=0x7f18a80cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:59.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.252+0000 7f18ace5e700 1 -- 172.21.15.6:0/2139583328 shutdown_connections 2023-07-06T19:59:59.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.252+0000 7f18ace5e700 1 -- 172.21.15.6:0/2139583328 wait complete. 2023-07-06T19:59:59.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.253+0000 7f18ace5e700 1 Processor -- start 2023-07-06T19:59:59.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.253+0000 7f18ace5e700 1 -- start start 2023-07-06T19:59:59.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.254+0000 7f18ace5e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a8071c00 0x7f18a8155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:59.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.254+0000 7f18ace5e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18a80ceab0 0x7f18a81f2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:59.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.254+0000 7f18ace5e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18a80cee80 0x7f18a815fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:59.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.254+0000 7f18ace5e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a815b100 con 0x7f18a8071c00 2023-07-06T19:59:59.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.254+0000 7f18ace5e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a815b3a0 con 0x7f18a80ceab0 2023-07-06T19:59:59.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.254+0000 7f18ace5e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a815b680 con 0x7f18a80cee80 2023-07-06T19:59:59.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.254+0000 7f18a659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a8071c00 0x7f18a8155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:59.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.254+0000 7f18a659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a8071c00 0x7f18a8155430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60388/0 (socket says 172.21.15.6:60388) 2023-07-06T19:59:59.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.254+0000 7f18a659c700 1 -- 172.21.15.6:0/2969818550 learned_addr learned my addr 172.21.15.6:0/2969818550 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:59.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.254+0000 7f18a5d9b700 1 --2- 172.21.15.6:0/2969818550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18a80ceab0 0x7f18a81f2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:59.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.254+0000 7f18a6d9d700 1 --2- 172.21.15.6:0/2969818550 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18a80cee80 0x7f18a815fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:59.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.254+0000 7f18a659c700 1 -- 172.21.15.6:0/2969818550 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18a80cee80 msgr2=0x7f18a815fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:59.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.254+0000 7f18a659c700 1 --2- 172.21.15.6:0/2969818550 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18a80cee80 0x7f18a815fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:59.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.254+0000 7f18a659c700 1 -- 172.21.15.6:0/2969818550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18a80ceab0 msgr2=0x7f18a81f2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:59.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.254+0000 7f18a659c700 1 --2- 172.21.15.6:0/2969818550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18a80ceab0 0x7f18a81f2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:59.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.254+0000 7f18a659c700 1 -- 172.21.15.6:0/2969818550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18980094a0 con 0x7f18a8071c00 2023-07-06T19:59:59.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.254+0000 7f18a5d9b700 1 --2- 172.21.15.6:0/2969818550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18a80ceab0 0x7f18a81f2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:59.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.254+0000 7f18a6d9d700 1 --2- 172.21.15.6:0/2969818550 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18a80cee80 0x7f18a815fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T19:59:59.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.254+0000 7f18a659c700 1 --2- 172.21.15.6:0/2969818550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a8071c00 0x7f18a8155430 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f189c00b530 tx=0x7f189c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:59.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.254+0000 7f1896ffd700 1 -- 172.21.15.6:0/2969818550 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c011830 con 0x7f18a8071c00 2023-07-06T19:59:59.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.254+0000 7f1896ffd700 1 -- 172.21.15.6:0/2969818550 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189c0119b0 con 0x7f18a8071c00 2023-07-06T19:59:59.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.255+0000 7f1896ffd700 1 -- 172.21.15.6:0/2969818550 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c011d60 con 0x7f18a8071c00 2023-07-06T19:59:59.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.255+0000 7f18ace5e700 1 -- 172.21.15.6:0/2969818550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a815b960 con 0x7f18a8071c00 2023-07-06T19:59:59.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.255+0000 7f18ace5e700 1 -- 172.21.15.6:0/2969818550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a815bf20 con 0x7f18a8071c00 2023-07-06T19:59:59.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.255+0000 7f18ace5e700 1 -- 172.21.15.6:0/2969818550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a815c110 con 0x7f18a8071c00 2023-07-06T19:59:59.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.256+0000 7f1896ffd700 1 -- 172.21.15.6:0/2969818550 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f189c01a400 con 0x7f18a8071c00 2023-07-06T19:59:59.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.256+0000 7f1896ffd700 1 --2- 172.21.15.6:0/2969818550 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f188806ace0 0x7f188806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:59.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.256+0000 7f1896ffd700 1 -- 172.21.15.6:0/2969818550 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f189c089910 con 0x7f18a8071c00 2023-07-06T19:59:59.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.257+0000 7f18a5d9b700 1 --2- 172.21.15.6:0/2969818550 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f188806ace0 0x7f188806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:59.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.257+0000 7f18a5d9b700 1 --2- 172.21.15.6:0/2969818550 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f188806ace0 0x7f188806d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1898009b60 tx=0x7f1898008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:59.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.261+0000 7f1896ffd700 1 -- 172.21.15.6:0/2969818550 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f189c054610 con 0x7f18a8071c00 2023-07-06T19:59:59.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.458+0000 7f18ace5e700 1 -- 172.21.15.6:0/2969818550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18a80b5920 con 0x7f18a8071c00 2023-07-06T19:59:59.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.460+0000 7f1896ffd700 1 -- 172.21.15.6:0/2969818550 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20059 (secure 0 0 0) 0x7f189c057c30 con 0x7f18a8071c00 2023-07-06T19:59:59.466 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T19:59:59.467 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":29,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:59:33.917851+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T19:58:51.062712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T19:58:52.130350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T19:58:55.785128+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T19:59:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.462+0000 7f18ace5e700 1 -- 172.21.15.6:0/2969818550 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f188806ace0 msgr2=0x7f188806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.462+0000 7f18ace5e700 1 --2- 172.21.15.6:0/2969818550 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f188806ace0 0x7f188806d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1898009b60 tx=0x7f1898008030 comp rx=0 tx=0).stop 2023-07-06T19:59:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.462+0000 7f18ace5e700 1 -- 172.21.15.6:0/2969818550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a8071c00 msgr2=0x7f18a8155430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.462+0000 7f18ace5e700 1 --2- 172.21.15.6:0/2969818550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a8071c00 0x7f18a8155430 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f189c00b530 tx=0x7f189c00b8f0 comp rx=0 tx=0).stop 2023-07-06T19:59:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.462+0000 7f18ace5e700 1 -- 172.21.15.6:0/2969818550 shutdown_connections 2023-07-06T19:59:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.462+0000 7f18ace5e700 1 --2- 172.21.15.6:0/2969818550 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f188806ace0 0x7f188806d190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:59.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.462+0000 7f18ace5e700 1 --2- 172.21.15.6:0/2969818550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a8071c00 0x7f18a8155430 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:59.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.462+0000 7f18ace5e700 1 --2- 172.21.15.6:0/2969818550 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18a80cee80 0x7f18a815fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:59.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.462+0000 7f18ace5e700 1 --2- 172.21.15.6:0/2969818550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18a80ceab0 0x7f18a81f2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:59.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.462+0000 7f18ace5e700 1 -- 172.21.15.6:0/2969818550 >> 172.21.15.6:0/2969818550 conn(0x7f18a80cc420 msgr2=0x7f18a806d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:59.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.462+0000 7f18ace5e700 1 -- 172.21.15.6:0/2969818550 shutdown_connections 2023-07-06T19:59:59.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.462+0000 7f18ace5e700 1 -- 172.21.15.6:0/2969818550 wait complete. 2023-07-06T19:59:59.480 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T19:58:38.767727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T19:58:45.759808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T19:58:51.062712+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T19:58:52.130350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T19:58:55.785128+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T19:59:59.482 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T19:59:59.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.609+0000 7fde75583700 1 Processor -- start 2023-07-06T19:59:59.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.610+0000 7fde75583700 1 -- start start 2023-07-06T19:59:59.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.610+0000 7fde75583700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fde700cf870 0x7fde70165200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:59.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.610+0000 7fde75583700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde700cd300 con 0x7fde7015a520 2023-07-06T19:59:59.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.610+0000 7fde75583700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde700b0290 con 0x7fde700d15e0 2023-07-06T19:59:59.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.610+0000 7fde75583700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7006ea30 con 0x7fde700cf870 2023-07-06T19:59:59.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.610+0000 7fde6f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fde700cf870 0x7fde70165200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:59.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.610+0000 7fde6effd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fde7015a520 0x7fde7006dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33372/0 (socket says 172.21.15.6:33372) 2023-07-06T19:59:59.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.610+0000 7fde6effd700 1 -- 172.21.15.6:0/1481969135 learned_addr learned my addr 172.21.15.6:0/1481969135 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:59.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.611+0000 7fde6f7fe700 1 -- 172.21.15.6:0/1481969135 >> v1:172.21.15.40:6789/0 conn(0x7fde700d15e0 legacy=0x7fde7006e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:59.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.611+0000 7fde6f7fe700 1 -- 172.21.15.6:0/1481969135 >> v1:172.21.15.6:6789/0 conn(0x7fde7015a520 legacy=0x7fde7006dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:59.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.611+0000 7fde6f7fe700 1 -- 172.21.15.6:0/1481969135 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde700ccd80 con 0x7fde700cf870 2023-07-06T19:59:59.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.611+0000 7fde6dffb700 1 -- 172.21.15.6:0/1481969135 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427025207 0 0) 0x7fde700cd300 con 0x7fde7015a520 2023-07-06T19:59:59.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.611+0000 7fde6f7fe700 1 --2- 172.21.15.6:0/1481969135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde700cf870 0x7fde70165200 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fde68009d90 tx=0x7fde6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=595df34468a5c191 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:59.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.611+0000 7fde6dffb700 1 -- 172.21.15.6:0/1481969135 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6800e070 con 0x7fde700cf870 2023-07-06T19:59:59.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.611+0000 7fde6dffb700 1 -- 172.21.15.6:0/1481969135 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6800bbd0 con 0x7fde700cf870 2023-07-06T19:59:59.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.611+0000 7fde6dffb700 1 -- 172.21.15.6:0/1481969135 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde68012430 con 0x7fde700cf870 2023-07-06T19:59:59.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.612+0000 7fde75583700 1 -- 172.21.15.6:0/1481969135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde700cf870 msgr2=0x7fde70165200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:59.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.612+0000 7fde75583700 1 --2- 172.21.15.6:0/1481969135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde700cf870 0x7fde70165200 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fde68009d90 tx=0x7fde6800b330 comp rx=0 tx=0).stop 2023-07-06T19:59:59.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.612+0000 7fde75583700 1 -- 172.21.15.6:0/1481969135 shutdown_connections 2023-07-06T19:59:59.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.612+0000 7fde75583700 1 --2- 172.21.15.6:0/1481969135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde700cf870 0x7fde70165200 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:59.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.612+0000 7fde75583700 1 -- 172.21.15.6:0/1481969135 >> 172.21.15.6:0/1481969135 conn(0x7fde700ce120 msgr2=0x7fde700d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:59.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.612+0000 7fde75583700 1 -- 172.21.15.6:0/1481969135 shutdown_connections 2023-07-06T19:59:59.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.612+0000 7fde75583700 1 -- 172.21.15.6:0/1481969135 wait complete. 2023-07-06T19:59:59.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.613+0000 7fde75583700 1 Processor -- start 2023-07-06T19:59:59.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.613+0000 7fde75583700 1 -- start start 2023-07-06T19:59:59.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.614+0000 7fde75583700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde700cf870 0x7fde7015cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.614+0000 7fde75583700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde700d15e0 0x7fde700c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.614+0000 7fde75583700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde7015a520 0x7fde700c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.614+0000 7fde75583700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7006cbd0 con 0x7fde700cf870 2023-07-06T19:59:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.614+0000 7fde75583700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde700b54e0 con 0x7fde700d15e0 2023-07-06T19:59:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.614+0000 7fde75583700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde700b57c0 con 0x7fde7015a520 2023-07-06T19:59:59.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.614+0000 7fde6effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde700cf870 0x7fde7015cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:59.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.614+0000 7fde6effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde700cf870 0x7fde7015cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60402/0 (socket says 172.21.15.6:60402) 2023-07-06T19:59:59.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.614+0000 7fde6effd700 1 -- 172.21.15.6:0/860474931 learned_addr learned my addr 172.21.15.6:0/860474931 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:59.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.614+0000 7fde6f7fe700 1 --2- 172.21.15.6:0/860474931 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde7015a520 0x7fde700c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:59.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.614+0000 7fde6e7fc700 1 --2- 172.21.15.6:0/860474931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde700d15e0 0x7fde700c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:59.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.614+0000 7fde6effd700 1 -- 172.21.15.6:0/860474931 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde7015a520 msgr2=0x7fde700c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:59.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.614+0000 7fde6effd700 1 --2- 172.21.15.6:0/860474931 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde7015a520 0x7fde700c95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:59.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.614+0000 7fde6effd700 1 -- 172.21.15.6:0/860474931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde700d15e0 msgr2=0x7fde700c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:59.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.614+0000 7fde6effd700 1 --2- 172.21.15.6:0/860474931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde700d15e0 0x7fde700c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:59.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.614+0000 7fde6effd700 1 -- 172.21.15.6:0/860474931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde68009a70 con 0x7fde700cf870 2023-07-06T19:59:59.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.614+0000 7fde6f7fe700 1 --2- 172.21.15.6:0/860474931 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde7015a520 0x7fde700c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:59.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.614+0000 7fde6e7fc700 1 --2- 172.21.15.6:0/860474931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde700d15e0 0x7fde700c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T19:59:59.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.614+0000 7fde6effd700 1 --2- 172.21.15.6:0/860474931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde700cf870 0x7fde7015cb60 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fde6400c520 tx=0x7fde6400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:59.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.615+0000 7fde577fe700 1 -- 172.21.15.6:0/860474931 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde64004c80 con 0x7fde700cf870 2023-07-06T19:59:59.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.615+0000 7fde577fe700 1 -- 172.21.15.6:0/860474931 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde64004e00 con 0x7fde700cf870 2023-07-06T19:59:59.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.615+0000 7fde577fe700 1 -- 172.21.15.6:0/860474931 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde64007310 con 0x7fde700cf870 2023-07-06T19:59:59.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.615+0000 7fde75583700 1 -- 172.21.15.6:0/860474931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde700b5aa0 con 0x7fde700cf870 2023-07-06T19:59:59.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.615+0000 7fde75583700 1 -- 172.21.15.6:0/860474931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde700b6060 con 0x7fde700cf870 2023-07-06T19:59:59.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.616+0000 7fde75583700 1 -- 172.21.15.6:0/860474931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde700b6250 con 0x7fde700cf870 2023-07-06T19:59:59.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.616+0000 7fde577fe700 1 -- 172.21.15.6:0/860474931 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fde64007470 con 0x7fde700cf870 2023-07-06T19:59:59.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.616+0000 7fde577fe700 1 --2- 172.21.15.6:0/860474931 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fde5c06ace0 0x7fde5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:59.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.617+0000 7fde577fe700 1 -- 172.21.15.6:0/860474931 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fde64089540 con 0x7fde700cf870 2023-07-06T19:59:59.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.617+0000 7fde6e7fc700 1 --2- 172.21.15.6:0/860474931 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fde5c06ace0 0x7fde5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:59.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.617+0000 7fde6e7fc700 1 --2- 172.21.15.6:0/860474931 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fde5c06ace0 0x7fde5c06d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fde700af500 tx=0x7fde60009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:59.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.621+0000 7fde577fe700 1 -- 172.21.15.6:0/860474931 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fde640542b0 con 0x7fde700cf870 2023-07-06T19:59:59.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.817+0000 7fde75583700 1 -- 172.21.15.6:0/860474931 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fde7004eb90 con 0x7fde700cf870 2023-07-06T19:59:59.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.817+0000 7fde577fe700 1 -- 172.21.15.6:0/860474931 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fde640578d0 con 0x7fde700cf870 2023-07-06T19:59:59.820 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-06T19:59:59.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.819+0000 7fde75583700 1 -- 172.21.15.6:0/860474931 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fde5c06ace0 msgr2=0x7fde5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:59.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.819+0000 7fde75583700 1 --2- 172.21.15.6:0/860474931 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fde5c06ace0 0x7fde5c06d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fde700af500 tx=0x7fde60009040 comp rx=0 tx=0).stop 2023-07-06T19:59:59.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.819+0000 7fde75583700 1 -- 172.21.15.6:0/860474931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde700cf870 msgr2=0x7fde7015cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:59.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.819+0000 7fde75583700 1 --2- 172.21.15.6:0/860474931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde700cf870 0x7fde7015cb60 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fde6400c520 tx=0x7fde6400c8e0 comp rx=0 tx=0).stop 2023-07-06T19:59:59.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.819+0000 7fde75583700 1 -- 172.21.15.6:0/860474931 shutdown_connections 2023-07-06T19:59:59.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.819+0000 7fde75583700 1 --2- 172.21.15.6:0/860474931 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fde5c06ace0 0x7fde5c06d190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:59.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.819+0000 7fde75583700 1 --2- 172.21.15.6:0/860474931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde700cf870 0x7fde7015cb60 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:59.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.819+0000 7fde75583700 1 --2- 172.21.15.6:0/860474931 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fde7015a520 0x7fde700c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:59.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.819+0000 7fde75583700 1 --2- 172.21.15.6:0/860474931 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde700d15e0 0x7fde700c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:59.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.819+0000 7fde75583700 1 -- 172.21.15.6:0/860474931 >> 172.21.15.6:0/860474931 conn(0x7fde700ce120 msgr2=0x7fde70156380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:59.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.819+0000 7fde75583700 1 -- 172.21.15.6:0/860474931 shutdown_connections 2023-07-06T19:59:59.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.819+0000 7fde75583700 1 -- 172.21.15.6:0/860474931 wait complete. 2023-07-06T19:59:59.836 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T19:59:59.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.962+0000 7f9a034da700 1 Processor -- start 2023-07-06T19:59:59.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.963+0000 7f9a034da700 1 -- start start 2023-07-06T19:59:59.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.963+0000 7f9a034da700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99fc0ca850 0x7f99fc15bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:59.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.963+0000 7f9a034da700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99fc0cb310 con 0x7f99fc071900 2023-07-06T19:59:59.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.963+0000 7f9a034da700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99fc0af070 con 0x7f99fc071cd0 2023-07-06T19:59:59.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.963+0000 7f9a034da700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc0cdbf0 con 0x7f99fc0ca850 2023-07-06T19:59:59.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.963+0000 7f9a01276700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f99fc071900 0x7f99fc0ca140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33386/0 (socket says 172.21.15.6:33386) 2023-07-06T19:59:59.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.963+0000 7f9a01276700 1 -- 172.21.15.6:0/2001449355 learned_addr learned my addr 172.21.15.6:0/2001449355 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T19:59:59.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.964+0000 7f99effff700 1 -- 172.21.15.6:0/2001449355 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3655378751 0 0) 0x7f99fc0cb310 con 0x7f99fc071900 2023-07-06T19:59:59.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.964+0000 7f9a00a75700 1 --2- 172.21.15.6:0/2001449355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99fc0ca850 0x7f99fc15bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:59.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.964+0000 7f99effff700 1 -- 172.21.15.6:0/2001449355 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99e80035b0 con 0x7f99fc071900 2023-07-06T19:59:59.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.964+0000 7f99effff700 1 -- 172.21.15.6:0/2001449355 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3506540927 0 0) 0x7f99e80035b0 con 0x7f99fc071900 2023-07-06T19:59:59.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.964+0000 7f99effff700 1 -- 172.21.15.6:0/2001449355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99fc0ca850 msgr2=0x7f99fc15bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:59.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.964+0000 7f99effff700 1 --2- 172.21.15.6:0/2001449355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99fc0ca850 0x7f99fc15bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:59.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.964+0000 7f99effff700 1 -- 172.21.15.6:0/2001449355 >> v1:172.21.15.40:6789/0 conn(0x7f99fc071cd0 legacy=0x7f99fc0ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:59.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.964+0000 7f99effff700 1 -- 172.21.15.6:0/2001449355 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc0cad50 con 0x7f99fc071900 2023-07-06T19:59:59.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.964+0000 7f99effff700 1 -- 172.21.15.6:0/2001449355 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f99f0001670 con 0x7f99fc071900 2023-07-06T19:59:59.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.964+0000 7f99effff700 1 -- 172.21.15.6:0/2001449355 >> v1:172.21.15.6:6789/0 conn(0x7f99fc071900 legacy=0x7f99fc0ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:59.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.964+0000 7f99effff700 1 --2- 172.21.15.6:0/2001449355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99e8003a30 0x7f99e8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:59.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.964+0000 7f99effff700 1 --2- 172.21.15.6:0/2001449355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99fc0ca850 0x7f99e8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:59.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.964+0000 7f99effff700 1 --2- 172.21.15.6:0/2001449355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e8004d90 0x7f99e8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:59.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.964+0000 7f99effff700 1 -- 172.21.15.6:0/2001449355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc0cdbf0 con 0x7f99e8004d90 2023-07-06T19:59:59.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.964+0000 7f99effff700 1 -- 172.21.15.6:0/2001449355 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e800bbd0 con 0x7f99e8003a30 2023-07-06T19:59:59.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.964+0000 7f99effff700 1 -- 172.21.15.6:0/2001449355 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e800bd90 con 0x7f99fc0ca850 2023-07-06T19:59:59.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.964+0000 7f9a01a77700 1 --2- 172.21.15.6:0/2001449355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e8004d90 0x7f99e8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:59.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.964+0000 7f9a00a75700 1 --2- 172.21.15.6:0/2001449355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99fc0ca850 0x7f99e8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:59.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.964+0000 7f9a01276700 1 --2- 172.21.15.6:0/2001449355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99e8003a30 0x7f99e8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:59.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.965+0000 7f9a01a77700 1 -- 172.21.15.6:0/2001449355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99fc0ca850 msgr2=0x7f99e8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:59.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.965+0000 7f9a01a77700 1 --2- 172.21.15.6:0/2001449355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99fc0ca850 0x7f99e8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:59.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.965+0000 7f9a01a77700 1 -- 172.21.15.6:0/2001449355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99e8003a30 msgr2=0x7f99e8003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T19:59:59.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.965+0000 7f9a01a77700 1 --2- 172.21.15.6:0/2001449355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99e8003a30 0x7f99e8003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:59.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.965+0000 7f9a01a77700 1 -- 172.21.15.6:0/2001449355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e80035b0 con 0x7f99e8004d90 2023-07-06T19:59:59.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.965+0000 7f9a01a77700 1 --2- 172.21.15.6:0/2001449355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e8004d90 0x7f99e8005200 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f99f400c160 tx=0x7f99e8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916cda7cbd473e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:59.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.965+0000 7f99effff700 1 -- 172.21.15.6:0/2001449355 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f4001db0 con 0x7f99e8004d90 2023-07-06T19:59:59.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.965+0000 7f99effff700 1 -- 172.21.15.6:0/2001449355 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f400cca0 con 0x7f99e8004d90 2023-07-06T19:59:59.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.965+0000 7f99effff700 1 -- 172.21.15.6:0/2001449355 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f4003c40 con 0x7f99e8004d90 2023-07-06T19:59:59.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.965+0000 7f9a034da700 1 -- 172.21.15.6:0/2001449355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e8004d90 msgr2=0x7f99e8005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:59.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.965+0000 7f9a034da700 1 --2- 172.21.15.6:0/2001449355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99e8004d90 0x7f99e8005200 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f99f400c160 tx=0x7f99e8005880 comp rx=0 tx=0).stop 2023-07-06T19:59:59.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.965+0000 7f9a01a77700 1 -- 172.21.15.6:0/2001449355 reap_dead start 2023-07-06T19:59:59.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.965+0000 7f9a034da700 1 -- 172.21.15.6:0/2001449355 shutdown_connections 2023-07-06T19:59:59.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.965+0000 7f9a034da700 1 -- 172.21.15.6:0/2001449355 >> 172.21.15.6:0/2001449355 conn(0x7f99fc0cf960 msgr2=0x7f99fc0cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T19:59:59.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.966+0000 7f9a034da700 1 -- 172.21.15.6:0/2001449355 shutdown_connections 2023-07-06T19:59:59.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.966+0000 7f9a034da700 1 -- 172.21.15.6:0/2001449355 wait complete. 2023-07-06T19:59:59.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.967+0000 7f9a034da700 1 Processor -- start 2023-07-06T19:59:59.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.967+0000 7f9a034da700 1 -- start start 2023-07-06T19:59:59.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.967+0000 7f9a034da700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99e8004d90 0x7f99fc151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:59.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.967+0000 7f9a034da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99fc0af230 0x7f99fc0ada90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:59.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.967+0000 7f9a034da700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99fc15d750 0x7f99fc0adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:59.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.967+0000 7f9a034da700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc152440 con 0x7f99fc0af230 2023-07-06T19:59:59.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.967+0000 7f9a034da700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc0af7a0 con 0x7f99e8004d90 2023-07-06T19:59:59.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.967+0000 7f9a034da700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc0afa80 con 0x7f99fc15d750 2023-07-06T19:59:59.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.968+0000 7f9a00a75700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99fc0af230 0x7f99fc0ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:59.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.968+0000 7f9a00a75700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99fc0af230 0x7f99fc0ada90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60424/0 (socket says 172.21.15.6:60424) 2023-07-06T19:59:59.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.968+0000 7f9a00a75700 1 -- 172.21.15.6:0/3119390053 learned_addr learned my addr 172.21.15.6:0/3119390053 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T19:59:59.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.968+0000 7f9a01276700 1 --2- 172.21.15.6:0/3119390053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99e8004d90 0x7f99fc151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.968+0000 7f9a01a77700 1 --2- 172.21.15.6:0/3119390053 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99fc15d750 0x7f99fc0adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.968+0000 7f9a00a75700 1 -- 172.21.15.6:0/3119390053 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99fc15d750 msgr2=0x7f99fc0adfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.968+0000 7f9a00a75700 1 --2- 172.21.15.6:0/3119390053 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99fc15d750 0x7f99fc0adfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.968+0000 7f9a00a75700 1 -- 172.21.15.6:0/3119390053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99e8004d90 msgr2=0x7f99fc151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T19:59:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.968+0000 7f9a00a75700 1 --2- 172.21.15.6:0/3119390053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99e8004d90 0x7f99fc151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T19:59:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.968+0000 7f9a00a75700 1 -- 172.21.15.6:0/3119390053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc0afd60 con 0x7f99fc0af230 2023-07-06T19:59:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.968+0000 7f9a00a75700 1 --2- 172.21.15.6:0/3119390053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99fc0af230 0x7f99fc0ada90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f99f80119c0 tx=0x7f99f8011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:59.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.968+0000 7f99edffb700 1 -- 172.21.15.6:0/3119390053 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8011e60 con 0x7f99fc0af230 2023-07-06T19:59:59.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.968+0000 7f99edffb700 1 -- 172.21.15.6:0/3119390053 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f8004240 con 0x7f99fc0af230 2023-07-06T19:59:59.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.968+0000 7f9a034da700 1 -- 172.21.15.6:0/3119390053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99fc0b0040 con 0x7f99fc0af230 2023-07-06T19:59:59.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.968+0000 7f99edffb700 1 -- 172.21.15.6:0/3119390053 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f800f730 con 0x7f99fc0af230 2023-07-06T19:59:59.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.968+0000 7f9a034da700 1 -- 172.21.15.6:0/3119390053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99fc0b0d30 con 0x7f99fc0af230 2023-07-06T19:59:59.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.969+0000 7f9a034da700 1 -- 172.21.15.6:0/3119390053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99fc1f2380 con 0x7f99fc0af230 2023-07-06T19:59:59.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.970+0000 7f99edffb700 1 -- 172.21.15.6:0/3119390053 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f99f800f890 con 0x7f99fc0af230 2023-07-06T19:59:59.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.970+0000 7f99edffb700 1 --2- 172.21.15.6:0/3119390053 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f99e006ace0 0x7f99e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T19:59:59.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.970+0000 7f99edffb700 1 -- 172.21.15.6:0/3119390053 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f99f8089c20 con 0x7f99fc0af230 2023-07-06T19:59:59.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.970+0000 7f9a01276700 1 --2- 172.21.15.6:0/3119390053 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f99e006ace0 0x7f99e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T19:59:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.971+0000 7f9a01276700 1 --2- 172.21.15.6:0/3119390053 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f99e006ace0 0x7f99e006d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f99f0000c00 tx=0x7f99f0001bd0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T19:59:59.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T19:59:59.975+0000 7f99edffb700 1 -- 172.21.15.6:0/3119390053 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f99f8054990 con 0x7f99fc0af230 2023-07-06T20:00:00.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.172+0000 7f9a034da700 1 -- 172.21.15.6:0/3119390053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f99fc1f21b0 con 0x7f99fc0af230 2023-07-06T20:00:00.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.173+0000 7f99edffb700 1 -- 172.21.15.6:0/3119390053 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f99f80190a0 con 0x7f99fc0af230 2023-07-06T20:00:00.175 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-06T20:00:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.175+0000 7f9a034da700 1 -- 172.21.15.6:0/3119390053 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f99e006ace0 msgr2=0x7f99e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.175+0000 7f9a034da700 1 --2- 172.21.15.6:0/3119390053 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f99e006ace0 0x7f99e006d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f99f0000c00 tx=0x7f99f0001bd0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.175+0000 7f9a034da700 1 -- 172.21.15.6:0/3119390053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99fc0af230 msgr2=0x7f99fc0ada90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:00.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.175+0000 7f9a034da700 1 --2- 172.21.15.6:0/3119390053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99fc0af230 0x7f99fc0ada90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f99f80119c0 tx=0x7f99f8011cd0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.175+0000 7f9a034da700 1 -- 172.21.15.6:0/3119390053 shutdown_connections 2023-07-06T20:00:00.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.175+0000 7f9a034da700 1 --2- 172.21.15.6:0/3119390053 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f99e006ace0 0x7f99e006d190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.175+0000 7f9a034da700 1 --2- 172.21.15.6:0/3119390053 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f99fc15d750 0x7f99fc0adfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.175+0000 7f9a034da700 1 --2- 172.21.15.6:0/3119390053 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f99e8004d90 0x7f99fc151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.175+0000 7f9a034da700 1 --2- 172.21.15.6:0/3119390053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99fc0af230 0x7f99fc0ada90 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.175+0000 7f9a034da700 1 -- 172.21.15.6:0/3119390053 >> 172.21.15.6:0/3119390053 conn(0x7f99fc0cf960 msgr2=0x7f99fc0b5140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:00.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.175+0000 7f9a034da700 1 -- 172.21.15.6:0/3119390053 shutdown_connections 2023-07-06T20:00:00.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.175+0000 7f9a034da700 1 -- 172.21.15.6:0/3119390053 wait complete. 2023-07-06T20:00:00.189 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T20:00:00.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.317+0000 7f93cdcfd700 1 Processor -- start 2023-07-06T20:00:00.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.317+0000 7f93cdcfd700 1 -- start start 2023-07-06T20:00:00.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.318+0000 7f93cdcfd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f93c815bdd0 0x7f93c80b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:00.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.318+0000 7f93cdcfd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93c80ce120 0x7f93c80ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:00.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.318+0000 7f93cdcfd700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93c80b1370 con 0x7f93c806ac70 2023-07-06T20:00:00.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.318+0000 7f93cdcfd700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93c815c1a0 con 0x7f93c815bdd0 2023-07-06T20:00:00.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.318+0000 7f93cdcfd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c80b1090 con 0x7f93c80ce120 2023-07-06T20:00:00.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.318+0000 7f93c6ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f93c806ac70 0x7f93c80cda10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33408/0 (socket says 172.21.15.6:33408) 2023-07-06T20:00:00.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.318+0000 7f93c6ffd700 1 -- 172.21.15.6:0/1074384230 learned_addr learned my addr 172.21.15.6:0/1074384230 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:00.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.318+0000 7f93c7fff700 1 --2- 172.21.15.6:0/1074384230 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93c80ce120 0x7f93c80ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:00.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.318+0000 7f93c77fe700 1 --2- 172.21.15.6:0/1074384230 >> v2:172.21.15.40:3300/0 conn(0x7f93c815bdd0 0x7f93c80b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:00.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.318+0000 7f93c67fc700 1 -- 172.21.15.6:0/1074384230 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862090885 0 0) 0x7f93c80b1370 con 0x7f93c806ac70 2023-07-06T20:00:00.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.318+0000 7f93c67fc700 1 -- 172.21.15.6:0/1074384230 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93b40035b0 con 0x7f93c806ac70 2023-07-06T20:00:00.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.318+0000 7f93c7fff700 1 -- 172.21.15.6:0/1074384230 >> v2:172.21.15.40:3300/0 conn(0x7f93c815bdd0 msgr2=0x7f93c80b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:00.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.318+0000 7f93c7fff700 1 --2- 172.21.15.6:0/1074384230 >> v2:172.21.15.40:3300/0 conn(0x7f93c815bdd0 0x7f93c80b0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.318+0000 7f93c7fff700 1 -- 172.21.15.6:0/1074384230 >> v1:172.21.15.6:6789/0 conn(0x7f93c806ac70 legacy=0x7f93c80cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:00.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.318+0000 7f93c7fff700 1 -- 172.21.15.6:0/1074384230 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c806a190 con 0x7f93c80ce120 2023-07-06T20:00:00.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.318+0000 7f93c77fe700 1 --2- 172.21.15.6:0/1074384230 >> v2:172.21.15.40:3300/0 conn(0x7f93c815bdd0 0x7f93c80b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T20:00:00.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.319+0000 7f93c7fff700 1 --2- 172.21.15.6:0/1074384230 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93c80ce120 0x7f93c80ca140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f93c0009d90 tx=0x7f93c000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f3c4501debc5a45 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:00.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.319+0000 7f93c67fc700 1 -- 172.21.15.6:0/1074384230 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c000e070 con 0x7f93c80ce120 2023-07-06T20:00:00.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.319+0000 7f93c67fc700 1 -- 172.21.15.6:0/1074384230 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c000bb20 con 0x7f93c80ce120 2023-07-06T20:00:00.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.319+0000 7f93c67fc700 1 -- 172.21.15.6:0/1074384230 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c0012430 con 0x7f93c80ce120 2023-07-06T20:00:00.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.319+0000 7f93cdcfd700 1 -- 172.21.15.6:0/1074384230 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93c80ce120 msgr2=0x7f93c80ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:00.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.319+0000 7f93cdcfd700 1 --2- 172.21.15.6:0/1074384230 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93c80ce120 0x7f93c80ca140 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f93c0009d90 tx=0x7f93c000b330 comp rx=0 tx=0).stop 2023-07-06T20:00:00.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.319+0000 7f93cdcfd700 1 -- 172.21.15.6:0/1074384230 shutdown_connections 2023-07-06T20:00:00.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.319+0000 7f93cdcfd700 1 --2- 172.21.15.6:0/1074384230 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93c80ce120 0x7f93c80ca140 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.319+0000 7f93cdcfd700 1 --2- 172.21.15.6:0/1074384230 >> v2:172.21.15.40:3300/0 conn(0x7f93c815bdd0 0x7f93c80b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.319+0000 7f93cdcfd700 1 -- 172.21.15.6:0/1074384230 >> 172.21.15.6:0/1074384230 conn(0x7f93c80cf420 msgr2=0x7f93c80cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:00.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.319+0000 7f93cdcfd700 1 -- 172.21.15.6:0/1074384230 shutdown_connections 2023-07-06T20:00:00.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.319+0000 7f93cdcfd700 1 -- 172.21.15.6:0/1074384230 wait complete. 2023-07-06T20:00:00.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.321+0000 7f93cdcfd700 1 Processor -- start 2023-07-06T20:00:00.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.321+0000 7f93cdcfd700 1 -- start start 2023-07-06T20:00:00.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.321+0000 7f93cdcfd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93c806ac70 0x7f93c8154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:00.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.321+0000 7f93cdcfd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93c80ce120 0x7f93c80a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:00.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.321+0000 7f93cdcfd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93c815bdd0 0x7f93c8070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:00.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.322+0000 7f93cdcfd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c81549b0 con 0x7f93c80ce120 2023-07-06T20:00:00.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.322+0000 7f93cdcfd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93c81551c0 con 0x7f93c815bdd0 2023-07-06T20:00:00.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.322+0000 7f93cdcfd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93c8154c00 con 0x7f93c806ac70 2023-07-06T20:00:00.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.322+0000 7f93c6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93c80ce120 0x7f93c80a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:00.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.322+0000 7f93c6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93c80ce120 0x7f93c80a7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60438/0 (socket says 172.21.15.6:60438) 2023-07-06T20:00:00.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.322+0000 7f93c6ffd700 1 -- 172.21.15.6:0/2107058197 learned_addr learned my addr 172.21.15.6:0/2107058197 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:00.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.322+0000 7f93c7fff700 1 --2- 172.21.15.6:0/2107058197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93c815bdd0 0x7f93c8070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:00.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.322+0000 7f93c77fe700 1 --2- 172.21.15.6:0/2107058197 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93c806ac70 0x7f93c8154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:00.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.322+0000 7f93c6ffd700 1 -- 172.21.15.6:0/2107058197 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93c806ac70 msgr2=0x7f93c8154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:00.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.322+0000 7f93c6ffd700 1 --2- 172.21.15.6:0/2107058197 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93c806ac70 0x7f93c8154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.322+0000 7f93c6ffd700 1 -- 172.21.15.6:0/2107058197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93c815bdd0 msgr2=0x7f93c8070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:00.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.322+0000 7f93c6ffd700 1 --2- 172.21.15.6:0/2107058197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93c815bdd0 0x7f93c8070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.322+0000 7f93c6ffd700 1 -- 172.21.15.6:0/2107058197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b80094a0 con 0x7f93c80ce120 2023-07-06T20:00:00.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.322+0000 7f93c7fff700 1 --2- 172.21.15.6:0/2107058197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93c815bdd0 0x7f93c8070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:00.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.322+0000 7f93c77fe700 1 --2- 172.21.15.6:0/2107058197 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93c806ac70 0x7f93c8154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:00.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.322+0000 7f93c6ffd700 1 --2- 172.21.15.6:0/2107058197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93c80ce120 0x7f93c80a7e30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f93b0005910 tx=0x7f93b000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:00.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.322+0000 7f93bffff700 1 -- 172.21.15.6:0/2107058197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b0005d70 con 0x7f93c80ce120 2023-07-06T20:00:00.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.322+0000 7f93bffff700 1 -- 172.21.15.6:0/2107058197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b00070d0 con 0x7f93c80ce120 2023-07-06T20:00:00.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.322+0000 7f93cdcfd700 1 -- 172.21.15.6:0/2107058197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c0009a70 con 0x7f93c80ce120 2023-07-06T20:00:00.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.322+0000 7f93bffff700 1 -- 172.21.15.6:0/2107058197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b0007440 con 0x7f93c80ce120 2023-07-06T20:00:00.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.322+0000 7f93cdcfd700 1 -- 172.21.15.6:0/2107058197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93c80c63e0 con 0x7f93c80ce120 2023-07-06T20:00:00.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.323+0000 7f93cdcfd700 1 -- 172.21.15.6:0/2107058197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93c804eb90 con 0x7f93c80ce120 2023-07-06T20:00:00.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.324+0000 7f93bffff700 1 -- 172.21.15.6:0/2107058197 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f93b00075a0 con 0x7f93c80ce120 2023-07-06T20:00:00.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.324+0000 7f93bffff700 1 --2- 172.21.15.6:0/2107058197 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f93a806ace0 0x7f93a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:00.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.324+0000 7f93bffff700 1 -- 172.21.15.6:0/2107058197 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f93b0088af0 con 0x7f93c80ce120 2023-07-06T20:00:00.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.324+0000 7f93c77fe700 1 --2- 172.21.15.6:0/2107058197 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f93a806ace0 0x7f93a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:00.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.325+0000 7f93c77fe700 1 --2- 172.21.15.6:0/2107058197 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f93a806ace0 0x7f93a806d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f93b8009dc0 tx=0x7f93b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:00.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.329+0000 7f93bffff700 1 -- 172.21.15.6:0/2107058197 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f93b00539b0 con 0x7f93c80ce120 2023-07-06T20:00:00.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.523+0000 7f93cdcfd700 1 -- 172.21.15.6:0/2107058197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f93c80c8b90 con 0x7f93c80ce120 2023-07-06T20:00:00.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.524+0000 7f93bffff700 1 -- 172.21.15.6:0/2107058197 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f93b0056fd0 con 0x7f93c80ce120 2023-07-06T20:00:00.530 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T20:00:00.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.526+0000 7f93cdcfd700 1 -- 172.21.15.6:0/2107058197 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f93a806ace0 msgr2=0x7f93a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:00.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.526+0000 7f93cdcfd700 1 --2- 172.21.15.6:0/2107058197 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f93a806ace0 0x7f93a806d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f93b8009dc0 tx=0x7f93b8008040 comp rx=0 tx=0).stop 2023-07-06T20:00:00.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.526+0000 7f93cdcfd700 1 -- 172.21.15.6:0/2107058197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93c80ce120 msgr2=0x7f93c80a7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:00.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.526+0000 7f93cdcfd700 1 --2- 172.21.15.6:0/2107058197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93c80ce120 0x7f93c80a7e30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f93b0005910 tx=0x7f93b000c860 comp rx=0 tx=0).stop 2023-07-06T20:00:00.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.526+0000 7f93cdcfd700 1 -- 172.21.15.6:0/2107058197 shutdown_connections 2023-07-06T20:00:00.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.526+0000 7f93cdcfd700 1 --2- 172.21.15.6:0/2107058197 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f93a806ace0 0x7f93a806d190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.526+0000 7f93cdcfd700 1 --2- 172.21.15.6:0/2107058197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93c815bdd0 0x7f93c8070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.526+0000 7f93cdcfd700 1 --2- 172.21.15.6:0/2107058197 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f93c806ac70 0x7f93c8154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.526+0000 7f93cdcfd700 1 --2- 172.21.15.6:0/2107058197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93c80ce120 0x7f93c80a7e30 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.526+0000 7f93cdcfd700 1 -- 172.21.15.6:0/2107058197 >> 172.21.15.6:0/2107058197 conn(0x7f93c80cf420 msgr2=0x7f93c80c4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:00.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.526+0000 7f93cdcfd700 1 -- 172.21.15.6:0/2107058197 shutdown_connections 2023-07-06T20:00:00.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.526+0000 7f93cdcfd700 1 -- 172.21.15.6:0/2107058197 wait complete. 2023-07-06T20:00:00.542 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T20:00:00.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.670+0000 7efec9e7a700 1 Processor -- start 2023-07-06T20:00:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.670+0000 7efec9e7a700 1 -- start start 2023-07-06T20:00:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.671+0000 7efec9e7a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efec40ca850 0x7efec415bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:00.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.671+0000 7efec9e7a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efec4071cd0 0x7efec415c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.671+0000 7efec9e7a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec40cb310 con 0x7efec4071900 2023-07-06T20:00:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.671+0000 7efec9e7a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec40cdbf0 con 0x7efec4071cd0 2023-07-06T20:00:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.671+0000 7efec9e7a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec415c9d0 con 0x7efec40ca850 2023-07-06T20:00:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.671+0000 7efec3fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efec4071cd0 0x7efec415c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.671+0000 7efec3fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7efec4071cd0 0x7efec415c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60446/0 (socket says 172.21.15.6:60446) 2023-07-06T20:00:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.671+0000 7efec3fff700 1 -- 172.21.15.6:0/701929409 learned_addr learned my addr 172.21.15.6:0/701929409 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:00.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.671+0000 7efec2ffd700 1 --2- 172.21.15.6:0/701929409 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efec40ca850 0x7efec415bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:00.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.671+0000 7efec3fff700 1 -- 172.21.15.6:0/701929409 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efec40ca850 msgr2=0x7efec415bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:00.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.671+0000 7efec3fff700 1 --2- 172.21.15.6:0/701929409 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efec40ca850 0x7efec415bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.671+0000 7efec3fff700 1 -- 172.21.15.6:0/701929409 >> v1:172.21.15.40:6789/0 conn(0x7efec4071900 legacy=0x7efec40ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:00.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.671+0000 7efec3fff700 1 -- 172.21.15.6:0/701929409 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec40af070 con 0x7efec4071cd0 2023-07-06T20:00:00.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.671+0000 7efec2ffd700 1 --2- 172.21.15.6:0/701929409 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efec40ca850 0x7efec415bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T20:00:00.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.671+0000 7efec3fff700 1 --2- 172.21.15.6:0/701929409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efec4071cd0 0x7efec415c490 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7efebc009e50 tx=0x7efebc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08b0f0790e6e721 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:00.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.671+0000 7efec27fc700 1 -- 172.21.15.6:0/701929409 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc00e070 con 0x7efec4071cd0 2023-07-06T20:00:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.671+0000 7efec27fc700 1 -- 172.21.15.6:0/701929409 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc003a20 con 0x7efec4071cd0 2023-07-06T20:00:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.672+0000 7efec27fc700 1 -- 172.21.15.6:0/701929409 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc003dd0 con 0x7efec4071cd0 2023-07-06T20:00:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.672+0000 7efec9e7a700 1 -- 172.21.15.6:0/701929409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efec4071cd0 msgr2=0x7efec415c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.672+0000 7efec9e7a700 1 --2- 172.21.15.6:0/701929409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efec4071cd0 0x7efec415c490 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7efebc009e50 tx=0x7efebc00b330 comp rx=0 tx=0).stop 2023-07-06T20:00:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.672+0000 7efec9e7a700 1 -- 172.21.15.6:0/701929409 shutdown_connections 2023-07-06T20:00:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.672+0000 7efec9e7a700 1 --2- 172.21.15.6:0/701929409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efec4071cd0 0x7efec415c490 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.672+0000 7efec9e7a700 1 --2- 172.21.15.6:0/701929409 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efec40ca850 0x7efec415bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.672+0000 7efec9e7a700 1 -- 172.21.15.6:0/701929409 >> 172.21.15.6:0/701929409 conn(0x7efec40cf960 msgr2=0x7efec40cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.672+0000 7efec9e7a700 1 -- 172.21.15.6:0/701929409 shutdown_connections 2023-07-06T20:00:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.672+0000 7efec9e7a700 1 -- 172.21.15.6:0/701929409 wait complete. 2023-07-06T20:00:00.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.673+0000 7efec9e7a700 1 Processor -- start 2023-07-06T20:00:00.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.673+0000 7efec9e7a700 1 -- start start 2023-07-06T20:00:00.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.674+0000 7efec9e7a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efec4071900 0x7efec414ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:00.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.674+0000 7efec9e7a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efec4071cd0 0x7efec415eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:00.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.674+0000 7efec9e7a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efec40ca850 0x7efec40c5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:00.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.674+0000 7efec9e7a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec40b3550 con 0x7efec40ca850 2023-07-06T20:00:00.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.674+0000 7efec9e7a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec40b3830 con 0x7efec4071900 2023-07-06T20:00:00.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.674+0000 7efec9e7a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec40b3b10 con 0x7efec4071cd0 2023-07-06T20:00:00.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.674+0000 7efec3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efec40ca850 0x7efec40c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:00.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.674+0000 7efec3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efec40ca850 0x7efec40c5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60452/0 (socket says 172.21.15.6:60452) 2023-07-06T20:00:00.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.674+0000 7efec3fff700 1 -- 172.21.15.6:0/955987485 learned_addr learned my addr 172.21.15.6:0/955987485 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:00.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.675+0000 7efec2ffd700 1 --2- 172.21.15.6:0/955987485 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efec4071cd0 0x7efec415eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:00.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.675+0000 7efec37fe700 1 --2- 172.21.15.6:0/955987485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efec4071900 0x7efec414ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:00.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.675+0000 7efec3fff700 1 -- 172.21.15.6:0/955987485 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efec4071cd0 msgr2=0x7efec415eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:00.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.675+0000 7efec3fff700 1 --2- 172.21.15.6:0/955987485 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efec4071cd0 0x7efec415eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.675+0000 7efec3fff700 1 -- 172.21.15.6:0/955987485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efec4071900 msgr2=0x7efec414ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:00.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.675+0000 7efec3fff700 1 --2- 172.21.15.6:0/955987485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efec4071900 0x7efec414ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.675+0000 7efec3fff700 1 -- 172.21.15.6:0/955987485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc009b30 con 0x7efec40ca850 2023-07-06T20:00:00.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.675+0000 7efec3fff700 1 --2- 172.21.15.6:0/955987485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efec40ca850 0x7efec40c5640 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7efec406eb20 tx=0x7efebc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:00.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.675+0000 7efeabfff700 1 -- 172.21.15.6:0/955987485 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc0044c0 con 0x7efec40ca850 2023-07-06T20:00:00.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.675+0000 7efeabfff700 1 -- 172.21.15.6:0/955987485 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc004620 con 0x7efec40ca850 2023-07-06T20:00:00.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.675+0000 7efeabfff700 1 -- 172.21.15.6:0/955987485 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc012430 con 0x7efec40ca850 2023-07-06T20:00:00.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.675+0000 7efec9e7a700 1 -- 172.21.15.6:0/955987485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec40b3df0 con 0x7efec40ca850 2023-07-06T20:00:00.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.675+0000 7efec9e7a700 1 -- 172.21.15.6:0/955987485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec41f6620 con 0x7efec40ca850 2023-07-06T20:00:00.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.676+0000 7efec9e7a700 1 -- 172.21.15.6:0/955987485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec415c6b0 con 0x7efec40ca850 2023-07-06T20:00:00.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.676+0000 7efeabfff700 1 -- 172.21.15.6:0/955987485 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efebc012590 con 0x7efec40ca850 2023-07-06T20:00:00.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.677+0000 7efeabfff700 1 --2- 172.21.15.6:0/955987485 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efeb006ace0 0x7efeb006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:00.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.677+0000 7efeabfff700 1 -- 172.21.15.6:0/955987485 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7efebc08acb0 con 0x7efec40ca850 2023-07-06T20:00:00.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.677+0000 7efec37fe700 1 --2- 172.21.15.6:0/955987485 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efeb006ace0 0x7efeb006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:00.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.677+0000 7efec37fe700 1 --2- 172.21.15.6:0/955987485 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efeb006ace0 0x7efeb006d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efeb8009870 tx=0x7efeb8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:00.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.681+0000 7efeabfff700 1 -- 172.21.15.6:0/955987485 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efebc055ac0 con 0x7efec40ca850 2023-07-06T20:00:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.882+0000 7efec9e7a700 1 -- 172.21.15.6:0/955987485 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efec40b3690 con 0x7efec40ca850 2023-07-06T20:00:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.882+0000 7efeabfff700 1 -- 172.21.15.6:0/955987485 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7efebc017020 con 0x7efec40ca850 2023-07-06T20:00:00.885 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-06T20:00:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.884+0000 7efec9e7a700 1 -- 172.21.15.6:0/955987485 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efeb006ace0 msgr2=0x7efeb006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.884+0000 7efec9e7a700 1 --2- 172.21.15.6:0/955987485 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efeb006ace0 0x7efeb006d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efeb8009870 tx=0x7efeb8008040 comp rx=0 tx=0).stop 2023-07-06T20:00:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.885+0000 7efec9e7a700 1 -- 172.21.15.6:0/955987485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efec40ca850 msgr2=0x7efec40c5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.885+0000 7efec9e7a700 1 --2- 172.21.15.6:0/955987485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efec40ca850 0x7efec40c5640 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7efec406eb20 tx=0x7efebc004ad0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.885+0000 7efec9e7a700 1 -- 172.21.15.6:0/955987485 shutdown_connections 2023-07-06T20:00:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.885+0000 7efec9e7a700 1 --2- 172.21.15.6:0/955987485 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efeb006ace0 0x7efeb006d190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.885+0000 7efec9e7a700 1 --2- 172.21.15.6:0/955987485 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efec40ca850 0x7efec40c5640 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.885+0000 7efec9e7a700 1 --2- 172.21.15.6:0/955987485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efec4071900 0x7efec414ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.885+0000 7efec9e7a700 1 --2- 172.21.15.6:0/955987485 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efec4071cd0 0x7efec415eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:00.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.885+0000 7efec9e7a700 1 -- 172.21.15.6:0/955987485 >> 172.21.15.6:0/955987485 conn(0x7efec40cf960 msgr2=0x7efec406ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:00.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.885+0000 7efec9e7a700 1 -- 172.21.15.6:0/955987485 shutdown_connections 2023-07-06T20:00:00.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:00.885+0000 7efec9e7a700 1 -- 172.21.15.6:0/955987485 wait complete. 2023-07-06T20:00:00.899 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T20:00:01.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.028+0000 7f319df29700 1 Processor -- start 2023-07-06T20:00:01.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.028+0000 7f319df29700 1 -- start start 2023-07-06T20:00:01.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.029+0000 7f319df29700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3198071900 0x7f31980ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:01.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.029+0000 7f319df29700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3198071cd0 0x7f31980ca680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:01.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.029+0000 7f319df29700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31980cb310 con 0x7f319815bf50 2023-07-06T20:00:01.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.029+0000 7f319df29700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31980cdbf0 con 0x7f3198071cd0 2023-07-06T20:00:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.029+0000 7f319df29700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31980af070 con 0x7f3198071900 2023-07-06T20:00:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.029+0000 7f3197fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f319815bf50 0x7f319815c3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33436/0 (socket says 172.21.15.6:33436) 2023-07-06T20:00:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.029+0000 7f3197fff700 1 -- 172.21.15.6:0/1156086778 learned_addr learned my addr 172.21.15.6:0/1156086778 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.029+0000 7f31967fc700 1 -- 172.21.15.6:0/1156086778 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287304865 0 0) 0x7f31980cb310 con 0x7f319815bf50 2023-07-06T20:00:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.029+0000 7f3196ffd700 1 --2- 172.21.15.6:0/1156086778 >> v2:172.21.15.40:3300/0 conn(0x7f3198071cd0 0x7f31980ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.029+0000 7f31967fc700 1 -- 172.21.15.6:0/1156086778 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31840035b0 con 0x7f319815bf50 2023-07-06T20:00:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.029+0000 7f31977fe700 1 --2- 172.21.15.6:0/1156086778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3198071900 0x7f31980ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:01.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.030+0000 7f31967fc700 1 -- 172.21.15.6:0/1156086778 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2268599715 0 0) 0x7f31840035b0 con 0x7f319815bf50 2023-07-06T20:00:01.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.030+0000 7f31967fc700 1 -- 172.21.15.6:0/1156086778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3198071900 msgr2=0x7f31980ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:01.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.030+0000 7f31967fc700 1 --2- 172.21.15.6:0/1156086778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3198071900 0x7f31980ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.030+0000 7f31967fc700 1 -- 172.21.15.6:0/1156086778 >> v2:172.21.15.40:3300/0 conn(0x7f3198071cd0 msgr2=0x7f31980ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:01.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.030+0000 7f31967fc700 1 --2- 172.21.15.6:0/1156086778 >> v2:172.21.15.40:3300/0 conn(0x7f3198071cd0 0x7f31980ca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.030+0000 7f31967fc700 1 -- 172.21.15.6:0/1156086778 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31980cad50 con 0x7f319815bf50 2023-07-06T20:00:01.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.030+0000 7f31967fc700 1 -- 172.21.15.6:0/1156086778 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f31900019f0 con 0x7f319815bf50 2023-07-06T20:00:01.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.030+0000 7f31967fc700 1 -- 172.21.15.6:0/1156086778 >> v1:172.21.15.6:6789/0 conn(0x7f319815bf50 legacy=0x7f319815c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:01.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.030+0000 7f31967fc700 1 --2- 172.21.15.6:0/1156086778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3198071900 0x7f3184003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:01.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.030+0000 7f31967fc700 1 --2- 172.21.15.6:0/1156086778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3184003fd0 0x7f3184004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:01.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.030+0000 7f31967fc700 1 --2- 172.21.15.6:0/1156086778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3184004d90 0x7f3184005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:01.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.030+0000 7f31967fc700 1 -- 172.21.15.6:0/1156086778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31980cdbf0 con 0x7f3184003fd0 2023-07-06T20:00:01.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.030+0000 7f31967fc700 1 -- 172.21.15.6:0/1156086778 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31980af070 con 0x7f3184004d90 2023-07-06T20:00:01.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.030+0000 7f31967fc700 1 -- 172.21.15.6:0/1156086778 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318400bb40 con 0x7f3198071900 2023-07-06T20:00:01.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.030+0000 7f3196ffd700 1 --2- 172.21.15.6:0/1156086778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3184003fd0 0x7f3184004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:01.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.030+0000 7f31977fe700 1 --2- 172.21.15.6:0/1156086778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3198071900 0x7f3184003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.030+0000 7f3197fff700 1 --2- 172.21.15.6:0/1156086778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3184004d90 0x7f3184005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.030+0000 7f3196ffd700 1 -- 172.21.15.6:0/1156086778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3198071900 msgr2=0x7f3184003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.030+0000 7f3196ffd700 1 --2- 172.21.15.6:0/1156086778 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3198071900 0x7f3184003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.030+0000 7f3196ffd700 1 -- 172.21.15.6:0/1156086778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3184004d90 msgr2=0x7f3184005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.030+0000 7f3196ffd700 1 --2- 172.21.15.6:0/1156086778 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3184004d90 0x7f3184005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.030+0000 7f3196ffd700 1 -- 172.21.15.6:0/1156086778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31840035b0 con 0x7f3184003fd0 2023-07-06T20:00:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.030+0000 7f3196ffd700 1 --2- 172.21.15.6:0/1156086778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3184003fd0 0x7f3184004850 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3188009b30 tx=0x7f3184005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e633ac08fdb900 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:01.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.031+0000 7f31967fc700 1 -- 172.21.15.6:0/1156086778 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318800e6c0 con 0x7f3184003fd0 2023-07-06T20:00:01.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.031+0000 7f31967fc700 1 -- 172.21.15.6:0/1156086778 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318800e820 con 0x7f3184003fd0 2023-07-06T20:00:01.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.031+0000 7f31967fc700 1 -- 172.21.15.6:0/1156086778 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318800eb90 con 0x7f3184003fd0 2023-07-06T20:00:01.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.031+0000 7f319df29700 1 -- 172.21.15.6:0/1156086778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3184003fd0 msgr2=0x7f3184004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:01.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.031+0000 7f319df29700 1 --2- 172.21.15.6:0/1156086778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3184003fd0 0x7f3184004850 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3188009b30 tx=0x7f3184005880 comp rx=0 tx=0).stop 2023-07-06T20:00:01.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.031+0000 7f3197fff700 1 -- 172.21.15.6:0/1156086778 reap_dead start 2023-07-06T20:00:01.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.031+0000 7f319df29700 1 -- 172.21.15.6:0/1156086778 shutdown_connections 2023-07-06T20:00:01.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.031+0000 7f319df29700 1 -- 172.21.15.6:0/1156086778 >> 172.21.15.6:0/1156086778 conn(0x7f31980cf960 msgr2=0x7f31980cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:01.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.031+0000 7f319df29700 1 -- 172.21.15.6:0/1156086778 shutdown_connections 2023-07-06T20:00:01.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.031+0000 7f319df29700 1 -- 172.21.15.6:0/1156086778 wait complete. 2023-07-06T20:00:01.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.032+0000 7f319df29700 1 Processor -- start 2023-07-06T20:00:01.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.033+0000 7f319df29700 1 -- start start 2023-07-06T20:00:01.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.033+0000 7f319df29700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3184003fd0 0x7f31980c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:01.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.033+0000 7f319df29700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31981f18f0 0x7f31980b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:01.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.033+0000 7f319df29700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31981f1d60 0x7f319815a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:01.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.033+0000 7f319df29700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31980c4500 con 0x7f31981f18f0 2023-07-06T20:00:01.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.033+0000 7f319df29700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31980c47e0 con 0x7f3184003fd0 2023-07-06T20:00:01.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.033+0000 7f319df29700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31980c4ac0 con 0x7f31981f1d60 2023-07-06T20:00:01.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.033+0000 7f3196ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31981f18f0 0x7f31980b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:01.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.034+0000 7f3196ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31981f18f0 0x7f31980b3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60470/0 (socket says 172.21.15.6:60470) 2023-07-06T20:00:01.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.034+0000 7f3196ffd700 1 -- 172.21.15.6:0/2285887483 learned_addr learned my addr 172.21.15.6:0/2285887483 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:01.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.034+0000 7f31977fe700 1 --2- 172.21.15.6:0/2285887483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3184003fd0 0x7f31980c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:01.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.034+0000 7f3197fff700 1 --2- 172.21.15.6:0/2285887483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31981f1d60 0x7f319815a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:01.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.034+0000 7f3196ffd700 1 -- 172.21.15.6:0/2285887483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31981f1d60 msgr2=0x7f319815a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:01.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.034+0000 7f3196ffd700 1 --2- 172.21.15.6:0/2285887483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31981f1d60 0x7f319815a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.034+0000 7f3196ffd700 1 -- 172.21.15.6:0/2285887483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3184003fd0 msgr2=0x7f31980c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:01.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.034+0000 7f3196ffd700 1 --2- 172.21.15.6:0/2285887483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3184003fd0 0x7f31980c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.034+0000 7f3196ffd700 1 -- 172.21.15.6:0/2285887483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31980c4da0 con 0x7f31981f18f0 2023-07-06T20:00:01.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.034+0000 7f3196ffd700 1 --2- 172.21.15.6:0/2285887483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31981f18f0 0x7f31980b3170 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f318800e4b0 tx=0x7f31880047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:01.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.034+0000 7f318ffff700 1 -- 172.21.15.6:0/2285887483 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318800e6c0 con 0x7f31981f18f0 2023-07-06T20:00:01.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.034+0000 7f318ffff700 1 -- 172.21.15.6:0/2285887483 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3188003ad0 con 0x7f31981f18f0 2023-07-06T20:00:01.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.034+0000 7f319df29700 1 -- 172.21.15.6:0/2285887483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31980c5080 con 0x7f31981f18f0 2023-07-06T20:00:01.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.034+0000 7f318ffff700 1 -- 172.21.15.6:0/2285887483 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3188003e80 con 0x7f31981f18f0 2023-07-06T20:00:01.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.034+0000 7f319df29700 1 -- 172.21.15.6:0/2285887483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31980b50d0 con 0x7f31981f18f0 2023-07-06T20:00:01.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.035+0000 7f319df29700 1 -- 172.21.15.6:0/2285887483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31980b52c0 con 0x7f31981f18f0 2023-07-06T20:00:01.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.036+0000 7f318ffff700 1 -- 172.21.15.6:0/2285887483 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3188013470 con 0x7f31981f18f0 2023-07-06T20:00:01.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.036+0000 7f318ffff700 1 --2- 172.21.15.6:0/2285887483 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f317806ace0 0x7f317806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:01.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.036+0000 7f318ffff700 1 -- 172.21.15.6:0/2285887483 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f318808b070 con 0x7f31981f18f0 2023-07-06T20:00:01.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.036+0000 7f31977fe700 1 --2- 172.21.15.6:0/2285887483 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f317806ace0 0x7f317806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:01.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.036+0000 7f31977fe700 1 --2- 172.21.15.6:0/2285887483 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f317806ace0 0x7f317806d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f31800099c0 tx=0x7f3180008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:01.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.040+0000 7f318ffff700 1 -- 172.21.15.6:0/2285887483 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f31980b52c0 con 0x7f31981f18f0 2023-07-06T20:00:01.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.238+0000 7f319df29700 1 -- 172.21.15.6:0/2285887483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f31980b52c0 con 0x7f31981f18f0 2023-07-06T20:00:01.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.239+0000 7f318ffff700 1 -- 172.21.15.6:0/2285887483 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f31980b52c0 con 0x7f31981f18f0 2023-07-06T20:00:01.244 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T20:00:01.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.241+0000 7f319df29700 1 -- 172.21.15.6:0/2285887483 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f317806ace0 msgr2=0x7f317806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:01.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.241+0000 7f319df29700 1 --2- 172.21.15.6:0/2285887483 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f317806ace0 0x7f317806d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f31800099c0 tx=0x7f3180008040 comp rx=0 tx=0).stop 2023-07-06T20:00:01.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.241+0000 7f319df29700 1 -- 172.21.15.6:0/2285887483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31981f18f0 msgr2=0x7f31980b3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:01.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.241+0000 7f319df29700 1 --2- 172.21.15.6:0/2285887483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31981f18f0 0x7f31980b3170 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f318800e4b0 tx=0x7f31880047c0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.241+0000 7f319df29700 1 -- 172.21.15.6:0/2285887483 shutdown_connections 2023-07-06T20:00:01.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.241+0000 7f319df29700 1 --2- 172.21.15.6:0/2285887483 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f317806ace0 0x7f317806d190 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.241+0000 7f319df29700 1 --2- 172.21.15.6:0/2285887483 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31981f1d60 0x7f319815a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.241+0000 7f319df29700 1 --2- 172.21.15.6:0/2285887483 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3184003fd0 0x7f31980c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.241+0000 7f319df29700 1 --2- 172.21.15.6:0/2285887483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31981f18f0 0x7f31980b3170 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.241+0000 7f319df29700 1 -- 172.21.15.6:0/2285887483 >> 172.21.15.6:0/2285887483 conn(0x7f31980cf960 msgr2=0x7f319806ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:01.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.241+0000 7f319df29700 1 -- 172.21.15.6:0/2285887483 shutdown_connections 2023-07-06T20:00:01.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.241+0000 7f319df29700 1 -- 172.21.15.6:0/2285887483 wait complete. 2023-07-06T20:00:01.256 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-06T20:00:01.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.382+0000 7fe3f5337700 1 Processor -- start 2023-07-06T20:00:01.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.382+0000 7fe3f5337700 1 -- start start 2023-07-06T20:00:01.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.383+0000 7fe3f5337700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe3f00b3c60 0x7fe3f015c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:01.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.383+0000 7fe3f5337700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe3f00cfbf0 0x7fe3f015c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:01.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.383+0000 7fe3f5337700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f00b5e30 con 0x7fe3f01602c0 2023-07-06T20:00:01.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.383+0000 7fe3f5337700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f00b6110 con 0x7fe3f00b3c60 2023-07-06T20:00:01.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.383+0000 7fe3f5337700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f00b63f0 con 0x7fe3f00cfbf0 2023-07-06T20:00:01.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.383+0000 7fe3ee7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe3f00b3c60 0x7fe3f015c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:01.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.383+0000 7fe3eeffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe3f01602c0 0x7fe3f00b5370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33452/0 (socket says 172.21.15.6:33452) 2023-07-06T20:00:01.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.383+0000 7fe3eeffd700 1 -- 172.21.15.6:0/2280345384 learned_addr learned my addr 172.21.15.6:0/2280345384 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:01.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.383+0000 7fe3ef7fe700 1 --2- 172.21.15.6:0/2280345384 >> v2:172.21.15.40:3300/0 conn(0x7fe3f00cfbf0 0x7fe3f015c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:01.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.383+0000 7fe3edffb700 1 -- 172.21.15.6:0/2280345384 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400865275 0 0) 0x7fe3f00b5e30 con 0x7fe3f01602c0 2023-07-06T20:00:01.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.383+0000 7fe3edffb700 1 -- 172.21.15.6:0/2280345384 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3d80035b0 con 0x7fe3f01602c0 2023-07-06T20:00:01.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.383+0000 7fe3ee7fc700 1 -- 172.21.15.6:0/2280345384 >> v2:172.21.15.40:3300/0 conn(0x7fe3f00cfbf0 msgr2=0x7fe3f015c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:01.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.383+0000 7fe3ee7fc700 1 --2- 172.21.15.6:0/2280345384 >> v2:172.21.15.40:3300/0 conn(0x7fe3f00cfbf0 0x7fe3f015c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.383+0000 7fe3ee7fc700 1 -- 172.21.15.6:0/2280345384 >> v1:172.21.15.6:6789/0 conn(0x7fe3f01602c0 legacy=0x7fe3f00b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:01.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.383+0000 7fe3ee7fc700 1 -- 172.21.15.6:0/2280345384 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f00b66d0 con 0x7fe3f00b3c60 2023-07-06T20:00:01.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.383+0000 7fe3ee7fc700 1 --2- 172.21.15.6:0/2280345384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3f00b3c60 0x7fe3f015c410 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe3f00b3600 tx=0x7fe3e0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f60423853b66fab server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:01.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.383+0000 7fe3edffb700 1 -- 172.21.15.6:0/2280345384 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0011830 con 0x7fe3f00b3c60 2023-07-06T20:00:01.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.384+0000 7fe3edffb700 1 -- 172.21.15.6:0/2280345384 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e0011990 con 0x7fe3f00b3c60 2023-07-06T20:00:01.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.384+0000 7fe3edffb700 1 -- 172.21.15.6:0/2280345384 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0011d20 con 0x7fe3f00b3c60 2023-07-06T20:00:01.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.384+0000 7fe3f5337700 1 -- 172.21.15.6:0/2280345384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3f00b3c60 msgr2=0x7fe3f015c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:01.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.384+0000 7fe3f5337700 1 --2- 172.21.15.6:0/2280345384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3f00b3c60 0x7fe3f015c410 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe3f00b3600 tx=0x7fe3e0009b20 comp rx=0 tx=0).stop 2023-07-06T20:00:01.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.384+0000 7fe3f5337700 1 -- 172.21.15.6:0/2280345384 shutdown_connections 2023-07-06T20:00:01.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.384+0000 7fe3f5337700 1 --2- 172.21.15.6:0/2280345384 >> v2:172.21.15.40:3300/0 conn(0x7fe3f00cfbf0 0x7fe3f015c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.384+0000 7fe3f5337700 1 --2- 172.21.15.6:0/2280345384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3f00b3c60 0x7fe3f015c410 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.384+0000 7fe3f5337700 1 -- 172.21.15.6:0/2280345384 >> 172.21.15.6:0/2280345384 conn(0x7fe3f00ce120 msgr2=0x7fe3f00d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:01.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.384+0000 7fe3f5337700 1 -- 172.21.15.6:0/2280345384 shutdown_connections 2023-07-06T20:00:01.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.384+0000 7fe3f5337700 1 -- 172.21.15.6:0/2280345384 wait complete. 2023-07-06T20:00:01.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.385+0000 7fe3f5337700 1 Processor -- start 2023-07-06T20:00:01.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.385+0000 7fe3f5337700 1 -- start start 2023-07-06T20:00:01.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.386+0000 7fe3f5337700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3f00b3c60 0x7fe3f01f5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:01.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.386+0000 7fe3f5337700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3f00cfbf0 0x7fe3f015aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:01.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.386+0000 7fe3f5337700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3f01602c0 0x7fe3f00b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:01.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.386+0000 7fe3f5337700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f01f6490 con 0x7fe3f00cfbf0 2023-07-06T20:00:01.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.386+0000 7fe3f5337700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f01f1f70 con 0x7fe3f01602c0 2023-07-06T20:00:01.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.386+0000 7fe3f5337700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f015af60 con 0x7fe3f00b3c60 2023-07-06T20:00:01.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.386+0000 7fe3ee7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3f00cfbf0 0x7fe3f015aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:01.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.386+0000 7fe3ee7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3f00cfbf0 0x7fe3f015aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60484/0 (socket says 172.21.15.6:60484) 2023-07-06T20:00:01.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.386+0000 7fe3ee7fc700 1 -- 172.21.15.6:0/701069236 learned_addr learned my addr 172.21.15.6:0/701069236 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:01.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.386+0000 7fe3ef7fe700 1 --2- 172.21.15.6:0/701069236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3f01602c0 0x7fe3f00b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:01.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.386+0000 7fe3eeffd700 1 --2- 172.21.15.6:0/701069236 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3f00b3c60 0x7fe3f01f5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:01.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.386+0000 7fe3ee7fc700 1 -- 172.21.15.6:0/701069236 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3f00b3c60 msgr2=0x7fe3f01f5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:01.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.387+0000 7fe3ee7fc700 1 --2- 172.21.15.6:0/701069236 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3f00b3c60 0x7fe3f01f5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.387+0000 7fe3ee7fc700 1 -- 172.21.15.6:0/701069236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3f01602c0 msgr2=0x7fe3f00b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:01.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.387+0000 7fe3ee7fc700 1 --2- 172.21.15.6:0/701069236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3f01602c0 0x7fe3f00b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.387+0000 7fe3ee7fc700 1 -- 172.21.15.6:0/701069236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e00094a0 con 0x7fe3f00cfbf0 2023-07-06T20:00:01.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.387+0000 7fe3ef7fe700 1 --2- 172.21.15.6:0/701069236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3f01602c0 0x7fe3f00b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T20:00:01.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.387+0000 7fe3eeffd700 1 --2- 172.21.15.6:0/701069236 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3f00b3c60 0x7fe3f01f5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T20:00:01.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.387+0000 7fe3ee7fc700 1 --2- 172.21.15.6:0/701069236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3f00cfbf0 0x7fe3f015aa20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009b60 tx=0x7fe3e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:01.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.387+0000 7fe3d77fe700 1 -- 172.21.15.6:0/701069236 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e00038a0 con 0x7fe3f00cfbf0 2023-07-06T20:00:01.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.387+0000 7fe3d77fe700 1 -- 172.21.15.6:0/701069236 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e001f070 con 0x7fe3f00cfbf0 2023-07-06T20:00:01.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.387+0000 7fe3d77fe700 1 -- 172.21.15.6:0/701069236 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0003c00 con 0x7fe3f00cfbf0 2023-07-06T20:00:01.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.387+0000 7fe3f5337700 1 -- 172.21.15.6:0/701069236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f00b5c00 con 0x7fe3f00cfbf0 2023-07-06T20:00:01.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.387+0000 7fe3f5337700 1 -- 172.21.15.6:0/701069236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f01f61b0 con 0x7fe3f00cfbf0 2023-07-06T20:00:01.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.388+0000 7fe3f5337700 1 -- 172.21.15.6:0/701069236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f004eb90 con 0x7fe3f00cfbf0 2023-07-06T20:00:01.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.388+0000 7fe3d77fe700 1 -- 172.21.15.6:0/701069236 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe3e001a430 con 0x7fe3f00cfbf0 2023-07-06T20:00:01.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.389+0000 7fe3d77fe700 1 --2- 172.21.15.6:0/701069236 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe3dc06ace0 0x7fe3dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:01.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.389+0000 7fe3d77fe700 1 -- 172.21.15.6:0/701069236 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe3e0021070 con 0x7fe3f00cfbf0 2023-07-06T20:00:01.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.389+0000 7fe3eeffd700 1 --2- 172.21.15.6:0/701069236 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe3dc06ace0 0x7fe3dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:01.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.389+0000 7fe3eeffd700 1 --2- 172.21.15.6:0/701069236 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe3dc06ace0 0x7fe3dc06d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40011e0 tx=0x7fe3e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:01.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.393+0000 7fe3d77fe700 1 -- 172.21.15.6:0/701069236 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe3e0055ec0 con 0x7fe3f00cfbf0 2023-07-06T20:00:01.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.609+0000 7fe3f5337700 1 -- 172.21.15.6:0/701069236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe3f015cb20 con 0x7fe3f00cfbf0 2023-07-06T20:00:01.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.609+0000 7fe3d77fe700 1 -- 172.21.15.6:0/701069236 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe3e00594e0 con 0x7fe3f00cfbf0 2023-07-06T20:00:01.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.611+0000 7fe3f5337700 1 -- 172.21.15.6:0/701069236 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe3dc06ace0 msgr2=0x7fe3dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:01.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.611+0000 7fe3f5337700 1 --2- 172.21.15.6:0/701069236 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe3dc06ace0 0x7fe3dc06d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40011e0 tx=0x7fe3e4009040 comp rx=0 tx=0).stop 2023-07-06T20:00:01.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.611+0000 7fe3f5337700 1 -- 172.21.15.6:0/701069236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3f00cfbf0 msgr2=0x7fe3f015aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:01.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.611+0000 7fe3f5337700 1 --2- 172.21.15.6:0/701069236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3f00cfbf0 0x7fe3f015aa20 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009b60 tx=0x7fe3e0004750 comp rx=0 tx=0).stop 2023-07-06T20:00:01.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.611+0000 7fe3f5337700 1 -- 172.21.15.6:0/701069236 shutdown_connections 2023-07-06T20:00:01.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.611+0000 7fe3f5337700 1 --2- 172.21.15.6:0/701069236 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe3dc06ace0 0x7fe3dc06d190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.611+0000 7fe3f5337700 1 --2- 172.21.15.6:0/701069236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3f01602c0 0x7fe3f00b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.611+0000 7fe3f5337700 1 --2- 172.21.15.6:0/701069236 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe3f00b3c60 0x7fe3f01f5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.611+0000 7fe3f5337700 1 --2- 172.21.15.6:0/701069236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3f00cfbf0 0x7fe3f015aa20 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.611+0000 7fe3f5337700 1 -- 172.21.15.6:0/701069236 >> 172.21.15.6:0/701069236 conn(0x7fe3f00ce120 msgr2=0x7fe3f015db90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:01.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.611+0000 7fe3f5337700 1 -- 172.21.15.6:0/701069236 shutdown_connections 2023-07-06T20:00:01.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.611+0000 7fe3f5337700 1 -- 172.21.15.6:0/701069236 wait complete. 2023-07-06T20:00:01.617 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-07-06T20:00:01.625 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-07-06T20:00:01.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T20:00:01.626 DEBUG:teuthology.orchestra.run.smithi040:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-07-06T20:00:01.672 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2023-07-06T20:00:01.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T20:00:01.673 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-06T20:00:01.731 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-06T20:00:01.732 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T20:00:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.858+0000 7f5b36a8b700 1 Processor -- start 2023-07-06T20:00:01.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.858+0000 7f5b36a8b700 1 -- start start 2023-07-06T20:00:01.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.858+0000 7f5b36a8b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5b30071930 0x7f5b300cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:01.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.858+0000 7f5b36a8b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b30071d00 0x7f5b30157f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:01.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.859+0000 7f5b36a8b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b3006a990 con 0x7f5b3006ce60 2023-07-06T20:00:01.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.859+0000 7f5b36a8b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b3006b150 con 0x7f5b30071930 2023-07-06T20:00:01.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.859+0000 7f5b36a8b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3006ac30 con 0x7f5b30071d00 2023-07-06T20:00:01.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.859+0000 7f5b34827700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5b30071930 0x7f5b300cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:01.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.859+0000 7f5b34827700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5b30071930 0x7f5b300cae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60490/0 (socket says 172.21.15.6:60490) 2023-07-06T20:00:01.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.859+0000 7f5b34827700 1 -- 172.21.15.6:0/2698842158 learned_addr learned my addr 172.21.15.6:0/2698842158 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:01.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.859+0000 7f5b35028700 1 --2- 172.21.15.6:0/2698842158 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b30071d00 0x7f5b30157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:01.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.859+0000 7f5b34827700 1 -- 172.21.15.6:0/2698842158 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b30071d00 msgr2=0x7f5b30157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:01.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.859+0000 7f5b34827700 1 --2- 172.21.15.6:0/2698842158 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b30071d00 0x7f5b30157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.859+0000 7f5b34827700 1 -- 172.21.15.6:0/2698842158 >> v1:172.21.15.40:6789/0 conn(0x7f5b3006ce60 legacy=0x7f5b30157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:01.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.859+0000 7f5b34827700 1 -- 172.21.15.6:0/2698842158 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b3006b360 con 0x7f5b30071930 2023-07-06T20:00:01.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.859+0000 7f5b34827700 1 --2- 172.21.15.6:0/2698842158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b30071930 0x7f5b300cae00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5b3006b290 tx=0x7f5b24009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2e6992037453bd server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:01.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.859+0000 7f5b2f7fe700 1 -- 172.21.15.6:0/2698842158 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b24011830 con 0x7f5b30071930 2023-07-06T20:00:01.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.859+0000 7f5b2f7fe700 1 -- 172.21.15.6:0/2698842158 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b24011990 con 0x7f5b30071930 2023-07-06T20:00:01.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.859+0000 7f5b2f7fe700 1 -- 172.21.15.6:0/2698842158 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b24011d20 con 0x7f5b30071930 2023-07-06T20:00:01.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.860+0000 7f5b36a8b700 1 -- 172.21.15.6:0/2698842158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b30071930 msgr2=0x7f5b300cae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:01.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.860+0000 7f5b36a8b700 1 --2- 172.21.15.6:0/2698842158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b30071930 0x7f5b300cae00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5b3006b290 tx=0x7f5b24009bd0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.860+0000 7f5b36a8b700 1 -- 172.21.15.6:0/2698842158 shutdown_connections 2023-07-06T20:00:01.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.860+0000 7f5b36a8b700 1 --2- 172.21.15.6:0/2698842158 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b30071d00 0x7f5b30157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.860+0000 7f5b36a8b700 1 --2- 172.21.15.6:0/2698842158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b30071930 0x7f5b300cae00 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.860+0000 7f5b36a8b700 1 -- 172.21.15.6:0/2698842158 >> 172.21.15.6:0/2698842158 conn(0x7f5b300cc420 msgr2=0x7f5b300cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:01.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.860+0000 7f5b36a8b700 1 -- 172.21.15.6:0/2698842158 shutdown_connections 2023-07-06T20:00:01.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.860+0000 7f5b36a8b700 1 -- 172.21.15.6:0/2698842158 wait complete. 2023-07-06T20:00:01.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.861+0000 7f5b36a8b700 1 Processor -- start 2023-07-06T20:00:01.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.861+0000 7f5b36a8b700 1 -- start start 2023-07-06T20:00:01.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.862+0000 7f5b36a8b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3006ce60 0x7f5b30155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:01.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.862+0000 7f5b36a8b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b30071930 0x7f5b301597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:01.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.862+0000 7f5b36a8b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b30071d00 0x7f5b300b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:01.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.862+0000 7f5b36a8b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b301557d0 con 0x7f5b3006ce60 2023-07-06T20:00:01.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.862+0000 7f5b36a8b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b301568c0 con 0x7f5b30071930 2023-07-06T20:00:01.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.862+0000 7f5b36a8b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3015ca40 con 0x7f5b30071d00 2023-07-06T20:00:01.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.862+0000 7f5b34827700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3006ce60 0x7f5b30155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:01.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.862+0000 7f5b34827700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3006ce60 0x7f5b30155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60494/0 (socket says 172.21.15.6:60494) 2023-07-06T20:00:01.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.862+0000 7f5b34827700 1 -- 172.21.15.6:0/176765408 learned_addr learned my addr 172.21.15.6:0/176765408 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:01.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.862+0000 7f5b35028700 1 --2- 172.21.15.6:0/176765408 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b30071d00 0x7f5b300b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:01.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.862+0000 7f5b2ffff700 1 --2- 172.21.15.6:0/176765408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b30071930 0x7f5b301597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:01.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.862+0000 7f5b34827700 1 -- 172.21.15.6:0/176765408 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b30071d00 msgr2=0x7f5b300b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:01.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.862+0000 7f5b34827700 1 --2- 172.21.15.6:0/176765408 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b30071d00 0x7f5b300b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.862+0000 7f5b34827700 1 -- 172.21.15.6:0/176765408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b30071930 msgr2=0x7f5b301597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:01.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.862+0000 7f5b34827700 1 --2- 172.21.15.6:0/176765408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b30071930 0x7f5b301597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:01.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.862+0000 7f5b34827700 1 -- 172.21.15.6:0/176765408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b24009550 con 0x7f5b3006ce60 2023-07-06T20:00:01.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.862+0000 7f5b35028700 1 --2- 172.21.15.6:0/176765408 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b30071d00 0x7f5b300b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:01.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.862+0000 7f5b2ffff700 1 --2- 172.21.15.6:0/176765408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b30071930 0x7f5b301597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:01.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.863+0000 7f5b34827700 1 --2- 172.21.15.6:0/176765408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3006ce60 0x7f5b30155290 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5b300c6a20 tx=0x7f5b24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:01.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.863+0000 7f5b2d7fa700 1 -- 172.21.15.6:0/176765408 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b24004400 con 0x7f5b3006ce60 2023-07-06T20:00:01.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.863+0000 7f5b2d7fa700 1 -- 172.21.15.6:0/176765408 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2401f070 con 0x7f5b3006ce60 2023-07-06T20:00:01.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.863+0000 7f5b36a8b700 1 -- 172.21.15.6:0/176765408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3015c1a0 con 0x7f5b3006ce60 2023-07-06T20:00:01.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.863+0000 7f5b2d7fa700 1 -- 172.21.15.6:0/176765408 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b240038c0 con 0x7f5b3006ce60 2023-07-06T20:00:01.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.863+0000 7f5b36a8b700 1 -- 172.21.15.6:0/176765408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3015c760 con 0x7f5b3006ce60 2023-07-06T20:00:01.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.864+0000 7f5b36a8b700 1 -- 172.21.15.6:0/176765408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b30074200 con 0x7f5b3006ce60 2023-07-06T20:00:01.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.864+0000 7f5b2d7fa700 1 -- 172.21.15.6:0/176765408 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5b24021030 con 0x7f5b3006ce60 2023-07-06T20:00:01.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.865+0000 7f5b2d7fa700 1 --2- 172.21.15.6:0/176765408 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f5b1406ace0 0x7f5b1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:01.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.865+0000 7f5b2d7fa700 1 -- 172.21.15.6:0/176765408 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5b2408ab80 con 0x7f5b3006ce60 2023-07-06T20:00:01.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.865+0000 7f5b2ffff700 1 --2- 172.21.15.6:0/176765408 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f5b1406ace0 0x7f5b1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:01.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.865+0000 7f5b2ffff700 1 --2- 172.21.15.6:0/176765408 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f5b1406ace0 0x7f5b1406d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5b300cf530 tx=0x7f5b1c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:01.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:01.869+0000 7f5b2d7fa700 1 -- 172.21.15.6:0/176765408 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5b24055990 con 0x7f5b3006ce60 2023-07-06T20:00:02.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.112+0000 7f5b36a8b700 1 -- 172.21.15.6:0/176765408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b300ca210 con 0x7f5b3006ce60 2023-07-06T20:00:02.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.112+0000 7f5b2d7fa700 1 -- 172.21.15.6:0/176765408 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4652 (secure 0 0 0) 0x7f5b24058fb0 con 0x7f5b3006ce60 2023-07-06T20:00:02.115 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:02.116 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3695014381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3695014381},{"type":"v1","addr":"172.21.15.6:6835","nonce":3695014381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/849399781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":849399781},{"type":"v1","addr":"172.21.15.40:6833","nonce":849399781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/512806705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":512806705},{"type":"v1","addr":"172.21.15.40:6835","nonce":512806705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T19:58:53.158966+0000","modified":"2023-07-06T19:59:17.827616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/368324315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":368324315},{"type":"v1","addr":"172.21.15.6:6837","nonce":368324315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-06T20:00:02.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.114+0000 7f5b36a8b700 1 -- 172.21.15.6:0/176765408 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f5b1406ace0 msgr2=0x7f5b1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:02.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.114+0000 7f5b36a8b700 1 --2- 172.21.15.6:0/176765408 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f5b1406ace0 0x7f5b1406d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5b300cf530 tx=0x7f5b1c009040 comp rx=0 tx=0).stop 2023-07-06T20:00:02.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.114+0000 7f5b36a8b700 1 -- 172.21.15.6:0/176765408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3006ce60 msgr2=0x7f5b30155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:02.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.114+0000 7f5b36a8b700 1 --2- 172.21.15.6:0/176765408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3006ce60 0x7f5b30155290 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5b300c6a20 tx=0x7f5b24004750 comp rx=0 tx=0).stop 2023-07-06T20:00:02.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.115+0000 7f5b36a8b700 1 -- 172.21.15.6:0/176765408 shutdown_connections 2023-07-06T20:00:02.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.115+0000 7f5b36a8b700 1 --2- 172.21.15.6:0/176765408 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f5b1406ace0 0x7f5b1406d190 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.115+0000 7f5b36a8b700 1 --2- 172.21.15.6:0/176765408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3006ce60 0x7f5b30155290 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.115+0000 7f5b36a8b700 1 --2- 172.21.15.6:0/176765408 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5b30071d00 0x7f5b300b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.115+0000 7f5b36a8b700 1 --2- 172.21.15.6:0/176765408 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b30071930 0x7f5b301597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.115+0000 7f5b36a8b700 1 -- 172.21.15.6:0/176765408 >> 172.21.15.6:0/176765408 conn(0x7f5b300cc420 msgr2=0x7f5b300cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:02.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.115+0000 7f5b36a8b700 1 -- 172.21.15.6:0/176765408 shutdown_connections 2023-07-06T20:00:02.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.115+0000 7f5b36a8b700 1 -- 172.21.15.6:0/176765408 wait complete. 2023-07-06T20:00:02.120 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 9 2023-07-06T20:00:02.130 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T20:00:02.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.254+0000 7f9811406700 1 Processor -- start 2023-07-06T20:00:02.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.254+0000 7f9811406700 1 -- start start 2023-07-06T20:00:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.255+0000 7f9811406700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f980c0ceab0 0x7f980c0caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:02.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.255+0000 7f9811406700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f980c0cee80 0x7f980c0716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.255+0000 7f9811406700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980c160ff0 con 0x7f980c071c00 2023-07-06T20:00:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.255+0000 7f9811406700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c0cb400 con 0x7f980c0ceab0 2023-07-06T20:00:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.255+0000 7f9811406700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c072020 con 0x7f980c0cee80 2023-07-06T20:00:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.255+0000 7f980affd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f980c0ceab0 0x7f980c0caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.255+0000 7f980b7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f980c071c00 0x7f980c1602c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33480/0 (socket says 172.21.15.6:33480) 2023-07-06T20:00:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.255+0000 7f980b7fe700 1 -- 172.21.15.6:0/4125149112 learned_addr learned my addr 172.21.15.6:0/4125149112 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:02.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.255+0000 7f980a7fc700 1 --2- 172.21.15.6:0/4125149112 >> v2:172.21.15.40:3300/0 conn(0x7f980c0cee80 0x7f980c0716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:02.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.256+0000 7f980affd700 1 -- 172.21.15.6:0/4125149112 >> v2:172.21.15.40:3300/0 conn(0x7f980c0cee80 msgr2=0x7f980c0716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:02.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.256+0000 7f980affd700 1 --2- 172.21.15.6:0/4125149112 >> v2:172.21.15.40:3300/0 conn(0x7f980c0cee80 0x7f980c0716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.256+0000 7f980affd700 1 -- 172.21.15.6:0/4125149112 >> v1:172.21.15.6:6789/0 conn(0x7f980c071c00 legacy=0x7f980c1602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:02.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.256+0000 7f980affd700 1 -- 172.21.15.6:0/4125149112 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c0ca100 con 0x7f980c0ceab0 2023-07-06T20:00:02.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.256+0000 7f9809ffb700 1 -- 172.21.15.6:0/4125149112 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827581531 0 0) 0x7f980c160ff0 con 0x7f980c071c00 2023-07-06T20:00:02.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.256+0000 7f980affd700 1 --2- 172.21.15.6:0/4125149112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f980c0ceab0 0x7f980c0caec0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f980c0727a0 tx=0x7f9800009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c8fb8b8cd2ddfd server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:02.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.256+0000 7f9809ffb700 1 -- 172.21.15.6:0/4125149112 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800011830 con 0x7f980c0ceab0 2023-07-06T20:00:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.256+0000 7f9809ffb700 1 -- 172.21.15.6:0/4125149112 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9800011990 con 0x7f980c0ceab0 2023-07-06T20:00:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.256+0000 7f9809ffb700 1 -- 172.21.15.6:0/4125149112 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800011d20 con 0x7f980c0ceab0 2023-07-06T20:00:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.256+0000 7f9811406700 1 -- 172.21.15.6:0/4125149112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f980c0ceab0 msgr2=0x7f980c0caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.256+0000 7f9811406700 1 --2- 172.21.15.6:0/4125149112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f980c0ceab0 0x7f980c0caec0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f980c0727a0 tx=0x7f9800009b20 comp rx=0 tx=0).stop 2023-07-06T20:00:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.256+0000 7f9811406700 1 -- 172.21.15.6:0/4125149112 shutdown_connections 2023-07-06T20:00:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.256+0000 7f9811406700 1 --2- 172.21.15.6:0/4125149112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f980c0ceab0 0x7f980c0caec0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.256+0000 7f9811406700 1 --2- 172.21.15.6:0/4125149112 >> v2:172.21.15.40:3300/0 conn(0x7f980c0cee80 0x7f980c0716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.257+0000 7f9811406700 1 -- 172.21.15.6:0/4125149112 >> 172.21.15.6:0/4125149112 conn(0x7f980c0cc420 msgr2=0x7f980c0cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:02.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.257+0000 7f9811406700 1 -- 172.21.15.6:0/4125149112 shutdown_connections 2023-07-06T20:00:02.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.257+0000 7f9811406700 1 -- 172.21.15.6:0/4125149112 wait complete. 2023-07-06T20:00:02.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.258+0000 7f9811406700 1 Processor -- start 2023-07-06T20:00:02.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.258+0000 7f9811406700 1 -- start start 2023-07-06T20:00:02.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.259+0000 7f9811406700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f980c071c00 0x7f980c1564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:02.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.259+0000 7f9811406700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f980c0ceab0 0x7f980c146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:02.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.259+0000 7f9811406700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f980c0cee80 0x7f980c1f0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:02.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.259+0000 7f9811406700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c1478d0 con 0x7f980c0ceab0 2023-07-06T20:00:02.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.259+0000 7f9811406700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c0c6510 con 0x7f980c071c00 2023-07-06T20:00:02.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.259+0000 7f9811406700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c156a10 con 0x7f980c0cee80 2023-07-06T20:00:02.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.259+0000 7f980a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f980c0ceab0 0x7f980c146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:02.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.259+0000 7f980a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f980c0ceab0 0x7f980c146bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60508/0 (socket says 172.21.15.6:60508) 2023-07-06T20:00:02.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.259+0000 7f980a7fc700 1 -- 172.21.15.6:0/1735277044 learned_addr learned my addr 172.21.15.6:0/1735277044 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:02.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.259+0000 7f980b7fe700 1 --2- 172.21.15.6:0/1735277044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f980c0cee80 0x7f980c1f0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:02.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.259+0000 7f980affd700 1 --2- 172.21.15.6:0/1735277044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f980c071c00 0x7f980c1564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:02.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.259+0000 7f980a7fc700 1 -- 172.21.15.6:0/1735277044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f980c0cee80 msgr2=0x7f980c1f0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:02.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.259+0000 7f980a7fc700 1 --2- 172.21.15.6:0/1735277044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f980c0cee80 0x7f980c1f0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.259+0000 7f980a7fc700 1 -- 172.21.15.6:0/1735277044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f980c071c00 msgr2=0x7f980c1564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:02.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.259+0000 7f980a7fc700 1 --2- 172.21.15.6:0/1735277044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f980c071c00 0x7f980c1564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.259+0000 7f980a7fc700 1 -- 172.21.15.6:0/1735277044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98000094a0 con 0x7f980c0ceab0 2023-07-06T20:00:02.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.259+0000 7f980a7fc700 1 --2- 172.21.15.6:0/1735277044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f980c0ceab0 0x7f980c146bb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f97fc00e9d0 tx=0x7f97fc00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:02.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.259+0000 7f97f37fe700 1 -- 172.21.15.6:0/1735277044 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc009730 con 0x7f980c0ceab0 2023-07-06T20:00:02.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.259+0000 7f97f37fe700 1 -- 172.21.15.6:0/1735277044 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc00c850 con 0x7f980c0ceab0 2023-07-06T20:00:02.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.259+0000 7f9811406700 1 -- 172.21.15.6:0/1735277044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f980c0b5750 con 0x7f980c0ceab0 2023-07-06T20:00:02.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.259+0000 7f97f37fe700 1 -- 172.21.15.6:0/1735277044 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc00cbe0 con 0x7f980c0ceab0 2023-07-06T20:00:02.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.259+0000 7f9811406700 1 -- 172.21.15.6:0/1735277044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980c0b4e20 con 0x7f980c0ceab0 2023-07-06T20:00:02.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.260+0000 7f9811406700 1 -- 172.21.15.6:0/1735277044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f980c06ad00 con 0x7f980c0ceab0 2023-07-06T20:00:02.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.261+0000 7f97f37fe700 1 -- 172.21.15.6:0/1735277044 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f97fc013470 con 0x7f980c0ceab0 2023-07-06T20:00:02.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.261+0000 7f97f37fe700 1 --2- 172.21.15.6:0/1735277044 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f97f806ace0 0x7f97f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:02.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.261+0000 7f97f37fe700 1 -- 172.21.15.6:0/1735277044 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f97fc089900 con 0x7f980c0ceab0 2023-07-06T20:00:02.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.261+0000 7f980affd700 1 --2- 172.21.15.6:0/1735277044 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f97f806ace0 0x7f97f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:02.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.262+0000 7f980affd700 1 --2- 172.21.15.6:0/1735277044 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f97f806ace0 0x7f97f806d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f98000090b0 tx=0x7f9800008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:02.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.266+0000 7f97f37fe700 1 -- 172.21.15.6:0/1735277044 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f980c06ad00 con 0x7f980c0ceab0 2023-07-06T20:00:02.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.463+0000 7f9811406700 1 -- 172.21.15.6:0/1735277044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f980c06ad00 con 0x7f980c0ceab0 2023-07-06T20:00:02.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.465+0000 7f97f37fe700 1 -- 172.21.15.6:0/1735277044 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20059 (secure 0 0 0) 0x7f980c06ad00 con 0x7f980c0ceab0 2023-07-06T20:00:02.468 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:02.468 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":29,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:59:33.917851+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T19:58:51.062712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T19:58:52.130350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T19:58:55.785128+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T20:00:02.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.467+0000 7f9811406700 1 -- 172.21.15.6:0/1735277044 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f97f806ace0 msgr2=0x7f97f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:02.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.467+0000 7f9811406700 1 --2- 172.21.15.6:0/1735277044 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f97f806ace0 0x7f97f806d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f98000090b0 tx=0x7f9800008030 comp rx=0 tx=0).stop 2023-07-06T20:00:02.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.467+0000 7f9811406700 1 -- 172.21.15.6:0/1735277044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f980c0ceab0 msgr2=0x7f980c146bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:02.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.467+0000 7f9811406700 1 --2- 172.21.15.6:0/1735277044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f980c0ceab0 0x7f980c146bb0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f97fc00e9d0 tx=0x7f97fc00ed90 comp rx=0 tx=0).stop 2023-07-06T20:00:02.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.467+0000 7f9811406700 1 -- 172.21.15.6:0/1735277044 shutdown_connections 2023-07-06T20:00:02.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.467+0000 7f9811406700 1 --2- 172.21.15.6:0/1735277044 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f97f806ace0 0x7f97f806d190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.467+0000 7f9811406700 1 --2- 172.21.15.6:0/1735277044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f980c0cee80 0x7f980c1f0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.467+0000 7f9811406700 1 --2- 172.21.15.6:0/1735277044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f980c071c00 0x7f980c1564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.467+0000 7f9811406700 1 --2- 172.21.15.6:0/1735277044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f980c0ceab0 0x7f980c146bb0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.467+0000 7f9811406700 1 -- 172.21.15.6:0/1735277044 >> 172.21.15.6:0/1735277044 conn(0x7f980c0cc420 msgr2=0x7f980c06d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:02.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.467+0000 7f9811406700 1 -- 172.21.15.6:0/1735277044 shutdown_connections 2023-07-06T20:00:02.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.467+0000 7f9811406700 1 -- 172.21.15.6:0/1735277044 wait complete. 2023-07-06T20:00:02.491 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T19:58:38.767727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T19:58:45.759808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T19:58:51.062712+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T19:58:52.130350+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-06T19:58:55.785128+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-06T20:00:02.493 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T20:00:02.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.619+0000 7f1a7dae1700 1 Processor -- start 2023-07-06T20:00:02.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.619+0000 7f1a7dae1700 1 -- start start 2023-07-06T20:00:02.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.620+0000 7f1a7dae1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1a780aef10 0x7f1a7815b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:02.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.620+0000 7f1a7dae1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a7815de10 0x7f1a7815e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:02.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.620+0000 7f1a7dae1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1a78071690 0x7f1a78071b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:02.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.620+0000 7f1a7dae1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a78072070 con 0x7f1a780aef10 2023-07-06T20:00:02.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.620+0000 7f1a7dae1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a78151750 con 0x7f1a78071690 2023-07-06T20:00:02.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.620+0000 7f1a7dae1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7815e890 con 0x7f1a7815de10 2023-07-06T20:00:02.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.620+0000 7f1a777fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1a780aef10 0x7f1a7815b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:02.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.620+0000 7f1a777fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1a780aef10 0x7f1a7815b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60514/0 (socket says 172.21.15.6:60514) 2023-07-06T20:00:02.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.620+0000 7f1a777fe700 1 -- 172.21.15.6:0/3658751991 learned_addr learned my addr 172.21.15.6:0/3658751991 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:02.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.620+0000 7f1a76ffd700 1 --2- 172.21.15.6:0/3658751991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a7815de10 0x7f1a7815e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:02.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.620+0000 7f1a77fff700 1 --2- 172.21.15.6:0/3658751991 >> v2:172.21.15.40:3300/0 conn(0x7f1a78071690 0x7f1a78071b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:02.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.620+0000 7f1a777fe700 1 -- 172.21.15.6:0/3658751991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a7815de10 msgr2=0x7f1a7815e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:02.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.620+0000 7f1a777fe700 1 --2- 172.21.15.6:0/3658751991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a7815de10 0x7f1a7815e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.620+0000 7f1a777fe700 1 -- 172.21.15.6:0/3658751991 >> v2:172.21.15.40:3300/0 conn(0x7f1a78071690 msgr2=0x7f1a78071b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:02.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.620+0000 7f1a777fe700 1 --2- 172.21.15.6:0/3658751991 >> v2:172.21.15.40:3300/0 conn(0x7f1a78071690 0x7f1a78071b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.620+0000 7f1a777fe700 1 -- 172.21.15.6:0/3658751991 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7815eb70 con 0x7f1a780aef10 2023-07-06T20:00:02.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.620+0000 7f1a76ffd700 1 --2- 172.21.15.6:0/3658751991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a7815de10 0x7f1a7815e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:02.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.620+0000 7f1a77fff700 1 --2- 172.21.15.6:0/3658751991 >> v2:172.21.15.40:3300/0 conn(0x7f1a78071690 0x7f1a78071b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:02.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.621+0000 7f1a777fe700 1 --2- 172.21.15.6:0/3658751991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a780aef10 0x7f1a7815b370 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1a7806a9d0 tx=0x7f1a6c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738fec5a8d8e6071 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:02.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.621+0000 7f1a767fc700 1 -- 172.21.15.6:0/3658751991 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c00b870 con 0x7f1a780aef10 2023-07-06T20:00:02.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.621+0000 7f1a767fc700 1 -- 172.21.15.6:0/3658751991 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6c00b9d0 con 0x7f1a780aef10 2023-07-06T20:00:02.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.621+0000 7f1a767fc700 1 -- 172.21.15.6:0/3658751991 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c00bd60 con 0x7f1a780aef10 2023-07-06T20:00:02.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.621+0000 7f1a7dae1700 1 -- 172.21.15.6:0/3658751991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a780aef10 msgr2=0x7f1a7815b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:02.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.621+0000 7f1a7dae1700 1 --2- 172.21.15.6:0/3658751991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a780aef10 0x7f1a7815b370 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1a7806a9d0 tx=0x7f1a6c009bd0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.621+0000 7f1a7dae1700 1 -- 172.21.15.6:0/3658751991 shutdown_connections 2023-07-06T20:00:02.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.621+0000 7f1a7dae1700 1 --2- 172.21.15.6:0/3658751991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a780aef10 0x7f1a7815b370 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.621+0000 7f1a7dae1700 1 --2- 172.21.15.6:0/3658751991 >> v2:172.21.15.40:3300/0 conn(0x7f1a78071690 0x7f1a78071b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.621+0000 7f1a7dae1700 1 --2- 172.21.15.6:0/3658751991 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a7815de10 0x7f1a7815e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.621+0000 7f1a7dae1700 1 -- 172.21.15.6:0/3658751991 >> 172.21.15.6:0/3658751991 conn(0x7f1a780cf960 msgr2=0x7f1a780cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:02.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.621+0000 7f1a7dae1700 1 -- 172.21.15.6:0/3658751991 shutdown_connections 2023-07-06T20:00:02.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.621+0000 7f1a7dae1700 1 -- 172.21.15.6:0/3658751991 wait complete. 2023-07-06T20:00:02.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.623+0000 7f1a7dae1700 1 Processor -- start 2023-07-06T20:00:02.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.623+0000 7f1a7dae1700 1 -- start start 2023-07-06T20:00:02.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.624+0000 7f1a7dae1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a78071690 0x7f1a7814b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:02.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.624+0000 7f1a7dae1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a780aef10 0x7f1a781e6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:02.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.624+0000 7f1a7dae1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a7815de10 0x7f1a78148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:02.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.624+0000 7f1a7dae1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a780c2f70 con 0x7f1a780aef10 2023-07-06T20:00:02.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.624+0000 7f1a7dae1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a780b0b70 con 0x7f1a78071690 2023-07-06T20:00:02.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.624+0000 7f1a7dae1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a780b0e50 con 0x7f1a7815de10 2023-07-06T20:00:02.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.624+0000 7f1a76ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a780aef10 0x7f1a781e6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:02.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.624+0000 7f1a76ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a780aef10 0x7f1a781e6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60522/0 (socket says 172.21.15.6:60522) 2023-07-06T20:00:02.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.624+0000 7f1a76ffd700 1 -- 172.21.15.6:0/1984297324 learned_addr learned my addr 172.21.15.6:0/1984297324 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:02.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.625+0000 7f1a77fff700 1 --2- 172.21.15.6:0/1984297324 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a7815de10 0x7f1a78148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:02.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.625+0000 7f1a777fe700 1 --2- 172.21.15.6:0/1984297324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a78071690 0x7f1a7814b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:02.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.625+0000 7f1a76ffd700 1 -- 172.21.15.6:0/1984297324 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a7815de10 msgr2=0x7f1a78148720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:02.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.625+0000 7f1a76ffd700 1 --2- 172.21.15.6:0/1984297324 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a7815de10 0x7f1a78148720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.625+0000 7f1a76ffd700 1 -- 172.21.15.6:0/1984297324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a78071690 msgr2=0x7f1a7814b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:02.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.625+0000 7f1a76ffd700 1 --2- 172.21.15.6:0/1984297324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a78071690 0x7f1a7814b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.625+0000 7f1a76ffd700 1 -- 172.21.15.6:0/1984297324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6c009550 con 0x7f1a780aef10 2023-07-06T20:00:02.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.625+0000 7f1a76ffd700 1 --2- 172.21.15.6:0/1984297324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a780aef10 0x7f1a781e6660 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800e810 tx=0x7f1a6800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:02.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.625+0000 7f1a5ffff700 1 -- 172.21.15.6:0/1984297324 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a68013610 con 0x7f1a780aef10 2023-07-06T20:00:02.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.625+0000 7f1a5ffff700 1 -- 172.21.15.6:0/1984297324 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a68013770 con 0x7f1a780aef10 2023-07-06T20:00:02.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.625+0000 7f1a7dae1700 1 -- 172.21.15.6:0/1984297324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a780b1130 con 0x7f1a780aef10 2023-07-06T20:00:02.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.625+0000 7f1a5ffff700 1 -- 172.21.15.6:0/1984297324 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a68013b20 con 0x7f1a780aef10 2023-07-06T20:00:02.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.625+0000 7f1a7dae1700 1 -- 172.21.15.6:0/1984297324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a780b0820 con 0x7f1a780aef10 2023-07-06T20:00:02.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.626+0000 7f1a7dae1700 1 -- 172.21.15.6:0/1984297324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a7804eb90 con 0x7f1a780aef10 2023-07-06T20:00:02.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.626+0000 7f1a5ffff700 1 -- 172.21.15.6:0/1984297324 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1a68013c80 con 0x7f1a780aef10 2023-07-06T20:00:02.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.627+0000 7f1a5ffff700 1 --2- 172.21.15.6:0/1984297324 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1a6406ace0 0x7f1a6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:02.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.627+0000 7f1a5ffff700 1 -- 172.21.15.6:0/1984297324 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1a680894b0 con 0x7f1a780aef10 2023-07-06T20:00:02.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.627+0000 7f1a777fe700 1 --2- 172.21.15.6:0/1984297324 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1a6406ace0 0x7f1a6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:02.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.627+0000 7f1a777fe700 1 --2- 172.21.15.6:0/1984297324 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1a6406ace0 0x7f1a6406d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c009c10 tx=0x7f1a6c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:02.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.632+0000 7f1a5ffff700 1 -- 172.21.15.6:0/1984297324 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1a680541a0 con 0x7f1a780aef10 2023-07-06T20:00:02.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.828+0000 7f1a7dae1700 1 -- 172.21.15.6:0/1984297324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1a780ca250 con 0x7f1a780aef10 2023-07-06T20:00:02.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.829+0000 7f1a5ffff700 1 -- 172.21.15.6:0/1984297324 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1a680577c0 con 0x7f1a780aef10 2023-07-06T20:00:02.831 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-06T20:00:02.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.831+0000 7f1a7dae1700 1 -- 172.21.15.6:0/1984297324 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1a6406ace0 msgr2=0x7f1a6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:02.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.831+0000 7f1a7dae1700 1 --2- 172.21.15.6:0/1984297324 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1a6406ace0 0x7f1a6406d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c009c10 tx=0x7f1a6c008030 comp rx=0 tx=0).stop 2023-07-06T20:00:02.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.831+0000 7f1a7dae1700 1 -- 172.21.15.6:0/1984297324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a780aef10 msgr2=0x7f1a781e6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:02.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.831+0000 7f1a7dae1700 1 --2- 172.21.15.6:0/1984297324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a780aef10 0x7f1a781e6660 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800e810 tx=0x7f1a6800ebd0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.832+0000 7f1a7dae1700 1 -- 172.21.15.6:0/1984297324 shutdown_connections 2023-07-06T20:00:02.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.832+0000 7f1a7dae1700 1 --2- 172.21.15.6:0/1984297324 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1a6406ace0 0x7f1a6406d190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.832+0000 7f1a7dae1700 1 --2- 172.21.15.6:0/1984297324 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1a7815de10 0x7f1a78148720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.832+0000 7f1a7dae1700 1 --2- 172.21.15.6:0/1984297324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1a78071690 0x7f1a7814b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.832+0000 7f1a7dae1700 1 --2- 172.21.15.6:0/1984297324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a780aef10 0x7f1a781e6660 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.832+0000 7f1a7dae1700 1 -- 172.21.15.6:0/1984297324 >> 172.21.15.6:0/1984297324 conn(0x7f1a780cf960 msgr2=0x7f1a780ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:02.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.832+0000 7f1a7dae1700 1 -- 172.21.15.6:0/1984297324 shutdown_connections 2023-07-06T20:00:02.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.832+0000 7f1a7dae1700 1 -- 172.21.15.6:0/1984297324 wait complete. 2023-07-06T20:00:02.851 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T20:00:02.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.979+0000 7f5378b85700 1 Processor -- start 2023-07-06T20:00:02.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.979+0000 7f5378b85700 1 -- start start 2023-07-06T20:00:02.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f5378b85700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53740ca850 0x7f537415bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:02.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f5378b85700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5374071cd0 0x7f537415c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:02.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f5378b85700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53740cb310 con 0x7f5374071900 2023-07-06T20:00:02.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f5378b85700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53740cdbf0 con 0x7f5374071cd0 2023-07-06T20:00:02.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f5378b85700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537415c9d0 con 0x7f53740ca850 2023-07-06T20:00:02.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f537259c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5374071900 0x7f53740ca140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33504/0 (socket says 172.21.15.6:33504) 2023-07-06T20:00:02.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f537259c700 1 -- 172.21.15.6:0/4206706234 learned_addr learned my addr 172.21.15.6:0/4206706234 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:02.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f5372d9d700 1 --2- 172.21.15.6:0/4206706234 >> v2:172.21.15.40:3300/0 conn(0x7f5374071cd0 0x7f537415c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:02.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f5371d9b700 1 --2- 172.21.15.6:0/4206706234 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53740ca850 0x7f537415bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:02.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f537159a700 1 -- 172.21.15.6:0/4206706234 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198212679 0 0) 0x7f53740cb310 con 0x7f5374071900 2023-07-06T20:00:02.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f537159a700 1 -- 172.21.15.6:0/4206706234 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53600035b0 con 0x7f5374071900 2023-07-06T20:00:02.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f537159a700 1 -- 172.21.15.6:0/4206706234 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 103153615 0 0) 0x7f53600035b0 con 0x7f5374071900 2023-07-06T20:00:02.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f537159a700 1 -- 172.21.15.6:0/4206706234 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53740ca850 msgr2=0x7f537415bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:02.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f537159a700 1 --2- 172.21.15.6:0/4206706234 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53740ca850 0x7f537415bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f537159a700 1 -- 172.21.15.6:0/4206706234 >> v2:172.21.15.40:3300/0 conn(0x7f5374071cd0 msgr2=0x7f537415c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:02.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f537159a700 1 --2- 172.21.15.6:0/4206706234 >> v2:172.21.15.40:3300/0 conn(0x7f5374071cd0 0x7f537415c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:02.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f537159a700 1 -- 172.21.15.6:0/4206706234 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53740af070 con 0x7f5374071900 2023-07-06T20:00:02.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f537159a700 1 -- 172.21.15.6:0/4206706234 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f535c001670 con 0x7f5374071900 2023-07-06T20:00:02.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f5372d9d700 1 --2- 172.21.15.6:0/4206706234 >> v2:172.21.15.40:3300/0 conn(0x7f5374071cd0 0x7f537415c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T20:00:02.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f537159a700 1 -- 172.21.15.6:0/4206706234 >> v1:172.21.15.6:6789/0 conn(0x7f5374071900 legacy=0x7f53740ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:02.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f537159a700 1 --2- 172.21.15.6:0/4206706234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5360003a00 0x7f5360003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:02.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f537159a700 1 --2- 172.21.15.6:0/4206706234 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53740ca850 0x7f5360004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:02.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f537159a700 1 --2- 172.21.15.6:0/4206706234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5360004d90 0x7f5360005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:02.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f537159a700 1 -- 172.21.15.6:0/4206706234 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53740cdbf0 con 0x7f5360003a00 2023-07-06T20:00:02.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.980+0000 7f537159a700 1 -- 172.21.15.6:0/4206706234 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537415c9d0 con 0x7f5360004d90 2023-07-06T20:00:02.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.981+0000 7f537159a700 1 -- 172.21.15.6:0/4206706234 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536000ba90 con 0x7f53740ca850 2023-07-06T20:00:02.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.981+0000 7f537259c700 1 --2- 172.21.15.6:0/4206706234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5360003a00 0x7f5360003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:02.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.981+0000 7f5372d9d700 1 --2- 172.21.15.6:0/4206706234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5360004d90 0x7f5360005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:02.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.981+0000 7f5371d9b700 1 --2- 172.21.15.6:0/4206706234 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53740ca850 0x7f5360004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:02.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.981+0000 7f537259c700 1 -- 172.21.15.6:0/4206706234 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53740ca850 msgr2=0x7f5360004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:02.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.981+0000 7f537259c700 1 --2- 172.21.15.6:0/4206706234 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f53740ca850 0x7f5360004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.981+0000 7f537259c700 1 -- 172.21.15.6:0/4206706234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5360004d90 msgr2=0x7f5360005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:03.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.981+0000 7f537259c700 1 --2- 172.21.15.6:0/4206706234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5360004d90 0x7f5360005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.981+0000 7f537259c700 1 -- 172.21.15.6:0/4206706234 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53600035b0 con 0x7f5360003a00 2023-07-06T20:00:03.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.981+0000 7f5372d9d700 1 --2- 172.21.15.6:0/4206706234 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5360004d90 0x7f5360005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:03.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.981+0000 7f537259c700 1 --2- 172.21.15.6:0/4206706234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5360003a00 0x7f5360003e10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f535c00c2f0 tx=0x7f5360005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9950d67eaf236685 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:03.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.981+0000 7f537159a700 1 -- 172.21.15.6:0/4206706234 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c00ce30 con 0x7f5360003a00 2023-07-06T20:00:03.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.981+0000 7f537159a700 1 -- 172.21.15.6:0/4206706234 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535c005960 con 0x7f5360003a00 2023-07-06T20:00:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.981+0000 7f537159a700 1 -- 172.21.15.6:0/4206706234 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c005d10 con 0x7f5360003a00 2023-07-06T20:00:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.982+0000 7f5378b85700 1 -- 172.21.15.6:0/4206706234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5360003a00 msgr2=0x7f5360003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.982+0000 7f5378b85700 1 --2- 172.21.15.6:0/4206706234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5360003a00 0x7f5360003e10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f535c00c2f0 tx=0x7f5360005880 comp rx=0 tx=0).stop 2023-07-06T20:00:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.982+0000 7f5372d9d700 1 -- 172.21.15.6:0/4206706234 reap_dead start 2023-07-06T20:00:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.982+0000 7f5378b85700 1 -- 172.21.15.6:0/4206706234 shutdown_connections 2023-07-06T20:00:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.982+0000 7f5378b85700 1 -- 172.21.15.6:0/4206706234 >> 172.21.15.6:0/4206706234 conn(0x7f53740cf960 msgr2=0x7f53740cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.982+0000 7f5378b85700 1 -- 172.21.15.6:0/4206706234 shutdown_connections 2023-07-06T20:00:03.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.982+0000 7f5378b85700 1 -- 172.21.15.6:0/4206706234 wait complete. 2023-07-06T20:00:03.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.983+0000 7f5378b85700 1 Processor -- start 2023-07-06T20:00:03.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.983+0000 7f5378b85700 1 -- start start 2023-07-06T20:00:03.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.984+0000 7f5378b85700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5360003a00 0x7f537414bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:03.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.984+0000 7f5378b85700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53740c75e0 0x7f53740c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:03.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.984+0000 7f5378b85700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53740c37c0 0x7f53740c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:03.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.984+0000 7f5378b85700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53740c41a0 con 0x7f53740c75e0 2023-07-06T20:00:03.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.984+0000 7f5378b85700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53740c6130 con 0x7f53740c37c0 2023-07-06T20:00:03.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.984+0000 7f5378b85700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53740c6410 con 0x7f5360003a00 2023-07-06T20:00:03.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.984+0000 7f5371d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53740c75e0 0x7f53740c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:03.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.984+0000 7f5371d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53740c75e0 0x7f53740c57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60540/0 (socket says 172.21.15.6:60540) 2023-07-06T20:00:03.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.984+0000 7f5371d9b700 1 -- 172.21.15.6:0/2264755326 learned_addr learned my addr 172.21.15.6:0/2264755326 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:03.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.984+0000 7f5371d9b700 1 -- 172.21.15.6:0/2264755326 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5360003a00 msgr2=0x7f537414bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:03.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.984+0000 7f5371d9b700 1 --2- 172.21.15.6:0/2264755326 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5360003a00 0x7f537414bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.984+0000 7f5371d9b700 1 -- 172.21.15.6:0/2264755326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53740c37c0 msgr2=0x7f53740c3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.984+0000 7f5372d9d700 1 --2- 172.21.15.6:0/2264755326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53740c37c0 0x7f53740c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.984+0000 7f5371d9b700 1 --2- 172.21.15.6:0/2264755326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53740c37c0 0x7f53740c3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.984+0000 7f5371d9b700 1 -- 172.21.15.6:0/2264755326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53740c8010 con 0x7f53740c75e0 2023-07-06T20:00:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.985+0000 7f5371d9b700 1 --2- 172.21.15.6:0/2264755326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53740c75e0 0x7f53740c57e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5364011600 tx=0x7f53640119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.985+0000 7f536affd700 1 -- 172.21.15.6:0/2264755326 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5364004220 con 0x7f53740c75e0 2023-07-06T20:00:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.985+0000 7f536affd700 1 -- 172.21.15.6:0/2264755326 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5364004380 con 0x7f53740c75e0 2023-07-06T20:00:03.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.985+0000 7f5378b85700 1 -- 172.21.15.6:0/2264755326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53740c82f0 con 0x7f53740c75e0 2023-07-06T20:00:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.985+0000 7f536affd700 1 -- 172.21.15.6:0/2264755326 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53640036a0 con 0x7f53740c75e0 2023-07-06T20:00:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.985+0000 7f5378b85700 1 -- 172.21.15.6:0/2264755326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53740c5d20 con 0x7f53740c75e0 2023-07-06T20:00:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.986+0000 7f5378b85700 1 -- 172.21.15.6:0/2264755326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53740c7e60 con 0x7f53740c75e0 2023-07-06T20:00:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.986+0000 7f536affd700 1 -- 172.21.15.6:0/2264755326 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5364003800 con 0x7f53740c75e0 2023-07-06T20:00:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.987+0000 7f536affd700 1 --2- 172.21.15.6:0/2264755326 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f535406ace0 0x7f535406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.987+0000 7f536affd700 1 -- 172.21.15.6:0/2264755326 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5364089800 con 0x7f53740c75e0 2023-07-06T20:00:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.987+0000 7f537259c700 1 --2- 172.21.15.6:0/2264755326 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f535406ace0 0x7f535406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:03.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.987+0000 7f537259c700 1 --2- 172.21.15.6:0/2264755326 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f535406ace0 0x7f535406d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f535c015040 tx=0x7f535c00f000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:03.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:02.991+0000 7f536affd700 1 -- 172.21.15.6:0/2264755326 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f53640580a0 con 0x7f53740c75e0 2023-07-06T20:00:03.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.187+0000 7f5378b85700 1 -- 172.21.15.6:0/2264755326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f537404eb90 con 0x7f53740c75e0 2023-07-06T20:00:03.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.188+0000 7f536affd700 1 -- 172.21.15.6:0/2264755326 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5364057c30 con 0x7f53740c75e0 2023-07-06T20:00:03.190 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-06T20:00:03.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.190+0000 7f5378b85700 1 -- 172.21.15.6:0/2264755326 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f535406ace0 msgr2=0x7f535406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:03.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.190+0000 7f5378b85700 1 --2- 172.21.15.6:0/2264755326 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f535406ace0 0x7f535406d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f535c015040 tx=0x7f535c00f000 comp rx=0 tx=0).stop 2023-07-06T20:00:03.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.190+0000 7f5378b85700 1 -- 172.21.15.6:0/2264755326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53740c75e0 msgr2=0x7f53740c57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:03.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.190+0000 7f5378b85700 1 --2- 172.21.15.6:0/2264755326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53740c75e0 0x7f53740c57e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5364011600 tx=0x7f53640119c0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.190+0000 7f5378b85700 1 -- 172.21.15.6:0/2264755326 shutdown_connections 2023-07-06T20:00:03.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.190+0000 7f5378b85700 1 --2- 172.21.15.6:0/2264755326 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f535406ace0 0x7f535406d190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.190+0000 7f5378b85700 1 --2- 172.21.15.6:0/2264755326 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f53740c37c0 0x7f53740c3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.190+0000 7f5378b85700 1 --2- 172.21.15.6:0/2264755326 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f5360003a00 0x7f537414bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.190+0000 7f5378b85700 1 --2- 172.21.15.6:0/2264755326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53740c75e0 0x7f53740c57e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.190+0000 7f5378b85700 1 -- 172.21.15.6:0/2264755326 >> 172.21.15.6:0/2264755326 conn(0x7f53740cf960 msgr2=0x7f537415dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:03.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.190+0000 7f5378b85700 1 -- 172.21.15.6:0/2264755326 shutdown_connections 2023-07-06T20:00:03.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.190+0000 7f5378b85700 1 -- 172.21.15.6:0/2264755326 wait complete. 2023-07-06T20:00:03.204 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-06T20:00:03.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.330+0000 7fb8fc2a9700 1 Processor -- start 2023-07-06T20:00:03.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.330+0000 7fb8fc2a9700 1 -- start start 2023-07-06T20:00:03.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.331+0000 7fb8fc2a9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb8f4071900 0x7fb8f40ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:03.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.332+0000 7fb8fc2a9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb8f415c660 0x7fb8f40ca680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:03.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.332+0000 7fb8fc2a9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f40cb310 con 0x7fb8f4071cd0 2023-07-06T20:00:03.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.332+0000 7fb8fc2a9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f40cdbf0 con 0x7fb8f4071900 2023-07-06T20:00:03.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.332+0000 7fb8fc2a9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f40af070 con 0x7fb8f415c660 2023-07-06T20:00:03.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.332+0000 7fb8fa045700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb8f4071900 0x7fb8f40ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:03.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.332+0000 7fb8fa045700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb8f4071900 0x7fb8f40ca140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60548/0 (socket says 172.21.15.6:60548) 2023-07-06T20:00:03.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.332+0000 7fb8fa045700 1 -- 172.21.15.6:0/539260179 learned_addr learned my addr 172.21.15.6:0/539260179 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:03.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.332+0000 7fb8fa846700 1 --2- 172.21.15.6:0/539260179 >> v2:172.21.15.40:3300/0 conn(0x7fb8f415c660 0x7fb8f40ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:03.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.332+0000 7fb8fa045700 1 -- 172.21.15.6:0/539260179 >> v2:172.21.15.40:3300/0 conn(0x7fb8f415c660 msgr2=0x7fb8f40ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:03.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.332+0000 7fb8fa045700 1 --2- 172.21.15.6:0/539260179 >> v2:172.21.15.40:3300/0 conn(0x7fb8f415c660 0x7fb8f40ca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.332+0000 7fb8fa045700 1 -- 172.21.15.6:0/539260179 >> v1:172.21.15.40:6789/0 conn(0x7fb8f4071cd0 legacy=0x7fb8f415bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:03.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.332+0000 7fb8fa045700 1 -- 172.21.15.6:0/539260179 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f40cad50 con 0x7fb8f4071900 2023-07-06T20:00:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.332+0000 7fb8fa045700 1 --2- 172.21.15.6:0/539260179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8f4071900 0x7fb8f40ca140 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb8f40cbfe0 tx=0x7fb8e4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f774cb1a4bb51520 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.332+0000 7fb8f9043700 1 -- 172.21.15.6:0/539260179 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400b870 con 0x7fb8f4071900 2023-07-06T20:00:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.332+0000 7fb8f9043700 1 -- 172.21.15.6:0/539260179 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e400b9d0 con 0x7fb8f4071900 2023-07-06T20:00:03.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.332+0000 7fb8f9043700 1 -- 172.21.15.6:0/539260179 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400bd60 con 0x7fb8f4071900 2023-07-06T20:00:03.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.333+0000 7fb8fc2a9700 1 -- 172.21.15.6:0/539260179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8f4071900 msgr2=0x7fb8f40ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:03.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.333+0000 7fb8fc2a9700 1 --2- 172.21.15.6:0/539260179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8f4071900 0x7fb8f40ca140 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb8f40cbfe0 tx=0x7fb8e4009bd0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.333+0000 7fb8fc2a9700 1 -- 172.21.15.6:0/539260179 shutdown_connections 2023-07-06T20:00:03.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.333+0000 7fb8fc2a9700 1 --2- 172.21.15.6:0/539260179 >> v2:172.21.15.40:3300/0 conn(0x7fb8f415c660 0x7fb8f40ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.333+0000 7fb8fc2a9700 1 --2- 172.21.15.6:0/539260179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8f4071900 0x7fb8f40ca140 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.333+0000 7fb8fc2a9700 1 -- 172.21.15.6:0/539260179 >> 172.21.15.6:0/539260179 conn(0x7fb8f40cf960 msgr2=0x7fb8f40cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:03.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.333+0000 7fb8fc2a9700 1 -- 172.21.15.6:0/539260179 shutdown_connections 2023-07-06T20:00:03.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.333+0000 7fb8fc2a9700 1 -- 172.21.15.6:0/539260179 wait complete. 2023-07-06T20:00:03.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.335+0000 7fb8fc2a9700 1 Processor -- start 2023-07-06T20:00:03.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.335+0000 7fb8fc2a9700 1 -- start start 2023-07-06T20:00:03.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.336+0000 7fb8fc2a9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f4071900 0x7fb8f40b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:03.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.336+0000 7fb8fc2a9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8f4071cd0 0x7fb8f40b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:03.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.336+0000 7fb8fc2a9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8f415c660 0x7fb8f40b3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:03.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.336+0000 7fb8fc2a9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f41501f0 con 0x7fb8f415c660 2023-07-06T20:00:03.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.336+0000 7fb8fc2a9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f41504d0 con 0x7fb8f4071cd0 2023-07-06T20:00:03.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.336+0000 7fb8fc2a9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f41507b0 con 0x7fb8f4071900 2023-07-06T20:00:03.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.336+0000 7fb8fa846700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8f415c660 0x7fb8f40b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:03.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.336+0000 7fb8fa846700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8f415c660 0x7fb8f40b3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60558/0 (socket says 172.21.15.6:60558) 2023-07-06T20:00:03.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.336+0000 7fb8fa846700 1 -- 172.21.15.6:0/3697476746 learned_addr learned my addr 172.21.15.6:0/3697476746 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:03.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.336+0000 7fb8fa045700 1 --2- 172.21.15.6:0/3697476746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f4071900 0x7fb8f40b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:03.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.336+0000 7fb8f9844700 1 --2- 172.21.15.6:0/3697476746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8f4071cd0 0x7fb8f40b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:03.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.336+0000 7fb8fa846700 1 -- 172.21.15.6:0/3697476746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f4071900 msgr2=0x7fb8f40b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:03.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.336+0000 7fb8fa846700 1 --2- 172.21.15.6:0/3697476746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f4071900 0x7fb8f40b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.336+0000 7fb8fa846700 1 -- 172.21.15.6:0/3697476746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8f4071cd0 msgr2=0x7fb8f40b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:03.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.336+0000 7fb8fa846700 1 --2- 172.21.15.6:0/3697476746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8f4071cd0 0x7fb8f40b3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.336+0000 7fb8fa846700 1 -- 172.21.15.6:0/3697476746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e4009550 con 0x7fb8f415c660 2023-07-06T20:00:03.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.336+0000 7fb8fa846700 1 --2- 172.21.15.6:0/3697476746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8f415c660 0x7fb8f40b3880 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec007e60 tx=0x7fb8ec00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:03.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.336+0000 7fb8eaffd700 1 -- 172.21.15.6:0/3697476746 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec00ed30 con 0x7fb8f415c660 2023-07-06T20:00:03.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.336+0000 7fb8eaffd700 1 -- 172.21.15.6:0/3697476746 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec014420 con 0x7fb8f415c660 2023-07-06T20:00:03.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.336+0000 7fb8eaffd700 1 -- 172.21.15.6:0/3697476746 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec0147d0 con 0x7fb8f415c660 2023-07-06T20:00:03.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.336+0000 7fb8fc2a9700 1 -- 172.21.15.6:0/3697476746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f4150a90 con 0x7fb8f415c660 2023-07-06T20:00:03.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.337+0000 7fb8fc2a9700 1 -- 172.21.15.6:0/3697476746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f414a360 con 0x7fb8f415c660 2023-07-06T20:00:03.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.337+0000 7fb8fc2a9700 1 -- 172.21.15.6:0/3697476746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f404eb90 con 0x7fb8f415c660 2023-07-06T20:00:03.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.338+0000 7fb8eaffd700 1 -- 172.21.15.6:0/3697476746 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb8ec014930 con 0x7fb8f415c660 2023-07-06T20:00:03.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.338+0000 7fb8eaffd700 1 --2- 172.21.15.6:0/3697476746 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb8d806ace0 0x7fb8d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:03.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.338+0000 7fb8eaffd700 1 -- 172.21.15.6:0/3697476746 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb8ec089d60 con 0x7fb8f415c660 2023-07-06T20:00:03.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.338+0000 7fb8fa045700 1 --2- 172.21.15.6:0/3697476746 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb8d806ace0 0x7fb8d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:03.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.339+0000 7fb8fa045700 1 --2- 172.21.15.6:0/3697476746 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb8d806ace0 0x7fb8d806d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4014040 tx=0x7fb8e4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:03.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.343+0000 7fb8eaffd700 1 -- 172.21.15.6:0/3697476746 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb8ec054b70 con 0x7fb8f415c660 2023-07-06T20:00:03.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.539+0000 7fb8fc2a9700 1 -- 172.21.15.6:0/3697476746 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb8f4150330 con 0x7fb8f415c660 2023-07-06T20:00:03.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.539+0000 7fb8eaffd700 1 -- 172.21.15.6:0/3697476746 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb8f4150330 con 0x7fb8f415c660 2023-07-06T20:00:03.545 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T20:00:03.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.541+0000 7fb8fc2a9700 1 -- 172.21.15.6:0/3697476746 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb8d806ace0 msgr2=0x7fb8d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:03.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.541+0000 7fb8fc2a9700 1 --2- 172.21.15.6:0/3697476746 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb8d806ace0 0x7fb8d806d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4014040 tx=0x7fb8e4008030 comp rx=0 tx=0).stop 2023-07-06T20:00:03.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.541+0000 7fb8fc2a9700 1 -- 172.21.15.6:0/3697476746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8f415c660 msgr2=0x7fb8f40b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:03.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.541+0000 7fb8fc2a9700 1 --2- 172.21.15.6:0/3697476746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8f415c660 0x7fb8f40b3880 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec007e60 tx=0x7fb8ec00e3c0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.541+0000 7fb8fc2a9700 1 -- 172.21.15.6:0/3697476746 shutdown_connections 2023-07-06T20:00:03.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.541+0000 7fb8fc2a9700 1 --2- 172.21.15.6:0/3697476746 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb8d806ace0 0x7fb8d806d190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.541+0000 7fb8fc2a9700 1 --2- 172.21.15.6:0/3697476746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8f415c660 0x7fb8f40b3880 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.541+0000 7fb8fc2a9700 1 --2- 172.21.15.6:0/3697476746 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f4071900 0x7fb8f40b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.541+0000 7fb8fc2a9700 1 --2- 172.21.15.6:0/3697476746 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8f4071cd0 0x7fb8f40b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.541+0000 7fb8fc2a9700 1 -- 172.21.15.6:0/3697476746 >> 172.21.15.6:0/3697476746 conn(0x7fb8f40cf960 msgr2=0x7fb8f406d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:03.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.542+0000 7fb8fc2a9700 1 -- 172.21.15.6:0/3697476746 shutdown_connections 2023-07-06T20:00:03.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.542+0000 7fb8fc2a9700 1 -- 172.21.15.6:0/3697476746 wait complete. 2023-07-06T20:00:03.556 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-06T20:00:03.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.682+0000 7fc3c2992700 1 Processor -- start 2023-07-06T20:00:03.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.682+0000 7fc3c2992700 1 -- start start 2023-07-06T20:00:03.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.683+0000 7fc3c2992700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3bc071900 0x7fc3bc0ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:03.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.683+0000 7fc3c2992700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3bc071cd0 0x7fc3bc0ca680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:03.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.683+0000 7fc3c2992700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3bc0cb310 con 0x7fc3bc15bf50 2023-07-06T20:00:03.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.683+0000 7fc3c2992700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3bc0cdbf0 con 0x7fc3bc071cd0 2023-07-06T20:00:03.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.683+0000 7fc3c2992700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0af070 con 0x7fc3bc071900 2023-07-06T20:00:03.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.683+0000 7fc3bb7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3bc071cd0 0x7fc3bc0ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:03.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.683+0000 7fc3bb7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc3bc071cd0 0x7fc3bc0ca680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60562/0 (socket says 172.21.15.6:60562) 2023-07-06T20:00:03.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.683+0000 7fc3bb7fe700 1 -- 172.21.15.6:0/1300223308 learned_addr learned my addr 172.21.15.6:0/1300223308 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:03.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.683+0000 7fc3bbfff700 1 --2- 172.21.15.6:0/1300223308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3bc071900 0x7fc3bc0ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:03.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.683+0000 7fc3bb7fe700 1 -- 172.21.15.6:0/1300223308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3bc071900 msgr2=0x7fc3bc0ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:03.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.683+0000 7fc3bb7fe700 1 --2- 172.21.15.6:0/1300223308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3bc071900 0x7fc3bc0ca140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.683+0000 7fc3bb7fe700 1 -- 172.21.15.6:0/1300223308 >> v1:172.21.15.40:6789/0 conn(0x7fc3bc15bf50 legacy=0x7fc3bc15c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:03.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.683+0000 7fc3bb7fe700 1 -- 172.21.15.6:0/1300223308 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc0cad50 con 0x7fc3bc071cd0 2023-07-06T20:00:03.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.683+0000 7fc3bb7fe700 1 --2- 172.21.15.6:0/1300223308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3bc071cd0 0x7fc3bc0ca680 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac0098f0 tx=0x7fc3ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c293f8a8f707b3ee server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:03.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.683+0000 7fc3baffd700 1 -- 172.21.15.6:0/1300223308 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac004230 con 0x7fc3bc071cd0 2023-07-06T20:00:03.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.683+0000 7fc3baffd700 1 -- 172.21.15.6:0/1300223308 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ac004390 con 0x7fc3bc071cd0 2023-07-06T20:00:03.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.683+0000 7fc3baffd700 1 -- 172.21.15.6:0/1300223308 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac0036a0 con 0x7fc3bc071cd0 2023-07-06T20:00:03.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.684+0000 7fc3c2992700 1 -- 172.21.15.6:0/1300223308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3bc071cd0 msgr2=0x7fc3bc0ca680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:03.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.684+0000 7fc3c2992700 1 --2- 172.21.15.6:0/1300223308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3bc071cd0 0x7fc3bc0ca680 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac0098f0 tx=0x7fc3ac009c00 comp rx=0 tx=0).stop 2023-07-06T20:00:03.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.684+0000 7fc3c2992700 1 -- 172.21.15.6:0/1300223308 shutdown_connections 2023-07-06T20:00:03.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.684+0000 7fc3c2992700 1 --2- 172.21.15.6:0/1300223308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3bc071900 0x7fc3bc0ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.684+0000 7fc3c2992700 1 --2- 172.21.15.6:0/1300223308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3bc071cd0 0x7fc3bc0ca680 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.684+0000 7fc3c2992700 1 -- 172.21.15.6:0/1300223308 >> 172.21.15.6:0/1300223308 conn(0x7fc3bc0cf960 msgr2=0x7fc3bc0cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:03.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.684+0000 7fc3c2992700 1 -- 172.21.15.6:0/1300223308 shutdown_connections 2023-07-06T20:00:03.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.684+0000 7fc3c2992700 1 -- 172.21.15.6:0/1300223308 wait complete. 2023-07-06T20:00:03.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.685+0000 7fc3c2992700 1 Processor -- start 2023-07-06T20:00:03.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.685+0000 7fc3c2992700 1 -- start start 2023-07-06T20:00:03.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.686+0000 7fc3c2992700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3bc071900 0x7fc3bc158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:03.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.686+0000 7fc3c2992700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3bc071cd0 0x7fc3bc156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:03.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.686+0000 7fc3c2992700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3bc15bf50 0x7fc3bc06c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:03.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.686+0000 7fc3c2992700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc157ee0 con 0x7fc3bc071900 2023-07-06T20:00:03.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.686+0000 7fc3c2992700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc06c6f0 con 0x7fc3bc15bf50 2023-07-06T20:00:03.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.686+0000 7fc3c2992700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc1572d0 con 0x7fc3bc071cd0 2023-07-06T20:00:03.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.686+0000 7fc3bbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3bc071900 0x7fc3bc158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:03.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.686+0000 7fc3bbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3bc071900 0x7fc3bc158370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60568/0 (socket says 172.21.15.6:60568) 2023-07-06T20:00:03.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.686+0000 7fc3bbfff700 1 -- 172.21.15.6:0/4269965044 learned_addr learned my addr 172.21.15.6:0/4269965044 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:03.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.687+0000 7fc3c0f2f700 1 --2- 172.21.15.6:0/4269965044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3bc15bf50 0x7fc3bc06c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:03.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.687+0000 7fc3bb7fe700 1 --2- 172.21.15.6:0/4269965044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3bc071cd0 0x7fc3bc156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:03.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.687+0000 7fc3bbfff700 1 -- 172.21.15.6:0/4269965044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3bc071cd0 msgr2=0x7fc3bc156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:03.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.687+0000 7fc3bbfff700 1 --2- 172.21.15.6:0/4269965044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3bc071cd0 0x7fc3bc156c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.687+0000 7fc3bbfff700 1 -- 172.21.15.6:0/4269965044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3bc15bf50 msgr2=0x7fc3bc06c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:03.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.687+0000 7fc3bbfff700 1 --2- 172.21.15.6:0/4269965044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3bc15bf50 0x7fc3bc06c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.687+0000 7fc3bbfff700 1 -- 172.21.15.6:0/4269965044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ac009550 con 0x7fc3bc071900 2023-07-06T20:00:03.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.687+0000 7fc3c0f2f700 1 --2- 172.21.15.6:0/4269965044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3bc15bf50 0x7fc3bc06c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T20:00:03.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.687+0000 7fc3bbfff700 1 --2- 172.21.15.6:0/4269965044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3bc071900 0x7fc3bc158370 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000c7f0 tx=0x7fc3b000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:03.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.687+0000 7fc3b8ff9700 1 -- 172.21.15.6:0/4269965044 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0011800 con 0x7fc3bc071900 2023-07-06T20:00:03.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.687+0000 7fc3b8ff9700 1 -- 172.21.15.6:0/4269965044 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b0011960 con 0x7fc3bc071900 2023-07-06T20:00:03.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.687+0000 7fc3c2992700 1 -- 172.21.15.6:0/4269965044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3bc1575b0 con 0x7fc3bc071900 2023-07-06T20:00:03.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.687+0000 7fc3b8ff9700 1 -- 172.21.15.6:0/4269965044 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0011cf0 con 0x7fc3bc071900 2023-07-06T20:00:03.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.687+0000 7fc3c2992700 1 -- 172.21.15.6:0/4269965044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3bc157b70 con 0x7fc3bc071900 2023-07-06T20:00:03.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.688+0000 7fc3c2992700 1 -- 172.21.15.6:0/4269965044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3bc04eb90 con 0x7fc3bc071900 2023-07-06T20:00:03.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.688+0000 7fc3b8ff9700 1 -- 172.21.15.6:0/4269965044 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc3b0018360 con 0x7fc3bc071900 2023-07-06T20:00:03.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.689+0000 7fc3b8ff9700 1 --2- 172.21.15.6:0/4269965044 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc3a806ace0 0x7fc3a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:03.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.689+0000 7fc3b8ff9700 1 -- 172.21.15.6:0/4269965044 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc3b0089710 con 0x7fc3bc071900 2023-07-06T20:00:03.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.689+0000 7fc3bb7fe700 1 --2- 172.21.15.6:0/4269965044 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc3a806ace0 0x7fc3a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:03.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.689+0000 7fc3bb7fe700 1 --2- 172.21.15.6:0/4269965044 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc3a806ace0 0x7fc3a806d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc14efb0 tx=0x7fc3ac008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:03.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.693+0000 7fc3b8ff9700 1 -- 172.21.15.6:0/4269965044 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc3b0054490 con 0x7fc3bc071900 2023-07-06T20:00:03.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.890+0000 7fc3c2992700 1 -- 172.21.15.6:0/4269965044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc3bc0b58e0 con 0x7fc3bc071900 2023-07-06T20:00:03.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.890+0000 7fc3b8ff9700 1 -- 172.21.15.6:0/4269965044 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc3b0057ab0 con 0x7fc3bc071900 2023-07-06T20:00:03.893 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-06T20:00:03.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.892+0000 7fc3c2992700 1 -- 172.21.15.6:0/4269965044 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc3a806ace0 msgr2=0x7fc3a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:03.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.892+0000 7fc3c2992700 1 --2- 172.21.15.6:0/4269965044 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc3a806ace0 0x7fc3a806d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc14efb0 tx=0x7fc3ac008030 comp rx=0 tx=0).stop 2023-07-06T20:00:03.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.893+0000 7fc3c2992700 1 -- 172.21.15.6:0/4269965044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3bc071900 msgr2=0x7fc3bc158370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:03.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.893+0000 7fc3c2992700 1 --2- 172.21.15.6:0/4269965044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3bc071900 0x7fc3bc158370 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000c7f0 tx=0x7fc3b000cbb0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.893+0000 7fc3c2992700 1 -- 172.21.15.6:0/4269965044 shutdown_connections 2023-07-06T20:00:03.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.893+0000 7fc3c2992700 1 --2- 172.21.15.6:0/4269965044 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc3a806ace0 0x7fc3a806d190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.893+0000 7fc3c2992700 1 --2- 172.21.15.6:0/4269965044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3bc071900 0x7fc3bc158370 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.893+0000 7fc3c2992700 1 --2- 172.21.15.6:0/4269965044 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3bc15bf50 0x7fc3bc06c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.893+0000 7fc3c2992700 1 --2- 172.21.15.6:0/4269965044 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc3bc071cd0 0x7fc3bc156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:03.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.893+0000 7fc3c2992700 1 -- 172.21.15.6:0/4269965044 >> 172.21.15.6:0/4269965044 conn(0x7fc3bc0cf960 msgr2=0x7fc3bc0cde60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:03.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.893+0000 7fc3c2992700 1 -- 172.21.15.6:0/4269965044 shutdown_connections 2023-07-06T20:00:03.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:03.893+0000 7fc3c2992700 1 -- 172.21.15.6:0/4269965044 wait complete. 2023-07-06T20:00:03.907 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-06T20:00:04.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.034+0000 7fbddd187700 1 Processor -- start 2023-07-06T20:00:04.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.034+0000 7fbddd187700 1 -- start start 2023-07-06T20:00:04.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.035+0000 7fbddd187700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd80b21c0 0x7fbdd815cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:04.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.035+0000 7fbddd187700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbdd80d0c00 0x7fbdd80cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:04.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.035+0000 7fbddd187700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbdd80cd800 0x7fbdd81601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:04.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.035+0000 7fbddd187700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd80cdc20 con 0x7fbdd80cd800 2023-07-06T20:00:04.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.035+0000 7fbddd187700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdd80d11c0 con 0x7fbdd80d0c00 2023-07-06T20:00:04.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.035+0000 7fbddd187700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd80d14a0 con 0x7fbdd80b21c0 2023-07-06T20:00:04.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.035+0000 7fbdd759e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbdd80cd800 0x7fbdd81601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:04.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.035+0000 7fbdd759e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbdd80cd800 0x7fbdd81601f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60580/0 (socket says 172.21.15.6:60580) 2023-07-06T20:00:04.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.035+0000 7fbdd759e700 1 -- 172.21.15.6:0/315560055 learned_addr learned my addr 172.21.15.6:0/315560055 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:04.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.035+0000 7fbdd659c700 1 --2- 172.21.15.6:0/315560055 >> v2:172.21.15.40:3300/0 conn(0x7fbdd80d0c00 0x7fbdd80cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:04.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.035+0000 7fbdd759e700 1 -- 172.21.15.6:0/315560055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd80b21c0 msgr2=0x7fbdd815cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:04.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.035+0000 7fbdd6d9d700 1 --2- 172.21.15.6:0/315560055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd80b21c0 0x7fbdd815cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:04.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.035+0000 7fbdd759e700 1 --2- 172.21.15.6:0/315560055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd80b21c0 0x7fbdd815cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.035+0000 7fbdd759e700 1 -- 172.21.15.6:0/315560055 >> v2:172.21.15.40:3300/0 conn(0x7fbdd80d0c00 msgr2=0x7fbdd80cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:04.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.035+0000 7fbdd759e700 1 --2- 172.21.15.6:0/315560055 >> v2:172.21.15.40:3300/0 conn(0x7fbdd80d0c00 0x7fbdd80cd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.035+0000 7fbdd759e700 1 -- 172.21.15.6:0/315560055 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd80d1780 con 0x7fbdd80cd800 2023-07-06T20:00:04.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.035+0000 7fbdd659c700 1 --2- 172.21.15.6:0/315560055 >> v2:172.21.15.40:3300/0 conn(0x7fbdd80d0c00 0x7fbdd80cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T20:00:04.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.035+0000 7fbdd6d9d700 1 --2- 172.21.15.6:0/315560055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd80b21c0 0x7fbdd815cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T20:00:04.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.035+0000 7fbdd759e700 1 --2- 172.21.15.6:0/315560055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdd80cd800 0x7fbdd81601f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbdd808bc00 tx=0x7fbdd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f105f1cc36771255 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:04.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.035+0000 7fbdd5d9b700 1 -- 172.21.15.6:0/315560055 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd000e070 con 0x7fbdd80cd800 2023-07-06T20:00:04.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.035+0000 7fbdd5d9b700 1 -- 172.21.15.6:0/315560055 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd000b9c0 con 0x7fbdd80cd800 2023-07-06T20:00:04.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.035+0000 7fbdd5d9b700 1 -- 172.21.15.6:0/315560055 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd000bd70 con 0x7fbdd80cd800 2023-07-06T20:00:04.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.036+0000 7fbddd187700 1 -- 172.21.15.6:0/315560055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdd80cd800 msgr2=0x7fbdd81601f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:04.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.036+0000 7fbddd187700 1 --2- 172.21.15.6:0/315560055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdd80cd800 0x7fbdd81601f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fbdd808bc00 tx=0x7fbdd000b330 comp rx=0 tx=0).stop 2023-07-06T20:00:04.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.036+0000 7fbddd187700 1 -- 172.21.15.6:0/315560055 shutdown_connections 2023-07-06T20:00:04.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.036+0000 7fbddd187700 1 --2- 172.21.15.6:0/315560055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdd80cd800 0x7fbdd81601f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.036+0000 7fbddd187700 1 --2- 172.21.15.6:0/315560055 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd80b21c0 0x7fbdd815cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.036+0000 7fbddd187700 1 --2- 172.21.15.6:0/315560055 >> v2:172.21.15.40:3300/0 conn(0x7fbdd80d0c00 0x7fbdd80cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.036+0000 7fbddd187700 1 -- 172.21.15.6:0/315560055 >> 172.21.15.6:0/315560055 conn(0x7fbdd80d3900 msgr2=0x7fbdd80b4760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:04.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.036+0000 7fbddd187700 1 -- 172.21.15.6:0/315560055 shutdown_connections 2023-07-06T20:00:04.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.036+0000 7fbddd187700 1 -- 172.21.15.6:0/315560055 wait complete. 2023-07-06T20:00:04.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.037+0000 7fbddd187700 1 Processor -- start 2023-07-06T20:00:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.038+0000 7fbddd187700 1 -- start start 2023-07-06T20:00:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.038+0000 7fbddd187700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd80b21c0 0x7fbdd80b82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.038+0000 7fbddd187700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdd80cd800 0x7fbdd8160540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.038+0000 7fbddd187700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdd80d0c00 0x7fbdd814c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.038+0000 7fbddd187700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd8160a80 con 0x7fbdd80cd800 2023-07-06T20:00:04.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.038+0000 7fbddd187700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd80b8150 con 0x7fbdd80d0c00 2023-07-06T20:00:04.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.038+0000 7fbddd187700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd80b89b0 con 0x7fbdd80b21c0 2023-07-06T20:00:04.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.038+0000 7fbdd659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdd80cd800 0x7fbdd8160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:04.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.038+0000 7fbdd659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdd80cd800 0x7fbdd8160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60586/0 (socket says 172.21.15.6:60586) 2023-07-06T20:00:04.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.038+0000 7fbdd659c700 1 -- 172.21.15.6:0/2592631706 learned_addr learned my addr 172.21.15.6:0/2592631706 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:04.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.039+0000 7fbdd6d9d700 1 --2- 172.21.15.6:0/2592631706 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd80b21c0 0x7fbdd80b82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:04.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.039+0000 7fbdd759e700 1 --2- 172.21.15.6:0/2592631706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdd80d0c00 0x7fbdd814c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:04.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.039+0000 7fbdd659c700 1 -- 172.21.15.6:0/2592631706 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd80b21c0 msgr2=0x7fbdd80b82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:04.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.039+0000 7fbdd659c700 1 --2- 172.21.15.6:0/2592631706 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd80b21c0 0x7fbdd80b82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.039+0000 7fbdd659c700 1 -- 172.21.15.6:0/2592631706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdd80d0c00 msgr2=0x7fbdd814c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:04.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.039+0000 7fbdd659c700 1 --2- 172.21.15.6:0/2592631706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdd80d0c00 0x7fbdd814c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.039+0000 7fbdd659c700 1 -- 172.21.15.6:0/2592631706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd0009b30 con 0x7fbdd80cd800 2023-07-06T20:00:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.039+0000 7fbdd6d9d700 1 --2- 172.21.15.6:0/2592631706 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd80b21c0 0x7fbdd80b82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T20:00:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.039+0000 7fbdd759e700 1 --2- 172.21.15.6:0/2592631706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdd80d0c00 0x7fbdd814c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T20:00:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.039+0000 7fbdd659c700 1 --2- 172.21.15.6:0/2592631706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdd80cd800 0x7fbdd8160540 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00c780 tx=0x7fbdcc00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.039+0000 7fbdbf7fe700 1 -- 172.21.15.6:0/2592631706 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc011800 con 0x7fbdd80cd800 2023-07-06T20:00:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.039+0000 7fbdbf7fe700 1 -- 172.21.15.6:0/2592631706 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdcc011960 con 0x7fbdd80cd800 2023-07-06T20:00:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.039+0000 7fbddd187700 1 -- 172.21.15.6:0/2592631706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdd80b78b0 con 0x7fbdd80cd800 2023-07-06T20:00:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.039+0000 7fbdbf7fe700 1 -- 172.21.15.6:0/2592631706 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdcc011cd0 con 0x7fbdd80cd800 2023-07-06T20:00:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.039+0000 7fbddd187700 1 -- 172.21.15.6:0/2592631706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdd80b7e70 con 0x7fbdd80cd800 2023-07-06T20:00:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.040+0000 7fbddd187700 1 -- 172.21.15.6:0/2592631706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd80ce380 con 0x7fbdd80cd800 2023-07-06T20:00:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.041+0000 7fbdbf7fe700 1 -- 172.21.15.6:0/2592631706 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbdcc021350 con 0x7fbdd80cd800 2023-07-06T20:00:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.041+0000 7fbdbf7fe700 1 --2- 172.21.15.6:0/2592631706 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbdc406ace0 0x7fbdc406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.041+0000 7fbdbf7fe700 1 -- 172.21.15.6:0/2592631706 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbdcc089740 con 0x7fbdd80cd800 2023-07-06T20:00:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.041+0000 7fbdd6d9d700 1 --2- 172.21.15.6:0/2592631706 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbdc406ace0 0x7fbdc406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.042+0000 7fbdd6d9d700 1 --2- 172.21.15.6:0/2592631706 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbdc406ace0 0x7fbdc406d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8006fd0 tx=0x7fbdc8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.046+0000 7fbdbf7fe700 1 -- 172.21.15.6:0/2592631706 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbdcc057f60 con 0x7fbdd80cd800 2023-07-06T20:00:04.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.243+0000 7fbddd187700 1 -- 172.21.15.6:0/2592631706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbdd804eb90 con 0x7fbdd80cd800 2023-07-06T20:00:04.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.244+0000 7fbdbf7fe700 1 -- 172.21.15.6:0/2592631706 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbdcc057af0 con 0x7fbdd80cd800 2023-07-06T20:00:04.247 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-06T20:00:04.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.246+0000 7fbddd187700 1 -- 172.21.15.6:0/2592631706 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbdc406ace0 msgr2=0x7fbdc406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:04.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.246+0000 7fbddd187700 1 --2- 172.21.15.6:0/2592631706 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbdc406ace0 0x7fbdc406d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8006fd0 tx=0x7fbdc8008040 comp rx=0 tx=0).stop 2023-07-06T20:00:04.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.246+0000 7fbddd187700 1 -- 172.21.15.6:0/2592631706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdd80cd800 msgr2=0x7fbdd8160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:04.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.246+0000 7fbddd187700 1 --2- 172.21.15.6:0/2592631706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdd80cd800 0x7fbdd8160540 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc00c780 tx=0x7fbdcc00cb40 comp rx=0 tx=0).stop 2023-07-06T20:00:04.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.246+0000 7fbddd187700 1 -- 172.21.15.6:0/2592631706 shutdown_connections 2023-07-06T20:00:04.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.246+0000 7fbddd187700 1 --2- 172.21.15.6:0/2592631706 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbdc406ace0 0x7fbdc406d190 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.246+0000 7fbddd187700 1 --2- 172.21.15.6:0/2592631706 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdd80d0c00 0x7fbdd814c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.246+0000 7fbddd187700 1 --2- 172.21.15.6:0/2592631706 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbdd80b21c0 0x7fbdd80b82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.246+0000 7fbddd187700 1 --2- 172.21.15.6:0/2592631706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdd80cd800 0x7fbdd8160540 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.246+0000 7fbddd187700 1 -- 172.21.15.6:0/2592631706 >> 172.21.15.6:0/2592631706 conn(0x7fbdd80d3900 msgr2=0x7fbdd815f930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:04.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.246+0000 7fbddd187700 1 -- 172.21.15.6:0/2592631706 shutdown_connections 2023-07-06T20:00:04.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.246+0000 7fbddd187700 1 -- 172.21.15.6:0/2592631706 wait complete. 2023-07-06T20:00:04.260 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T20:00:04.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.385+0000 7f765b84d700 1 Processor -- start 2023-07-06T20:00:04.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.385+0000 7f765b84d700 1 -- start start 2023-07-06T20:00:04.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.386+0000 7f765b84d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f765415c4d0 0x7f76540b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:04.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.386+0000 7f765b84d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76541606e0 0x7f76540cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:04.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.386+0000 7f765b84d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76540cffe0 con 0x7f76540b3e30 2023-07-06T20:00:04.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.386+0000 7f765b84d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76540d0470 con 0x7f765415c4d0 2023-07-06T20:00:04.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.386+0000 7f765b84d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f765415c8a0 con 0x7f76541606e0 2023-07-06T20:00:04.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.386+0000 7f76595e9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f765415c4d0 0x7f76540b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:04.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.386+0000 7f7658de8700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f76540b3e30 0x7f765415ffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33568/0 (socket says 172.21.15.6:33568) 2023-07-06T20:00:04.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.386+0000 7f7658de8700 1 -- 172.21.15.6:0/3914362732 learned_addr learned my addr 172.21.15.6:0/3914362732 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:04.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.386+0000 7f764bfff700 1 -- 172.21.15.6:0/3914362732 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2956339763 0 0) 0x7f76540cffe0 con 0x7f76540b3e30 2023-07-06T20:00:04.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.386+0000 7f764bfff700 1 -- 172.21.15.6:0/3914362732 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76400035b0 con 0x7f76540b3e30 2023-07-06T20:00:04.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.386+0000 7f7659dea700 1 --2- 172.21.15.6:0/3914362732 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76541606e0 0x7f76540cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:04.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.386+0000 7f76595e9700 1 -- 172.21.15.6:0/3914362732 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76541606e0 msgr2=0x7f76540cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:04.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.386+0000 7f76595e9700 1 --2- 172.21.15.6:0/3914362732 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76541606e0 0x7f76540cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.386+0000 7f76595e9700 1 -- 172.21.15.6:0/3914362732 >> v1:172.21.15.6:6789/0 conn(0x7f76540b3e30 legacy=0x7f765415ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:04.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.386+0000 7f76595e9700 1 -- 172.21.15.6:0/3914362732 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76540cf3d0 con 0x7f765415c4d0 2023-07-06T20:00:04.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.386+0000 7f7659dea700 1 --2- 172.21.15.6:0/3914362732 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76541606e0 0x7f76540cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T20:00:04.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.386+0000 7f76595e9700 1 --2- 172.21.15.6:0/3914362732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f765415c4d0 0x7f76540b38f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7650009840 tx=0x7f7650009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d672249a65fef9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:04.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.387+0000 7f764bfff700 1 -- 172.21.15.6:0/3914362732 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7650011830 con 0x7f765415c4d0 2023-07-06T20:00:04.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.387+0000 7f764bfff700 1 -- 172.21.15.6:0/3914362732 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7650011990 con 0x7f765415c4d0 2023-07-06T20:00:04.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.387+0000 7f764bfff700 1 -- 172.21.15.6:0/3914362732 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7650011d20 con 0x7f765415c4d0 2023-07-06T20:00:04.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.387+0000 7f765b84d700 1 -- 172.21.15.6:0/3914362732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f765415c4d0 msgr2=0x7f76540b38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:04.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.387+0000 7f765b84d700 1 --2- 172.21.15.6:0/3914362732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f765415c4d0 0x7f76540b38f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7650009840 tx=0x7f7650009b50 comp rx=0 tx=0).stop 2023-07-06T20:00:04.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.387+0000 7f765b84d700 1 -- 172.21.15.6:0/3914362732 shutdown_connections 2023-07-06T20:00:04.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.387+0000 7f765b84d700 1 --2- 172.21.15.6:0/3914362732 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f76541606e0 0x7f76540cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.387+0000 7f765b84d700 1 --2- 172.21.15.6:0/3914362732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f765415c4d0 0x7f76540b38f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.387+0000 7f765b84d700 1 -- 172.21.15.6:0/3914362732 >> 172.21.15.6:0/3914362732 conn(0x7f76540d0a30 msgr2=0x7f76540d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:04.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.387+0000 7f765b84d700 1 -- 172.21.15.6:0/3914362732 shutdown_connections 2023-07-06T20:00:04.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.387+0000 7f765b84d700 1 -- 172.21.15.6:0/3914362732 wait complete. 2023-07-06T20:00:04.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.389+0000 7f765b84d700 1 Processor -- start 2023-07-06T20:00:04.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.389+0000 7f765b84d700 1 -- start start 2023-07-06T20:00:04.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.389+0000 7f765b84d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76540b3e30 0x7f76541f1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:04.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.389+0000 7f765b84d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f765415c4d0 0x7f76540c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:04.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.389+0000 7f765b84d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76541606e0 0x7f765415e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:04.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.389+0000 7f765b84d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76540c7330 con 0x7f76541606e0 2023-07-06T20:00:04.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.389+0000 7f765b84d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76540c8400 con 0x7f76540b3e30 2023-07-06T20:00:04.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.389+0000 7f765b84d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76540c86e0 con 0x7f765415c4d0 2023-07-06T20:00:04.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.389+0000 7f7659dea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76541606e0 0x7f765415e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:04.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.389+0000 7f7659dea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76541606e0 0x7f765415e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60598/0 (socket says 172.21.15.6:60598) 2023-07-06T20:00:04.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.390+0000 7f7659dea700 1 -- 172.21.15.6:0/769850577 learned_addr learned my addr 172.21.15.6:0/769850577 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:04.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.390+0000 7f76595e9700 1 --2- 172.21.15.6:0/769850577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76540b3e30 0x7f76541f1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:04.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.390+0000 7f7658de8700 1 --2- 172.21.15.6:0/769850577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f765415c4d0 0x7f76540c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:04.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.390+0000 7f7659dea700 1 -- 172.21.15.6:0/769850577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f765415c4d0 msgr2=0x7f76540c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:04.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.390+0000 7f7659dea700 1 --2- 172.21.15.6:0/769850577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f765415c4d0 0x7f76540c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.390+0000 7f7659dea700 1 -- 172.21.15.6:0/769850577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76540b3e30 msgr2=0x7f76541f1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:04.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.390+0000 7f7659dea700 1 --2- 172.21.15.6:0/769850577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76540b3e30 0x7f76541f1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.390+0000 7f7659dea700 1 -- 172.21.15.6:0/769850577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76500094a0 con 0x7f76541606e0 2023-07-06T20:00:04.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.390+0000 7f7658de8700 1 --2- 172.21.15.6:0/769850577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f765415c4d0 0x7f76540c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:04.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.390+0000 7f7659dea700 1 --2- 172.21.15.6:0/769850577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76541606e0 0x7f765415e2b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f764c00ccf0 tx=0x7f764c00a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:04.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.390+0000 7f7649ffb700 1 -- 172.21.15.6:0/769850577 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c00ae00 con 0x7f76541606e0 2023-07-06T20:00:04.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.390+0000 7f7649ffb700 1 -- 172.21.15.6:0/769850577 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764c00f480 con 0x7f76541606e0 2023-07-06T20:00:04.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.390+0000 7f765b84d700 1 -- 172.21.15.6:0/769850577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76540c89c0 con 0x7f76541606e0 2023-07-06T20:00:04.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.390+0000 7f7649ffb700 1 -- 172.21.15.6:0/769850577 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c00f830 con 0x7f76541606e0 2023-07-06T20:00:04.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.390+0000 7f765b84d700 1 -- 172.21.15.6:0/769850577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76540c8f80 con 0x7f76541606e0 2023-07-06T20:00:04.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.391+0000 7f765b84d700 1 -- 172.21.15.6:0/769850577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7654160f00 con 0x7f76541606e0 2023-07-06T20:00:04.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.392+0000 7f7649ffb700 1 -- 172.21.15.6:0/769850577 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f764c00b040 con 0x7f76541606e0 2023-07-06T20:00:04.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.392+0000 7f7649ffb700 1 --2- 172.21.15.6:0/769850577 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f763806ad10 0x7f763806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:04.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.392+0000 7f76595e9700 1 --2- 172.21.15.6:0/769850577 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f763806ad10 0x7f763806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:04.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.392+0000 7f7649ffb700 1 -- 172.21.15.6:0/769850577 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f764c089ec0 con 0x7f76541606e0 2023-07-06T20:00:04.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.393+0000 7f76595e9700 1 --2- 172.21.15.6:0/769850577 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f763806ad10 0x7f763806d1c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7650000c00 tx=0x7f7650008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:04.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.397+0000 7f7649ffb700 1 -- 172.21.15.6:0/769850577 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f764c054c40 con 0x7f76541606e0 2023-07-06T20:00:04.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.637+0000 7f765b84d700 1 -- 172.21.15.6:0/769850577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76540c91a0 con 0x7f76541606e0 2023-07-06T20:00:04.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.638+0000 7f7649ffb700 1 -- 172.21.15.6:0/769850577 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4652 (secure 0 0 0) 0x7f764c058260 con 0x7f76541606e0 2023-07-06T20:00:04.640 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:04.640 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3695014381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3695014381},{"type":"v1","addr":"172.21.15.6:6835","nonce":3695014381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/849399781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":849399781},{"type":"v1","addr":"172.21.15.40:6833","nonce":849399781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/512806705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":512806705},{"type":"v1","addr":"172.21.15.40:6835","nonce":512806705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T19:58:53.158966+0000","modified":"2023-07-06T19:59:17.827616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/368324315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":368324315},{"type":"v1","addr":"172.21.15.6:6837","nonce":368324315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-06T20:00:04.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.640+0000 7f765b84d700 1 -- 172.21.15.6:0/769850577 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f763806ad10 msgr2=0x7f763806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:04.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.640+0000 7f765b84d700 1 --2- 172.21.15.6:0/769850577 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f763806ad10 0x7f763806d1c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7650000c00 tx=0x7f7650008030 comp rx=0 tx=0).stop 2023-07-06T20:00:04.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.640+0000 7f765b84d700 1 -- 172.21.15.6:0/769850577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76541606e0 msgr2=0x7f765415e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:04.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.640+0000 7f765b84d700 1 --2- 172.21.15.6:0/769850577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76541606e0 0x7f765415e2b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f764c00ccf0 tx=0x7f764c00a280 comp rx=0 tx=0).stop 2023-07-06T20:00:04.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.640+0000 7f765b84d700 1 -- 172.21.15.6:0/769850577 shutdown_connections 2023-07-06T20:00:04.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.640+0000 7f765b84d700 1 --2- 172.21.15.6:0/769850577 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f763806ad10 0x7f763806d1c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.640+0000 7f765b84d700 1 --2- 172.21.15.6:0/769850577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76541606e0 0x7f765415e2b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.640+0000 7f765b84d700 1 --2- 172.21.15.6:0/769850577 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76540b3e30 0x7f76541f1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.640+0000 7f765b84d700 1 --2- 172.21.15.6:0/769850577 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f765415c4d0 0x7f76540c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.640+0000 7f765b84d700 1 -- 172.21.15.6:0/769850577 >> 172.21.15.6:0/769850577 conn(0x7f76540d0a30 msgr2=0x7f765415b340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:04.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.640+0000 7f765b84d700 1 -- 172.21.15.6:0/769850577 shutdown_connections 2023-07-06T20:00:04.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.640+0000 7f765b84d700 1 -- 172.21.15.6:0/769850577 wait complete. 2023-07-06T20:00:04.644 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 9 2023-07-06T20:00:04.654 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T20:00:04.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.779+0000 7fe4b9509700 1 Processor -- start 2023-07-06T20:00:04.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.779+0000 7fe4b9509700 1 -- start start 2023-07-06T20:00:04.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.779+0000 7fe4b9509700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe4b415ce50 0x7fe4b40cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:04.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.779+0000 7fe4b9509700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe4b406c4c0 0x7fe4b40d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:04.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.779+0000 7fe4b9509700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4b4160060 con 0x7fe4b415d220 2023-07-06T20:00:04.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.779+0000 7fe4b9509700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b40cd800 con 0x7fe4b415ce50 2023-07-06T20:00:04.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.779+0000 7fe4b9509700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4b41602b0 con 0x7fe4b406c4c0 2023-07-06T20:00:04.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.780+0000 7fe4b2ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe4b415ce50 0x7fe4b40cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:04.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.780+0000 7fe4b2ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe4b415ce50 0x7fe4b40cd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60602/0 (socket says 172.21.15.6:60602) 2023-07-06T20:00:04.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.780+0000 7fe4b2ffd700 1 -- 172.21.15.6:0/1180107104 learned_addr learned my addr 172.21.15.6:0/1180107104 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:04.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.780+0000 7fe4b37fe700 1 --2- 172.21.15.6:0/1180107104 >> v2:172.21.15.40:3300/0 conn(0x7fe4b406c4c0 0x7fe4b40d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:04.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.780+0000 7fe4b2ffd700 1 -- 172.21.15.6:0/1180107104 >> v2:172.21.15.40:3300/0 conn(0x7fe4b406c4c0 msgr2=0x7fe4b40d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:04.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.780+0000 7fe4b2ffd700 1 --2- 172.21.15.6:0/1180107104 >> v2:172.21.15.40:3300/0 conn(0x7fe4b406c4c0 0x7fe4b40d0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.780+0000 7fe4b2ffd700 1 -- 172.21.15.6:0/1180107104 >> v1:172.21.15.40:6789/0 conn(0x7fe4b415d220 legacy=0x7fe4b406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:04.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.780+0000 7fe4b2ffd700 1 -- 172.21.15.6:0/1180107104 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b4160590 con 0x7fe4b415ce50 2023-07-06T20:00:04.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.780+0000 7fe4b2ffd700 1 --2- 172.21.15.6:0/1180107104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b415ce50 0x7fe4b40cd1b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe4b40cd140 tx=0x7fe4a4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d929431ce352ee9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:04.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.780+0000 7fe4b1ffb700 1 -- 172.21.15.6:0/1180107104 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a4004230 con 0x7fe4b415ce50 2023-07-06T20:00:04.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.780+0000 7fe4b1ffb700 1 -- 172.21.15.6:0/1180107104 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a4004390 con 0x7fe4b415ce50 2023-07-06T20:00:04.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.780+0000 7fe4b1ffb700 1 -- 172.21.15.6:0/1180107104 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a40036a0 con 0x7fe4b415ce50 2023-07-06T20:00:04.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.781+0000 7fe4b9509700 1 -- 172.21.15.6:0/1180107104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b415ce50 msgr2=0x7fe4b40cd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:04.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.781+0000 7fe4b9509700 1 --2- 172.21.15.6:0/1180107104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b415ce50 0x7fe4b40cd1b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe4b40cd140 tx=0x7fe4a4009bd0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.781+0000 7fe4b9509700 1 -- 172.21.15.6:0/1180107104 shutdown_connections 2023-07-06T20:00:04.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.781+0000 7fe4b9509700 1 --2- 172.21.15.6:0/1180107104 >> v2:172.21.15.40:3300/0 conn(0x7fe4b406c4c0 0x7fe4b40d0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.781+0000 7fe4b9509700 1 --2- 172.21.15.6:0/1180107104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b415ce50 0x7fe4b40cd1b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.781+0000 7fe4b9509700 1 -- 172.21.15.6:0/1180107104 >> 172.21.15.6:0/1180107104 conn(0x7fe4b40d3880 msgr2=0x7fe4b40cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:04.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.781+0000 7fe4b9509700 1 -- 172.21.15.6:0/1180107104 shutdown_connections 2023-07-06T20:00:04.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.781+0000 7fe4b9509700 1 -- 172.21.15.6:0/1180107104 wait complete. 2023-07-06T20:00:04.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.783+0000 7fe4b9509700 1 Processor -- start 2023-07-06T20:00:04.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.783+0000 7fe4b9509700 1 -- start start 2023-07-06T20:00:04.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.784+0000 7fe4b9509700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4b406c4c0 0x7fe4b41e6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:04.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.784+0000 7fe4b9509700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4b415ce50 0x7fe4b415e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:04.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.784+0000 7fe4b9509700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b415d220 0x7fe4b41592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:04.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.784+0000 7fe4b9509700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b40b79d0 con 0x7fe4b415d220 2023-07-06T20:00:04.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.784+0000 7fe4b9509700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b40b6ae0 con 0x7fe4b406c4c0 2023-07-06T20:00:04.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.784+0000 7fe4b9509700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b40b6dc0 con 0x7fe4b415ce50 2023-07-06T20:00:04.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.784+0000 7fe4b37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b415d220 0x7fe4b41592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:04.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.784+0000 7fe4b37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b415d220 0x7fe4b41592a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60612/0 (socket says 172.21.15.6:60612) 2023-07-06T20:00:04.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.784+0000 7fe4b37fe700 1 -- 172.21.15.6:0/2555106444 learned_addr learned my addr 172.21.15.6:0/2555106444 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:04.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.784+0000 7fe4b2ffd700 1 --2- 172.21.15.6:0/2555106444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4b406c4c0 0x7fe4b41e6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:04.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.784+0000 7fe4b27fc700 1 --2- 172.21.15.6:0/2555106444 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4b415ce50 0x7fe4b415e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.784+0000 7fe4b37fe700 1 -- 172.21.15.6:0/2555106444 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4b415ce50 msgr2=0x7fe4b415e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.784+0000 7fe4b37fe700 1 --2- 172.21.15.6:0/2555106444 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4b415ce50 0x7fe4b415e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.784+0000 7fe4b37fe700 1 -- 172.21.15.6:0/2555106444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4b406c4c0 msgr2=0x7fe4b41e6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.784+0000 7fe4b37fe700 1 --2- 172.21.15.6:0/2555106444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4b406c4c0 0x7fe4b41e6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.784+0000 7fe4b37fe700 1 -- 172.21.15.6:0/2555106444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a4009550 con 0x7fe4b415d220 2023-07-06T20:00:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.784+0000 7fe4b27fc700 1 --2- 172.21.15.6:0/2555106444 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4b415ce50 0x7fe4b415e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.784+0000 7fe4b37fe700 1 --2- 172.21.15.6:0/2555106444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b415d220 0x7fe4b41592a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac007e40 tx=0x7fe4ac00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:04.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.784+0000 7fe4ab7fe700 1 -- 172.21.15.6:0/2555106444 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac00ede0 con 0x7fe4b415d220 2023-07-06T20:00:04.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.784+0000 7fe4ab7fe700 1 -- 172.21.15.6:0/2555106444 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ac014420 con 0x7fe4b415d220 2023-07-06T20:00:04.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.784+0000 7fe4b9509700 1 -- 172.21.15.6:0/2555106444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b4160f10 con 0x7fe4b415d220 2023-07-06T20:00:04.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.784+0000 7fe4ab7fe700 1 -- 172.21.15.6:0/2555106444 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ac0147d0 con 0x7fe4b415d220 2023-07-06T20:00:04.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.784+0000 7fe4b9509700 1 -- 172.21.15.6:0/2555106444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4b40b7380 con 0x7fe4b415d220 2023-07-06T20:00:04.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.785+0000 7fe4b9509700 1 -- 172.21.15.6:0/2555106444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4b40b7b40 con 0x7fe4b415d220 2023-07-06T20:00:04.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.786+0000 7fe4ab7fe700 1 -- 172.21.15.6:0/2555106444 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe4ac014930 con 0x7fe4b415d220 2023-07-06T20:00:04.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.787+0000 7fe4ab7fe700 1 --2- 172.21.15.6:0/2555106444 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe49406ace0 0x7fe49406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:04.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.787+0000 7fe4ab7fe700 1 -- 172.21.15.6:0/2555106444 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe4ac08acf0 con 0x7fe4b415d220 2023-07-06T20:00:04.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.787+0000 7fe4b2ffd700 1 --2- 172.21.15.6:0/2555106444 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe49406ace0 0x7fe49406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:04.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.787+0000 7fe4b2ffd700 1 --2- 172.21.15.6:0/2555106444 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe49406ace0 0x7fe49406d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4009130 tx=0x7fe4a4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:04.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.790+0000 7fe4ab7fe700 1 -- 172.21.15.6:0/2555106444 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe4ac0595e0 con 0x7fe4b415d220 2023-07-06T20:00:04.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.989+0000 7fe4b9509700 1 -- 172.21.15.6:0/2555106444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4b4160840 con 0x7fe4b415d220 2023-07-06T20:00:04.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.990+0000 7fe4ab7fe700 1 -- 172.21.15.6:0/2555106444 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20059 (secure 0 0 0) 0x7fe4ac059170 con 0x7fe4b415d220 2023-07-06T20:00:04.992 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:04.993 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":29,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:59:33.917851+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T19:58:51.062712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T19:58:52.130350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T19:58:55.785128+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T20:00:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.992+0000 7fe4b9509700 1 -- 172.21.15.6:0/2555106444 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe49406ace0 msgr2=0x7fe49406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.992+0000 7fe4b9509700 1 --2- 172.21.15.6:0/2555106444 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe49406ace0 0x7fe49406d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4009130 tx=0x7fe4a4008030 comp rx=0 tx=0).stop 2023-07-06T20:00:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.992+0000 7fe4b9509700 1 -- 172.21.15.6:0/2555106444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b415d220 msgr2=0x7fe4b41592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.992+0000 7fe4b9509700 1 --2- 172.21.15.6:0/2555106444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b415d220 0x7fe4b41592a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe4ac007e40 tx=0x7fe4ac00e3c0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.992+0000 7fe4b9509700 1 -- 172.21.15.6:0/2555106444 shutdown_connections 2023-07-06T20:00:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.992+0000 7fe4b9509700 1 --2- 172.21.15.6:0/2555106444 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe49406ace0 0x7fe49406d190 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.992+0000 7fe4b9509700 1 --2- 172.21.15.6:0/2555106444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4b415d220 0x7fe4b41592a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.992+0000 7fe4b9509700 1 --2- 172.21.15.6:0/2555106444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4b406c4c0 0x7fe4b41e6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.992+0000 7fe4b9509700 1 --2- 172.21.15.6:0/2555106444 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4b415ce50 0x7fe4b415e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.992+0000 7fe4b9509700 1 -- 172.21.15.6:0/2555106444 >> 172.21.15.6:0/2555106444 conn(0x7fe4b40d3880 msgr2=0x7fe4b40d2360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.992+0000 7fe4b9509700 1 -- 172.21.15.6:0/2555106444 shutdown_connections 2023-07-06T20:00:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:04.992+0000 7fe4b9509700 1 -- 172.21.15.6:0/2555106444 wait complete. 2023-07-06T20:00:05.007 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-06T20:00:05.007 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T20:00:05.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.133+0000 7ff481684700 1 Processor -- start 2023-07-06T20:00:05.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.133+0000 7ff481684700 1 -- start start 2023-07-06T20:00:05.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.134+0000 7ff481684700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff47c15ce50 0x7ff47c0cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:05.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.134+0000 7ff481684700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47c160060 con 0x7ff47c15d220 2023-07-06T20:00:05.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.134+0000 7ff481684700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47c0cd800 con 0x7ff47c06c4c0 2023-07-06T20:00:05.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.134+0000 7ff481684700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47c1602b0 con 0x7ff47c15ce50 2023-07-06T20:00:05.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.134+0000 7ff47a7fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff47c15d220 0x7ff47c06bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33594/0 (socket says 172.21.15.6:33594) 2023-07-06T20:00:05.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.134+0000 7ff47a7fc700 1 -- 172.21.15.6:0/1580051248 learned_addr learned my addr 172.21.15.6:0/1580051248 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:05.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff47affd700 1 --2- 172.21.15.6:0/1580051248 >> v2:172.21.15.40:3300/0 conn(0x7ff47c15ce50 0x7ff47c0cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:05.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff479ffb700 1 -- 172.21.15.6:0/1580051248 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3636855436 0 0) 0x7ff47c160060 con 0x7ff47c15d220 2023-07-06T20:00:05.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff479ffb700 1 -- 172.21.15.6:0/1580051248 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4640035b0 con 0x7ff47c15d220 2023-07-06T20:00:05.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff479ffb700 1 -- 172.21.15.6:0/1580051248 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347170728 0 0) 0x7ff47c0cd800 con 0x7ff47c06c4c0 2023-07-06T20:00:05.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff479ffb700 1 -- 172.21.15.6:0/1580051248 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff47c160060 con 0x7ff47c06c4c0 2023-07-06T20:00:05.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff479ffb700 1 -- 172.21.15.6:0/1580051248 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1401574169 0 0) 0x7ff4640035b0 con 0x7ff47c15d220 2023-07-06T20:00:05.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff479ffb700 1 -- 172.21.15.6:0/1580051248 >> v2:172.21.15.40:3300/0 conn(0x7ff47c15ce50 msgr2=0x7ff47c0cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:05.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff479ffb700 1 --2- 172.21.15.6:0/1580051248 >> v2:172.21.15.40:3300/0 conn(0x7ff47c15ce50 0x7ff47c0cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff479ffb700 1 -- 172.21.15.6:0/1580051248 >> v1:172.21.15.40:6789/0 conn(0x7ff47c06c4c0 legacy=0x7ff47c0d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:05.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff479ffb700 1 -- 172.21.15.6:0/1580051248 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c160590 con 0x7ff47c15d220 2023-07-06T20:00:05.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff479ffb700 1 -- 172.21.15.6:0/1580051248 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7ff46c0015f0 con 0x7ff47c15d220 2023-07-06T20:00:05.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff479ffb700 1 -- 172.21.15.6:0/1580051248 >> v1:172.21.15.6:6789/0 conn(0x7ff47c15d220 legacy=0x7ff47c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:05.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff479ffb700 1 --2- 172.21.15.6:0/1580051248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff464003c50 0x7ff464004040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:05.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff479ffb700 1 --2- 172.21.15.6:0/1580051248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff464004850 0x7ff464004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:05.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff479ffb700 1 --2- 172.21.15.6:0/1580051248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff464005200 0x7ff46400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:05.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff479ffb700 1 -- 172.21.15.6:0/1580051248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c1602b0 con 0x7ff464003c50 2023-07-06T20:00:05.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff479ffb700 1 -- 172.21.15.6:0/1580051248 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46400c110 con 0x7ff464004850 2023-07-06T20:00:05.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff479ffb700 1 -- 172.21.15.6:0/1580051248 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46400c2d0 con 0x7ff464005200 2023-07-06T20:00:05.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff47affd700 1 --2- 172.21.15.6:0/1580051248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff464003c50 0x7ff464004040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:05.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff47a7fc700 1 --2- 172.21.15.6:0/1580051248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff464004850 0x7ff464004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:05.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff47b7fe700 1 --2- 172.21.15.6:0/1580051248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff464005200 0x7ff46400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:05.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff47affd700 1 -- 172.21.15.6:0/1580051248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff464005200 msgr2=0x7ff46400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:05.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff47affd700 1 --2- 172.21.15.6:0/1580051248 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff464005200 0x7ff46400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff47affd700 1 -- 172.21.15.6:0/1580051248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff464004850 msgr2=0x7ff464004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:05.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff47affd700 1 --2- 172.21.15.6:0/1580051248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff464004850 0x7ff464004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff47affd700 1 -- 172.21.15.6:0/1580051248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4640035b0 con 0x7ff464003c50 2023-07-06T20:00:05.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff47a7fc700 1 --2- 172.21.15.6:0/1580051248 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff464004850 0x7ff464004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:05.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.135+0000 7ff47b7fe700 1 -- 172.21.15.6:0/1580051248 reap_dead start 2023-07-06T20:00:05.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.136+0000 7ff47affd700 1 --2- 172.21.15.6:0/1580051248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff464003c50 0x7ff464004040 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff470009b60 tx=0x7ff464005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a22becc95e737e server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:05.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.136+0000 7ff479ffb700 1 -- 172.21.15.6:0/1580051248 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47000e6c0 con 0x7ff464003c50 2023-07-06T20:00:05.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.136+0000 7ff479ffb700 1 -- 172.21.15.6:0/1580051248 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47000e820 con 0x7ff464003c50 2023-07-06T20:00:05.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.136+0000 7ff479ffb700 1 -- 172.21.15.6:0/1580051248 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47000eb90 con 0x7ff464003c50 2023-07-06T20:00:05.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.136+0000 7ff481684700 1 -- 172.21.15.6:0/1580051248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff464003c50 msgr2=0x7ff464004040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:05.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.136+0000 7ff481684700 1 --2- 172.21.15.6:0/1580051248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff464003c50 0x7ff464004040 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff470009b60 tx=0x7ff464005880 comp rx=0 tx=0).stop 2023-07-06T20:00:05.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.136+0000 7ff481684700 1 -- 172.21.15.6:0/1580051248 shutdown_connections 2023-07-06T20:00:05.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.136+0000 7ff481684700 1 --2- 172.21.15.6:0/1580051248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff464003c50 0x7ff464004040 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.136+0000 7ff481684700 1 -- 172.21.15.6:0/1580051248 >> 172.21.15.6:0/1580051248 conn(0x7ff47c0d3880 msgr2=0x7ff47c0cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:05.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.136+0000 7ff481684700 1 -- 172.21.15.6:0/1580051248 shutdown_connections 2023-07-06T20:00:05.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.136+0000 7ff481684700 1 -- 172.21.15.6:0/1580051248 wait complete. 2023-07-06T20:00:05.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.138+0000 7ff481684700 1 Processor -- start 2023-07-06T20:00:05.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.138+0000 7ff481684700 1 -- start start 2023-07-06T20:00:05.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.139+0000 7ff481684700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff464003c50 0x7ff47c158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:05.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.139+0000 7ff481684700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff47c0cc640 0x7ff47c0b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:05.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.139+0000 7ff481684700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff47c14cf00 0x7ff47c0cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:05.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.139+0000 7ff481684700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c0b5f60 con 0x7ff464003c50 2023-07-06T20:00:05.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.139+0000 7ff481684700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c0ccab0 con 0x7ff47c14cf00 2023-07-06T20:00:05.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.139+0000 7ff481684700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c0b6150 con 0x7ff47c0cc640 2023-07-06T20:00:05.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.139+0000 7ff47affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff464003c50 0x7ff47c158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:05.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.139+0000 7ff47affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff464003c50 0x7ff47c158bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60628/0 (socket says 172.21.15.6:60628) 2023-07-06T20:00:05.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.139+0000 7ff47affd700 1 -- 172.21.15.6:0/946259007 learned_addr learned my addr 172.21.15.6:0/946259007 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:05.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.139+0000 7ff47a7fc700 1 --2- 172.21.15.6:0/946259007 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff47c0cc640 0x7ff47c0b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:05.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.139+0000 7ff47b7fe700 1 --2- 172.21.15.6:0/946259007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff47c14cf00 0x7ff47c0cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:05.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.140+0000 7ff47affd700 1 -- 172.21.15.6:0/946259007 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff47c0cc640 msgr2=0x7ff47c0b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:05.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.140+0000 7ff47affd700 1 --2- 172.21.15.6:0/946259007 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff47c0cc640 0x7ff47c0b5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.140+0000 7ff47affd700 1 -- 172.21.15.6:0/946259007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff47c14cf00 msgr2=0x7ff47c0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:05.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.140+0000 7ff47affd700 1 --2- 172.21.15.6:0/946259007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff47c14cf00 0x7ff47c0cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.140+0000 7ff47affd700 1 -- 172.21.15.6:0/946259007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c160f10 con 0x7ff464003c50 2023-07-06T20:00:05.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.140+0000 7ff47b7fe700 1 --2- 172.21.15.6:0/946259007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff47c14cf00 0x7ff47c0cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:05.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.140+0000 7ff47affd700 1 --2- 172.21.15.6:0/946259007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff464003c50 0x7ff47c158bc0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff46400c0e0 tx=0x7ff4700047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:05.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.140+0000 7ff4637fe700 1 -- 172.21.15.6:0/946259007 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47000e6c0 con 0x7ff464003c50 2023-07-06T20:00:05.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.140+0000 7ff4637fe700 1 -- 172.21.15.6:0/946259007 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff470003ad0 con 0x7ff464003c50 2023-07-06T20:00:05.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.140+0000 7ff481684700 1 -- 172.21.15.6:0/946259007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47c0b6430 con 0x7ff464003c50 2023-07-06T20:00:05.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.140+0000 7ff4637fe700 1 -- 172.21.15.6:0/946259007 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff470003e80 con 0x7ff464003c50 2023-07-06T20:00:05.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.140+0000 7ff481684700 1 -- 172.21.15.6:0/946259007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47c0c7980 con 0x7ff464003c50 2023-07-06T20:00:05.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.141+0000 7ff481684700 1 -- 172.21.15.6:0/946259007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47c0c7b70 con 0x7ff464003c50 2023-07-06T20:00:05.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.141+0000 7ff4637fe700 1 -- 172.21.15.6:0/946259007 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff470013470 con 0x7ff464003c50 2023-07-06T20:00:05.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.142+0000 7ff4637fe700 1 --2- 172.21.15.6:0/946259007 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7ff46806ad10 0x7ff46806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:05.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.142+0000 7ff4637fe700 1 -- 172.21.15.6:0/946259007 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff47008b120 con 0x7ff464003c50 2023-07-06T20:00:05.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.142+0000 7ff47a7fc700 1 --2- 172.21.15.6:0/946259007 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7ff46806ad10 0x7ff46806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:05.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.142+0000 7ff47a7fc700 1 --2- 172.21.15.6:0/946259007 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7ff46806ad10 0x7ff46806d1c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff47c0cc5d0 tx=0x7ff46c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:05.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.146+0000 7ff4637fe700 1 -- 172.21.15.6:0/946259007 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff470056050 con 0x7ff464003c50 2023-07-06T20:00:05.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.394+0000 7ff481684700 1 -- 172.21.15.6:0/946259007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff47c0b1f30 con 0x7ff464003c50 2023-07-06T20:00:05.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.395+0000 7ff4637fe700 1 -- 172.21.15.6:0/946259007 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4652 (secure 0 0 0) 0x7ff470059670 con 0x7ff464003c50 2023-07-06T20:00:05.397 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:05.397 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3695014381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3695014381},{"type":"v1","addr":"172.21.15.6:6835","nonce":3695014381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/849399781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":849399781},{"type":"v1","addr":"172.21.15.40:6833","nonce":849399781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/512806705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":512806705},{"type":"v1","addr":"172.21.15.40:6835","nonce":512806705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T19:58:53.158966+0000","modified":"2023-07-06T19:59:17.827616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/368324315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":368324315},{"type":"v1","addr":"172.21.15.6:6837","nonce":368324315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-06T20:00:05.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.397+0000 7ff481684700 1 -- 172.21.15.6:0/946259007 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7ff46806ad10 msgr2=0x7ff46806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:05.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.397+0000 7ff481684700 1 --2- 172.21.15.6:0/946259007 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7ff46806ad10 0x7ff46806d1c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff47c0cc5d0 tx=0x7ff46c009040 comp rx=0 tx=0).stop 2023-07-06T20:00:05.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.397+0000 7ff481684700 1 -- 172.21.15.6:0/946259007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff464003c50 msgr2=0x7ff47c158bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:05.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.397+0000 7ff481684700 1 --2- 172.21.15.6:0/946259007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff464003c50 0x7ff47c158bc0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff46400c0e0 tx=0x7ff4700047c0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.397+0000 7ff481684700 1 -- 172.21.15.6:0/946259007 shutdown_connections 2023-07-06T20:00:05.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.397+0000 7ff481684700 1 --2- 172.21.15.6:0/946259007 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7ff46806ad10 0x7ff46806d1c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.397+0000 7ff481684700 1 --2- 172.21.15.6:0/946259007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff464003c50 0x7ff47c158bc0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.397+0000 7ff481684700 1 --2- 172.21.15.6:0/946259007 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff47c14cf00 0x7ff47c0cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.397+0000 7ff481684700 1 --2- 172.21.15.6:0/946259007 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff47c0cc640 0x7ff47c0b5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.397+0000 7ff481684700 1 -- 172.21.15.6:0/946259007 >> 172.21.15.6:0/946259007 conn(0x7ff47c0d3880 msgr2=0x7ff47c15f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.397+0000 7ff481684700 1 -- 172.21.15.6:0/946259007 shutdown_connections 2023-07-06T20:00:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.397+0000 7ff481684700 1 -- 172.21.15.6:0/946259007 wait complete. 2023-07-06T20:00:05.401 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 9 2023-07-06T20:00:05.411 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T20:00:05.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.534+0000 7fb8f739b700 1 Processor -- start 2023-07-06T20:00:05.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.535+0000 7fb8f739b700 1 -- start start 2023-07-06T20:00:05.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.535+0000 7fb8f739b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb8f00ceab0 0x7fb8f00caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.535+0000 7fb8f739b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f00cee80 0x7fb8f00716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:05.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.535+0000 7fb8f739b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f0160ff0 con 0x7fb8f0071c00 2023-07-06T20:00:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.535+0000 7fb8f739b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f00cb400 con 0x7fb8f00ceab0 2023-07-06T20:00:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.535+0000 7fb8f739b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f0072020 con 0x7fb8f00cee80 2023-07-06T20:00:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.536+0000 7fb8f5938700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb8f0071c00 0x7fb8f01602c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33614/0 (socket says 172.21.15.6:33614) 2023-07-06T20:00:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.536+0000 7fb8f5938700 1 -- 172.21.15.6:0/633737660 learned_addr learned my addr 172.21.15.6:0/633737660 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.536+0000 7fb8f5137700 1 --2- 172.21.15.6:0/633737660 >> v2:172.21.15.40:3300/0 conn(0x7fb8f00ceab0 0x7fb8f00caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.536+0000 7fb8f4936700 1 --2- 172.21.15.6:0/633737660 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f00cee80 0x7fb8f00716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:05.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.536+0000 7fb8e3fff700 1 -- 172.21.15.6:0/633737660 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 956060418 0 0) 0x7fb8f0160ff0 con 0x7fb8f0071c00 2023-07-06T20:00:05.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.536+0000 7fb8e3fff700 1 -- 172.21.15.6:0/633737660 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8dc0035b0 con 0x7fb8f0071c00 2023-07-06T20:00:05.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.536+0000 7fb8e3fff700 1 -- 172.21.15.6:0/633737660 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3586775257 0 0) 0x7fb8dc0035b0 con 0x7fb8f0071c00 2023-07-06T20:00:05.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.536+0000 7fb8e3fff700 1 -- 172.21.15.6:0/633737660 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f00cee80 msgr2=0x7fb8f00716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:05.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.536+0000 7fb8e3fff700 1 --2- 172.21.15.6:0/633737660 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f00cee80 0x7fb8f00716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.536+0000 7fb8e3fff700 1 -- 172.21.15.6:0/633737660 >> v2:172.21.15.40:3300/0 conn(0x7fb8f00ceab0 msgr2=0x7fb8f00caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:05.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.536+0000 7fb8e3fff700 1 --2- 172.21.15.6:0/633737660 >> v2:172.21.15.40:3300/0 conn(0x7fb8f00ceab0 0x7fb8f00caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.536+0000 7fb8e3fff700 1 -- 172.21.15.6:0/633737660 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f00ca100 con 0x7fb8f0071c00 2023-07-06T20:00:05.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.536+0000 7fb8e3fff700 1 -- 172.21.15.6:0/633737660 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7fb8e80019f0 con 0x7fb8f0071c00 2023-07-06T20:00:05.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.536+0000 7fb8e3fff700 1 -- 172.21.15.6:0/633737660 >> v1:172.21.15.6:6789/0 conn(0x7fb8f0071c00 legacy=0x7fb8f01602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:05.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.536+0000 7fb8e3fff700 1 --2- 172.21.15.6:0/633737660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8dc003a70 0x7fb8dc003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:05.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.536+0000 7fb8e3fff700 1 --2- 172.21.15.6:0/633737660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8dc004850 0x7fb8dc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:05.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.536+0000 7fb8e3fff700 1 --2- 172.21.15.6:0/633737660 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f00cee80 0x7fb8dc005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:05.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.536+0000 7fb8e3fff700 1 -- 172.21.15.6:0/633737660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f00cb400 con 0x7fb8dc004850 2023-07-06T20:00:05.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.536+0000 7fb8e3fff700 1 -- 172.21.15.6:0/633737660 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f0072020 con 0x7fb8dc003a70 2023-07-06T20:00:05.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.536+0000 7fb8e3fff700 1 -- 172.21.15.6:0/633737660 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8dc00ba10 con 0x7fb8f00cee80 2023-07-06T20:00:05.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.536+0000 7fb8f5137700 1 --2- 172.21.15.6:0/633737660 >> v2:172.21.15.40:3300/0 conn(0x7fb8f00ceab0 0x7fb8f00caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T20:00:05.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.536+0000 7fb8f4936700 1 --2- 172.21.15.6:0/633737660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8dc004850 0x7fb8dc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:05.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.536+0000 7fb8f5938700 1 --2- 172.21.15.6:0/633737660 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f00cee80 0x7fb8dc005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:05.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.537+0000 7fb8f5137700 1 --2- 172.21.15.6:0/633737660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8dc003a70 0x7fb8dc003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:05.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.537+0000 7fb8f4936700 1 -- 172.21.15.6:0/633737660 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f00cee80 msgr2=0x7fb8dc005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.537+0000 7fb8f4936700 1 --2- 172.21.15.6:0/633737660 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f00cee80 0x7fb8dc005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.537+0000 7fb8f4936700 1 -- 172.21.15.6:0/633737660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8dc003a70 msgr2=0x7fb8dc003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.537+0000 7fb8f4936700 1 --2- 172.21.15.6:0/633737660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8dc003a70 0x7fb8dc003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.537+0000 7fb8f4936700 1 -- 172.21.15.6:0/633737660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8dc0035b0 con 0x7fb8dc004850 2023-07-06T20:00:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.537+0000 7fb8f5938700 1 --2- 172.21.15.6:0/633737660 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f00cee80 0x7fb8dc005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.537+0000 7fb8f4936700 1 --2- 172.21.15.6:0/633737660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8dc004850 0x7fb8dc004cc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009b90 tx=0x7fb8dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffbcf1689c2a5bd0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.537+0000 7fb8e3fff700 1 -- 172.21.15.6:0/633737660 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400e6c0 con 0x7fb8dc004850 2023-07-06T20:00:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.537+0000 7fb8e3fff700 1 -- 172.21.15.6:0/633737660 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e400e820 con 0x7fb8dc004850 2023-07-06T20:00:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.537+0000 7fb8e3fff700 1 -- 172.21.15.6:0/633737660 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e400eb90 con 0x7fb8dc004850 2023-07-06T20:00:05.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.537+0000 7fb8f739b700 1 -- 172.21.15.6:0/633737660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8dc004850 msgr2=0x7fb8dc004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.537+0000 7fb8f739b700 1 --2- 172.21.15.6:0/633737660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8dc004850 0x7fb8dc004cc0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb8e4009b90 tx=0x7fb8dc005880 comp rx=0 tx=0).stop 2023-07-06T20:00:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.537+0000 7fb8f5938700 1 -- 172.21.15.6:0/633737660 reap_dead start 2023-07-06T20:00:05.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.537+0000 7fb8f739b700 1 -- 172.21.15.6:0/633737660 shutdown_connections 2023-07-06T20:00:05.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.537+0000 7fb8f739b700 1 -- 172.21.15.6:0/633737660 >> 172.21.15.6:0/633737660 conn(0x7fb8f00cc420 msgr2=0x7fb8f00cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:05.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.538+0000 7fb8f739b700 1 -- 172.21.15.6:0/633737660 shutdown_connections 2023-07-06T20:00:05.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.538+0000 7fb8f739b700 1 -- 172.21.15.6:0/633737660 wait complete. 2023-07-06T20:00:05.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.539+0000 7fb8f739b700 1 Processor -- start 2023-07-06T20:00:05.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.539+0000 7fb8f739b700 1 -- start start 2023-07-06T20:00:05.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.539+0000 7fb8f739b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8dc004850 0x7fb8f0156610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:05.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.539+0000 7fb8f739b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f0153ba0 0x7fb8f01f5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:05.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.539+0000 7fb8f739b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8f00cf9c0 0x7fb8f00cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:05.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.539+0000 7fb8f739b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f01487c0 con 0x7fb8dc004850 2023-07-06T20:00:05.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.539+0000 7fb8f739b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f0155620 con 0x7fb8f00cf9c0 2023-07-06T20:00:05.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.539+0000 7fb8f739b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f00d0360 con 0x7fb8f0153ba0 2023-07-06T20:00:05.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.540+0000 7fb8f5137700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8dc004850 0x7fb8f0156610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:05.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.540+0000 7fb8f5137700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8dc004850 0x7fb8f0156610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60646/0 (socket says 172.21.15.6:60646) 2023-07-06T20:00:05.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.540+0000 7fb8f5137700 1 -- 172.21.15.6:0/510659788 learned_addr learned my addr 172.21.15.6:0/510659788 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:05.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.540+0000 7fb8f5137700 1 -- 172.21.15.6:0/510659788 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f0153ba0 msgr2=0x7fb8f01f5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:05.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.540+0000 7fb8f4936700 1 --2- 172.21.15.6:0/510659788 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f0153ba0 0x7fb8f01f5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:05.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.540+0000 7fb8f5938700 1 --2- 172.21.15.6:0/510659788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8f00cf9c0 0x7fb8f00cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:05.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.540+0000 7fb8f5137700 1 --2- 172.21.15.6:0/510659788 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f0153ba0 0x7fb8f01f5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.540+0000 7fb8f5137700 1 -- 172.21.15.6:0/510659788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8f00cf9c0 msgr2=0x7fb8f00cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.540+0000 7fb8f5137700 1 --2- 172.21.15.6:0/510659788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8f00cf9c0 0x7fb8f00cfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.540+0000 7fb8f5137700 1 -- 172.21.15.6:0/510659788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f01f60b0 con 0x7fb8dc004850 2023-07-06T20:00:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.540+0000 7fb8f4936700 1 --2- 172.21.15.6:0/510659788 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f0153ba0 0x7fb8f01f5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T20:00:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.540+0000 7fb8f5137700 1 --2- 172.21.15.6:0/510659788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8dc004850 0x7fb8f0156610 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec011900 tx=0x7fb8ec011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.540+0000 7fb8e1ffb700 1 -- 172.21.15.6:0/510659788 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec00fae0 con 0x7fb8dc004850 2023-07-06T20:00:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.540+0000 7fb8e1ffb700 1 -- 172.21.15.6:0/510659788 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec00fc40 con 0x7fb8dc004850 2023-07-06T20:00:05.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.540+0000 7fb8f739b700 1 -- 172.21.15.6:0/510659788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f01558b0 con 0x7fb8dc004850 2023-07-06T20:00:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.540+0000 7fb8e1ffb700 1 -- 172.21.15.6:0/510659788 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec011ea0 con 0x7fb8dc004850 2023-07-06T20:00:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.540+0000 7fb8f739b700 1 -- 172.21.15.6:0/510659788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f01560f0 con 0x7fb8dc004850 2023-07-06T20:00:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.541+0000 7fb8f739b700 1 -- 172.21.15.6:0/510659788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f0155a90 con 0x7fb8dc004850 2023-07-06T20:00:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.542+0000 7fb8e1ffb700 1 -- 172.21.15.6:0/510659788 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb8ec015460 con 0x7fb8dc004850 2023-07-06T20:00:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.542+0000 7fb8e1ffb700 1 --2- 172.21.15.6:0/510659788 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb8d406ace0 0x7fb8d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.542+0000 7fb8f4936700 1 --2- 172.21.15.6:0/510659788 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb8d406ace0 0x7fb8d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:05.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.542+0000 7fb8e1ffb700 1 -- 172.21.15.6:0/510659788 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb8ec08a200 con 0x7fb8dc004850 2023-07-06T20:00:05.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.543+0000 7fb8f4936700 1 --2- 172.21.15.6:0/510659788 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb8d406ace0 0x7fb8d406d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40090b0 tx=0x7fb8e4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:05.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.547+0000 7fb8e1ffb700 1 -- 172.21.15.6:0/510659788 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb8ec058a10 con 0x7fb8dc004850 2023-07-06T20:00:05.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.790+0000 7fb8f739b700 1 -- 172.21.15.6:0/510659788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8f00b5920 con 0x7fb8dc004850 2023-07-06T20:00:05.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.790+0000 7fb8e1ffb700 1 -- 172.21.15.6:0/510659788 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4652 (secure 0 0 0) 0x7fb8ec0585a0 con 0x7fb8dc004850 2023-07-06T20:00:05.793 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:05.793 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/3695014381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":3695014381},{"type":"v1","addr":"172.21.15.6:6835","nonce":3695014381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/849399781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":849399781},{"type":"v1","addr":"172.21.15.40:6833","nonce":849399781}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/512806705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":512806705},{"type":"v1","addr":"172.21.15.40:6835","nonce":512806705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T19:58:53.158966+0000","modified":"2023-07-06T19:59:17.827616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.6:6837/368324315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":368324315},{"type":"v1","addr":"172.21.15.6:6837","nonce":368324315}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-06T20:00:05.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.792+0000 7fb8f739b700 1 -- 172.21.15.6:0/510659788 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb8d406ace0 msgr2=0x7fb8d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:05.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.792+0000 7fb8f739b700 1 --2- 172.21.15.6:0/510659788 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb8d406ace0 0x7fb8d406d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb8e40090b0 tx=0x7fb8e4008030 comp rx=0 tx=0).stop 2023-07-06T20:00:05.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.792+0000 7fb8f739b700 1 -- 172.21.15.6:0/510659788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8dc004850 msgr2=0x7fb8f0156610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:05.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.792+0000 7fb8f739b700 1 --2- 172.21.15.6:0/510659788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8dc004850 0x7fb8f0156610 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec011900 tx=0x7fb8ec011cc0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.792+0000 7fb8f739b700 1 -- 172.21.15.6:0/510659788 shutdown_connections 2023-07-06T20:00:05.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.792+0000 7fb8f739b700 1 --2- 172.21.15.6:0/510659788 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb8d406ace0 0x7fb8d406d190 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.792+0000 7fb8f739b700 1 --2- 172.21.15.6:0/510659788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8dc004850 0x7fb8f0156610 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.792+0000 7fb8f739b700 1 --2- 172.21.15.6:0/510659788 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8f00cf9c0 0x7fb8f00cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.792+0000 7fb8f739b700 1 --2- 172.21.15.6:0/510659788 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb8f0153ba0 0x7fb8f01f5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.792+0000 7fb8f739b700 1 -- 172.21.15.6:0/510659788 >> 172.21.15.6:0/510659788 conn(0x7fb8f00cc420 msgr2=0x7fb8f015e150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:05.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.792+0000 7fb8f739b700 1 -- 172.21.15.6:0/510659788 shutdown_connections 2023-07-06T20:00:05.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.792+0000 7fb8f739b700 1 -- 172.21.15.6:0/510659788 wait complete. 2023-07-06T20:00:05.796 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 9 2023-07-06T20:00:05.807 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T20:00:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.933+0000 7fc391364700 1 Processor -- start 2023-07-06T20:00:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.933+0000 7fc391364700 1 -- start start 2023-07-06T20:00:05.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.934+0000 7fc391364700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc38c0ceab0 0x7fc38c0caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:05.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.934+0000 7fc391364700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc38c0cee80 0x7fc38c0716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:05.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.934+0000 7fc391364700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc38c160ff0 con 0x7fc38c071c00 2023-07-06T20:00:05.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.934+0000 7fc391364700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc38c0cb400 con 0x7fc38c0cee80 2023-07-06T20:00:05.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.934+0000 7fc391364700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c072020 con 0x7fc38c0ceab0 2023-07-06T20:00:05.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.934+0000 7fc38a7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc38c0cee80 0x7fc38c0716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:05.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.934+0000 7fc38a7fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc38c0cee80 0x7fc38c0716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60656/0 (socket says 172.21.15.6:60656) 2023-07-06T20:00:05.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.934+0000 7fc38a7fc700 1 -- 172.21.15.6:0/4006251057 learned_addr learned my addr 172.21.15.6:0/4006251057 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:05.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.934+0000 7fc38affd700 1 --2- 172.21.15.6:0/4006251057 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc38c0ceab0 0x7fc38c0caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:05.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.935+0000 7fc38a7fc700 1 -- 172.21.15.6:0/4006251057 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc38c0ceab0 msgr2=0x7fc38c0caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:05.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.935+0000 7fc38a7fc700 1 --2- 172.21.15.6:0/4006251057 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc38c0ceab0 0x7fc38c0caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.935+0000 7fc38a7fc700 1 -- 172.21.15.6:0/4006251057 >> v1:172.21.15.40:6789/0 conn(0x7fc38c071c00 legacy=0x7fc38c1602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:05.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.935+0000 7fc38a7fc700 1 -- 172.21.15.6:0/4006251057 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38c0ca100 con 0x7fc38c0cee80 2023-07-06T20:00:05.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.935+0000 7fc38a7fc700 1 --2- 172.21.15.6:0/4006251057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc38c0cee80 0x7fc38c0716c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc37c0098f0 tx=0x7fc37c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2b1da6e8a326384 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:05.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.935+0000 7fc389ffb700 1 -- 172.21.15.6:0/4006251057 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c00b8a0 con 0x7fc38c0cee80 2023-07-06T20:00:05.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.935+0000 7fc389ffb700 1 -- 172.21.15.6:0/4006251057 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37c00ba00 con 0x7fc38c0cee80 2023-07-06T20:00:05.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.935+0000 7fc389ffb700 1 -- 172.21.15.6:0/4006251057 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c00bd90 con 0x7fc38c0cee80 2023-07-06T20:00:05.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.935+0000 7fc391364700 1 -- 172.21.15.6:0/4006251057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc38c0cee80 msgr2=0x7fc38c0716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:05.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.935+0000 7fc391364700 1 --2- 172.21.15.6:0/4006251057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc38c0cee80 0x7fc38c0716c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc37c0098f0 tx=0x7fc37c009c00 comp rx=0 tx=0).stop 2023-07-06T20:00:05.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.935+0000 7fc391364700 1 -- 172.21.15.6:0/4006251057 shutdown_connections 2023-07-06T20:00:05.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.936+0000 7fc391364700 1 --2- 172.21.15.6:0/4006251057 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc38c0ceab0 0x7fc38c0caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.936+0000 7fc391364700 1 --2- 172.21.15.6:0/4006251057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc38c0cee80 0x7fc38c0716c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.936+0000 7fc391364700 1 -- 172.21.15.6:0/4006251057 >> 172.21.15.6:0/4006251057 conn(0x7fc38c0cc420 msgr2=0x7fc38c0cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:05.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.936+0000 7fc391364700 1 -- 172.21.15.6:0/4006251057 shutdown_connections 2023-07-06T20:00:05.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.936+0000 7fc391364700 1 -- 172.21.15.6:0/4006251057 wait complete. 2023-07-06T20:00:05.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.937+0000 7fc391364700 1 Processor -- start 2023-07-06T20:00:05.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.937+0000 7fc391364700 1 -- start start 2023-07-06T20:00:05.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.938+0000 7fc391364700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc38c071c00 0x7fc38c149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:05.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.938+0000 7fc391364700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc38c0ceab0 0x7fc38c0b0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:05.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.938+0000 7fc391364700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc38c0cee80 0x7fc38c0b0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:05.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.938+0000 7fc391364700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c15adf0 con 0x7fc38c0ceab0 2023-07-06T20:00:05.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.938+0000 7fc391364700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c15a530 con 0x7fc38c071c00 2023-07-06T20:00:05.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.938+0000 7fc391364700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c1597c0 con 0x7fc38c0cee80 2023-07-06T20:00:05.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.938+0000 7fc38a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc38c0ceab0 0x7fc38c0b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:05.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.938+0000 7fc38a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc38c0ceab0 0x7fc38c0b0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60662/0 (socket says 172.21.15.6:60662) 2023-07-06T20:00:05.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.938+0000 7fc38a7fc700 1 -- 172.21.15.6:0/2593015175 learned_addr learned my addr 172.21.15.6:0/2593015175 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:05.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.938+0000 7fc38affd700 1 --2- 172.21.15.6:0/2593015175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc38c071c00 0x7fc38c149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:05.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.938+0000 7fc38b7fe700 1 --2- 172.21.15.6:0/2593015175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc38c0cee80 0x7fc38c0b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:05.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.938+0000 7fc38a7fc700 1 -- 172.21.15.6:0/2593015175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc38c0cee80 msgr2=0x7fc38c0b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:05.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.938+0000 7fc38a7fc700 1 --2- 172.21.15.6:0/2593015175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc38c0cee80 0x7fc38c0b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.938+0000 7fc38a7fc700 1 -- 172.21.15.6:0/2593015175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc38c071c00 msgr2=0x7fc38c149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:05.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.938+0000 7fc38a7fc700 1 --2- 172.21.15.6:0/2593015175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc38c071c00 0x7fc38c149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:05.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.938+0000 7fc38a7fc700 1 -- 172.21.15.6:0/2593015175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c009550 con 0x7fc38c0ceab0 2023-07-06T20:00:05.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.938+0000 7fc38a7fc700 1 --2- 172.21.15.6:0/2593015175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc38c0ceab0 0x7fc38c0b0240 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc38c06ec50 tx=0x7fc37c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:05.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.938+0000 7fc3737fe700 1 -- 172.21.15.6:0/2593015175 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c004510 con 0x7fc38c0ceab0 2023-07-06T20:00:05.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.938+0000 7fc3737fe700 1 -- 172.21.15.6:0/2593015175 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc37c0036a0 con 0x7fc38c0ceab0 2023-07-06T20:00:05.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.938+0000 7fc391364700 1 -- 172.21.15.6:0/2593015175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc38c15a7a0 con 0x7fc38c0ceab0 2023-07-06T20:00:05.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.938+0000 7fc3737fe700 1 -- 172.21.15.6:0/2593015175 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc37c003a30 con 0x7fc38c0ceab0 2023-07-06T20:00:05.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.939+0000 7fc391364700 1 -- 172.21.15.6:0/2593015175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc38c15c550 con 0x7fc38c0ceab0 2023-07-06T20:00:05.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.939+0000 7fc391364700 1 -- 172.21.15.6:0/2593015175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc38c15afa0 con 0x7fc38c0ceab0 2023-07-06T20:00:05.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.940+0000 7fc3737fe700 1 -- 172.21.15.6:0/2593015175 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc37c003b90 con 0x7fc38c0ceab0 2023-07-06T20:00:05.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.940+0000 7fc3737fe700 1 --2- 172.21.15.6:0/2593015175 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc37806ace0 0x7fc37806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:05.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.940+0000 7fc3737fe700 1 -- 172.21.15.6:0/2593015175 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc37c08acd0 con 0x7fc38c0ceab0 2023-07-06T20:00:05.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.940+0000 7fc38affd700 1 --2- 172.21.15.6:0/2593015175 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc37806ace0 0x7fc37806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:05.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.941+0000 7fc38affd700 1 --2- 172.21.15.6:0/2593015175 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc37806ace0 0x7fc37806d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc3800099d0 tx=0x7fc380008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:05.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:05.945+0000 7fc3737fe700 1 -- 172.21.15.6:0/2593015175 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc38c15afa0 con 0x7fc38c0ceab0 2023-07-06T20:00:06.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.146+0000 7fc391364700 1 -- 172.21.15.6:0/2593015175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc38c074200 con 0x7fc38c0ceab0 2023-07-06T20:00:06.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.148+0000 7fc3737fe700 1 -- 172.21.15.6:0/2593015175 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20059 (secure 0 0 0) 0x7fc37c055a50 con 0x7fc38c0ceab0 2023-07-06T20:00:06.150 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:06.150 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":29,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T19:59:33.917851+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-06T19:58:51.062712+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-06T19:58:52.130350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-06T19:58:55.785128+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T20:00:06.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.150+0000 7fc391364700 1 -- 172.21.15.6:0/2593015175 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc37806ace0 msgr2=0x7fc37806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:06.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.150+0000 7fc391364700 1 --2- 172.21.15.6:0/2593015175 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc37806ace0 0x7fc37806d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc3800099d0 tx=0x7fc380008040 comp rx=0 tx=0).stop 2023-07-06T20:00:06.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.150+0000 7fc391364700 1 -- 172.21.15.6:0/2593015175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc38c0ceab0 msgr2=0x7fc38c0b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:06.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.150+0000 7fc391364700 1 --2- 172.21.15.6:0/2593015175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc38c0ceab0 0x7fc38c0b0240 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc38c06ec50 tx=0x7fc37c004750 comp rx=0 tx=0).stop 2023-07-06T20:00:06.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.150+0000 7fc391364700 1 -- 172.21.15.6:0/2593015175 shutdown_connections 2023-07-06T20:00:06.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.150+0000 7fc391364700 1 --2- 172.21.15.6:0/2593015175 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc37806ace0 0x7fc37806d190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:06.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.150+0000 7fc391364700 1 --2- 172.21.15.6:0/2593015175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc38c0cee80 0x7fc38c0b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:06.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.150+0000 7fc391364700 1 --2- 172.21.15.6:0/2593015175 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc38c071c00 0x7fc38c149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:06.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.150+0000 7fc391364700 1 --2- 172.21.15.6:0/2593015175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc38c0ceab0 0x7fc38c0b0240 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:06.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.150+0000 7fc391364700 1 -- 172.21.15.6:0/2593015175 >> 172.21.15.6:0/2593015175 conn(0x7fc38c0cc420 msgr2=0x7fc38c1516e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:06.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.150+0000 7fc391364700 1 -- 172.21.15.6:0/2593015175 shutdown_connections 2023-07-06T20:00:06.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.150+0000 7fc391364700 1 -- 172.21.15.6:0/2593015175 wait complete. 2023-07-06T20:00:06.166 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-06T20:00:06.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.289+0000 7f4f1e573700 1 Processor -- start 2023-07-06T20:00:06.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.290+0000 7f4f1e573700 1 -- start start 2023-07-06T20:00:06.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.290+0000 7f4f1e573700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4f18071900 0x7f4f180ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:06.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.290+0000 7f4f1e573700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f18071cd0 0x7f4f180ca680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:06.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.290+0000 7f4f1e573700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f180cb310 con 0x7f4f1815bf50 2023-07-06T20:00:06.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.290+0000 7f4f1e573700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f180cdbf0 con 0x7f4f18071900 2023-07-06T20:00:06.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.290+0000 7f4f1e573700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180af070 con 0x7f4f18071cd0 2023-07-06T20:00:06.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.291+0000 7f4f17fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f4f18071900 0x7f4f180ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:06.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.291+0000 7f4f1cb10700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4f1815bf50 0x7f4f1815c3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33648/0 (socket says 172.21.15.6:33648) 2023-07-06T20:00:06.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.291+0000 7f4f1cb10700 1 -- 172.21.15.6:0/1482208622 learned_addr learned my addr 172.21.15.6:0/1482208622 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:06.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.291+0000 7f4f177fe700 1 --2- 172.21.15.6:0/1482208622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f18071cd0 0x7f4f180ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:06.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.291+0000 7f4f17fff700 1 -- 172.21.15.6:0/1482208622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f18071cd0 msgr2=0x7f4f180ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:06.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.291+0000 7f4f17fff700 1 --2- 172.21.15.6:0/1482208622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f18071cd0 0x7f4f180ca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.291+0000 7f4f17fff700 1 -- 172.21.15.6:0/1482208622 >> v1:172.21.15.6:6789/0 conn(0x7f4f1815bf50 legacy=0x7f4f1815c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.291+0000 7f4f17fff700 1 -- 172.21.15.6:0/1482208622 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f180cad50 con 0x7f4f18071900 2023-07-06T20:00:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.291+0000 7f4f17fff700 1 --2- 172.21.15.6:0/1482208622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f18071900 0x7f4f180ca140 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009840 tx=0x7f4f08009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184e6bcf27d6b311 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.291+0000 7f4f16ffd700 1 -- 172.21.15.6:0/1482208622 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08011830 con 0x7f4f18071900 2023-07-06T20:00:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.291+0000 7f4f16ffd700 1 -- 172.21.15.6:0/1482208622 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f08011990 con 0x7f4f18071900 2023-07-06T20:00:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.291+0000 7f4f16ffd700 1 -- 172.21.15.6:0/1482208622 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08011d20 con 0x7f4f18071900 2023-07-06T20:00:06.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.292+0000 7f4f1e573700 1 -- 172.21.15.6:0/1482208622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f18071900 msgr2=0x7f4f180ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:06.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.292+0000 7f4f1e573700 1 --2- 172.21.15.6:0/1482208622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f18071900 0x7f4f180ca140 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009840 tx=0x7f4f08009b50 comp rx=0 tx=0).stop 2023-07-06T20:00:06.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.292+0000 7f4f1e573700 1 -- 172.21.15.6:0/1482208622 shutdown_connections 2023-07-06T20:00:06.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.292+0000 7f4f1e573700 1 --2- 172.21.15.6:0/1482208622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f18071900 0x7f4f180ca140 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:06.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.292+0000 7f4f1e573700 1 --2- 172.21.15.6:0/1482208622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f18071cd0 0x7f4f180ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:06.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.292+0000 7f4f1e573700 1 -- 172.21.15.6:0/1482208622 >> 172.21.15.6:0/1482208622 conn(0x7f4f180cf960 msgr2=0x7f4f180cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:06.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.292+0000 7f4f1e573700 1 -- 172.21.15.6:0/1482208622 shutdown_connections 2023-07-06T20:00:06.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.292+0000 7f4f1e573700 1 -- 172.21.15.6:0/1482208622 wait complete. 2023-07-06T20:00:06.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.293+0000 7f4f1e573700 1 Processor -- start 2023-07-06T20:00:06.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.293+0000 7f4f1e573700 1 -- start start 2023-07-06T20:00:06.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.294+0000 7f4f1e573700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f18071900 0x7f4f1814fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:06.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.294+0000 7f4f1e573700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f18071cd0 0x7f4f181f6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:06.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.294+0000 7f4f1e573700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f1815bf50 0x7f4f1814a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:06.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.294+0000 7f4f1e573700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f18150d50 con 0x7f4f1815bf50 2023-07-06T20:00:06.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.294+0000 7f4f1e573700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f181f67d0 con 0x7f4f18071900 2023-07-06T20:00:06.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.294+0000 7f4f1e573700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f181501d0 con 0x7f4f18071cd0 2023-07-06T20:00:06.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.294+0000 7f4f1cb10700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f1815bf50 0x7f4f1814a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:06.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.294+0000 7f4f1cb10700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f1815bf50 0x7f4f1814a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60676/0 (socket says 172.21.15.6:60676) 2023-07-06T20:00:06.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.294+0000 7f4f1cb10700 1 -- 172.21.15.6:0/2404645362 learned_addr learned my addr 172.21.15.6:0/2404645362 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:06.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.294+0000 7f4f1cb10700 1 -- 172.21.15.6:0/2404645362 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f18071cd0 msgr2=0x7f4f181f6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:06.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.294+0000 7f4f1cb10700 1 --2- 172.21.15.6:0/2404645362 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f18071cd0 0x7f4f181f6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:06.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.294+0000 7f4f1cb10700 1 -- 172.21.15.6:0/2404645362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f18071900 msgr2=0x7f4f1814fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:06.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.294+0000 7f4f1cb10700 1 --2- 172.21.15.6:0/2404645362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f18071900 0x7f4f1814fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:06.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.294+0000 7f4f1cb10700 1 -- 172.21.15.6:0/2404645362 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f080094a0 con 0x7f4f1815bf50 2023-07-06T20:00:06.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.294+0000 7f4f1cb10700 1 --2- 172.21.15.6:0/2404645362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f1815bf50 0x7f4f1814a4c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000cbf0 tx=0x7f4f100021c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:06.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.295+0000 7f4f14ff9700 1 -- 172.21.15.6:0/2404645362 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1000ab40 con 0x7f4f1815bf50 2023-07-06T20:00:06.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.295+0000 7f4f14ff9700 1 -- 172.21.15.6:0/2404645362 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1000aca0 con 0x7f4f1815bf50 2023-07-06T20:00:06.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.295+0000 7f4f1e573700 1 -- 172.21.15.6:0/2404645362 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f181504b0 con 0x7f4f1815bf50 2023-07-06T20:00:06.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.295+0000 7f4f14ff9700 1 -- 172.21.15.6:0/2404645362 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f10012600 con 0x7f4f1815bf50 2023-07-06T20:00:06.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.295+0000 7f4f1e573700 1 -- 172.21.15.6:0/2404645362 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f18150a70 con 0x7f4f1815bf50 2023-07-06T20:00:06.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.296+0000 7f4f1e573700 1 -- 172.21.15.6:0/2404645362 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1814dc10 con 0x7f4f1815bf50 2023-07-06T20:00:06.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.296+0000 7f4f14ff9700 1 -- 172.21.15.6:0/2404645362 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f1001b3b0 con 0x7f4f1815bf50 2023-07-06T20:00:06.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.297+0000 7f4f14ff9700 1 --2- 172.21.15.6:0/2404645362 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4ef806ace0 0x7f4ef806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:06.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.297+0000 7f4f14ff9700 1 -- 172.21.15.6:0/2404645362 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4f10089350 con 0x7f4f1815bf50 2023-07-06T20:00:06.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.297+0000 7f4f17fff700 1 --2- 172.21.15.6:0/2404645362 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4ef806ace0 0x7f4ef806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:06.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.297+0000 7f4f17fff700 1 --2- 172.21.15.6:0/2404645362 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4ef806ace0 0x7f4ef806d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4f080090b0 tx=0x7f4f08010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:06.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.301+0000 7f4f14ff9700 1 -- 172.21.15.6:0/2404645362 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4f1814dc10 con 0x7f4f1815bf50 2023-07-06T20:00:06.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.543+0000 7f4f1e573700 1 -- 172.21.15.6:0/2404645362 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4f1814dc10 con 0x7f4f1815bf50 2023-07-06T20:00:06.546 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-07-06T20:00:06.544+0000 7f6748688700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-06T20:00:06.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.547+0000 7f4f14ff9700 1 -- 172.21.15.6:0/2404645362 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4f1814dc10 con 0x7f4f1815bf50 2023-07-06T20:00:06.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.550+0000 7f4f1e573700 1 -- 172.21.15.6:0/2404645362 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4ef806ace0 msgr2=0x7f4ef806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:06.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.550+0000 7f4f1e573700 1 --2- 172.21.15.6:0/2404645362 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4ef806ace0 0x7f4ef806d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4f080090b0 tx=0x7f4f08010000 comp rx=0 tx=0).stop 2023-07-06T20:00:06.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.550+0000 7f4f1e573700 1 -- 172.21.15.6:0/2404645362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f1815bf50 msgr2=0x7f4f1814a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:06.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.550+0000 7f4f1e573700 1 --2- 172.21.15.6:0/2404645362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f1815bf50 0x7f4f1814a4c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4f1000cbf0 tx=0x7f4f100021c0 comp rx=0 tx=0).stop 2023-07-06T20:00:06.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.550+0000 7f4f1e573700 1 -- 172.21.15.6:0/2404645362 shutdown_connections 2023-07-06T20:00:06.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.550+0000 7f4f1e573700 1 --2- 172.21.15.6:0/2404645362 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4ef806ace0 0x7f4ef806d190 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:06.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.550+0000 7f4f1e573700 1 --2- 172.21.15.6:0/2404645362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f1815bf50 0x7f4f1814a4c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:06.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.550+0000 7f4f1e573700 1 --2- 172.21.15.6:0/2404645362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f18071900 0x7f4f1814fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:06.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.550+0000 7f4f1e573700 1 --2- 172.21.15.6:0/2404645362 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f18071cd0 0x7f4f181f6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:06.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.550+0000 7f4f1e573700 1 -- 172.21.15.6:0/2404645362 >> 172.21.15.6:0/2404645362 conn(0x7f4f180cf960 msgr2=0x7f4f1806ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:06.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.550+0000 7f4f1e573700 1 -- 172.21.15.6:0/2404645362 shutdown_connections 2023-07-06T20:00:06.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.550+0000 7f4f1e573700 1 -- 172.21.15.6:0/2404645362 wait complete. 2023-07-06T20:00:06.555 INFO:tasks.ceph.mds.c.smithi006.stderr: -5986> 2023-07-06T19:58:58.843+0000 7fab31c33700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-06T20:00:06.555 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-06T20:00:06.566 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-06T20:00:06.587 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-07-06T20:00:06.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.694+0000 7fc408487700 1 Processor -- start 2023-07-06T20:00:06.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.694+0000 7fc408487700 1 -- start start 2023-07-06T20:00:06.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.695+0000 7fc408487700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc400071900 0x7fc4000ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:06.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.695+0000 7fc408487700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4000cb310 con 0x7fc40015c660 2023-07-06T20:00:06.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.695+0000 7fc408487700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4000af070 con 0x7fc400071cd0 2023-07-06T20:00:06.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.695+0000 7fc408487700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4000cdbf0 con 0x7fc400071900 2023-07-06T20:00:06.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.695+0000 7fc406a24700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc40015c660 0x7fc4000ce010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33672/0 (socket says 172.21.15.6:33672) 2023-07-06T20:00:06.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.695+0000 7fc406a24700 1 -- 172.21.15.6:0/1093578135 learned_addr learned my addr 172.21.15.6:0/1093578135 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:06.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.695+0000 7fc406223700 1 --2- 172.21.15.6:0/1093578135 >> v2:172.21.15.6:3300/0 conn(0x7fc400071900 0x7fc4000ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:06.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.695+0000 7fc405221700 1 -- 172.21.15.6:0/1093578135 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995247613 0 0) 0x7fc4000cb310 con 0x7fc40015c660 2023-07-06T20:00:06.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.695+0000 7fc405221700 1 -- 172.21.15.6:0/1093578135 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3ec0035b0 con 0x7fc40015c660 2023-07-06T20:00:06.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.695+0000 7fc406223700 1 -- 172.21.15.6:0/1093578135 >> v1:172.21.15.40:6789/0 conn(0x7fc400071cd0 legacy=0x7fc40015bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:06.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.695+0000 7fc406223700 1 -- 172.21.15.6:0/1093578135 >> v1:172.21.15.6:6789/0 conn(0x7fc40015c660 legacy=0x7fc4000ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:06.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.695+0000 7fc406223700 1 -- 172.21.15.6:0/1093578135 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4000cad50 con 0x7fc400071900 2023-07-06T20:00:06.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.695+0000 7fc406223700 1 --2- 172.21.15.6:0/1093578135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc400071900 0x7fc4000ca140 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009840 tx=0x7fc3fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314fc58493229bae server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:06.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.696+0000 7fc405221700 1 -- 172.21.15.6:0/1093578135 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc011830 con 0x7fc400071900 2023-07-06T20:00:06.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.696+0000 7fc405221700 1 -- 172.21.15.6:0/1093578135 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3fc011990 con 0x7fc400071900 2023-07-06T20:00:06.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.696+0000 7fc405221700 1 -- 172.21.15.6:0/1093578135 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc011d20 con 0x7fc400071900 2023-07-06T20:00:06.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.696+0000 7fc408487700 1 -- 172.21.15.6:0/1093578135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc400071900 msgr2=0x7fc4000ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:06.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.696+0000 7fc408487700 1 --2- 172.21.15.6:0/1093578135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc400071900 0x7fc4000ca140 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc009840 tx=0x7fc3fc009b50 comp rx=0 tx=0).stop 2023-07-06T20:00:06.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.696+0000 7fc408487700 1 -- 172.21.15.6:0/1093578135 shutdown_connections 2023-07-06T20:00:06.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.696+0000 7fc408487700 1 --2- 172.21.15.6:0/1093578135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc400071900 0x7fc4000ca140 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:06.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.696+0000 7fc408487700 1 -- 172.21.15.6:0/1093578135 >> 172.21.15.6:0/1093578135 conn(0x7fc4000cf960 msgr2=0x7fc4000cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:06.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.696+0000 7fc408487700 1 -- 172.21.15.6:0/1093578135 shutdown_connections 2023-07-06T20:00:06.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.696+0000 7fc408487700 1 -- 172.21.15.6:0/1093578135 wait complete. 2023-07-06T20:00:06.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.698+0000 7fc408487700 1 Processor -- start 2023-07-06T20:00:06.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.698+0000 7fc408487700 1 -- start start 2023-07-06T20:00:06.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.699+0000 7fc408487700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc400071900 0x7fc4000b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:06.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.699+0000 7fc408487700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc400071cd0 0x7fc4000b4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:06.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.699+0000 7fc408487700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc40015c660 0x7fc40006db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:06.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.699+0000 7fc408487700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4000b4e70 con 0x7fc40015c660 2023-07-06T20:00:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.699+0000 7fc408487700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4000ac420 con 0x7fc400071cd0 2023-07-06T20:00:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.699+0000 7fc408487700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4000b2db0 con 0x7fc400071900 2023-07-06T20:00:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.699+0000 7fc406a24700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc40015c660 0x7fc40006db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.699+0000 7fc406a24700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc40015c660 0x7fc40006db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60704/0 (socket says 172.21.15.6:60704) 2023-07-06T20:00:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.699+0000 7fc406a24700 1 -- 172.21.15.6:0/3287599692 learned_addr learned my addr 172.21.15.6:0/3287599692 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.699+0000 7fc406223700 1 --2- 172.21.15.6:0/3287599692 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc400071900 0x7fc4000b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:06.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.699+0000 7fc405a22700 1 --2- 172.21.15.6:0/3287599692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc400071cd0 0x7fc4000b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:06.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.699+0000 7fc406a24700 1 -- 172.21.15.6:0/3287599692 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc400071900 msgr2=0x7fc4000b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:06.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.699+0000 7fc406a24700 1 --2- 172.21.15.6:0/3287599692 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc400071900 0x7fc4000b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:06.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.699+0000 7fc406a24700 1 -- 172.21.15.6:0/3287599692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc400071cd0 msgr2=0x7fc4000b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:06.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.699+0000 7fc406a24700 1 --2- 172.21.15.6:0/3287599692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc400071cd0 0x7fc4000b4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:06.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.699+0000 7fc406a24700 1 -- 172.21.15.6:0/3287599692 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3fc0094a0 con 0x7fc40015c660 2023-07-06T20:00:06.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.699+0000 7fc406a24700 1 --2- 172.21.15.6:0/3287599692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc40015c660 0x7fc40006db50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800cb40 tx=0x7fc3f800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:06.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.700+0000 7fc3f6ffd700 1 -- 172.21.15.6:0/3287599692 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f800a9e0 con 0x7fc40015c660 2023-07-06T20:00:06.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.700+0000 7fc3f6ffd700 1 -- 172.21.15.6:0/3287599692 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f800ab40 con 0x7fc40015c660 2023-07-06T20:00:06.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.700+0000 7fc408487700 1 -- 172.21.15.6:0/3287599692 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4000b3090 con 0x7fc40015c660 2023-07-06T20:00:06.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.700+0000 7fc3f6ffd700 1 -- 172.21.15.6:0/3287599692 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f8012400 con 0x7fc40015c660 2023-07-06T20:00:06.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.700+0000 7fc408487700 1 -- 172.21.15.6:0/3287599692 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4000b3650 con 0x7fc40015c660 2023-07-06T20:00:06.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.700+0000 7fc408487700 1 -- 172.21.15.6:0/3287599692 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4000ac5f0 con 0x7fc40015c660 2023-07-06T20:00:06.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.701+0000 7fc3f6ffd700 1 -- 172.21.15.6:0/3287599692 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc3f801b3b0 con 0x7fc40015c660 2023-07-06T20:00:06.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.701+0000 7fc3f6ffd700 1 --2- 172.21.15.6:0/3287599692 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc3e406ad10 0x7fc3e406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:06.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.701+0000 7fc3f6ffd700 1 -- 172.21.15.6:0/3287599692 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fc3f8089360 con 0x7fc40015c660 2023-07-06T20:00:06.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.701+0000 7fc406223700 1 --2- 172.21.15.6:0/3287599692 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc3e406ad10 0x7fc3e406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:06.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.702+0000 7fc406223700 1 --2- 172.21.15.6:0/3287599692 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc3e406ad10 0x7fc3e406d1c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0090b0 tx=0x7fc3fc01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:06.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.706+0000 7fc3f6ffd700 1 -- 172.21.15.6:0/3287599692 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc3f8054140 con 0x7fc40015c660 2023-07-06T20:00:06.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:06.953+0000 7fc408487700 1 -- 172.21.15.6:0/3287599692 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc4000cd7e0 con 0x7fc40015c660 2023-07-06T20:00:07.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.553+0000 7fc3f6ffd700 1 -- 172.21.15.6:0/3287599692 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc3f8057760 con 0x7fc40015c660 2023-07-06T20:00:07.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.556+0000 7fc408487700 1 -- 172.21.15.6:0/3287599692 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc3e406ad10 msgr2=0x7fc3e406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:07.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.556+0000 7fc408487700 1 --2- 172.21.15.6:0/3287599692 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc3e406ad10 0x7fc3e406d1c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0090b0 tx=0x7fc3fc01c040 comp rx=0 tx=0).stop 2023-07-06T20:00:07.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.556+0000 7fc408487700 1 -- 172.21.15.6:0/3287599692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc40015c660 msgr2=0x7fc40006db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:07.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.556+0000 7fc408487700 1 --2- 172.21.15.6:0/3287599692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc40015c660 0x7fc40006db50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800cb40 tx=0x7fc3f800ce50 comp rx=0 tx=0).stop 2023-07-06T20:00:07.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.557+0000 7fc408487700 1 -- 172.21.15.6:0/3287599692 shutdown_connections 2023-07-06T20:00:07.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.557+0000 7fc408487700 1 --2- 172.21.15.6:0/3287599692 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc3e406ad10 0x7fc3e406d1c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:07.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.557+0000 7fc408487700 1 --2- 172.21.15.6:0/3287599692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc40015c660 0x7fc40006db50 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:07.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.557+0000 7fc408487700 1 --2- 172.21.15.6:0/3287599692 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc400071900 0x7fc4000b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:07.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.557+0000 7fc408487700 1 --2- 172.21.15.6:0/3287599692 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc400071cd0 0x7fc4000b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:07.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.557+0000 7fc408487700 1 -- 172.21.15.6:0/3287599692 >> 172.21.15.6:0/3287599692 conn(0x7fc4000cf960 msgr2=0x7fc40015ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:07.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.557+0000 7fc408487700 1 -- 172.21.15.6:0/3287599692 shutdown_connections 2023-07-06T20:00:07.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.557+0000 7fc408487700 1 -- 172.21.15.6:0/3287599692 wait complete. 2023-07-06T20:00:07.574 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-06T20:00:07.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.751+0000 7f653b842700 1 Processor -- start 2023-07-06T20:00:07.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.751+0000 7f653b842700 1 -- start start 2023-07-06T20:00:07.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.752+0000 7f653b842700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6534070e10 0x7f65340711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:07.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.752+0000 7f653b842700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65340c96a0 0x7f65340c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:07.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.752+0000 7f653b842700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6534158110 con 0x7f65340cb200 2023-07-06T20:00:07.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.752+0000 7f653b842700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f653406f1d0 con 0x7f6534070e10 2023-07-06T20:00:07.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.752+0000 7f653b842700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653406a900 con 0x7f65340c96a0 2023-07-06T20:00:07.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.752+0000 7f6539ddf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65340c96a0 0x7f65340c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:07.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.752+0000 7f65395de700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6534070e10 0x7f65340711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:07.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.752+0000 7f6538ddd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f65340cb200 0x7f653406eac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:51790/0 (socket says 172.21.15.6:51790) 2023-07-06T20:00:07.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.752+0000 7f6538ddd700 1 -- 172.21.15.6:0/87798380 learned_addr learned my addr 172.21.15.6:0/87798380 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:07.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.753+0000 7f652bfff700 1 -- 172.21.15.6:0/87798380 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2845948161 0 0) 0x7f6534158110 con 0x7f65340cb200 2023-07-06T20:00:07.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.753+0000 7f652bfff700 1 -- 172.21.15.6:0/87798380 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65200035b0 con 0x7f65340cb200 2023-07-06T20:00:07.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.753+0000 7f6539ddf700 1 -- 172.21.15.6:0/87798380 >> v2:172.21.15.40:3300/0 conn(0x7f6534070e10 msgr2=0x7f65340711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:07.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.753+0000 7f6539ddf700 1 --2- 172.21.15.6:0/87798380 >> v2:172.21.15.40:3300/0 conn(0x7f6534070e10 0x7f65340711e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:07.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.753+0000 7f6539ddf700 1 -- 172.21.15.6:0/87798380 >> v1:172.21.15.40:6789/0 conn(0x7f65340cb200 legacy=0x7f653406eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:07.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.753+0000 7f6539ddf700 1 -- 172.21.15.6:0/87798380 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6534071720 con 0x7f65340c96a0 2023-07-06T20:00:07.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.753+0000 7f65395de700 1 --2- 172.21.15.6:0/87798380 >> v2:172.21.15.40:3300/0 conn(0x7f6534070e10 0x7f65340711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T20:00:07.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.753+0000 7f6539ddf700 1 --2- 172.21.15.6:0/87798380 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65340c96a0 0x7f65340c9b20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f652c009d90 tx=0x7f652c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9084c42036bf7108 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:07.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.753+0000 7f652bfff700 1 -- 172.21.15.6:0/87798380 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c00bd20 con 0x7f65340c96a0 2023-07-06T20:00:07.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.753+0000 7f652bfff700 1 -- 172.21.15.6:0/87798380 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652c00be80 con 0x7f65340c96a0 2023-07-06T20:00:07.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.753+0000 7f652bfff700 1 -- 172.21.15.6:0/87798380 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c010710 con 0x7f65340c96a0 2023-07-06T20:00:07.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.754+0000 7f653b842700 1 -- 172.21.15.6:0/87798380 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65340c96a0 msgr2=0x7f65340c9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:07.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.754+0000 7f653b842700 1 --2- 172.21.15.6:0/87798380 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65340c96a0 0x7f65340c9b20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f652c009d90 tx=0x7f652c00b330 comp rx=0 tx=0).stop 2023-07-06T20:00:07.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.754+0000 7f653b842700 1 -- 172.21.15.6:0/87798380 shutdown_connections 2023-07-06T20:00:07.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.754+0000 7f653b842700 1 --2- 172.21.15.6:0/87798380 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65340c96a0 0x7f65340c9b20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:07.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.754+0000 7f653b842700 1 --2- 172.21.15.6:0/87798380 >> v2:172.21.15.40:3300/0 conn(0x7f6534070e10 0x7f65340711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:07.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.754+0000 7f653b842700 1 -- 172.21.15.6:0/87798380 >> 172.21.15.6:0/87798380 conn(0x7f65340cf050 msgr2=0x7f65340cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:07.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.754+0000 7f653b842700 1 -- 172.21.15.6:0/87798380 shutdown_connections 2023-07-06T20:00:07.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.754+0000 7f653b842700 1 -- 172.21.15.6:0/87798380 wait complete. 2023-07-06T20:00:07.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.755+0000 7f653b842700 1 Processor -- start 2023-07-06T20:00:07.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.755+0000 7f653b842700 1 -- start start 2023-07-06T20:00:07.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.756+0000 7f653b842700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6534070e10 0x7f65340b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:07.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.756+0000 7f653b842700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65340c96a0 0x7f65340b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:07.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.756+0000 7f653b842700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65340cb200 0x7f65340b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:07.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.756+0000 7f653b842700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6534154300 con 0x7f6534070e10 2023-07-06T20:00:07.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.756+0000 7f653b842700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65341545e0 con 0x7f65340c96a0 2023-07-06T20:00:07.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.756+0000 7f653b842700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65341548c0 con 0x7f65340cb200 2023-07-06T20:00:07.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.756+0000 7f65395de700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6534070e10 0x7f65340b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:07.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.756+0000 7f65395de700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6534070e10 0x7f65340b1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60716/0 (socket says 172.21.15.6:60716) 2023-07-06T20:00:07.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.756+0000 7f65395de700 1 -- 172.21.15.6:0/875430436 learned_addr learned my addr 172.21.15.6:0/875430436 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:07.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.756+0000 7f6539ddf700 1 --2- 172.21.15.6:0/875430436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65340cb200 0x7f65340b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:07.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.756+0000 7f6538ddd700 1 --2- 172.21.15.6:0/875430436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65340c96a0 0x7f65340b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:07.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.756+0000 7f65395de700 1 -- 172.21.15.6:0/875430436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65340cb200 msgr2=0x7f65340b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:07.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.756+0000 7f65395de700 1 --2- 172.21.15.6:0/875430436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65340cb200 0x7f65340b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:07.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.756+0000 7f65395de700 1 -- 172.21.15.6:0/875430436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65340c96a0 msgr2=0x7f65340b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:07.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.756+0000 7f65395de700 1 --2- 172.21.15.6:0/875430436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65340c96a0 0x7f65340b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:07.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.756+0000 7f65395de700 1 -- 172.21.15.6:0/875430436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65240094a0 con 0x7f6534070e10 2023-07-06T20:00:07.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.756+0000 7f6539ddf700 1 --2- 172.21.15.6:0/875430436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65340cb200 0x7f65340b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:07.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.756+0000 7f6538ddd700 1 --2- 172.21.15.6:0/875430436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65340c96a0 0x7f65340b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:07.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.757+0000 7f65395de700 1 --2- 172.21.15.6:0/875430436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6534070e10 0x7f65340b1f40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f652400ebe0 tx=0x7f6524009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:07.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.757+0000 7f6529ffb700 1 -- 172.21.15.6:0/875430436 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652400c910 con 0x7f6534070e10 2023-07-06T20:00:07.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.757+0000 7f6529ffb700 1 -- 172.21.15.6:0/875430436 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652400ca70 con 0x7f6534070e10 2023-07-06T20:00:07.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.757+0000 7f653b842700 1 -- 172.21.15.6:0/875430436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f652c009a70 con 0x7f6534070e10 2023-07-06T20:00:07.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.757+0000 7f6529ffb700 1 -- 172.21.15.6:0/875430436 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652400cde0 con 0x7f6534070e10 2023-07-06T20:00:07.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.757+0000 7f653b842700 1 -- 172.21.15.6:0/875430436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6534153fd0 con 0x7f6534070e10 2023-07-06T20:00:07.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.758+0000 7f653b842700 1 -- 172.21.15.6:0/875430436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65340b38a0 con 0x7f6534070e10 2023-07-06T20:00:07.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.758+0000 7f6529ffb700 1 -- 172.21.15.6:0/875430436 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6524013470 con 0x7f6534070e10 2023-07-06T20:00:07.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.759+0000 7f6529ffb700 1 --2- 172.21.15.6:0/875430436 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f651806ace0 0x7f651806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:07.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.759+0000 7f6529ffb700 1 -- 172.21.15.6:0/875430436 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f6524089d00 con 0x7f6534070e10 2023-07-06T20:00:07.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.759+0000 7f6538ddd700 1 --2- 172.21.15.6:0/875430436 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f651806ace0 0x7f651806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:07.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.759+0000 7f6538ddd700 1 --2- 172.21.15.6:0/875430436 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f651806ace0 0x7f651806d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f65340cdf20 tx=0x7f6530009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:07.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.763+0000 7f6529ffb700 1 -- 172.21.15.6:0/875430436 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6524054ac0 con 0x7f6534070e10 2023-07-06T20:00:07.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:07.962+0000 7f653b842700 1 -- 172.21.15.6:0/875430436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6534154440 con 0x7f6534070e10 2023-07-06T20:00:08.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.558+0000 7f6529ffb700 1 -- 172.21.15.6:0/875430436 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6534154440 con 0x7f6534070e10 2023-07-06T20:00:08.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.562+0000 7f653b842700 1 -- 172.21.15.6:0/875430436 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f651806ace0 msgr2=0x7f651806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:08.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.562+0000 7f653b842700 1 --2- 172.21.15.6:0/875430436 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f651806ace0 0x7f651806d190 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f65340cdf20 tx=0x7f6530009040 comp rx=0 tx=0).stop 2023-07-06T20:00:08.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.562+0000 7f653b842700 1 -- 172.21.15.6:0/875430436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6534070e10 msgr2=0x7f65340b1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:08.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.562+0000 7f653b842700 1 --2- 172.21.15.6:0/875430436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6534070e10 0x7f65340b1f40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f652400ebe0 tx=0x7f6524009ec0 comp rx=0 tx=0).stop 2023-07-06T20:00:08.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.562+0000 7f653b842700 1 -- 172.21.15.6:0/875430436 shutdown_connections 2023-07-06T20:00:08.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.562+0000 7f653b842700 1 --2- 172.21.15.6:0/875430436 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f651806ace0 0x7f651806d190 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:08.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.562+0000 7f653b842700 1 --2- 172.21.15.6:0/875430436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6534070e10 0x7f65340b1f40 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:08.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.562+0000 7f653b842700 1 --2- 172.21.15.6:0/875430436 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f65340cb200 0x7f65340b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:08.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.562+0000 7f653b842700 1 --2- 172.21.15.6:0/875430436 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65340c96a0 0x7f65340b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:08.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.562+0000 7f653b842700 1 -- 172.21.15.6:0/875430436 >> 172.21.15.6:0/875430436 conn(0x7f65340cf050 msgr2=0x7f65340cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:08.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.563+0000 7f653b842700 1 -- 172.21.15.6:0/875430436 shutdown_connections 2023-07-06T20:00:08.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.563+0000 7f653b842700 1 -- 172.21.15.6:0/875430436 wait complete. 2023-07-06T20:00:08.569 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-07-06T20:00:08.582 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-06T20:00:08.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.718+0000 7f582aa56700 1 Processor -- start 2023-07-06T20:00:08.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.718+0000 7f582aa56700 1 -- start start 2023-07-06T20:00:08.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.719+0000 7f582aa56700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f582415c670 0x7f582406bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:08.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.719+0000 7f582aa56700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582406aa30 con 0x7f58240cd950 2023-07-06T20:00:08.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.719+0000 7f582aa56700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582415ca40 con 0x7f582406c410 2023-07-06T20:00:08.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.719+0000 7f582aa56700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f582406c950 con 0x7f582415c670 2023-07-06T20:00:08.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.719+0000 7f5823fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f582415c670 0x7f582406bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:08.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.719+0000 7f5828ff3700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f58240cd950 0x7f58240d0b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33704/0 (socket says 172.21.15.6:33704) 2023-07-06T20:00:08.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.719+0000 7f5828ff3700 1 -- 172.21.15.6:0/3107609164 learned_addr learned my addr 172.21.15.6:0/3107609164 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:08.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.719+0000 7f5823fff700 1 -- 172.21.15.6:0/3107609164 >> v1:172.21.15.40:6789/0 conn(0x7f582406c410 legacy=0x7f58240cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:08.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.719+0000 7f5823fff700 1 -- 172.21.15.6:0/3107609164 >> v1:172.21.15.6:6789/0 conn(0x7f58240cd950 legacy=0x7f58240d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:08.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.719+0000 7f5823fff700 1 -- 172.21.15.6:0/3107609164 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582406a100 con 0x7f582415c670 2023-07-06T20:00:08.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.719+0000 7f5822ffd700 1 -- 172.21.15.6:0/3107609164 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196372388 0 0) 0x7f582406aa30 con 0x7f58240cd950 2023-07-06T20:00:08.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.720+0000 7f5823fff700 1 --2- 172.21.15.6:0/3107609164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f582415c670 0x7f582406bed0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5814009840 tx=0x7f5814009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92bc24acb160a58 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:08.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.720+0000 7f5822ffd700 1 -- 172.21.15.6:0/3107609164 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5814011830 con 0x7f582415c670 2023-07-06T20:00:08.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.720+0000 7f5822ffd700 1 -- 172.21.15.6:0/3107609164 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5814011990 con 0x7f582415c670 2023-07-06T20:00:08.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.720+0000 7f5822ffd700 1 -- 172.21.15.6:0/3107609164 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5814011d20 con 0x7f582415c670 2023-07-06T20:00:08.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.720+0000 7f582aa56700 1 -- 172.21.15.6:0/3107609164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f582415c670 msgr2=0x7f582406bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:08.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.720+0000 7f582aa56700 1 --2- 172.21.15.6:0/3107609164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f582415c670 0x7f582406bed0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5814009840 tx=0x7f5814009b50 comp rx=0 tx=0).stop 2023-07-06T20:00:08.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.720+0000 7f582aa56700 1 -- 172.21.15.6:0/3107609164 shutdown_connections 2023-07-06T20:00:08.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.720+0000 7f582aa56700 1 --2- 172.21.15.6:0/3107609164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f582415c670 0x7f582406bed0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:08.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.720+0000 7f582aa56700 1 -- 172.21.15.6:0/3107609164 >> 172.21.15.6:0/3107609164 conn(0x7f58240d2bf0 msgr2=0x7f58240d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:08.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.720+0000 7f582aa56700 1 -- 172.21.15.6:0/3107609164 shutdown_connections 2023-07-06T20:00:08.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.721+0000 7f582aa56700 1 -- 172.21.15.6:0/3107609164 wait complete. 2023-07-06T20:00:08.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.722+0000 7f582aa56700 1 Processor -- start 2023-07-06T20:00:08.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.722+0000 7f582aa56700 1 -- start start 2023-07-06T20:00:08.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.723+0000 7f582aa56700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f582406c410 0x7f58241447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:08.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.723+0000 7f582aa56700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58240cd950 0x7f58240c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:08.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.723+0000 7f582aa56700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f582415c670 0x7f58241e8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:08.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.723+0000 7f582aa56700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58241e9100 con 0x7f582415c670 2023-07-06T20:00:08.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.723+0000 7f582aa56700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58241589a0 con 0x7f58240cd950 2023-07-06T20:00:08.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.723+0000 7f582aa56700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5824158c80 con 0x7f582406c410 2023-07-06T20:00:08.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.723+0000 7f5828ff3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f582415c670 0x7f58241e8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:08.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.723+0000 7f5828ff3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f582415c670 0x7f58241e8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60734/0 (socket says 172.21.15.6:60734) 2023-07-06T20:00:08.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.723+0000 7f5828ff3700 1 -- 172.21.15.6:0/1236124403 learned_addr learned my addr 172.21.15.6:0/1236124403 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:08.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.723+0000 7f5823fff700 1 --2- 172.21.15.6:0/1236124403 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f582406c410 0x7f58241447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:08.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.723+0000 7f58237fe700 1 --2- 172.21.15.6:0/1236124403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58240cd950 0x7f58240c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:08.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.723+0000 7f5828ff3700 1 -- 172.21.15.6:0/1236124403 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f582406c410 msgr2=0x7f58241447c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:08.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.723+0000 7f5828ff3700 1 --2- 172.21.15.6:0/1236124403 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f582406c410 0x7f58241447c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:08.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.723+0000 7f5828ff3700 1 -- 172.21.15.6:0/1236124403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58240cd950 msgr2=0x7f58240c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:08.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.723+0000 7f5828ff3700 1 --2- 172.21.15.6:0/1236124403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58240cd950 0x7f58240c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:08.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.723+0000 7f5828ff3700 1 -- 172.21.15.6:0/1236124403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58140094a0 con 0x7f582415c670 2023-07-06T20:00:08.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.723+0000 7f58237fe700 1 --2- 172.21.15.6:0/1236124403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58240cd950 0x7f58240c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T20:00:08.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.723+0000 7f5823fff700 1 --2- 172.21.15.6:0/1236124403 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f582406c410 0x7f58241447c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T20:00:08.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.723+0000 7f5828ff3700 1 --2- 172.21.15.6:0/1236124403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f582415c670 0x7f58241e8640 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f581c00cc70 tx=0x7f581c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:08.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.723+0000 7f5820ff9700 1 -- 172.21.15.6:0/1236124403 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c00ad80 con 0x7f582415c670 2023-07-06T20:00:08.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.723+0000 7f5820ff9700 1 -- 172.21.15.6:0/1236124403 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c00ce70 con 0x7f582415c670 2023-07-06T20:00:08.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.723+0000 7f582aa56700 1 -- 172.21.15.6:0/1236124403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5824158f60 con 0x7f582415c670 2023-07-06T20:00:08.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.723+0000 7f5820ff9700 1 -- 172.21.15.6:0/1236124403 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c0072f0 con 0x7f582415c670 2023-07-06T20:00:08.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.723+0000 7f582aa56700 1 -- 172.21.15.6:0/1236124403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5824157fd0 con 0x7f582415c670 2023-07-06T20:00:08.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.724+0000 7f582aa56700 1 -- 172.21.15.6:0/1236124403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5824159480 con 0x7f582415c670 2023-07-06T20:00:08.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.725+0000 7f5820ff9700 1 -- 172.21.15.6:0/1236124403 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f581c007450 con 0x7f582415c670 2023-07-06T20:00:08.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.725+0000 7f5820ff9700 1 --2- 172.21.15.6:0/1236124403 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f581006ace0 0x7f581006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:08.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.725+0000 7f5820ff9700 1 -- 172.21.15.6:0/1236124403 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f581c089550 con 0x7f582415c670 2023-07-06T20:00:08.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.725+0000 7f5823fff700 1 --2- 172.21.15.6:0/1236124403 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f581006ace0 0x7f581006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:08.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.726+0000 7f5823fff700 1 --2- 172.21.15.6:0/1236124403 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f581006ace0 0x7f581006d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5814000c00 tx=0x7f581401c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:08.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.730+0000 7f5820ff9700 1 -- 172.21.15.6:0/1236124403 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5824159480 con 0x7f582415c670 2023-07-06T20:00:08.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:08.932+0000 7f582aa56700 1 -- 172.21.15.6:0/1236124403 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5824159480 con 0x7f582415c670 2023-07-06T20:00:09.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.562+0000 7f5820ff9700 1 -- 172.21.15.6:0/1236124403 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5824159480 con 0x7f582415c670 2023-07-06T20:00:09.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.567+0000 7f582aa56700 1 -- 172.21.15.6:0/1236124403 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f581006ace0 msgr2=0x7f581006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:09.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.567+0000 7f582aa56700 1 --2- 172.21.15.6:0/1236124403 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f581006ace0 0x7f581006d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5814000c00 tx=0x7f581401c040 comp rx=0 tx=0).stop 2023-07-06T20:00:09.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.567+0000 7f582aa56700 1 -- 172.21.15.6:0/1236124403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f582415c670 msgr2=0x7f58241e8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:09.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.567+0000 7f582aa56700 1 --2- 172.21.15.6:0/1236124403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f582415c670 0x7f58241e8640 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f581c00cc70 tx=0x7f581c00a340 comp rx=0 tx=0).stop 2023-07-06T20:00:09.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.567+0000 7f582aa56700 1 -- 172.21.15.6:0/1236124403 shutdown_connections 2023-07-06T20:00:09.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.567+0000 7f582aa56700 1 --2- 172.21.15.6:0/1236124403 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f581006ace0 0x7f581006d190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:09.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.567+0000 7f582aa56700 1 --2- 172.21.15.6:0/1236124403 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f582415c670 0x7f58241e8640 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:09.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.567+0000 7f582aa56700 1 --2- 172.21.15.6:0/1236124403 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f582406c410 0x7f58241447c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:09.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.567+0000 7f582aa56700 1 --2- 172.21.15.6:0/1236124403 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f58240cd950 0x7f58240c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:09.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.567+0000 7f582aa56700 1 -- 172.21.15.6:0/1236124403 >> 172.21.15.6:0/1236124403 conn(0x7f58240d2bf0 msgr2=0x7f582406aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:09.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.568+0000 7f582aa56700 1 -- 172.21.15.6:0/1236124403 shutdown_connections 2023-07-06T20:00:09.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.568+0000 7f582aa56700 1 -- 172.21.15.6:0/1236124403 wait complete. 2023-07-06T20:00:09.571 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-07-06T20:00:09.585 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-07-06T20:00:09.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.719+0000 7fa075afe700 1 Processor -- start 2023-07-06T20:00:09.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.719+0000 7fa075afe700 1 -- start start 2023-07-06T20:00:09.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.719+0000 7fa075afe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa0700d0580 0x7fa0700ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:09.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.719+0000 7fa075afe700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0700cb800 con 0x7fa07015e910 2023-07-06T20:00:09.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.719+0000 7fa075afe700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0700cd0f0 con 0x7fa07015de30 2023-07-06T20:00:09.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.719+0000 7fa075afe700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0700cb240 con 0x7fa0700d0580 2023-07-06T20:00:09.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.720+0000 7fa06effd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa0700d0580 0x7fa0700ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:09.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.720+0000 7fa06ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa07015e910 0x7fa0700cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33718/0 (socket says 172.21.15.6:33718) 2023-07-06T20:00:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.720+0000 7fa06ffff700 1 -- 172.21.15.6:0/166462044 learned_addr learned my addr 172.21.15.6:0/166462044 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.720+0000 7fa06effd700 1 -- 172.21.15.6:0/166462044 >> v1:172.21.15.40:6789/0 conn(0x7fa07015de30 legacy=0x7fa07015e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.720+0000 7fa06effd700 1 -- 172.21.15.6:0/166462044 >> v1:172.21.15.6:6789/0 conn(0x7fa07015e910 legacy=0x7fa0700cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.720+0000 7fa06effd700 1 -- 172.21.15.6:0/166462044 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0700cb520 con 0x7fa0700d0580 2023-07-06T20:00:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.720+0000 7fa06effd700 1 --2- 172.21.15.6:0/166462044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0700d0580 0x7fa0700ce9c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa064009840 tx=0x7fa064009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c41129917545beb server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.720+0000 7fa06e7fc700 1 -- 172.21.15.6:0/166462044 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa064004230 con 0x7fa0700d0580 2023-07-06T20:00:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.720+0000 7fa06e7fc700 1 -- 172.21.15.6:0/166462044 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa064004390 con 0x7fa0700d0580 2023-07-06T20:00:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.720+0000 7fa06e7fc700 1 -- 172.21.15.6:0/166462044 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0640036a0 con 0x7fa0700d0580 2023-07-06T20:00:09.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.721+0000 7fa075afe700 1 -- 172.21.15.6:0/166462044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0700d0580 msgr2=0x7fa0700ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:09.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.721+0000 7fa075afe700 1 --2- 172.21.15.6:0/166462044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0700d0580 0x7fa0700ce9c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa064009840 tx=0x7fa064009b50 comp rx=0 tx=0).stop 2023-07-06T20:00:09.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.721+0000 7fa075afe700 1 -- 172.21.15.6:0/166462044 shutdown_connections 2023-07-06T20:00:09.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.721+0000 7fa075afe700 1 --2- 172.21.15.6:0/166462044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0700d0580 0x7fa0700ce9c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:09.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.721+0000 7fa075afe700 1 -- 172.21.15.6:0/166462044 >> 172.21.15.6:0/166462044 conn(0x7fa0700ce160 msgr2=0x7fa0700d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:09.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.721+0000 7fa075afe700 1 -- 172.21.15.6:0/166462044 shutdown_connections 2023-07-06T20:00:09.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.721+0000 7fa075afe700 1 -- 172.21.15.6:0/166462044 wait complete. 2023-07-06T20:00:09.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.722+0000 7fa075afe700 1 Processor -- start 2023-07-06T20:00:09.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.722+0000 7fa075afe700 1 -- start start 2023-07-06T20:00:09.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.723+0000 7fa075afe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0700d0580 0x7fa07015bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:09.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.723+0000 7fa075afe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa07015de30 0x7fa070148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:09.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.723+0000 7fa075afe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07015e910 0x7fa07015cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:09.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.723+0000 7fa075afe700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07015ac80 con 0x7fa07015de30 2023-07-06T20:00:09.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.723+0000 7fa075afe700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07015af60 con 0x7fa07015e910 2023-07-06T20:00:09.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.723+0000 7fa075afe700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07015b240 con 0x7fa0700d0580 2023-07-06T20:00:09.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.723+0000 7fa06effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa07015de30 0x7fa070148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:09.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.723+0000 7fa06effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa07015de30 0x7fa070148ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60746/0 (socket says 172.21.15.6:60746) 2023-07-06T20:00:09.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.723+0000 7fa06effd700 1 -- 172.21.15.6:0/1313910356 learned_addr learned my addr 172.21.15.6:0/1313910356 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:09.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.723+0000 7fa06ffff700 1 --2- 172.21.15.6:0/1313910356 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07015e910 0x7fa07015cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:09.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.723+0000 7fa06f7fe700 1 --2- 172.21.15.6:0/1313910356 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0700d0580 0x7fa07015bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:09.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.723+0000 7fa06effd700 1 -- 172.21.15.6:0/1313910356 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0700d0580 msgr2=0x7fa07015bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:09.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.723+0000 7fa06effd700 1 --2- 172.21.15.6:0/1313910356 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0700d0580 0x7fa07015bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:09.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.723+0000 7fa06effd700 1 -- 172.21.15.6:0/1313910356 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07015e910 msgr2=0x7fa07015cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:09.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.723+0000 7fa06effd700 1 --2- 172.21.15.6:0/1313910356 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07015e910 0x7fa07015cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:09.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.723+0000 7fa06effd700 1 -- 172.21.15.6:0/1313910356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0640094a0 con 0x7fa07015de30 2023-07-06T20:00:09.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.723+0000 7fa06effd700 1 --2- 172.21.15.6:0/1313910356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa07015de30 0x7fa070148ee0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa0640090b0 tx=0x7fa064004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:09.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.724+0000 7fa057fff700 1 -- 172.21.15.6:0/1313910356 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa064011830 con 0x7fa07015de30 2023-07-06T20:00:09.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.724+0000 7fa057fff700 1 -- 172.21.15.6:0/1313910356 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06401e070 con 0x7fa07015de30 2023-07-06T20:00:09.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.724+0000 7fa075afe700 1 -- 172.21.15.6:0/1313910356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa07015b520 con 0x7fa07015de30 2023-07-06T20:00:09.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.724+0000 7fa057fff700 1 -- 172.21.15.6:0/1313910356 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa064011bf0 con 0x7fa07015de30 2023-07-06T20:00:09.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.724+0000 7fa075afe700 1 -- 172.21.15.6:0/1313910356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07015c260 con 0x7fa07015de30 2023-07-06T20:00:09.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.725+0000 7fa075afe700 1 -- 172.21.15.6:0/1313910356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa07015ba40 con 0x7fa07015de30 2023-07-06T20:00:09.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.725+0000 7fa057fff700 1 -- 172.21.15.6:0/1313910356 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa064011d50 con 0x7fa07015de30 2023-07-06T20:00:09.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.726+0000 7fa057fff700 1 --2- 172.21.15.6:0/1313910356 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa05c06ace0 0x7fa05c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:09.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.726+0000 7fa057fff700 1 -- 172.21.15.6:0/1313910356 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fa06408a7a0 con 0x7fa07015de30 2023-07-06T20:00:09.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.726+0000 7fa06f7fe700 1 --2- 172.21.15.6:0/1313910356 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa05c06ace0 0x7fa05c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:09.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.726+0000 7fa06f7fe700 1 --2- 172.21.15.6:0/1313910356 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa05c06ace0 0x7fa05c06d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa060004f30 tx=0x7fa060009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:09.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.730+0000 7fa057fff700 1 -- 172.21.15.6:0/1313910356 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa0640558f0 con 0x7fa07015de30 2023-07-06T20:00:09.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:09.930+0000 7fa075afe700 1 -- 172.21.15.6:0/1313910356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa070074200 con 0x7fa07015de30 2023-07-06T20:00:10.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.567+0000 7fa057fff700 1 -- 172.21.15.6:0/1313910356 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7fa064058f10 con 0x7fa07015de30 2023-07-06T20:00:10.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.571+0000 7fa075afe700 1 -- 172.21.15.6:0/1313910356 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa05c06ace0 msgr2=0x7fa05c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:10.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.571+0000 7fa075afe700 1 --2- 172.21.15.6:0/1313910356 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa05c06ace0 0x7fa05c06d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa060004f30 tx=0x7fa060009040 comp rx=0 tx=0).stop 2023-07-06T20:00:10.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.571+0000 7fa075afe700 1 -- 172.21.15.6:0/1313910356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa07015de30 msgr2=0x7fa070148ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:10.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.571+0000 7fa075afe700 1 --2- 172.21.15.6:0/1313910356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa07015de30 0x7fa070148ee0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa0640090b0 tx=0x7fa064004750 comp rx=0 tx=0).stop 2023-07-06T20:00:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.571+0000 7fa075afe700 1 -- 172.21.15.6:0/1313910356 shutdown_connections 2023-07-06T20:00:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.571+0000 7fa075afe700 1 --2- 172.21.15.6:0/1313910356 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa05c06ace0 0x7fa05c06d190 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.571+0000 7fa075afe700 1 --2- 172.21.15.6:0/1313910356 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa07015e910 0x7fa07015cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:10.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.571+0000 7fa075afe700 1 --2- 172.21.15.6:0/1313910356 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0700d0580 0x7fa07015bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:10.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.571+0000 7fa075afe700 1 --2- 172.21.15.6:0/1313910356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa07015de30 0x7fa070148ee0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:10.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.571+0000 7fa075afe700 1 -- 172.21.15.6:0/1313910356 >> 172.21.15.6:0/1313910356 conn(0x7fa0700ce160 msgr2=0x7fa07006dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:10.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.573+0000 7fa075afe700 1 -- 172.21.15.6:0/1313910356 shutdown_connections 2023-07-06T20:00:10.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.573+0000 7fa075afe700 1 -- 172.21.15.6:0/1313910356 wait complete. 2023-07-06T20:00:10.580 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data_ec' removed 2023-07-06T20:00:10.601 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-06T20:00:10.602 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-06T20:00:10.602 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-06T20:00:10.602 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T20:00:10.603 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-06T20:00:10.603 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-06T20:00:10.604 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-06T20:00:10.605 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T20:00:10.606 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-06T20:00:10.606 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-06T20:00:10.606 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-06T20:00:10.607 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T20:00:10.607 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-06T20:00:10.607 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-06T20:00:10.608 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-06T20:00:10.608 INFO:teuthology.orchestra.run:waiting for 300 2023-07-06T20:00:10.613 INFO:tasks.ceph.mds.a:Stopped 2023-07-06T20:00:10.613 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-06T20:00:10.618 INFO:tasks.ceph.mds.c:Stopped 2023-07-06T20:00:10.618 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-06T20:00:10.620 INFO:tasks.ceph.mds.b:Stopped 2023-07-06T20:00:10.621 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-06T20:00:10.624 INFO:tasks.ceph.mds.d:Stopped 2023-07-06T20:00:10.625 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-06T20:00:10.660 INFO:tasks.ceph.mds.a:Started 2023-07-06T20:00:10.661 DEBUG:teuthology.parallel:result is None 2023-07-06T20:00:10.663 INFO:tasks.ceph.mds.c:Started 2023-07-06T20:00:10.663 DEBUG:teuthology.parallel:result is None 2023-07-06T20:00:10.664 INFO:tasks.ceph.mds.b:Started 2023-07-06T20:00:10.665 INFO:tasks.ceph.mds.d:Started 2023-07-06T20:00:10.665 DEBUG:teuthology.parallel:result is None 2023-07-06T20:00:10.665 DEBUG:teuthology.parallel:result is None 2023-07-06T20:00:10.666 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-06T20:00:10.745 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2023-07-06T20:00:10.749 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2023-07-06T20:00:10.753 INFO:tasks.ceph.mds.d.smithi040.stdout:starting mds.d at 2023-07-06T20:00:10.754 INFO:tasks.ceph.mds.b.smithi040.stdout:starting mds.b at 2023-07-06T20:00:10.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.802+0000 7fc17e889700 1 Processor -- start 2023-07-06T20:00:10.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.802+0000 7fc17e889700 1 -- start start 2023-07-06T20:00:10.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.802+0000 7fc17e889700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc1780ca850 0x7fc17815bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:10.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.802+0000 7fc17e889700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc178071cd0 0x7fc17815c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:10.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.802+0000 7fc17e889700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1780cb310 con 0x7fc178071900 2023-07-06T20:00:10.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.803+0000 7fc17e889700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1780cdbf0 con 0x7fc1780ca850 2023-07-06T20:00:10.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.803+0000 7fc17e889700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17815c9d0 con 0x7fc178071cd0 2023-07-06T20:00:10.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.803+0000 7fc17ce26700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc178071cd0 0x7fc17815c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:10.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.803+0000 7fc1777fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc1780ca850 0x7fc17815bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:10.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.803+0000 7fc177fff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc178071900 0x7fc1780ca140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:51856/0 (socket says 172.21.15.6:51856) 2023-07-06T20:00:10.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.803+0000 7fc17ce26700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc178071cd0 0x7fc17815c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:53424/0 (socket says 172.21.15.6:53424) 2023-07-06T20:00:10.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.803+0000 7fc1777fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc1780ca850 0x7fc17815bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:39814/0 (socket says 172.21.15.6:39814) 2023-07-06T20:00:10.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.803+0000 7fc177fff700 1 -- 172.21.15.6:0/3716715754 learned_addr learned my addr 172.21.15.6:0/3716715754 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:10.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.803+0000 7fc176ffd700 1 -- 172.21.15.6:0/3716715754 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958188923 0 0) 0x7fc1780cb310 con 0x7fc178071900 2023-07-06T20:00:10.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.803+0000 7fc176ffd700 1 -- 172.21.15.6:0/3716715754 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1600035b0 con 0x7fc178071900 2023-07-06T20:00:10.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.803+0000 7fc1777fe700 1 -- 172.21.15.6:0/3716715754 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc178071cd0 msgr2=0x7fc17815c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:10.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.803+0000 7fc1777fe700 1 --2- 172.21.15.6:0/3716715754 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc178071cd0 0x7fc17815c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:10.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.803+0000 7fc1777fe700 1 -- 172.21.15.6:0/3716715754 >> v1:172.21.15.40:6789/0 conn(0x7fc178071900 legacy=0x7fc1780ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:10.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.803+0000 7fc1777fe700 1 -- 172.21.15.6:0/3716715754 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1780af070 con 0x7fc1780ca850 2023-07-06T20:00:10.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.803+0000 7fc17ce26700 1 --2- 172.21.15.6:0/3716715754 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc178071cd0 0x7fc17815c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T20:00:10.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.803+0000 7fc1777fe700 1 --2- 172.21.15.6:0/3716715754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1780ca850 0x7fc17815bf50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009840 tx=0x7fc16c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82ee53714d994382 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:10.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.804+0000 7fc176ffd700 1 -- 172.21.15.6:0/3716715754 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c011830 con 0x7fc1780ca850 2023-07-06T20:00:10.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.804+0000 7fc176ffd700 1 -- 172.21.15.6:0/3716715754 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c011990 con 0x7fc1780ca850 2023-07-06T20:00:10.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.804+0000 7fc176ffd700 1 -- 172.21.15.6:0/3716715754 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c011d20 con 0x7fc1780ca850 2023-07-06T20:00:10.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.804+0000 7fc17e889700 1 -- 172.21.15.6:0/3716715754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1780ca850 msgr2=0x7fc17815bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:10.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.804+0000 7fc17e889700 1 --2- 172.21.15.6:0/3716715754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1780ca850 0x7fc17815bf50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc16c009840 tx=0x7fc16c009b50 comp rx=0 tx=0).stop 2023-07-06T20:00:10.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.804+0000 7fc17e889700 1 -- 172.21.15.6:0/3716715754 shutdown_connections 2023-07-06T20:00:10.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.804+0000 7fc17e889700 1 --2- 172.21.15.6:0/3716715754 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc178071cd0 0x7fc17815c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:10.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.804+0000 7fc17e889700 1 --2- 172.21.15.6:0/3716715754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1780ca850 0x7fc17815bf50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:10.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.804+0000 7fc17e889700 1 -- 172.21.15.6:0/3716715754 >> 172.21.15.6:0/3716715754 conn(0x7fc1780cf960 msgr2=0x7fc1780cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:10.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.804+0000 7fc17e889700 1 -- 172.21.15.6:0/3716715754 shutdown_connections 2023-07-06T20:00:10.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.804+0000 7fc17e889700 1 -- 172.21.15.6:0/3716715754 wait complete. 2023-07-06T20:00:10.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.805+0000 7fc17e889700 1 Processor -- start 2023-07-06T20:00:10.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.806+0000 7fc17e889700 1 -- start start 2023-07-06T20:00:10.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.806+0000 7fc17e889700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc178071900 0x7fc17806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:10.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.806+0000 7fc17e889700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc178071cd0 0x7fc1780b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:10.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.806+0000 7fc17e889700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1780ca850 0x7fc1780b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:10.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.806+0000 7fc17e889700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1780acfc0 con 0x7fc1780ca850 2023-07-06T20:00:10.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.806+0000 7fc17e889700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1780ad1d0 con 0x7fc178071cd0 2023-07-06T20:00:10.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.806+0000 7fc17e889700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1780ad4b0 con 0x7fc178071900 2023-07-06T20:00:10.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.806+0000 7fc17ce26700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1780ca850 0x7fc1780b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:10.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.806+0000 7fc17ce26700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1780ca850 0x7fc1780b4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60786/0 (socket says 172.21.15.6:60786) 2023-07-06T20:00:10.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.806+0000 7fc17ce26700 1 -- 172.21.15.6:0/1543698653 learned_addr learned my addr 172.21.15.6:0/1543698653 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:10.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.807+0000 7fc177fff700 1 --2- 172.21.15.6:0/1543698653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc178071900 0x7fc17806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:10.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.807+0000 7fc1777fe700 1 --2- 172.21.15.6:0/1543698653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc178071cd0 0x7fc1780b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:10.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.807+0000 7fc17ce26700 1 -- 172.21.15.6:0/1543698653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc178071900 msgr2=0x7fc17806c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:10.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.807+0000 7fc17ce26700 1 --2- 172.21.15.6:0/1543698653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc178071900 0x7fc17806c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:10.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.807+0000 7fc17ce26700 1 -- 172.21.15.6:0/1543698653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc178071cd0 msgr2=0x7fc1780b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:10.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.807+0000 7fc17ce26700 1 --2- 172.21.15.6:0/1543698653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc178071cd0 0x7fc1780b4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:10.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.807+0000 7fc17ce26700 1 -- 172.21.15.6:0/1543698653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc170009a70 con 0x7fc1780ca850 2023-07-06T20:00:10.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.807+0000 7fc177fff700 1 --2- 172.21.15.6:0/1543698653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc178071900 0x7fc17806c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:10.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.807+0000 7fc17ce26700 1 --2- 172.21.15.6:0/1543698653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1780ca850 0x7fc1780b4fc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc17000efc0 tx=0x7fc17000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:10.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.807+0000 7fc174ff9700 1 -- 172.21.15.6:0/1543698653 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17000cb40 con 0x7fc1780ca850 2023-07-06T20:00:10.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.807+0000 7fc174ff9700 1 -- 172.21.15.6:0/1543698653 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17000f040 con 0x7fc1780ca850 2023-07-06T20:00:10.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.807+0000 7fc174ff9700 1 -- 172.21.15.6:0/1543698653 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc170003a20 con 0x7fc1780ca850 2023-07-06T20:00:10.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.807+0000 7fc17e889700 1 -- 172.21.15.6:0/1543698653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc16c0094a0 con 0x7fc1780ca850 2023-07-06T20:00:10.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.807+0000 7fc17e889700 1 -- 172.21.15.6:0/1543698653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1780ada70 con 0x7fc1780ca850 2023-07-06T20:00:10.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.808+0000 7fc17e889700 1 -- 172.21.15.6:0/1543698653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17804eb90 con 0x7fc1780ca850 2023-07-06T20:00:10.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.808+0000 7fc174ff9700 1 -- 172.21.15.6:0/1543698653 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc170014480 con 0x7fc1780ca850 2023-07-06T20:00:10.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.809+0000 7fc174ff9700 1 --2- 172.21.15.6:0/1543698653 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc16406ace0 0x7fc16406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:10.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.809+0000 7fc174ff9700 1 -- 172.21.15.6:0/1543698653 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fc170089c40 con 0x7fc1780ca850 2023-07-06T20:00:10.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.809+0000 7fc177fff700 1 --2- 172.21.15.6:0/1543698653 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc16406ace0 0x7fc16406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:10.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.809+0000 7fc177fff700 1 --2- 172.21.15.6:0/1543698653 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc16406ace0 0x7fc16406d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc1680011e0 tx=0x7fc168009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:10.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:10.813+0000 7fc174ff9700 1 -- 172.21.15.6:0/1543698653 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc170054ec0 con 0x7fc1780ca850 2023-07-06T20:00:11.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.027+0000 7fc17e889700 1 -- 172.21.15.6:0/1543698653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc1780b58e0 con 0x7fc1780ca850 2023-07-06T20:00:11.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.579+0000 7fc174ff9700 1 -- 172.21.15.6:0/1543698653 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc1700584e0 con 0x7fc1780ca850 2023-07-06T20:00:11.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.582+0000 7fc17e889700 1 -- 172.21.15.6:0/1543698653 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc16406ace0 msgr2=0x7fc16406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:11.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.582+0000 7fc17e889700 1 --2- 172.21.15.6:0/1543698653 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc16406ace0 0x7fc16406d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc1680011e0 tx=0x7fc168009040 comp rx=0 tx=0).stop 2023-07-06T20:00:11.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.582+0000 7fc17e889700 1 -- 172.21.15.6:0/1543698653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1780ca850 msgr2=0x7fc1780b4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:11.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.582+0000 7fc17e889700 1 --2- 172.21.15.6:0/1543698653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1780ca850 0x7fc1780b4fc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc17000efc0 tx=0x7fc17000c3a0 comp rx=0 tx=0).stop 2023-07-06T20:00:11.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.582+0000 7fc17e889700 1 -- 172.21.15.6:0/1543698653 shutdown_connections 2023-07-06T20:00:11.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.582+0000 7fc17e889700 1 --2- 172.21.15.6:0/1543698653 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc16406ace0 0x7fc16406d190 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:11.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.582+0000 7fc17e889700 1 --2- 172.21.15.6:0/1543698653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc1780ca850 0x7fc1780b4fc0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:11.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.582+0000 7fc17e889700 1 --2- 172.21.15.6:0/1543698653 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc178071900 0x7fc17806c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:11.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.582+0000 7fc17e889700 1 --2- 172.21.15.6:0/1543698653 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc178071cd0 0x7fc1780b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:11.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.582+0000 7fc17e889700 1 -- 172.21.15.6:0/1543698653 >> 172.21.15.6:0/1543698653 conn(0x7fc1780cf960 msgr2=0x7fc17815df80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:11.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.582+0000 7fc17e889700 1 -- 172.21.15.6:0/1543698653 shutdown_connections 2023-07-06T20:00:11.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.582+0000 7fc17e889700 1 -- 172.21.15.6:0/1543698653 wait complete. 2023-07-06T20:00:11.587 INFO:teuthology.orchestra.run.smithi006.stderr: removed all blocklist entries 2023-07-06T20:00:11.599 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-06T20:00:11.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.725+0000 7ff59eddc700 1 Processor -- start 2023-07-06T20:00:11.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.725+0000 7ff59eddc700 1 -- start start 2023-07-06T20:00:11.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.726+0000 7ff59eddc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff59815c4d0 0x7ff5980b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:11.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.726+0000 7ff59eddc700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5980cffe0 con 0x7ff5980b3e30 2023-07-06T20:00:11.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.726+0000 7ff59eddc700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5980d0470 con 0x7ff5981606e0 2023-07-06T20:00:11.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.726+0000 7ff59eddc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59815c8a0 con 0x7ff59815c4d0 2023-07-06T20:00:11.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.726+0000 7ff597fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7ff5980b3e30 0x7ff59815ffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33770/0 (socket says 172.21.15.6:33770) 2023-07-06T20:00:11.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.726+0000 7ff597fff700 1 -- 172.21.15.6:0/1973978622 learned_addr learned my addr 172.21.15.6:0/1973978622 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:11.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.726+0000 7ff59cb78700 1 --2- 172.21.15.6:0/1973978622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff59815c4d0 0x7ff5980b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:11.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.726+0000 7ff5977fe700 1 -- 172.21.15.6:0/1973978622 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274574926 0 0) 0x7ff5980cffe0 con 0x7ff5980b3e30 2023-07-06T20:00:11.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.726+0000 7ff5977fe700 1 -- 172.21.15.6:0/1973978622 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5880035b0 con 0x7ff5980b3e30 2023-07-06T20:00:11.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.726+0000 7ff5977fe700 1 -- 172.21.15.6:0/1973978622 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2481456304 0 0) 0x7ff5880035b0 con 0x7ff5980b3e30 2023-07-06T20:00:11.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.726+0000 7ff5977fe700 1 -- 172.21.15.6:0/1973978622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff59815c4d0 msgr2=0x7ff5980b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:11.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.726+0000 7ff5977fe700 1 --2- 172.21.15.6:0/1973978622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff59815c4d0 0x7ff5980b38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:11.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.726+0000 7ff5977fe700 1 -- 172.21.15.6:0/1973978622 >> v1:172.21.15.40:6789/0 conn(0x7ff5981606e0 legacy=0x7ff5980cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:11.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.726+0000 7ff5977fe700 1 -- 172.21.15.6:0/1973978622 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5980cf3d0 con 0x7ff5980b3e30 2023-07-06T20:00:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.726+0000 7ff5977fe700 1 -- 172.21.15.6:0/1973978622 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7ff584001670 con 0x7ff5980b3e30 2023-07-06T20:00:11.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.727+0000 7ff5977fe700 1 -- 172.21.15.6:0/1973978622 >> v1:172.21.15.6:6789/0 conn(0x7ff5980b3e30 legacy=0x7ff59815ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:11.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.727+0000 7ff5977fe700 1 --2- 172.21.15.6:0/1973978622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff588003aa0 0x7ff588003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:11.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.727+0000 7ff5977fe700 1 --2- 172.21.15.6:0/1973978622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff59815c4d0 0x7ff588004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:11.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.727+0000 7ff5977fe700 1 --2- 172.21.15.6:0/1973978622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff588004d90 0x7ff588005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:11.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.727+0000 7ff5977fe700 1 -- 172.21.15.6:0/1973978622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59815c8a0 con 0x7ff588004d90 2023-07-06T20:00:11.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.727+0000 7ff5977fe700 1 -- 172.21.15.6:0/1973978622 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff58800bac0 con 0x7ff588003aa0 2023-07-06T20:00:11.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.727+0000 7ff5977fe700 1 -- 172.21.15.6:0/1973978622 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58800bc30 con 0x7ff59815c4d0 2023-07-06T20:00:11.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.727+0000 7ff59d379700 1 --2- 172.21.15.6:0/1973978622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff588004d90 0x7ff588005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:11.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.727+0000 7ff597fff700 1 --2- 172.21.15.6:0/1973978622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff59815c4d0 0x7ff588004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:11.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.727+0000 7ff59cb78700 1 --2- 172.21.15.6:0/1973978622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff588003aa0 0x7ff588003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:11.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.727+0000 7ff59d379700 1 -- 172.21.15.6:0/1973978622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff59815c4d0 msgr2=0x7ff588004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:11.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.727+0000 7ff59d379700 1 --2- 172.21.15.6:0/1973978622 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff59815c4d0 0x7ff588004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:11.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.727+0000 7ff59d379700 1 -- 172.21.15.6:0/1973978622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff588003aa0 msgr2=0x7ff588003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:11.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.727+0000 7ff59d379700 1 --2- 172.21.15.6:0/1973978622 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff588003aa0 0x7ff588003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:11.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.727+0000 7ff59d379700 1 -- 172.21.15.6:0/1973978622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5880035b0 con 0x7ff588004d90 2023-07-06T20:00:11.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.727+0000 7ff59d379700 1 --2- 172.21.15.6:0/1973978622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff588004d90 0x7ff588005200 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff59000c260 tx=0x7ff588005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12de42c7306b7787 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:11.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.727+0000 7ff5977fe700 1 -- 172.21.15.6:0/1973978622 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590001e70 con 0x7ff588004d90 2023-07-06T20:00:11.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.727+0000 7ff5977fe700 1 -- 172.21.15.6:0/1973978622 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59000cdc0 con 0x7ff588004d90 2023-07-06T20:00:11.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.727+0000 7ff5977fe700 1 -- 172.21.15.6:0/1973978622 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590012660 con 0x7ff588004d90 2023-07-06T20:00:11.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.728+0000 7ff59eddc700 1 -- 172.21.15.6:0/1973978622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff588004d90 msgr2=0x7ff588005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:11.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.728+0000 7ff59eddc700 1 --2- 172.21.15.6:0/1973978622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff588004d90 0x7ff588005200 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff59000c260 tx=0x7ff588005880 comp rx=0 tx=0).stop 2023-07-06T20:00:11.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.728+0000 7ff59d379700 1 -- 172.21.15.6:0/1973978622 reap_dead start 2023-07-06T20:00:11.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.728+0000 7ff59eddc700 1 -- 172.21.15.6:0/1973978622 shutdown_connections 2023-07-06T20:00:11.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.728+0000 7ff59eddc700 1 -- 172.21.15.6:0/1973978622 >> 172.21.15.6:0/1973978622 conn(0x7ff5980d0a30 msgr2=0x7ff5980d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:11.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.728+0000 7ff59eddc700 1 -- 172.21.15.6:0/1973978622 shutdown_connections 2023-07-06T20:00:11.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.728+0000 7ff59eddc700 1 -- 172.21.15.6:0/1973978622 wait complete. 2023-07-06T20:00:11.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.729+0000 7ff59eddc700 1 Processor -- start 2023-07-06T20:00:11.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.729+0000 7ff59eddc700 1 -- start start 2023-07-06T20:00:11.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.730+0000 7ff59eddc700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff588004d90 0x7ff59815e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:11.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.730+0000 7ff59eddc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5980b1e00 0x7ff5981f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:11.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.730+0000 7ff59eddc700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5980cc760 0x7ff5980ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:11.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.730+0000 7ff59eddc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59815b5c0 con 0x7ff5980b1e00 2023-07-06T20:00:11.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.730+0000 7ff59eddc700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff598155a10 con 0x7ff588004d90 2023-07-06T20:00:11.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.730+0000 7ff59eddc700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5981f2a10 con 0x7ff5980cc760 2023-07-06T20:00:11.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.730+0000 7ff597fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5980b1e00 0x7ff5981f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:11.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.730+0000 7ff597fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5980b1e00 0x7ff5981f24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60808/0 (socket says 172.21.15.6:60808) 2023-07-06T20:00:11.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.730+0000 7ff597fff700 1 -- 172.21.15.6:0/189163623 learned_addr learned my addr 172.21.15.6:0/189163623 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:11.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.730+0000 7ff59cb78700 1 --2- 172.21.15.6:0/189163623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff588004d90 0x7ff59815e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:11.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.730+0000 7ff59d379700 1 --2- 172.21.15.6:0/189163623 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5980cc760 0x7ff5980ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:11.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.731+0000 7ff597fff700 1 -- 172.21.15.6:0/189163623 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5980cc760 msgr2=0x7ff5980ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:11.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.731+0000 7ff597fff700 1 --2- 172.21.15.6:0/189163623 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5980cc760 0x7ff5980ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:11.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.731+0000 7ff597fff700 1 -- 172.21.15.6:0/189163623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff588004d90 msgr2=0x7ff59815e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:11.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.731+0000 7ff597fff700 1 --2- 172.21.15.6:0/189163623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff588004d90 0x7ff59815e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:11.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.731+0000 7ff597fff700 1 -- 172.21.15.6:0/189163623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59815cba0 con 0x7ff5980b1e00 2023-07-06T20:00:11.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.731+0000 7ff597fff700 1 --2- 172.21.15.6:0/189163623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5980b1e00 0x7ff5981f24d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff5840011e0 tx=0x7ff584007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:11.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.731+0000 7ff5957fa700 1 -- 172.21.15.6:0/189163623 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff584012560 con 0x7ff5980b1e00 2023-07-06T20:00:11.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.731+0000 7ff5957fa700 1 -- 172.21.15.6:0/189163623 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5840126e0 con 0x7ff5980b1e00 2023-07-06T20:00:11.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.731+0000 7ff59eddc700 1 -- 172.21.15.6:0/189163623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff59815ce80 con 0x7ff5980b1e00 2023-07-06T20:00:11.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.731+0000 7ff5957fa700 1 -- 172.21.15.6:0/189163623 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff584012a90 con 0x7ff5980b1e00 2023-07-06T20:00:11.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.731+0000 7ff59eddc700 1 -- 172.21.15.6:0/189163623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff59815d440 con 0x7ff5980b1e00 2023-07-06T20:00:11.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.732+0000 7ff59eddc700 1 -- 172.21.15.6:0/189163623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5980cd120 con 0x7ff5980b1e00 2023-07-06T20:00:11.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.732+0000 7ff5957fa700 1 -- 172.21.15.6:0/189163623 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff584012bf0 con 0x7ff5980b1e00 2023-07-06T20:00:11.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.733+0000 7ff5957fa700 1 --2- 172.21.15.6:0/189163623 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7ff57c06ace0 0x7ff57c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:11.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.733+0000 7ff5957fa700 1 -- 172.21.15.6:0/189163623 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff5840891f0 con 0x7ff5980b1e00 2023-07-06T20:00:11.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.733+0000 7ff59cb78700 1 --2- 172.21.15.6:0/189163623 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7ff57c06ace0 0x7ff57c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:11.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.733+0000 7ff59cb78700 1 --2- 172.21.15.6:0/189163623 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7ff57c06ace0 0x7ff57c06d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff58c009c60 tx=0x7ff58c009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:11.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:11.737+0000 7ff5957fa700 1 -- 172.21.15.6:0/189163623 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff584057f30 con 0x7ff5980b1e00 2023-07-06T20:00:12.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.017+0000 7ff59eddc700 1 -- 172.21.15.6:0/189163623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff5980d12b0 con 0x7ff5980b1e00 2023-07-06T20:00:12.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.017+0000 7ff5957fa700 1 -- 172.21.15.6:0/189163623 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7ff584057ac0 con 0x7ff5980b1e00 2023-07-06T20:00:12.019 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:12.020 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-06T20:00:12.020 INFO:teuthology.orchestra.run.smithi006.stdout: "auth_dump": [ 2023-07-06T20:00:12.020 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.020 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.a", 2023-07-06T20:00:12.020 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDAHKdksmW6IRAA1wpPcBfPPnSPVrOGM8phDw==", 2023-07-06T20:00:12.020 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.021 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-06T20:00:12.021 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-06T20:00:12.021 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-06T20:00:12.021 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-06T20:00:12.021 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.021 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:12.021 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.022 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.b", 2023-07-06T20:00:12.022 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDAHKdkQl02MBAADc2npiCo5orpGdCLgMUPtQ==", 2023-07-06T20:00:12.022 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.022 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-06T20:00:12.023 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-06T20:00:12.024 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-06T20:00:12.024 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-06T20:00:12.031 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.032 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:12.032 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.032 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.c", 2023-07-06T20:00:12.032 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDAHKdkWXHyKRAA3zOwSTVGKmxpJOCHRHAMDA==", 2023-07-06T20:00:12.032 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.032 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-06T20:00:12.033 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-06T20:00:12.033 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-06T20:00:12.033 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-06T20:00:12.033 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.033 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:12.033 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.033 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mds.d", 2023-07-06T20:00:12.034 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDAHKdk/4EhOBAAHJKIMjc5xn/tQ92FJtZ1eA==", 2023-07-06T20:00:12.034 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.034 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-06T20:00:12.034 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-06T20:00:12.034 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-06T20:00:12.034 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-06T20:00:12.034 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.034 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:12.035 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.035 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.0", 2023-07-06T20:00:12.035 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDEHKdk1SWpGhAAKPRMRysEPLCV7tO8xaOI4Q==", 2023-07-06T20:00:12.035 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.035 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-06T20:00:12.035 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-06T20:00:12.035 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-06T20:00:12.036 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.036 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:12.036 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.036 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.1", 2023-07-06T20:00:12.036 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDHHKdkGDnHGhAAoDBqJ7rzR/dxt0jiKrTdtA==", 2023-07-06T20:00:12.036 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.037 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-06T20:00:12.037 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-06T20:00:12.037 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-06T20:00:12.037 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.037 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:12.038 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.038 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.2", 2023-07-06T20:00:12.038 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDKHKdkoqPWGhAARxj6y09apY8nGbqXccrmWQ==", 2023-07-06T20:00:12.038 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.038 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-06T20:00:12.038 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-06T20:00:12.039 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-06T20:00:12.039 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.039 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:12.039 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.039 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.3", 2023-07-06T20:00:12.040 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDNHKdkBlIaGxAA0sbdgcKC/BGyGLawfFRONA==", 2023-07-06T20:00:12.040 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.040 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-06T20:00:12.040 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-06T20:00:12.040 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-06T20:00:12.040 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:12.040 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.041 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.4", 2023-07-06T20:00:12.041 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDTHKdk2vXWIxAADeugUMANdLamwYvIJrkwpQ==", 2023-07-06T20:00:12.041 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.041 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-06T20:00:12.041 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-06T20:00:12.041 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-06T20:00:12.041 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.042 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:12.042 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.042 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.5", 2023-07-06T20:00:12.042 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDWHKdkP74dJBAANpSaeygPL+DdajPYDJ363g==", 2023-07-06T20:00:12.042 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.042 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-06T20:00:12.042 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-06T20:00:12.042 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-06T20:00:12.043 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.043 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:12.043 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.043 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.6", 2023-07-06T20:00:12.043 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDZHKdkIAjPJBAAxxOF8OFO2XJ7BC2UTmvIaw==", 2023-07-06T20:00:12.044 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.044 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-06T20:00:12.044 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-06T20:00:12.044 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-06T20:00:12.044 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.044 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:12.044 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.045 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "osd.7", 2023-07-06T20:00:12.045 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDcHKdk8FydJBAAQsy28Viyo3sJCz9IlFzJ3w==", 2023-07-06T20:00:12.045 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.045 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow profile osd", 2023-07-06T20:00:12.045 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile osd", 2023-07-06T20:00:12.045 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-06T20:00:12.045 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.045 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:12.046 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.046 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.0", 2023-07-06T20:00:12.046 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDBHKdk4UdrARAA1/eBBdDGSoFnlxWcwFTAdQ==", 2023-07-06T20:00:12.046 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.046 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-06T20:00:12.046 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-06T20:00:12.046 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-06T20:00:12.047 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-06T20:00:12.047 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.047 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:12.047 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.047 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.1", 2023-07-06T20:00:12.047 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDBHKdkHUetCBAAuCz5Qk36bN1LhUpNlmQ/Yg==", 2023-07-06T20:00:12.047 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.047 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-06T20:00:12.048 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-06T20:00:12.048 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-06T20:00:12.048 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-06T20:00:12.049 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.049 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:12.049 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.049 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.2", 2023-07-06T20:00:12.049 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDBHKdk7QgEBRAAGHbS9wFnBD0lUMZcuSDA4A==", 2023-07-06T20:00:12.050 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.050 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-06T20:00:12.050 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-06T20:00:12.050 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-06T20:00:12.050 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-06T20:00:12.050 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.050 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:12.050 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.051 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.3", 2023-07-06T20:00:12.051 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDBHKdk4VWLDhAAmbWoeVhV7XpS9uVlYOFOlw==", 2023-07-06T20:00:12.051 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.051 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow", 2023-07-06T20:00:12.051 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow r", 2023-07-06T20:00:12.051 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow rw", 2023-07-06T20:00:12.059 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow rwx" 2023-07-06T20:00:12.059 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.060 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:12.061 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.061 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.admin", 2023-07-06T20:00:12.061 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g==", 2023-07-06T20:00:12.061 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.062 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-06T20:00:12.062 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": "allow *", 2023-07-06T20:00:12.062 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow *", 2023-07-06T20:00:12.063 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-06T20:00:12.063 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.063 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:12.064 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.064 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-mds", 2023-07-06T20:00:12.064 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDiHKdkf5DjNxAAi1vah1pwcSgQ0SYlYjLPBg==", 2023-07-06T20:00:12.065 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.065 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-mds" 2023-07-06T20:00:12.066 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.066 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:12.066 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.067 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-mgr", 2023-07-06T20:00:12.067 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDiHKdkZ5rjNxAAK95SJ9djeg0K0XNQhugNlA==", 2023-07-06T20:00:12.067 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.068 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-06T20:00:12.068 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.068 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:12.069 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.069 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-osd", 2023-07-06T20:00:12.073 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDiHKdkrqPjNxAAXDQFFm54UTNAxITAYTe1bg==", 2023-07-06T20:00:12.073 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.074 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-osd" 2023-07-06T20:00:12.074 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:12.074 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.074 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rbd", 2023-07-06T20:00:12.074 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDiHKdksavjNxAAVh4quPdHTMUlEGPX4JArCA==", 2023-07-06T20:00:12.074 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.075 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-06T20:00:12.075 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.075 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:12.075 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.075 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-06T20:00:12.075 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDiHKdkzLPjNxAAab29lzJkfxTPgEbX5ibMUg==", 2023-07-06T20:00:12.075 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.076 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-06T20:00:12.076 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.076 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:12.076 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.076 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "client.bootstrap-rgw", 2023-07-06T20:00:12.076 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDiHKdkD7zjNxAAW8Ak15ZRtqnmk5NxapvYpA==", 2023-07-06T20:00:12.077 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.077 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-06T20:00:12.077 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.077 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:12.077 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.077 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.x", 2023-07-06T20:00:12.077 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDAHKdkMUMNHRAAdLYbojZBse//EvXWHTdnYw==", 2023-07-06T20:00:12.078 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.078 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-06T20:00:12.078 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-06T20:00:12.078 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-06T20:00:12.078 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.078 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:12.079 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:12.079 INFO:teuthology.orchestra.run.smithi006.stdout: "entity": "mgr.y", 2023-07-06T20:00:12.079 INFO:teuthology.orchestra.run.smithi006.stdout: "key": "AQDAHKdk+3U0GBAAPM2LAiDbSVzWfPSd8vGgKQ==", 2023-07-06T20:00:12.079 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": { 2023-07-06T20:00:12.079 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": "allow *", 2023-07-06T20:00:12.079 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": "allow profile mgr", 2023-07-06T20:00:12.079 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": "allow *" 2023-07-06T20:00:12.080 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.080 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:12.080 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-07-06T20:00:12.080 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-06T20:00:12.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.019+0000 7ff59eddc700 1 -- 172.21.15.6:0/189163623 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7ff57c06ace0 msgr2=0x7ff57c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:12.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.019+0000 7ff59eddc700 1 --2- 172.21.15.6:0/189163623 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7ff57c06ace0 0x7ff57c06d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff58c009c60 tx=0x7ff58c009210 comp rx=0 tx=0).stop 2023-07-06T20:00:12.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.019+0000 7ff59eddc700 1 -- 172.21.15.6:0/189163623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5980b1e00 msgr2=0x7ff5981f24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:12.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.019+0000 7ff59eddc700 1 --2- 172.21.15.6:0/189163623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5980b1e00 0x7ff5981f24d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff5840011e0 tx=0x7ff584007570 comp rx=0 tx=0).stop 2023-07-06T20:00:12.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.019+0000 7ff59eddc700 1 -- 172.21.15.6:0/189163623 shutdown_connections 2023-07-06T20:00:12.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.019+0000 7ff59eddc700 1 --2- 172.21.15.6:0/189163623 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7ff57c06ace0 0x7ff57c06d190 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:12.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.019+0000 7ff59eddc700 1 --2- 172.21.15.6:0/189163623 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7ff5980cc760 0x7ff5980ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:12.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.019+0000 7ff59eddc700 1 --2- 172.21.15.6:0/189163623 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff588004d90 0x7ff59815e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:12.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.019+0000 7ff59eddc700 1 --2- 172.21.15.6:0/189163623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5980b1e00 0x7ff5981f24d0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:12.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.019+0000 7ff59eddc700 1 -- 172.21.15.6:0/189163623 >> 172.21.15.6:0/189163623 conn(0x7ff5980d0a30 msgr2=0x7ff5980c9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:12.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.019+0000 7ff59eddc700 1 -- 172.21.15.6:0/189163623 shutdown_connections 2023-07-06T20:00:12.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.019+0000 7ff59eddc700 1 -- 172.21.15.6:0/189163623 wait complete. 2023-07-06T20:00:12.085 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-06T20:00:12.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.213+0000 7fefec6d4700 1 Processor -- start 2023-07-06T20:00:12.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.213+0000 7fefec6d4700 1 -- start start 2023-07-06T20:00:12.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.214+0000 7fefec6d4700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fefe40d15e0 0x7fefe406e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:12.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.214+0000 7fefec6d4700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe40cd300 con 0x7fefe40ce860 2023-07-06T20:00:12.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.214+0000 7fefec6d4700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe40b0290 con 0x7fefe415a520 2023-07-06T20:00:12.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.214+0000 7fefec6d4700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe40ccd80 con 0x7fefe40d15e0 2023-07-06T20:00:12.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.214+0000 7fefeac71700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fefe40ce860 0x7fefe40cecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33792/0 (socket says 172.21.15.6:33792) 2023-07-06T20:00:12.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.214+0000 7fefeac71700 1 -- 172.21.15.6:0/3033283775 learned_addr learned my addr 172.21.15.6:0/3033283775 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:12.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.214+0000 7fefe9c6f700 1 --2- 172.21.15.6:0/3033283775 >> v2:172.21.15.40:3300/0 conn(0x7fefe40d15e0 0x7fefe406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:12.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.214+0000 7fefe946e700 1 -- 172.21.15.6:0/3033283775 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638726135 0 0) 0x7fefe40cd300 con 0x7fefe40ce860 2023-07-06T20:00:12.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefe946e700 1 -- 172.21.15.6:0/3033283775 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefd00035b0 con 0x7fefe40ce860 2023-07-06T20:00:12.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefe946e700 1 -- 172.21.15.6:0/3033283775 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3030998497 0 0) 0x7fefd00035b0 con 0x7fefe40ce860 2023-07-06T20:00:12.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefe946e700 1 -- 172.21.15.6:0/3033283775 >> v2:172.21.15.40:3300/0 conn(0x7fefe40d15e0 msgr2=0x7fefe406e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefe946e700 1 --2- 172.21.15.6:0/3033283775 >> v2:172.21.15.40:3300/0 conn(0x7fefe40d15e0 0x7fefe406e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefe946e700 1 -- 172.21.15.6:0/3033283775 >> v1:172.21.15.40:6789/0 conn(0x7fefe415a520 legacy=0x7fefe406dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefe946e700 1 -- 172.21.15.6:0/3033283775 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe40cd020 con 0x7fefe40ce860 2023-07-06T20:00:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefe946e700 1 -- 172.21.15.6:0/3033283775 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7fefdc0019f0 con 0x7fefe40ce860 2023-07-06T20:00:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefe946e700 1 -- 172.21.15.6:0/3033283775 >> v1:172.21.15.6:6789/0 conn(0x7fefe40ce860 legacy=0x7fefe40cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefe946e700 1 --2- 172.21.15.6:0/3033283775 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefd0003a00 0x7fefd0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:12.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefe946e700 1 --2- 172.21.15.6:0/3033283775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd0004850 0x7fefd0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefe946e700 1 --2- 172.21.15.6:0/3033283775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefd0005200 0x7fefd000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefe946e700 1 -- 172.21.15.6:0/3033283775 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40ccd80 con 0x7fefd0004850 2023-07-06T20:00:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefe946e700 1 -- 172.21.15.6:0/3033283775 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd000c080 con 0x7fefd0005200 2023-07-06T20:00:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefe946e700 1 -- 172.21.15.6:0/3033283775 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd000c240 con 0x7fefd0003a00 2023-07-06T20:00:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefe9c6f700 1 --2- 172.21.15.6:0/3033283775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd0004850 0x7fefd0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:12.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefea470700 1 --2- 172.21.15.6:0/3033283775 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefd0003a00 0x7fefd0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:12.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefeac71700 1 --2- 172.21.15.6:0/3033283775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefd0005200 0x7fefd000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:12.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefe9c6f700 1 -- 172.21.15.6:0/3033283775 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefd0003a00 msgr2=0x7fefd0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:12.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefe9c6f700 1 --2- 172.21.15.6:0/3033283775 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefd0003a00 0x7fefd0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:12.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefe9c6f700 1 -- 172.21.15.6:0/3033283775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefd0005200 msgr2=0x7fefd000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:12.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefe9c6f700 1 --2- 172.21.15.6:0/3033283775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefd0005200 0x7fefd000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:12.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefe9c6f700 1 -- 172.21.15.6:0/3033283775 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd00035b0 con 0x7fefd0004850 2023-07-06T20:00:12.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefeac71700 1 --2- 172.21.15.6:0/3033283775 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefd0005200 0x7fefd000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:12.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefeac71700 1 -- 172.21.15.6:0/3033283775 reap_dead start 2023-07-06T20:00:12.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.215+0000 7fefe9c6f700 1 --2- 172.21.15.6:0/3033283775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd0004850 0x7fefd0004cc0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fefe0009b60 tx=0x7fefd0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e379237abe55a06 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:12.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.216+0000 7fefe946e700 1 -- 172.21.15.6:0/3033283775 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe000e6c0 con 0x7fefd0004850 2023-07-06T20:00:12.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.216+0000 7fefe946e700 1 -- 172.21.15.6:0/3033283775 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefe000e820 con 0x7fefd0004850 2023-07-06T20:00:12.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.216+0000 7fefe946e700 1 -- 172.21.15.6:0/3033283775 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe000eb90 con 0x7fefd0004850 2023-07-06T20:00:12.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.216+0000 7fefec6d4700 1 -- 172.21.15.6:0/3033283775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd0004850 msgr2=0x7fefd0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:12.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.216+0000 7fefec6d4700 1 --2- 172.21.15.6:0/3033283775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd0004850 0x7fefd0004cc0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fefe0009b60 tx=0x7fefd0005880 comp rx=0 tx=0).stop 2023-07-06T20:00:12.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.216+0000 7fefec6d4700 1 -- 172.21.15.6:0/3033283775 shutdown_connections 2023-07-06T20:00:12.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.216+0000 7fefec6d4700 1 --2- 172.21.15.6:0/3033283775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd0004850 0x7fefd0004cc0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:12.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.216+0000 7fefec6d4700 1 -- 172.21.15.6:0/3033283775 >> 172.21.15.6:0/3033283775 conn(0x7fefe40ce120 msgr2=0x7fefe40d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:12.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.216+0000 7fefec6d4700 1 -- 172.21.15.6:0/3033283775 shutdown_connections 2023-07-06T20:00:12.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.216+0000 7fefec6d4700 1 -- 172.21.15.6:0/3033283775 wait complete. 2023-07-06T20:00:12.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.217+0000 7fefec6d4700 1 Processor -- start 2023-07-06T20:00:12.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.217+0000 7fefec6d4700 1 -- start start 2023-07-06T20:00:12.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.218+0000 7fefec6d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd0004850 0x7fefe40c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:12.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.218+0000 7fefec6d4700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefe40b60d0 0x7fefe415cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:12.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.218+0000 7fefec6d4700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefe415d020 0x7fefe41efd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:12.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.218+0000 7fefec6d4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40c92d0 con 0x7fefd0004850 2023-07-06T20:00:12.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.218+0000 7fefec6d4700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe415d490 con 0x7fefe415d020 2023-07-06T20:00:12.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.218+0000 7fefec6d4700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe41f0c50 con 0x7fefe40b60d0 2023-07-06T20:00:12.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.218+0000 7fefea470700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd0004850 0x7fefe40c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:12.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.218+0000 7fefea470700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd0004850 0x7fefe40c96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60824/0 (socket says 172.21.15.6:60824) 2023-07-06T20:00:12.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.218+0000 7fefea470700 1 -- 172.21.15.6:0/1683115747 learned_addr learned my addr 172.21.15.6:0/1683115747 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:12.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.218+0000 7fefeac71700 1 --2- 172.21.15.6:0/1683115747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefe415d020 0x7fefe41efd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:12.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.218+0000 7fefe9c6f700 1 --2- 172.21.15.6:0/1683115747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefe40b60d0 0x7fefe415cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:12.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.219+0000 7fefea470700 1 -- 172.21.15.6:0/1683115747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefe40b60d0 msgr2=0x7fefe415cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:12.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.219+0000 7fefea470700 1 --2- 172.21.15.6:0/1683115747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefe40b60d0 0x7fefe415cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:12.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.219+0000 7fefea470700 1 -- 172.21.15.6:0/1683115747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefe415d020 msgr2=0x7fefe41efd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:12.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.219+0000 7fefea470700 1 --2- 172.21.15.6:0/1683115747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefe415d020 0x7fefe41efd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:12.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.219+0000 7fefea470700 1 -- 172.21.15.6:0/1683115747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe41f0970 con 0x7fefd0004850 2023-07-06T20:00:12.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.219+0000 7fefea470700 1 --2- 172.21.15.6:0/1683115747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd0004850 0x7fefe40c96f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fefd400f850 tx=0x7fefd400fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:12.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.219+0000 7fefdaffd700 1 -- 172.21.15.6:0/1683115747 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd40050d0 con 0x7fefd0004850 2023-07-06T20:00:12.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.219+0000 7fefdaffd700 1 -- 172.21.15.6:0/1683115747 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd4005230 con 0x7fefd0004850 2023-07-06T20:00:12.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.219+0000 7fefec6d4700 1 -- 172.21.15.6:0/1683115747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe40c8c10 con 0x7fefd0004850 2023-07-06T20:00:12.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.219+0000 7fefdaffd700 1 -- 172.21.15.6:0/1683115747 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4003680 con 0x7fefd0004850 2023-07-06T20:00:12.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.219+0000 7fefec6d4700 1 -- 172.21.15.6:0/1683115747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe40b6540 con 0x7fefd0004850 2023-07-06T20:00:12.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.220+0000 7fefec6d4700 1 -- 172.21.15.6:0/1683115747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe40d11d0 con 0x7fefd0004850 2023-07-06T20:00:12.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.220+0000 7fefdaffd700 1 -- 172.21.15.6:0/1683115747 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fefd40037e0 con 0x7fefd0004850 2023-07-06T20:00:12.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.221+0000 7fefdaffd700 1 --2- 172.21.15.6:0/1683115747 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fefc806ad10 0x7fefc806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:12.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.221+0000 7fefdaffd700 1 -- 172.21.15.6:0/1683115747 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fefd4089050 con 0x7fefd0004850 2023-07-06T20:00:12.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.221+0000 7fefe9c6f700 1 --2- 172.21.15.6:0/1683115747 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fefc806ad10 0x7fefc806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:12.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.221+0000 7fefe9c6f700 1 --2- 172.21.15.6:0/1683115747 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fefc806ad10 0x7fefc806d1c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fefe00090b0 tx=0x7fefe001e040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:12.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.225+0000 7fefdaffd700 1 -- 172.21.15.6:0/1683115747 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fefd4054310 con 0x7fefd0004850 2023-07-06T20:00:12.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.507+0000 7fefec6d4700 1 -- 172.21.15.6:0/1683115747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fefe404eb90 con 0x7fefd0004850 2023-07-06T20:00:12.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.511+0000 7fefdaffd700 1 -- 172.21.15.6:0/1683115747 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fefd4057930 con 0x7fefd0004850 2023-07-06T20:00:12.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.513+0000 7fefec6d4700 1 -- 172.21.15.6:0/1683115747 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fefc806ad10 msgr2=0x7fefc806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:12.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.513+0000 7fefec6d4700 1 --2- 172.21.15.6:0/1683115747 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fefc806ad10 0x7fefc806d1c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fefe00090b0 tx=0x7fefe001e040 comp rx=0 tx=0).stop 2023-07-06T20:00:12.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.513+0000 7fefec6d4700 1 -- 172.21.15.6:0/1683115747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd0004850 msgr2=0x7fefe40c96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:12.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.513+0000 7fefec6d4700 1 --2- 172.21.15.6:0/1683115747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd0004850 0x7fefe40c96f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fefd400f850 tx=0x7fefd400fc10 comp rx=0 tx=0).stop 2023-07-06T20:00:12.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.513+0000 7fefec6d4700 1 -- 172.21.15.6:0/1683115747 shutdown_connections 2023-07-06T20:00:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.513+0000 7fefec6d4700 1 --2- 172.21.15.6:0/1683115747 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fefc806ad10 0x7fefc806d1c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.513+0000 7fefec6d4700 1 --2- 172.21.15.6:0/1683115747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefd0004850 0x7fefe40c96f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.513+0000 7fefec6d4700 1 --2- 172.21.15.6:0/1683115747 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fefe415d020 0x7fefe41efd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.513+0000 7fefec6d4700 1 --2- 172.21.15.6:0/1683115747 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fefe40b60d0 0x7fefe415cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.513+0000 7fefec6d4700 1 -- 172.21.15.6:0/1683115747 >> 172.21.15.6:0/1683115747 conn(0x7fefe40ce120 msgr2=0x7fefe41538c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.513+0000 7fefec6d4700 1 -- 172.21.15.6:0/1683115747 shutdown_connections 2023-07-06T20:00:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.513+0000 7fefec6d4700 1 -- 172.21.15.6:0/1683115747 wait complete. 2023-07-06T20:00:12.530 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-06T20:00:12.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.659+0000 7f0cf49a0700 1 Processor -- start 2023-07-06T20:00:12.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.659+0000 7f0cf49a0700 1 -- start start 2023-07-06T20:00:12.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.660+0000 7f0cf49a0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0cf0160e00 0x7f0cf006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:12.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.660+0000 7f0cf49a0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cf015d910 0x7f0cf006c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:12.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.660+0000 7f0cf49a0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf015d480 con 0x7f0cf00b1f10 2023-07-06T20:00:12.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.660+0000 7f0cf49a0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf015cc60 con 0x7f0cf0160e00 2023-07-06T20:00:12.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.660+0000 7f0cf49a0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf015ce70 con 0x7f0cf015d910 2023-07-06T20:00:12.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.660+0000 7f0cedd9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0cf0160e00 0x7f0cf006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:12.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.660+0000 7f0cee59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f0cf00b1f10 0x7f0cf00cd2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33810/0 (socket says 172.21.15.6:33810) 2023-07-06T20:00:12.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.660+0000 7f0cee59c700 1 -- 172.21.15.6:0/1120550983 learned_addr learned my addr 172.21.15.6:0/1120550983 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:12.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.660+0000 7f0ceed9d700 1 --2- 172.21.15.6:0/1120550983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cf015d910 0x7f0cf006c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:12.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.660+0000 7f0cedd9b700 1 -- 172.21.15.6:0/1120550983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cf015d910 msgr2=0x7f0cf006c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:12.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.660+0000 7f0cedd9b700 1 --2- 172.21.15.6:0/1120550983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cf015d910 0x7f0cf006c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:12.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.660+0000 7f0cedd9b700 1 -- 172.21.15.6:0/1120550983 >> v1:172.21.15.6:6789/0 conn(0x7f0cf00b1f10 legacy=0x7f0cf00cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:12.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.660+0000 7f0cedd9b700 1 -- 172.21.15.6:0/1120550983 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf00cddd0 con 0x7f0cf0160e00 2023-07-06T20:00:12.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.660+0000 7f0ced59a700 1 -- 172.21.15.6:0/1120550983 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974435956 0 0) 0x7f0cf015d480 con 0x7f0cf00b1f10 2023-07-06T20:00:12.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.660+0000 7f0cedd9b700 1 --2- 172.21.15.6:0/1120550983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf0160e00 0x7f0cf006bdb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4009840 tx=0x7f0ce4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1507ed7d230aa0b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:12.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.660+0000 7f0ced59a700 1 -- 172.21.15.6:0/1120550983 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4011830 con 0x7f0cf0160e00 2023-07-06T20:00:12.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.661+0000 7f0ced59a700 1 -- 172.21.15.6:0/1120550983 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce4011990 con 0x7f0cf0160e00 2023-07-06T20:00:12.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.661+0000 7f0ced59a700 1 -- 172.21.15.6:0/1120550983 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4011d20 con 0x7f0cf0160e00 2023-07-06T20:00:12.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.661+0000 7f0cf49a0700 1 -- 172.21.15.6:0/1120550983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf0160e00 msgr2=0x7f0cf006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:12.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.661+0000 7f0cf49a0700 1 --2- 172.21.15.6:0/1120550983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf0160e00 0x7f0cf006bdb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4009840 tx=0x7f0ce4009b50 comp rx=0 tx=0).stop 2023-07-06T20:00:12.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.661+0000 7f0cf49a0700 1 -- 172.21.15.6:0/1120550983 shutdown_connections 2023-07-06T20:00:12.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.661+0000 7f0cf49a0700 1 --2- 172.21.15.6:0/1120550983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cf015d910 0x7f0cf006c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:12.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.661+0000 7f0cf49a0700 1 --2- 172.21.15.6:0/1120550983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf0160e00 0x7f0cf006bdb0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:12.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.661+0000 7f0cf49a0700 1 -- 172.21.15.6:0/1120550983 >> 172.21.15.6:0/1120550983 conn(0x7f0cf00d2c70 msgr2=0x7f0cf00d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:12.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.661+0000 7f0cf49a0700 1 -- 172.21.15.6:0/1120550983 shutdown_connections 2023-07-06T20:00:12.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.661+0000 7f0cf49a0700 1 -- 172.21.15.6:0/1120550983 wait complete. 2023-07-06T20:00:12.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.663+0000 7f0cf49a0700 1 Processor -- start 2023-07-06T20:00:12.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.663+0000 7f0cf49a0700 1 -- start start 2023-07-06T20:00:12.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.663+0000 7f0cf49a0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cf00b1f10 0x7f0cf014b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:12.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.663+0000 7f0cf49a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf015d910 0x7f0cf014e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:12.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.663+0000 7f0cf49a0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cf0160e00 0x7f0cf015dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:12.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.663+0000 7f0cf49a0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf00b8430 con 0x7f0cf015d910 2023-07-06T20:00:12.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.663+0000 7f0cf49a0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf014f220 con 0x7f0cf0160e00 2023-07-06T20:00:12.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.663+0000 7f0cf49a0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf014be00 con 0x7f0cf00b1f10 2023-07-06T20:00:12.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.663+0000 7f0cedd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf015d910 0x7f0cf014e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:12.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.663+0000 7f0cedd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf015d910 0x7f0cf014e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60842/0 (socket says 172.21.15.6:60842) 2023-07-06T20:00:12.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.663+0000 7f0cedd9b700 1 -- 172.21.15.6:0/2077049826 learned_addr learned my addr 172.21.15.6:0/2077049826 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:12.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.664+0000 7f0cee59c700 1 --2- 172.21.15.6:0/2077049826 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cf00b1f10 0x7f0cf014b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.664+0000 7f0cedd9b700 1 -- 172.21.15.6:0/2077049826 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cf00b1f10 msgr2=0x7f0cf014b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.664+0000 7f0cedd9b700 1 --2- 172.21.15.6:0/2077049826 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cf00b1f10 0x7f0cf014b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.664+0000 7f0cedd9b700 1 -- 172.21.15.6:0/2077049826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cf0160e00 msgr2=0x7f0cf015dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.664+0000 7f0cedd9b700 1 --2- 172.21.15.6:0/2077049826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cf0160e00 0x7f0cf015dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.664+0000 7f0cedd9b700 1 -- 172.21.15.6:0/2077049826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce40094a0 con 0x7f0cf015d910 2023-07-06T20:00:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.664+0000 7f0cedd9b700 1 --2- 172.21.15.6:0/2077049826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf015d910 0x7f0cf014e6a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4009fd0 tx=0x7f0ce4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.664+0000 7f0cdeffd700 1 -- 172.21.15.6:0/2077049826 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce40036a0 con 0x7f0cf015d910 2023-07-06T20:00:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.664+0000 7f0cdeffd700 1 -- 172.21.15.6:0/2077049826 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce401e070 con 0x7f0cf015d910 2023-07-06T20:00:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.664+0000 7f0cdeffd700 1 -- 172.21.15.6:0/2077049826 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4003a20 con 0x7f0cf015d910 2023-07-06T20:00:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.664+0000 7f0cf49a0700 1 -- 172.21.15.6:0/2077049826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf00b7820 con 0x7f0cf015d910 2023-07-06T20:00:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.664+0000 7f0cf49a0700 1 -- 172.21.15.6:0/2077049826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf00b7de0 con 0x7f0cf015d910 2023-07-06T20:00:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.665+0000 7f0cf49a0700 1 -- 172.21.15.6:0/2077049826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf0072f20 con 0x7f0cf015d910 2023-07-06T20:00:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.666+0000 7f0cdeffd700 1 -- 172.21.15.6:0/2077049826 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0ce4003b80 con 0x7f0cf015d910 2023-07-06T20:00:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.666+0000 7f0cdeffd700 1 --2- 172.21.15.6:0/2077049826 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0cd006ad10 0x7f0cd006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.666+0000 7f0cdeffd700 1 -- 172.21.15.6:0/2077049826 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f0ce408a1e0 con 0x7f0cf015d910 2023-07-06T20:00:12.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.666+0000 7f0cee59c700 1 --2- 172.21.15.6:0/2077049826 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0cd006ad10 0x7f0cd006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:12.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.667+0000 7f0cee59c700 1 --2- 172.21.15.6:0/2077049826 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0cd006ad10 0x7f0cd006d1c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0000f60 tx=0x7f0ce0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:12.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.671+0000 7f0cdeffd700 1 -- 172.21.15.6:0/2077049826 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0ce4055530 con 0x7f0cf015d910 2023-07-06T20:00:12.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.960+0000 7f0cf49a0700 1 -- 172.21.15.6:0/2077049826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f0cf004eb90 con 0x7f0cf015d910 2023-07-06T20:00:12.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.964+0000 7f0cdeffd700 1 -- 172.21.15.6:0/2077049826 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0ce4058b50 con 0x7f0cf015d910 2023-07-06T20:00:12.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.966+0000 7f0cf49a0700 1 -- 172.21.15.6:0/2077049826 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0cd006ad10 msgr2=0x7f0cd006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:12.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.966+0000 7f0cf49a0700 1 --2- 172.21.15.6:0/2077049826 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0cd006ad10 0x7f0cd006d1c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0000f60 tx=0x7f0ce0009040 comp rx=0 tx=0).stop 2023-07-06T20:00:12.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.966+0000 7f0cf49a0700 1 -- 172.21.15.6:0/2077049826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf015d910 msgr2=0x7f0cf014e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:12.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.966+0000 7f0cf49a0700 1 --2- 172.21.15.6:0/2077049826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf015d910 0x7f0cf014e6a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4009fd0 tx=0x7f0ce4004750 comp rx=0 tx=0).stop 2023-07-06T20:00:12.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.966+0000 7f0cf49a0700 1 -- 172.21.15.6:0/2077049826 shutdown_connections 2023-07-06T20:00:12.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.966+0000 7f0cf49a0700 1 --2- 172.21.15.6:0/2077049826 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0cd006ad10 0x7f0cd006d1c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:12.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.966+0000 7f0cf49a0700 1 --2- 172.21.15.6:0/2077049826 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0cf0160e00 0x7f0cf015dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.966+0000 7f0cf49a0700 1 --2- 172.21.15.6:0/2077049826 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0cf00b1f10 0x7f0cf014b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.966+0000 7f0cf49a0700 1 --2- 172.21.15.6:0/2077049826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cf015d910 0x7f0cf014e6a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.966+0000 7f0cf49a0700 1 -- 172.21.15.6:0/2077049826 >> 172.21.15.6:0/2077049826 conn(0x7f0cf00d2c70 msgr2=0x7f0cf006ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.966+0000 7f0cf49a0700 1 -- 172.21.15.6:0/2077049826 shutdown_connections 2023-07-06T20:00:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:12.966+0000 7f0cf49a0700 1 -- 172.21.15.6:0/2077049826 wait complete. 2023-07-06T20:00:12.981 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-06T20:00:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.104+0000 7fa101df0700 1 Processor -- start 2023-07-06T20:00:13.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.104+0000 7fa101df0700 1 -- start start 2023-07-06T20:00:13.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.105+0000 7fa101df0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa0fc1592b0 0x7fa0fc071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:13.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.105+0000 7fa101df0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa0fc15cd40 0x7fa0fc071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:13.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.105+0000 7fa101df0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0fc0cc160 con 0x7fa0fc0cd950 2023-07-06T20:00:13.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.105+0000 7fa101df0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0fc159680 con 0x7fa0fc15cd40 2023-07-06T20:00:13.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.105+0000 7fa101df0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0fc15d2b0 con 0x7fa0fc1592b0 2023-07-06T20:00:13.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.105+0000 7fa0faffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa0fc15cd40 0x7fa0fc071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:13.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.105+0000 7fa0faffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fa0fc15cd40 0x7fa0fc071bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60850/0 (socket says 172.21.15.6:60850) 2023-07-06T20:00:13.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.105+0000 7fa0faffd700 1 -- 172.21.15.6:0/757153837 learned_addr learned my addr 172.21.15.6:0/757153837 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:13.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.105+0000 7fa0fb7fe700 1 --2- 172.21.15.6:0/757153837 >> v2:172.21.15.40:3300/0 conn(0x7fa0fc1592b0 0x7fa0fc071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:13.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.106+0000 7fa0faffd700 1 -- 172.21.15.6:0/757153837 >> v2:172.21.15.40:3300/0 conn(0x7fa0fc1592b0 msgr2=0x7fa0fc071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.106+0000 7fa0faffd700 1 --2- 172.21.15.6:0/757153837 >> v2:172.21.15.40:3300/0 conn(0x7fa0fc1592b0 0x7fa0fc071690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.106+0000 7fa0faffd700 1 -- 172.21.15.6:0/757153837 >> v1:172.21.15.40:6789/0 conn(0x7fa0fc0cd950 legacy=0x7fa0fc06d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.106+0000 7fa0faffd700 1 -- 172.21.15.6:0/757153837 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0fc15d590 con 0x7fa0fc15cd40 2023-07-06T20:00:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.106+0000 7fa0faffd700 1 --2- 172.21.15.6:0/757153837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0fc15cd40 0x7fa0fc071bd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc06a800 tx=0x7fa0f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6daa43a1d3d52b90 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.106+0000 7fa0fa7fc700 1 -- 172.21.15.6:0/757153837 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f000b870 con 0x7fa0fc15cd40 2023-07-06T20:00:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.106+0000 7fa0fa7fc700 1 -- 172.21.15.6:0/757153837 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f000b9d0 con 0x7fa0fc15cd40 2023-07-06T20:00:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.106+0000 7fa0fa7fc700 1 -- 172.21.15.6:0/757153837 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f000bd60 con 0x7fa0fc15cd40 2023-07-06T20:00:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.106+0000 7fa101df0700 1 -- 172.21.15.6:0/757153837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0fc15cd40 msgr2=0x7fa0fc071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.106+0000 7fa101df0700 1 --2- 172.21.15.6:0/757153837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0fc15cd40 0x7fa0fc071bd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc06a800 tx=0x7fa0f0009bd0 comp rx=0 tx=0).stop 2023-07-06T20:00:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.106+0000 7fa101df0700 1 -- 172.21.15.6:0/757153837 shutdown_connections 2023-07-06T20:00:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.106+0000 7fa101df0700 1 --2- 172.21.15.6:0/757153837 >> v2:172.21.15.40:3300/0 conn(0x7fa0fc1592b0 0x7fa0fc071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.106+0000 7fa101df0700 1 --2- 172.21.15.6:0/757153837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0fc15cd40 0x7fa0fc071bd0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.106+0000 7fa101df0700 1 -- 172.21.15.6:0/757153837 >> 172.21.15.6:0/757153837 conn(0x7fa0fc0cf960 msgr2=0x7fa0fc0cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.107+0000 7fa101df0700 1 -- 172.21.15.6:0/757153837 shutdown_connections 2023-07-06T20:00:13.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.107+0000 7fa101df0700 1 -- 172.21.15.6:0/757153837 wait complete. 2023-07-06T20:00:13.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.108+0000 7fa101df0700 1 Processor -- start 2023-07-06T20:00:13.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.108+0000 7fa101df0700 1 -- start start 2023-07-06T20:00:13.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.109+0000 7fa101df0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0fc0cd950 0x7fa0fc0b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:13.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.109+0000 7fa101df0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0fc1592b0 0x7fa0fc14a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:13.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.109+0000 7fa101df0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0fc15cd40 0x7fa0fc164190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:13.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.109+0000 7fa101df0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc166f20 con 0x7fa0fc0cd950 2023-07-06T20:00:13.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.109+0000 7fa101df0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc0b4640 con 0x7fa0fc1592b0 2023-07-06T20:00:13.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.109+0000 7fa101df0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc1646d0 con 0x7fa0fc15cd40 2023-07-06T20:00:13.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.109+0000 7fa0fb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0fc0cd950 0x7fa0fc0b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:13.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.109+0000 7fa0fb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0fc0cd950 0x7fa0fc0b33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60854/0 (socket says 172.21.15.6:60854) 2023-07-06T20:00:13.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.109+0000 7fa0fb7fe700 1 -- 172.21.15.6:0/3534612331 learned_addr learned my addr 172.21.15.6:0/3534612331 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:13.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.109+0000 7fa0faffd700 1 --2- 172.21.15.6:0/3534612331 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0fc1592b0 0x7fa0fc14a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:13.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.109+0000 7fa0fbfff700 1 --2- 172.21.15.6:0/3534612331 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0fc15cd40 0x7fa0fc164190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:13.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.109+0000 7fa0fb7fe700 1 -- 172.21.15.6:0/3534612331 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0fc15cd40 msgr2=0x7fa0fc164190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:13.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.109+0000 7fa0fb7fe700 1 --2- 172.21.15.6:0/3534612331 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0fc15cd40 0x7fa0fc164190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:13.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.109+0000 7fa0fb7fe700 1 -- 172.21.15.6:0/3534612331 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0fc1592b0 msgr2=0x7fa0fc14a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:13.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.109+0000 7fa0fb7fe700 1 --2- 172.21.15.6:0/3534612331 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0fc1592b0 0x7fa0fc14a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:13.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.109+0000 7fa0fb7fe700 1 -- 172.21.15.6:0/3534612331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f0009550 con 0x7fa0fc0cd950 2023-07-06T20:00:13.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.109+0000 7fa0fb7fe700 1 --2- 172.21.15.6:0/3534612331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0fc0cd950 0x7fa0fc0b33c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec00d800 tx=0x7fa0ec00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:13.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.109+0000 7fa0e3fff700 1 -- 172.21.15.6:0/3534612331 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec0125f0 con 0x7fa0fc0cd950 2023-07-06T20:00:13.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.109+0000 7fa0e3fff700 1 -- 172.21.15.6:0/3534612331 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ec012750 con 0x7fa0fc0cd950 2023-07-06T20:00:13.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.109+0000 7fa101df0700 1 -- 172.21.15.6:0/3534612331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0fc0b3a30 con 0x7fa0fc0cd950 2023-07-06T20:00:13.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.109+0000 7fa0e3fff700 1 -- 172.21.15.6:0/3534612331 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec012b00 con 0x7fa0fc0cd950 2023-07-06T20:00:13.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.110+0000 7fa101df0700 1 -- 172.21.15.6:0/3534612331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0fc0b3ff0 con 0x7fa0fc0cd950 2023-07-06T20:00:13.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.110+0000 7fa101df0700 1 -- 172.21.15.6:0/3534612331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0fc04eb90 con 0x7fa0fc0cd950 2023-07-06T20:00:13.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.111+0000 7fa0e3fff700 1 -- 172.21.15.6:0/3534612331 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa0ec012c60 con 0x7fa0fc0cd950 2023-07-06T20:00:13.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.111+0000 7fa0e3fff700 1 --2- 172.21.15.6:0/3534612331 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa0e806ace0 0x7fa0e806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:13.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.111+0000 7fa0e3fff700 1 -- 172.21.15.6:0/3534612331 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fa0ec089270 con 0x7fa0fc0cd950 2023-07-06T20:00:13.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.111+0000 7fa0faffd700 1 --2- 172.21.15.6:0/3534612331 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa0e806ace0 0x7fa0e806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:13.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.112+0000 7fa0faffd700 1 --2- 172.21.15.6:0/3534612331 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa0e806ace0 0x7fa0e806d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc06a800 tx=0x7fa0f001d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:13.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.116+0000 7fa0e3fff700 1 -- 172.21.15.6:0/3534612331 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa0ec054670 con 0x7fa0fc0cd950 2023-07-06T20:00:13.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.400+0000 7fa101df0700 1 -- 172.21.15.6:0/3534612331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fa0fc166950 con 0x7fa0fc0cd950 2023-07-06T20:00:13.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.404+0000 7fa0e3fff700 1 -- 172.21.15.6:0/3534612331 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa0ec057c90 con 0x7fa0fc0cd950 2023-07-06T20:00:13.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.406+0000 7fa101df0700 1 -- 172.21.15.6:0/3534612331 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa0e806ace0 msgr2=0x7fa0e806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:13.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.406+0000 7fa101df0700 1 --2- 172.21.15.6:0/3534612331 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa0e806ace0 0x7fa0e806d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc06a800 tx=0x7fa0f001d040 comp rx=0 tx=0).stop 2023-07-06T20:00:13.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.406+0000 7fa101df0700 1 -- 172.21.15.6:0/3534612331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0fc0cd950 msgr2=0x7fa0fc0b33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:13.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.406+0000 7fa101df0700 1 --2- 172.21.15.6:0/3534612331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0fc0cd950 0x7fa0fc0b33c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec00d800 tx=0x7fa0ec00db10 comp rx=0 tx=0).stop 2023-07-06T20:00:13.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.406+0000 7fa101df0700 1 -- 172.21.15.6:0/3534612331 shutdown_connections 2023-07-06T20:00:13.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.406+0000 7fa101df0700 1 --2- 172.21.15.6:0/3534612331 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa0e806ace0 0x7fa0e806d190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:13.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.406+0000 7fa101df0700 1 --2- 172.21.15.6:0/3534612331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0fc0cd950 0x7fa0fc0b33c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:13.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.406+0000 7fa101df0700 1 --2- 172.21.15.6:0/3534612331 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa0fc15cd40 0x7fa0fc164190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:13.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.406+0000 7fa101df0700 1 --2- 172.21.15.6:0/3534612331 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa0fc1592b0 0x7fa0fc14a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:13.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.406+0000 7fa101df0700 1 -- 172.21.15.6:0/3534612331 >> 172.21.15.6:0/3534612331 conn(0x7fa0fc0cf960 msgr2=0x7fa0fc14f360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:13.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.406+0000 7fa101df0700 1 -- 172.21.15.6:0/3534612331 shutdown_connections 2023-07-06T20:00:13.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.406+0000 7fa101df0700 1 -- 172.21.15.6:0/3534612331 wait complete. 2023-07-06T20:00:13.420 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-06T20:00:13.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.546+0000 7fe4ee578700 1 Processor -- start 2023-07-06T20:00:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.547+0000 7fe4ee578700 1 -- start start 2023-07-06T20:00:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.547+0000 7fe4ee578700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe4e8159140 0x7fe4e815ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.547+0000 7fe4ee578700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe4e80c9c70 0x7fe4e80ce590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.547+0000 7fe4ee578700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e80ce100 con 0x7fe4e80cead0 2023-07-06T20:00:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.547+0000 7fe4ee578700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e80cddd0 con 0x7fe4e8159140 2023-07-06T20:00:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.547+0000 7fe4ee578700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e815d540 con 0x7fe4e80c9c70 2023-07-06T20:00:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.547+0000 7fe4e7fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe4e8159140 0x7fe4e815ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:13.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.548+0000 7fe4e7fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe4e8159140 0x7fe4e815ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60862/0 (socket says 172.21.15.6:60862) 2023-07-06T20:00:13.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.548+0000 7fe4e7fff700 1 -- 172.21.15.6:0/3219697039 learned_addr learned my addr 172.21.15.6:0/3219697039 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:13.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.548+0000 7fe4e77fe700 1 --2- 172.21.15.6:0/3219697039 >> v2:172.21.15.40:3300/0 conn(0x7fe4e80c9c70 0x7fe4e80ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:13.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.548+0000 7fe4e7fff700 1 -- 172.21.15.6:0/3219697039 >> v2:172.21.15.40:3300/0 conn(0x7fe4e80c9c70 msgr2=0x7fe4e80ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:13.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.548+0000 7fe4e7fff700 1 --2- 172.21.15.6:0/3219697039 >> v2:172.21.15.40:3300/0 conn(0x7fe4e80c9c70 0x7fe4e80ce590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:13.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.548+0000 7fe4e7fff700 1 -- 172.21.15.6:0/3219697039 >> v1:172.21.15.40:6789/0 conn(0x7fe4e80cead0 legacy=0x7fe4e806ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:13.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.548+0000 7fe4e7fff700 1 -- 172.21.15.6:0/3219697039 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e815d820 con 0x7fe4e8159140 2023-07-06T20:00:13.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.548+0000 7fe4e7fff700 1 --2- 172.21.15.6:0/3219697039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e8159140 0x7fe4e815ccf0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80cd670 tx=0x7fe4d8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad951e2c7b8e3d9b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:13.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.548+0000 7fe4e6ffd700 1 -- 172.21.15.6:0/3219697039 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d800b870 con 0x7fe4e8159140 2023-07-06T20:00:13.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.548+0000 7fe4e6ffd700 1 -- 172.21.15.6:0/3219697039 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d800b9d0 con 0x7fe4e8159140 2023-07-06T20:00:13.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.548+0000 7fe4e6ffd700 1 -- 172.21.15.6:0/3219697039 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d800bd60 con 0x7fe4e8159140 2023-07-06T20:00:13.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.549+0000 7fe4ee578700 1 -- 172.21.15.6:0/3219697039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e8159140 msgr2=0x7fe4e815ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:13.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.549+0000 7fe4ee578700 1 --2- 172.21.15.6:0/3219697039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e8159140 0x7fe4e815ccf0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80cd670 tx=0x7fe4d8009bd0 comp rx=0 tx=0).stop 2023-07-06T20:00:13.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.549+0000 7fe4ee578700 1 -- 172.21.15.6:0/3219697039 shutdown_connections 2023-07-06T20:00:13.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.549+0000 7fe4ee578700 1 --2- 172.21.15.6:0/3219697039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e8159140 0x7fe4e815ccf0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:13.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.549+0000 7fe4ee578700 1 --2- 172.21.15.6:0/3219697039 >> v2:172.21.15.40:3300/0 conn(0x7fe4e80c9c70 0x7fe4e80ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:13.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.549+0000 7fe4ee578700 1 -- 172.21.15.6:0/3219697039 >> 172.21.15.6:0/3219697039 conn(0x7fe4e80b0b60 msgr2=0x7fe4e80b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:13.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.549+0000 7fe4ee578700 1 -- 172.21.15.6:0/3219697039 shutdown_connections 2023-07-06T20:00:13.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.549+0000 7fe4ee578700 1 -- 172.21.15.6:0/3219697039 wait complete. 2023-07-06T20:00:13.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.550+0000 7fe4ee578700 1 Processor -- start 2023-07-06T20:00:13.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.550+0000 7fe4ee578700 1 -- start start 2023-07-06T20:00:13.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.551+0000 7fe4ee578700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4e80c9c70 0x7fe4e8157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:13.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.551+0000 7fe4ee578700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4e80cead0 0x7fe4e80c2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:13.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.551+0000 7fe4ee578700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e8159140 0x7fe4e80c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:13.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.551+0000 7fe4ee578700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e8158420 con 0x7fe4e8159140 2023-07-06T20:00:13.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.551+0000 7fe4ee578700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e80c3810 con 0x7fe4e80c9c70 2023-07-06T20:00:13.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.551+0000 7fe4ee578700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e80c3af0 con 0x7fe4e80cead0 2023-07-06T20:00:13.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.551+0000 7fe4ecb15700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e8159140 0x7fe4e80c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:13.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.551+0000 7fe4ecb15700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e8159140 0x7fe4e80c31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60872/0 (socket says 172.21.15.6:60872) 2023-07-06T20:00:13.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.551+0000 7fe4ecb15700 1 -- 172.21.15.6:0/3080145056 learned_addr learned my addr 172.21.15.6:0/3080145056 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:13.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.551+0000 7fe4e7fff700 1 --2- 172.21.15.6:0/3080145056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4e80c9c70 0x7fe4e8157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:13.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.551+0000 7fe4e77fe700 1 --2- 172.21.15.6:0/3080145056 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4e80cead0 0x7fe4e80c2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:13.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.551+0000 7fe4ecb15700 1 -- 172.21.15.6:0/3080145056 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4e80cead0 msgr2=0x7fe4e80c2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:13.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.551+0000 7fe4ecb15700 1 --2- 172.21.15.6:0/3080145056 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4e80cead0 0x7fe4e80c2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.551+0000 7fe4ecb15700 1 -- 172.21.15.6:0/3080145056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4e80c9c70 msgr2=0x7fe4e8157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.551+0000 7fe4ecb15700 1 --2- 172.21.15.6:0/3080145056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4e80c9c70 0x7fe4e8157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.551+0000 7fe4ecb15700 1 -- 172.21.15.6:0/3080145056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d8009550 con 0x7fe4e8159140 2023-07-06T20:00:13.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.552+0000 7fe4ecb15700 1 --2- 172.21.15.6:0/3080145056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e8159140 0x7fe4e80c31e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000cb50 tx=0x7fe4e000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:13.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.552+0000 7fe4e4ff9700 1 -- 172.21.15.6:0/3080145056 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0003c00 con 0x7fe4e8159140 2023-07-06T20:00:13.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.552+0000 7fe4e4ff9700 1 -- 172.21.15.6:0/3080145056 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e0003d60 con 0x7fe4e8159140 2023-07-06T20:00:13.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.552+0000 7fe4e4ff9700 1 -- 172.21.15.6:0/3080145056 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e000aa20 con 0x7fe4e8159140 2023-07-06T20:00:13.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.552+0000 7fe4ee578700 1 -- 172.21.15.6:0/3080145056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e80c3dd0 con 0x7fe4e8159140 2023-07-06T20:00:13.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.552+0000 7fe4ee578700 1 -- 172.21.15.6:0/3080145056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e80c4390 con 0x7fe4e8159140 2023-07-06T20:00:13.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.553+0000 7fe4ee578700 1 -- 172.21.15.6:0/3080145056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e80c2770 con 0x7fe4e8159140 2023-07-06T20:00:13.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.553+0000 7fe4e4ff9700 1 -- 172.21.15.6:0/3080145056 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe4e000ab80 con 0x7fe4e8159140 2023-07-06T20:00:13.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.554+0000 7fe4e4ff9700 1 --2- 172.21.15.6:0/3080145056 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe4c806ace0 0x7fe4c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:13.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.554+0000 7fe4e4ff9700 1 -- 172.21.15.6:0/3080145056 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fe4e00891f0 con 0x7fe4e8159140 2023-07-06T20:00:13.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.554+0000 7fe4e7fff700 1 --2- 172.21.15.6:0/3080145056 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe4c806ace0 0x7fe4c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:13.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.554+0000 7fe4e7fff700 1 --2- 172.21.15.6:0/3080145056 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe4c806ace0 0x7fe4c806d190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8000c00 tx=0x7fe4d8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:13.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.558+0000 7fe4e4ff9700 1 -- 172.21.15.6:0/3080145056 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe4e0054540 con 0x7fe4e8159140 2023-07-06T20:00:13.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.843+0000 7fe4ee578700 1 -- 172.21.15.6:0/3080145056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fe4e815dad0 con 0x7fe4e8159140 2023-07-06T20:00:13.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.847+0000 7fe4e4ff9700 1 -- 172.21.15.6:0/3080145056 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe4e0057b60 con 0x7fe4e8159140 2023-07-06T20:00:13.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.849+0000 7fe4ee578700 1 -- 172.21.15.6:0/3080145056 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe4c806ace0 msgr2=0x7fe4c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:13.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.849+0000 7fe4ee578700 1 --2- 172.21.15.6:0/3080145056 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe4c806ace0 0x7fe4c806d190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8000c00 tx=0x7fe4d8008030 comp rx=0 tx=0).stop 2023-07-06T20:00:13.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.849+0000 7fe4ee578700 1 -- 172.21.15.6:0/3080145056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e8159140 msgr2=0x7fe4e80c31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:13.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.849+0000 7fe4ee578700 1 --2- 172.21.15.6:0/3080145056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e8159140 0x7fe4e80c31e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000cb50 tx=0x7fe4e000ce60 comp rx=0 tx=0).stop 2023-07-06T20:00:13.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.849+0000 7fe4ee578700 1 -- 172.21.15.6:0/3080145056 shutdown_connections 2023-07-06T20:00:13.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.849+0000 7fe4ee578700 1 --2- 172.21.15.6:0/3080145056 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe4c806ace0 0x7fe4c806d190 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:13.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.849+0000 7fe4ee578700 1 --2- 172.21.15.6:0/3080145056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e8159140 0x7fe4e80c31e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:13.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.849+0000 7fe4ee578700 1 --2- 172.21.15.6:0/3080145056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4e80c9c70 0x7fe4e8157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:13.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.849+0000 7fe4ee578700 1 --2- 172.21.15.6:0/3080145056 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe4e80cead0 0x7fe4e80c2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:13.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.849+0000 7fe4ee578700 1 -- 172.21.15.6:0/3080145056 >> 172.21.15.6:0/3080145056 conn(0x7fe4e80b0b60 msgr2=0x7fe4e80aead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:13.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.849+0000 7fe4ee578700 1 -- 172.21.15.6:0/3080145056 shutdown_connections 2023-07-06T20:00:13.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.849+0000 7fe4ee578700 1 -- 172.21.15.6:0/3080145056 wait complete. 2023-07-06T20:00:13.865 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-06T20:00:13.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.989+0000 7f491aac6700 1 Processor -- start 2023-07-06T20:00:13.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.989+0000 7f491aac6700 1 -- start start 2023-07-06T20:00:13.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.990+0000 7f491aac6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49140ca850 0x7f491415bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:13.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.990+0000 7f491aac6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4914071cd0 0x7f491415c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:13.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.990+0000 7f491aac6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49140cb310 con 0x7f4914071900 2023-07-06T20:00:13.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.990+0000 7f491aac6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49140cdbf0 con 0x7f49140ca850 2023-07-06T20:00:13.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.990+0000 7f491aac6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491415c9d0 con 0x7f4914071cd0 2023-07-06T20:00:13.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.990+0000 7f4913fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f49140ca850 0x7f491415bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:14.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.990+0000 7f4918862700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4914071900 0x7f49140ca140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33852/0 (socket says 172.21.15.6:33852) 2023-07-06T20:00:14.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.990+0000 7f4918862700 1 -- 172.21.15.6:0/1798010956 learned_addr learned my addr 172.21.15.6:0/1798010956 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:14.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.990+0000 7f4913fff700 1 -- 172.21.15.6:0/1798010956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4914071cd0 msgr2=0x7f491415c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.990+0000 7f4913fff700 1 --2- 172.21.15.6:0/1798010956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4914071cd0 0x7f491415c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.990+0000 7f4913fff700 1 -- 172.21.15.6:0/1798010956 >> v1:172.21.15.6:6789/0 conn(0x7f4914071900 legacy=0x7f49140ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.990+0000 7f4913fff700 1 -- 172.21.15.6:0/1798010956 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49140af070 con 0x7f49140ca850 2023-07-06T20:00:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.990+0000 7f49137fe700 1 -- 172.21.15.6:0/1798010956 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2159536124 0 0) 0x7f49140cb310 con 0x7f4914071900 2023-07-06T20:00:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.991+0000 7f4913fff700 1 --2- 172.21.15.6:0/1798010956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140ca850 0x7f491415bf50 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4900009840 tx=0x7f4900009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb950d9cbf45087 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.991+0000 7f49137fe700 1 -- 172.21.15.6:0/1798010956 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900011830 con 0x7f49140ca850 2023-07-06T20:00:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.991+0000 7f49137fe700 1 -- 172.21.15.6:0/1798010956 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4900011990 con 0x7f49140ca850 2023-07-06T20:00:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.991+0000 7f49137fe700 1 -- 172.21.15.6:0/1798010956 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900011d20 con 0x7f49140ca850 2023-07-06T20:00:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.991+0000 7f491aac6700 1 -- 172.21.15.6:0/1798010956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140ca850 msgr2=0x7f491415bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.991+0000 7f491aac6700 1 --2- 172.21.15.6:0/1798010956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140ca850 0x7f491415bf50 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4900009840 tx=0x7f4900009b50 comp rx=0 tx=0).stop 2023-07-06T20:00:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.991+0000 7f491aac6700 1 -- 172.21.15.6:0/1798010956 shutdown_connections 2023-07-06T20:00:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.991+0000 7f491aac6700 1 --2- 172.21.15.6:0/1798010956 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4914071cd0 0x7f491415c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.991+0000 7f491aac6700 1 --2- 172.21.15.6:0/1798010956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49140ca850 0x7f491415bf50 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.991+0000 7f491aac6700 1 -- 172.21.15.6:0/1798010956 >> 172.21.15.6:0/1798010956 conn(0x7f49140cf960 msgr2=0x7f49140cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.991+0000 7f491aac6700 1 -- 172.21.15.6:0/1798010956 shutdown_connections 2023-07-06T20:00:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.991+0000 7f491aac6700 1 -- 172.21.15.6:0/1798010956 wait complete. 2023-07-06T20:00:14.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.993+0000 7f491aac6700 1 Processor -- start 2023-07-06T20:00:14.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.993+0000 7f491aac6700 1 -- start start 2023-07-06T20:00:14.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.994+0000 7f491aac6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4914071900 0x7f49140c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:14.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.994+0000 7f491aac6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4914071cd0 0x7f4914151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:14.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.994+0000 7f491aac6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49140ca850 0x7f4914151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:14.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.994+0000 7f491aac6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4914155520 con 0x7f4914071900 2023-07-06T20:00:14.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.994+0000 7f491aac6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49141537d0 con 0x7f4914071cd0 2023-07-06T20:00:14.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.994+0000 7f491aac6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4914153a70 con 0x7f49140ca850 2023-07-06T20:00:14.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.994+0000 7f4918862700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4914071900 0x7f49140c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:14.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.994+0000 7f4918862700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4914071900 0x7f49140c9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60882/0 (socket says 172.21.15.6:60882) 2023-07-06T20:00:14.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.994+0000 7f4918862700 1 -- 172.21.15.6:0/349022983 learned_addr learned my addr 172.21.15.6:0/349022983 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:14.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.994+0000 7f4919063700 1 --2- 172.21.15.6:0/349022983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49140ca850 0x7f4914151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:14.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.994+0000 7f4913fff700 1 --2- 172.21.15.6:0/349022983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4914071cd0 0x7f4914151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:14.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.994+0000 7f4918862700 1 -- 172.21.15.6:0/349022983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49140ca850 msgr2=0x7f4914151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:14.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.994+0000 7f4918862700 1 --2- 172.21.15.6:0/349022983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49140ca850 0x7f4914151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.994+0000 7f4918862700 1 -- 172.21.15.6:0/349022983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4914071cd0 msgr2=0x7f4914151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:14.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.994+0000 7f4918862700 1 --2- 172.21.15.6:0/349022983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4914071cd0 0x7f4914151980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.994+0000 7f4918862700 1 -- 172.21.15.6:0/349022983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49000094a0 con 0x7f4914071900 2023-07-06T20:00:14.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.994+0000 7f4919063700 1 --2- 172.21.15.6:0/349022983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49140ca850 0x7f4914151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T20:00:14.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.994+0000 7f4913fff700 1 --2- 172.21.15.6:0/349022983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4914071cd0 0x7f4914151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T20:00:14.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.994+0000 7f4918862700 1 --2- 172.21.15.6:0/349022983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4914071900 0x7f49140c9f00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f490800c550 tx=0x7f490800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:14.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.994+0000 7f49117fa700 1 -- 172.21.15.6:0/349022983 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4908004c80 con 0x7f4914071900 2023-07-06T20:00:14.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.994+0000 7f49117fa700 1 -- 172.21.15.6:0/349022983 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4908004e00 con 0x7f4914071900 2023-07-06T20:00:14.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.994+0000 7f491aac6700 1 -- 172.21.15.6:0/349022983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4914153d50 con 0x7f4914071900 2023-07-06T20:00:14.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.994+0000 7f49117fa700 1 -- 172.21.15.6:0/349022983 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4908007310 con 0x7f4914071900 2023-07-06T20:00:14.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.994+0000 7f491aac6700 1 -- 172.21.15.6:0/349022983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4914154310 con 0x7f4914071900 2023-07-06T20:00:14.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.995+0000 7f491aac6700 1 -- 172.21.15.6:0/349022983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f491404eb90 con 0x7f4914071900 2023-07-06T20:00:14.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.996+0000 7f49117fa700 1 -- 172.21.15.6:0/349022983 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4908007470 con 0x7f4914071900 2023-07-06T20:00:14.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.996+0000 7f49117fa700 1 --2- 172.21.15.6:0/349022983 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f48f806ace0 0x7f48f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:14.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.996+0000 7f49117fa700 1 -- 172.21.15.6:0/349022983 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f4908088f80 con 0x7f4914071900 2023-07-06T20:00:14.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.996+0000 7f4913fff700 1 --2- 172.21.15.6:0/349022983 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f48f806ace0 0x7f48f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:14.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:13.997+0000 7f4913fff700 1 --2- 172.21.15.6:0/349022983 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f48f806ace0 0x7f48f806d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f491406ba00 tx=0x7f4900008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:14.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.001+0000 7f49117fa700 1 -- 172.21.15.6:0/349022983 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f49080bb310 con 0x7f4914071900 2023-07-06T20:00:14.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.278+0000 7f491aac6700 1 -- 172.21.15.6:0/349022983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f49140b58e0 con 0x7f4914071900 2023-07-06T20:00:14.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.282+0000 7f49117fa700 1 -- 172.21.15.6:0/349022983 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4908054240 con 0x7f4914071900 2023-07-06T20:00:14.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.284+0000 7f491aac6700 1 -- 172.21.15.6:0/349022983 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f48f806ace0 msgr2=0x7f48f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:14.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.284+0000 7f491aac6700 1 --2- 172.21.15.6:0/349022983 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f48f806ace0 0x7f48f806d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f491406ba00 tx=0x7f4900008030 comp rx=0 tx=0).stop 2023-07-06T20:00:14.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.284+0000 7f491aac6700 1 -- 172.21.15.6:0/349022983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4914071900 msgr2=0x7f49140c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:14.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.284+0000 7f491aac6700 1 --2- 172.21.15.6:0/349022983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4914071900 0x7f49140c9f00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f490800c550 tx=0x7f490800c910 comp rx=0 tx=0).stop 2023-07-06T20:00:14.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.284+0000 7f491aac6700 1 -- 172.21.15.6:0/349022983 shutdown_connections 2023-07-06T20:00:14.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.284+0000 7f491aac6700 1 --2- 172.21.15.6:0/349022983 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f48f806ace0 0x7f48f806d190 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.284+0000 7f491aac6700 1 --2- 172.21.15.6:0/349022983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4914071900 0x7f49140c9f00 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.284+0000 7f491aac6700 1 --2- 172.21.15.6:0/349022983 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f49140ca850 0x7f4914151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.284+0000 7f491aac6700 1 --2- 172.21.15.6:0/349022983 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4914071cd0 0x7f4914151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.284+0000 7f491aac6700 1 -- 172.21.15.6:0/349022983 >> 172.21.15.6:0/349022983 conn(0x7f49140cf960 msgr2=0x7f491415a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:14.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.284+0000 7f491aac6700 1 -- 172.21.15.6:0/349022983 shutdown_connections 2023-07-06T20:00:14.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.284+0000 7f491aac6700 1 -- 172.21.15.6:0/349022983 wait complete. 2023-07-06T20:00:14.300 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-06T20:00:14.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.427+0000 7fcd29ce0700 1 Processor -- start 2023-07-06T20:00:14.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.427+0000 7fcd29ce0700 1 -- start start 2023-07-06T20:00:14.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.428+0000 7fcd29ce0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd24071900 0x7fcd240ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:14.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.428+0000 7fcd29ce0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcd24071cd0 0x7fcd240ca680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:14.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.428+0000 7fcd29ce0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcd2415bf50 0x7fcd2415c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.428+0000 7fcd29ce0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd240cdbf0 con 0x7fcd2415bf50 2023-07-06T20:00:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.428+0000 7fcd29ce0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd240cb310 con 0x7fcd24071cd0 2023-07-06T20:00:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.428+0000 7fcd29ce0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd240af070 con 0x7fcd24071900 2023-07-06T20:00:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.428+0000 7fcd23fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcd2415bf50 0x7fcd2415c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:14.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.428+0000 7fcd23fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcd2415bf50 0x7fcd2415c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60894/0 (socket says 172.21.15.6:60894) 2023-07-06T20:00:14.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.428+0000 7fcd23fff700 1 -- 172.21.15.6:0/4063530665 learned_addr learned my addr 172.21.15.6:0/4063530665 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:14.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.428+0000 7fcd237fe700 1 --2- 172.21.15.6:0/4063530665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd24071900 0x7fcd240ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:14.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.428+0000 7fcd22ffd700 1 --2- 172.21.15.6:0/4063530665 >> v2:172.21.15.40:3300/0 conn(0x7fcd24071cd0 0x7fcd240ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.429+0000 7fcd23fff700 1 -- 172.21.15.6:0/4063530665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd24071900 msgr2=0x7fcd240ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.429+0000 7fcd23fff700 1 --2- 172.21.15.6:0/4063530665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd24071900 0x7fcd240ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.429+0000 7fcd23fff700 1 -- 172.21.15.6:0/4063530665 >> v2:172.21.15.40:3300/0 conn(0x7fcd24071cd0 msgr2=0x7fcd240ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:14.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.429+0000 7fcd23fff700 1 --2- 172.21.15.6:0/4063530665 >> v2:172.21.15.40:3300/0 conn(0x7fcd24071cd0 0x7fcd240ca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.429+0000 7fcd23fff700 1 -- 172.21.15.6:0/4063530665 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2415c8e0 con 0x7fcd2415bf50 2023-07-06T20:00:14.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.429+0000 7fcd237fe700 1 --2- 172.21.15.6:0/4063530665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd24071900 0x7fcd240ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T20:00:14.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.429+0000 7fcd22ffd700 1 --2- 172.21.15.6:0/4063530665 >> v2:172.21.15.40:3300/0 conn(0x7fcd24071cd0 0x7fcd240ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T20:00:14.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.429+0000 7fcd23fff700 1 --2- 172.21.15.6:0/4063530665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd2415bf50 0x7fcd2415c3a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcd24071280 tx=0x7fcd1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66cb6bdecf01bb80 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:14.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.429+0000 7fcd227fc700 1 -- 172.21.15.6:0/4063530665 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c00e070 con 0x7fcd2415bf50 2023-07-06T20:00:14.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.429+0000 7fcd227fc700 1 -- 172.21.15.6:0/4063530665 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c00b9c0 con 0x7fcd2415bf50 2023-07-06T20:00:14.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.429+0000 7fcd227fc700 1 -- 172.21.15.6:0/4063530665 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c00bd70 con 0x7fcd2415bf50 2023-07-06T20:00:14.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.429+0000 7fcd29ce0700 1 -- 172.21.15.6:0/4063530665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd2415bf50 msgr2=0x7fcd2415c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:14.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.429+0000 7fcd29ce0700 1 --2- 172.21.15.6:0/4063530665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd2415bf50 0x7fcd2415c3a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcd24071280 tx=0x7fcd1c00b330 comp rx=0 tx=0).stop 2023-07-06T20:00:14.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.429+0000 7fcd29ce0700 1 -- 172.21.15.6:0/4063530665 shutdown_connections 2023-07-06T20:00:14.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.429+0000 7fcd29ce0700 1 --2- 172.21.15.6:0/4063530665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd2415bf50 0x7fcd2415c3a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.429+0000 7fcd29ce0700 1 --2- 172.21.15.6:0/4063530665 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd24071900 0x7fcd240ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.429+0000 7fcd29ce0700 1 --2- 172.21.15.6:0/4063530665 >> v2:172.21.15.40:3300/0 conn(0x7fcd24071cd0 0x7fcd240ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.429+0000 7fcd29ce0700 1 -- 172.21.15.6:0/4063530665 >> 172.21.15.6:0/4063530665 conn(0x7fcd240cf960 msgr2=0x7fcd240cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:14.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.430+0000 7fcd29ce0700 1 -- 172.21.15.6:0/4063530665 shutdown_connections 2023-07-06T20:00:14.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.430+0000 7fcd29ce0700 1 -- 172.21.15.6:0/4063530665 wait complete. 2023-07-06T20:00:14.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.431+0000 7fcd29ce0700 1 Processor -- start 2023-07-06T20:00:14.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.431+0000 7fcd29ce0700 1 -- start start 2023-07-06T20:00:14.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.432+0000 7fcd29ce0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd24071900 0x7fcd24157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:14.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.432+0000 7fcd29ce0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd24071cd0 0x7fcd240c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:14.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.432+0000 7fcd29ce0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd2415bf50 0x7fcd2406b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:14.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.432+0000 7fcd29ce0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd241f6370 con 0x7fcd2415bf50 2023-07-06T20:00:14.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.432+0000 7fcd29ce0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd240c4410 con 0x7fcd24071900 2023-07-06T20:00:14.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.432+0000 7fcd29ce0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd241f57f0 con 0x7fcd24071cd0 2023-07-06T20:00:14.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.432+0000 7fcd23fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd2415bf50 0x7fcd2406b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:14.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.432+0000 7fcd23fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd2415bf50 0x7fcd2406b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60900/0 (socket says 172.21.15.6:60900) 2023-07-06T20:00:14.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.432+0000 7fcd23fff700 1 -- 172.21.15.6:0/2860190634 learned_addr learned my addr 172.21.15.6:0/2860190634 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:14.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.432+0000 7fcd22ffd700 1 --2- 172.21.15.6:0/2860190634 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd24071cd0 0x7fcd240c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:14.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.432+0000 7fcd237fe700 1 --2- 172.21.15.6:0/2860190634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd24071900 0x7fcd24157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:14.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.432+0000 7fcd23fff700 1 -- 172.21.15.6:0/2860190634 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd24071cd0 msgr2=0x7fcd240c3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:14.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.432+0000 7fcd23fff700 1 --2- 172.21.15.6:0/2860190634 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd24071cd0 0x7fcd240c3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.432+0000 7fcd23fff700 1 -- 172.21.15.6:0/2860190634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd24071900 msgr2=0x7fcd24157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:14.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.432+0000 7fcd23fff700 1 --2- 172.21.15.6:0/2860190634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd24071900 0x7fcd24157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.432+0000 7fcd23fff700 1 -- 172.21.15.6:0/2860190634 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c009b30 con 0x7fcd2415bf50 2023-07-06T20:00:14.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.432+0000 7fcd237fe700 1 --2- 172.21.15.6:0/2860190634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd24071900 0x7fcd24157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:14.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.432+0000 7fcd23fff700 1 --2- 172.21.15.6:0/2860190634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd2415bf50 0x7fcd2406b9f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00b370 tx=0x7fcd1c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:14.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.432+0000 7fcd1bfff700 1 -- 172.21.15.6:0/2860190634 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c004310 con 0x7fcd2415bf50 2023-07-06T20:00:14.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.432+0000 7fcd1bfff700 1 -- 172.21.15.6:0/2860190634 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c004470 con 0x7fcd2415bf50 2023-07-06T20:00:14.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.432+0000 7fcd1bfff700 1 -- 172.21.15.6:0/2860190634 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c004820 con 0x7fcd2415bf50 2023-07-06T20:00:14.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.432+0000 7fcd29ce0700 1 -- 172.21.15.6:0/2860190634 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd241f5ad0 con 0x7fcd2415bf50 2023-07-06T20:00:14.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.433+0000 7fcd29ce0700 1 -- 172.21.15.6:0/2860190634 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd241f6090 con 0x7fcd2415bf50 2023-07-06T20:00:14.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.433+0000 7fcd29ce0700 1 -- 172.21.15.6:0/2860190634 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2404eb90 con 0x7fcd2415bf50 2023-07-06T20:00:14.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.434+0000 7fcd1bfff700 1 -- 172.21.15.6:0/2860190634 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcd1c01c440 con 0x7fcd2415bf50 2023-07-06T20:00:14.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.434+0000 7fcd1bfff700 1 --2- 172.21.15.6:0/2860190634 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcd0406ace0 0x7fcd0406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:14.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.434+0000 7fcd1bfff700 1 -- 172.21.15.6:0/2860190634 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fcd1c08a820 con 0x7fcd2415bf50 2023-07-06T20:00:14.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.434+0000 7fcd237fe700 1 --2- 172.21.15.6:0/2860190634 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcd0406ace0 0x7fcd0406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:14.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.435+0000 7fcd237fe700 1 --2- 172.21.15.6:0/2860190634 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcd0406ace0 0x7fcd0406d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcd1400aa50 tx=0x7fcd14008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:14.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.439+0000 7fcd1bfff700 1 -- 172.21.15.6:0/2860190634 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcd1c055b70 con 0x7fcd2415bf50 2023-07-06T20:00:14.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.718+0000 7fcd29ce0700 1 -- 172.21.15.6:0/2860190634 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fcd240b58e0 con 0x7fcd2415bf50 2023-07-06T20:00:14.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.722+0000 7fcd1bfff700 1 -- 172.21.15.6:0/2860190634 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fcd1c0200a0 con 0x7fcd2415bf50 2023-07-06T20:00:14.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.724+0000 7fcd29ce0700 1 -- 172.21.15.6:0/2860190634 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcd0406ace0 msgr2=0x7fcd0406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:14.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.724+0000 7fcd29ce0700 1 --2- 172.21.15.6:0/2860190634 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcd0406ace0 0x7fcd0406d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcd1400aa50 tx=0x7fcd14008040 comp rx=0 tx=0).stop 2023-07-06T20:00:14.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.724+0000 7fcd29ce0700 1 -- 172.21.15.6:0/2860190634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd2415bf50 msgr2=0x7fcd2406b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:14.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.724+0000 7fcd29ce0700 1 --2- 172.21.15.6:0/2860190634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd2415bf50 0x7fcd2406b9f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00b370 tx=0x7fcd1c004ad0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.724+0000 7fcd29ce0700 1 -- 172.21.15.6:0/2860190634 shutdown_connections 2023-07-06T20:00:14.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.724+0000 7fcd29ce0700 1 --2- 172.21.15.6:0/2860190634 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcd0406ace0 0x7fcd0406d190 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.724+0000 7fcd29ce0700 1 --2- 172.21.15.6:0/2860190634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd2415bf50 0x7fcd2406b9f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.724+0000 7fcd29ce0700 1 --2- 172.21.15.6:0/2860190634 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd24071900 0x7fcd24157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.724+0000 7fcd29ce0700 1 --2- 172.21.15.6:0/2860190634 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd24071cd0 0x7fcd240c3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.724+0000 7fcd29ce0700 1 -- 172.21.15.6:0/2860190634 >> 172.21.15.6:0/2860190634 conn(0x7fcd240cf960 msgr2=0x7fcd240af230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:14.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.724+0000 7fcd29ce0700 1 -- 172.21.15.6:0/2860190634 shutdown_connections 2023-07-06T20:00:14.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.724+0000 7fcd29ce0700 1 -- 172.21.15.6:0/2860190634 wait complete. 2023-07-06T20:00:14.738 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T20:00:14.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.861+0000 7f1b69cb6700 1 Processor -- start 2023-07-06T20:00:14.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.861+0000 7f1b69cb6700 1 -- start start 2023-07-06T20:00:14.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.862+0000 7f1b69cb6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b640ceab0 0x7f1b640caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:14.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.862+0000 7f1b69cb6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1b640cee80 0x7f1b640716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:14.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.862+0000 7f1b69cb6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b64160ff0 con 0x7f1b64071c00 2023-07-06T20:00:14.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.862+0000 7f1b69cb6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b640cb400 con 0x7f1b640cee80 2023-07-06T20:00:14.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.862+0000 7f1b69cb6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b64072020 con 0x7f1b640ceab0 2023-07-06T20:00:14.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.862+0000 7f1b62ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1b640cee80 0x7f1b640716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:14.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.862+0000 7f1b62ffd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1b640cee80 0x7f1b640716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60906/0 (socket says 172.21.15.6:60906) 2023-07-06T20:00:14.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.862+0000 7f1b62ffd700 1 -- 172.21.15.6:0/3606331052 learned_addr learned my addr 172.21.15.6:0/3606331052 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:14.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.862+0000 7f1b637fe700 1 --2- 172.21.15.6:0/3606331052 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b640ceab0 0x7f1b640caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:14.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.862+0000 7f1b62ffd700 1 -- 172.21.15.6:0/3606331052 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b640ceab0 msgr2=0x7f1b640caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:14.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.862+0000 7f1b62ffd700 1 --2- 172.21.15.6:0/3606331052 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b640ceab0 0x7f1b640caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.862+0000 7f1b62ffd700 1 -- 172.21.15.6:0/3606331052 >> v1:172.21.15.40:6789/0 conn(0x7f1b64071c00 legacy=0x7f1b641602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:14.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.862+0000 7f1b62ffd700 1 -- 172.21.15.6:0/3606331052 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b640ca100 con 0x7f1b640cee80 2023-07-06T20:00:14.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.862+0000 7f1b637fe700 1 --2- 172.21.15.6:0/3606331052 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b640ceab0 0x7f1b640caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:14.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.863+0000 7f1b62ffd700 1 --2- 172.21.15.6:0/3606331052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b640cee80 0x7f1b640716c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1b540098f0 tx=0x7f1b54009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c9d68469209983 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:14.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.863+0000 7f1b627fc700 1 -- 172.21.15.6:0/3606331052 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5400b8a0 con 0x7f1b640cee80 2023-07-06T20:00:14.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.863+0000 7f1b627fc700 1 -- 172.21.15.6:0/3606331052 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5400ba00 con 0x7f1b640cee80 2023-07-06T20:00:14.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.863+0000 7f1b627fc700 1 -- 172.21.15.6:0/3606331052 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5400bd90 con 0x7f1b640cee80 2023-07-06T20:00:14.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.863+0000 7f1b69cb6700 1 -- 172.21.15.6:0/3606331052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b640cee80 msgr2=0x7f1b640716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:14.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.863+0000 7f1b69cb6700 1 --2- 172.21.15.6:0/3606331052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b640cee80 0x7f1b640716c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1b540098f0 tx=0x7f1b54009c00 comp rx=0 tx=0).stop 2023-07-06T20:00:14.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.863+0000 7f1b69cb6700 1 -- 172.21.15.6:0/3606331052 shutdown_connections 2023-07-06T20:00:14.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.863+0000 7f1b69cb6700 1 --2- 172.21.15.6:0/3606331052 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b640ceab0 0x7f1b640caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.863+0000 7f1b69cb6700 1 --2- 172.21.15.6:0/3606331052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b640cee80 0x7f1b640716c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.863+0000 7f1b69cb6700 1 -- 172.21.15.6:0/3606331052 >> 172.21.15.6:0/3606331052 conn(0x7f1b640cc420 msgr2=0x7f1b640cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:14.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.863+0000 7f1b69cb6700 1 -- 172.21.15.6:0/3606331052 shutdown_connections 2023-07-06T20:00:14.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.863+0000 7f1b69cb6700 1 -- 172.21.15.6:0/3606331052 wait complete. 2023-07-06T20:00:14.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.865+0000 7f1b69cb6700 1 Processor -- start 2023-07-06T20:00:14.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.865+0000 7f1b69cb6700 1 -- start start 2023-07-06T20:00:14.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.865+0000 7f1b69cb6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b64071c00 0x7f1b64151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:14.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.865+0000 7f1b69cb6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b640ceab0 0x7f1b641591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:14.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.865+0000 7f1b69cb6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b640cee80 0x7f1b64159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:14.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.866+0000 7f1b69cb6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b640b3010 con 0x7f1b64071c00 2023-07-06T20:00:14.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.866+0000 7f1b69cb6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b64157e00 con 0x7f1b640cee80 2023-07-06T20:00:14.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.866+0000 7f1b69cb6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b64159d80 con 0x7f1b640ceab0 2023-07-06T20:00:14.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.866+0000 7f1b637fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b64071c00 0x7f1b64151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:14.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.866+0000 7f1b637fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b64071c00 0x7f1b64151a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60910/0 (socket says 172.21.15.6:60910) 2023-07-06T20:00:14.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.866+0000 7f1b637fe700 1 -- 172.21.15.6:0/2478911877 learned_addr learned my addr 172.21.15.6:0/2478911877 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:14.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.866+0000 7f1b62ffd700 1 --2- 172.21.15.6:0/2478911877 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b640ceab0 0x7f1b641591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:14.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.866+0000 7f1b63fff700 1 --2- 172.21.15.6:0/2478911877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b640cee80 0x7f1b64159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:14.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.866+0000 7f1b637fe700 1 -- 172.21.15.6:0/2478911877 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b640ceab0 msgr2=0x7f1b641591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:14.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.866+0000 7f1b637fe700 1 --2- 172.21.15.6:0/2478911877 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b640ceab0 0x7f1b641591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.866+0000 7f1b637fe700 1 -- 172.21.15.6:0/2478911877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b640cee80 msgr2=0x7f1b64159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:14.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.866+0000 7f1b637fe700 1 --2- 172.21.15.6:0/2478911877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b640cee80 0x7f1b64159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:14.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.866+0000 7f1b637fe700 1 -- 172.21.15.6:0/2478911877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b54009550 con 0x7f1b64071c00 2023-07-06T20:00:14.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.866+0000 7f1b637fe700 1 --2- 172.21.15.6:0/2478911877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b64071c00 0x7f1b64151a10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c00e810 tx=0x7f1b4c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.866+0000 7f1b5bfff700 1 -- 172.21.15.6:0/2478911877 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c004230 con 0x7f1b64071c00 2023-07-06T20:00:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.866+0000 7f1b5bfff700 1 -- 172.21.15.6:0/2478911877 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4c004390 con 0x7f1b64071c00 2023-07-06T20:00:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.866+0000 7f1b69cb6700 1 -- 172.21.15.6:0/2478911877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b640b2950 con 0x7f1b64071c00 2023-07-06T20:00:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.866+0000 7f1b5bfff700 1 -- 172.21.15.6:0/2478911877 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c0036a0 con 0x7f1b64071c00 2023-07-06T20:00:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.866+0000 7f1b69cb6700 1 -- 172.21.15.6:0/2478911877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b64152200 con 0x7f1b64071c00 2023-07-06T20:00:14.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.867+0000 7f1b69cb6700 1 -- 172.21.15.6:0/2478911877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b640b3280 con 0x7f1b64071c00 2023-07-06T20:00:14.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.868+0000 7f1b5bfff700 1 -- 172.21.15.6:0/2478911877 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1b4c003800 con 0x7f1b64071c00 2023-07-06T20:00:14.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.868+0000 7f1b5bfff700 1 --2- 172.21.15.6:0/2478911877 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1b4406ace0 0x7f1b4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:14.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.868+0000 7f1b5bfff700 1 -- 172.21.15.6:0/2478911877 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f1b4c088cf0 con 0x7f1b64071c00 2023-07-06T20:00:14.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.868+0000 7f1b62ffd700 1 --2- 172.21.15.6:0/2478911877 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1b4406ace0 0x7f1b4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:14.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.869+0000 7f1b62ffd700 1 --2- 172.21.15.6:0/2478911877 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1b4406ace0 0x7f1b4406d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1b54009c40 tx=0x7f1b54008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:14.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:14.872+0000 7f1b5bfff700 1 -- 172.21.15.6:0/2478911877 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1b4c08d070 con 0x7f1b64071c00 2023-07-06T20:00:15.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.071+0000 7f1b69cb6700 1 -- 172.21.15.6:0/2478911877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b64074200 con 0x7f1b64071c00 2023-07-06T20:00:15.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.072+0000 7f1b5bfff700 1 -- 172.21.15.6:0/2478911877 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+14688 (secure 0 0 0) 0x7f1b4c054040 con 0x7f1b64071c00 2023-07-06T20:00:15.074 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:15.074 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":37,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T20:00:11.584436+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T20:00:15.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.074+0000 7f1b69cb6700 1 -- 172.21.15.6:0/2478911877 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1b4406ace0 msgr2=0x7f1b4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.074+0000 7f1b69cb6700 1 --2- 172.21.15.6:0/2478911877 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1b4406ace0 0x7f1b4406d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1b54009c40 tx=0x7f1b54008030 comp rx=0 tx=0).stop 2023-07-06T20:00:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.074+0000 7f1b69cb6700 1 -- 172.21.15.6:0/2478911877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b64071c00 msgr2=0x7f1b64151a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.074+0000 7f1b69cb6700 1 --2- 172.21.15.6:0/2478911877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b64071c00 0x7f1b64151a10 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c00e810 tx=0x7f1b4c00ebd0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.074+0000 7f1b69cb6700 1 -- 172.21.15.6:0/2478911877 shutdown_connections 2023-07-06T20:00:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.074+0000 7f1b69cb6700 1 --2- 172.21.15.6:0/2478911877 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1b4406ace0 0x7f1b4406d190 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.074+0000 7f1b69cb6700 1 --2- 172.21.15.6:0/2478911877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b64071c00 0x7f1b64151a10 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.074+0000 7f1b69cb6700 1 --2- 172.21.15.6:0/2478911877 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b640cee80 0x7f1b64159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.074+0000 7f1b69cb6700 1 --2- 172.21.15.6:0/2478911877 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1b640ceab0 0x7f1b641591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.074+0000 7f1b69cb6700 1 -- 172.21.15.6:0/2478911877 >> 172.21.15.6:0/2478911877 conn(0x7f1b640cc420 msgr2=0x7f1b640cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.075+0000 7f1b69cb6700 1 -- 172.21.15.6:0/2478911877 shutdown_connections 2023-07-06T20:00:15.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.075+0000 7f1b69cb6700 1 -- 172.21.15.6:0/2478911877 wait complete. 2023-07-06T20:00:15.089 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T19:58:38.767727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T19:58:45.759808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-06T20:00:15.090 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-06T20:00:15.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.216+0000 7fad1f44e700 1 Processor -- start 2023-07-06T20:00:15.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.216+0000 7fad1f44e700 1 -- start start 2023-07-06T20:00:15.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.217+0000 7fad1f44e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fad181592b0 0x7fad18071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:15.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.217+0000 7fad1f44e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fad1815cd40 0x7fad18071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:15.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.217+0000 7fad1f44e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad180cc160 con 0x7fad180cd950 2023-07-06T20:00:15.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.217+0000 7fad1f44e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad18159680 con 0x7fad1815cd40 2023-07-06T20:00:15.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.217+0000 7fad1f44e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad1815d2b0 con 0x7fad181592b0 2023-07-06T20:00:15.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.217+0000 7fad1c9e9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fad1815cd40 0x7fad18071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:15.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.217+0000 7fad1d9eb700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fad180cd950 0x7fad1806d8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33898/0 (socket says 172.21.15.6:33898) 2023-07-06T20:00:15.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.217+0000 7fad1d9eb700 1 -- 172.21.15.6:0/3300827871 learned_addr learned my addr 172.21.15.6:0/3300827871 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:15.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.218+0000 7fad1d1ea700 1 --2- 172.21.15.6:0/3300827871 >> v2:172.21.15.40:3300/0 conn(0x7fad181592b0 0x7fad18071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:15.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.218+0000 7fad1c9e9700 1 -- 172.21.15.6:0/3300827871 >> v2:172.21.15.40:3300/0 conn(0x7fad181592b0 msgr2=0x7fad18071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:15.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.218+0000 7fad1c9e9700 1 --2- 172.21.15.6:0/3300827871 >> v2:172.21.15.40:3300/0 conn(0x7fad181592b0 0x7fad18071690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.218+0000 7fad1c9e9700 1 -- 172.21.15.6:0/3300827871 >> v1:172.21.15.6:6789/0 conn(0x7fad180cd950 legacy=0x7fad1806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:15.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.218+0000 7fad1c9e9700 1 -- 172.21.15.6:0/3300827871 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1815d590 con 0x7fad1815cd40 2023-07-06T20:00:15.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.218+0000 7fad0ffff700 1 -- 172.21.15.6:0/3300827871 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2196010978 0 0) 0x7fad180cc160 con 0x7fad180cd950 2023-07-06T20:00:15.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.218+0000 7fad1c9e9700 1 --2- 172.21.15.6:0/3300827871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1815cd40 0x7fad18071bd0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fad1806a800 tx=0x7fad14009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef450235fa180d2d server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:15.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.218+0000 7fad0ffff700 1 -- 172.21.15.6:0/3300827871 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad14011830 con 0x7fad1815cd40 2023-07-06T20:00:15.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.218+0000 7fad0ffff700 1 -- 172.21.15.6:0/3300827871 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad14011990 con 0x7fad1815cd40 2023-07-06T20:00:15.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.218+0000 7fad0ffff700 1 -- 172.21.15.6:0/3300827871 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad14011d20 con 0x7fad1815cd40 2023-07-06T20:00:15.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.219+0000 7fad1f44e700 1 -- 172.21.15.6:0/3300827871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1815cd40 msgr2=0x7fad18071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:15.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.219+0000 7fad1f44e700 1 --2- 172.21.15.6:0/3300827871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1815cd40 0x7fad18071bd0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fad1806a800 tx=0x7fad14009b20 comp rx=0 tx=0).stop 2023-07-06T20:00:15.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.219+0000 7fad1f44e700 1 -- 172.21.15.6:0/3300827871 shutdown_connections 2023-07-06T20:00:15.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.219+0000 7fad1f44e700 1 --2- 172.21.15.6:0/3300827871 >> v2:172.21.15.40:3300/0 conn(0x7fad181592b0 0x7fad18071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.219+0000 7fad1f44e700 1 --2- 172.21.15.6:0/3300827871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1815cd40 0x7fad18071bd0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.219+0000 7fad1f44e700 1 -- 172.21.15.6:0/3300827871 >> 172.21.15.6:0/3300827871 conn(0x7fad180cf960 msgr2=0x7fad180cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:15.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.219+0000 7fad1f44e700 1 -- 172.21.15.6:0/3300827871 shutdown_connections 2023-07-06T20:00:15.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.219+0000 7fad1f44e700 1 -- 172.21.15.6:0/3300827871 wait complete. 2023-07-06T20:00:15.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.220+0000 7fad1f44e700 1 Processor -- start 2023-07-06T20:00:15.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.220+0000 7fad1f44e700 1 -- start start 2023-07-06T20:00:15.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.221+0000 7fad1f44e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad180cd950 0x7fad180c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:15.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.221+0000 7fad1f44e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad181592b0 0x7fad180b0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:15.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.221+0000 7fad1f44e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1815cd40 0x7fad180b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:15.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.221+0000 7fad1f44e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1806ca70 con 0x7fad1815cd40 2023-07-06T20:00:15.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.221+0000 7fad1f44e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad180c92e0 con 0x7fad180cd950 2023-07-06T20:00:15.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.221+0000 7fad1f44e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad180c86d0 con 0x7fad181592b0 2023-07-06T20:00:15.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.221+0000 7fad1d9eb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1815cd40 0x7fad180b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:15.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.222+0000 7fad1d9eb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1815cd40 0x7fad180b0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60928/0 (socket says 172.21.15.6:60928) 2023-07-06T20:00:15.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.222+0000 7fad1d9eb700 1 -- 172.21.15.6:0/1381306033 learned_addr learned my addr 172.21.15.6:0/1381306033 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:15.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.222+0000 7fad1d1ea700 1 --2- 172.21.15.6:0/1381306033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad180cd950 0x7fad180c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:15.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.222+0000 7fad1c9e9700 1 --2- 172.21.15.6:0/1381306033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad181592b0 0x7fad180b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:15.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.222+0000 7fad1d9eb700 1 -- 172.21.15.6:0/1381306033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad181592b0 msgr2=0x7fad180b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:15.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.222+0000 7fad1d9eb700 1 --2- 172.21.15.6:0/1381306033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad181592b0 0x7fad180b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.222+0000 7fad1d9eb700 1 -- 172.21.15.6:0/1381306033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad180cd950 msgr2=0x7fad180c57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:15.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.222+0000 7fad1d9eb700 1 --2- 172.21.15.6:0/1381306033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad180cd950 0x7fad180c57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.222+0000 7fad1d9eb700 1 -- 172.21.15.6:0/1381306033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad140094a0 con 0x7fad1815cd40 2023-07-06T20:00:15.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.222+0000 7fad1d9eb700 1 --2- 172.21.15.6:0/1381306033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1815cd40 0x7fad180b0a50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fad1000cba0 tx=0x7fad1000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:15.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.222+0000 7fad0dffb700 1 -- 172.21.15.6:0/1381306033 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1000aaa0 con 0x7fad1815cd40 2023-07-06T20:00:15.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.222+0000 7fad0dffb700 1 -- 172.21.15.6:0/1381306033 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1000ac20 con 0x7fad1815cd40 2023-07-06T20:00:15.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.222+0000 7fad1f44e700 1 -- 172.21.15.6:0/1381306033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad180c89b0 con 0x7fad1815cd40 2023-07-06T20:00:15.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.222+0000 7fad0dffb700 1 -- 172.21.15.6:0/1381306033 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad100070d0 con 0x7fad1815cd40 2023-07-06T20:00:15.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.222+0000 7fad1f44e700 1 -- 172.21.15.6:0/1381306033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad180c8f70 con 0x7fad1815cd40 2023-07-06T20:00:15.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.223+0000 7fad1f44e700 1 -- 172.21.15.6:0/1381306033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad180c9470 con 0x7fad1815cd40 2023-07-06T20:00:15.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.224+0000 7fad0dffb700 1 -- 172.21.15.6:0/1381306033 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fad10007230 con 0x7fad1815cd40 2023-07-06T20:00:15.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.224+0000 7fad0dffb700 1 --2- 172.21.15.6:0/1381306033 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7facfc06ad10 0x7facfc06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:15.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.224+0000 7fad0dffb700 1 -- 172.21.15.6:0/1381306033 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fad10088d60 con 0x7fad1815cd40 2023-07-06T20:00:15.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.224+0000 7fad1d1ea700 1 --2- 172.21.15.6:0/1381306033 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7facfc06ad10 0x7facfc06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:15.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.225+0000 7fad1d1ea700 1 --2- 172.21.15.6:0/1381306033 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7facfc06ad10 0x7facfc06d1c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fad08006fd0 tx=0x7fad08008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:15.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.228+0000 7fad0dffb700 1 -- 172.21.15.6:0/1381306033 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fad10053fa0 con 0x7fad1815cd40 2023-07-06T20:00:15.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.428+0000 7fad1f44e700 1 -- 172.21.15.6:0/1381306033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fad180cf470 con 0x7fad1815cd40 2023-07-06T20:00:15.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.428+0000 7fad0dffb700 1 -- 172.21.15.6:0/1381306033 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7fad100180a0 con 0x7fad1815cd40 2023-07-06T20:00:15.430 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-06T20:00:15.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.430+0000 7fad1f44e700 1 -- 172.21.15.6:0/1381306033 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7facfc06ad10 msgr2=0x7facfc06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:15.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.430+0000 7fad1f44e700 1 --2- 172.21.15.6:0/1381306033 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7facfc06ad10 0x7facfc06d1c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fad08006fd0 tx=0x7fad08008040 comp rx=0 tx=0).stop 2023-07-06T20:00:15.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.430+0000 7fad1f44e700 1 -- 172.21.15.6:0/1381306033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1815cd40 msgr2=0x7fad180b0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:15.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.430+0000 7fad1f44e700 1 --2- 172.21.15.6:0/1381306033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1815cd40 0x7fad180b0a50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fad1000cba0 tx=0x7fad1000ceb0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.430+0000 7fad1f44e700 1 -- 172.21.15.6:0/1381306033 shutdown_connections 2023-07-06T20:00:15.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.430+0000 7fad1f44e700 1 --2- 172.21.15.6:0/1381306033 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7facfc06ad10 0x7facfc06d1c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.430+0000 7fad1f44e700 1 --2- 172.21.15.6:0/1381306033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad1815cd40 0x7fad180b0a50 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.430+0000 7fad1f44e700 1 --2- 172.21.15.6:0/1381306033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fad180cd950 0x7fad180c57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.430+0000 7fad1f44e700 1 --2- 172.21.15.6:0/1381306033 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fad181592b0 0x7fad180b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.430+0000 7fad1f44e700 1 -- 172.21.15.6:0/1381306033 >> 172.21.15.6:0/1381306033 conn(0x7fad180cf960 msgr2=0x7fad1806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:15.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.430+0000 7fad1f44e700 1 -- 172.21.15.6:0/1381306033 shutdown_connections 2023-07-06T20:00:15.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.430+0000 7fad1f44e700 1 -- 172.21.15.6:0/1381306033 wait complete. 2023-07-06T20:00:15.445 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-06T20:00:15.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.572+0000 7f976dd66700 1 Processor -- start 2023-07-06T20:00:15.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.572+0000 7f976dd66700 1 -- start start 2023-07-06T20:00:15.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.573+0000 7f976dd66700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f97680d15e0 0x7f976806e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:15.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.573+0000 7f976dd66700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97680cd300 con 0x7f97680ce860 2023-07-06T20:00:15.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.573+0000 7f976dd66700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97680b0290 con 0x7f976815a520 2023-07-06T20:00:15.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.573+0000 7f976dd66700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97680ccd80 con 0x7f97680d15e0 2023-07-06T20:00:15.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.573+0000 7f9767fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f97680ce860 0x7f97680cecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33912/0 (socket says 172.21.15.6:33912) 2023-07-06T20:00:15.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.573+0000 7f9767fff700 1 -- 172.21.15.6:0/717560170 learned_addr learned my addr 172.21.15.6:0/717560170 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:15.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.574+0000 7f9766ffd700 1 --2- 172.21.15.6:0/717560170 >> v2:172.21.15.40:3300/0 conn(0x7f97680d15e0 0x7f976806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:15.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.574+0000 7f97667fc700 1 -- 172.21.15.6:0/717560170 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3845338379 0 0) 0x7f97680cd300 con 0x7f97680ce860 2023-07-06T20:00:15.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.574+0000 7f97667fc700 1 -- 172.21.15.6:0/717560170 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97540035b0 con 0x7f97680ce860 2023-07-06T20:00:15.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.574+0000 7f97667fc700 1 -- 172.21.15.6:0/717560170 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609518247 0 0) 0x7f97680b0290 con 0x7f976815a520 2023-07-06T20:00:15.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.574+0000 7f97667fc700 1 -- 172.21.15.6:0/717560170 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97680cd300 con 0x7f976815a520 2023-07-06T20:00:15.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.574+0000 7f97667fc700 1 -- 172.21.15.6:0/717560170 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 722719955 0 0) 0x7f97540035b0 con 0x7f97680ce860 2023-07-06T20:00:15.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.574+0000 7f9766ffd700 1 -- 172.21.15.6:0/717560170 >> v1:172.21.15.40:6789/0 conn(0x7f976815a520 legacy=0x7f976806dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:15.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.574+0000 7f9766ffd700 1 -- 172.21.15.6:0/717560170 >> v1:172.21.15.6:6789/0 conn(0x7f97680ce860 legacy=0x7f97680cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:15.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.574+0000 7f9766ffd700 1 -- 172.21.15.6:0/717560170 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97680cd020 con 0x7f97680d15e0 2023-07-06T20:00:15.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.574+0000 7f9766ffd700 1 --2- 172.21.15.6:0/717560170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97680d15e0 0x7f976806e320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9750009840 tx=0x7f9750009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad4bd410e572bedd server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:15.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.574+0000 7f97667fc700 1 -- 172.21.15.6:0/717560170 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97600019f0 con 0x7f97680d15e0 2023-07-06T20:00:15.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.574+0000 7f97667fc700 1 -- 172.21.15.6:0/717560170 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9750004030 con 0x7f97680d15e0 2023-07-06T20:00:15.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.574+0000 7f97667fc700 1 -- 172.21.15.6:0/717560170 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97500043c0 con 0x7f97680d15e0 2023-07-06T20:00:15.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.575+0000 7f976dd66700 1 -- 172.21.15.6:0/717560170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97680d15e0 msgr2=0x7f976806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:15.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.575+0000 7f976dd66700 1 --2- 172.21.15.6:0/717560170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97680d15e0 0x7f976806e320 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9750009840 tx=0x7f9750009b50 comp rx=0 tx=0).stop 2023-07-06T20:00:15.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.575+0000 7f976dd66700 1 -- 172.21.15.6:0/717560170 shutdown_connections 2023-07-06T20:00:15.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.575+0000 7f976dd66700 1 --2- 172.21.15.6:0/717560170 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97680d15e0 0x7f976806e320 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.575+0000 7f976dd66700 1 -- 172.21.15.6:0/717560170 >> 172.21.15.6:0/717560170 conn(0x7f97680ce120 msgr2=0x7f97680d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:15.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.575+0000 7f976dd66700 1 -- 172.21.15.6:0/717560170 shutdown_connections 2023-07-06T20:00:15.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.575+0000 7f976dd66700 1 -- 172.21.15.6:0/717560170 wait complete. 2023-07-06T20:00:15.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.576+0000 7f976dd66700 1 Processor -- start 2023-07-06T20:00:15.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.576+0000 7f976dd66700 1 -- start start 2023-07-06T20:00:15.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.577+0000 7f976dd66700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97680ce860 0x7f97680ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:15.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.577+0000 7f976dd66700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97680d15e0 0x7f97680b5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:15.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.577+0000 7f976dd66700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f976815a520 0x7f976814f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:15.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.577+0000 7f976dd66700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9768150060 con 0x7f976815a520 2023-07-06T20:00:15.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.577+0000 7f976dd66700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97680b4630 con 0x7f97680ce860 2023-07-06T20:00:15.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.577+0000 7f976dd66700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97680b4910 con 0x7f97680d15e0 2023-07-06T20:00:15.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.577+0000 7f9767fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f976815a520 0x7f976814f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:15.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.577+0000 7f9767fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f976815a520 0x7f976814f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60942/0 (socket says 172.21.15.6:60942) 2023-07-06T20:00:15.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.577+0000 7f9767fff700 1 -- 172.21.15.6:0/242865336 learned_addr learned my addr 172.21.15.6:0/242865336 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:15.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.578+0000 7f9766ffd700 1 --2- 172.21.15.6:0/242865336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97680d15e0 0x7f97680b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:15.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.578+0000 7f97677fe700 1 --2- 172.21.15.6:0/242865336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97680ce860 0x7f97680ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:15.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.578+0000 7f9767fff700 1 -- 172.21.15.6:0/242865336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97680d15e0 msgr2=0x7f97680b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:15.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.578+0000 7f9767fff700 1 --2- 172.21.15.6:0/242865336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97680d15e0 0x7f97680b5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.578+0000 7f9767fff700 1 -- 172.21.15.6:0/242865336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97680ce860 msgr2=0x7f97680ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:15.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.578+0000 7f9767fff700 1 --2- 172.21.15.6:0/242865336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97680ce860 0x7f97680ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.578+0000 7f9767fff700 1 -- 172.21.15.6:0/242865336 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97500094a0 con 0x7f976815a520 2023-07-06T20:00:15.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.578+0000 7f9766ffd700 1 --2- 172.21.15.6:0/242865336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97680d15e0 0x7f97680b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:15.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.578+0000 7f9767fff700 1 --2- 172.21.15.6:0/242865336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f976815a520 0x7f976814f140 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f976000cba0 tx=0x7f976000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:15.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.578+0000 7f975ffff700 1 -- 172.21.15.6:0/242865336 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976000ab80 con 0x7f976815a520 2023-07-06T20:00:15.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.578+0000 7f976dd66700 1 -- 172.21.15.6:0/242865336 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97680c7bc0 con 0x7f976815a520 2023-07-06T20:00:15.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.578+0000 7f975ffff700 1 -- 172.21.15.6:0/242865336 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976000ad00 con 0x7f976815a520 2023-07-06T20:00:15.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.578+0000 7f975ffff700 1 -- 172.21.15.6:0/242865336 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9760007310 con 0x7f976815a520 2023-07-06T20:00:15.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.578+0000 7f976dd66700 1 -- 172.21.15.6:0/242865336 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97680c8180 con 0x7f976815a520 2023-07-06T20:00:15.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.579+0000 7f976dd66700 1 -- 172.21.15.6:0/242865336 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97680c83a0 con 0x7f976815a520 2023-07-06T20:00:15.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.579+0000 7f975ffff700 1 -- 172.21.15.6:0/242865336 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9760007470 con 0x7f976815a520 2023-07-06T20:00:15.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.580+0000 7f975ffff700 1 --2- 172.21.15.6:0/242865336 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f974806ace0 0x7f974806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:15.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.580+0000 7f975ffff700 1 -- 172.21.15.6:0/242865336 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f9760088ea0 con 0x7f976815a520 2023-07-06T20:00:15.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.580+0000 7f97677fe700 1 --2- 172.21.15.6:0/242865336 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f974806ace0 0x7f974806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:15.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.580+0000 7f97677fe700 1 --2- 172.21.15.6:0/242865336 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f974806ace0 0x7f974806d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f97580011e0 tx=0x7f9758009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:15.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.584+0000 7f975ffff700 1 -- 172.21.15.6:0/242865336 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f97600540e0 con 0x7f976815a520 2023-07-06T20:00:15.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.786+0000 7f976dd66700 1 -- 172.21.15.6:0/242865336 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f976804eb90 con 0x7f976815a520 2023-07-06T20:00:15.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.786+0000 7f975ffff700 1 -- 172.21.15.6:0/242865336 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9760057700 con 0x7f976815a520 2023-07-06T20:00:15.789 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-06T20:00:15.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.788+0000 7f976dd66700 1 -- 172.21.15.6:0/242865336 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f974806ace0 msgr2=0x7f974806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.788+0000 7f976dd66700 1 --2- 172.21.15.6:0/242865336 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f974806ace0 0x7f974806d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f97580011e0 tx=0x7f9758009040 comp rx=0 tx=0).stop 2023-07-06T20:00:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.788+0000 7f976dd66700 1 -- 172.21.15.6:0/242865336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f976815a520 msgr2=0x7f976814f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.788+0000 7f976dd66700 1 --2- 172.21.15.6:0/242865336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f976815a520 0x7f976814f140 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f976000cba0 tx=0x7f976000cf60 comp rx=0 tx=0).stop 2023-07-06T20:00:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.789+0000 7f976dd66700 1 -- 172.21.15.6:0/242865336 shutdown_connections 2023-07-06T20:00:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.789+0000 7f976dd66700 1 --2- 172.21.15.6:0/242865336 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f974806ace0 0x7f974806d190 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.789+0000 7f976dd66700 1 --2- 172.21.15.6:0/242865336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f976815a520 0x7f976814f140 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.789+0000 7f976dd66700 1 --2- 172.21.15.6:0/242865336 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f97680ce860 0x7f97680ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.789+0000 7f976dd66700 1 --2- 172.21.15.6:0/242865336 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f97680d15e0 0x7f97680b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.789+0000 7f976dd66700 1 -- 172.21.15.6:0/242865336 >> 172.21.15.6:0/242865336 conn(0x7f97680ce120 msgr2=0x7f9768159720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.789+0000 7f976dd66700 1 -- 172.21.15.6:0/242865336 shutdown_connections 2023-07-06T20:00:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.789+0000 7f976dd66700 1 -- 172.21.15.6:0/242865336 wait complete. 2023-07-06T20:00:15.803 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-06T20:00:15.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.926+0000 7fbe0ef58700 1 Processor -- start 2023-07-06T20:00:15.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.926+0000 7fbe0ef58700 1 -- start start 2023-07-06T20:00:15.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.926+0000 7fbe0ef58700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0806f160 0x7fbe0815ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:15.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.926+0000 7fbe0ef58700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbe0815e2f0 0x7fbe080ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:15.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.926+0000 7fbe0ef58700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe080cd2f0 con 0x7fbe08157ed0 2023-07-06T20:00:15.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.927+0000 7fbe0ef58700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe0815e760 con 0x7fbe0815e2f0 2023-07-06T20:00:15.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.927+0000 7fbe0ef58700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0806e6c0 con 0x7fbe0806f160 2023-07-06T20:00:15.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.927+0000 7fbe0ccf4700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fbe08157ed0 0x7fbe080ccbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33922/0 (socket says 172.21.15.6:33922) 2023-07-06T20:00:15.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.927+0000 7fbe0ccf4700 1 -- 172.21.15.6:0/657778487 learned_addr learned my addr 172.21.15.6:0/657778487 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:15.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.927+0000 7fbe0d4f5700 1 --2- 172.21.15.6:0/657778487 >> v2:172.21.15.40:3300/0 conn(0x7fbe0815e2f0 0x7fbe080ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:15.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.927+0000 7fbe07fff700 1 --2- 172.21.15.6:0/657778487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0806f160 0x7fbe0815ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:15.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.927+0000 7fbe077fe700 1 -- 172.21.15.6:0/657778487 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785494308 0 0) 0x7fbe080cd2f0 con 0x7fbe08157ed0 2023-07-06T20:00:15.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.927+0000 7fbe077fe700 1 -- 172.21.15.6:0/657778487 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdf80035b0 con 0x7fbe08157ed0 2023-07-06T20:00:15.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.927+0000 7fbe077fe700 1 -- 172.21.15.6:0/657778487 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3461747075 0 0) 0x7fbdf80035b0 con 0x7fbe08157ed0 2023-07-06T20:00:15.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.927+0000 7fbe077fe700 1 -- 172.21.15.6:0/657778487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0806f160 msgr2=0x7fbe0815ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:15.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.927+0000 7fbe077fe700 1 --2- 172.21.15.6:0/657778487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0806f160 0x7fbe0815ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.927+0000 7fbe077fe700 1 -- 172.21.15.6:0/657778487 >> v2:172.21.15.40:3300/0 conn(0x7fbe0815e2f0 msgr2=0x7fbe080ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:15.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.927+0000 7fbe077fe700 1 --2- 172.21.15.6:0/657778487 >> v2:172.21.15.40:3300/0 conn(0x7fbe0815e2f0 0x7fbe080ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.927+0000 7fbe077fe700 1 -- 172.21.15.6:0/657778487 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe080cb080 con 0x7fbe08157ed0 2023-07-06T20:00:15.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.927+0000 7fbe077fe700 1 -- 172.21.15.6:0/657778487 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7fbdfc001670 con 0x7fbe08157ed0 2023-07-06T20:00:15.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.927+0000 7fbe077fe700 1 -- 172.21.15.6:0/657778487 >> v1:172.21.15.6:6789/0 conn(0x7fbe08157ed0 legacy=0x7fbe080ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:15.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.927+0000 7fbe077fe700 1 --2- 172.21.15.6:0/657778487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf8003a70 0x7fbdf8003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:15.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.927+0000 7fbe077fe700 1 --2- 172.21.15.6:0/657778487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdf8004850 0x7fbdf8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:15.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.927+0000 7fbe077fe700 1 --2- 172.21.15.6:0/657778487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0806f160 0x7fbdf8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:15.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.927+0000 7fbe077fe700 1 -- 172.21.15.6:0/657778487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0815e760 con 0x7fbdf8003a70 2023-07-06T20:00:15.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.927+0000 7fbe077fe700 1 -- 172.21.15.6:0/657778487 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0806e6c0 con 0x7fbdf8004850 2023-07-06T20:00:15.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.927+0000 7fbe077fe700 1 -- 172.21.15.6:0/657778487 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf800ba10 con 0x7fbe0806f160 2023-07-06T20:00:15.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.927+0000 7fbe0ccf4700 1 --2- 172.21.15.6:0/657778487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf8003a70 0x7fbdf8003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:15.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.927+0000 7fbe07fff700 1 --2- 172.21.15.6:0/657778487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdf8004850 0x7fbdf8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:15.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.928+0000 7fbe0d4f5700 1 --2- 172.21.15.6:0/657778487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0806f160 0x7fbdf8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:15.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.928+0000 7fbe0ccf4700 1 -- 172.21.15.6:0/657778487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0806f160 msgr2=0x7fbdf8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:15.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.928+0000 7fbe0ccf4700 1 --2- 172.21.15.6:0/657778487 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0806f160 0x7fbdf8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.928+0000 7fbe0ccf4700 1 -- 172.21.15.6:0/657778487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdf8004850 msgr2=0x7fbdf8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:15.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.928+0000 7fbe0ccf4700 1 --2- 172.21.15.6:0/657778487 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdf8004850 0x7fbdf8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.928+0000 7fbe0ccf4700 1 -- 172.21.15.6:0/657778487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf80035b0 con 0x7fbdf8003a70 2023-07-06T20:00:15.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.928+0000 7fbe0ccf4700 1 --2- 172.21.15.6:0/657778487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf8003a70 0x7fbdf8003e80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00c320 tx=0x7fbdf8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a56b20fda300212 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:15.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.928+0000 7fbe077fe700 1 -- 172.21.15.6:0/657778487 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc007c60 con 0x7fbdf8003a70 2023-07-06T20:00:15.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.928+0000 7fbe077fe700 1 -- 172.21.15.6:0/657778487 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc00ce60 con 0x7fbdf8003a70 2023-07-06T20:00:15.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.928+0000 7fbe077fe700 1 -- 172.21.15.6:0/657778487 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc005ba0 con 0x7fbdf8003a70 2023-07-06T20:00:15.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.929+0000 7fbe0ef58700 1 -- 172.21.15.6:0/657778487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf8003a70 msgr2=0x7fbdf8003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:15.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.929+0000 7fbe0ef58700 1 --2- 172.21.15.6:0/657778487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdf8003a70 0x7fbdf8003e80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00c320 tx=0x7fbdf8005880 comp rx=0 tx=0).stop 2023-07-06T20:00:15.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.929+0000 7fbe0d4f5700 1 -- 172.21.15.6:0/657778487 reap_dead start 2023-07-06T20:00:15.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.929+0000 7fbe0ef58700 1 -- 172.21.15.6:0/657778487 shutdown_connections 2023-07-06T20:00:15.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.929+0000 7fbe0ef58700 1 -- 172.21.15.6:0/657778487 >> 172.21.15.6:0/657778487 conn(0x7fbe080d0a30 msgr2=0x7fbe080d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:15.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.929+0000 7fbe0ef58700 1 -- 172.21.15.6:0/657778487 shutdown_connections 2023-07-06T20:00:15.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.929+0000 7fbe0ef58700 1 -- 172.21.15.6:0/657778487 wait complete. 2023-07-06T20:00:15.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.930+0000 7fbe0ef58700 1 Processor -- start 2023-07-06T20:00:15.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.930+0000 7fbe0ef58700 1 -- start start 2023-07-06T20:00:15.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.931+0000 7fbe0ef58700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdf8003a70 0x7fbe08154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:15.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.931+0000 7fbe0ef58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe080c9ba0 0x7fbe080ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:15.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.931+0000 7fbe0ef58700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0806cf00 0x7fbe0806d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:15.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.931+0000 7fbe0ef58700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe080ca550 con 0x7fbe080c9ba0 2023-07-06T20:00:15.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.931+0000 7fbe0ef58700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe080b4450 con 0x7fbdf8003a70 2023-07-06T20:00:15.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.931+0000 7fbe0ef58700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe080b3860 con 0x7fbe0806cf00 2023-07-06T20:00:15.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.931+0000 7fbe07fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe080c9ba0 0x7fbe080ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:15.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.931+0000 7fbe07fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe080c9ba0 0x7fbe080ca010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60960/0 (socket says 172.21.15.6:60960) 2023-07-06T20:00:15.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.931+0000 7fbe07fff700 1 -- 172.21.15.6:0/1909983000 learned_addr learned my addr 172.21.15.6:0/1909983000 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:15.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.931+0000 7fbe0d4f5700 1 --2- 172.21.15.6:0/1909983000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0806cf00 0x7fbe0806d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:15.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.931+0000 7fbe0ccf4700 1 --2- 172.21.15.6:0/1909983000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdf8003a70 0x7fbe08154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:15.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.931+0000 7fbe07fff700 1 -- 172.21.15.6:0/1909983000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0806cf00 msgr2=0x7fbe0806d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:15.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.931+0000 7fbe07fff700 1 --2- 172.21.15.6:0/1909983000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0806cf00 0x7fbe0806d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.931+0000 7fbe07fff700 1 -- 172.21.15.6:0/1909983000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdf8003a70 msgr2=0x7fbe08154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:15.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.931+0000 7fbe07fff700 1 --2- 172.21.15.6:0/1909983000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdf8003a70 0x7fbe08154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:15.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.931+0000 7fbe07fff700 1 -- 172.21.15.6:0/1909983000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe080b3b20 con 0x7fbe080c9ba0 2023-07-06T20:00:15.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.931+0000 7fbe0ccf4700 1 --2- 172.21.15.6:0/1909983000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdf8003a70 0x7fbe08154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:15.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.931+0000 7fbe07fff700 1 --2- 172.21.15.6:0/1909983000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe080c9ba0 0x7fbe080ca010 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4011930 tx=0x7fbdf4011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:15.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.932+0000 7fbe057fa700 1 -- 172.21.15.6:0/1909983000 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf4011e80 con 0x7fbe080c9ba0 2023-07-06T20:00:15.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.932+0000 7fbe057fa700 1 -- 172.21.15.6:0/1909983000 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf400f940 con 0x7fbe080c9ba0 2023-07-06T20:00:15.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.932+0000 7fbe0ef58700 1 -- 172.21.15.6:0/1909983000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe080b3e00 con 0x7fbe080c9ba0 2023-07-06T20:00:15.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.932+0000 7fbe057fa700 1 -- 172.21.15.6:0/1909983000 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf400fcd0 con 0x7fbe080c9ba0 2023-07-06T20:00:15.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.932+0000 7fbe0ef58700 1 -- 172.21.15.6:0/1909983000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0806d8b0 con 0x7fbe080c9ba0 2023-07-06T20:00:15.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.933+0000 7fbe0ef58700 1 -- 172.21.15.6:0/1909983000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe080b4600 con 0x7fbe080c9ba0 2023-07-06T20:00:15.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.933+0000 7fbe057fa700 1 -- 172.21.15.6:0/1909983000 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbdf4014440 con 0x7fbe080c9ba0 2023-07-06T20:00:15.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.933+0000 7fbe057fa700 1 --2- 172.21.15.6:0/1909983000 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbdec06ace0 0x7fbdec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:15.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.933+0000 7fbe057fa700 1 -- 172.21.15.6:0/1909983000 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fbdf4089850 con 0x7fbe080c9ba0 2023-07-06T20:00:15.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.933+0000 7fbe0ccf4700 1 --2- 172.21.15.6:0/1909983000 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbdec06ace0 0x7fbdec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:15.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.934+0000 7fbe0ccf4700 1 --2- 172.21.15.6:0/1909983000 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbdec06ace0 0x7fbdec06d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00d010 tx=0x7fbdfc00a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:15.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:15.938+0000 7fbe057fa700 1 -- 172.21.15.6:0/1909983000 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbe080b4600 con 0x7fbe080c9ba0 2023-07-06T20:00:16.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.141+0000 7fbe0ef58700 1 -- 172.21.15.6:0/1909983000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbe080b47c0 con 0x7fbe080c9ba0 2023-07-06T20:00:16.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.141+0000 7fbe057fa700 1 -- 172.21.15.6:0/1909983000 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) v1 ==== 84+0+126 (secure 0 0 0) 0x7fbdf4054ba0 con 0x7fbe080c9ba0 2023-07-06T20:00:16.144 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:16.144 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-07-06T20:00:16.144 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:16.144 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-07-06T20:00:16.145 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-07-06T20:00:16.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-07-06T20:00:16.145 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-07-06T20:00:16.145 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2023-07-06T20:00:16.145 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2023-07-06T20:00:16.145 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-07-06T20:00:16.145 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-07-06T20:00:16.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.143+0000 7fbe0ef58700 1 -- 172.21.15.6:0/1909983000 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbdec06ace0 msgr2=0x7fbdec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:16.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.143+0000 7fbe0ef58700 1 --2- 172.21.15.6:0/1909983000 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbdec06ace0 0x7fbdec06d190 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00d010 tx=0x7fbdfc00a000 comp rx=0 tx=0).stop 2023-07-06T20:00:16.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.143+0000 7fbe0ef58700 1 -- 172.21.15.6:0/1909983000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe080c9ba0 msgr2=0x7fbe080ca010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:16.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.143+0000 7fbe0ef58700 1 --2- 172.21.15.6:0/1909983000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe080c9ba0 0x7fbe080ca010 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4011930 tx=0x7fbdf4011c40 comp rx=0 tx=0).stop 2023-07-06T20:00:16.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.143+0000 7fbe0ef58700 1 -- 172.21.15.6:0/1909983000 shutdown_connections 2023-07-06T20:00:16.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.144+0000 7fbe0ef58700 1 --2- 172.21.15.6:0/1909983000 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbdec06ace0 0x7fbdec06d190 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:16.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.144+0000 7fbe0ef58700 1 --2- 172.21.15.6:0/1909983000 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbe0806cf00 0x7fbe0806d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:16.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.144+0000 7fbe0ef58700 1 --2- 172.21.15.6:0/1909983000 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbdf8003a70 0x7fbe08154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:16.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.144+0000 7fbe0ef58700 1 --2- 172.21.15.6:0/1909983000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe080c9ba0 0x7fbe080ca010 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:16.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.144+0000 7fbe0ef58700 1 -- 172.21.15.6:0/1909983000 >> 172.21.15.6:0/1909983000 conn(0x7fbe080d0a30 msgr2=0x7fbe080ccba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:16.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.144+0000 7fbe0ef58700 1 -- 172.21.15.6:0/1909983000 shutdown_connections 2023-07-06T20:00:16.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.144+0000 7fbe0ef58700 1 -- 172.21.15.6:0/1909983000 wait complete. 2023-07-06T20:00:16.160 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-06T20:00:16.160 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-06T20:00:16.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.288+0000 7f051c53c700 1 Processor -- start 2023-07-06T20:00:16.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.288+0000 7f051c53c700 1 -- start start 2023-07-06T20:00:16.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.289+0000 7f051c53c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05140cb200 0x7f051406eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:16.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.289+0000 7f051c53c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f05140c96a0 0x7f05140c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:16.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.289+0000 7f051c53c700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0514158110 con 0x7f0514070e10 2023-07-06T20:00:16.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.289+0000 7f051c53c700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f051406a900 con 0x7f05140c96a0 2023-07-06T20:00:16.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.289+0000 7f051c53c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f051406a060 con 0x7f05140cb200 2023-07-06T20:00:16.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.289+0000 7f051aad9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f05140c96a0 0x7f05140c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:16.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.289+0000 7f051aad9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f05140c96a0 0x7f05140c9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60970/0 (socket says 172.21.15.6:60970) 2023-07-06T20:00:16.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.289+0000 7f051aad9700 1 -- 172.21.15.6:0/3751067730 learned_addr learned my addr 172.21.15.6:0/3751067730 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:16.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.289+0000 7f0519ad7700 1 --2- 172.21.15.6:0/3751067730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05140cb200 0x7f051406eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:16.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.289+0000 7f051aad9700 1 -- 172.21.15.6:0/3751067730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05140cb200 msgr2=0x7f051406eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:16.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.289+0000 7f051aad9700 1 --2- 172.21.15.6:0/3751067730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05140cb200 0x7f051406eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:16.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.289+0000 7f051aad9700 1 -- 172.21.15.6:0/3751067730 >> v1:172.21.15.40:6789/0 conn(0x7f0514070e10 legacy=0x7f05140711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:16.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.289+0000 7f051aad9700 1 -- 172.21.15.6:0/3751067730 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051406a340 con 0x7f05140c96a0 2023-07-06T20:00:16.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.289+0000 7f051aad9700 1 --2- 172.21.15.6:0/3751067730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05140c96a0 0x7f05140c9b20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f050c009e50 tx=0x7f050c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5132729ac93bcbb1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:16.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.289+0000 7f05192d6700 1 -- 172.21.15.6:0/3751067730 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050c00e070 con 0x7f05140c96a0 2023-07-06T20:00:16.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.290+0000 7f05192d6700 1 -- 172.21.15.6:0/3751067730 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050c00b910 con 0x7f05140c96a0 2023-07-06T20:00:16.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.290+0000 7f05192d6700 1 -- 172.21.15.6:0/3751067730 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050c00bcc0 con 0x7f05140c96a0 2023-07-06T20:00:16.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.290+0000 7f051c53c700 1 -- 172.21.15.6:0/3751067730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05140c96a0 msgr2=0x7f05140c9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:16.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.290+0000 7f051c53c700 1 --2- 172.21.15.6:0/3751067730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05140c96a0 0x7f05140c9b20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f050c009e50 tx=0x7f050c00b330 comp rx=0 tx=0).stop 2023-07-06T20:00:16.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.290+0000 7f051c53c700 1 -- 172.21.15.6:0/3751067730 shutdown_connections 2023-07-06T20:00:16.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.290+0000 7f051c53c700 1 --2- 172.21.15.6:0/3751067730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05140c96a0 0x7f05140c9b20 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:16.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.290+0000 7f051c53c700 1 --2- 172.21.15.6:0/3751067730 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f05140cb200 0x7f051406eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:16.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.290+0000 7f051c53c700 1 -- 172.21.15.6:0/3751067730 >> 172.21.15.6:0/3751067730 conn(0x7f05140cf050 msgr2=0x7f05140cf420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:16.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.290+0000 7f051c53c700 1 -- 172.21.15.6:0/3751067730 shutdown_connections 2023-07-06T20:00:16.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.290+0000 7f051c53c700 1 -- 172.21.15.6:0/3751067730 wait complete. 2023-07-06T20:00:16.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.291+0000 7f051c53c700 1 Processor -- start 2023-07-06T20:00:16.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.291+0000 7f051c53c700 1 -- start start 2023-07-06T20:00:16.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.292+0000 7f051c53c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0514070e10 0x7f05140c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:16.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.292+0000 7f051c53c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05140c96a0 0x7f0514153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:16.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.292+0000 7f051c53c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05140cb200 0x7f05140afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:16.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.292+0000 7f051c53c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0514157450 con 0x7f05140c96a0 2023-07-06T20:00:16.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.292+0000 7f051c53c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05140c82b0 con 0x7f05140cb200 2023-07-06T20:00:16.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.292+0000 7f051c53c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05140c5160 con 0x7f0514070e10 2023-07-06T20:00:16.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.292+0000 7f0519ad7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05140c96a0 0x7f0514153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:16.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.292+0000 7f0519ad7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05140c96a0 0x7f0514153300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60974/0 (socket says 172.21.15.6:60974) 2023-07-06T20:00:16.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.292+0000 7f0519ad7700 1 -- 172.21.15.6:0/838341892 learned_addr learned my addr 172.21.15.6:0/838341892 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:16.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.292+0000 7f051a2d8700 1 --2- 172.21.15.6:0/838341892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0514070e10 0x7f05140c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:16.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.292+0000 7f051aad9700 1 --2- 172.21.15.6:0/838341892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05140cb200 0x7f05140afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:16.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.293+0000 7f0519ad7700 1 -- 172.21.15.6:0/838341892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0514070e10 msgr2=0x7f05140c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:16.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.293+0000 7f0519ad7700 1 --2- 172.21.15.6:0/838341892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0514070e10 0x7f05140c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:16.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.293+0000 7f0519ad7700 1 -- 172.21.15.6:0/838341892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05140cb200 msgr2=0x7f05140afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:16.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.293+0000 7f0519ad7700 1 --2- 172.21.15.6:0/838341892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05140cb200 0x7f05140afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.293+0000 7f0519ad7700 1 -- 172.21.15.6:0/838341892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050c009b30 con 0x7f05140c96a0 2023-07-06T20:00:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.293+0000 7f0519ad7700 1 --2- 172.21.15.6:0/838341892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05140c96a0 0x7f0514153300 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f050400e870 tx=0x7f050400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.293+0000 7f050affd700 1 -- 172.21.15.6:0/838341892 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0504009590 con 0x7f05140c96a0 2023-07-06T20:00:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.293+0000 7f050affd700 1 -- 172.21.15.6:0/838341892 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0504013680 con 0x7f05140c96a0 2023-07-06T20:00:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.293+0000 7f051c53c700 1 -- 172.21.15.6:0/838341892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05140c6fb0 con 0x7f05140c96a0 2023-07-06T20:00:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.293+0000 7f050affd700 1 -- 172.21.15.6:0/838341892 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05040139f0 con 0x7f05140c96a0 2023-07-06T20:00:16.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.293+0000 7f051c53c700 1 -- 172.21.15.6:0/838341892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05140c7570 con 0x7f05140c96a0 2023-07-06T20:00:16.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.294+0000 7f051c53c700 1 -- 172.21.15.6:0/838341892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0514074200 con 0x7f05140c96a0 2023-07-06T20:00:16.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.294+0000 7f050affd700 1 -- 172.21.15.6:0/838341892 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0504013b50 con 0x7f05140c96a0 2023-07-06T20:00:16.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.295+0000 7f050affd700 1 --2- 172.21.15.6:0/838341892 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f04f806ace0 0x7f04f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:16.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.295+0000 7f050affd700 1 -- 172.21.15.6:0/838341892 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f0504089100 con 0x7f05140c96a0 2023-07-06T20:00:16.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.295+0000 7f051a2d8700 1 --2- 172.21.15.6:0/838341892 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f04f806ace0 0x7f04f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:16.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.295+0000 7f051a2d8700 1 --2- 172.21.15.6:0/838341892 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f04f806ace0 0x7f04f806d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0510007fd0 tx=0x7f0510009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:16.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.299+0000 7f050affd700 1 -- 172.21.15.6:0/838341892 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0504057e50 con 0x7f05140c96a0 2023-07-06T20:00:16.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.496+0000 7f051c53c700 1 -- 172.21.15.6:0/838341892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0514153840 con 0x7f05140c96a0 2023-07-06T20:00:16.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.730+0000 7f050affd700 1 -- 172.21.15.6:0/838341892 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) v1 ==== 138+0+0 (secure 0 0 0) 0x7f05040579e0 con 0x7f05140c96a0 2023-07-06T20:00:16.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.734+0000 7f051c53c700 1 -- 172.21.15.6:0/838341892 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f04f806ace0 msgr2=0x7f04f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:16.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.734+0000 7f051c53c700 1 --2- 172.21.15.6:0/838341892 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f04f806ace0 0x7f04f806d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0510007fd0 tx=0x7f0510009040 comp rx=0 tx=0).stop 2023-07-06T20:00:16.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.734+0000 7f051c53c700 1 -- 172.21.15.6:0/838341892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05140c96a0 msgr2=0x7f0514153300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:16.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.734+0000 7f051c53c700 1 --2- 172.21.15.6:0/838341892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05140c96a0 0x7f0514153300 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f050400e870 tx=0x7f050400eb80 comp rx=0 tx=0).stop 2023-07-06T20:00:16.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.734+0000 7f051c53c700 1 -- 172.21.15.6:0/838341892 shutdown_connections 2023-07-06T20:00:16.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.734+0000 7f051c53c700 1 --2- 172.21.15.6:0/838341892 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f04f806ace0 0x7f04f806d190 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:16.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.734+0000 7f051c53c700 1 --2- 172.21.15.6:0/838341892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05140cb200 0x7f05140afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:16.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.734+0000 7f051c53c700 1 --2- 172.21.15.6:0/838341892 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0514070e10 0x7f05140c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:16.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.734+0000 7f051c53c700 1 --2- 172.21.15.6:0/838341892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05140c96a0 0x7f0514153300 secure :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f050400e870 tx=0x7f050400eb80 comp rx=0 tx=0).stop 2023-07-06T20:00:16.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.734+0000 7f051c53c700 1 -- 172.21.15.6:0/838341892 >> 172.21.15.6:0/838341892 conn(0x7f05140cf050 msgr2=0x7f0514154870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:16.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.734+0000 7f051c53c700 1 -- 172.21.15.6:0/838341892 shutdown_connections 2023-07-06T20:00:16.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.734+0000 7f051c53c700 1 -- 172.21.15.6:0/838341892 wait complete. 2023-07-06T20:00:16.746 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-07-06T20:00:16.752 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-06T20:00:16.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.885+0000 7f7b0d988700 1 Processor -- start 2023-07-06T20:00:16.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.885+0000 7f7b0d988700 1 -- start start 2023-07-06T20:00:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.886+0000 7f7b0d988700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b08071900 0x7f7b080ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.886+0000 7f7b0d988700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7b08071cd0 0x7f7b080ca680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.886+0000 7f7b0d988700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7b0815bf50 0x7f7b0815c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:16.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.886+0000 7f7b0d988700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b080cdbf0 con 0x7f7b0815bf50 2023-07-06T20:00:16.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.886+0000 7f7b0d988700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b080cb310 con 0x7f7b08071cd0 2023-07-06T20:00:16.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.886+0000 7f7b0d988700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b080af070 con 0x7f7b08071900 2023-07-06T20:00:16.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.886+0000 7f7b077fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7b0815bf50 0x7f7b0815c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:16.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.886+0000 7f7b077fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f7b0815bf50 0x7f7b0815c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60984/0 (socket says 172.21.15.6:60984) 2023-07-06T20:00:16.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.886+0000 7f7b077fe700 1 -- 172.21.15.6:0/2206865272 learned_addr learned my addr 172.21.15.6:0/2206865272 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:16.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.886+0000 7f7b06ffd700 1 --2- 172.21.15.6:0/2206865272 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b08071900 0x7f7b080ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:16.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.886+0000 7f7b067fc700 1 --2- 172.21.15.6:0/2206865272 >> v2:172.21.15.40:3300/0 conn(0x7f7b08071cd0 0x7f7b080ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:16.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.886+0000 7f7b077fe700 1 -- 172.21.15.6:0/2206865272 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b08071900 msgr2=0x7f7b080ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:16.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.886+0000 7f7b077fe700 1 --2- 172.21.15.6:0/2206865272 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b08071900 0x7f7b080ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:16.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.886+0000 7f7b077fe700 1 -- 172.21.15.6:0/2206865272 >> v2:172.21.15.40:3300/0 conn(0x7f7b08071cd0 msgr2=0x7f7b080ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:16.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.886+0000 7f7b077fe700 1 --2- 172.21.15.6:0/2206865272 >> v2:172.21.15.40:3300/0 conn(0x7f7b08071cd0 0x7f7b080ca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:16.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.886+0000 7f7b077fe700 1 -- 172.21.15.6:0/2206865272 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b0815c8e0 con 0x7f7b0815bf50 2023-07-06T20:00:16.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.887+0000 7f7b077fe700 1 --2- 172.21.15.6:0/2206865272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b0815bf50 0x7f7b0815c3a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7b08071280 tx=0x7f7b0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a87d119eb437eda server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:16.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.887+0000 7f7b05ffb700 1 -- 172.21.15.6:0/2206865272 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0000e070 con 0x7f7b0815bf50 2023-07-06T20:00:16.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.887+0000 7f7b05ffb700 1 -- 172.21.15.6:0/2206865272 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b0000b910 con 0x7f7b0815bf50 2023-07-06T20:00:16.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.887+0000 7f7b05ffb700 1 -- 172.21.15.6:0/2206865272 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0000bcc0 con 0x7f7b0815bf50 2023-07-06T20:00:16.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.887+0000 7f7b0d988700 1 -- 172.21.15.6:0/2206865272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b0815bf50 msgr2=0x7f7b0815c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:16.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.887+0000 7f7b0d988700 1 --2- 172.21.15.6:0/2206865272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b0815bf50 0x7f7b0815c3a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7b08071280 tx=0x7f7b0000b330 comp rx=0 tx=0).stop 2023-07-06T20:00:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.887+0000 7f7b0d988700 1 -- 172.21.15.6:0/2206865272 shutdown_connections 2023-07-06T20:00:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.887+0000 7f7b0d988700 1 --2- 172.21.15.6:0/2206865272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b0815bf50 0x7f7b0815c3a0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.887+0000 7f7b0d988700 1 --2- 172.21.15.6:0/2206865272 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b08071900 0x7f7b080ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.887+0000 7f7b0d988700 1 --2- 172.21.15.6:0/2206865272 >> v2:172.21.15.40:3300/0 conn(0x7f7b08071cd0 0x7f7b080ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.887+0000 7f7b0d988700 1 -- 172.21.15.6:0/2206865272 >> 172.21.15.6:0/2206865272 conn(0x7f7b080cf960 msgr2=0x7f7b080cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.887+0000 7f7b0d988700 1 -- 172.21.15.6:0/2206865272 shutdown_connections 2023-07-06T20:00:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.887+0000 7f7b0d988700 1 -- 172.21.15.6:0/2206865272 wait complete. 2023-07-06T20:00:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.889+0000 7f7b0d988700 1 Processor -- start 2023-07-06T20:00:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.889+0000 7f7b0d988700 1 -- start start 2023-07-06T20:00:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.890+0000 7f7b0d988700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b08071900 0x7f7b0815cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.890+0000 7f7b0d988700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b08071cd0 0x7f7b081f17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.890+0000 7f7b0d988700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b0815bf50 0x7f7b081f1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.890+0000 7f7b0d988700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b080c5c60 con 0x7f7b0815bf50 2023-07-06T20:00:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.890+0000 7f7b0d988700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b081f2250 con 0x7f7b08071900 2023-07-06T20:00:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.890+0000 7f7b0d988700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b080c4fe0 con 0x7f7b08071cd0 2023-07-06T20:00:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.890+0000 7f7b077fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b0815bf50 0x7f7b081f1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.890+0000 7f7b077fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b0815bf50 0x7f7b081f1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60990/0 (socket says 172.21.15.6:60990) 2023-07-06T20:00:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.890+0000 7f7b077fe700 1 -- 172.21.15.6:0/718411501 learned_addr learned my addr 172.21.15.6:0/718411501 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.890+0000 7f7b067fc700 1 --2- 172.21.15.6:0/718411501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b08071cd0 0x7f7b081f17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.890+0000 7f7b06ffd700 1 --2- 172.21.15.6:0/718411501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b08071900 0x7f7b0815cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.890+0000 7f7b077fe700 1 -- 172.21.15.6:0/718411501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b08071cd0 msgr2=0x7f7b081f17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.890+0000 7f7b077fe700 1 --2- 172.21.15.6:0/718411501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b08071cd0 0x7f7b081f17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.890+0000 7f7b077fe700 1 -- 172.21.15.6:0/718411501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b08071900 msgr2=0x7f7b0815cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.890+0000 7f7b077fe700 1 --2- 172.21.15.6:0/718411501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b08071900 0x7f7b0815cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.890+0000 7f7b077fe700 1 -- 172.21.15.6:0/718411501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b00009b30 con 0x7f7b0815bf50 2023-07-06T20:00:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.890+0000 7f7b077fe700 1 --2- 172.21.15.6:0/718411501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b0815bf50 0x7f7b081f1d10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7b0806eb20 tx=0x7f7b00004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.891+0000 7f7aeffff700 1 -- 172.21.15.6:0/718411501 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0000ce80 con 0x7f7b0815bf50 2023-07-06T20:00:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.891+0000 7f7aeffff700 1 -- 172.21.15.6:0/718411501 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b00004040 con 0x7f7b0815bf50 2023-07-06T20:00:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.891+0000 7f7b0d988700 1 -- 172.21.15.6:0/718411501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b080c52c0 con 0x7f7b0815bf50 2023-07-06T20:00:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.891+0000 7f7aeffff700 1 -- 172.21.15.6:0/718411501 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b000043f0 con 0x7f7b0815bf50 2023-07-06T20:00:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.891+0000 7f7b0d988700 1 -- 172.21.15.6:0/718411501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b080c5880 con 0x7f7b0815bf50 2023-07-06T20:00:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.892+0000 7f7b0d988700 1 -- 172.21.15.6:0/718411501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b080c5da0 con 0x7f7b0815bf50 2023-07-06T20:00:16.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.892+0000 7f7aeffff700 1 -- 172.21.15.6:0/718411501 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7b00004550 con 0x7f7b0815bf50 2023-07-06T20:00:16.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.893+0000 7f7aeffff700 1 --2- 172.21.15.6:0/718411501 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7af406ace0 0x7f7af406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.893+0000 7f7aeffff700 1 -- 172.21.15.6:0/718411501 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f7b0008a530 con 0x7f7b0815bf50 2023-07-06T20:00:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.893+0000 7f7b06ffd700 1 --2- 172.21.15.6:0/718411501 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7af406ace0 0x7f7af406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.893+0000 7f7b06ffd700 1 --2- 172.21.15.6:0/718411501 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7af406ace0 0x7f7af406d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7afc009ac0 tx=0x7f7afc009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:16.897+0000 7f7aeffff700 1 -- 172.21.15.6:0/718411501 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7b080c5da0 con 0x7f7b0815bf50 2023-07-06T20:00:17.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.098+0000 7f7b0d988700 1 -- 172.21.15.6:0/718411501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7b080c5da0 con 0x7f7b0815bf50 2023-07-06T20:00:17.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.732+0000 7f7aeffff700 1 -- 172.21.15.6:0/718411501 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7b080c5da0 con 0x7f7b0815bf50 2023-07-06T20:00:17.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.744+0000 7f7b0d988700 1 -- 172.21.15.6:0/718411501 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7af406ace0 msgr2=0x7f7af406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:17.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.744+0000 7f7b0d988700 1 --2- 172.21.15.6:0/718411501 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7af406ace0 0x7f7af406d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7afc009ac0 tx=0x7f7afc009210 comp rx=0 tx=0).stop 2023-07-06T20:00:17.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.744+0000 7f7b0d988700 1 -- 172.21.15.6:0/718411501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b0815bf50 msgr2=0x7f7b081f1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:17.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.744+0000 7f7b0d988700 1 --2- 172.21.15.6:0/718411501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b0815bf50 0x7f7b081f1d10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7b0806eb20 tx=0x7f7b00004ad0 comp rx=0 tx=0).stop 2023-07-06T20:00:17.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.744+0000 7f7b0d988700 1 -- 172.21.15.6:0/718411501 shutdown_connections 2023-07-06T20:00:17.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.744+0000 7f7b0d988700 1 --2- 172.21.15.6:0/718411501 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7af406ace0 0x7f7af406d190 secure :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7afc009ac0 tx=0x7f7afc009210 comp rx=0 tx=0).stop 2023-07-06T20:00:17.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.744+0000 7f7b0d988700 1 --2- 172.21.15.6:0/718411501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b0815bf50 0x7f7b081f1d10 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:17.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.744+0000 7f7b0d988700 1 --2- 172.21.15.6:0/718411501 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7b08071900 0x7f7b0815cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:17.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.744+0000 7f7b0d988700 1 --2- 172.21.15.6:0/718411501 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7b08071cd0 0x7f7b081f17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:17.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.744+0000 7f7b0d988700 1 -- 172.21.15.6:0/718411501 >> 172.21.15.6:0/718411501 conn(0x7f7b080cf960 msgr2=0x7f7b080c2980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:17.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.745+0000 7f7b0d988700 1 -- 172.21.15.6:0/718411501 shutdown_connections 2023-07-06T20:00:17.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.745+0000 7f7b0d988700 1 -- 172.21.15.6:0/718411501 wait complete. 2023-07-06T20:00:17.755 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-07-06T20:00:17.768 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-06T20:00:17.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.905+0000 7f89229d6700 1 Processor -- start 2023-07-06T20:00:17.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.905+0000 7f89229d6700 1 -- start start 2023-07-06T20:00:17.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.906+0000 7f89229d6700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f891c15c660 0x7f891c167420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:17.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.906+0000 7f89229d6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f891c0cb310 con 0x7f891c0ca850 2023-07-06T20:00:17.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.906+0000 7f89229d6700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f891c0af070 con 0x7f891c071900 2023-07-06T20:00:17.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.906+0000 7f89229d6700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f891c0cdbf0 con 0x7f891c15c660 2023-07-06T20:00:17.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.906+0000 7f8920f73700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f891c15c660 0x7f891c167420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:17.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.906+0000 7f891b7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f891c0ca850 0x7f891c15bf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33972/0 (socket says 172.21.15.6:33972) 2023-07-06T20:00:17.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.906+0000 7f891b7fe700 1 -- 172.21.15.6:0/446609609 learned_addr learned my addr 172.21.15.6:0/446609609 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:17.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.906+0000 7f8920f73700 1 -- 172.21.15.6:0/446609609 >> v1:172.21.15.40:6789/0 conn(0x7f891c071900 legacy=0x7f891c0ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:17.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.906+0000 7f8920f73700 1 -- 172.21.15.6:0/446609609 >> v1:172.21.15.6:6789/0 conn(0x7f891c0ca850 legacy=0x7f891c15bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:17.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.907+0000 7f891affd700 1 -- 172.21.15.6:0/446609609 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289687160 0 0) 0x7f891c0cb310 con 0x7f891c0ca850 2023-07-06T20:00:17.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.907+0000 7f8920f73700 1 -- 172.21.15.6:0/446609609 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891c0cad50 con 0x7f891c15c660 2023-07-06T20:00:17.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.907+0000 7f8920f73700 1 --2- 172.21.15.6:0/446609609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f891c15c660 0x7f891c167420 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8914009d90 tx=0x7f891400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69cc3b4f9764883f server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:17.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.907+0000 7f891affd700 1 -- 172.21.15.6:0/446609609 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891400e070 con 0x7f891c15c660 2023-07-06T20:00:17.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.907+0000 7f891affd700 1 -- 172.21.15.6:0/446609609 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891400bb90 con 0x7f891c15c660 2023-07-06T20:00:17.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.907+0000 7f891affd700 1 -- 172.21.15.6:0/446609609 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8914003a20 con 0x7f891c15c660 2023-07-06T20:00:17.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.907+0000 7f89229d6700 1 -- 172.21.15.6:0/446609609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f891c15c660 msgr2=0x7f891c167420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:17.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.907+0000 7f89229d6700 1 --2- 172.21.15.6:0/446609609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f891c15c660 0x7f891c167420 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8914009d90 tx=0x7f891400b330 comp rx=0 tx=0).stop 2023-07-06T20:00:17.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.907+0000 7f89229d6700 1 -- 172.21.15.6:0/446609609 shutdown_connections 2023-07-06T20:00:17.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.907+0000 7f89229d6700 1 --2- 172.21.15.6:0/446609609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f891c15c660 0x7f891c167420 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:17.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.907+0000 7f89229d6700 1 -- 172.21.15.6:0/446609609 >> 172.21.15.6:0/446609609 conn(0x7f891c0cf960 msgr2=0x7f891c0cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:17.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.907+0000 7f89229d6700 1 -- 172.21.15.6:0/446609609 shutdown_connections 2023-07-06T20:00:17.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.907+0000 7f89229d6700 1 -- 172.21.15.6:0/446609609 wait complete. 2023-07-06T20:00:17.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.909+0000 7f89229d6700 1 Processor -- start 2023-07-06T20:00:17.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.909+0000 7f89229d6700 1 -- start start 2023-07-06T20:00:17.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.910+0000 7f89229d6700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f891c071900 0x7f891c0c4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:17.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.910+0000 7f89229d6700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f891c0ca850 0x7f891c0c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:17.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.910+0000 7f89229d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f891c15c660 0x7f891c149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:17.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.910+0000 7f89229d6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891c14a5c0 con 0x7f891c15c660 2023-07-06T20:00:17.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.910+0000 7f89229d6700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f891c0c3ef0 con 0x7f891c0ca850 2023-07-06T20:00:17.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.910+0000 7f89229d6700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891c15cc10 con 0x7f891c071900 2023-07-06T20:00:17.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.910+0000 7f8920f73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f891c15c660 0x7f891c149720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:17.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.910+0000 7f8920f73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f891c15c660 0x7f891c149720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32772/0 (socket says 172.21.15.6:32772) 2023-07-06T20:00:17.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.910+0000 7f8920f73700 1 -- 172.21.15.6:0/560464666 learned_addr learned my addr 172.21.15.6:0/560464666 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:17.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.910+0000 7f891b7fe700 1 --2- 172.21.15.6:0/560464666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f891c0ca850 0x7f891c0c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.910+0000 7f891bfff700 1 --2- 172.21.15.6:0/560464666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f891c071900 0x7f891c0c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.910+0000 7f8920f73700 1 -- 172.21.15.6:0/560464666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f891c071900 msgr2=0x7f891c0c4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.910+0000 7f8920f73700 1 --2- 172.21.15.6:0/560464666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f891c071900 0x7f891c0c4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.910+0000 7f8920f73700 1 -- 172.21.15.6:0/560464666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f891c0ca850 msgr2=0x7f891c0c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.910+0000 7f8920f73700 1 --2- 172.21.15.6:0/560464666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f891c0ca850 0x7f891c0c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.910+0000 7f8920f73700 1 -- 172.21.15.6:0/560464666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8914009a70 con 0x7f891c15c660 2023-07-06T20:00:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.910+0000 7f891bfff700 1 --2- 172.21.15.6:0/560464666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f891c071900 0x7f891c0c4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T20:00:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.910+0000 7f8920f73700 1 --2- 172.21.15.6:0/560464666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f891c15c660 0x7f891c149720 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f891c0af200 tx=0x7f8914004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:17.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.910+0000 7f8918ff9700 1 -- 172.21.15.6:0/560464666 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8914012630 con 0x7f891c15c660 2023-07-06T20:00:17.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.910+0000 7f8918ff9700 1 -- 172.21.15.6:0/560464666 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8914012790 con 0x7f891c15c660 2023-07-06T20:00:17.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.910+0000 7f89229d6700 1 -- 172.21.15.6:0/560464666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f891c15cef0 con 0x7f891c15c660 2023-07-06T20:00:17.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.910+0000 7f8918ff9700 1 -- 172.21.15.6:0/560464666 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8914012b40 con 0x7f891c15c660 2023-07-06T20:00:17.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.911+0000 7f89229d6700 1 -- 172.21.15.6:0/560464666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f891c0c4460 con 0x7f891c15c660 2023-07-06T20:00:17.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.911+0000 7f89229d6700 1 -- 172.21.15.6:0/560464666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f891c0c47d0 con 0x7f891c15c660 2023-07-06T20:00:17.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.912+0000 7f8918ff9700 1 -- 172.21.15.6:0/560464666 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8914012ca0 con 0x7f891c15c660 2023-07-06T20:00:17.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.912+0000 7f8918ff9700 1 --2- 172.21.15.6:0/560464666 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f890806ace0 0x7f890806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:17.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.912+0000 7f8918ff9700 1 -- 172.21.15.6:0/560464666 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f891408bb00 con 0x7f891c15c660 2023-07-06T20:00:17.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.912+0000 7f891bfff700 1 --2- 172.21.15.6:0/560464666 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f890806ace0 0x7f890806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:17.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.913+0000 7f891bfff700 1 --2- 172.21.15.6:0/560464666 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f890806ace0 0x7f890806d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f890c006fd0 tx=0x7f890c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:17.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:17.917+0000 7f8918ff9700 1 -- 172.21.15.6:0/560464666 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8914056b60 con 0x7f891c15c660 2023-07-06T20:00:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.161+0000 7f89229d6700 1 -- 172.21.15.6:0/560464666 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f891c0c45f0 con 0x7f891c15c660 2023-07-06T20:00:18.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.775+0000 7f8918ff9700 1 -- 172.21.15.6:0/560464666 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f891405a180 con 0x7f891c15c660 2023-07-06T20:00:18.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.791+0000 7f89229d6700 1 -- 172.21.15.6:0/560464666 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f890806ace0 msgr2=0x7f890806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:18.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.791+0000 7f89229d6700 1 --2- 172.21.15.6:0/560464666 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f890806ace0 0x7f890806d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f890c006fd0 tx=0x7f890c008040 comp rx=0 tx=0).stop 2023-07-06T20:00:18.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.791+0000 7f89229d6700 1 -- 172.21.15.6:0/560464666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f891c15c660 msgr2=0x7f891c149720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:18.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.791+0000 7f89229d6700 1 --2- 172.21.15.6:0/560464666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f891c15c660 0x7f891c149720 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f891c0af200 tx=0x7f8914004ad0 comp rx=0 tx=0).stop 2023-07-06T20:00:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.792+0000 7f89229d6700 1 -- 172.21.15.6:0/560464666 shutdown_connections 2023-07-06T20:00:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.792+0000 7f89229d6700 1 --2- 172.21.15.6:0/560464666 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f890806ace0 0x7f890806d190 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.792+0000 7f89229d6700 1 --2- 172.21.15.6:0/560464666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f891c15c660 0x7f891c149720 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.792+0000 7f89229d6700 1 --2- 172.21.15.6:0/560464666 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f891c071900 0x7f891c0c4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:18.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.792+0000 7f89229d6700 1 --2- 172.21.15.6:0/560464666 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f891c0ca850 0x7f891c0c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:18.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.792+0000 7f89229d6700 1 -- 172.21.15.6:0/560464666 >> 172.21.15.6:0/560464666 conn(0x7f891c0cf960 msgr2=0x7f891c06ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:18.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.793+0000 7f89229d6700 1 -- 172.21.15.6:0/560464666 shutdown_connections 2023-07-06T20:00:18.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.793+0000 7f89229d6700 1 -- 172.21.15.6:0/560464666 wait complete. 2023-07-06T20:00:18.801 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 6 and data pool 7 2023-07-06T20:00:18.814 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T20:00:18.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.942+0000 7fe01c1e1700 1 Processor -- start 2023-07-06T20:00:18.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.942+0000 7fe01c1e1700 1 -- start start 2023-07-06T20:00:18.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.943+0000 7fe01c1e1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe014157ed0 0x7fe01406f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:18.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.943+0000 7fe01c1e1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe0140ccbe0 0x7fe01415ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:18.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.943+0000 7fe01c1e1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01406e6c0 con 0x7fe0140cd030 2023-07-06T20:00:18.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.943+0000 7fe01c1e1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01406f6a0 con 0x7fe014157ed0 2023-07-06T20:00:18.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.943+0000 7fe01c1e1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0140cb080 con 0x7fe0140ccbe0 2023-07-06T20:00:18.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.943+0000 7fe019f7d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe014157ed0 0x7fe01406f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:18.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.943+0000 7fe01a77e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fe0140cd030 0x7fe0140ce600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:33988/0 (socket says 172.21.15.6:33988) 2023-07-06T20:00:18.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.943+0000 7fe01a77e700 1 -- 172.21.15.6:0/2931291643 learned_addr learned my addr 172.21.15.6:0/2931291643 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:18.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.943+0000 7fe019f7d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe014157ed0 0x7fe01406f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32776/0 (socket says 172.21.15.6:32776) 2023-07-06T20:00:18.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.943+0000 7fe01977c700 1 --2- 172.21.15.6:0/2931291643 >> v2:172.21.15.40:3300/0 conn(0x7fe0140ccbe0 0x7fe01415ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:18.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.943+0000 7fe019f7d700 1 -- 172.21.15.6:0/2931291643 >> v2:172.21.15.40:3300/0 conn(0x7fe0140ccbe0 msgr2=0x7fe01415ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:18.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.943+0000 7fe019f7d700 1 --2- 172.21.15.6:0/2931291643 >> v2:172.21.15.40:3300/0 conn(0x7fe0140ccbe0 0x7fe01415ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:18.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.943+0000 7fe019f7d700 1 -- 172.21.15.6:0/2931291643 >> v1:172.21.15.6:6789/0 conn(0x7fe0140cd030 legacy=0x7fe0140ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:18.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.943+0000 7fe018f7b700 1 -- 172.21.15.6:0/2931291643 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799864531 0 0) 0x7fe01406e6c0 con 0x7fe0140cd030 2023-07-06T20:00:18.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.943+0000 7fe019f7d700 1 -- 172.21.15.6:0/2931291643 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0140cb360 con 0x7fe014157ed0 2023-07-06T20:00:18.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.943+0000 7fe019f7d700 1 --2- 172.21.15.6:0/2931291643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe014157ed0 0x7fe01406f160 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe0140cbdd0 tx=0x7fe010009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0347e97ac0ff16 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:18.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.944+0000 7fe018f7b700 1 -- 172.21.15.6:0/2931291643 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe010011830 con 0x7fe014157ed0 2023-07-06T20:00:18.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.944+0000 7fe018f7b700 1 -- 172.21.15.6:0/2931291643 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe010011990 con 0x7fe014157ed0 2023-07-06T20:00:18.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.944+0000 7fe018f7b700 1 -- 172.21.15.6:0/2931291643 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe010011d20 con 0x7fe014157ed0 2023-07-06T20:00:18.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.944+0000 7fe01c1e1700 1 -- 172.21.15.6:0/2931291643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe014157ed0 msgr2=0x7fe01406f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:18.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.944+0000 7fe01c1e1700 1 --2- 172.21.15.6:0/2931291643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe014157ed0 0x7fe01406f160 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe0140cbdd0 tx=0x7fe010009b20 comp rx=0 tx=0).stop 2023-07-06T20:00:18.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.944+0000 7fe01c1e1700 1 -- 172.21.15.6:0/2931291643 shutdown_connections 2023-07-06T20:00:18.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.944+0000 7fe01c1e1700 1 --2- 172.21.15.6:0/2931291643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe014157ed0 0x7fe01406f160 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:18.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.944+0000 7fe01c1e1700 1 --2- 172.21.15.6:0/2931291643 >> v2:172.21.15.40:3300/0 conn(0x7fe0140ccbe0 0x7fe01415ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:18.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.944+0000 7fe01c1e1700 1 -- 172.21.15.6:0/2931291643 >> 172.21.15.6:0/2931291643 conn(0x7fe0140d0a30 msgr2=0x7fe0140d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:18.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.944+0000 7fe01c1e1700 1 -- 172.21.15.6:0/2931291643 shutdown_connections 2023-07-06T20:00:18.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.944+0000 7fe01c1e1700 1 -- 172.21.15.6:0/2931291643 wait complete. 2023-07-06T20:00:18.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.945+0000 7fe01c1e1700 1 Processor -- start 2023-07-06T20:00:18.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.945+0000 7fe01c1e1700 1 -- start start 2023-07-06T20:00:18.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.946+0000 7fe01c1e1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0140ccbe0 0x7fe014159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:18.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.946+0000 7fe01c1e1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0140cd030 0x7fe014159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:18.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.946+0000 7fe01c1e1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe014157ed0 0x7fe0140c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:18.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.946+0000 7fe01c1e1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0140afd60 con 0x7fe0140cd030 2023-07-06T20:00:18.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.946+0000 7fe01c1e1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0140b0000 con 0x7fe014157ed0 2023-07-06T20:00:18.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.946+0000 7fe01c1e1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0140b02e0 con 0x7fe0140ccbe0 2023-07-06T20:00:18.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.946+0000 7fe01977c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0140cd030 0x7fe014159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:18.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.946+0000 7fe01977c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0140cd030 0x7fe014159880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32784/0 (socket says 172.21.15.6:32784) 2023-07-06T20:00:18.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.946+0000 7fe01977c700 1 -- 172.21.15.6:0/2244044763 learned_addr learned my addr 172.21.15.6:0/2244044763 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:18.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.947+0000 7fe019f7d700 1 --2- 172.21.15.6:0/2244044763 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0140ccbe0 0x7fe014159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:18.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.947+0000 7fe01a77e700 1 --2- 172.21.15.6:0/2244044763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe014157ed0 0x7fe0140c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:18.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.947+0000 7fe01977c700 1 -- 172.21.15.6:0/2244044763 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0140ccbe0 msgr2=0x7fe014159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:18.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.947+0000 7fe01977c700 1 --2- 172.21.15.6:0/2244044763 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0140ccbe0 0x7fe014159340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:18.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.947+0000 7fe01977c700 1 -- 172.21.15.6:0/2244044763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe014157ed0 msgr2=0x7fe0140c8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:18.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.947+0000 7fe01977c700 1 --2- 172.21.15.6:0/2244044763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe014157ed0 0x7fe0140c8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:18.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.947+0000 7fe01977c700 1 -- 172.21.15.6:0/2244044763 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0100094a0 con 0x7fe0140cd030 2023-07-06T20:00:18.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.947+0000 7fe019f7d700 1 --2- 172.21.15.6:0/2244044763 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0140ccbe0 0x7fe014159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:18.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.947+0000 7fe01a77e700 1 --2- 172.21.15.6:0/2244044763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe014157ed0 0x7fe0140c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:18.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.947+0000 7fe01977c700 1 --2- 172.21.15.6:0/2244044763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0140cd030 0x7fe014159880 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe00400c7f0 tx=0x7fe00400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:18.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.947+0000 7fe00a7fc700 1 -- 172.21.15.6:0/2244044763 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe004004220 con 0x7fe0140cd030 2023-07-06T20:00:18.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.947+0000 7fe00a7fc700 1 -- 172.21.15.6:0/2244044763 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe004004380 con 0x7fe0140cd030 2023-07-06T20:00:18.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.947+0000 7fe01c1e1700 1 -- 172.21.15.6:0/2244044763 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0140b05c0 con 0x7fe0140cd030 2023-07-06T20:00:18.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.947+0000 7fe00a7fc700 1 -- 172.21.15.6:0/2244044763 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0040036a0 con 0x7fe0140cd030 2023-07-06T20:00:18.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.947+0000 7fe01c1e1700 1 -- 172.21.15.6:0/2244044763 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0140b0b80 con 0x7fe0140cd030 2023-07-06T20:00:18.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.948+0000 7fe01c1e1700 1 -- 172.21.15.6:0/2244044763 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0140b0d40 con 0x7fe0140cd030 2023-07-06T20:00:18.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.949+0000 7fe00a7fc700 1 -- 172.21.15.6:0/2244044763 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe004003800 con 0x7fe0140cd030 2023-07-06T20:00:18.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.949+0000 7fe00a7fc700 1 --2- 172.21.15.6:0/2244044763 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fdff806ace0 0x7fdff806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:18.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.949+0000 7fe00a7fc700 1 -- 172.21.15.6:0/2244044763 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe0040891f0 con 0x7fe0140cd030 2023-07-06T20:00:18.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.949+0000 7fe019f7d700 1 --2- 172.21.15.6:0/2244044763 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fdff806ace0 0x7fdff806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:18.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.949+0000 7fe019f7d700 1 --2- 172.21.15.6:0/2244044763 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fdff806ace0 0x7fdff806d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe0100090b0 tx=0x7fe01001c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:18.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:18.953+0000 7fe00a7fc700 1 -- 172.21.15.6:0/2244044763 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe004057c00 con 0x7fe0140cd030 2023-07-06T20:00:19.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.155+0000 7fe01c1e1700 1 -- 172.21.15.6:0/2244044763 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe014155510 con 0x7fe0140cd030 2023-07-06T20:00:19.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.156+0000 7fe00a7fc700 1 -- 172.21.15.6:0/2244044763 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18357 (secure 0 0 0) 0x7fe004057790 con 0x7fe0140cd030 2023-07-06T20:00:19.159 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:19.160 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":40,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T20:00:18.162763+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-06T20:00:16.527659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-06T20:00:17.129118+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T20:00:19.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.158+0000 7fe01c1e1700 1 -- 172.21.15.6:0/2244044763 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fdff806ace0 msgr2=0x7fdff806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:19.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.158+0000 7fe01c1e1700 1 --2- 172.21.15.6:0/2244044763 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fdff806ace0 0x7fdff806d190 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe0100090b0 tx=0x7fe01001c040 comp rx=0 tx=0).stop 2023-07-06T20:00:19.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.158+0000 7fe01c1e1700 1 -- 172.21.15.6:0/2244044763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0140cd030 msgr2=0x7fe014159880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:19.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.158+0000 7fe01c1e1700 1 --2- 172.21.15.6:0/2244044763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0140cd030 0x7fe014159880 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe00400c7f0 tx=0x7fe00400cbb0 comp rx=0 tx=0).stop 2023-07-06T20:00:19.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.158+0000 7fe01c1e1700 1 -- 172.21.15.6:0/2244044763 shutdown_connections 2023-07-06T20:00:19.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.158+0000 7fe01c1e1700 1 --2- 172.21.15.6:0/2244044763 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fdff806ace0 0x7fdff806d190 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:19.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.158+0000 7fe01c1e1700 1 --2- 172.21.15.6:0/2244044763 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe014157ed0 0x7fe0140c8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:19.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.158+0000 7fe01c1e1700 1 --2- 172.21.15.6:0/2244044763 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe0140ccbe0 0x7fe014159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:19.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.158+0000 7fe01c1e1700 1 --2- 172.21.15.6:0/2244044763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0140cd030 0x7fe014159880 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:19.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.158+0000 7fe01c1e1700 1 -- 172.21.15.6:0/2244044763 >> 172.21.15.6:0/2244044763 conn(0x7fe0140d0a30 msgr2=0x7fe0140d0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:19.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.158+0000 7fe01c1e1700 1 -- 172.21.15.6:0/2244044763 shutdown_connections 2023-07-06T20:00:19.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.158+0000 7fe01c1e1700 1 -- 172.21.15.6:0/2244044763 wait complete. 2023-07-06T20:00:19.173 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T20:00:19.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.297+0000 7f51f11a0700 1 Processor -- start 2023-07-06T20:00:19.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.297+0000 7f51f11a0700 1 -- start start 2023-07-06T20:00:19.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.297+0000 7f51f11a0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51ec0ceab0 0x7f51ec0caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:19.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.297+0000 7f51f11a0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f51ec0cee80 0x7f51ec0716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:19.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.297+0000 7f51f11a0700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ec160ff0 con 0x7f51ec071c00 2023-07-06T20:00:19.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.297+0000 7f51f11a0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ec0cb400 con 0x7f51ec0cee80 2023-07-06T20:00:19.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.297+0000 7f51f11a0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec072020 con 0x7f51ec0ceab0 2023-07-06T20:00:19.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.298+0000 7f51eb59e700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f51ec071c00 0x7f51ec1602c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34002/0 (socket says 172.21.15.6:34002) 2023-07-06T20:00:19.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.298+0000 7f51eb59e700 1 -- 172.21.15.6:0/550353543 learned_addr learned my addr 172.21.15.6:0/550353543 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:19.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.298+0000 7f51ead9d700 1 --2- 172.21.15.6:0/550353543 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51ec0ceab0 0x7f51ec0caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:19.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.298+0000 7f51e9d9b700 1 -- 172.21.15.6:0/550353543 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835809263 0 0) 0x7f51ec160ff0 con 0x7f51ec071c00 2023-07-06T20:00:19.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.298+0000 7f51ea59c700 1 --2- 172.21.15.6:0/550353543 >> v2:172.21.15.40:3300/0 conn(0x7f51ec0cee80 0x7f51ec0716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:19.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.298+0000 7f51e9d9b700 1 -- 172.21.15.6:0/550353543 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51d80035b0 con 0x7f51ec071c00 2023-07-06T20:00:19.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.298+0000 7f51e9d9b700 1 -- 172.21.15.6:0/550353543 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1167638868 0 0) 0x7f51d80035b0 con 0x7f51ec071c00 2023-07-06T20:00:19.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.298+0000 7f51e9d9b700 1 -- 172.21.15.6:0/550353543 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51ec0ceab0 msgr2=0x7f51ec0caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:19.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.298+0000 7f51e9d9b700 1 --2- 172.21.15.6:0/550353543 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51ec0ceab0 0x7f51ec0caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:19.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.298+0000 7f51e9d9b700 1 -- 172.21.15.6:0/550353543 >> v2:172.21.15.40:3300/0 conn(0x7f51ec0cee80 msgr2=0x7f51ec0716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:19.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.298+0000 7f51e9d9b700 1 --2- 172.21.15.6:0/550353543 >> v2:172.21.15.40:3300/0 conn(0x7f51ec0cee80 0x7f51ec0716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:19.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.298+0000 7f51e9d9b700 1 -- 172.21.15.6:0/550353543 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec0ca100 con 0x7f51ec071c00 2023-07-06T20:00:19.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.298+0000 7f51e9d9b700 1 -- 172.21.15.6:0/550353543 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f51e40019f0 con 0x7f51ec071c00 2023-07-06T20:00:19.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.298+0000 7f51e9d9b700 1 -- 172.21.15.6:0/550353543 >> v1:172.21.15.6:6789/0 conn(0x7f51ec071c00 legacy=0x7f51ec1602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:19.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.298+0000 7f51e9d9b700 1 --2- 172.21.15.6:0/550353543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51d8003a70 0x7f51d8003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:19.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.298+0000 7f51e9d9b700 1 --2- 172.21.15.6:0/550353543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51d8004850 0x7f51d8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.298+0000 7f51e9d9b700 1 --2- 172.21.15.6:0/550353543 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51ec0ceab0 0x7f51d8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.298+0000 7f51e9d9b700 1 -- 172.21.15.6:0/550353543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec0cb400 con 0x7f51d8004850 2023-07-06T20:00:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.298+0000 7f51e9d9b700 1 -- 172.21.15.6:0/550353543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec072020 con 0x7f51d8003a70 2023-07-06T20:00:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.298+0000 7f51e9d9b700 1 -- 172.21.15.6:0/550353543 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d800ba10 con 0x7f51ec0ceab0 2023-07-06T20:00:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.298+0000 7f51ea59c700 1 --2- 172.21.15.6:0/550353543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51d8004850 0x7f51d8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.298+0000 7f51ead9d700 1 --2- 172.21.15.6:0/550353543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51d8003a70 0x7f51d8003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:19.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.298+0000 7f51eb59e700 1 --2- 172.21.15.6:0/550353543 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51ec0ceab0 0x7f51d8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:19.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.299+0000 7f51ea59c700 1 -- 172.21.15.6:0/550353543 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51ec0ceab0 msgr2=0x7f51d8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:19.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.299+0000 7f51ea59c700 1 --2- 172.21.15.6:0/550353543 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51ec0ceab0 0x7f51d8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:19.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.299+0000 7f51ea59c700 1 -- 172.21.15.6:0/550353543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51d8003a70 msgr2=0x7f51d8003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:19.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.299+0000 7f51ea59c700 1 --2- 172.21.15.6:0/550353543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51d8003a70 0x7f51d8003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:19.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.299+0000 7f51ea59c700 1 -- 172.21.15.6:0/550353543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d80035b0 con 0x7f51d8004850 2023-07-06T20:00:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.299+0000 7f51ea59c700 1 --2- 172.21.15.6:0/550353543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51d8004850 0x7f51d8004cc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009b60 tx=0x7f51d8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8054221c25c87f45 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:19.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.299+0000 7f51e9d9b700 1 -- 172.21.15.6:0/550353543 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc00e6c0 con 0x7f51d8004850 2023-07-06T20:00:19.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.299+0000 7f51e9d9b700 1 -- 172.21.15.6:0/550353543 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc00e820 con 0x7f51d8004850 2023-07-06T20:00:19.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.299+0000 7f51e9d9b700 1 -- 172.21.15.6:0/550353543 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc00eb90 con 0x7f51d8004850 2023-07-06T20:00:19.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.299+0000 7f51f11a0700 1 -- 172.21.15.6:0/550353543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51d8004850 msgr2=0x7f51d8004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:19.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.299+0000 7f51f11a0700 1 --2- 172.21.15.6:0/550353543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51d8004850 0x7f51d8004cc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009b60 tx=0x7f51d8005880 comp rx=0 tx=0).stop 2023-07-06T20:00:19.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.299+0000 7f51eb59e700 1 -- 172.21.15.6:0/550353543 reap_dead start 2023-07-06T20:00:19.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.299+0000 7f51f11a0700 1 -- 172.21.15.6:0/550353543 shutdown_connections 2023-07-06T20:00:19.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.299+0000 7f51f11a0700 1 -- 172.21.15.6:0/550353543 >> 172.21.15.6:0/550353543 conn(0x7f51ec0cc420 msgr2=0x7f51ec0cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:19.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.299+0000 7f51f11a0700 1 -- 172.21.15.6:0/550353543 shutdown_connections 2023-07-06T20:00:19.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.299+0000 7f51f11a0700 1 -- 172.21.15.6:0/550353543 wait complete. 2023-07-06T20:00:19.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.301+0000 7f51f11a0700 1 Processor -- start 2023-07-06T20:00:19.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.301+0000 7f51f11a0700 1 -- start start 2023-07-06T20:00:19.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.302+0000 7f51f11a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51d8004850 0x7f51ec0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:19.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.302+0000 7f51f11a0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51ec151310 0x7f51ec0b0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:19.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.302+0000 7f51f11a0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51ec0b54a0 0x7f51ec0b0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:19.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.302+0000 7f51f11a0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec150850 con 0x7f51d8004850 2023-07-06T20:00:19.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.302+0000 7f51f11a0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec0b3390 con 0x7f51ec151310 2023-07-06T20:00:19.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.302+0000 7f51f11a0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec14fbd0 con 0x7f51ec0b54a0 2023-07-06T20:00:19.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.302+0000 7f51ead9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51d8004850 0x7f51ec0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:19.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.302+0000 7f51ead9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51d8004850 0x7f51ec0b4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32802/0 (socket says 172.21.15.6:32802) 2023-07-06T20:00:19.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.302+0000 7f51ead9d700 1 -- 172.21.15.6:0/3486740036 learned_addr learned my addr 172.21.15.6:0/3486740036 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:19.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.302+0000 7f51ea59c700 1 --2- 172.21.15.6:0/3486740036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51ec151310 0x7f51ec0b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:19.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.302+0000 7f51eb59e700 1 --2- 172.21.15.6:0/3486740036 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51ec0b54a0 0x7f51ec0b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:19.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.302+0000 7f51ead9d700 1 -- 172.21.15.6:0/3486740036 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51ec0b54a0 msgr2=0x7f51ec0b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:19.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.302+0000 7f51ead9d700 1 --2- 172.21.15.6:0/3486740036 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51ec0b54a0 0x7f51ec0b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:19.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.302+0000 7f51ead9d700 1 -- 172.21.15.6:0/3486740036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51ec151310 msgr2=0x7f51ec0b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:19.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.302+0000 7f51ead9d700 1 --2- 172.21.15.6:0/3486740036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51ec151310 0x7f51ec0b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:19.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.302+0000 7f51ead9d700 1 -- 172.21.15.6:0/3486740036 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec14feb0 con 0x7f51d8004850 2023-07-06T20:00:19.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.302+0000 7f51ead9d700 1 --2- 172.21.15.6:0/3486740036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51d8004850 0x7f51ec0b4f60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f51d40119a0 tx=0x7f51d4011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:19.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.303+0000 7f51e37fe700 1 -- 172.21.15.6:0/3486740036 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d400f780 con 0x7f51d8004850 2023-07-06T20:00:19.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.303+0000 7f51e37fe700 1 -- 172.21.15.6:0/3486740036 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d400f8e0 con 0x7f51d8004850 2023-07-06T20:00:19.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.303+0000 7f51f11a0700 1 -- 172.21.15.6:0/3486740036 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ec150190 con 0x7f51d8004850 2023-07-06T20:00:19.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.303+0000 7f51e37fe700 1 -- 172.21.15.6:0/3486740036 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d400fc70 con 0x7f51d8004850 2023-07-06T20:00:19.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.303+0000 7f51f11a0700 1 -- 172.21.15.6:0/3486740036 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ec14c090 con 0x7f51d8004850 2023-07-06T20:00:19.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.304+0000 7f51f11a0700 1 -- 172.21.15.6:0/3486740036 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ec150ac0 con 0x7f51d8004850 2023-07-06T20:00:19.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.304+0000 7f51e37fe700 1 -- 172.21.15.6:0/3486740036 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f51d4014440 con 0x7f51d8004850 2023-07-06T20:00:19.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.305+0000 7f51e37fe700 1 --2- 172.21.15.6:0/3486740036 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f51cc06ace0 0x7f51cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:19.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.305+0000 7f51e37fe700 1 -- 172.21.15.6:0/3486740036 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f51d4089af0 con 0x7f51d8004850 2023-07-06T20:00:19.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.305+0000 7f51ea59c700 1 --2- 172.21.15.6:0/3486740036 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f51cc06ace0 0x7f51cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:19.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.305+0000 7f51ea59c700 1 --2- 172.21.15.6:0/3486740036 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f51cc06ace0 0x7f51cc06d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0090b0 tx=0x7f51dc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:19.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.309+0000 7f51e37fe700 1 -- 172.21.15.6:0/3486740036 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f51d4054a50 con 0x7f51d8004850 2023-07-06T20:00:19.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.511+0000 7f51f11a0700 1 -- 172.21.15.6:0/3486740036 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51ec0b5920 con 0x7f51d8004850 2023-07-06T20:00:19.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.512+0000 7f51e37fe700 1 -- 172.21.15.6:0/3486740036 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18357 (secure 0 0 0) 0x7f51d4058070 con 0x7f51d8004850 2023-07-06T20:00:19.515 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:19.515 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":40,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T20:00:18.162763+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-06T20:00:16.527659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-06T20:00:17.129118+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T20:00:19.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.514+0000 7f51f11a0700 1 -- 172.21.15.6:0/3486740036 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f51cc06ace0 msgr2=0x7f51cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:19.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.514+0000 7f51f11a0700 1 --2- 172.21.15.6:0/3486740036 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f51cc06ace0 0x7f51cc06d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0090b0 tx=0x7f51dc008030 comp rx=0 tx=0).stop 2023-07-06T20:00:19.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.514+0000 7f51f11a0700 1 -- 172.21.15.6:0/3486740036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51d8004850 msgr2=0x7f51ec0b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:19.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.514+0000 7f51f11a0700 1 --2- 172.21.15.6:0/3486740036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51d8004850 0x7f51ec0b4f60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f51d40119a0 tx=0x7f51d4011cb0 comp rx=0 tx=0).stop 2023-07-06T20:00:19.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.514+0000 7f51f11a0700 1 -- 172.21.15.6:0/3486740036 shutdown_connections 2023-07-06T20:00:19.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.514+0000 7f51f11a0700 1 --2- 172.21.15.6:0/3486740036 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f51cc06ace0 0x7f51cc06d190 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:19.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.514+0000 7f51f11a0700 1 --2- 172.21.15.6:0/3486740036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51d8004850 0x7f51ec0b4f60 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:19.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.514+0000 7f51f11a0700 1 --2- 172.21.15.6:0/3486740036 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f51ec0b54a0 0x7f51ec0b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:19.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.514+0000 7f51f11a0700 1 --2- 172.21.15.6:0/3486740036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51ec151310 0x7f51ec0b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:19.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.514+0000 7f51f11a0700 1 -- 172.21.15.6:0/3486740036 >> 172.21.15.6:0/3486740036 conn(0x7f51ec0cc420 msgr2=0x7f51ec0cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:19.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.515+0000 7f51f11a0700 1 -- 172.21.15.6:0/3486740036 shutdown_connections 2023-07-06T20:00:19.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.515+0000 7f51f11a0700 1 -- 172.21.15.6:0/3486740036 wait complete. 2023-07-06T20:00:19.529 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-06T20:00:19.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.657+0000 7fd0d5333700 1 Processor -- start 2023-07-06T20:00:19.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.657+0000 7fd0d5333700 1 -- start start 2023-07-06T20:00:19.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.658+0000 7fd0d5333700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0d00b1f10 0x7fd0d00cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:19.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.658+0000 7fd0d5333700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd0d006c4c0 0x7fd0d00d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:19.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.658+0000 7fd0d5333700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d015d480 con 0x7fd0d0160e00 2023-07-06T20:00:19.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.658+0000 7fd0d5333700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d015cc60 con 0x7fd0d006c4c0 2023-07-06T20:00:19.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.658+0000 7fd0d5333700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d015ce70 con 0x7fd0d00b1f10 2023-07-06T20:00:19.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.658+0000 7fd0ceffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0d00b1f10 0x7fd0d00cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:19.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.658+0000 7fd0cf7fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd0d006c4c0 0x7fd0d00d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:19.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.658+0000 7fd0ceffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0d00b1f10 0x7fd0d00cd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:53686/0 (socket says 172.21.15.6:53686) 2023-07-06T20:00:19.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.658+0000 7fd0ceffd700 1 -- 172.21.15.6:0/2902916075 learned_addr learned my addr 172.21.15.6:0/2902916075 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:19.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.659+0000 7fd0ceffd700 1 -- 172.21.15.6:0/2902916075 >> v2:172.21.15.40:3300/0 conn(0x7fd0d006c4c0 msgr2=0x7fd0d00d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:19.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.659+0000 7fd0ceffd700 1 --2- 172.21.15.6:0/2902916075 >> v2:172.21.15.40:3300/0 conn(0x7fd0d006c4c0 0x7fd0d00d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:19.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.659+0000 7fd0ceffd700 1 -- 172.21.15.6:0/2902916075 >> v1:172.21.15.40:6789/0 conn(0x7fd0d0160e00 legacy=0x7fd0d006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:19.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.659+0000 7fd0ceffd700 1 -- 172.21.15.6:0/2902916075 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d00cddd0 con 0x7fd0d00b1f10 2023-07-06T20:00:19.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.659+0000 7fd0ceffd700 1 --2- 172.21.15.6:0/2902916075 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0d00b1f10 0x7fd0d00cd2c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd0c40098f0 tx=0x7fd0c4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a359922e0db4800b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:19.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.659+0000 7fd0cdffb700 1 -- 172.21.15.6:0/2902916075 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4011830 con 0x7fd0d00b1f10 2023-07-06T20:00:19.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.659+0000 7fd0cdffb700 1 -- 172.21.15.6:0/2902916075 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c4011990 con 0x7fd0d00b1f10 2023-07-06T20:00:19.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.659+0000 7fd0cdffb700 1 -- 172.21.15.6:0/2902916075 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4011d20 con 0x7fd0d00b1f10 2023-07-06T20:00:19.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.660+0000 7fd0d5333700 1 -- 172.21.15.6:0/2902916075 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0d00b1f10 msgr2=0x7fd0d00cd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:19.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.660+0000 7fd0d5333700 1 --2- 172.21.15.6:0/2902916075 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0d00b1f10 0x7fd0d00cd2c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd0c40098f0 tx=0x7fd0c4009c00 comp rx=0 tx=0).stop 2023-07-06T20:00:19.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.660+0000 7fd0d5333700 1 -- 172.21.15.6:0/2902916075 shutdown_connections 2023-07-06T20:00:19.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.660+0000 7fd0d5333700 1 --2- 172.21.15.6:0/2902916075 >> v2:172.21.15.40:3300/0 conn(0x7fd0d006c4c0 0x7fd0d00d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:19.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.660+0000 7fd0d5333700 1 --2- 172.21.15.6:0/2902916075 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0d00b1f10 0x7fd0d00cd2c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:19.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.660+0000 7fd0d5333700 1 -- 172.21.15.6:0/2902916075 >> 172.21.15.6:0/2902916075 conn(0x7fd0d00d2c70 msgr2=0x7fd0d00d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:19.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.660+0000 7fd0d5333700 1 -- 172.21.15.6:0/2902916075 shutdown_connections 2023-07-06T20:00:19.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.660+0000 7fd0d5333700 1 -- 172.21.15.6:0/2902916075 wait complete. 2023-07-06T20:00:19.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.661+0000 7fd0d5333700 1 Processor -- start 2023-07-06T20:00:19.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.661+0000 7fd0d5333700 1 -- start start 2023-07-06T20:00:19.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.662+0000 7fd0d5333700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0d006c4c0 0x7fd0d01577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:19.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.662+0000 7fd0d5333700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0d00b1f10 0x7fd0d01e7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:19.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.662+0000 7fd0d5333700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0d0160e00 0x7fd0d015ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:19.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.662+0000 7fd0d5333700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00b5e80 con 0x7fd0d0160e00 2023-07-06T20:00:19.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.662+0000 7fd0d5333700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00b6160 con 0x7fd0d00b1f10 2023-07-06T20:00:19.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.662+0000 7fd0d5333700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00b6440 con 0x7fd0d006c4c0 2023-07-06T20:00:19.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.662+0000 7fd0cf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0d0160e00 0x7fd0d015ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:19.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.662+0000 7fd0ceffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0d006c4c0 0x7fd0d01577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:19.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.662+0000 7fd0cf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0d0160e00 0x7fd0d015ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32820/0 (socket says 172.21.15.6:32820) 2023-07-06T20:00:19.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.662+0000 7fd0ceffd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0d006c4c0 0x7fd0d01577e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:53692/0 (socket says 172.21.15.6:53692) 2023-07-06T20:00:19.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.662+0000 7fd0cf7fe700 1 -- 172.21.15.6:0/3434820679 learned_addr learned my addr 172.21.15.6:0/3434820679 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:19.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.662+0000 7fd0ce7fc700 1 --2- 172.21.15.6:0/3434820679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0d00b1f10 0x7fd0d01e7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:19.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.662+0000 7fd0cf7fe700 1 -- 172.21.15.6:0/3434820679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0d006c4c0 msgr2=0x7fd0d01577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:19.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.662+0000 7fd0cf7fe700 1 --2- 172.21.15.6:0/3434820679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0d006c4c0 0x7fd0d01577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:19.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.662+0000 7fd0cf7fe700 1 -- 172.21.15.6:0/3434820679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0d00b1f10 msgr2=0x7fd0d01e7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:19.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.662+0000 7fd0cf7fe700 1 --2- 172.21.15.6:0/3434820679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0d00b1f10 0x7fd0d01e7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:19.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.662+0000 7fd0cf7fe700 1 -- 172.21.15.6:0/3434820679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c4009550 con 0x7fd0d0160e00 2023-07-06T20:00:19.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.662+0000 7fd0cf7fe700 1 --2- 172.21.15.6:0/3434820679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0d0160e00 0x7fd0d015ef30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd0c800efc0 tx=0x7fd0c800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:19.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.663+0000 7fd0b77fe700 1 -- 172.21.15.6:0/3434820679 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c800cc90 con 0x7fd0d0160e00 2023-07-06T20:00:19.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.663+0000 7fd0b77fe700 1 -- 172.21.15.6:0/3434820679 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c800f040 con 0x7fd0d0160e00 2023-07-06T20:00:19.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.663+0000 7fd0d5333700 1 -- 172.21.15.6:0/3434820679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d00b6720 con 0x7fd0d0160e00 2023-07-06T20:00:19.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.663+0000 7fd0b77fe700 1 -- 172.21.15.6:0/3434820679 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c80146c0 con 0x7fd0d0160e00 2023-07-06T20:00:19.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.663+0000 7fd0d5333700 1 -- 172.21.15.6:0/3434820679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d0157d20 con 0x7fd0d0160e00 2023-07-06T20:00:19.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.664+0000 7fd0d5333700 1 -- 172.21.15.6:0/3434820679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d004eb90 con 0x7fd0d0160e00 2023-07-06T20:00:19.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.664+0000 7fd0b77fe700 1 -- 172.21.15.6:0/3434820679 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd0c8014820 con 0x7fd0d0160e00 2023-07-06T20:00:19.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.664+0000 7fd0b77fe700 1 --2- 172.21.15.6:0/3434820679 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd0bc06ace0 0x7fd0bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:19.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.664+0000 7fd0b77fe700 1 -- 172.21.15.6:0/3434820679 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd0c808a210 con 0x7fd0d0160e00 2023-07-06T20:00:19.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.665+0000 7fd0ceffd700 1 --2- 172.21.15.6:0/3434820679 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd0bc06ace0 0x7fd0bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:19.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.665+0000 7fd0ceffd700 1 --2- 172.21.15.6:0/3434820679 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd0bc06ace0 0x7fd0bc06d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009c40 tx=0x7fd0c4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:19.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.669+0000 7fd0b77fe700 1 -- 172.21.15.6:0/3434820679 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd0c80550f0 con 0x7fd0d0160e00 2023-07-06T20:00:19.865 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:00:19.867 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:00:19.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:19.925+0000 7fd0d5333700 1 -- 172.21.15.6:0/3434820679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd0d00ce600 con 0x7fd0d0160e00 2023-07-06T20:00:20.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.783+0000 7fd0b77fe700 1 -- 172.21.15.6:0/3434820679 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd0c80180b0 con 0x7fd0d0160e00 2023-07-06T20:00:20.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.786+0000 7fd0d5333700 1 -- 172.21.15.6:0/3434820679 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd0bc06ace0 msgr2=0x7fd0bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:20.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.786+0000 7fd0d5333700 1 --2- 172.21.15.6:0/3434820679 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd0bc06ace0 0x7fd0bc06d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4009c40 tx=0x7fd0c4008030 comp rx=0 tx=0).stop 2023-07-06T20:00:20.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.786+0000 7fd0d5333700 1 -- 172.21.15.6:0/3434820679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0d0160e00 msgr2=0x7fd0d015ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:20.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.786+0000 7fd0d5333700 1 --2- 172.21.15.6:0/3434820679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0d0160e00 0x7fd0d015ef30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd0c800efc0 tx=0x7fd0c800c3a0 comp rx=0 tx=0).stop 2023-07-06T20:00:20.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.786+0000 7fd0d5333700 1 -- 172.21.15.6:0/3434820679 shutdown_connections 2023-07-06T20:00:20.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.786+0000 7fd0d5333700 1 --2- 172.21.15.6:0/3434820679 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd0bc06ace0 0x7fd0bc06d190 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:20.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.786+0000 7fd0d5333700 1 --2- 172.21.15.6:0/3434820679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0d0160e00 0x7fd0d015ef30 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:20.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.786+0000 7fd0d5333700 1 --2- 172.21.15.6:0/3434820679 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd0d006c4c0 0x7fd0d01577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:20.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.786+0000 7fd0d5333700 1 --2- 172.21.15.6:0/3434820679 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0d00b1f10 0x7fd0d01e7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:20.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.786+0000 7fd0d5333700 1 -- 172.21.15.6:0/3434820679 >> 172.21.15.6:0/3434820679 conn(0x7fd0d00d2c70 msgr2=0x7fd0d015ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:20.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.786+0000 7fd0d5333700 1 -- 172.21.15.6:0/3434820679 shutdown_connections 2023-07-06T20:00:20.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.786+0000 7fd0d5333700 1 -- 172.21.15.6:0/3434820679 wait complete. 2023-07-06T20:00:20.803 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-06T20:00:20.804 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-06T20:00:20.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.980+0000 7f4f452ff700 1 Processor -- start 2023-07-06T20:00:20.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.980+0000 7f4f452ff700 1 -- start start 2023-07-06T20:00:20.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.981+0000 7f4f452ff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4f400b1f10 0x7f4f400cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:20.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.981+0000 7f4f452ff700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4015d480 con 0x7f4f4006c4c0 2023-07-06T20:00:20.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.981+0000 7f4f452ff700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4015ce70 con 0x7f4f40160e00 2023-07-06T20:00:20.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.981+0000 7f4f452ff700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f4015cc60 con 0x7f4f400b1f10 2023-07-06T20:00:20.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.981+0000 7f4f3f7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f4f4006c4c0 0x7f4f400d0c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34036/0 (socket says 172.21.15.6:34036) 2023-07-06T20:00:20.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.981+0000 7f4f3f7fe700 1 -- 172.21.15.6:0/2536979026 learned_addr learned my addr 172.21.15.6:0/2536979026 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:20.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.981+0000 7f4f3dffb700 1 -- 172.21.15.6:0/2536979026 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856712415 0 0) 0x7f4f4015d480 con 0x7f4f4006c4c0 2023-07-06T20:00:20.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.981+0000 7f4f3dffb700 1 -- 172.21.15.6:0/2536979026 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f280035b0 con 0x7f4f4006c4c0 2023-07-06T20:00:20.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.981+0000 7f4f3effd700 1 --2- 172.21.15.6:0/2536979026 >> v2:172.21.15.40:3300/0 conn(0x7f4f400b1f10 0x7f4f400cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:20.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.981+0000 7f4f3dffb700 1 -- 172.21.15.6:0/2536979026 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 596879133 0 0) 0x7f4f280035b0 con 0x7f4f4006c4c0 2023-07-06T20:00:20.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.981+0000 7f4f3dffb700 1 -- 172.21.15.6:0/2536979026 >> v2:172.21.15.40:3300/0 conn(0x7f4f400b1f10 msgr2=0x7f4f400cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:20.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.981+0000 7f4f3dffb700 1 --2- 172.21.15.6:0/2536979026 >> v2:172.21.15.40:3300/0 conn(0x7f4f400b1f10 0x7f4f400cd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:20.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.981+0000 7f4f3dffb700 1 -- 172.21.15.6:0/2536979026 >> v1:172.21.15.40:6789/0 conn(0x7f4f40160e00 legacy=0x7f4f4006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:20.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.982+0000 7f4f3dffb700 1 -- 172.21.15.6:0/2536979026 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f400cddd0 con 0x7f4f4006c4c0 2023-07-06T20:00:20.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.982+0000 7f4f3dffb700 1 -- 172.21.15.6:0/2536979026 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f4f380019f0 con 0x7f4f4006c4c0 2023-07-06T20:00:20.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.982+0000 7f4f3dffb700 1 -- 172.21.15.6:0/2536979026 >> v1:172.21.15.6:6789/0 conn(0x7f4f4006c4c0 legacy=0x7f4f400d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:20.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.982+0000 7f4f3dffb700 1 --2- 172.21.15.6:0/2536979026 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f28003a00 0x7f4f28003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:20.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.982+0000 7f4f3dffb700 1 --2- 172.21.15.6:0/2536979026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f280043f0 0x7f4f280048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:20.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.982+0000 7f4f3dffb700 1 --2- 172.21.15.6:0/2536979026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f280050b0 0x7f4f2800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:20.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.982+0000 7f4f3dffb700 1 -- 172.21.15.6:0/2536979026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4015cc60 con 0x7f4f280050b0 2023-07-06T20:00:20.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.982+0000 7f4f3dffb700 1 -- 172.21.15.6:0/2536979026 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2800c000 con 0x7f4f280043f0 2023-07-06T20:00:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.982+0000 7f4f3dffb700 1 -- 172.21.15.6:0/2536979026 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2800c1c0 con 0x7f4f28003a00 2023-07-06T20:00:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.982+0000 7f4f3f7fe700 1 --2- 172.21.15.6:0/2536979026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f280050b0 0x7f4f2800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.982+0000 7f4f3effd700 1 --2- 172.21.15.6:0/2536979026 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f28003a00 0x7f4f28003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.982+0000 7f4f3e7fc700 1 --2- 172.21.15.6:0/2536979026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f280043f0 0x7f4f280048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.982+0000 7f4f3f7fe700 1 -- 172.21.15.6:0/2536979026 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f28003a00 msgr2=0x7f4f28003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:20.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.982+0000 7f4f3f7fe700 1 --2- 172.21.15.6:0/2536979026 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f28003a00 0x7f4f28003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:20.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.982+0000 7f4f3f7fe700 1 -- 172.21.15.6:0/2536979026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f280043f0 msgr2=0x7f4f280048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:20.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.982+0000 7f4f3f7fe700 1 --2- 172.21.15.6:0/2536979026 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f280043f0 0x7f4f280048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:20.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.982+0000 7f4f3f7fe700 1 -- 172.21.15.6:0/2536979026 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f280035b0 con 0x7f4f280050b0 2023-07-06T20:00:20.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.982+0000 7f4f3f7fe700 1 -- 172.21.15.6:0/2536979026 reap_dead start 2023-07-06T20:00:20.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.982+0000 7f4f3f7fe700 1 --2- 172.21.15.6:0/2536979026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f280050b0 0x7f4f2800ba10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4f3800ab00 tx=0x7f4f28005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894799ef527a2471 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:20.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.983+0000 7f4f3dffb700 1 -- 172.21.15.6:0/2536979026 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3800a570 con 0x7f4f280050b0 2023-07-06T20:00:20.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.983+0000 7f4f3dffb700 1 -- 172.21.15.6:0/2536979026 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3800c890 con 0x7f4f280050b0 2023-07-06T20:00:20.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.983+0000 7f4f3dffb700 1 -- 172.21.15.6:0/2536979026 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3800cc40 con 0x7f4f280050b0 2023-07-06T20:00:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.983+0000 7f4f452ff700 1 -- 172.21.15.6:0/2536979026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f280050b0 msgr2=0x7f4f2800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:20.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.983+0000 7f4f452ff700 1 --2- 172.21.15.6:0/2536979026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f280050b0 0x7f4f2800ba10 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4f3800ab00 tx=0x7f4f28005880 comp rx=0 tx=0).stop 2023-07-06T20:00:20.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.983+0000 7f4f452ff700 1 -- 172.21.15.6:0/2536979026 shutdown_connections 2023-07-06T20:00:20.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.983+0000 7f4f452ff700 1 --2- 172.21.15.6:0/2536979026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f280050b0 0x7f4f2800ba10 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:20.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.983+0000 7f4f452ff700 1 -- 172.21.15.6:0/2536979026 >> 172.21.15.6:0/2536979026 conn(0x7f4f400d2c70 msgr2=0x7f4f400d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:20.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.983+0000 7f4f452ff700 1 -- 172.21.15.6:0/2536979026 shutdown_connections 2023-07-06T20:00:20.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.983+0000 7f4f452ff700 1 -- 172.21.15.6:0/2536979026 wait complete. 2023-07-06T20:00:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.985+0000 7f4f452ff700 1 Processor -- start 2023-07-06T20:00:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.985+0000 7f4f452ff700 1 -- start start 2023-07-06T20:00:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.985+0000 7f4f452ff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f280050b0 0x7f4f400b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.985+0000 7f4f452ff700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f400c93b0 0x7f4f400ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.985+0000 7f4f452ff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f40159c90 0x7f4f40159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.985+0000 7f4f452ff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4015a530 con 0x7f4f40159c90 2023-07-06T20:00:20.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.985+0000 7f4f452ff700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f400b3180 con 0x7f4f400c93b0 2023-07-06T20:00:20.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.985+0000 7f4f452ff700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f400c8930 con 0x7f4f280050b0 2023-07-06T20:00:20.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.986+0000 7f4f3f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f40159c90 0x7f4f40159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:20.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.986+0000 7f4f3f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f40159c90 0x7f4f40159030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32840/0 (socket says 172.21.15.6:32840) 2023-07-06T20:00:20.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.986+0000 7f4f3f7fe700 1 -- 172.21.15.6:0/1785763518 learned_addr learned my addr 172.21.15.6:0/1785763518 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:20.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.986+0000 7f4f3effd700 1 --2- 172.21.15.6:0/1785763518 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f280050b0 0x7f4f400b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:20.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.986+0000 7f4f3f7fe700 1 -- 172.21.15.6:0/1785763518 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f280050b0 msgr2=0x7f4f400b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:20.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.986+0000 7f4f3e7fc700 1 --2- 172.21.15.6:0/1785763518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f400c93b0 0x7f4f400ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:20.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.986+0000 7f4f3f7fe700 1 --2- 172.21.15.6:0/1785763518 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f280050b0 0x7f4f400b27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:20.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.986+0000 7f4f3f7fe700 1 -- 172.21.15.6:0/1785763518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f400c93b0 msgr2=0x7f4f400ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:20.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.986+0000 7f4f3f7fe700 1 --2- 172.21.15.6:0/1785763518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f400c93b0 0x7f4f400ca6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:20.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.986+0000 7f4f3f7fe700 1 -- 172.21.15.6:0/1785763518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f400b2ea0 con 0x7f4f40159c90 2023-07-06T20:00:20.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.986+0000 7f4f3f7fe700 1 --2- 172.21.15.6:0/1785763518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f40159c90 0x7f4f40159030 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4f4006c890 tx=0x7f4f38001f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:20.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.986+0000 7f4f277fe700 1 -- 172.21.15.6:0/1785763518 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f38023070 con 0x7f4f40159c90 2023-07-06T20:00:20.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.986+0000 7f4f277fe700 1 -- 172.21.15.6:0/1785763518 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f38001a00 con 0x7f4f40159c90 2023-07-06T20:00:20.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.986+0000 7f4f452ff700 1 -- 172.21.15.6:0/1785763518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f400c8bd0 con 0x7f4f40159c90 2023-07-06T20:00:20.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.986+0000 7f4f277fe700 1 -- 172.21.15.6:0/1785763518 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3801c410 con 0x7f4f40159c90 2023-07-06T20:00:21.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.986+0000 7f4f452ff700 1 -- 172.21.15.6:0/1785763518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f400cabe0 con 0x7f4f40159c90 2023-07-06T20:00:21.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.987+0000 7f4f452ff700 1 -- 172.21.15.6:0/1785763518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f400c9220 con 0x7f4f40159c90 2023-07-06T20:00:21.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.988+0000 7f4f277fe700 1 -- 172.21.15.6:0/1785763518 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f3801c570 con 0x7f4f40159c90 2023-07-06T20:00:21.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.988+0000 7f4f277fe700 1 --2- 172.21.15.6:0/1785763518 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4f2c06ace0 0x7f4f2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:21.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.988+0000 7f4f277fe700 1 -- 172.21.15.6:0/1785763518 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4f3808afa0 con 0x7f4f40159c90 2023-07-06T20:00:21.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.988+0000 7f4f3effd700 1 --2- 172.21.15.6:0/1785763518 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4f2c06ace0 0x7f4f2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:21.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.989+0000 7f4f3effd700 1 --2- 172.21.15.6:0/1785763518 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4f2c06ace0 0x7f4f2c06d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4f34009a20 tx=0x7f4f34008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:21.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:20.993+0000 7f4f277fe700 1 -- 172.21.15.6:0/1785763518 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4f38055fa0 con 0x7f4f40159c90 2023-07-06T20:00:21.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.236+0000 7f4f452ff700 1 -- 172.21.15.6:0/1785763518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4f4004eb90 con 0x7f4f40159c90 2023-07-06T20:00:21.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.787+0000 7f4f277fe700 1 -- 172.21.15.6:0/1785763518 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4f380595c0 con 0x7f4f40159c90 2023-07-06T20:00:21.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.790+0000 7f4f452ff700 1 -- 172.21.15.6:0/1785763518 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4f2c06ace0 msgr2=0x7f4f2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:21.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.790+0000 7f4f452ff700 1 --2- 172.21.15.6:0/1785763518 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4f2c06ace0 0x7f4f2c06d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4f34009a20 tx=0x7f4f34008040 comp rx=0 tx=0).stop 2023-07-06T20:00:21.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.790+0000 7f4f452ff700 1 -- 172.21.15.6:0/1785763518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f40159c90 msgr2=0x7f4f40159030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:21.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.790+0000 7f4f452ff700 1 --2- 172.21.15.6:0/1785763518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f40159c90 0x7f4f40159030 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4f4006c890 tx=0x7f4f38001f70 comp rx=0 tx=0).stop 2023-07-06T20:00:21.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.790+0000 7f4f452ff700 1 -- 172.21.15.6:0/1785763518 shutdown_connections 2023-07-06T20:00:21.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.790+0000 7f4f452ff700 1 --2- 172.21.15.6:0/1785763518 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f4f2c06ace0 0x7f4f2c06d190 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:21.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.790+0000 7f4f452ff700 1 --2- 172.21.15.6:0/1785763518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f40159c90 0x7f4f40159030 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:21.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.790+0000 7f4f452ff700 1 --2- 172.21.15.6:0/1785763518 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f4f280050b0 0x7f4f400b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:21.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.790+0000 7f4f452ff700 1 --2- 172.21.15.6:0/1785763518 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4f400c93b0 0x7f4f400ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:21.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.790+0000 7f4f452ff700 1 -- 172.21.15.6:0/1785763518 >> 172.21.15.6:0/1785763518 conn(0x7f4f400d2c70 msgr2=0x7f4f400d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:21.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.790+0000 7f4f452ff700 1 -- 172.21.15.6:0/1785763518 shutdown_connections 2023-07-06T20:00:21.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.790+0000 7f4f452ff700 1 -- 172.21.15.6:0/1785763518 wait complete. 2023-07-06T20:00:21.808 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-06T20:00:21.808 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T20:00:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.946+0000 7f0e7e55e700 1 Processor -- start 2023-07-06T20:00:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.946+0000 7f0e7e55e700 1 -- start start 2023-07-06T20:00:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.946+0000 7f0e7e55e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0e780ceab0 0x7f0e780caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.946+0000 7f0e7e55e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0e78071dd0 0x7f0e781602c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.946+0000 7f0e7e55e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e78160ff0 con 0x7f0e780cee80 2023-07-06T20:00:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.946+0000 7f0e7e55e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e780cb400 con 0x7f0e78071dd0 2023-07-06T20:00:21.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.946+0000 7f0e7e55e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e780ca100 con 0x7f0e780ceab0 2023-07-06T20:00:21.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.947+0000 7f0e7cafb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0e78071dd0 0x7f0e781602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:21.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.947+0000 7f0e7cafb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0e78071dd0 0x7f0e781602c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32846/0 (socket says 172.21.15.6:32846) 2023-07-06T20:00:21.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.947+0000 7f0e7cafb700 1 -- 172.21.15.6:0/1116050044 learned_addr learned my addr 172.21.15.6:0/1116050044 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:21.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.947+0000 7f0e77fff700 1 --2- 172.21.15.6:0/1116050044 >> v2:172.21.15.40:3300/0 conn(0x7f0e780ceab0 0x7f0e780caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:21.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.947+0000 7f0e7cafb700 1 -- 172.21.15.6:0/1116050044 >> v2:172.21.15.40:3300/0 conn(0x7f0e780ceab0 msgr2=0x7f0e780caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:21.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.947+0000 7f0e7cafb700 1 --2- 172.21.15.6:0/1116050044 >> v2:172.21.15.40:3300/0 conn(0x7f0e780ceab0 0x7f0e780caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:21.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.947+0000 7f0e7cafb700 1 -- 172.21.15.6:0/1116050044 >> v1:172.21.15.40:6789/0 conn(0x7f0e780cee80 legacy=0x7f0e780716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:21.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.947+0000 7f0e7cafb700 1 -- 172.21.15.6:0/1116050044 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e780ca3e0 con 0x7f0e78071dd0 2023-07-06T20:00:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.947+0000 7f0e7cafb700 1 --2- 172.21.15.6:0/1116050044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e78071dd0 0x7f0e781602c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0e780731c0 tx=0x7f0e7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61098427eb9c8d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.947+0000 7f0e76ffd700 1 -- 172.21.15.6:0/1116050044 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7000e070 con 0x7f0e78071dd0 2023-07-06T20:00:21.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.947+0000 7f0e76ffd700 1 -- 172.21.15.6:0/1116050044 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e70003a20 con 0x7f0e78071dd0 2023-07-06T20:00:21.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.947+0000 7f0e76ffd700 1 -- 172.21.15.6:0/1116050044 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70003dd0 con 0x7f0e78071dd0 2023-07-06T20:00:21.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.948+0000 7f0e7e55e700 1 -- 172.21.15.6:0/1116050044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e78071dd0 msgr2=0x7f0e781602c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:21.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.948+0000 7f0e7e55e700 1 --2- 172.21.15.6:0/1116050044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e78071dd0 0x7f0e781602c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f0e780731c0 tx=0x7f0e7000b330 comp rx=0 tx=0).stop 2023-07-06T20:00:21.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.948+0000 7f0e7e55e700 1 -- 172.21.15.6:0/1116050044 shutdown_connections 2023-07-06T20:00:21.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.948+0000 7f0e7e55e700 1 --2- 172.21.15.6:0/1116050044 >> v2:172.21.15.40:3300/0 conn(0x7f0e780ceab0 0x7f0e780caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:21.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.948+0000 7f0e7e55e700 1 --2- 172.21.15.6:0/1116050044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e78071dd0 0x7f0e781602c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:21.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.948+0000 7f0e7e55e700 1 -- 172.21.15.6:0/1116050044 >> 172.21.15.6:0/1116050044 conn(0x7f0e780cc420 msgr2=0x7f0e780cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:21.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.948+0000 7f0e7e55e700 1 -- 172.21.15.6:0/1116050044 shutdown_connections 2023-07-06T20:00:21.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.948+0000 7f0e7e55e700 1 -- 172.21.15.6:0/1116050044 wait complete. 2023-07-06T20:00:21.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.950+0000 7f0e7e55e700 1 Processor -- start 2023-07-06T20:00:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.950+0000 7f0e7e55e700 1 -- start start 2023-07-06T20:00:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.951+0000 7f0e7e55e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e78071dd0 0x7f0e781f1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.951+0000 7f0e7e55e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e780ceab0 0x7f0e78154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.951+0000 7f0e7e55e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e780cee80 0x7f0e78155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:21.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.951+0000 7f0e7e55e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e781f1c70 con 0x7f0e780cee80 2023-07-06T20:00:21.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.951+0000 7f0e7e55e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e780cdf90 con 0x7f0e780ceab0 2023-07-06T20:00:21.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.951+0000 7f0e7e55e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e780ce270 con 0x7f0e78071dd0 2023-07-06T20:00:21.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.951+0000 7f0e7cafb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e780cee80 0x7f0e78155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:21.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.951+0000 7f0e7cafb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e780cee80 0x7f0e78155130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32852/0 (socket says 172.21.15.6:32852) 2023-07-06T20:00:21.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.951+0000 7f0e7cafb700 1 -- 172.21.15.6:0/3374105624 learned_addr learned my addr 172.21.15.6:0/3374105624 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:21.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.951+0000 7f0e77fff700 1 --2- 172.21.15.6:0/3374105624 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e78071dd0 0x7f0e781f1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:21.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.951+0000 7f0e777fe700 1 --2- 172.21.15.6:0/3374105624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e780ceab0 0x7f0e78154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:21.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.951+0000 7f0e7cafb700 1 -- 172.21.15.6:0/3374105624 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e78071dd0 msgr2=0x7f0e781f1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:21.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.951+0000 7f0e7cafb700 1 --2- 172.21.15.6:0/3374105624 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e78071dd0 0x7f0e781f1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:21.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.951+0000 7f0e7cafb700 1 -- 172.21.15.6:0/3374105624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e780ceab0 msgr2=0x7f0e78154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:21.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.951+0000 7f0e7cafb700 1 --2- 172.21.15.6:0/3374105624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e780ceab0 0x7f0e78154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:21.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.951+0000 7f0e7cafb700 1 -- 172.21.15.6:0/3374105624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e70009b30 con 0x7f0e780cee80 2023-07-06T20:00:21.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.951+0000 7f0e7cafb700 1 --2- 172.21.15.6:0/3374105624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e780cee80 0x7f0e78155130 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0e70015040 tx=0x7f0e70004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:21.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.951+0000 7f0e74ff9700 1 -- 172.21.15.6:0/3374105624 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70004440 con 0x7f0e780cee80 2023-07-06T20:00:21.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.952+0000 7f0e74ff9700 1 -- 172.21.15.6:0/3374105624 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e700045c0 con 0x7f0e780cee80 2023-07-06T20:00:21.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.952+0000 7f0e74ff9700 1 -- 172.21.15.6:0/3374105624 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70004970 con 0x7f0e780cee80 2023-07-06T20:00:21.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.952+0000 7f0e7e55e700 1 -- 172.21.15.6:0/3374105624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e780c6a70 con 0x7f0e780cee80 2023-07-06T20:00:21.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.952+0000 7f0e7e55e700 1 -- 172.21.15.6:0/3374105624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e780c7030 con 0x7f0e780cee80 2023-07-06T20:00:21.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.952+0000 7f0e7e55e700 1 -- 172.21.15.6:0/3374105624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e78074200 con 0x7f0e780cee80 2023-07-06T20:00:21.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.953+0000 7f0e74ff9700 1 -- 172.21.15.6:0/3374105624 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0e70012430 con 0x7f0e780cee80 2023-07-06T20:00:21.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.953+0000 7f0e74ff9700 1 --2- 172.21.15.6:0/3374105624 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0e6406ace0 0x7f0e6406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:21.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.954+0000 7f0e74ff9700 1 -- 172.21.15.6:0/3374105624 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0e7008aac0 con 0x7f0e780cee80 2023-07-06T20:00:21.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.954+0000 7f0e77fff700 1 --2- 172.21.15.6:0/3374105624 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0e6406ace0 0x7f0e6406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:21.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.954+0000 7f0e77fff700 1 --2- 172.21.15.6:0/3374105624 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0e6406ace0 0x7f0e6406d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0e6800ab60 tx=0x7f0e68008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:21.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:21.958+0000 7f0e74ff9700 1 -- 172.21.15.6:0/3374105624 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0e70059430 con 0x7f0e780cee80 2023-07-06T20:00:22.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.199+0000 7f0e7e55e700 1 -- 172.21.15.6:0/3374105624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e780b5920 con 0x7f0e780cee80 2023-07-06T20:00:22.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.200+0000 7f0e74ff9700 1 -- 172.21.15.6:0/3374105624 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4662 (secure 0 0 0) 0x7f0e70007310 con 0x7f0e780cee80 2023-07-06T20:00:22.202 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:22.202 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/554562026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":554562026},{"type":"v1","addr":"172.21.15.40:6834","nonce":554562026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5379,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1231939681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1231939681},{"type":"v1","addr":"172.21.15.6:6835","nonce":1231939681}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5382,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2836488850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":2836488850},{"type":"v1","addr":"172.21.15.6:6837","nonce":2836488850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T20:00:18.163079+0000","modified":"2023-07-06T20:00:21.782010+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5397},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5397":{"gid":5397,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.40:6835/2106779005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":2106779005},{"type":"v1","addr":"172.21.15.40:6835","nonce":2106779005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-06T20:00:22.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.202+0000 7f0e7e55e700 1 -- 172.21.15.6:0/3374105624 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0e6406ace0 msgr2=0x7f0e6406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:22.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.202+0000 7f0e7e55e700 1 --2- 172.21.15.6:0/3374105624 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0e6406ace0 0x7f0e6406d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0e6800ab60 tx=0x7f0e68008040 comp rx=0 tx=0).stop 2023-07-06T20:00:22.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.202+0000 7f0e7e55e700 1 -- 172.21.15.6:0/3374105624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e780cee80 msgr2=0x7f0e78155130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:22.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.202+0000 7f0e7e55e700 1 --2- 172.21.15.6:0/3374105624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e780cee80 0x7f0e78155130 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0e70015040 tx=0x7f0e70004ad0 comp rx=0 tx=0).stop 2023-07-06T20:00:22.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.202+0000 7f0e7e55e700 1 -- 172.21.15.6:0/3374105624 shutdown_connections 2023-07-06T20:00:22.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.202+0000 7f0e7e55e700 1 --2- 172.21.15.6:0/3374105624 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0e6406ace0 0x7f0e6406d190 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:22.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.202+0000 7f0e7e55e700 1 --2- 172.21.15.6:0/3374105624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e780cee80 0x7f0e78155130 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:22.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.202+0000 7f0e7e55e700 1 --2- 172.21.15.6:0/3374105624 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0e78071dd0 0x7f0e781f1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:22.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.202+0000 7f0e7e55e700 1 --2- 172.21.15.6:0/3374105624 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0e780ceab0 0x7f0e78154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:22.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.202+0000 7f0e7e55e700 1 -- 172.21.15.6:0/3374105624 >> 172.21.15.6:0/3374105624 conn(0x7f0e780cc420 msgr2=0x7f0e7806d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:22.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.202+0000 7f0e7e55e700 1 -- 172.21.15.6:0/3374105624 shutdown_connections 2023-07-06T20:00:22.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.202+0000 7f0e7e55e700 1 -- 172.21.15.6:0/3374105624 wait complete. 2023-07-06T20:00:22.207 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 18 2023-07-06T20:00:22.221 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-06T20:00:22.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.344+0000 7fc92019e700 1 Processor -- start 2023-07-06T20:00:22.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.344+0000 7fc92019e700 1 -- start start 2023-07-06T20:00:22.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.345+0000 7fc92019e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc918159040 0x7fc9180cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:22.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.345+0000 7fc92019e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc918071dd0 0x7fc91806c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:22.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.345+0000 7fc92019e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9180cac20 con 0x7fc918159410 2023-07-06T20:00:22.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.345+0000 7fc92019e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91806d490 con 0x7fc918071dd0 2023-07-06T20:00:22.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.345+0000 7fc92019e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91806ced0 con 0x7fc918159040 2023-07-06T20:00:22.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.345+0000 7fc91e73b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc918071dd0 0x7fc91806c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:22.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.345+0000 7fc91d739700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc918159410 0x7fc9180716c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34066/0 (socket says 172.21.15.6:34066) 2023-07-06T20:00:22.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.345+0000 7fc91d739700 1 -- 172.21.15.6:0/2537532417 learned_addr learned my addr 172.21.15.6:0/2537532417 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:22.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.345+0000 7fc91e73b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc918071dd0 0x7fc91806c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32860/0 (socket says 172.21.15.6:32860) 2023-07-06T20:00:22.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.345+0000 7fc91df3a700 1 --2- 172.21.15.6:0/2537532417 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc918159040 0x7fc9180cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:22.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.345+0000 7fc91e73b700 1 -- 172.21.15.6:0/2537532417 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc918159040 msgr2=0x7fc9180cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:22.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.345+0000 7fc91e73b700 1 --2- 172.21.15.6:0/2537532417 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc918159040 0x7fc9180cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:22.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.345+0000 7fc91e73b700 1 -- 172.21.15.6:0/2537532417 >> v1:172.21.15.6:6789/0 conn(0x7fc918159410 legacy=0x7fc9180716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:22.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.345+0000 7fc91cf38700 1 -- 172.21.15.6:0/2537532417 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 560272151 0 0) 0x7fc9180cac20 con 0x7fc918159410 2023-07-06T20:00:22.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.345+0000 7fc91e73b700 1 -- 172.21.15.6:0/2537532417 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91806d1b0 con 0x7fc918071dd0 2023-07-06T20:00:22.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.346+0000 7fc91e73b700 1 --2- 172.21.15.6:0/2537532417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc918071dd0 0x7fc91806c160 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc910009d90 tx=0x7fc91000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db014c28f85d76a server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:22.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.346+0000 7fc91cf38700 1 -- 172.21.15.6:0/2537532417 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91000e070 con 0x7fc918071dd0 2023-07-06T20:00:22.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.346+0000 7fc91cf38700 1 -- 172.21.15.6:0/2537532417 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91000bbd0 con 0x7fc918071dd0 2023-07-06T20:00:22.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.346+0000 7fc91cf38700 1 -- 172.21.15.6:0/2537532417 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc910012430 con 0x7fc918071dd0 2023-07-06T20:00:22.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.346+0000 7fc92019e700 1 -- 172.21.15.6:0/2537532417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc918071dd0 msgr2=0x7fc91806c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:22.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.346+0000 7fc92019e700 1 --2- 172.21.15.6:0/2537532417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc918071dd0 0x7fc91806c160 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fc910009d90 tx=0x7fc91000b330 comp rx=0 tx=0).stop 2023-07-06T20:00:22.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.346+0000 7fc92019e700 1 -- 172.21.15.6:0/2537532417 shutdown_connections 2023-07-06T20:00:22.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.346+0000 7fc92019e700 1 --2- 172.21.15.6:0/2537532417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc918071dd0 0x7fc91806c160 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:22.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.346+0000 7fc92019e700 1 --2- 172.21.15.6:0/2537532417 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc918159040 0x7fc9180cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:22.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.346+0000 7fc92019e700 1 -- 172.21.15.6:0/2537532417 >> 172.21.15.6:0/2537532417 conn(0x7fc9180cc420 msgr2=0x7fc9180cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:22.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.346+0000 7fc92019e700 1 -- 172.21.15.6:0/2537532417 shutdown_connections 2023-07-06T20:00:22.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.346+0000 7fc92019e700 1 -- 172.21.15.6:0/2537532417 wait complete. 2023-07-06T20:00:22.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.348+0000 7fc92019e700 1 Processor -- start 2023-07-06T20:00:22.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.348+0000 7fc92019e700 1 -- start start 2023-07-06T20:00:22.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.348+0000 7fc92019e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc918071dd0 0x7fc9180c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:22.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.348+0000 7fc92019e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc918159040 0x7fc9181478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:22.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.348+0000 7fc92019e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc918159410 0x7fc918155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:22.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.348+0000 7fc92019e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9181482c0 con 0x7fc918159410 2023-07-06T20:00:22.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.348+0000 7fc92019e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc918147e00 con 0x7fc918071dd0 2023-07-06T20:00:22.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.348+0000 7fc92019e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc918155ed0 con 0x7fc918159040 2023-07-06T20:00:22.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.348+0000 7fc91e73b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc918159410 0x7fc918155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:22.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.348+0000 7fc91e73b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc918159410 0x7fc918155030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32866/0 (socket says 172.21.15.6:32866) 2023-07-06T20:00:22.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.348+0000 7fc91e73b700 1 -- 172.21.15.6:0/4282070544 learned_addr learned my addr 172.21.15.6:0/4282070544 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:22.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.349+0000 7fc91e73b700 1 -- 172.21.15.6:0/4282070544 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc918159040 msgr2=0x7fc9181478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:22.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.349+0000 7fc91e73b700 1 --2- 172.21.15.6:0/4282070544 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc918159040 0x7fc9181478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:22.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.349+0000 7fc91e73b700 1 -- 172.21.15.6:0/4282070544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc918071dd0 msgr2=0x7fc9180c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:22.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.349+0000 7fc91df3a700 1 --2- 172.21.15.6:0/4282070544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc918071dd0 0x7fc9180c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:22.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.349+0000 7fc91e73b700 1 --2- 172.21.15.6:0/4282070544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc918071dd0 0x7fc9180c34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:22.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.349+0000 7fc91e73b700 1 -- 172.21.15.6:0/4282070544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc910009a70 con 0x7fc918159410 2023-07-06T20:00:22.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.349+0000 7fc91e73b700 1 --2- 172.21.15.6:0/4282070544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc918159410 0x7fc918155030 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc91806ec50 tx=0x7fc910004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:22.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.349+0000 7fc90e7fc700 1 -- 172.21.15.6:0/4282070544 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc910012430 con 0x7fc918159410 2023-07-06T20:00:22.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.349+0000 7fc90e7fc700 1 -- 172.21.15.6:0/4282070544 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc910020070 con 0x7fc918159410 2023-07-06T20:00:22.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.349+0000 7fc92019e700 1 -- 172.21.15.6:0/4282070544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc918155bf0 con 0x7fc918159410 2023-07-06T20:00:22.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.349+0000 7fc90e7fc700 1 -- 172.21.15.6:0/4282070544 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc910004280 con 0x7fc918159410 2023-07-06T20:00:22.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.349+0000 7fc92019e700 1 -- 172.21.15.6:0/4282070544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9180b2b50 con 0x7fc918159410 2023-07-06T20:00:22.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.350+0000 7fc92019e700 1 -- 172.21.15.6:0/4282070544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc91806bd80 con 0x7fc918159410 2023-07-06T20:00:22.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.351+0000 7fc90e7fc700 1 -- 172.21.15.6:0/4282070544 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc9100043e0 con 0x7fc918159410 2023-07-06T20:00:22.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.351+0000 7fc90e7fc700 1 --2- 172.21.15.6:0/4282070544 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc8fc06ace0 0x7fc8fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:22.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.351+0000 7fc90e7fc700 1 -- 172.21.15.6:0/4282070544 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fc910022070 con 0x7fc918159410 2023-07-06T20:00:22.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.351+0000 7fc91df3a700 1 --2- 172.21.15.6:0/4282070544 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc8fc06ace0 0x7fc8fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:22.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.352+0000 7fc91df3a700 1 --2- 172.21.15.6:0/4282070544 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc8fc06ace0 0x7fc8fc06d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc918152c00 tx=0x7fc908008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:22.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.356+0000 7fc90e7fc700 1 -- 172.21.15.6:0/4282070544 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc9100566f0 con 0x7fc918159410 2023-07-06T20:00:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.556+0000 7fc92019e700 1 -- 172.21.15.6:0/4282070544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9180c3030 con 0x7fc918159410 2023-07-06T20:00:22.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.557+0000 7fc90e7fc700 1 -- 172.21.15.6:0/4282070544 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18344 (secure 0 0 0) 0x7fc910059d10 con 0x7fc918159410 2023-07-06T20:00:22.560 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:22.561 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":41,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T20:00:19.771989+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-06T20:00:16.527659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-06T20:00:17.129118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-06T20:00:22.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.559+0000 7fc92019e700 1 -- 172.21.15.6:0/4282070544 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc8fc06ace0 msgr2=0x7fc8fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:22.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.559+0000 7fc92019e700 1 --2- 172.21.15.6:0/4282070544 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc8fc06ace0 0x7fc8fc06d190 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc918152c00 tx=0x7fc908008040 comp rx=0 tx=0).stop 2023-07-06T20:00:22.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.559+0000 7fc92019e700 1 -- 172.21.15.6:0/4282070544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc918159410 msgr2=0x7fc918155030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:22.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.559+0000 7fc92019e700 1 --2- 172.21.15.6:0/4282070544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc918159410 0x7fc918155030 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc91806ec50 tx=0x7fc910004ad0 comp rx=0 tx=0).stop 2023-07-06T20:00:22.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.559+0000 7fc92019e700 1 -- 172.21.15.6:0/4282070544 shutdown_connections 2023-07-06T20:00:22.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.559+0000 7fc92019e700 1 --2- 172.21.15.6:0/4282070544 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc8fc06ace0 0x7fc8fc06d190 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:22.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.559+0000 7fc92019e700 1 --2- 172.21.15.6:0/4282070544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc918159410 0x7fc918155030 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:22.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.559+0000 7fc92019e700 1 --2- 172.21.15.6:0/4282070544 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc918071dd0 0x7fc9180c34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:22.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.559+0000 7fc92019e700 1 --2- 172.21.15.6:0/4282070544 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc918159040 0x7fc9181478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:22.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.559+0000 7fc92019e700 1 -- 172.21.15.6:0/4282070544 >> 172.21.15.6:0/4282070544 conn(0x7fc9180cc420 msgr2=0x7fc9180cdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:22.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.559+0000 7fc92019e700 1 -- 172.21.15.6:0/4282070544 shutdown_connections 2023-07-06T20:00:22.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.559+0000 7fc92019e700 1 -- 172.21.15.6:0/4282070544 wait complete. 2023-07-06T20:00:22.582 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-06T20:00:22.583 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T20:00:22.584 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-07-06T20:00:22.582+0000 7f3a2494b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-06T20:00:22.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.707+0000 7f203adfd700 1 Processor -- start 2023-07-06T20:00:22.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.707+0000 7f203adfd700 1 -- start start 2023-07-06T20:00:22.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.708+0000 7f203adfd700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f203415c4d0 0x7f20340b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:22.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.708+0000 7f203adfd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20341606e0 0x7f20340cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:22.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.708+0000 7f203adfd700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20340cffe0 con 0x7f20340b3e30 2023-07-06T20:00:22.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.708+0000 7f203adfd700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20340d0470 con 0x7f203415c4d0 2023-07-06T20:00:22.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.708+0000 7f203adfd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203415c8a0 con 0x7f20341606e0 2023-07-06T20:00:22.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.708+0000 7f2033fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f20340b3e30 0x7f203415ffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34080/0 (socket says 172.21.15.6:34080) 2023-07-06T20:00:22.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.708+0000 7f2033fff700 1 -- 172.21.15.6:0/3565582953 learned_addr learned my addr 172.21.15.6:0/3565582953 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:22.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.708+0000 7f203939a700 1 --2- 172.21.15.6:0/3565582953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20341606e0 0x7f20340cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:22.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.708+0000 7f2038b99700 1 --2- 172.21.15.6:0/3565582953 >> v2:172.21.15.40:3300/0 conn(0x7f203415c4d0 0x7f20340b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:22.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.708+0000 7f20337fe700 1 -- 172.21.15.6:0/3565582953 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3274134357 0 0) 0x7f20340cffe0 con 0x7f20340b3e30 2023-07-06T20:00:22.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.708+0000 7f20337fe700 1 -- 172.21.15.6:0/3565582953 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20240035b0 con 0x7f20340b3e30 2023-07-06T20:00:22.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.708+0000 7f203939a700 1 -- 172.21.15.6:0/3565582953 >> v2:172.21.15.40:3300/0 conn(0x7f203415c4d0 msgr2=0x7f20340b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:22.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.708+0000 7f203939a700 1 --2- 172.21.15.6:0/3565582953 >> v2:172.21.15.40:3300/0 conn(0x7f203415c4d0 0x7f20340b38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:22.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.708+0000 7f203939a700 1 -- 172.21.15.6:0/3565582953 >> v1:172.21.15.6:6789/0 conn(0x7f20340b3e30 legacy=0x7f203415ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:22.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.708+0000 7f203939a700 1 -- 172.21.15.6:0/3565582953 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20340cf3d0 con 0x7f20341606e0 2023-07-06T20:00:22.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.709+0000 7f203939a700 1 --2- 172.21.15.6:0/3565582953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20341606e0 0x7f20340cb080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f202c009d90 tx=0x7f202c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89239f985ef983cc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:22.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.709+0000 7f20337fe700 1 -- 172.21.15.6:0/3565582953 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202c00e070 con 0x7f20341606e0 2023-07-06T20:00:22.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.709+0000 7f20337fe700 1 -- 172.21.15.6:0/3565582953 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202c00bb20 con 0x7f20341606e0 2023-07-06T20:00:22.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.709+0000 7f20337fe700 1 -- 172.21.15.6:0/3565582953 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202c00be90 con 0x7f20341606e0 2023-07-06T20:00:22.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.709+0000 7f203adfd700 1 -- 172.21.15.6:0/3565582953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20341606e0 msgr2=0x7f20340cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:22.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.709+0000 7f203adfd700 1 --2- 172.21.15.6:0/3565582953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20341606e0 0x7f20340cb080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f202c009d90 tx=0x7f202c00b330 comp rx=0 tx=0).stop 2023-07-06T20:00:22.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.709+0000 7f203adfd700 1 -- 172.21.15.6:0/3565582953 shutdown_connections 2023-07-06T20:00:22.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.709+0000 7f203adfd700 1 --2- 172.21.15.6:0/3565582953 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20341606e0 0x7f20340cb080 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:22.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.709+0000 7f203adfd700 1 --2- 172.21.15.6:0/3565582953 >> v2:172.21.15.40:3300/0 conn(0x7f203415c4d0 0x7f20340b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:22.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.709+0000 7f203adfd700 1 -- 172.21.15.6:0/3565582953 >> 172.21.15.6:0/3565582953 conn(0x7f20340d0a30 msgr2=0x7f20340d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:22.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.709+0000 7f203adfd700 1 -- 172.21.15.6:0/3565582953 shutdown_connections 2023-07-06T20:00:22.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.709+0000 7f203adfd700 1 -- 172.21.15.6:0/3565582953 wait complete. 2023-07-06T20:00:22.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.710+0000 7f203adfd700 1 Processor -- start 2023-07-06T20:00:22.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.711+0000 7f203adfd700 1 -- start start 2023-07-06T20:00:22.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.711+0000 7f203adfd700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20340b3e30 0x7f203415f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:22.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.711+0000 7f203adfd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f203415c4d0 0x7f2034157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:22.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.711+0000 7f203adfd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20341606e0 0x7f2034158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:22.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.711+0000 7f203adfd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20341f3590 con 0x7f203415c4d0 2023-07-06T20:00:22.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.711+0000 7f203adfd700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20340b31c0 con 0x7f20340b3e30 2023-07-06T20:00:22.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.711+0000 7f203adfd700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20341f28c0 con 0x7f20341606e0 2023-07-06T20:00:22.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.712+0000 7f2033fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f203415c4d0 0x7f2034157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:22.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.712+0000 7f2033fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f203415c4d0 0x7f2034157e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32878/0 (socket says 172.21.15.6:32878) 2023-07-06T20:00:22.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.712+0000 7f2033fff700 1 -- 172.21.15.6:0/3808121583 learned_addr learned my addr 172.21.15.6:0/3808121583 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:22.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.712+0000 7f203939a700 1 --2- 172.21.15.6:0/3808121583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20341606e0 0x7f2034158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:22.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.712+0000 7f2038b99700 1 --2- 172.21.15.6:0/3808121583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20340b3e30 0x7f203415f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:22.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.712+0000 7f2033fff700 1 -- 172.21.15.6:0/3808121583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20341606e0 msgr2=0x7f2034158370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:22.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.712+0000 7f2033fff700 1 --2- 172.21.15.6:0/3808121583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20341606e0 0x7f2034158370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:22.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.712+0000 7f2033fff700 1 -- 172.21.15.6:0/3808121583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20340b3e30 msgr2=0x7f203415f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:22.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.712+0000 7f2033fff700 1 --2- 172.21.15.6:0/3808121583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20340b3e30 0x7f203415f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:22.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.712+0000 7f2033fff700 1 -- 172.21.15.6:0/3808121583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c009a70 con 0x7f203415c4d0 2023-07-06T20:00:22.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.712+0000 7f203939a700 1 --2- 172.21.15.6:0/3808121583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20341606e0 0x7f2034158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:22.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.712+0000 7f2033fff700 1 --2- 172.21.15.6:0/3808121583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f203415c4d0 0x7f2034157e30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f202000c4d0 tx=0x7f202000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:22.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.712+0000 7f20317fa700 1 -- 172.21.15.6:0/3808121583 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2020005d70 con 0x7f203415c4d0 2023-07-06T20:00:22.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.712+0000 7f20317fa700 1 -- 172.21.15.6:0/3808121583 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20200070d0 con 0x7f203415c4d0 2023-07-06T20:00:22.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.712+0000 7f203adfd700 1 -- 172.21.15.6:0/3808121583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20341f2ba0 con 0x7f203415c4d0 2023-07-06T20:00:22.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.712+0000 7f20317fa700 1 -- 172.21.15.6:0/3808121583 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2020007440 con 0x7f203415c4d0 2023-07-06T20:00:22.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.712+0000 7f203adfd700 1 -- 172.21.15.6:0/3808121583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20341f31b0 con 0x7f203415c4d0 2023-07-06T20:00:22.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.713+0000 7f203adfd700 1 -- 172.21.15.6:0/3808121583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20341f36d0 con 0x7f203415c4d0 2023-07-06T20:00:22.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.714+0000 7f20317fa700 1 -- 172.21.15.6:0/3808121583 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f20200075a0 con 0x7f203415c4d0 2023-07-06T20:00:22.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.714+0000 7f20317fa700 1 --2- 172.21.15.6:0/3808121583 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f201806ace0 0x7f201806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:22.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.714+0000 7f20317fa700 1 -- 172.21.15.6:0/3808121583 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2020088980 con 0x7f203415c4d0 2023-07-06T20:00:22.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.714+0000 7f2038b99700 1 --2- 172.21.15.6:0/3808121583 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f201806ace0 0x7f201806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:22.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.714+0000 7f2038b99700 1 --2- 172.21.15.6:0/3808121583 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f201806ace0 0x7f201806d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2028009b70 tx=0x7f2028008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:22.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.718+0000 7f20317fa700 1 -- 172.21.15.6:0/3808121583 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f20341f36d0 con 0x7f203415c4d0 2023-07-06T20:00:22.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.913+0000 7f203adfd700 1 -- 172.21.15.6:0/3808121583 --> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f20340cf990 con 0x7f201806ace0 2023-07-06T20:00:22.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.922+0000 7f20317fa700 1 -- 172.21.15.6:0/3808121583 <== mgr.4110 v2:172.21.15.6:6832/201543369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305583 (secure 0 0 0) 0x7f20280117b0 con 0x7f201806ace0 2023-07-06T20:00:22.928 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:22.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.925+0000 7f203adfd700 1 -- 172.21.15.6:0/3808121583 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f201806ace0 msgr2=0x7f201806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:22.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.925+0000 7f203adfd700 1 --2- 172.21.15.6:0/3808121583 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f201806ace0 0x7f201806d190 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2028009b70 tx=0x7f2028008040 comp rx=0 tx=0).stop 2023-07-06T20:00:22.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.925+0000 7f203adfd700 1 -- 172.21.15.6:0/3808121583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f203415c4d0 msgr2=0x7f2034157e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:22.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.925+0000 7f203adfd700 1 --2- 172.21.15.6:0/3808121583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f203415c4d0 0x7f2034157e30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f202000c4d0 tx=0x7f202000c890 comp rx=0 tx=0).stop 2023-07-06T20:00:22.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.925+0000 7f203adfd700 1 -- 172.21.15.6:0/3808121583 shutdown_connections 2023-07-06T20:00:22.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.925+0000 7f203adfd700 1 --2- 172.21.15.6:0/3808121583 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f201806ace0 0x7f201806d190 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:22.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.925+0000 7f203adfd700 1 --2- 172.21.15.6:0/3808121583 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f20341606e0 0x7f2034158370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:22.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.925+0000 7f203adfd700 1 --2- 172.21.15.6:0/3808121583 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f20340b3e30 0x7f203415f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:22.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.925+0000 7f203adfd700 1 --2- 172.21.15.6:0/3808121583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f203415c4d0 0x7f2034157e30 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:22.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.925+0000 7f203adfd700 1 -- 172.21.15.6:0/3808121583 >> 172.21.15.6:0/3808121583 conn(0x7f20340d0a30 msgr2=0x7f20340d0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:22.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.925+0000 7f203adfd700 1 -- 172.21.15.6:0/3808121583 shutdown_connections 2023-07-06T20:00:22.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:22.925+0000 7f203adfd700 1 -- 172.21.15.6:0/3808121583 wait complete. 2023-07-06T20:00:22.933 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-06T20:00:22.943 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2023-07-06T20:00:22.733895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220296,"kb_used_data":4680,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754424,"statfs":{"total":773094113280,"available":772868530176,"internally_reserved":0,"allocated":4792320,"data_stored":2767608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001222"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.743254+0000","last_change":"2023-07-06T20:00:17.743254+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.743254+0000","last_undegraded":"2023-07-06T20:00:17.743254+0000","last_fullsized":"2023-07-06T20:00:17.743254+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737249+0000","last_change":"2023-07-06T20:00:17.737249+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737249+0000","last_undegraded":"2023-07-06T20:00:17.737249+0000","last_fullsized":"2023-07-06T20:00:17.737249+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740525+0000","last_change":"2023-07-06T20:00:17.740525+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740525+0000","last_undegraded":"2023-07-06T20:00:17.740525+0000","last_fullsized":"2023-07-06T20:00:17.740525+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740208+0000","last_change":"2023-07-06T20:00:17.740208+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740208+0000","last_undegraded":"2023-07-06T20:00:17.740208+0000","last_fullsized":"2023-07-06T20:00:17.740208+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737134+0000","last_change":"2023-07-06T20:00:17.737134+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737134+0000","last_undegraded":"2023-07-06T20:00:17.737134+0000","last_fullsized":"2023-07-06T20:00:17.737134+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737709+0000","last_change":"2023-07-06T20:00:17.737709+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737709+0000","last_undegraded":"2023-07-06T20:00:17.737709+0000","last_fullsized":"2023-07-06T20:00:17.737709+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.741619+0000","last_change":"2023-07-06T20:00:17.741619+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.741619+0000","last_undegraded":"2023-07-06T20:00:17.741619+0000","last_fullsized":"2023-07-06T20:00:17.741619+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739812+0000","last_change":"2023-07-06T20:00:17.739812+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739812+0000","last_undegraded":"2023-07-06T20:00:17.739812+0000","last_fullsized":"2023-07-06T20:00:17.739812+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.747878+0000","last_change":"2023-07-06T20:00:17.747878+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.747878+0000","last_undegraded":"2023-07-06T20:00:17.747878+0000","last_fullsized":"2023-07-06T20:00:17.747878+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740246+0000","last_change":"2023-07-06T20:00:17.740246+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740246+0000","last_undegraded":"2023-07-06T20:00:17.740246+0000","last_fullsized":"2023-07-06T20:00:17.740246+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737847+0000","last_change":"2023-07-06T20:00:17.737847+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737847+0000","last_undegraded":"2023-07-06T20:00:17.737847+0000","last_fullsized":"2023-07-06T20:00:17.737847+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.735950+0000","last_change":"2023-07-06T20:00:17.735950+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.735950+0000","last_undegraded":"2023-07-06T20:00:17.735950+0000","last_fullsized":"2023-07-06T20:00:17.735950+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.735224+0000","last_change":"2023-07-06T20:00:17.735224+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.735224+0000","last_undegraded":"2023-07-06T20:00:17.735224+0000","last_fullsized":"2023-07-06T20:00:17.735224+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740125+0000","last_change":"2023-07-06T20:00:17.740125+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740125+0000","last_undegraded":"2023-07-06T20:00:17.740125+0000","last_fullsized":"2023-07-06T20:00:17.740125+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739659+0000","last_change":"2023-07-06T20:00:17.739659+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739659+0000","last_undegraded":"2023-07-06T20:00:17.739659+0000","last_fullsized":"2023-07-06T20:00:17.739659+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.747954+0000","last_change":"2023-07-06T20:00:17.747954+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.747954+0000","last_undegraded":"2023-07-06T20:00:17.747954+0000","last_fullsized":"2023-07-06T20:00:17.747954+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.741146+0000","last_change":"2023-07-06T20:00:17.741146+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.741146+0000","last_undegraded":"2023-07-06T20:00:17.741146+0000","last_fullsized":"2023-07-06T20:00:17.741146+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.743851+0000","last_change":"2023-07-06T20:00:17.743851+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.743851+0000","last_undegraded":"2023-07-06T20:00:17.743851+0000","last_fullsized":"2023-07-06T20:00:17.743851+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.751695+0000","last_change":"2023-07-06T20:00:17.751695+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.751695+0000","last_undegraded":"2023-07-06T20:00:17.751695+0000","last_fullsized":"2023-07-06T20:00:17.751695+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.735268+0000","last_change":"2023-07-06T20:00:17.735268+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.735268+0000","last_undegraded":"2023-07-06T20:00:17.735268+0000","last_fullsized":"2023-07-06T20:00:17.735268+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.738405+0000","last_change":"2023-07-06T20:00:17.738405+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.738405+0000","last_undegraded":"2023-07-06T20:00:17.738405+0000","last_fullsized":"2023-07-06T20:00:17.738405+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737707+0000","last_change":"2023-07-06T20:00:17.737707+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737707+0000","last_undegraded":"2023-07-06T20:00:17.737707+0000","last_fullsized":"2023-07-06T20:00:17.737707+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.751754+0000","last_change":"2023-07-06T20:00:17.751754+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.751754+0000","last_undegraded":"2023-07-06T20:00:17.751754+0000","last_fullsized":"2023-07-06T20:00:17.751754+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.747413+0000","last_change":"2023-07-06T20:00:17.747413+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.747413+0000","last_undegraded":"2023-07-06T20:00:17.747413+0000","last_fullsized":"2023-07-06T20:00:17.747413+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.747243+0000","last_change":"2023-07-06T20:00:17.747243+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.747243+0000","last_undegraded":"2023-07-06T20:00:17.747243+0000","last_fullsized":"2023-07-06T20:00:17.747243+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.735296+0000","last_change":"2023-07-06T20:00:17.735296+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.735296+0000","last_undegraded":"2023-07-06T20:00:17.735296+0000","last_fullsized":"2023-07-06T20:00:17.735296+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739964+0000","last_change":"2023-07-06T20:00:17.739964+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739964+0000","last_undegraded":"2023-07-06T20:00:17.739964+0000","last_fullsized":"2023-07-06T20:00:17.739964+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737482+0000","last_change":"2023-07-06T20:00:17.737482+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737482+0000","last_undegraded":"2023-07-06T20:00:17.737482+0000","last_fullsized":"2023-07-06T20:00:17.737482+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.746364+0000","last_change":"2023-07-06T20:00:17.746364+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.746364+0000","last_undegraded":"2023-07-06T20:00:17.746364+0000","last_fullsized":"2023-07-06T20:00:17.746364+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.742720+0000","last_change":"2023-07-06T20:00:17.742720+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.742720+0000","last_undegraded":"2023-07-06T20:00:17.742720+0000","last_fullsized":"2023-07-06T20:00:17.742720+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740508+0000","last_change":"2023-07-06T20:00:17.740508+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740508+0000","last_undegraded":"2023-07-06T20:00:17.740508+0000","last_fullsized":"2023-07-06T20:00:17.740508+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.735149+0000","last_change":"2023-07-06T20:00:17.735149+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.735149+0000","last_undegraded":"2023-07-06T20:00:17.735149+0000","last_fullsized":"2023-07-06T20:00:17.735149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.742676+0000","last_change":"2023-07-06T20:00:17.742676+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.742676+0000","last_undegraded":"2023-07-06T20:00:17.742676+0000","last_fullsized":"2023-07-06T20:00:17.742676+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761370+0000","last_change":"2023-07-06T20:00:17.758785+0000","last_active":"2023-07-06T20:00:17.761370+0000","last_peered":"2023-07-06T20:00:17.761370+0000","last_clean":"2023-07-06T20:00:17.761370+0000","last_became_active":"2023-07-06T20:00:17.758511+0000","last_became_peered":"2023-07-06T20:00:17.758511+0000","last_unstale":"2023-07-06T20:00:17.761370+0000","last_undegraded":"2023-07-06T20:00:17.761370+0000","last_fullsized":"2023-07-06T20:00:17.761370+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:11:09.727533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.752192+0000","last_change":"2023-07-06T20:00:17.752192+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.752192+0000","last_undegraded":"2023-07-06T20:00:17.752192+0000","last_fullsized":"2023-07-06T20:00:17.752192+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.758753+0000","last_change":"2023-07-06T20:00:17.754956+0000","last_active":"2023-07-06T20:00:17.758753+0000","last_peered":"2023-07-06T20:00:17.758753+0000","last_clean":"2023-07-06T20:00:17.758753+0000","last_became_active":"2023-07-06T20:00:17.754698+0000","last_became_peered":"2023-07-06T20:00:17.754698+0000","last_unstale":"2023-07-06T20:00:17.758753+0000","last_undegraded":"2023-07-06T20:00:17.758753+0000","last_fullsized":"2023-07-06T20:00:17.758753+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:44:13.823614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.736556+0000","last_change":"2023-07-06T20:00:17.736556+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.736556+0000","last_undegraded":"2023-07-06T20:00:17.736556+0000","last_fullsized":"2023-07-06T20:00:17.736556+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755124+0000","last_change":"2023-07-06T20:00:17.751853+0000","last_active":"2023-07-06T20:00:17.755124+0000","last_peered":"2023-07-06T20:00:17.755124+0000","last_clean":"2023-07-06T20:00:17.755124+0000","last_became_active":"2023-07-06T20:00:17.751574+0000","last_became_peered":"2023-07-06T20:00:17.751574+0000","last_unstale":"2023-07-06T20:00:17.755124+0000","last_undegraded":"2023-07-06T20:00:17.755124+0000","last_fullsized":"2023-07-06T20:00:17.755124+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:21:53.159655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.743759+0000","last_change":"2023-07-06T20:00:17.743759+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.743759+0000","last_undegraded":"2023-07-06T20:00:17.743759+0000","last_fullsized":"2023-07-06T20:00:17.743759+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761674+0000","last_change":"2023-07-06T20:00:17.753933+0000","last_active":"2023-07-06T20:00:17.761674+0000","last_peered":"2023-07-06T20:00:17.761674+0000","last_clean":"2023-07-06T20:00:17.761674+0000","last_became_active":"2023-07-06T20:00:17.753624+0000","last_became_peered":"2023-07-06T20:00:17.753624+0000","last_unstale":"2023-07-06T20:00:17.761674+0000","last_undegraded":"2023-07-06T20:00:17.761674+0000","last_fullsized":"2023-07-06T20:00:17.761674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:53:29.761935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.741548+0000","last_change":"2023-07-06T20:00:17.741548+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.741548+0000","last_undegraded":"2023-07-06T20:00:17.741548+0000","last_fullsized":"2023-07-06T20:00:17.741548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755524+0000","last_change":"2023-07-06T20:00:17.749676+0000","last_active":"2023-07-06T20:00:17.755524+0000","last_peered":"2023-07-06T20:00:17.755524+0000","last_clean":"2023-07-06T20:00:17.755524+0000","last_became_active":"2023-07-06T20:00:17.749394+0000","last_became_peered":"2023-07-06T20:00:17.749394+0000","last_unstale":"2023-07-06T20:00:17.755524+0000","last_undegraded":"2023-07-06T20:00:17.755524+0000","last_fullsized":"2023-07-06T20:00:17.755524+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:53:29.761935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739684+0000","last_change":"2023-07-06T20:00:17.739684+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739684+0000","last_undegraded":"2023-07-06T20:00:17.739684+0000","last_fullsized":"2023-07-06T20:00:17.739684+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755960+0000","last_change":"2023-07-06T20:00:17.750239+0000","last_active":"2023-07-06T20:00:17.755960+0000","last_peered":"2023-07-06T20:00:17.755960+0000","last_clean":"2023-07-06T20:00:17.755960+0000","last_became_active":"2023-07-06T20:00:17.749871+0000","last_became_peered":"2023-07-06T20:00:17.749871+0000","last_unstale":"2023-07-06T20:00:17.755960+0000","last_undegraded":"2023-07-06T20:00:17.755960+0000","last_fullsized":"2023-07-06T20:00:17.755960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:12:04.119622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739325+0000","last_change":"2023-07-06T20:00:17.739325+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739325+0000","last_undegraded":"2023-07-06T20:00:17.739325+0000","last_fullsized":"2023-07-06T20:00:17.739325+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.753319+0000","last_change":"2023-07-06T20:00:17.748331+0000","last_active":"2023-07-06T20:00:17.753319+0000","last_peered":"2023-07-06T20:00:17.753319+0000","last_clean":"2023-07-06T20:00:17.753319+0000","last_became_active":"2023-07-06T20:00:17.748017+0000","last_became_peered":"2023-07-06T20:00:17.748017+0000","last_unstale":"2023-07-06T20:00:17.753319+0000","last_undegraded":"2023-07-06T20:00:17.753319+0000","last_fullsized":"2023-07-06T20:00:17.753319+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:54:02.894383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.746280+0000","last_change":"2023-07-06T20:00:17.746280+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.746280+0000","last_undegraded":"2023-07-06T20:00:17.746280+0000","last_fullsized":"2023-07-06T20:00:17.746280+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755552+0000","last_change":"2023-07-06T20:00:17.750674+0000","last_active":"2023-07-06T20:00:17.755552+0000","last_peered":"2023-07-06T20:00:17.755552+0000","last_clean":"2023-07-06T20:00:17.755552+0000","last_became_active":"2023-07-06T20:00:17.749956+0000","last_became_peered":"2023-07-06T20:00:17.749956+0000","last_unstale":"2023-07-06T20:00:17.755552+0000","last_undegraded":"2023-07-06T20:00:17.755552+0000","last_fullsized":"2023-07-06T20:00:17.755552+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:24:16.127038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.742449+0000","last_change":"2023-07-06T20:00:17.742449+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.742449+0000","last_undegraded":"2023-07-06T20:00:17.742449+0000","last_fullsized":"2023-07-06T20:00:17.742449+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755884+0000","last_change":"2023-07-06T20:00:17.750053+0000","last_active":"2023-07-06T20:00:17.755884+0000","last_peered":"2023-07-06T20:00:17.755884+0000","last_clean":"2023-07-06T20:00:17.755884+0000","last_became_active":"2023-07-06T20:00:17.749690+0000","last_became_peered":"2023-07-06T20:00:17.749690+0000","last_unstale":"2023-07-06T20:00:17.755884+0000","last_undegraded":"2023-07-06T20:00:17.755884+0000","last_fullsized":"2023-07-06T20:00:17.755884+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:11:32.106916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.742789+0000","last_change":"2023-07-06T20:00:17.742789+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.742789+0000","last_undegraded":"2023-07-06T20:00:17.742789+0000","last_fullsized":"2023-07-06T20:00:17.742789+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761115+0000","last_change":"2023-07-06T20:00:17.756702+0000","last_active":"2023-07-06T20:00:17.761115+0000","last_peered":"2023-07-06T20:00:17.761115+0000","last_clean":"2023-07-06T20:00:17.761115+0000","last_became_active":"2023-07-06T20:00:17.756498+0000","last_became_peered":"2023-07-06T20:00:17.756498+0000","last_unstale":"2023-07-06T20:00:17.761115+0000","last_undegraded":"2023-07-06T20:00:17.761115+0000","last_fullsized":"2023-07-06T20:00:17.761115+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:21:53.159655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739078+0000","last_change":"2023-07-06T20:00:17.739078+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739078+0000","last_undegraded":"2023-07-06T20:00:17.739078+0000","last_fullsized":"2023-07-06T20:00:17.739078+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761813+0000","last_change":"2023-07-06T20:00:17.758181+0000","last_active":"2023-07-06T20:00:17.761813+0000","last_peered":"2023-07-06T20:00:17.761813+0000","last_clean":"2023-07-06T20:00:17.761813+0000","last_became_active":"2023-07-06T20:00:17.757621+0000","last_became_peered":"2023-07-06T20:00:17.757621+0000","last_unstale":"2023-07-06T20:00:17.761813+0000","last_undegraded":"2023-07-06T20:00:17.761813+0000","last_fullsized":"2023-07-06T20:00:17.761813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:11:09.727533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740073+0000","last_change":"2023-07-06T20:00:17.740073+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740073+0000","last_undegraded":"2023-07-06T20:00:17.740073+0000","last_fullsized":"2023-07-06T20:00:17.740073+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.748501+0000","last_change":"2023-07-06T20:00:17.744182+0000","last_active":"2023-07-06T20:00:17.748501+0000","last_peered":"2023-07-06T20:00:17.748501+0000","last_clean":"2023-07-06T20:00:17.748501+0000","last_became_active":"2023-07-06T20:00:17.743898+0000","last_became_peered":"2023-07-06T20:00:17.743898+0000","last_unstale":"2023-07-06T20:00:17.748501+0000","last_undegraded":"2023-07-06T20:00:17.748501+0000","last_fullsized":"2023-07-06T20:00:17.748501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:52:44.455571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.750181+0000","last_change":"2023-07-06T20:00:17.750181+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.750181+0000","last_undegraded":"2023-07-06T20:00:17.750181+0000","last_fullsized":"2023-07-06T20:00:17.750181+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755541+0000","last_change":"2023-07-06T20:00:17.752168+0000","last_active":"2023-07-06T20:00:17.755541+0000","last_peered":"2023-07-06T20:00:17.755541+0000","last_clean":"2023-07-06T20:00:17.755541+0000","last_became_active":"2023-07-06T20:00:17.751874+0000","last_became_peered":"2023-07-06T20:00:17.751874+0000","last_unstale":"2023-07-06T20:00:17.755541+0000","last_undegraded":"2023-07-06T20:00:17.755541+0000","last_fullsized":"2023-07-06T20:00:17.755541+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:31:05.588401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739186+0000","last_change":"2023-07-06T20:00:17.739186+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739186+0000","last_undegraded":"2023-07-06T20:00:17.739186+0000","last_fullsized":"2023-07-06T20:00:17.739186+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761708+0000","last_change":"2023-07-06T20:00:17.755859+0000","last_active":"2023-07-06T20:00:17.761708+0000","last_peered":"2023-07-06T20:00:17.761708+0000","last_clean":"2023-07-06T20:00:17.761708+0000","last_became_active":"2023-07-06T20:00:17.755572+0000","last_became_peered":"2023-07-06T20:00:17.755572+0000","last_unstale":"2023-07-06T20:00:17.761708+0000","last_undegraded":"2023-07-06T20:00:17.761708+0000","last_fullsized":"2023-07-06T20:00:17.761708+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:09:34.121891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737099+0000","last_change":"2023-07-06T20:00:17.737099+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737099+0000","last_undegraded":"2023-07-06T20:00:17.737099+0000","last_fullsized":"2023-07-06T20:00:17.737099+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.756216+0000","last_change":"2023-07-06T20:00:17.754316+0000","last_active":"2023-07-06T20:00:17.756216+0000","last_peered":"2023-07-06T20:00:17.756216+0000","last_clean":"2023-07-06T20:00:17.756216+0000","last_became_active":"2023-07-06T20:00:17.753974+0000","last_became_peered":"2023-07-06T20:00:17.753974+0000","last_unstale":"2023-07-06T20:00:17.756216+0000","last_undegraded":"2023-07-06T20:00:17.756216+0000","last_fullsized":"2023-07-06T20:00:17.756216+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:04:36.784868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740959+0000","last_change":"2023-07-06T20:00:17.740959+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740959+0000","last_undegraded":"2023-07-06T20:00:17.740959+0000","last_fullsized":"2023-07-06T20:00:17.740959+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755594+0000","last_change":"2023-07-06T20:00:17.750850+0000","last_active":"2023-07-06T20:00:17.755594+0000","last_peered":"2023-07-06T20:00:17.755594+0000","last_clean":"2023-07-06T20:00:17.755594+0000","last_became_active":"2023-07-06T20:00:17.750550+0000","last_became_peered":"2023-07-06T20:00:17.750550+0000","last_unstale":"2023-07-06T20:00:17.755594+0000","last_undegraded":"2023-07-06T20:00:17.755594+0000","last_fullsized":"2023-07-06T20:00:17.755594+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:02:02.761364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.734629+0000","last_change":"2023-07-06T20:00:17.734629+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.734629+0000","last_undegraded":"2023-07-06T20:00:17.734629+0000","last_fullsized":"2023-07-06T20:00:17.734629+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.752051+0000","last_change":"2023-07-06T20:00:17.747641+0000","last_active":"2023-07-06T20:00:17.752051+0000","last_peered":"2023-07-06T20:00:17.752051+0000","last_clean":"2023-07-06T20:00:17.752051+0000","last_became_active":"2023-07-06T20:00:17.747332+0000","last_became_peered":"2023-07-06T20:00:17.747332+0000","last_unstale":"2023-07-06T20:00:17.752051+0000","last_undegraded":"2023-07-06T20:00:17.752051+0000","last_fullsized":"2023-07-06T20:00:17.752051+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:36:08.499704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740454+0000","last_change":"2023-07-06T20:00:17.740454+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740454+0000","last_undegraded":"2023-07-06T20:00:17.740454+0000","last_fullsized":"2023-07-06T20:00:17.740454+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.756014+0000","last_change":"2023-07-06T20:00:17.750549+0000","last_active":"2023-07-06T20:00:17.756014+0000","last_peered":"2023-07-06T20:00:17.756014+0000","last_clean":"2023-07-06T20:00:17.756014+0000","last_became_active":"2023-07-06T20:00:17.749747+0000","last_became_peered":"2023-07-06T20:00:17.749747+0000","last_unstale":"2023-07-06T20:00:17.756014+0000","last_undegraded":"2023-07-06T20:00:17.756014+0000","last_fullsized":"2023-07-06T20:00:17.756014+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:15:57.765205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.752039+0000","last_change":"2023-07-06T20:00:17.752039+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.752039+0000","last_undegraded":"2023-07-06T20:00:17.752039+0000","last_fullsized":"2023-07-06T20:00:17.752039+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.753289+0000","last_change":"2023-07-06T20:00:17.749209+0000","last_active":"2023-07-06T20:00:17.753289+0000","last_peered":"2023-07-06T20:00:17.753289+0000","last_clean":"2023-07-06T20:00:17.753289+0000","last_became_active":"2023-07-06T20:00:17.748680+0000","last_became_peered":"2023-07-06T20:00:17.748680+0000","last_unstale":"2023-07-06T20:00:17.753289+0000","last_undegraded":"2023-07-06T20:00:17.753289+0000","last_fullsized":"2023-07-06T20:00:17.753289+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:16:23.089607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.746358+0000","last_change":"2023-07-06T20:00:17.746358+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.746358+0000","last_undegraded":"2023-07-06T20:00:17.746358+0000","last_fullsized":"2023-07-06T20:00:17.746358+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761360+0000","last_change":"2023-07-06T20:00:17.758772+0000","last_active":"2023-07-06T20:00:17.761360+0000","last_peered":"2023-07-06T20:00:17.761360+0000","last_clean":"2023-07-06T20:00:17.761360+0000","last_became_active":"2023-07-06T20:00:17.758536+0000","last_became_peered":"2023-07-06T20:00:17.758536+0000","last_unstale":"2023-07-06T20:00:17.761360+0000","last_undegraded":"2023-07-06T20:00:17.761360+0000","last_fullsized":"2023-07-06T20:00:17.761360+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:01:36.817991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.738198+0000","last_change":"2023-07-06T20:00:17.738198+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.738198+0000","last_undegraded":"2023-07-06T20:00:17.738198+0000","last_fullsized":"2023-07-06T20:00:17.738198+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755503+0000","last_change":"2023-07-06T20:00:17.749103+0000","last_active":"2023-07-06T20:00:17.755503+0000","last_peered":"2023-07-06T20:00:17.755503+0000","last_clean":"2023-07-06T20:00:17.755503+0000","last_became_active":"2023-07-06T20:00:17.748753+0000","last_became_peered":"2023-07-06T20:00:17.748753+0000","last_unstale":"2023-07-06T20:00:17.755503+0000","last_undegraded":"2023-07-06T20:00:17.755503+0000","last_fullsized":"2023-07-06T20:00:17.755503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:01:43.769188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.744963+0000","last_change":"2023-07-06T20:00:17.744963+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.744963+0000","last_undegraded":"2023-07-06T20:00:17.744963+0000","last_fullsized":"2023-07-06T20:00:17.744963+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761329+0000","last_change":"2023-07-06T20:00:17.757297+0000","last_active":"2023-07-06T20:00:17.761329+0000","last_peered":"2023-07-06T20:00:17.761329+0000","last_clean":"2023-07-06T20:00:17.761329+0000","last_became_active":"2023-07-06T20:00:17.756954+0000","last_became_peered":"2023-07-06T20:00:17.756954+0000","last_unstale":"2023-07-06T20:00:17.761329+0000","last_undegraded":"2023-07-06T20:00:17.761329+0000","last_fullsized":"2023-07-06T20:00:17.761329+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:27:01.557116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.734557+0000","last_change":"2023-07-06T20:00:17.734557+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.734557+0000","last_undegraded":"2023-07-06T20:00:17.734557+0000","last_fullsized":"2023-07-06T20:00:17.734557+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755486+0000","last_change":"2023-07-06T20:00:17.749817+0000","last_active":"2023-07-06T20:00:17.755486+0000","last_peered":"2023-07-06T20:00:17.755486+0000","last_clean":"2023-07-06T20:00:17.755486+0000","last_became_active":"2023-07-06T20:00:17.749463+0000","last_became_peered":"2023-07-06T20:00:17.749463+0000","last_unstale":"2023-07-06T20:00:17.755486+0000","last_undegraded":"2023-07-06T20:00:17.755486+0000","last_fullsized":"2023-07-06T20:00:17.755486+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:03:37.487548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.738238+0000","last_change":"2023-07-06T20:00:17.738238+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.738238+0000","last_undegraded":"2023-07-06T20:00:17.738238+0000","last_fullsized":"2023-07-06T20:00:17.738238+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761738+0000","last_change":"2023-07-06T20:00:17.756010+0000","last_active":"2023-07-06T20:00:17.761738+0000","last_peered":"2023-07-06T20:00:17.761738+0000","last_clean":"2023-07-06T20:00:17.761738+0000","last_became_active":"2023-07-06T20:00:17.755721+0000","last_became_peered":"2023-07-06T20:00:17.755721+0000","last_unstale":"2023-07-06T20:00:17.761738+0000","last_undegraded":"2023-07-06T20:00:17.761738+0000","last_fullsized":"2023-07-06T20:00:17.761738+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:01:36.817991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739513+0000","last_change":"2023-07-06T20:00:17.739513+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739513+0000","last_undegraded":"2023-07-06T20:00:17.739513+0000","last_fullsized":"2023-07-06T20:00:17.739513+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755574+0000","last_change":"2023-07-06T20:00:17.750835+0000","last_active":"2023-07-06T20:00:17.755574+0000","last_peered":"2023-07-06T20:00:17.755574+0000","last_clean":"2023-07-06T20:00:17.755574+0000","last_became_active":"2023-07-06T20:00:17.750359+0000","last_became_peered":"2023-07-06T20:00:17.750359+0000","last_unstale":"2023-07-06T20:00:17.755574+0000","last_undegraded":"2023-07-06T20:00:17.755574+0000","last_fullsized":"2023-07-06T20:00:17.755574+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:23:22.777673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.745377+0000","last_change":"2023-07-06T19:58:47.723855+0000","last_active":"2023-07-06T20:00:17.745377+0000","last_peered":"2023-07-06T20:00:17.745377+0000","last_clean":"2023-07-06T20:00:17.745377+0000","last_became_active":"2023-07-06T19:58:47.723553+0000","last_became_peered":"2023-07-06T19:58:47.723553+0000","last_unstale":"2023-07-06T20:00:17.745377+0000","last_undegraded":"2023-07-06T20:00:17.745377+0000","last_fullsized":"2023-07-06T20:00:17.745377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:20:20.035886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.747848+0000","last_change":"2023-07-06T20:00:17.747848+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.747848+0000","last_undegraded":"2023-07-06T20:00:17.747848+0000","last_fullsized":"2023-07-06T20:00:17.747848+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755295+0000","last_change":"2023-07-06T20:00:17.751341+0000","last_active":"2023-07-06T20:00:17.755295+0000","last_peered":"2023-07-06T20:00:17.755295+0000","last_clean":"2023-07-06T20:00:17.755295+0000","last_became_active":"2023-07-06T20:00:17.751050+0000","last_became_peered":"2023-07-06T20:00:17.751050+0000","last_unstale":"2023-07-06T20:00:17.755295+0000","last_undegraded":"2023-07-06T20:00:17.755295+0000","last_fullsized":"2023-07-06T20:00:17.755295+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:57:19.370748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.737895+0000","last_change":"2023-07-06T19:58:47.705294+0000","last_active":"2023-07-06T20:00:17.737895+0000","last_peered":"2023-07-06T20:00:17.737895+0000","last_clean":"2023-07-06T20:00:17.737895+0000","last_became_active":"2023-07-06T19:58:47.704921+0000","last_became_peered":"2023-07-06T19:58:47.704921+0000","last_unstale":"2023-07-06T20:00:17.737895+0000","last_undegraded":"2023-07-06T20:00:17.737895+0000","last_fullsized":"2023-07-06T20:00:17.737895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:50:37.171246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.738631+0000","last_change":"2023-07-06T20:00:17.738631+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.738631+0000","last_undegraded":"2023-07-06T20:00:17.738631+0000","last_fullsized":"2023-07-06T20:00:17.738631+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761830+0000","last_change":"2023-07-06T20:00:17.758366+0000","last_active":"2023-07-06T20:00:17.761830+0000","last_peered":"2023-07-06T20:00:17.761830+0000","last_clean":"2023-07-06T20:00:17.761830+0000","last_became_active":"2023-07-06T20:00:17.757940+0000","last_became_peered":"2023-07-06T20:00:17.757940+0000","last_unstale":"2023-07-06T20:00:17.761830+0000","last_undegraded":"2023-07-06T20:00:17.761830+0000","last_fullsized":"2023-07-06T20:00:17.761830+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:43:44.061833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.732142+0000","last_change":"2023-07-06T19:58:47.766992+0000","last_active":"2023-07-06T20:00:17.732142+0000","last_peered":"2023-07-06T20:00:17.732142+0000","last_clean":"2023-07-06T20:00:17.732142+0000","last_became_active":"2023-07-06T19:58:47.766697+0000","last_became_peered":"2023-07-06T19:58:47.766697+0000","last_unstale":"2023-07-06T20:00:17.732142+0000","last_undegraded":"2023-07-06T20:00:17.732142+0000","last_fullsized":"2023-07-06T20:00:17.732142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:33:15.971622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.738186+0000","last_change":"2023-07-06T20:00:17.738186+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.738186+0000","last_undegraded":"2023-07-06T20:00:17.738186+0000","last_fullsized":"2023-07-06T20:00:17.738186+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.750938+0000","last_change":"2023-07-06T20:00:17.745505+0000","last_active":"2023-07-06T20:00:17.750938+0000","last_peered":"2023-07-06T20:00:17.750938+0000","last_clean":"2023-07-06T20:00:17.750938+0000","last_became_active":"2023-07-06T20:00:17.745185+0000","last_became_peered":"2023-07-06T20:00:17.745185+0000","last_unstale":"2023-07-06T20:00:17.750938+0000","last_undegraded":"2023-07-06T20:00:17.750938+0000","last_fullsized":"2023-07-06T20:00:17.750938+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:24:34.665958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.737860+0000","last_change":"2023-07-06T19:58:47.704498+0000","last_active":"2023-07-06T20:00:17.737860+0000","last_peered":"2023-07-06T20:00:17.737860+0000","last_clean":"2023-07-06T20:00:17.737860+0000","last_became_active":"2023-07-06T19:58:47.704172+0000","last_became_peered":"2023-07-06T19:58:47.704172+0000","last_unstale":"2023-07-06T20:00:17.737860+0000","last_undegraded":"2023-07-06T20:00:17.737860+0000","last_fullsized":"2023-07-06T20:00:17.737860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:24:23.512468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":203,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.745857+0000","last_change":"2023-07-06T19:58:40.972763+0000","last_active":"2023-07-06T20:00:17.745857+0000","last_peered":"2023-07-06T20:00:17.745857+0000","last_clean":"2023-07-06T20:00:17.745857+0000","last_became_active":"2023-07-06T19:58:40.971570+0000","last_became_peered":"2023-07-06T19:58:40.971570+0000","last_unstale":"2023-07-06T20:00:17.745857+0000","last_undegraded":"2023-07-06T20:00:17.745857+0000","last_fullsized":"2023-07-06T20:00:17.745857+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_clean_scrub_stamp":"2023-07-06T19:58:39.653546+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:25:14.499210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739541+0000","last_change":"2023-07-06T20:00:17.739541+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739541+0000","last_undegraded":"2023-07-06T20:00:17.739541+0000","last_fullsized":"2023-07-06T20:00:17.739541+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.757612+0000","last_change":"2023-07-06T20:00:17.755288+0000","last_active":"2023-07-06T20:00:17.757612+0000","last_peered":"2023-07-06T20:00:17.757612+0000","last_clean":"2023-07-06T20:00:17.757612+0000","last_became_active":"2023-07-06T20:00:17.754948+0000","last_became_peered":"2023-07-06T20:00:17.754948+0000","last_unstale":"2023-07-06T20:00:17.757612+0000","last_undegraded":"2023-07-06T20:00:17.757612+0000","last_fullsized":"2023-07-06T20:00:17.757612+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:03:37.487548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.745737+0000","last_change":"2023-07-06T19:58:47.708545+0000","last_active":"2023-07-06T20:00:17.745737+0000","last_peered":"2023-07-06T20:00:17.745737+0000","last_clean":"2023-07-06T20:00:17.745737+0000","last_became_active":"2023-07-06T19:58:47.708230+0000","last_became_peered":"2023-07-06T19:58:47.708230+0000","last_unstale":"2023-07-06T20:00:17.745737+0000","last_undegraded":"2023-07-06T20:00:17.745737+0000","last_fullsized":"2023-07-06T20:00:17.745737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:03:06.746603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.735958+0000","last_change":"2023-07-06T20:00:17.735958+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.735958+0000","last_undegraded":"2023-07-06T20:00:17.735958+0000","last_fullsized":"2023-07-06T20:00:17.735958+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.760563+0000","last_change":"2023-07-06T20:00:17.757297+0000","last_active":"2023-07-06T20:00:17.760563+0000","last_peered":"2023-07-06T20:00:17.760563+0000","last_clean":"2023-07-06T20:00:17.760563+0000","last_became_active":"2023-07-06T20:00:17.756965+0000","last_became_peered":"2023-07-06T20:00:17.756965+0000","last_unstale":"2023-07-06T20:00:17.760563+0000","last_undegraded":"2023-07-06T20:00:17.760563+0000","last_fullsized":"2023-07-06T20:00:17.760563+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:32:56.954102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.746405+0000","last_change":"2023-07-06T19:58:47.723926+0000","last_active":"2023-07-06T20:00:17.746405+0000","last_peered":"2023-07-06T20:00:17.746405+0000","last_clean":"2023-07-06T20:00:17.746405+0000","last_became_active":"2023-07-06T19:58:47.723646+0000","last_became_peered":"2023-07-06T19:58:47.723646+0000","last_unstale":"2023-07-06T20:00:17.746405+0000","last_undegraded":"2023-07-06T20:00:17.746405+0000","last_fullsized":"2023-07-06T20:00:17.746405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:52:32.856117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737618+0000","last_change":"2023-07-06T20:00:17.737618+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737618+0000","last_undegraded":"2023-07-06T20:00:17.737618+0000","last_fullsized":"2023-07-06T20:00:17.737618+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755941+0000","last_change":"2023-07-06T20:00:17.749291+0000","last_active":"2023-07-06T20:00:17.755941+0000","last_peered":"2023-07-06T20:00:17.755941+0000","last_clean":"2023-07-06T20:00:17.755941+0000","last_became_active":"2023-07-06T20:00:17.748503+0000","last_became_peered":"2023-07-06T20:00:17.748503+0000","last_unstale":"2023-07-06T20:00:17.755941+0000","last_undegraded":"2023-07-06T20:00:17.755941+0000","last_fullsized":"2023-07-06T20:00:17.755941+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:31:01.135507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.746057+0000","last_change":"2023-07-06T19:58:47.711918+0000","last_active":"2023-07-06T20:00:17.746057+0000","last_peered":"2023-07-06T20:00:17.746057+0000","last_clean":"2023-07-06T20:00:17.746057+0000","last_became_active":"2023-07-06T19:58:47.711591+0000","last_became_peered":"2023-07-06T19:58:47.711591+0000","last_unstale":"2023-07-06T20:00:17.746057+0000","last_undegraded":"2023-07-06T20:00:17.746057+0000","last_fullsized":"2023-07-06T20:00:17.746057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:43:44.671255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737149+0000","last_change":"2023-07-06T20:00:17.737149+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737149+0000","last_undegraded":"2023-07-06T20:00:17.737149+0000","last_fullsized":"2023-07-06T20:00:17.737149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761769+0000","last_change":"2023-07-06T20:00:17.757513+0000","last_active":"2023-07-06T20:00:17.761769+0000","last_peered":"2023-07-06T20:00:17.761769+0000","last_clean":"2023-07-06T20:00:17.761769+0000","last_became_active":"2023-07-06T20:00:17.757216+0000","last_became_peered":"2023-07-06T20:00:17.757216+0000","last_unstale":"2023-07-06T20:00:17.761769+0000","last_undegraded":"2023-07-06T20:00:17.761769+0000","last_fullsized":"2023-07-06T20:00:17.761769+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:19:35.805143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.754231+0000","last_change":"2023-07-06T19:58:47.712143+0000","last_active":"2023-07-06T20:00:17.754231+0000","last_peered":"2023-07-06T20:00:17.754231+0000","last_clean":"2023-07-06T20:00:17.754231+0000","last_became_active":"2023-07-06T19:58:47.711788+0000","last_became_peered":"2023-07-06T19:58:47.711788+0000","last_unstale":"2023-07-06T20:00:17.754231+0000","last_undegraded":"2023-07-06T20:00:17.754231+0000","last_fullsized":"2023-07-06T20:00:17.754231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:53:38.913611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":1044480,"data_stored":788727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.624},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.80800000000000005}]},{"osd":4,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.91100000000000003}]},{"osd":6,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":1.0009999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":198359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":3.129,"5min":3.129,"15min":3.129},"last":0.627}]},{"osd":3,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.47099999999999997}]},{"osd":5,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.502}]},{"osd":7,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.68300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":198359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":7.157,"5min":7.157,"15min":7.157},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.26000000000000001}]},{"osd":3,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.29099999999999998}]},{"osd":4,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.504}]},{"osd":7,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.55500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":1044480,"data_stored":788727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.317}]},{"osd":4,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.499},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":3.2029999999999998,"5min":3.2029999999999998,"15min":3.2029999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.47499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":198359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.372}]},{"osd":3,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.38}]},{"osd":4,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":198359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":3.5089999999999999,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.315},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.505},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.439}]},{"osd":5,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.41299999999999998}]},{"osd":6,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.46800000000000003}]},{"osd":7,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.48099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":198359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.63200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":198359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":0.441}]},{"osd":1,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.5},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.5870000000000002,"5min":3.5870000000000002,"15min":3.5870000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.6389999999999998,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":8.2859999999999996,"5min":8.2859999999999996,"15min":8.2859999999999996},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.57699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T20:00:22.957 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T20:00:23.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.106+0000 7f30b36c8700 1 Processor -- start 2023-07-06T20:00:23.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.106+0000 7f30b36c8700 1 -- start start 2023-07-06T20:00:23.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.107+0000 7f30b36c8700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f30ac158a40 0x7f30ac0c9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:23.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.107+0000 7f30b36c8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30ac071550 0x7f30ac06e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:23.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.107+0000 7f30b36c8700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30ac06b110 con 0x7f30ac0cb5b0 2023-07-06T20:00:23.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.107+0000 7f30b36c8700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30ac158e10 con 0x7f30ac158a40 2023-07-06T20:00:23.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.107+0000 7f30b36c8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac06b3f0 con 0x7f30ac071550 2023-07-06T20:00:23.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.107+0000 7f30b0c63700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f30ac0cb5b0 0x7f30ac070e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34092/0 (socket says 172.21.15.6:34092) 2023-07-06T20:00:23.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.107+0000 7f30b0c63700 1 -- 172.21.15.6:0/3502685570 learned_addr learned my addr 172.21.15.6:0/3502685570 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:23.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.107+0000 7f30b1c65700 1 --2- 172.21.15.6:0/3502685570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30ac071550 0x7f30ac06e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:23.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.107+0000 7f30b1464700 1 --2- 172.21.15.6:0/3502685570 >> v2:172.21.15.40:3300/0 conn(0x7f30ac158a40 0x7f30ac0c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:23.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.107+0000 7f30a3fff700 1 -- 172.21.15.6:0/3502685570 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638539668 0 0) 0x7f30ac06b110 con 0x7f30ac0cb5b0 2023-07-06T20:00:23.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.107+0000 7f30a3fff700 1 -- 172.21.15.6:0/3502685570 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30980034d0 con 0x7f30ac0cb5b0 2023-07-06T20:00:23.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.107+0000 7f30a3fff700 1 -- 172.21.15.6:0/3502685570 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2333299030 0 0) 0x7f30980034d0 con 0x7f30ac0cb5b0 2023-07-06T20:00:23.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.107+0000 7f30a3fff700 1 -- 172.21.15.6:0/3502685570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30ac071550 msgr2=0x7f30ac06e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:23.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30a3fff700 1 --2- 172.21.15.6:0/3502685570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30ac071550 0x7f30ac06e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30a3fff700 1 -- 172.21.15.6:0/3502685570 >> v2:172.21.15.40:3300/0 conn(0x7f30ac158a40 msgr2=0x7f30ac0c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:23.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30a3fff700 1 --2- 172.21.15.6:0/3502685570 >> v2:172.21.15.40:3300/0 conn(0x7f30ac158a40 0x7f30ac0c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30a3fff700 1 -- 172.21.15.6:0/3502685570 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ac06b6d0 con 0x7f30ac0cb5b0 2023-07-06T20:00:23.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30a3fff700 1 -- 172.21.15.6:0/3502685570 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f309c001670 con 0x7f30ac0cb5b0 2023-07-06T20:00:23.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30b1c65700 1 --2- 172.21.15.6:0/3502685570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30ac071550 0x7f30ac06e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T20:00:23.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30a3fff700 1 -- 172.21.15.6:0/3502685570 >> v1:172.21.15.6:6789/0 conn(0x7f30ac0cb5b0 legacy=0x7f30ac070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:23.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30a3fff700 1 --2- 172.21.15.6:0/3502685570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3098003b60 0x7f3098003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:23.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30a3fff700 1 --2- 172.21.15.6:0/3502685570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30ac071550 0x7f309800a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:23.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30a3fff700 1 --2- 172.21.15.6:0/3502685570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f309800aea0 0x7f309800d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:23.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30a3fff700 1 -- 172.21.15.6:0/3502685570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac158e10 con 0x7f309800aea0 2023-07-06T20:00:23.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30a3fff700 1 -- 172.21.15.6:0/3502685570 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac06b3f0 con 0x7f3098003b60 2023-07-06T20:00:23.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30a3fff700 1 -- 172.21.15.6:0/3502685570 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309800dc20 con 0x7f30ac071550 2023-07-06T20:00:23.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30b1c65700 1 --2- 172.21.15.6:0/3502685570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f309800aea0 0x7f309800d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:23.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30b0c63700 1 --2- 172.21.15.6:0/3502685570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30ac071550 0x7f309800a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:23.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30b1464700 1 --2- 172.21.15.6:0/3502685570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3098003b60 0x7f3098003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:23.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30b1c65700 1 -- 172.21.15.6:0/3502685570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30ac071550 msgr2=0x7f309800a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:23.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30b1c65700 1 --2- 172.21.15.6:0/3502685570 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30ac071550 0x7f309800a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30b1c65700 1 -- 172.21.15.6:0/3502685570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3098003b60 msgr2=0x7f3098003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:23.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30b1c65700 1 --2- 172.21.15.6:0/3502685570 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3098003b60 0x7f3098003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30b1c65700 1 -- 172.21.15.6:0/3502685570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a4009a70 con 0x7f309800aea0 2023-07-06T20:00:23.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30b1c65700 1 --2- 172.21.15.6:0/3502685570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f309800aea0 0x7f309800d320 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f30a400e320 tx=0x7f3098003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3562a656ec267b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:23.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30a3fff700 1 -- 172.21.15.6:0/3502685570 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a400edc0 con 0x7f309800aea0 2023-07-06T20:00:23.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30a3fff700 1 -- 172.21.15.6:0/3502685570 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a400f040 con 0x7f309800aea0 2023-07-06T20:00:23.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.108+0000 7f30a3fff700 1 -- 172.21.15.6:0/3502685570 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a40146a0 con 0x7f309800aea0 2023-07-06T20:00:23.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.109+0000 7f30b36c8700 1 -- 172.21.15.6:0/3502685570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f309800aea0 msgr2=0x7f309800d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:23.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.109+0000 7f30b36c8700 1 --2- 172.21.15.6:0/3502685570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f309800aea0 0x7f309800d320 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f30a400e320 tx=0x7f3098003780 comp rx=0 tx=0).stop 2023-07-06T20:00:23.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.109+0000 7f30b1c65700 1 -- 172.21.15.6:0/3502685570 reap_dead start 2023-07-06T20:00:23.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.109+0000 7f30b36c8700 1 -- 172.21.15.6:0/3502685570 shutdown_connections 2023-07-06T20:00:23.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.109+0000 7f30b36c8700 1 -- 172.21.15.6:0/3502685570 >> 172.21.15.6:0/3502685570 conn(0x7f30ac0cf0f0 msgr2=0x7f30ac0cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:23.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.109+0000 7f30b36c8700 1 -- 172.21.15.6:0/3502685570 shutdown_connections 2023-07-06T20:00:23.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.109+0000 7f30b36c8700 1 -- 172.21.15.6:0/3502685570 wait complete. 2023-07-06T20:00:23.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.110+0000 7f30b36c8700 1 Processor -- start 2023-07-06T20:00:23.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.110+0000 7f30b36c8700 1 -- start start 2023-07-06T20:00:23.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.111+0000 7f30b36c8700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30ac1f1cb0 0x7f30ac0c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:23.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.111+0000 7f30b36c8700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30ac0c3650 0x7f30ac1e20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:23.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.111+0000 7f30b36c8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30ac1e25f0 0x7f30ac0c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:23.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.111+0000 7f30b36c8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac1e2a70 con 0x7f30ac1e25f0 2023-07-06T20:00:23.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.111+0000 7f30b36c8700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac0c48b0 con 0x7f30ac1f1cb0 2023-07-06T20:00:23.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.111+0000 7f30b36c8700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac0c4b90 con 0x7f30ac0c3650 2023-07-06T20:00:23.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.111+0000 7f30b1c65700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30ac1e25f0 0x7f30ac0c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:23.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.111+0000 7f30b1c65700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30ac1e25f0 0x7f30ac0c6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32900/0 (socket says 172.21.15.6:32900) 2023-07-06T20:00:23.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.111+0000 7f30b1c65700 1 -- 172.21.15.6:0/2563296513 learned_addr learned my addr 172.21.15.6:0/2563296513 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:23.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.111+0000 7f30b0c63700 1 --2- 172.21.15.6:0/2563296513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30ac0c3650 0x7f30ac1e20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:23.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.111+0000 7f30b1464700 1 --2- 172.21.15.6:0/2563296513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30ac1f1cb0 0x7f30ac0c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:23.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.111+0000 7f30b1c65700 1 -- 172.21.15.6:0/2563296513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30ac0c3650 msgr2=0x7f30ac1e20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:23.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.111+0000 7f30b1c65700 1 --2- 172.21.15.6:0/2563296513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30ac0c3650 0x7f30ac1e20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.111+0000 7f30b1c65700 1 -- 172.21.15.6:0/2563296513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30ac1f1cb0 msgr2=0x7f30ac0c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:23.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.111+0000 7f30b1c65700 1 --2- 172.21.15.6:0/2563296513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30ac1f1cb0 0x7f30ac0c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.111+0000 7f30b1c65700 1 -- 172.21.15.6:0/2563296513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ac0c4e70 con 0x7f30ac1e25f0 2023-07-06T20:00:23.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.111+0000 7f30b0c63700 1 --2- 172.21.15.6:0/2563296513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30ac0c3650 0x7f30ac1e20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T20:00:23.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.111+0000 7f30b1464700 1 --2- 172.21.15.6:0/2563296513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30ac1f1cb0 0x7f30ac0c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T20:00:23.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.112+0000 7f30b1c65700 1 --2- 172.21.15.6:0/2563296513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30ac1e25f0 0x7f30ac0c6d60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f30a400b010 tx=0x7f30a4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:23.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.112+0000 7f30a1ffb700 1 -- 172.21.15.6:0/2563296513 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a4007000 con 0x7f30ac1e25f0 2023-07-06T20:00:23.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.112+0000 7f30a1ffb700 1 -- 172.21.15.6:0/2563296513 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a4022070 con 0x7f30ac1e25f0 2023-07-06T20:00:23.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.112+0000 7f30a1ffb700 1 -- 172.21.15.6:0/2563296513 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a40296c0 con 0x7f30ac1e25f0 2023-07-06T20:00:23.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.112+0000 7f30b36c8700 1 -- 172.21.15.6:0/2563296513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30ac0c5150 con 0x7f30ac1e25f0 2023-07-06T20:00:23.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.112+0000 7f30b36c8700 1 -- 172.21.15.6:0/2563296513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30ac0c3ac0 con 0x7f30ac1e25f0 2023-07-06T20:00:23.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.113+0000 7f30b36c8700 1 -- 172.21.15.6:0/2563296513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30ac0c5670 con 0x7f30ac1e25f0 2023-07-06T20:00:23.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.113+0000 7f30a1ffb700 1 -- 172.21.15.6:0/2563296513 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f30a401e430 con 0x7f30ac1e25f0 2023-07-06T20:00:23.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.114+0000 7f30a1ffb700 1 --2- 172.21.15.6:0/2563296513 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f309006ace0 0x7f309006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:23.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.114+0000 7f30a1ffb700 1 -- 172.21.15.6:0/2563296513 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f30a4024070 con 0x7f30ac1e25f0 2023-07-06T20:00:23.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.114+0000 7f30b1464700 1 --2- 172.21.15.6:0/2563296513 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f309006ace0 0x7f309006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:23.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.114+0000 7f30b1464700 1 --2- 172.21.15.6:0/2563296513 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f309006ace0 0x7f309006d190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f30ac158410 tx=0x7f30a8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:23.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.118+0000 7f30a1ffb700 1 -- 172.21.15.6:0/2563296513 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f30ac0c5670 con 0x7f30ac1e25f0 2023-07-06T20:00:23.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.311+0000 7f30b36c8700 1 -- 172.21.15.6:0/2563296513 --> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f30ac0c4d00 con 0x7f309006ace0 2023-07-06T20:00:23.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.319+0000 7f30a1ffb700 1 -- 172.21.15.6:0/2563296513 <== mgr.4110 v2:172.21.15.6:6832/201543369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305583 (secure 0 0 0) 0x7f30ac0c4d00 con 0x7f309006ace0 2023-07-06T20:00:23.327 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:23.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.322+0000 7f30b36c8700 1 -- 172.21.15.6:0/2563296513 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f309006ace0 msgr2=0x7f309006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:23.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.322+0000 7f30b36c8700 1 --2- 172.21.15.6:0/2563296513 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f309006ace0 0x7f309006d190 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f30ac158410 tx=0x7f30a8008040 comp rx=0 tx=0).stop 2023-07-06T20:00:23.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.322+0000 7f30b36c8700 1 -- 172.21.15.6:0/2563296513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30ac1e25f0 msgr2=0x7f30ac0c6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:23.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.322+0000 7f30b36c8700 1 --2- 172.21.15.6:0/2563296513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30ac1e25f0 0x7f30ac0c6d60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f30a400b010 tx=0x7f30a4009750 comp rx=0 tx=0).stop 2023-07-06T20:00:23.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.322+0000 7f30b36c8700 1 -- 172.21.15.6:0/2563296513 shutdown_connections 2023-07-06T20:00:23.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.322+0000 7f30b36c8700 1 --2- 172.21.15.6:0/2563296513 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f309006ace0 0x7f309006d190 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.322+0000 7f30b36c8700 1 --2- 172.21.15.6:0/2563296513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30ac1e25f0 0x7f30ac0c6d60 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.322+0000 7f30b36c8700 1 --2- 172.21.15.6:0/2563296513 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f30ac1f1cb0 0x7f30ac0c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.322+0000 7f30b36c8700 1 --2- 172.21.15.6:0/2563296513 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f30ac0c3650 0x7f30ac1e20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.322+0000 7f30b36c8700 1 -- 172.21.15.6:0/2563296513 >> 172.21.15.6:0/2563296513 conn(0x7f30ac0cf0f0 msgr2=0x7f30ac0b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:23.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.322+0000 7f30b36c8700 1 -- 172.21.15.6:0/2563296513 shutdown_connections 2023-07-06T20:00:23.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.322+0000 7f30b36c8700 1 -- 172.21.15.6:0/2563296513 wait complete. 2023-07-06T20:00:23.338 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-06T20:00:23.341 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2023-07-06T20:00:22.733895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220296,"kb_used_data":4680,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754424,"statfs":{"total":773094113280,"available":772868530176,"internally_reserved":0,"allocated":4792320,"data_stored":2767608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001222"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.743254+0000","last_change":"2023-07-06T20:00:17.743254+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.743254+0000","last_undegraded":"2023-07-06T20:00:17.743254+0000","last_fullsized":"2023-07-06T20:00:17.743254+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737249+0000","last_change":"2023-07-06T20:00:17.737249+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737249+0000","last_undegraded":"2023-07-06T20:00:17.737249+0000","last_fullsized":"2023-07-06T20:00:17.737249+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740525+0000","last_change":"2023-07-06T20:00:17.740525+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740525+0000","last_undegraded":"2023-07-06T20:00:17.740525+0000","last_fullsized":"2023-07-06T20:00:17.740525+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740208+0000","last_change":"2023-07-06T20:00:17.740208+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740208+0000","last_undegraded":"2023-07-06T20:00:17.740208+0000","last_fullsized":"2023-07-06T20:00:17.740208+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737134+0000","last_change":"2023-07-06T20:00:17.737134+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737134+0000","last_undegraded":"2023-07-06T20:00:17.737134+0000","last_fullsized":"2023-07-06T20:00:17.737134+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737709+0000","last_change":"2023-07-06T20:00:17.737709+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737709+0000","last_undegraded":"2023-07-06T20:00:17.737709+0000","last_fullsized":"2023-07-06T20:00:17.737709+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.741619+0000","last_change":"2023-07-06T20:00:17.741619+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.741619+0000","last_undegraded":"2023-07-06T20:00:17.741619+0000","last_fullsized":"2023-07-06T20:00:17.741619+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739812+0000","last_change":"2023-07-06T20:00:17.739812+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739812+0000","last_undegraded":"2023-07-06T20:00:17.739812+0000","last_fullsized":"2023-07-06T20:00:17.739812+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.747878+0000","last_change":"2023-07-06T20:00:17.747878+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.747878+0000","last_undegraded":"2023-07-06T20:00:17.747878+0000","last_fullsized":"2023-07-06T20:00:17.747878+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740246+0000","last_change":"2023-07-06T20:00:17.740246+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740246+0000","last_undegraded":"2023-07-06T20:00:17.740246+0000","last_fullsized":"2023-07-06T20:00:17.740246+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737847+0000","last_change":"2023-07-06T20:00:17.737847+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737847+0000","last_undegraded":"2023-07-06T20:00:17.737847+0000","last_fullsized":"2023-07-06T20:00:17.737847+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.735950+0000","last_change":"2023-07-06T20:00:17.735950+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.735950+0000","last_undegraded":"2023-07-06T20:00:17.735950+0000","last_fullsized":"2023-07-06T20:00:17.735950+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.735224+0000","last_change":"2023-07-06T20:00:17.735224+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.735224+0000","last_undegraded":"2023-07-06T20:00:17.735224+0000","last_fullsized":"2023-07-06T20:00:17.735224+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740125+0000","last_change":"2023-07-06T20:00:17.740125+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740125+0000","last_undegraded":"2023-07-06T20:00:17.740125+0000","last_fullsized":"2023-07-06T20:00:17.740125+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739659+0000","last_change":"2023-07-06T20:00:17.739659+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739659+0000","last_undegraded":"2023-07-06T20:00:17.739659+0000","last_fullsized":"2023-07-06T20:00:17.739659+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.747954+0000","last_change":"2023-07-06T20:00:17.747954+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.747954+0000","last_undegraded":"2023-07-06T20:00:17.747954+0000","last_fullsized":"2023-07-06T20:00:17.747954+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.741146+0000","last_change":"2023-07-06T20:00:17.741146+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.741146+0000","last_undegraded":"2023-07-06T20:00:17.741146+0000","last_fullsized":"2023-07-06T20:00:17.741146+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.743851+0000","last_change":"2023-07-06T20:00:17.743851+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.743851+0000","last_undegraded":"2023-07-06T20:00:17.743851+0000","last_fullsized":"2023-07-06T20:00:17.743851+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.751695+0000","last_change":"2023-07-06T20:00:17.751695+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.751695+0000","last_undegraded":"2023-07-06T20:00:17.751695+0000","last_fullsized":"2023-07-06T20:00:17.751695+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.735268+0000","last_change":"2023-07-06T20:00:17.735268+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.735268+0000","last_undegraded":"2023-07-06T20:00:17.735268+0000","last_fullsized":"2023-07-06T20:00:17.735268+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.738405+0000","last_change":"2023-07-06T20:00:17.738405+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.738405+0000","last_undegraded":"2023-07-06T20:00:17.738405+0000","last_fullsized":"2023-07-06T20:00:17.738405+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737707+0000","last_change":"2023-07-06T20:00:17.737707+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737707+0000","last_undegraded":"2023-07-06T20:00:17.737707+0000","last_fullsized":"2023-07-06T20:00:17.737707+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.751754+0000","last_change":"2023-07-06T20:00:17.751754+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.751754+0000","last_undegraded":"2023-07-06T20:00:17.751754+0000","last_fullsized":"2023-07-06T20:00:17.751754+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.747413+0000","last_change":"2023-07-06T20:00:17.747413+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.747413+0000","last_undegraded":"2023-07-06T20:00:17.747413+0000","last_fullsized":"2023-07-06T20:00:17.747413+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.747243+0000","last_change":"2023-07-06T20:00:17.747243+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.747243+0000","last_undegraded":"2023-07-06T20:00:17.747243+0000","last_fullsized":"2023-07-06T20:00:17.747243+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.735296+0000","last_change":"2023-07-06T20:00:17.735296+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.735296+0000","last_undegraded":"2023-07-06T20:00:17.735296+0000","last_fullsized":"2023-07-06T20:00:17.735296+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739964+0000","last_change":"2023-07-06T20:00:17.739964+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739964+0000","last_undegraded":"2023-07-06T20:00:17.739964+0000","last_fullsized":"2023-07-06T20:00:17.739964+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737482+0000","last_change":"2023-07-06T20:00:17.737482+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737482+0000","last_undegraded":"2023-07-06T20:00:17.737482+0000","last_fullsized":"2023-07-06T20:00:17.737482+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.746364+0000","last_change":"2023-07-06T20:00:17.746364+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.746364+0000","last_undegraded":"2023-07-06T20:00:17.746364+0000","last_fullsized":"2023-07-06T20:00:17.746364+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.742720+0000","last_change":"2023-07-06T20:00:17.742720+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.742720+0000","last_undegraded":"2023-07-06T20:00:17.742720+0000","last_fullsized":"2023-07-06T20:00:17.742720+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740508+0000","last_change":"2023-07-06T20:00:17.740508+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740508+0000","last_undegraded":"2023-07-06T20:00:17.740508+0000","last_fullsized":"2023-07-06T20:00:17.740508+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.735149+0000","last_change":"2023-07-06T20:00:17.735149+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.735149+0000","last_undegraded":"2023-07-06T20:00:17.735149+0000","last_fullsized":"2023-07-06T20:00:17.735149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.742676+0000","last_change":"2023-07-06T20:00:17.742676+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.742676+0000","last_undegraded":"2023-07-06T20:00:17.742676+0000","last_fullsized":"2023-07-06T20:00:17.742676+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761370+0000","last_change":"2023-07-06T20:00:17.758785+0000","last_active":"2023-07-06T20:00:17.761370+0000","last_peered":"2023-07-06T20:00:17.761370+0000","last_clean":"2023-07-06T20:00:17.761370+0000","last_became_active":"2023-07-06T20:00:17.758511+0000","last_became_peered":"2023-07-06T20:00:17.758511+0000","last_unstale":"2023-07-06T20:00:17.761370+0000","last_undegraded":"2023-07-06T20:00:17.761370+0000","last_fullsized":"2023-07-06T20:00:17.761370+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:11:09.727533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.752192+0000","last_change":"2023-07-06T20:00:17.752192+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.752192+0000","last_undegraded":"2023-07-06T20:00:17.752192+0000","last_fullsized":"2023-07-06T20:00:17.752192+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.758753+0000","last_change":"2023-07-06T20:00:17.754956+0000","last_active":"2023-07-06T20:00:17.758753+0000","last_peered":"2023-07-06T20:00:17.758753+0000","last_clean":"2023-07-06T20:00:17.758753+0000","last_became_active":"2023-07-06T20:00:17.754698+0000","last_became_peered":"2023-07-06T20:00:17.754698+0000","last_unstale":"2023-07-06T20:00:17.758753+0000","last_undegraded":"2023-07-06T20:00:17.758753+0000","last_fullsized":"2023-07-06T20:00:17.758753+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:44:13.823614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.736556+0000","last_change":"2023-07-06T20:00:17.736556+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.736556+0000","last_undegraded":"2023-07-06T20:00:17.736556+0000","last_fullsized":"2023-07-06T20:00:17.736556+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755124+0000","last_change":"2023-07-06T20:00:17.751853+0000","last_active":"2023-07-06T20:00:17.755124+0000","last_peered":"2023-07-06T20:00:17.755124+0000","last_clean":"2023-07-06T20:00:17.755124+0000","last_became_active":"2023-07-06T20:00:17.751574+0000","last_became_peered":"2023-07-06T20:00:17.751574+0000","last_unstale":"2023-07-06T20:00:17.755124+0000","last_undegraded":"2023-07-06T20:00:17.755124+0000","last_fullsized":"2023-07-06T20:00:17.755124+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:21:53.159655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.743759+0000","last_change":"2023-07-06T20:00:17.743759+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.743759+0000","last_undegraded":"2023-07-06T20:00:17.743759+0000","last_fullsized":"2023-07-06T20:00:17.743759+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761674+0000","last_change":"2023-07-06T20:00:17.753933+0000","last_active":"2023-07-06T20:00:17.761674+0000","last_peered":"2023-07-06T20:00:17.761674+0000","last_clean":"2023-07-06T20:00:17.761674+0000","last_became_active":"2023-07-06T20:00:17.753624+0000","last_became_peered":"2023-07-06T20:00:17.753624+0000","last_unstale":"2023-07-06T20:00:17.761674+0000","last_undegraded":"2023-07-06T20:00:17.761674+0000","last_fullsized":"2023-07-06T20:00:17.761674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:53:29.761935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.741548+0000","last_change":"2023-07-06T20:00:17.741548+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.741548+0000","last_undegraded":"2023-07-06T20:00:17.741548+0000","last_fullsized":"2023-07-06T20:00:17.741548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755524+0000","last_change":"2023-07-06T20:00:17.749676+0000","last_active":"2023-07-06T20:00:17.755524+0000","last_peered":"2023-07-06T20:00:17.755524+0000","last_clean":"2023-07-06T20:00:17.755524+0000","last_became_active":"2023-07-06T20:00:17.749394+0000","last_became_peered":"2023-07-06T20:00:17.749394+0000","last_unstale":"2023-07-06T20:00:17.755524+0000","last_undegraded":"2023-07-06T20:00:17.755524+0000","last_fullsized":"2023-07-06T20:00:17.755524+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:53:29.761935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739684+0000","last_change":"2023-07-06T20:00:17.739684+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739684+0000","last_undegraded":"2023-07-06T20:00:17.739684+0000","last_fullsized":"2023-07-06T20:00:17.739684+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755960+0000","last_change":"2023-07-06T20:00:17.750239+0000","last_active":"2023-07-06T20:00:17.755960+0000","last_peered":"2023-07-06T20:00:17.755960+0000","last_clean":"2023-07-06T20:00:17.755960+0000","last_became_active":"2023-07-06T20:00:17.749871+0000","last_became_peered":"2023-07-06T20:00:17.749871+0000","last_unstale":"2023-07-06T20:00:17.755960+0000","last_undegraded":"2023-07-06T20:00:17.755960+0000","last_fullsized":"2023-07-06T20:00:17.755960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:12:04.119622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739325+0000","last_change":"2023-07-06T20:00:17.739325+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739325+0000","last_undegraded":"2023-07-06T20:00:17.739325+0000","last_fullsized":"2023-07-06T20:00:17.739325+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.753319+0000","last_change":"2023-07-06T20:00:17.748331+0000","last_active":"2023-07-06T20:00:17.753319+0000","last_peered":"2023-07-06T20:00:17.753319+0000","last_clean":"2023-07-06T20:00:17.753319+0000","last_became_active":"2023-07-06T20:00:17.748017+0000","last_became_peered":"2023-07-06T20:00:17.748017+0000","last_unstale":"2023-07-06T20:00:17.753319+0000","last_undegraded":"2023-07-06T20:00:17.753319+0000","last_fullsized":"2023-07-06T20:00:17.753319+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:54:02.894383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.746280+0000","last_change":"2023-07-06T20:00:17.746280+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.746280+0000","last_undegraded":"2023-07-06T20:00:17.746280+0000","last_fullsized":"2023-07-06T20:00:17.746280+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755552+0000","last_change":"2023-07-06T20:00:17.750674+0000","last_active":"2023-07-06T20:00:17.755552+0000","last_peered":"2023-07-06T20:00:17.755552+0000","last_clean":"2023-07-06T20:00:17.755552+0000","last_became_active":"2023-07-06T20:00:17.749956+0000","last_became_peered":"2023-07-06T20:00:17.749956+0000","last_unstale":"2023-07-06T20:00:17.755552+0000","last_undegraded":"2023-07-06T20:00:17.755552+0000","last_fullsized":"2023-07-06T20:00:17.755552+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:24:16.127038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.742449+0000","last_change":"2023-07-06T20:00:17.742449+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.742449+0000","last_undegraded":"2023-07-06T20:00:17.742449+0000","last_fullsized":"2023-07-06T20:00:17.742449+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755884+0000","last_change":"2023-07-06T20:00:17.750053+0000","last_active":"2023-07-06T20:00:17.755884+0000","last_peered":"2023-07-06T20:00:17.755884+0000","last_clean":"2023-07-06T20:00:17.755884+0000","last_became_active":"2023-07-06T20:00:17.749690+0000","last_became_peered":"2023-07-06T20:00:17.749690+0000","last_unstale":"2023-07-06T20:00:17.755884+0000","last_undegraded":"2023-07-06T20:00:17.755884+0000","last_fullsized":"2023-07-06T20:00:17.755884+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:11:32.106916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.742789+0000","last_change":"2023-07-06T20:00:17.742789+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.742789+0000","last_undegraded":"2023-07-06T20:00:17.742789+0000","last_fullsized":"2023-07-06T20:00:17.742789+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761115+0000","last_change":"2023-07-06T20:00:17.756702+0000","last_active":"2023-07-06T20:00:17.761115+0000","last_peered":"2023-07-06T20:00:17.761115+0000","last_clean":"2023-07-06T20:00:17.761115+0000","last_became_active":"2023-07-06T20:00:17.756498+0000","last_became_peered":"2023-07-06T20:00:17.756498+0000","last_unstale":"2023-07-06T20:00:17.761115+0000","last_undegraded":"2023-07-06T20:00:17.761115+0000","last_fullsized":"2023-07-06T20:00:17.761115+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:21:53.159655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739078+0000","last_change":"2023-07-06T20:00:17.739078+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739078+0000","last_undegraded":"2023-07-06T20:00:17.739078+0000","last_fullsized":"2023-07-06T20:00:17.739078+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761813+0000","last_change":"2023-07-06T20:00:17.758181+0000","last_active":"2023-07-06T20:00:17.761813+0000","last_peered":"2023-07-06T20:00:17.761813+0000","last_clean":"2023-07-06T20:00:17.761813+0000","last_became_active":"2023-07-06T20:00:17.757621+0000","last_became_peered":"2023-07-06T20:00:17.757621+0000","last_unstale":"2023-07-06T20:00:17.761813+0000","last_undegraded":"2023-07-06T20:00:17.761813+0000","last_fullsized":"2023-07-06T20:00:17.761813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:11:09.727533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740073+0000","last_change":"2023-07-06T20:00:17.740073+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740073+0000","last_undegraded":"2023-07-06T20:00:17.740073+0000","last_fullsized":"2023-07-06T20:00:17.740073+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.748501+0000","last_change":"2023-07-06T20:00:17.744182+0000","last_active":"2023-07-06T20:00:17.748501+0000","last_peered":"2023-07-06T20:00:17.748501+0000","last_clean":"2023-07-06T20:00:17.748501+0000","last_became_active":"2023-07-06T20:00:17.743898+0000","last_became_peered":"2023-07-06T20:00:17.743898+0000","last_unstale":"2023-07-06T20:00:17.748501+0000","last_undegraded":"2023-07-06T20:00:17.748501+0000","last_fullsized":"2023-07-06T20:00:17.748501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:52:44.455571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.750181+0000","last_change":"2023-07-06T20:00:17.750181+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.750181+0000","last_undegraded":"2023-07-06T20:00:17.750181+0000","last_fullsized":"2023-07-06T20:00:17.750181+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755541+0000","last_change":"2023-07-06T20:00:17.752168+0000","last_active":"2023-07-06T20:00:17.755541+0000","last_peered":"2023-07-06T20:00:17.755541+0000","last_clean":"2023-07-06T20:00:17.755541+0000","last_became_active":"2023-07-06T20:00:17.751874+0000","last_became_peered":"2023-07-06T20:00:17.751874+0000","last_unstale":"2023-07-06T20:00:17.755541+0000","last_undegraded":"2023-07-06T20:00:17.755541+0000","last_fullsized":"2023-07-06T20:00:17.755541+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:31:05.588401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739186+0000","last_change":"2023-07-06T20:00:17.739186+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739186+0000","last_undegraded":"2023-07-06T20:00:17.739186+0000","last_fullsized":"2023-07-06T20:00:17.739186+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761708+0000","last_change":"2023-07-06T20:00:17.755859+0000","last_active":"2023-07-06T20:00:17.761708+0000","last_peered":"2023-07-06T20:00:17.761708+0000","last_clean":"2023-07-06T20:00:17.761708+0000","last_became_active":"2023-07-06T20:00:17.755572+0000","last_became_peered":"2023-07-06T20:00:17.755572+0000","last_unstale":"2023-07-06T20:00:17.761708+0000","last_undegraded":"2023-07-06T20:00:17.761708+0000","last_fullsized":"2023-07-06T20:00:17.761708+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:09:34.121891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737099+0000","last_change":"2023-07-06T20:00:17.737099+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737099+0000","last_undegraded":"2023-07-06T20:00:17.737099+0000","last_fullsized":"2023-07-06T20:00:17.737099+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.756216+0000","last_change":"2023-07-06T20:00:17.754316+0000","last_active":"2023-07-06T20:00:17.756216+0000","last_peered":"2023-07-06T20:00:17.756216+0000","last_clean":"2023-07-06T20:00:17.756216+0000","last_became_active":"2023-07-06T20:00:17.753974+0000","last_became_peered":"2023-07-06T20:00:17.753974+0000","last_unstale":"2023-07-06T20:00:17.756216+0000","last_undegraded":"2023-07-06T20:00:17.756216+0000","last_fullsized":"2023-07-06T20:00:17.756216+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:04:36.784868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740959+0000","last_change":"2023-07-06T20:00:17.740959+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740959+0000","last_undegraded":"2023-07-06T20:00:17.740959+0000","last_fullsized":"2023-07-06T20:00:17.740959+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755594+0000","last_change":"2023-07-06T20:00:17.750850+0000","last_active":"2023-07-06T20:00:17.755594+0000","last_peered":"2023-07-06T20:00:17.755594+0000","last_clean":"2023-07-06T20:00:17.755594+0000","last_became_active":"2023-07-06T20:00:17.750550+0000","last_became_peered":"2023-07-06T20:00:17.750550+0000","last_unstale":"2023-07-06T20:00:17.755594+0000","last_undegraded":"2023-07-06T20:00:17.755594+0000","last_fullsized":"2023-07-06T20:00:17.755594+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:02:02.761364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.734629+0000","last_change":"2023-07-06T20:00:17.734629+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.734629+0000","last_undegraded":"2023-07-06T20:00:17.734629+0000","last_fullsized":"2023-07-06T20:00:17.734629+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.752051+0000","last_change":"2023-07-06T20:00:17.747641+0000","last_active":"2023-07-06T20:00:17.752051+0000","last_peered":"2023-07-06T20:00:17.752051+0000","last_clean":"2023-07-06T20:00:17.752051+0000","last_became_active":"2023-07-06T20:00:17.747332+0000","last_became_peered":"2023-07-06T20:00:17.747332+0000","last_unstale":"2023-07-06T20:00:17.752051+0000","last_undegraded":"2023-07-06T20:00:17.752051+0000","last_fullsized":"2023-07-06T20:00:17.752051+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:36:08.499704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740454+0000","last_change":"2023-07-06T20:00:17.740454+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740454+0000","last_undegraded":"2023-07-06T20:00:17.740454+0000","last_fullsized":"2023-07-06T20:00:17.740454+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.756014+0000","last_change":"2023-07-06T20:00:17.750549+0000","last_active":"2023-07-06T20:00:17.756014+0000","last_peered":"2023-07-06T20:00:17.756014+0000","last_clean":"2023-07-06T20:00:17.756014+0000","last_became_active":"2023-07-06T20:00:17.749747+0000","last_became_peered":"2023-07-06T20:00:17.749747+0000","last_unstale":"2023-07-06T20:00:17.756014+0000","last_undegraded":"2023-07-06T20:00:17.756014+0000","last_fullsized":"2023-07-06T20:00:17.756014+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:15:57.765205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.752039+0000","last_change":"2023-07-06T20:00:17.752039+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.752039+0000","last_undegraded":"2023-07-06T20:00:17.752039+0000","last_fullsized":"2023-07-06T20:00:17.752039+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.753289+0000","last_change":"2023-07-06T20:00:17.749209+0000","last_active":"2023-07-06T20:00:17.753289+0000","last_peered":"2023-07-06T20:00:17.753289+0000","last_clean":"2023-07-06T20:00:17.753289+0000","last_became_active":"2023-07-06T20:00:17.748680+0000","last_became_peered":"2023-07-06T20:00:17.748680+0000","last_unstale":"2023-07-06T20:00:17.753289+0000","last_undegraded":"2023-07-06T20:00:17.753289+0000","last_fullsized":"2023-07-06T20:00:17.753289+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:16:23.089607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.746358+0000","last_change":"2023-07-06T20:00:17.746358+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.746358+0000","last_undegraded":"2023-07-06T20:00:17.746358+0000","last_fullsized":"2023-07-06T20:00:17.746358+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761360+0000","last_change":"2023-07-06T20:00:17.758772+0000","last_active":"2023-07-06T20:00:17.761360+0000","last_peered":"2023-07-06T20:00:17.761360+0000","last_clean":"2023-07-06T20:00:17.761360+0000","last_became_active":"2023-07-06T20:00:17.758536+0000","last_became_peered":"2023-07-06T20:00:17.758536+0000","last_unstale":"2023-07-06T20:00:17.761360+0000","last_undegraded":"2023-07-06T20:00:17.761360+0000","last_fullsized":"2023-07-06T20:00:17.761360+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:01:36.817991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.738198+0000","last_change":"2023-07-06T20:00:17.738198+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.738198+0000","last_undegraded":"2023-07-06T20:00:17.738198+0000","last_fullsized":"2023-07-06T20:00:17.738198+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755503+0000","last_change":"2023-07-06T20:00:17.749103+0000","last_active":"2023-07-06T20:00:17.755503+0000","last_peered":"2023-07-06T20:00:17.755503+0000","last_clean":"2023-07-06T20:00:17.755503+0000","last_became_active":"2023-07-06T20:00:17.748753+0000","last_became_peered":"2023-07-06T20:00:17.748753+0000","last_unstale":"2023-07-06T20:00:17.755503+0000","last_undegraded":"2023-07-06T20:00:17.755503+0000","last_fullsized":"2023-07-06T20:00:17.755503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:01:43.769188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.744963+0000","last_change":"2023-07-06T20:00:17.744963+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.744963+0000","last_undegraded":"2023-07-06T20:00:17.744963+0000","last_fullsized":"2023-07-06T20:00:17.744963+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761329+0000","last_change":"2023-07-06T20:00:17.757297+0000","last_active":"2023-07-06T20:00:17.761329+0000","last_peered":"2023-07-06T20:00:17.761329+0000","last_clean":"2023-07-06T20:00:17.761329+0000","last_became_active":"2023-07-06T20:00:17.756954+0000","last_became_peered":"2023-07-06T20:00:17.756954+0000","last_unstale":"2023-07-06T20:00:17.761329+0000","last_undegraded":"2023-07-06T20:00:17.761329+0000","last_fullsized":"2023-07-06T20:00:17.761329+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:27:01.557116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.734557+0000","last_change":"2023-07-06T20:00:17.734557+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.734557+0000","last_undegraded":"2023-07-06T20:00:17.734557+0000","last_fullsized":"2023-07-06T20:00:17.734557+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755486+0000","last_change":"2023-07-06T20:00:17.749817+0000","last_active":"2023-07-06T20:00:17.755486+0000","last_peered":"2023-07-06T20:00:17.755486+0000","last_clean":"2023-07-06T20:00:17.755486+0000","last_became_active":"2023-07-06T20:00:17.749463+0000","last_became_peered":"2023-07-06T20:00:17.749463+0000","last_unstale":"2023-07-06T20:00:17.755486+0000","last_undegraded":"2023-07-06T20:00:17.755486+0000","last_fullsized":"2023-07-06T20:00:17.755486+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:03:37.487548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.738238+0000","last_change":"2023-07-06T20:00:17.738238+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.738238+0000","last_undegraded":"2023-07-06T20:00:17.738238+0000","last_fullsized":"2023-07-06T20:00:17.738238+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761738+0000","last_change":"2023-07-06T20:00:17.756010+0000","last_active":"2023-07-06T20:00:17.761738+0000","last_peered":"2023-07-06T20:00:17.761738+0000","last_clean":"2023-07-06T20:00:17.761738+0000","last_became_active":"2023-07-06T20:00:17.755721+0000","last_became_peered":"2023-07-06T20:00:17.755721+0000","last_unstale":"2023-07-06T20:00:17.761738+0000","last_undegraded":"2023-07-06T20:00:17.761738+0000","last_fullsized":"2023-07-06T20:00:17.761738+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:01:36.817991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739513+0000","last_change":"2023-07-06T20:00:17.739513+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739513+0000","last_undegraded":"2023-07-06T20:00:17.739513+0000","last_fullsized":"2023-07-06T20:00:17.739513+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755574+0000","last_change":"2023-07-06T20:00:17.750835+0000","last_active":"2023-07-06T20:00:17.755574+0000","last_peered":"2023-07-06T20:00:17.755574+0000","last_clean":"2023-07-06T20:00:17.755574+0000","last_became_active":"2023-07-06T20:00:17.750359+0000","last_became_peered":"2023-07-06T20:00:17.750359+0000","last_unstale":"2023-07-06T20:00:17.755574+0000","last_undegraded":"2023-07-06T20:00:17.755574+0000","last_fullsized":"2023-07-06T20:00:17.755574+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:23:22.777673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.745377+0000","last_change":"2023-07-06T19:58:47.723855+0000","last_active":"2023-07-06T20:00:17.745377+0000","last_peered":"2023-07-06T20:00:17.745377+0000","last_clean":"2023-07-06T20:00:17.745377+0000","last_became_active":"2023-07-06T19:58:47.723553+0000","last_became_peered":"2023-07-06T19:58:47.723553+0000","last_unstale":"2023-07-06T20:00:17.745377+0000","last_undegraded":"2023-07-06T20:00:17.745377+0000","last_fullsized":"2023-07-06T20:00:17.745377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:20:20.035886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.747848+0000","last_change":"2023-07-06T20:00:17.747848+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.747848+0000","last_undegraded":"2023-07-06T20:00:17.747848+0000","last_fullsized":"2023-07-06T20:00:17.747848+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755295+0000","last_change":"2023-07-06T20:00:17.751341+0000","last_active":"2023-07-06T20:00:17.755295+0000","last_peered":"2023-07-06T20:00:17.755295+0000","last_clean":"2023-07-06T20:00:17.755295+0000","last_became_active":"2023-07-06T20:00:17.751050+0000","last_became_peered":"2023-07-06T20:00:17.751050+0000","last_unstale":"2023-07-06T20:00:17.755295+0000","last_undegraded":"2023-07-06T20:00:17.755295+0000","last_fullsized":"2023-07-06T20:00:17.755295+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:57:19.370748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.737895+0000","last_change":"2023-07-06T19:58:47.705294+0000","last_active":"2023-07-06T20:00:17.737895+0000","last_peered":"2023-07-06T20:00:17.737895+0000","last_clean":"2023-07-06T20:00:17.737895+0000","last_became_active":"2023-07-06T19:58:47.704921+0000","last_became_peered":"2023-07-06T19:58:47.704921+0000","last_unstale":"2023-07-06T20:00:17.737895+0000","last_undegraded":"2023-07-06T20:00:17.737895+0000","last_fullsized":"2023-07-06T20:00:17.737895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:50:37.171246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.738631+0000","last_change":"2023-07-06T20:00:17.738631+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.738631+0000","last_undegraded":"2023-07-06T20:00:17.738631+0000","last_fullsized":"2023-07-06T20:00:17.738631+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761830+0000","last_change":"2023-07-06T20:00:17.758366+0000","last_active":"2023-07-06T20:00:17.761830+0000","last_peered":"2023-07-06T20:00:17.761830+0000","last_clean":"2023-07-06T20:00:17.761830+0000","last_became_active":"2023-07-06T20:00:17.757940+0000","last_became_peered":"2023-07-06T20:00:17.757940+0000","last_unstale":"2023-07-06T20:00:17.761830+0000","last_undegraded":"2023-07-06T20:00:17.761830+0000","last_fullsized":"2023-07-06T20:00:17.761830+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:43:44.061833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.732142+0000","last_change":"2023-07-06T19:58:47.766992+0000","last_active":"2023-07-06T20:00:17.732142+0000","last_peered":"2023-07-06T20:00:17.732142+0000","last_clean":"2023-07-06T20:00:17.732142+0000","last_became_active":"2023-07-06T19:58:47.766697+0000","last_became_peered":"2023-07-06T19:58:47.766697+0000","last_unstale":"2023-07-06T20:00:17.732142+0000","last_undegraded":"2023-07-06T20:00:17.732142+0000","last_fullsized":"2023-07-06T20:00:17.732142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:33:15.971622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.738186+0000","last_change":"2023-07-06T20:00:17.738186+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.738186+0000","last_undegraded":"2023-07-06T20:00:17.738186+0000","last_fullsized":"2023-07-06T20:00:17.738186+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.750938+0000","last_change":"2023-07-06T20:00:17.745505+0000","last_active":"2023-07-06T20:00:17.750938+0000","last_peered":"2023-07-06T20:00:17.750938+0000","last_clean":"2023-07-06T20:00:17.750938+0000","last_became_active":"2023-07-06T20:00:17.745185+0000","last_became_peered":"2023-07-06T20:00:17.745185+0000","last_unstale":"2023-07-06T20:00:17.750938+0000","last_undegraded":"2023-07-06T20:00:17.750938+0000","last_fullsized":"2023-07-06T20:00:17.750938+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:24:34.665958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.737860+0000","last_change":"2023-07-06T19:58:47.704498+0000","last_active":"2023-07-06T20:00:17.737860+0000","last_peered":"2023-07-06T20:00:17.737860+0000","last_clean":"2023-07-06T20:00:17.737860+0000","last_became_active":"2023-07-06T19:58:47.704172+0000","last_became_peered":"2023-07-06T19:58:47.704172+0000","last_unstale":"2023-07-06T20:00:17.737860+0000","last_undegraded":"2023-07-06T20:00:17.737860+0000","last_fullsized":"2023-07-06T20:00:17.737860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:24:23.512468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":203,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.745857+0000","last_change":"2023-07-06T19:58:40.972763+0000","last_active":"2023-07-06T20:00:17.745857+0000","last_peered":"2023-07-06T20:00:17.745857+0000","last_clean":"2023-07-06T20:00:17.745857+0000","last_became_active":"2023-07-06T19:58:40.971570+0000","last_became_peered":"2023-07-06T19:58:40.971570+0000","last_unstale":"2023-07-06T20:00:17.745857+0000","last_undegraded":"2023-07-06T20:00:17.745857+0000","last_fullsized":"2023-07-06T20:00:17.745857+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_clean_scrub_stamp":"2023-07-06T19:58:39.653546+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:25:14.499210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739541+0000","last_change":"2023-07-06T20:00:17.739541+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739541+0000","last_undegraded":"2023-07-06T20:00:17.739541+0000","last_fullsized":"2023-07-06T20:00:17.739541+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.757612+0000","last_change":"2023-07-06T20:00:17.755288+0000","last_active":"2023-07-06T20:00:17.757612+0000","last_peered":"2023-07-06T20:00:17.757612+0000","last_clean":"2023-07-06T20:00:17.757612+0000","last_became_active":"2023-07-06T20:00:17.754948+0000","last_became_peered":"2023-07-06T20:00:17.754948+0000","last_unstale":"2023-07-06T20:00:17.757612+0000","last_undegraded":"2023-07-06T20:00:17.757612+0000","last_fullsized":"2023-07-06T20:00:17.757612+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:03:37.487548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.745737+0000","last_change":"2023-07-06T19:58:47.708545+0000","last_active":"2023-07-06T20:00:17.745737+0000","last_peered":"2023-07-06T20:00:17.745737+0000","last_clean":"2023-07-06T20:00:17.745737+0000","last_became_active":"2023-07-06T19:58:47.708230+0000","last_became_peered":"2023-07-06T19:58:47.708230+0000","last_unstale":"2023-07-06T20:00:17.745737+0000","last_undegraded":"2023-07-06T20:00:17.745737+0000","last_fullsized":"2023-07-06T20:00:17.745737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:03:06.746603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.735958+0000","last_change":"2023-07-06T20:00:17.735958+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.735958+0000","last_undegraded":"2023-07-06T20:00:17.735958+0000","last_fullsized":"2023-07-06T20:00:17.735958+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.760563+0000","last_change":"2023-07-06T20:00:17.757297+0000","last_active":"2023-07-06T20:00:17.760563+0000","last_peered":"2023-07-06T20:00:17.760563+0000","last_clean":"2023-07-06T20:00:17.760563+0000","last_became_active":"2023-07-06T20:00:17.756965+0000","last_became_peered":"2023-07-06T20:00:17.756965+0000","last_unstale":"2023-07-06T20:00:17.760563+0000","last_undegraded":"2023-07-06T20:00:17.760563+0000","last_fullsized":"2023-07-06T20:00:17.760563+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:32:56.954102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.746405+0000","last_change":"2023-07-06T19:58:47.723926+0000","last_active":"2023-07-06T20:00:17.746405+0000","last_peered":"2023-07-06T20:00:17.746405+0000","last_clean":"2023-07-06T20:00:17.746405+0000","last_became_active":"2023-07-06T19:58:47.723646+0000","last_became_peered":"2023-07-06T19:58:47.723646+0000","last_unstale":"2023-07-06T20:00:17.746405+0000","last_undegraded":"2023-07-06T20:00:17.746405+0000","last_fullsized":"2023-07-06T20:00:17.746405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:52:32.856117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737618+0000","last_change":"2023-07-06T20:00:17.737618+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737618+0000","last_undegraded":"2023-07-06T20:00:17.737618+0000","last_fullsized":"2023-07-06T20:00:17.737618+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755941+0000","last_change":"2023-07-06T20:00:17.749291+0000","last_active":"2023-07-06T20:00:17.755941+0000","last_peered":"2023-07-06T20:00:17.755941+0000","last_clean":"2023-07-06T20:00:17.755941+0000","last_became_active":"2023-07-06T20:00:17.748503+0000","last_became_peered":"2023-07-06T20:00:17.748503+0000","last_unstale":"2023-07-06T20:00:17.755941+0000","last_undegraded":"2023-07-06T20:00:17.755941+0000","last_fullsized":"2023-07-06T20:00:17.755941+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:31:01.135507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.746057+0000","last_change":"2023-07-06T19:58:47.711918+0000","last_active":"2023-07-06T20:00:17.746057+0000","last_peered":"2023-07-06T20:00:17.746057+0000","last_clean":"2023-07-06T20:00:17.746057+0000","last_became_active":"2023-07-06T19:58:47.711591+0000","last_became_peered":"2023-07-06T19:58:47.711591+0000","last_unstale":"2023-07-06T20:00:17.746057+0000","last_undegraded":"2023-07-06T20:00:17.746057+0000","last_fullsized":"2023-07-06T20:00:17.746057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:43:44.671255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737149+0000","last_change":"2023-07-06T20:00:17.737149+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737149+0000","last_undegraded":"2023-07-06T20:00:17.737149+0000","last_fullsized":"2023-07-06T20:00:17.737149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761769+0000","last_change":"2023-07-06T20:00:17.757513+0000","last_active":"2023-07-06T20:00:17.761769+0000","last_peered":"2023-07-06T20:00:17.761769+0000","last_clean":"2023-07-06T20:00:17.761769+0000","last_became_active":"2023-07-06T20:00:17.757216+0000","last_became_peered":"2023-07-06T20:00:17.757216+0000","last_unstale":"2023-07-06T20:00:17.761769+0000","last_undegraded":"2023-07-06T20:00:17.761769+0000","last_fullsized":"2023-07-06T20:00:17.761769+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:19:35.805143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.754231+0000","last_change":"2023-07-06T19:58:47.712143+0000","last_active":"2023-07-06T20:00:17.754231+0000","last_peered":"2023-07-06T20:00:17.754231+0000","last_clean":"2023-07-06T20:00:17.754231+0000","last_became_active":"2023-07-06T19:58:47.711788+0000","last_became_peered":"2023-07-06T19:58:47.711788+0000","last_unstale":"2023-07-06T20:00:17.754231+0000","last_undegraded":"2023-07-06T20:00:17.754231+0000","last_fullsized":"2023-07-06T20:00:17.754231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:53:38.913611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":1044480,"data_stored":788727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.624},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.80800000000000005}]},{"osd":4,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.91100000000000003}]},{"osd":6,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":1.0009999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":198359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":3.129,"5min":3.129,"15min":3.129},"last":0.627}]},{"osd":3,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.47099999999999997}]},{"osd":5,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.502}]},{"osd":7,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.68300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":198359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":7.157,"5min":7.157,"15min":7.157},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.26000000000000001}]},{"osd":3,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.29099999999999998}]},{"osd":4,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.504}]},{"osd":7,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.55500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":1044480,"data_stored":788727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.317}]},{"osd":4,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.499},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":3.2029999999999998,"5min":3.2029999999999998,"15min":3.2029999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.47499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":198359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.372}]},{"osd":3,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.38}]},{"osd":4,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":198359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":3.5089999999999999,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.315},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.505},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.439}]},{"osd":5,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.41299999999999998}]},{"osd":6,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.46800000000000003}]},{"osd":7,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.48099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":198359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.63200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":198359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":0.441}]},{"osd":1,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.5},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.5870000000000002,"5min":3.5870000000000002,"15min":3.5870000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.6389999999999998,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":8.2859999999999996,"5min":8.2859999999999996,"15min":8.2859999999999996},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.57699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T20:00:23.359 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T20:00:23.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.506+0000 7f62bcbb2700 1 Processor -- start 2023-07-06T20:00:23.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.506+0000 7f62bcbb2700 1 -- start start 2023-07-06T20:00:23.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.507+0000 7f62bcbb2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b8071dd0 0x7f62b80caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:23.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.507+0000 7f62bcbb2700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f62b80cee80 0x7f62b81602c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:23.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.507+0000 7f62bcbb2700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b8160ff0 con 0x7f62b80ceab0 2023-07-06T20:00:23.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.507+0000 7f62bcbb2700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b80cb400 con 0x7f62b80cee80 2023-07-06T20:00:23.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.507+0000 7f62bcbb2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b80ca100 con 0x7f62b8071dd0 2023-07-06T20:00:23.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.507+0000 7f62b5d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b8071dd0 0x7f62b80caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:23.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.507+0000 7f62b6d9d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f62b80cee80 0x7f62b81602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:23.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.507+0000 7f62b5d9b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b8071dd0 0x7f62b80caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:53782/0 (socket says 172.21.15.6:53782) 2023-07-06T20:00:23.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.507+0000 7f62b5d9b700 1 -- 172.21.15.6:0/1325040936 learned_addr learned my addr 172.21.15.6:0/1325040936 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:23.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.508+0000 7f62b5d9b700 1 -- 172.21.15.6:0/1325040936 >> v2:172.21.15.40:3300/0 conn(0x7f62b80cee80 msgr2=0x7f62b81602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:23.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.508+0000 7f62b5d9b700 1 --2- 172.21.15.6:0/1325040936 >> v2:172.21.15.40:3300/0 conn(0x7f62b80cee80 0x7f62b81602c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.508+0000 7f62b5d9b700 1 -- 172.21.15.6:0/1325040936 >> v1:172.21.15.40:6789/0 conn(0x7f62b80ceab0 legacy=0x7f62b80716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:23.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.508+0000 7f62b5d9b700 1 -- 172.21.15.6:0/1325040936 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b80ca3e0 con 0x7f62b8071dd0 2023-07-06T20:00:23.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.508+0000 7f62b5d9b700 1 --2- 172.21.15.6:0/1325040936 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b8071dd0 0x7f62b80caec0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f62a80098f0 tx=0x7f62a8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3db528338a1ea31 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:23.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.508+0000 7f62b559a700 1 -- 172.21.15.6:0/1325040936 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a8011830 con 0x7f62b8071dd0 2023-07-06T20:00:23.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.508+0000 7f62b559a700 1 -- 172.21.15.6:0/1325040936 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a8011990 con 0x7f62b8071dd0 2023-07-06T20:00:23.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.508+0000 7f62b559a700 1 -- 172.21.15.6:0/1325040936 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a8011d20 con 0x7f62b8071dd0 2023-07-06T20:00:23.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.509+0000 7f62bcbb2700 1 -- 172.21.15.6:0/1325040936 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b8071dd0 msgr2=0x7f62b80caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:23.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.509+0000 7f62bcbb2700 1 --2- 172.21.15.6:0/1325040936 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b8071dd0 0x7f62b80caec0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f62a80098f0 tx=0x7f62a8009c00 comp rx=0 tx=0).stop 2023-07-06T20:00:23.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.509+0000 7f62bcbb2700 1 -- 172.21.15.6:0/1325040936 shutdown_connections 2023-07-06T20:00:23.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.509+0000 7f62bcbb2700 1 --2- 172.21.15.6:0/1325040936 >> v2:172.21.15.40:3300/0 conn(0x7f62b80cee80 0x7f62b81602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.509+0000 7f62bcbb2700 1 --2- 172.21.15.6:0/1325040936 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b8071dd0 0x7f62b80caec0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.509+0000 7f62bcbb2700 1 -- 172.21.15.6:0/1325040936 >> 172.21.15.6:0/1325040936 conn(0x7f62b80cc420 msgr2=0x7f62b80cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:23.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.509+0000 7f62bcbb2700 1 -- 172.21.15.6:0/1325040936 shutdown_connections 2023-07-06T20:00:23.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.509+0000 7f62bcbb2700 1 -- 172.21.15.6:0/1325040936 wait complete. 2023-07-06T20:00:23.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.510+0000 7f62bcbb2700 1 Processor -- start 2023-07-06T20:00:23.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.510+0000 7f62bcbb2700 1 -- start start 2023-07-06T20:00:23.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.511+0000 7f62bcbb2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62b8071dd0 0x7f62b80b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:23.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.511+0000 7f62bcbb2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b80ceab0 0x7f62b815aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:23.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.511+0000 7f62bcbb2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62b80cee80 0x7f62b81f1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:23.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.511+0000 7f62bcbb2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b80b36b0 con 0x7f62b80cee80 2023-07-06T20:00:23.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.511+0000 7f62bcbb2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b815b6f0 con 0x7f62b8071dd0 2023-07-06T20:00:23.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.511+0000 7f62bcbb2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b815b9d0 con 0x7f62b80ceab0 2023-07-06T20:00:23.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.511+0000 7f62b6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62b80cee80 0x7f62b81f1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:23.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.511+0000 7f62b6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62b80cee80 0x7f62b81f1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32914/0 (socket says 172.21.15.6:32914) 2023-07-06T20:00:23.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.511+0000 7f62b6d9d700 1 -- 172.21.15.6:0/3833500324 learned_addr learned my addr 172.21.15.6:0/3833500324 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:23.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.511+0000 7f62b5d9b700 1 --2- 172.21.15.6:0/3833500324 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b80ceab0 0x7f62b815aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:23.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.511+0000 7f62b659c700 1 --2- 172.21.15.6:0/3833500324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62b8071dd0 0x7f62b80b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:23.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.511+0000 7f62b6d9d700 1 -- 172.21.15.6:0/3833500324 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b80ceab0 msgr2=0x7f62b815aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:23.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.511+0000 7f62b6d9d700 1 --2- 172.21.15.6:0/3833500324 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b80ceab0 0x7f62b815aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.512+0000 7f62b6d9d700 1 -- 172.21.15.6:0/3833500324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62b8071dd0 msgr2=0x7f62b80b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:23.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.512+0000 7f62b6d9d700 1 --2- 172.21.15.6:0/3833500324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62b8071dd0 0x7f62b80b30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.512+0000 7f62b6d9d700 1 -- 172.21.15.6:0/3833500324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a8009550 con 0x7f62b80cee80 2023-07-06T20:00:23.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.512+0000 7f62b6d9d700 1 --2- 172.21.15.6:0/3833500324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62b80cee80 0x7f62b81f1590 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f62b000efc0 tx=0x7f62b000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:23.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.512+0000 7f62a6ffd700 1 -- 172.21.15.6:0/3833500324 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b0009ea0 con 0x7f62b80cee80 2023-07-06T20:00:23.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.512+0000 7f62a6ffd700 1 -- 172.21.15.6:0/3833500324 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b000f040 con 0x7f62b80cee80 2023-07-06T20:00:23.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.512+0000 7f62bcbb2700 1 -- 172.21.15.6:0/3833500324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b815bcb0 con 0x7f62b80cee80 2023-07-06T20:00:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.512+0000 7f62a6ffd700 1 -- 172.21.15.6:0/3833500324 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b000ced0 con 0x7f62b80cee80 2023-07-06T20:00:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.512+0000 7f62bcbb2700 1 -- 172.21.15.6:0/3833500324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b815b3e0 con 0x7f62b80cee80 2023-07-06T20:00:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.513+0000 7f62bcbb2700 1 -- 172.21.15.6:0/3833500324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b80b3b40 con 0x7f62b80cee80 2023-07-06T20:00:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.513+0000 7f62a6ffd700 1 -- 172.21.15.6:0/3833500324 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f62b0014480 con 0x7f62b80cee80 2023-07-06T20:00:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.514+0000 7f62a6ffd700 1 --2- 172.21.15.6:0/3833500324 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f629806ace0 0x7f629806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.514+0000 7f62a6ffd700 1 -- 172.21.15.6:0/3833500324 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f62b0089d30 con 0x7f62b80cee80 2023-07-06T20:00:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.514+0000 7f62b659c700 1 --2- 172.21.15.6:0/3833500324 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f629806ace0 0x7f629806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.514+0000 7f62b659c700 1 --2- 172.21.15.6:0/3833500324 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f629806ace0 0x7f629806d190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f62ac007fd0 tx=0x7f62ac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:23.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.518+0000 7f62a6ffd700 1 -- 172.21.15.6:0/3833500324 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f62b80b3b40 con 0x7f62b80cee80 2023-07-06T20:00:23.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.712+0000 7f62bcbb2700 1 -- 172.21.15.6:0/3833500324 --> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62b80ca9a0 con 0x7f629806ace0 2023-07-06T20:00:23.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.721+0000 7f62a6ffd700 1 -- 172.21.15.6:0/3833500324 <== mgr.4110 v2:172.21.15.6:6832/201543369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305583 (secure 0 0 0) 0x7f62ac001560 con 0x7f629806ace0 2023-07-06T20:00:23.726 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:23.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.724+0000 7f62bcbb2700 1 -- 172.21.15.6:0/3833500324 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f629806ace0 msgr2=0x7f629806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:23.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.724+0000 7f62bcbb2700 1 --2- 172.21.15.6:0/3833500324 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f629806ace0 0x7f629806d190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f62ac007fd0 tx=0x7f62ac009040 comp rx=0 tx=0).stop 2023-07-06T20:00:23.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.724+0000 7f62bcbb2700 1 -- 172.21.15.6:0/3833500324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62b80cee80 msgr2=0x7f62b81f1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:23.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.724+0000 7f62bcbb2700 1 --2- 172.21.15.6:0/3833500324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62b80cee80 0x7f62b81f1590 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f62b000efc0 tx=0x7f62b000c3a0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.724+0000 7f62bcbb2700 1 -- 172.21.15.6:0/3833500324 shutdown_connections 2023-07-06T20:00:23.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.724+0000 7f62bcbb2700 1 --2- 172.21.15.6:0/3833500324 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f629806ace0 0x7f629806d190 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.724+0000 7f62bcbb2700 1 --2- 172.21.15.6:0/3833500324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62b80cee80 0x7f62b81f1590 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.724+0000 7f62bcbb2700 1 --2- 172.21.15.6:0/3833500324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62b8071dd0 0x7f62b80b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.724+0000 7f62bcbb2700 1 --2- 172.21.15.6:0/3833500324 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f62b80ceab0 0x7f62b815aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.724+0000 7f62bcbb2700 1 -- 172.21.15.6:0/3833500324 >> 172.21.15.6:0/3833500324 conn(0x7f62b80cc420 msgr2=0x7f62b806d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:23.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.724+0000 7f62bcbb2700 1 -- 172.21.15.6:0/3833500324 shutdown_connections 2023-07-06T20:00:23.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.724+0000 7f62bcbb2700 1 -- 172.21.15.6:0/3833500324 wait complete. 2023-07-06T20:00:23.732 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-06T20:00:23.740 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2023-07-06T20:00:22.733895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220296,"kb_used_data":4680,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754424,"statfs":{"total":773094113280,"available":772868530176,"internally_reserved":0,"allocated":4792320,"data_stored":2767608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001222"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.743254+0000","last_change":"2023-07-06T20:00:17.743254+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.743254+0000","last_undegraded":"2023-07-06T20:00:17.743254+0000","last_fullsized":"2023-07-06T20:00:17.743254+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737249+0000","last_change":"2023-07-06T20:00:17.737249+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737249+0000","last_undegraded":"2023-07-06T20:00:17.737249+0000","last_fullsized":"2023-07-06T20:00:17.737249+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740525+0000","last_change":"2023-07-06T20:00:17.740525+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740525+0000","last_undegraded":"2023-07-06T20:00:17.740525+0000","last_fullsized":"2023-07-06T20:00:17.740525+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740208+0000","last_change":"2023-07-06T20:00:17.740208+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740208+0000","last_undegraded":"2023-07-06T20:00:17.740208+0000","last_fullsized":"2023-07-06T20:00:17.740208+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737134+0000","last_change":"2023-07-06T20:00:17.737134+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737134+0000","last_undegraded":"2023-07-06T20:00:17.737134+0000","last_fullsized":"2023-07-06T20:00:17.737134+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737709+0000","last_change":"2023-07-06T20:00:17.737709+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737709+0000","last_undegraded":"2023-07-06T20:00:17.737709+0000","last_fullsized":"2023-07-06T20:00:17.737709+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.741619+0000","last_change":"2023-07-06T20:00:17.741619+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.741619+0000","last_undegraded":"2023-07-06T20:00:17.741619+0000","last_fullsized":"2023-07-06T20:00:17.741619+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739812+0000","last_change":"2023-07-06T20:00:17.739812+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739812+0000","last_undegraded":"2023-07-06T20:00:17.739812+0000","last_fullsized":"2023-07-06T20:00:17.739812+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.747878+0000","last_change":"2023-07-06T20:00:17.747878+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.747878+0000","last_undegraded":"2023-07-06T20:00:17.747878+0000","last_fullsized":"2023-07-06T20:00:17.747878+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740246+0000","last_change":"2023-07-06T20:00:17.740246+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740246+0000","last_undegraded":"2023-07-06T20:00:17.740246+0000","last_fullsized":"2023-07-06T20:00:17.740246+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737847+0000","last_change":"2023-07-06T20:00:17.737847+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737847+0000","last_undegraded":"2023-07-06T20:00:17.737847+0000","last_fullsized":"2023-07-06T20:00:17.737847+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.735950+0000","last_change":"2023-07-06T20:00:17.735950+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.735950+0000","last_undegraded":"2023-07-06T20:00:17.735950+0000","last_fullsized":"2023-07-06T20:00:17.735950+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.735224+0000","last_change":"2023-07-06T20:00:17.735224+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.735224+0000","last_undegraded":"2023-07-06T20:00:17.735224+0000","last_fullsized":"2023-07-06T20:00:17.735224+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740125+0000","last_change":"2023-07-06T20:00:17.740125+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740125+0000","last_undegraded":"2023-07-06T20:00:17.740125+0000","last_fullsized":"2023-07-06T20:00:17.740125+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739659+0000","last_change":"2023-07-06T20:00:17.739659+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739659+0000","last_undegraded":"2023-07-06T20:00:17.739659+0000","last_fullsized":"2023-07-06T20:00:17.739659+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.747954+0000","last_change":"2023-07-06T20:00:17.747954+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.747954+0000","last_undegraded":"2023-07-06T20:00:17.747954+0000","last_fullsized":"2023-07-06T20:00:17.747954+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.741146+0000","last_change":"2023-07-06T20:00:17.741146+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.741146+0000","last_undegraded":"2023-07-06T20:00:17.741146+0000","last_fullsized":"2023-07-06T20:00:17.741146+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.743851+0000","last_change":"2023-07-06T20:00:17.743851+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.743851+0000","last_undegraded":"2023-07-06T20:00:17.743851+0000","last_fullsized":"2023-07-06T20:00:17.743851+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.751695+0000","last_change":"2023-07-06T20:00:17.751695+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.751695+0000","last_undegraded":"2023-07-06T20:00:17.751695+0000","last_fullsized":"2023-07-06T20:00:17.751695+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.735268+0000","last_change":"2023-07-06T20:00:17.735268+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.735268+0000","last_undegraded":"2023-07-06T20:00:17.735268+0000","last_fullsized":"2023-07-06T20:00:17.735268+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.738405+0000","last_change":"2023-07-06T20:00:17.738405+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.738405+0000","last_undegraded":"2023-07-06T20:00:17.738405+0000","last_fullsized":"2023-07-06T20:00:17.738405+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737707+0000","last_change":"2023-07-06T20:00:17.737707+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737707+0000","last_undegraded":"2023-07-06T20:00:17.737707+0000","last_fullsized":"2023-07-06T20:00:17.737707+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.751754+0000","last_change":"2023-07-06T20:00:17.751754+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.751754+0000","last_undegraded":"2023-07-06T20:00:17.751754+0000","last_fullsized":"2023-07-06T20:00:17.751754+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.747413+0000","last_change":"2023-07-06T20:00:17.747413+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.747413+0000","last_undegraded":"2023-07-06T20:00:17.747413+0000","last_fullsized":"2023-07-06T20:00:17.747413+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.747243+0000","last_change":"2023-07-06T20:00:17.747243+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.747243+0000","last_undegraded":"2023-07-06T20:00:17.747243+0000","last_fullsized":"2023-07-06T20:00:17.747243+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.735296+0000","last_change":"2023-07-06T20:00:17.735296+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.735296+0000","last_undegraded":"2023-07-06T20:00:17.735296+0000","last_fullsized":"2023-07-06T20:00:17.735296+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739964+0000","last_change":"2023-07-06T20:00:17.739964+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739964+0000","last_undegraded":"2023-07-06T20:00:17.739964+0000","last_fullsized":"2023-07-06T20:00:17.739964+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737482+0000","last_change":"2023-07-06T20:00:17.737482+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737482+0000","last_undegraded":"2023-07-06T20:00:17.737482+0000","last_fullsized":"2023-07-06T20:00:17.737482+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.746364+0000","last_change":"2023-07-06T20:00:17.746364+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.746364+0000","last_undegraded":"2023-07-06T20:00:17.746364+0000","last_fullsized":"2023-07-06T20:00:17.746364+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.742720+0000","last_change":"2023-07-06T20:00:17.742720+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.742720+0000","last_undegraded":"2023-07-06T20:00:17.742720+0000","last_fullsized":"2023-07-06T20:00:17.742720+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740508+0000","last_change":"2023-07-06T20:00:17.740508+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740508+0000","last_undegraded":"2023-07-06T20:00:17.740508+0000","last_fullsized":"2023-07-06T20:00:17.740508+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.735149+0000","last_change":"2023-07-06T20:00:17.735149+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.735149+0000","last_undegraded":"2023-07-06T20:00:17.735149+0000","last_fullsized":"2023-07-06T20:00:17.735149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.742676+0000","last_change":"2023-07-06T20:00:17.742676+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.742676+0000","last_undegraded":"2023-07-06T20:00:17.742676+0000","last_fullsized":"2023-07-06T20:00:17.742676+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761370+0000","last_change":"2023-07-06T20:00:17.758785+0000","last_active":"2023-07-06T20:00:17.761370+0000","last_peered":"2023-07-06T20:00:17.761370+0000","last_clean":"2023-07-06T20:00:17.761370+0000","last_became_active":"2023-07-06T20:00:17.758511+0000","last_became_peered":"2023-07-06T20:00:17.758511+0000","last_unstale":"2023-07-06T20:00:17.761370+0000","last_undegraded":"2023-07-06T20:00:17.761370+0000","last_fullsized":"2023-07-06T20:00:17.761370+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:11:09.727533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.752192+0000","last_change":"2023-07-06T20:00:17.752192+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.752192+0000","last_undegraded":"2023-07-06T20:00:17.752192+0000","last_fullsized":"2023-07-06T20:00:17.752192+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.758753+0000","last_change":"2023-07-06T20:00:17.754956+0000","last_active":"2023-07-06T20:00:17.758753+0000","last_peered":"2023-07-06T20:00:17.758753+0000","last_clean":"2023-07-06T20:00:17.758753+0000","last_became_active":"2023-07-06T20:00:17.754698+0000","last_became_peered":"2023-07-06T20:00:17.754698+0000","last_unstale":"2023-07-06T20:00:17.758753+0000","last_undegraded":"2023-07-06T20:00:17.758753+0000","last_fullsized":"2023-07-06T20:00:17.758753+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:44:13.823614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.736556+0000","last_change":"2023-07-06T20:00:17.736556+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.736556+0000","last_undegraded":"2023-07-06T20:00:17.736556+0000","last_fullsized":"2023-07-06T20:00:17.736556+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755124+0000","last_change":"2023-07-06T20:00:17.751853+0000","last_active":"2023-07-06T20:00:17.755124+0000","last_peered":"2023-07-06T20:00:17.755124+0000","last_clean":"2023-07-06T20:00:17.755124+0000","last_became_active":"2023-07-06T20:00:17.751574+0000","last_became_peered":"2023-07-06T20:00:17.751574+0000","last_unstale":"2023-07-06T20:00:17.755124+0000","last_undegraded":"2023-07-06T20:00:17.755124+0000","last_fullsized":"2023-07-06T20:00:17.755124+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:21:53.159655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.743759+0000","last_change":"2023-07-06T20:00:17.743759+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.743759+0000","last_undegraded":"2023-07-06T20:00:17.743759+0000","last_fullsized":"2023-07-06T20:00:17.743759+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761674+0000","last_change":"2023-07-06T20:00:17.753933+0000","last_active":"2023-07-06T20:00:17.761674+0000","last_peered":"2023-07-06T20:00:17.761674+0000","last_clean":"2023-07-06T20:00:17.761674+0000","last_became_active":"2023-07-06T20:00:17.753624+0000","last_became_peered":"2023-07-06T20:00:17.753624+0000","last_unstale":"2023-07-06T20:00:17.761674+0000","last_undegraded":"2023-07-06T20:00:17.761674+0000","last_fullsized":"2023-07-06T20:00:17.761674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:53:29.761935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.741548+0000","last_change":"2023-07-06T20:00:17.741548+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.741548+0000","last_undegraded":"2023-07-06T20:00:17.741548+0000","last_fullsized":"2023-07-06T20:00:17.741548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755524+0000","last_change":"2023-07-06T20:00:17.749676+0000","last_active":"2023-07-06T20:00:17.755524+0000","last_peered":"2023-07-06T20:00:17.755524+0000","last_clean":"2023-07-06T20:00:17.755524+0000","last_became_active":"2023-07-06T20:00:17.749394+0000","last_became_peered":"2023-07-06T20:00:17.749394+0000","last_unstale":"2023-07-06T20:00:17.755524+0000","last_undegraded":"2023-07-06T20:00:17.755524+0000","last_fullsized":"2023-07-06T20:00:17.755524+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:53:29.761935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739684+0000","last_change":"2023-07-06T20:00:17.739684+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739684+0000","last_undegraded":"2023-07-06T20:00:17.739684+0000","last_fullsized":"2023-07-06T20:00:17.739684+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755960+0000","last_change":"2023-07-06T20:00:17.750239+0000","last_active":"2023-07-06T20:00:17.755960+0000","last_peered":"2023-07-06T20:00:17.755960+0000","last_clean":"2023-07-06T20:00:17.755960+0000","last_became_active":"2023-07-06T20:00:17.749871+0000","last_became_peered":"2023-07-06T20:00:17.749871+0000","last_unstale":"2023-07-06T20:00:17.755960+0000","last_undegraded":"2023-07-06T20:00:17.755960+0000","last_fullsized":"2023-07-06T20:00:17.755960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:12:04.119622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739325+0000","last_change":"2023-07-06T20:00:17.739325+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739325+0000","last_undegraded":"2023-07-06T20:00:17.739325+0000","last_fullsized":"2023-07-06T20:00:17.739325+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.753319+0000","last_change":"2023-07-06T20:00:17.748331+0000","last_active":"2023-07-06T20:00:17.753319+0000","last_peered":"2023-07-06T20:00:17.753319+0000","last_clean":"2023-07-06T20:00:17.753319+0000","last_became_active":"2023-07-06T20:00:17.748017+0000","last_became_peered":"2023-07-06T20:00:17.748017+0000","last_unstale":"2023-07-06T20:00:17.753319+0000","last_undegraded":"2023-07-06T20:00:17.753319+0000","last_fullsized":"2023-07-06T20:00:17.753319+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:54:02.894383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.746280+0000","last_change":"2023-07-06T20:00:17.746280+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.746280+0000","last_undegraded":"2023-07-06T20:00:17.746280+0000","last_fullsized":"2023-07-06T20:00:17.746280+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755552+0000","last_change":"2023-07-06T20:00:17.750674+0000","last_active":"2023-07-06T20:00:17.755552+0000","last_peered":"2023-07-06T20:00:17.755552+0000","last_clean":"2023-07-06T20:00:17.755552+0000","last_became_active":"2023-07-06T20:00:17.749956+0000","last_became_peered":"2023-07-06T20:00:17.749956+0000","last_unstale":"2023-07-06T20:00:17.755552+0000","last_undegraded":"2023-07-06T20:00:17.755552+0000","last_fullsized":"2023-07-06T20:00:17.755552+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:24:16.127038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.742449+0000","last_change":"2023-07-06T20:00:17.742449+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.742449+0000","last_undegraded":"2023-07-06T20:00:17.742449+0000","last_fullsized":"2023-07-06T20:00:17.742449+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755884+0000","last_change":"2023-07-06T20:00:17.750053+0000","last_active":"2023-07-06T20:00:17.755884+0000","last_peered":"2023-07-06T20:00:17.755884+0000","last_clean":"2023-07-06T20:00:17.755884+0000","last_became_active":"2023-07-06T20:00:17.749690+0000","last_became_peered":"2023-07-06T20:00:17.749690+0000","last_unstale":"2023-07-06T20:00:17.755884+0000","last_undegraded":"2023-07-06T20:00:17.755884+0000","last_fullsized":"2023-07-06T20:00:17.755884+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:11:32.106916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.742789+0000","last_change":"2023-07-06T20:00:17.742789+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.742789+0000","last_undegraded":"2023-07-06T20:00:17.742789+0000","last_fullsized":"2023-07-06T20:00:17.742789+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761115+0000","last_change":"2023-07-06T20:00:17.756702+0000","last_active":"2023-07-06T20:00:17.761115+0000","last_peered":"2023-07-06T20:00:17.761115+0000","last_clean":"2023-07-06T20:00:17.761115+0000","last_became_active":"2023-07-06T20:00:17.756498+0000","last_became_peered":"2023-07-06T20:00:17.756498+0000","last_unstale":"2023-07-06T20:00:17.761115+0000","last_undegraded":"2023-07-06T20:00:17.761115+0000","last_fullsized":"2023-07-06T20:00:17.761115+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:21:53.159655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739078+0000","last_change":"2023-07-06T20:00:17.739078+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739078+0000","last_undegraded":"2023-07-06T20:00:17.739078+0000","last_fullsized":"2023-07-06T20:00:17.739078+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761813+0000","last_change":"2023-07-06T20:00:17.758181+0000","last_active":"2023-07-06T20:00:17.761813+0000","last_peered":"2023-07-06T20:00:17.761813+0000","last_clean":"2023-07-06T20:00:17.761813+0000","last_became_active":"2023-07-06T20:00:17.757621+0000","last_became_peered":"2023-07-06T20:00:17.757621+0000","last_unstale":"2023-07-06T20:00:17.761813+0000","last_undegraded":"2023-07-06T20:00:17.761813+0000","last_fullsized":"2023-07-06T20:00:17.761813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:11:09.727533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740073+0000","last_change":"2023-07-06T20:00:17.740073+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740073+0000","last_undegraded":"2023-07-06T20:00:17.740073+0000","last_fullsized":"2023-07-06T20:00:17.740073+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.748501+0000","last_change":"2023-07-06T20:00:17.744182+0000","last_active":"2023-07-06T20:00:17.748501+0000","last_peered":"2023-07-06T20:00:17.748501+0000","last_clean":"2023-07-06T20:00:17.748501+0000","last_became_active":"2023-07-06T20:00:17.743898+0000","last_became_peered":"2023-07-06T20:00:17.743898+0000","last_unstale":"2023-07-06T20:00:17.748501+0000","last_undegraded":"2023-07-06T20:00:17.748501+0000","last_fullsized":"2023-07-06T20:00:17.748501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:52:44.455571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.750181+0000","last_change":"2023-07-06T20:00:17.750181+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.750181+0000","last_undegraded":"2023-07-06T20:00:17.750181+0000","last_fullsized":"2023-07-06T20:00:17.750181+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755541+0000","last_change":"2023-07-06T20:00:17.752168+0000","last_active":"2023-07-06T20:00:17.755541+0000","last_peered":"2023-07-06T20:00:17.755541+0000","last_clean":"2023-07-06T20:00:17.755541+0000","last_became_active":"2023-07-06T20:00:17.751874+0000","last_became_peered":"2023-07-06T20:00:17.751874+0000","last_unstale":"2023-07-06T20:00:17.755541+0000","last_undegraded":"2023-07-06T20:00:17.755541+0000","last_fullsized":"2023-07-06T20:00:17.755541+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:31:05.588401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739186+0000","last_change":"2023-07-06T20:00:17.739186+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739186+0000","last_undegraded":"2023-07-06T20:00:17.739186+0000","last_fullsized":"2023-07-06T20:00:17.739186+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761708+0000","last_change":"2023-07-06T20:00:17.755859+0000","last_active":"2023-07-06T20:00:17.761708+0000","last_peered":"2023-07-06T20:00:17.761708+0000","last_clean":"2023-07-06T20:00:17.761708+0000","last_became_active":"2023-07-06T20:00:17.755572+0000","last_became_peered":"2023-07-06T20:00:17.755572+0000","last_unstale":"2023-07-06T20:00:17.761708+0000","last_undegraded":"2023-07-06T20:00:17.761708+0000","last_fullsized":"2023-07-06T20:00:17.761708+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:09:34.121891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737099+0000","last_change":"2023-07-06T20:00:17.737099+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737099+0000","last_undegraded":"2023-07-06T20:00:17.737099+0000","last_fullsized":"2023-07-06T20:00:17.737099+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.756216+0000","last_change":"2023-07-06T20:00:17.754316+0000","last_active":"2023-07-06T20:00:17.756216+0000","last_peered":"2023-07-06T20:00:17.756216+0000","last_clean":"2023-07-06T20:00:17.756216+0000","last_became_active":"2023-07-06T20:00:17.753974+0000","last_became_peered":"2023-07-06T20:00:17.753974+0000","last_unstale":"2023-07-06T20:00:17.756216+0000","last_undegraded":"2023-07-06T20:00:17.756216+0000","last_fullsized":"2023-07-06T20:00:17.756216+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:04:36.784868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740959+0000","last_change":"2023-07-06T20:00:17.740959+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740959+0000","last_undegraded":"2023-07-06T20:00:17.740959+0000","last_fullsized":"2023-07-06T20:00:17.740959+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755594+0000","last_change":"2023-07-06T20:00:17.750850+0000","last_active":"2023-07-06T20:00:17.755594+0000","last_peered":"2023-07-06T20:00:17.755594+0000","last_clean":"2023-07-06T20:00:17.755594+0000","last_became_active":"2023-07-06T20:00:17.750550+0000","last_became_peered":"2023-07-06T20:00:17.750550+0000","last_unstale":"2023-07-06T20:00:17.755594+0000","last_undegraded":"2023-07-06T20:00:17.755594+0000","last_fullsized":"2023-07-06T20:00:17.755594+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:02:02.761364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.734629+0000","last_change":"2023-07-06T20:00:17.734629+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.734629+0000","last_undegraded":"2023-07-06T20:00:17.734629+0000","last_fullsized":"2023-07-06T20:00:17.734629+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.752051+0000","last_change":"2023-07-06T20:00:17.747641+0000","last_active":"2023-07-06T20:00:17.752051+0000","last_peered":"2023-07-06T20:00:17.752051+0000","last_clean":"2023-07-06T20:00:17.752051+0000","last_became_active":"2023-07-06T20:00:17.747332+0000","last_became_peered":"2023-07-06T20:00:17.747332+0000","last_unstale":"2023-07-06T20:00:17.752051+0000","last_undegraded":"2023-07-06T20:00:17.752051+0000","last_fullsized":"2023-07-06T20:00:17.752051+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:36:08.499704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740454+0000","last_change":"2023-07-06T20:00:17.740454+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740454+0000","last_undegraded":"2023-07-06T20:00:17.740454+0000","last_fullsized":"2023-07-06T20:00:17.740454+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.756014+0000","last_change":"2023-07-06T20:00:17.750549+0000","last_active":"2023-07-06T20:00:17.756014+0000","last_peered":"2023-07-06T20:00:17.756014+0000","last_clean":"2023-07-06T20:00:17.756014+0000","last_became_active":"2023-07-06T20:00:17.749747+0000","last_became_peered":"2023-07-06T20:00:17.749747+0000","last_unstale":"2023-07-06T20:00:17.756014+0000","last_undegraded":"2023-07-06T20:00:17.756014+0000","last_fullsized":"2023-07-06T20:00:17.756014+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:15:57.765205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.752039+0000","last_change":"2023-07-06T20:00:17.752039+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.752039+0000","last_undegraded":"2023-07-06T20:00:17.752039+0000","last_fullsized":"2023-07-06T20:00:17.752039+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.753289+0000","last_change":"2023-07-06T20:00:17.749209+0000","last_active":"2023-07-06T20:00:17.753289+0000","last_peered":"2023-07-06T20:00:17.753289+0000","last_clean":"2023-07-06T20:00:17.753289+0000","last_became_active":"2023-07-06T20:00:17.748680+0000","last_became_peered":"2023-07-06T20:00:17.748680+0000","last_unstale":"2023-07-06T20:00:17.753289+0000","last_undegraded":"2023-07-06T20:00:17.753289+0000","last_fullsized":"2023-07-06T20:00:17.753289+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:16:23.089607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.746358+0000","last_change":"2023-07-06T20:00:17.746358+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.746358+0000","last_undegraded":"2023-07-06T20:00:17.746358+0000","last_fullsized":"2023-07-06T20:00:17.746358+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761360+0000","last_change":"2023-07-06T20:00:17.758772+0000","last_active":"2023-07-06T20:00:17.761360+0000","last_peered":"2023-07-06T20:00:17.761360+0000","last_clean":"2023-07-06T20:00:17.761360+0000","last_became_active":"2023-07-06T20:00:17.758536+0000","last_became_peered":"2023-07-06T20:00:17.758536+0000","last_unstale":"2023-07-06T20:00:17.761360+0000","last_undegraded":"2023-07-06T20:00:17.761360+0000","last_fullsized":"2023-07-06T20:00:17.761360+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:01:36.817991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.738198+0000","last_change":"2023-07-06T20:00:17.738198+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.738198+0000","last_undegraded":"2023-07-06T20:00:17.738198+0000","last_fullsized":"2023-07-06T20:00:17.738198+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755503+0000","last_change":"2023-07-06T20:00:17.749103+0000","last_active":"2023-07-06T20:00:17.755503+0000","last_peered":"2023-07-06T20:00:17.755503+0000","last_clean":"2023-07-06T20:00:17.755503+0000","last_became_active":"2023-07-06T20:00:17.748753+0000","last_became_peered":"2023-07-06T20:00:17.748753+0000","last_unstale":"2023-07-06T20:00:17.755503+0000","last_undegraded":"2023-07-06T20:00:17.755503+0000","last_fullsized":"2023-07-06T20:00:17.755503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:01:43.769188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.744963+0000","last_change":"2023-07-06T20:00:17.744963+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.744963+0000","last_undegraded":"2023-07-06T20:00:17.744963+0000","last_fullsized":"2023-07-06T20:00:17.744963+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761329+0000","last_change":"2023-07-06T20:00:17.757297+0000","last_active":"2023-07-06T20:00:17.761329+0000","last_peered":"2023-07-06T20:00:17.761329+0000","last_clean":"2023-07-06T20:00:17.761329+0000","last_became_active":"2023-07-06T20:00:17.756954+0000","last_became_peered":"2023-07-06T20:00:17.756954+0000","last_unstale":"2023-07-06T20:00:17.761329+0000","last_undegraded":"2023-07-06T20:00:17.761329+0000","last_fullsized":"2023-07-06T20:00:17.761329+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:27:01.557116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.734557+0000","last_change":"2023-07-06T20:00:17.734557+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.734557+0000","last_undegraded":"2023-07-06T20:00:17.734557+0000","last_fullsized":"2023-07-06T20:00:17.734557+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755486+0000","last_change":"2023-07-06T20:00:17.749817+0000","last_active":"2023-07-06T20:00:17.755486+0000","last_peered":"2023-07-06T20:00:17.755486+0000","last_clean":"2023-07-06T20:00:17.755486+0000","last_became_active":"2023-07-06T20:00:17.749463+0000","last_became_peered":"2023-07-06T20:00:17.749463+0000","last_unstale":"2023-07-06T20:00:17.755486+0000","last_undegraded":"2023-07-06T20:00:17.755486+0000","last_fullsized":"2023-07-06T20:00:17.755486+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:03:37.487548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.738238+0000","last_change":"2023-07-06T20:00:17.738238+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.738238+0000","last_undegraded":"2023-07-06T20:00:17.738238+0000","last_fullsized":"2023-07-06T20:00:17.738238+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761738+0000","last_change":"2023-07-06T20:00:17.756010+0000","last_active":"2023-07-06T20:00:17.761738+0000","last_peered":"2023-07-06T20:00:17.761738+0000","last_clean":"2023-07-06T20:00:17.761738+0000","last_became_active":"2023-07-06T20:00:17.755721+0000","last_became_peered":"2023-07-06T20:00:17.755721+0000","last_unstale":"2023-07-06T20:00:17.761738+0000","last_undegraded":"2023-07-06T20:00:17.761738+0000","last_fullsized":"2023-07-06T20:00:17.761738+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:01:36.817991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739513+0000","last_change":"2023-07-06T20:00:17.739513+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739513+0000","last_undegraded":"2023-07-06T20:00:17.739513+0000","last_fullsized":"2023-07-06T20:00:17.739513+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755574+0000","last_change":"2023-07-06T20:00:17.750835+0000","last_active":"2023-07-06T20:00:17.755574+0000","last_peered":"2023-07-06T20:00:17.755574+0000","last_clean":"2023-07-06T20:00:17.755574+0000","last_became_active":"2023-07-06T20:00:17.750359+0000","last_became_peered":"2023-07-06T20:00:17.750359+0000","last_unstale":"2023-07-06T20:00:17.755574+0000","last_undegraded":"2023-07-06T20:00:17.755574+0000","last_fullsized":"2023-07-06T20:00:17.755574+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:23:22.777673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.745377+0000","last_change":"2023-07-06T19:58:47.723855+0000","last_active":"2023-07-06T20:00:17.745377+0000","last_peered":"2023-07-06T20:00:17.745377+0000","last_clean":"2023-07-06T20:00:17.745377+0000","last_became_active":"2023-07-06T19:58:47.723553+0000","last_became_peered":"2023-07-06T19:58:47.723553+0000","last_unstale":"2023-07-06T20:00:17.745377+0000","last_undegraded":"2023-07-06T20:00:17.745377+0000","last_fullsized":"2023-07-06T20:00:17.745377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:20:20.035886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.747848+0000","last_change":"2023-07-06T20:00:17.747848+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.747848+0000","last_undegraded":"2023-07-06T20:00:17.747848+0000","last_fullsized":"2023-07-06T20:00:17.747848+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755295+0000","last_change":"2023-07-06T20:00:17.751341+0000","last_active":"2023-07-06T20:00:17.755295+0000","last_peered":"2023-07-06T20:00:17.755295+0000","last_clean":"2023-07-06T20:00:17.755295+0000","last_became_active":"2023-07-06T20:00:17.751050+0000","last_became_peered":"2023-07-06T20:00:17.751050+0000","last_unstale":"2023-07-06T20:00:17.755295+0000","last_undegraded":"2023-07-06T20:00:17.755295+0000","last_fullsized":"2023-07-06T20:00:17.755295+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:57:19.370748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.737895+0000","last_change":"2023-07-06T19:58:47.705294+0000","last_active":"2023-07-06T20:00:17.737895+0000","last_peered":"2023-07-06T20:00:17.737895+0000","last_clean":"2023-07-06T20:00:17.737895+0000","last_became_active":"2023-07-06T19:58:47.704921+0000","last_became_peered":"2023-07-06T19:58:47.704921+0000","last_unstale":"2023-07-06T20:00:17.737895+0000","last_undegraded":"2023-07-06T20:00:17.737895+0000","last_fullsized":"2023-07-06T20:00:17.737895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:50:37.171246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.738631+0000","last_change":"2023-07-06T20:00:17.738631+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.738631+0000","last_undegraded":"2023-07-06T20:00:17.738631+0000","last_fullsized":"2023-07-06T20:00:17.738631+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761830+0000","last_change":"2023-07-06T20:00:17.758366+0000","last_active":"2023-07-06T20:00:17.761830+0000","last_peered":"2023-07-06T20:00:17.761830+0000","last_clean":"2023-07-06T20:00:17.761830+0000","last_became_active":"2023-07-06T20:00:17.757940+0000","last_became_peered":"2023-07-06T20:00:17.757940+0000","last_unstale":"2023-07-06T20:00:17.761830+0000","last_undegraded":"2023-07-06T20:00:17.761830+0000","last_fullsized":"2023-07-06T20:00:17.761830+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:43:44.061833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.732142+0000","last_change":"2023-07-06T19:58:47.766992+0000","last_active":"2023-07-06T20:00:17.732142+0000","last_peered":"2023-07-06T20:00:17.732142+0000","last_clean":"2023-07-06T20:00:17.732142+0000","last_became_active":"2023-07-06T19:58:47.766697+0000","last_became_peered":"2023-07-06T19:58:47.766697+0000","last_unstale":"2023-07-06T20:00:17.732142+0000","last_undegraded":"2023-07-06T20:00:17.732142+0000","last_fullsized":"2023-07-06T20:00:17.732142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:33:15.971622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.738186+0000","last_change":"2023-07-06T20:00:17.738186+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.738186+0000","last_undegraded":"2023-07-06T20:00:17.738186+0000","last_fullsized":"2023-07-06T20:00:17.738186+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.750938+0000","last_change":"2023-07-06T20:00:17.745505+0000","last_active":"2023-07-06T20:00:17.750938+0000","last_peered":"2023-07-06T20:00:17.750938+0000","last_clean":"2023-07-06T20:00:17.750938+0000","last_became_active":"2023-07-06T20:00:17.745185+0000","last_became_peered":"2023-07-06T20:00:17.745185+0000","last_unstale":"2023-07-06T20:00:17.750938+0000","last_undegraded":"2023-07-06T20:00:17.750938+0000","last_fullsized":"2023-07-06T20:00:17.750938+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:24:34.665958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.737860+0000","last_change":"2023-07-06T19:58:47.704498+0000","last_active":"2023-07-06T20:00:17.737860+0000","last_peered":"2023-07-06T20:00:17.737860+0000","last_clean":"2023-07-06T20:00:17.737860+0000","last_became_active":"2023-07-06T19:58:47.704172+0000","last_became_peered":"2023-07-06T19:58:47.704172+0000","last_unstale":"2023-07-06T20:00:17.737860+0000","last_undegraded":"2023-07-06T20:00:17.737860+0000","last_fullsized":"2023-07-06T20:00:17.737860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:24:23.512468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":203,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.745857+0000","last_change":"2023-07-06T19:58:40.972763+0000","last_active":"2023-07-06T20:00:17.745857+0000","last_peered":"2023-07-06T20:00:17.745857+0000","last_clean":"2023-07-06T20:00:17.745857+0000","last_became_active":"2023-07-06T19:58:40.971570+0000","last_became_peered":"2023-07-06T19:58:40.971570+0000","last_unstale":"2023-07-06T20:00:17.745857+0000","last_undegraded":"2023-07-06T20:00:17.745857+0000","last_fullsized":"2023-07-06T20:00:17.745857+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_clean_scrub_stamp":"2023-07-06T19:58:39.653546+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:25:14.499210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739541+0000","last_change":"2023-07-06T20:00:17.739541+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739541+0000","last_undegraded":"2023-07-06T20:00:17.739541+0000","last_fullsized":"2023-07-06T20:00:17.739541+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.757612+0000","last_change":"2023-07-06T20:00:17.755288+0000","last_active":"2023-07-06T20:00:17.757612+0000","last_peered":"2023-07-06T20:00:17.757612+0000","last_clean":"2023-07-06T20:00:17.757612+0000","last_became_active":"2023-07-06T20:00:17.754948+0000","last_became_peered":"2023-07-06T20:00:17.754948+0000","last_unstale":"2023-07-06T20:00:17.757612+0000","last_undegraded":"2023-07-06T20:00:17.757612+0000","last_fullsized":"2023-07-06T20:00:17.757612+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:03:37.487548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.745737+0000","last_change":"2023-07-06T19:58:47.708545+0000","last_active":"2023-07-06T20:00:17.745737+0000","last_peered":"2023-07-06T20:00:17.745737+0000","last_clean":"2023-07-06T20:00:17.745737+0000","last_became_active":"2023-07-06T19:58:47.708230+0000","last_became_peered":"2023-07-06T19:58:47.708230+0000","last_unstale":"2023-07-06T20:00:17.745737+0000","last_undegraded":"2023-07-06T20:00:17.745737+0000","last_fullsized":"2023-07-06T20:00:17.745737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:03:06.746603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.735958+0000","last_change":"2023-07-06T20:00:17.735958+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.735958+0000","last_undegraded":"2023-07-06T20:00:17.735958+0000","last_fullsized":"2023-07-06T20:00:17.735958+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.760563+0000","last_change":"2023-07-06T20:00:17.757297+0000","last_active":"2023-07-06T20:00:17.760563+0000","last_peered":"2023-07-06T20:00:17.760563+0000","last_clean":"2023-07-06T20:00:17.760563+0000","last_became_active":"2023-07-06T20:00:17.756965+0000","last_became_peered":"2023-07-06T20:00:17.756965+0000","last_unstale":"2023-07-06T20:00:17.760563+0000","last_undegraded":"2023-07-06T20:00:17.760563+0000","last_fullsized":"2023-07-06T20:00:17.760563+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:32:56.954102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.746405+0000","last_change":"2023-07-06T19:58:47.723926+0000","last_active":"2023-07-06T20:00:17.746405+0000","last_peered":"2023-07-06T20:00:17.746405+0000","last_clean":"2023-07-06T20:00:17.746405+0000","last_became_active":"2023-07-06T19:58:47.723646+0000","last_became_peered":"2023-07-06T19:58:47.723646+0000","last_unstale":"2023-07-06T20:00:17.746405+0000","last_undegraded":"2023-07-06T20:00:17.746405+0000","last_fullsized":"2023-07-06T20:00:17.746405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:52:32.856117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737618+0000","last_change":"2023-07-06T20:00:17.737618+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737618+0000","last_undegraded":"2023-07-06T20:00:17.737618+0000","last_fullsized":"2023-07-06T20:00:17.737618+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755941+0000","last_change":"2023-07-06T20:00:17.749291+0000","last_active":"2023-07-06T20:00:17.755941+0000","last_peered":"2023-07-06T20:00:17.755941+0000","last_clean":"2023-07-06T20:00:17.755941+0000","last_became_active":"2023-07-06T20:00:17.748503+0000","last_became_peered":"2023-07-06T20:00:17.748503+0000","last_unstale":"2023-07-06T20:00:17.755941+0000","last_undegraded":"2023-07-06T20:00:17.755941+0000","last_fullsized":"2023-07-06T20:00:17.755941+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:31:01.135507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.746057+0000","last_change":"2023-07-06T19:58:47.711918+0000","last_active":"2023-07-06T20:00:17.746057+0000","last_peered":"2023-07-06T20:00:17.746057+0000","last_clean":"2023-07-06T20:00:17.746057+0000","last_became_active":"2023-07-06T19:58:47.711591+0000","last_became_peered":"2023-07-06T19:58:47.711591+0000","last_unstale":"2023-07-06T20:00:17.746057+0000","last_undegraded":"2023-07-06T20:00:17.746057+0000","last_fullsized":"2023-07-06T20:00:17.746057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:43:44.671255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737149+0000","last_change":"2023-07-06T20:00:17.737149+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737149+0000","last_undegraded":"2023-07-06T20:00:17.737149+0000","last_fullsized":"2023-07-06T20:00:17.737149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761769+0000","last_change":"2023-07-06T20:00:17.757513+0000","last_active":"2023-07-06T20:00:17.761769+0000","last_peered":"2023-07-06T20:00:17.761769+0000","last_clean":"2023-07-06T20:00:17.761769+0000","last_became_active":"2023-07-06T20:00:17.757216+0000","last_became_peered":"2023-07-06T20:00:17.757216+0000","last_unstale":"2023-07-06T20:00:17.761769+0000","last_undegraded":"2023-07-06T20:00:17.761769+0000","last_fullsized":"2023-07-06T20:00:17.761769+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:19:35.805143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.754231+0000","last_change":"2023-07-06T19:58:47.712143+0000","last_active":"2023-07-06T20:00:17.754231+0000","last_peered":"2023-07-06T20:00:17.754231+0000","last_clean":"2023-07-06T20:00:17.754231+0000","last_became_active":"2023-07-06T19:58:47.711788+0000","last_became_peered":"2023-07-06T19:58:47.711788+0000","last_unstale":"2023-07-06T20:00:17.754231+0000","last_undegraded":"2023-07-06T20:00:17.754231+0000","last_fullsized":"2023-07-06T20:00:17.754231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:53:38.913611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":1044480,"data_stored":788727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.624},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.80800000000000005}]},{"osd":4,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.91100000000000003}]},{"osd":6,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":1.0009999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":198359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":3.129,"5min":3.129,"15min":3.129},"last":0.627}]},{"osd":3,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.47099999999999997}]},{"osd":5,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.502}]},{"osd":7,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.68300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":198359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":7.157,"5min":7.157,"15min":7.157},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.26000000000000001}]},{"osd":3,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.29099999999999998}]},{"osd":4,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.504}]},{"osd":7,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.55500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":1044480,"data_stored":788727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.317}]},{"osd":4,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.499},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":3.2029999999999998,"5min":3.2029999999999998,"15min":3.2029999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.47499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":198359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.372}]},{"osd":3,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.38}]},{"osd":4,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":198359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":3.5089999999999999,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.315},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.505},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.439}]},{"osd":5,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.41299999999999998}]},{"osd":6,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.46800000000000003}]},{"osd":7,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.48099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":198359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.63200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":198359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":0.441}]},{"osd":1,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.5},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.5870000000000002,"5min":3.5870000000000002,"15min":3.5870000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.6389999999999998,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":8.2859999999999996,"5min":8.2859999999999996,"15min":8.2859999999999996},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.57699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T20:00:23.749 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2023-07-06T20:00:23.749 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.743254+0000', 'last_change': '2023-07-06T20:00:17.743254+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.743254+0000', 'last_undegraded': '2023-07-06T20:00:17.743254+0000', 'last_fullsized': '2023-07-06T20:00:17.743254+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T20:00:23.750 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2023-07-06T20:00:23.750 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.737249+0000', 'last_change': '2023-07-06T20:00:17.737249+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.737249+0000', 'last_undegraded': '2023-07-06T20:00:17.737249+0000', 'last_fullsized': '2023-07-06T20:00:17.737249+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T20:00:23.751 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-07-06T20:00:23.751 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.740525+0000', 'last_change': '2023-07-06T20:00:17.740525+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.740525+0000', 'last_undegraded': '2023-07-06T20:00:17.740525+0000', 'last_fullsized': '2023-07-06T20:00:17.740525+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T20:00:23.752 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2023-07-06T20:00:23.752 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.740208+0000', 'last_change': '2023-07-06T20:00:17.740208+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.740208+0000', 'last_undegraded': '2023-07-06T20:00:17.740208+0000', 'last_fullsized': '2023-07-06T20:00:17.740208+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T20:00:23.753 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2023-07-06T20:00:23.753 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.737134+0000', 'last_change': '2023-07-06T20:00:17.737134+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.737134+0000', 'last_undegraded': '2023-07-06T20:00:17.737134+0000', 'last_fullsized': '2023-07-06T20:00:17.737134+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T20:00:23.753 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2023-07-06T20:00:23.753 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.737709+0000', 'last_change': '2023-07-06T20:00:17.737709+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.737709+0000', 'last_undegraded': '2023-07-06T20:00:17.737709+0000', 'last_fullsized': '2023-07-06T20:00:17.737709+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T20:00:23.754 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2023-07-06T20:00:23.754 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.741619+0000', 'last_change': '2023-07-06T20:00:17.741619+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.741619+0000', 'last_undegraded': '2023-07-06T20:00:17.741619+0000', 'last_fullsized': '2023-07-06T20:00:17.741619+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T20:00:23.754 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2023-07-06T20:00:23.755 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.739812+0000', 'last_change': '2023-07-06T20:00:17.739812+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.739812+0000', 'last_undegraded': '2023-07-06T20:00:17.739812+0000', 'last_fullsized': '2023-07-06T20:00:17.739812+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T20:00:23.756 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2023-07-06T20:00:23.756 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.747878+0000', 'last_change': '2023-07-06T20:00:17.747878+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.747878+0000', 'last_undegraded': '2023-07-06T20:00:17.747878+0000', 'last_fullsized': '2023-07-06T20:00:17.747878+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T20:00:23.756 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2023-07-06T20:00:23.757 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.740246+0000', 'last_change': '2023-07-06T20:00:17.740246+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.740246+0000', 'last_undegraded': '2023-07-06T20:00:17.740246+0000', 'last_fullsized': '2023-07-06T20:00:17.740246+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T20:00:23.757 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2023-07-06T20:00:23.758 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.737847+0000', 'last_change': '2023-07-06T20:00:17.737847+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.737847+0000', 'last_undegraded': '2023-07-06T20:00:17.737847+0000', 'last_fullsized': '2023-07-06T20:00:17.737847+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T20:00:23.759 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2023-07-06T20:00:23.759 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.735950+0000', 'last_change': '2023-07-06T20:00:17.735950+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.735950+0000', 'last_undegraded': '2023-07-06T20:00:17.735950+0000', 'last_fullsized': '2023-07-06T20:00:17.735950+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T20:00:23.760 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2023-07-06T20:00:23.760 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.735224+0000', 'last_change': '2023-07-06T20:00:17.735224+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.735224+0000', 'last_undegraded': '2023-07-06T20:00:17.735224+0000', 'last_fullsized': '2023-07-06T20:00:17.735224+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T20:00:23.760 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2023-07-06T20:00:23.760 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.740125+0000', 'last_change': '2023-07-06T20:00:17.740125+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.740125+0000', 'last_undegraded': '2023-07-06T20:00:17.740125+0000', 'last_fullsized': '2023-07-06T20:00:17.740125+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T20:00:23.761 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2023-07-06T20:00:23.761 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.739659+0000', 'last_change': '2023-07-06T20:00:17.739659+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.739659+0000', 'last_undegraded': '2023-07-06T20:00:17.739659+0000', 'last_fullsized': '2023-07-06T20:00:17.739659+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T20:00:23.761 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-07-06T20:00:23.762 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.747954+0000', 'last_change': '2023-07-06T20:00:17.747954+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.747954+0000', 'last_undegraded': '2023-07-06T20:00:17.747954+0000', 'last_fullsized': '2023-07-06T20:00:17.747954+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T20:00:23.762 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2023-07-06T20:00:23.762 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.741146+0000', 'last_change': '2023-07-06T20:00:17.741146+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.741146+0000', 'last_undegraded': '2023-07-06T20:00:17.741146+0000', 'last_fullsized': '2023-07-06T20:00:17.741146+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T20:00:23.763 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-07-06T20:00:23.763 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.743851+0000', 'last_change': '2023-07-06T20:00:17.743851+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.743851+0000', 'last_undegraded': '2023-07-06T20:00:17.743851+0000', 'last_fullsized': '2023-07-06T20:00:17.743851+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T20:00:23.763 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2023-07-06T20:00:23.764 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.751695+0000', 'last_change': '2023-07-06T20:00:17.751695+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.751695+0000', 'last_undegraded': '2023-07-06T20:00:17.751695+0000', 'last_fullsized': '2023-07-06T20:00:17.751695+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T20:00:23.764 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2023-07-06T20:00:23.765 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.735268+0000', 'last_change': '2023-07-06T20:00:17.735268+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.735268+0000', 'last_undegraded': '2023-07-06T20:00:17.735268+0000', 'last_fullsized': '2023-07-06T20:00:17.735268+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T20:00:23.765 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2023-07-06T20:00:23.765 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.738405+0000', 'last_change': '2023-07-06T20:00:17.738405+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.738405+0000', 'last_undegraded': '2023-07-06T20:00:17.738405+0000', 'last_fullsized': '2023-07-06T20:00:17.738405+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T20:00:23.766 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2023-07-06T20:00:23.767 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.737707+0000', 'last_change': '2023-07-06T20:00:17.737707+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.737707+0000', 'last_undegraded': '2023-07-06T20:00:17.737707+0000', 'last_fullsized': '2023-07-06T20:00:17.737707+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T20:00:23.767 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2023-07-06T20:00:23.770 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.751754+0000', 'last_change': '2023-07-06T20:00:17.751754+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.751754+0000', 'last_undegraded': '2023-07-06T20:00:17.751754+0000', 'last_fullsized': '2023-07-06T20:00:17.751754+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T20:00:23.771 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2023-07-06T20:00:23.771 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.747413+0000', 'last_change': '2023-07-06T20:00:17.747413+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.747413+0000', 'last_undegraded': '2023-07-06T20:00:17.747413+0000', 'last_fullsized': '2023-07-06T20:00:17.747413+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T20:00:23.772 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2023-07-06T20:00:23.772 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.747243+0000', 'last_change': '2023-07-06T20:00:17.747243+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.747243+0000', 'last_undegraded': '2023-07-06T20:00:17.747243+0000', 'last_fullsized': '2023-07-06T20:00:17.747243+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T20:00:23.772 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2023-07-06T20:00:23.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.735296+0000', 'last_change': '2023-07-06T20:00:17.735296+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.735296+0000', 'last_undegraded': '2023-07-06T20:00:17.735296+0000', 'last_fullsized': '2023-07-06T20:00:17.735296+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T20:00:23.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-07-06T20:00:23.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.739964+0000', 'last_change': '2023-07-06T20:00:17.739964+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.739964+0000', 'last_undegraded': '2023-07-06T20:00:17.739964+0000', 'last_fullsized': '2023-07-06T20:00:17.739964+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T20:00:23.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2023-07-06T20:00:23.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.737482+0000', 'last_change': '2023-07-06T20:00:17.737482+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.737482+0000', 'last_undegraded': '2023-07-06T20:00:17.737482+0000', 'last_fullsized': '2023-07-06T20:00:17.737482+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T20:00:23.775 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2023-07-06T20:00:23.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.746364+0000', 'last_change': '2023-07-06T20:00:17.746364+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.746364+0000', 'last_undegraded': '2023-07-06T20:00:17.746364+0000', 'last_fullsized': '2023-07-06T20:00:17.746364+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T20:00:23.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2023-07-06T20:00:23.776 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.742720+0000', 'last_change': '2023-07-06T20:00:17.742720+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.742720+0000', 'last_undegraded': '2023-07-06T20:00:17.742720+0000', 'last_fullsized': '2023-07-06T20:00:17.742720+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T20:00:23.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2023-07-06T20:00:23.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.740508+0000', 'last_change': '2023-07-06T20:00:17.740508+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.740508+0000', 'last_undegraded': '2023-07-06T20:00:17.740508+0000', 'last_fullsized': '2023-07-06T20:00:17.740508+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T20:00:23.777 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2023-07-06T20:00:23.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.735149+0000', 'last_change': '2023-07-06T20:00:17.735149+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.735149+0000', 'last_undegraded': '2023-07-06T20:00:17.735149+0000', 'last_fullsized': '2023-07-06T20:00:17.735149+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T20:00:23.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2023-07-06T20:00:23.778 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.742676+0000', 'last_change': '2023-07-06T20:00:17.742676+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.742676+0000', 'last_undegraded': '2023-07-06T20:00:17.742676+0000', 'last_fullsized': '2023-07-06T20:00:17.742676+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T20:00:23.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-07-06T20:00:23.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.752192+0000', 'last_change': '2023-07-06T20:00:17.752192+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.752192+0000', 'last_undegraded': '2023-07-06T20:00:17.752192+0000', 'last_fullsized': '2023-07-06T20:00:17.752192+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T20:00:23.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-07-06T20:00:23.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.736556+0000', 'last_change': '2023-07-06T20:00:17.736556+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.736556+0000', 'last_undegraded': '2023-07-06T20:00:17.736556+0000', 'last_fullsized': '2023-07-06T20:00:17.736556+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T20:00:23.780 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2023-07-06T20:00:23.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.743759+0000', 'last_change': '2023-07-06T20:00:17.743759+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.743759+0000', 'last_undegraded': '2023-07-06T20:00:17.743759+0000', 'last_fullsized': '2023-07-06T20:00:17.743759+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T20:00:23.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-07-06T20:00:23.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.741548+0000', 'last_change': '2023-07-06T20:00:17.741548+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.741548+0000', 'last_undegraded': '2023-07-06T20:00:17.741548+0000', 'last_fullsized': '2023-07-06T20:00:17.741548+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T20:00:23.782 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-07-06T20:00:23.782 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.739684+0000', 'last_change': '2023-07-06T20:00:17.739684+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.739684+0000', 'last_undegraded': '2023-07-06T20:00:17.739684+0000', 'last_fullsized': '2023-07-06T20:00:17.739684+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T20:00:23.782 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-07-06T20:00:23.783 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.739325+0000', 'last_change': '2023-07-06T20:00:17.739325+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.739325+0000', 'last_undegraded': '2023-07-06T20:00:17.739325+0000', 'last_fullsized': '2023-07-06T20:00:17.739325+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T20:00:23.783 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-07-06T20:00:23.783 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.746280+0000', 'last_change': '2023-07-06T20:00:17.746280+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.746280+0000', 'last_undegraded': '2023-07-06T20:00:17.746280+0000', 'last_fullsized': '2023-07-06T20:00:17.746280+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T20:00:23.784 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-07-06T20:00:23.784 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.742449+0000', 'last_change': '2023-07-06T20:00:17.742449+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.742449+0000', 'last_undegraded': '2023-07-06T20:00:17.742449+0000', 'last_fullsized': '2023-07-06T20:00:17.742449+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T20:00:23.784 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-07-06T20:00:23.785 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.742789+0000', 'last_change': '2023-07-06T20:00:17.742789+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.742789+0000', 'last_undegraded': '2023-07-06T20:00:17.742789+0000', 'last_fullsized': '2023-07-06T20:00:17.742789+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T20:00:23.785 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2023-07-06T20:00:23.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.739078+0000', 'last_change': '2023-07-06T20:00:17.739078+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.739078+0000', 'last_undegraded': '2023-07-06T20:00:17.739078+0000', 'last_fullsized': '2023-07-06T20:00:17.739078+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T20:00:23.786 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-07-06T20:00:23.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.740073+0000', 'last_change': '2023-07-06T20:00:17.740073+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.740073+0000', 'last_undegraded': '2023-07-06T20:00:17.740073+0000', 'last_fullsized': '2023-07-06T20:00:17.740073+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T20:00:23.787 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-07-06T20:00:23.787 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.750181+0000', 'last_change': '2023-07-06T20:00:17.750181+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.750181+0000', 'last_undegraded': '2023-07-06T20:00:17.750181+0000', 'last_fullsized': '2023-07-06T20:00:17.750181+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T20:00:23.787 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-07-06T20:00:23.787 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.739186+0000', 'last_change': '2023-07-06T20:00:17.739186+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.739186+0000', 'last_undegraded': '2023-07-06T20:00:17.739186+0000', 'last_fullsized': '2023-07-06T20:00:17.739186+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T20:00:23.788 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2023-07-06T20:00:23.788 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.737099+0000', 'last_change': '2023-07-06T20:00:17.737099+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.737099+0000', 'last_undegraded': '2023-07-06T20:00:17.737099+0000', 'last_fullsized': '2023-07-06T20:00:17.737099+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T20:00:23.788 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-07-06T20:00:23.789 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.740959+0000', 'last_change': '2023-07-06T20:00:17.740959+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.740959+0000', 'last_undegraded': '2023-07-06T20:00:17.740959+0000', 'last_fullsized': '2023-07-06T20:00:17.740959+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T20:00:23.789 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2023-07-06T20:00:23.789 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.734629+0000', 'last_change': '2023-07-06T20:00:17.734629+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.734629+0000', 'last_undegraded': '2023-07-06T20:00:17.734629+0000', 'last_fullsized': '2023-07-06T20:00:17.734629+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T20:00:23.790 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-07-06T20:00:23.790 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.740454+0000', 'last_change': '2023-07-06T20:00:17.740454+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.740454+0000', 'last_undegraded': '2023-07-06T20:00:17.740454+0000', 'last_fullsized': '2023-07-06T20:00:17.740454+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T20:00:23.790 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-07-06T20:00:23.791 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.752039+0000', 'last_change': '2023-07-06T20:00:17.752039+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.752039+0000', 'last_undegraded': '2023-07-06T20:00:17.752039+0000', 'last_fullsized': '2023-07-06T20:00:17.752039+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T20:00:23.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-07-06T20:00:23.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.746358+0000', 'last_change': '2023-07-06T20:00:17.746358+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.746358+0000', 'last_undegraded': '2023-07-06T20:00:17.746358+0000', 'last_fullsized': '2023-07-06T20:00:17.746358+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T20:00:23.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-07-06T20:00:23.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.738198+0000', 'last_change': '2023-07-06T20:00:17.738198+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.738198+0000', 'last_undegraded': '2023-07-06T20:00:17.738198+0000', 'last_fullsized': '2023-07-06T20:00:17.738198+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T20:00:23.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2023-07-06T20:00:23.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.744963+0000', 'last_change': '2023-07-06T20:00:17.744963+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.744963+0000', 'last_undegraded': '2023-07-06T20:00:17.744963+0000', 'last_fullsized': '2023-07-06T20:00:17.744963+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-06T20:00:23.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2023-07-06T20:00:23.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.734557+0000', 'last_change': '2023-07-06T20:00:17.734557+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.734557+0000', 'last_undegraded': '2023-07-06T20:00:17.734557+0000', 'last_fullsized': '2023-07-06T20:00:17.734557+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-06T20:00:23.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-07-06T20:00:23.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.738238+0000', 'last_change': '2023-07-06T20:00:17.738238+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.738238+0000', 'last_undegraded': '2023-07-06T20:00:17.738238+0000', 'last_fullsized': '2023-07-06T20:00:17.738238+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T20:00:23.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-07-06T20:00:23.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.739513+0000', 'last_change': '2023-07-06T20:00:17.739513+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.739513+0000', 'last_undegraded': '2023-07-06T20:00:17.739513+0000', 'last_fullsized': '2023-07-06T20:00:17.739513+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-06T20:00:23.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-07-06T20:00:23.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.747848+0000', 'last_change': '2023-07-06T20:00:17.747848+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.747848+0000', 'last_undegraded': '2023-07-06T20:00:17.747848+0000', 'last_fullsized': '2023-07-06T20:00:17.747848+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-06T20:00:23.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-07-06T20:00:23.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.738631+0000', 'last_change': '2023-07-06T20:00:17.738631+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.738631+0000', 'last_undegraded': '2023-07-06T20:00:17.738631+0000', 'last_fullsized': '2023-07-06T20:00:17.738631+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T20:00:23.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-07-06T20:00:23.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.738186+0000', 'last_change': '2023-07-06T20:00:17.738186+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.738186+0000', 'last_undegraded': '2023-07-06T20:00:17.738186+0000', 'last_fullsized': '2023-07-06T20:00:17.738186+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-06T20:00:23.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-07-06T20:00:23.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.739541+0000', 'last_change': '2023-07-06T20:00:17.739541+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.739541+0000', 'last_undegraded': '2023-07-06T20:00:17.739541+0000', 'last_fullsized': '2023-07-06T20:00:17.739541+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-06T20:00:23.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-07-06T20:00:23.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.735958+0000', 'last_change': '2023-07-06T20:00:17.735958+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.735958+0000', 'last_undegraded': '2023-07-06T20:00:17.735958+0000', 'last_fullsized': '2023-07-06T20:00:17.735958+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-06T20:00:23.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2023-07-06T20:00:23.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.737618+0000', 'last_change': '2023-07-06T20:00:17.737618+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.737618+0000', 'last_undegraded': '2023-07-06T20:00:17.737618+0000', 'last_fullsized': '2023-07-06T20:00:17.737618+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T20:00:23.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-07-06T20:00:23.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 39, 'state': 'creating+peering', 'last_fresh': '2023-07-06T20:00:17.737149+0000', 'last_change': '2023-07-06T20:00:17.737149+0000', 'last_active': '2023-07-06T20:00:17.727619+0000', 'last_peered': '2023-07-06T20:00:17.727619+0000', 'last_clean': '2023-07-06T20:00:17.727619+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-06T20:00:17.737149+0000', 'last_undegraded': '2023-07-06T20:00:17.737149+0000', 'last_fullsized': '2023-07-06T20:00:17.737149+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'last_clean_scrub_stamp': '2023-07-06T20:00:17.727619+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-06T20:00:23.803 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-06T20:00:23.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.925+0000 7f2e27358700 1 Processor -- start 2023-07-06T20:00:23.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.925+0000 7f2e27358700 1 -- start start 2023-07-06T20:00:23.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.926+0000 7f2e27358700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e2006f160 0x7f2e2015ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:23.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.926+0000 7f2e27358700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e2015e2f0 0x7f2e200ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:23.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.926+0000 7f2e27358700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e200cd2f0 con 0x7f2e20157ed0 2023-07-06T20:00:23.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.926+0000 7f2e27358700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2015e790 con 0x7f2e2006f160 2023-07-06T20:00:23.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.926+0000 7f2e27358700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2006e6c0 con 0x7f2e2015e2f0 2023-07-06T20:00:23.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.926+0000 7f2e258f5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e2015e2f0 0x7f2e200ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:23.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.926+0000 7f2e248f3700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e2006f160 0x7f2e2015ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:23.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.926+0000 7f2e258f5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e2015e2f0 0x7f2e200ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:53798/0 (socket says 172.21.15.6:53798) 2023-07-06T20:00:23.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.926+0000 7f2e258f5700 1 -- 172.21.15.6:0/2064821198 learned_addr learned my addr 172.21.15.6:0/2064821198 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:23.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.926+0000 7f2e258f5700 1 -- 172.21.15.6:0/2064821198 >> v2:172.21.15.40:3300/0 conn(0x7f2e2006f160 msgr2=0x7f2e2015ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:23.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.926+0000 7f2e258f5700 1 --2- 172.21.15.6:0/2064821198 >> v2:172.21.15.40:3300/0 conn(0x7f2e2006f160 0x7f2e2015ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.926+0000 7f2e258f5700 1 -- 172.21.15.6:0/2064821198 >> v1:172.21.15.40:6789/0 conn(0x7f2e20157ed0 legacy=0x7f2e200ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:23.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.926+0000 7f2e258f5700 1 -- 172.21.15.6:0/2064821198 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e200cb080 con 0x7f2e2015e2f0 2023-07-06T20:00:23.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.926+0000 7f2e248f3700 1 --2- 172.21.15.6:0/2064821198 >> v2:172.21.15.40:3300/0 conn(0x7f2e2006f160 0x7f2e2015ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-06T20:00:23.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.927+0000 7f2e258f5700 1 --2- 172.21.15.6:0/2064821198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e2015e2f0 0x7f2e200ce600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009e50 tx=0x7f2e1800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f57ef713ef2675bc server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:23.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.927+0000 7f2e17fff700 1 -- 172.21.15.6:0/2064821198 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1800e070 con 0x7f2e2015e2f0 2023-07-06T20:00:23.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.927+0000 7f2e17fff700 1 -- 172.21.15.6:0/2064821198 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1800b910 con 0x7f2e2015e2f0 2023-07-06T20:00:23.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.927+0000 7f2e17fff700 1 -- 172.21.15.6:0/2064821198 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1800bcc0 con 0x7f2e2015e2f0 2023-07-06T20:00:23.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.927+0000 7f2e27358700 1 -- 172.21.15.6:0/2064821198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e2015e2f0 msgr2=0x7f2e200ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:23.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.927+0000 7f2e27358700 1 --2- 172.21.15.6:0/2064821198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e2015e2f0 0x7f2e200ce600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009e50 tx=0x7f2e1800b330 comp rx=0 tx=0).stop 2023-07-06T20:00:23.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.927+0000 7f2e27358700 1 -- 172.21.15.6:0/2064821198 shutdown_connections 2023-07-06T20:00:23.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.927+0000 7f2e27358700 1 --2- 172.21.15.6:0/2064821198 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e2015e2f0 0x7f2e200ce600 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.927+0000 7f2e27358700 1 --2- 172.21.15.6:0/2064821198 >> v2:172.21.15.40:3300/0 conn(0x7f2e2006f160 0x7f2e2015ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.927+0000 7f2e27358700 1 -- 172.21.15.6:0/2064821198 >> 172.21.15.6:0/2064821198 conn(0x7f2e200d0a30 msgr2=0x7f2e200d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:23.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.927+0000 7f2e27358700 1 -- 172.21.15.6:0/2064821198 shutdown_connections 2023-07-06T20:00:23.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.928+0000 7f2e27358700 1 -- 172.21.15.6:0/2064821198 wait complete. 2023-07-06T20:00:23.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.929+0000 7f2e27358700 1 Processor -- start 2023-07-06T20:00:23.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.929+0000 7f2e27358700 1 -- start start 2023-07-06T20:00:23.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.929+0000 7f2e27358700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e2006f160 0x7f2e2014b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:23.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.929+0000 7f2e27358700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e20157ed0 0x7f2e20153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:23.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.929+0000 7f2e27358700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e2015e2f0 0x7f2e20154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:23.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.929+0000 7f2e27358700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e200c5dc0 con 0x7f2e20157ed0 2023-07-06T20:00:23.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.929+0000 7f2e27358700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e200b3420 con 0x7f2e2006f160 2023-07-06T20:00:23.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.929+0000 7f2e27358700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2014bd40 con 0x7f2e2015e2f0 2023-07-06T20:00:23.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.930+0000 7f2e248f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e20157ed0 0x7f2e20153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:23.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.930+0000 7f2e248f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e20157ed0 0x7f2e20153c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32926/0 (socket says 172.21.15.6:32926) 2023-07-06T20:00:23.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.930+0000 7f2e248f3700 1 -- 172.21.15.6:0/597571596 learned_addr learned my addr 172.21.15.6:0/597571596 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:23.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.930+0000 7f2e258f5700 1 --2- 172.21.15.6:0/597571596 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e2015e2f0 0x7f2e20154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:23.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.930+0000 7f2e250f4700 1 --2- 172.21.15.6:0/597571596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e2006f160 0x7f2e2014b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:23.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.930+0000 7f2e248f3700 1 -- 172.21.15.6:0/597571596 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e2015e2f0 msgr2=0x7f2e20154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:23.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.930+0000 7f2e248f3700 1 --2- 172.21.15.6:0/597571596 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e2015e2f0 0x7f2e20154170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.930+0000 7f2e248f3700 1 -- 172.21.15.6:0/597571596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e2006f160 msgr2=0x7f2e2014b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:23.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.930+0000 7f2e248f3700 1 --2- 172.21.15.6:0/597571596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e2006f160 0x7f2e2014b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:23.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.930+0000 7f2e248f3700 1 -- 172.21.15.6:0/597571596 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e100094a0 con 0x7f2e20157ed0 2023-07-06T20:00:23.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.930+0000 7f2e250f4700 1 --2- 172.21.15.6:0/597571596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e2006f160 0x7f2e2014b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T20:00:23.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.930+0000 7f2e248f3700 1 --2- 172.21.15.6:0/597571596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e20157ed0 0x7f2e20153c30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2e1000ebb0 tx=0x7f2e1000ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:23.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.930+0000 7f2e15ffb700 1 -- 172.21.15.6:0/597571596 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1000c7f0 con 0x7f2e20157ed0 2023-07-06T20:00:23.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.930+0000 7f2e15ffb700 1 -- 172.21.15.6:0/597571596 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1000c950 con 0x7f2e20157ed0 2023-07-06T20:00:23.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.930+0000 7f2e27358700 1 -- 172.21.15.6:0/597571596 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e18009b30 con 0x7f2e20157ed0 2023-07-06T20:00:23.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.930+0000 7f2e15ffb700 1 -- 172.21.15.6:0/597571596 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1000cce0 con 0x7f2e20157ed0 2023-07-06T20:00:23.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.931+0000 7f2e27358700 1 -- 172.21.15.6:0/597571596 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e200c5140 con 0x7f2e20157ed0 2023-07-06T20:00:23.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.931+0000 7f2e27358700 1 -- 172.21.15.6:0/597571596 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e200b69b0 con 0x7f2e20157ed0 2023-07-06T20:00:23.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.932+0000 7f2e15ffb700 1 -- 172.21.15.6:0/597571596 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2e10013470 con 0x7f2e20157ed0 2023-07-06T20:00:23.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.932+0000 7f2e15ffb700 1 --2- 172.21.15.6:0/597571596 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2e0406ace0 0x7f2e0406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:23.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.932+0000 7f2e15ffb700 1 -- 172.21.15.6:0/597571596 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2e100897c0 con 0x7f2e20157ed0 2023-07-06T20:00:23.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.932+0000 7f2e250f4700 1 --2- 172.21.15.6:0/597571596 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2e0406ace0 0x7f2e0406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:23.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.933+0000 7f2e250f4700 1 --2- 172.21.15.6:0/597571596 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2e0406ace0 0x7f2e0406d190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c000f60 tx=0x7f2e1c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:23.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:23.937+0000 7f2e15ffb700 1 -- 172.21.15.6:0/597571596 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2e10058130 con 0x7f2e20157ed0 2023-07-06T20:00:24.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.214+0000 7f2e27358700 1 -- 172.21.15.6:0/597571596 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f2e200b0100 con 0x7f2e20157ed0 2023-07-06T20:00:24.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.215+0000 7f2e15ffb700 1 -- 172.21.15.6:0/597571596 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1034 (secure 0 0 0) 0x7f2e10057cc0 con 0x7f2e20157ed0 2023-07-06T20:00:24.217 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:24.217 INFO:teuthology.orchestra.run.smithi006.stdout:{"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":117,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":41,"num_osds":8,"num_up_osds":8,"osd_up_since":1688673518,"num_in_osds":8,"osd_in_since":1688673509,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":225583104,"bytes_avail":772868530176,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":18,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":5397}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-07-06T20:00:00.729954+0000","services":{}},"progress_events":{}} 2023-07-06T20:00:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.217+0000 7f2e27358700 1 -- 172.21.15.6:0/597571596 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2e0406ace0 msgr2=0x7f2e0406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.217+0000 7f2e27358700 1 --2- 172.21.15.6:0/597571596 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2e0406ace0 0x7f2e0406d190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c000f60 tx=0x7f2e1c009040 comp rx=0 tx=0).stop 2023-07-06T20:00:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.217+0000 7f2e27358700 1 -- 172.21.15.6:0/597571596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e20157ed0 msgr2=0x7f2e20153c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.217+0000 7f2e27358700 1 --2- 172.21.15.6:0/597571596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e20157ed0 0x7f2e20153c30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2e1000ebb0 tx=0x7f2e1000ef70 comp rx=0 tx=0).stop 2023-07-06T20:00:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.217+0000 7f2e27358700 1 -- 172.21.15.6:0/597571596 shutdown_connections 2023-07-06T20:00:24.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.217+0000 7f2e27358700 1 --2- 172.21.15.6:0/597571596 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2e0406ace0 0x7f2e0406d190 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:24.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.217+0000 7f2e27358700 1 --2- 172.21.15.6:0/597571596 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2e2015e2f0 0x7f2e20154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:24.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.217+0000 7f2e27358700 1 --2- 172.21.15.6:0/597571596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e2006f160 0x7f2e2014b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:24.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.217+0000 7f2e27358700 1 --2- 172.21.15.6:0/597571596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e20157ed0 0x7f2e20153c30 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:24.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.217+0000 7f2e27358700 1 -- 172.21.15.6:0/597571596 >> 172.21.15.6:0/597571596 conn(0x7f2e200d0a30 msgr2=0x7f2e2006dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:24.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.217+0000 7f2e27358700 1 -- 172.21.15.6:0/597571596 shutdown_connections 2023-07-06T20:00:24.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.217+0000 7f2e27358700 1 -- 172.21.15.6:0/597571596 wait complete. 2023-07-06T20:00:24.234 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-06T20:00:24.235 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T20:00:24.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.358+0000 7f2fde362700 1 Processor -- start 2023-07-06T20:00:24.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.358+0000 7f2fde362700 1 -- start start 2023-07-06T20:00:24.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.359+0000 7f2fde362700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fd8071dd0 0x7f2fd80caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:24.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.359+0000 7f2fde362700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2fd80cee80 0x7f2fd81602c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:24.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.359+0000 7f2fde362700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd8160ff0 con 0x7f2fd80ceab0 2023-07-06T20:00:24.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.359+0000 7f2fde362700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd80cb400 con 0x7f2fd80cee80 2023-07-06T20:00:24.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.359+0000 7f2fde362700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd80ca100 con 0x7f2fd8071dd0 2023-07-06T20:00:24.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.359+0000 7f2fdc8ff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2fd80cee80 0x7f2fd81602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:24.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.359+0000 7f2fd7fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f2fd80ceab0 0x7f2fd80716c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:34140/0 (socket says 172.21.15.6:34140) 2023-07-06T20:00:24.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.359+0000 7f2fd7fff700 1 -- 172.21.15.6:0/351256930 learned_addr learned my addr 172.21.15.6:0/351256930 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-06T20:00:24.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.359+0000 7f2fd77fe700 1 --2- 172.21.15.6:0/351256930 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fd8071dd0 0x7f2fd80caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:24.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.359+0000 7f2fdc8ff700 1 -- 172.21.15.6:0/351256930 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fd8071dd0 msgr2=0x7f2fd80caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:24.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.359+0000 7f2fdc8ff700 1 --2- 172.21.15.6:0/351256930 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fd8071dd0 0x7f2fd80caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:24.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.359+0000 7f2fdc8ff700 1 -- 172.21.15.6:0/351256930 >> v1:172.21.15.6:6789/0 conn(0x7f2fd80ceab0 legacy=0x7f2fd80716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:24.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.359+0000 7f2fd6ffd700 1 -- 172.21.15.6:0/351256930 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1540244729 0 0) 0x7f2fd8160ff0 con 0x7f2fd80ceab0 2023-07-06T20:00:24.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.359+0000 7f2fdc8ff700 1 -- 172.21.15.6:0/351256930 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd80ca3e0 con 0x7f2fd80cee80 2023-07-06T20:00:24.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.360+0000 7f2fdc8ff700 1 --2- 172.21.15.6:0/351256930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd80cee80 0x7f2fd81602c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009d90 tx=0x7f2fd000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7940d12537f0858 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:24.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.360+0000 7f2fd6ffd700 1 -- 172.21.15.6:0/351256930 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd000e070 con 0x7f2fd80cee80 2023-07-06T20:00:24.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.360+0000 7f2fd6ffd700 1 -- 172.21.15.6:0/351256930 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd000bb20 con 0x7f2fd80cee80 2023-07-06T20:00:24.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.360+0000 7f2fd6ffd700 1 -- 172.21.15.6:0/351256930 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0012430 con 0x7f2fd80cee80 2023-07-06T20:00:24.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.360+0000 7f2fde362700 1 -- 172.21.15.6:0/351256930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd80cee80 msgr2=0x7f2fd81602c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:24.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.360+0000 7f2fde362700 1 --2- 172.21.15.6:0/351256930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd80cee80 0x7f2fd81602c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009d90 tx=0x7f2fd000b330 comp rx=0 tx=0).stop 2023-07-06T20:00:24.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.360+0000 7f2fde362700 1 -- 172.21.15.6:0/351256930 shutdown_connections 2023-07-06T20:00:24.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.360+0000 7f2fde362700 1 --2- 172.21.15.6:0/351256930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd80cee80 0x7f2fd81602c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:24.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.360+0000 7f2fde362700 1 --2- 172.21.15.6:0/351256930 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fd8071dd0 0x7f2fd80caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:24.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.360+0000 7f2fde362700 1 -- 172.21.15.6:0/351256930 >> 172.21.15.6:0/351256930 conn(0x7f2fd80cc420 msgr2=0x7f2fd80cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:24.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.360+0000 7f2fde362700 1 -- 172.21.15.6:0/351256930 shutdown_connections 2023-07-06T20:00:24.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.360+0000 7f2fde362700 1 -- 172.21.15.6:0/351256930 wait complete. 2023-07-06T20:00:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.362+0000 7f2fde362700 1 Processor -- start 2023-07-06T20:00:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.362+0000 7f2fde362700 1 -- start start 2023-07-06T20:00:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.362+0000 7f2fde362700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fd8071dd0 0x7f2fd80ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.362+0000 7f2fde362700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fd80ceab0 0x7f2fd81f5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.362+0000 7f2fde362700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd80cee80 0x7f2fd80aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:24.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.362+0000 7f2fde362700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd80b36a0 con 0x7f2fd80cee80 2023-07-06T20:00:24.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.362+0000 7f2fde362700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd8152480 con 0x7f2fd8071dd0 2023-07-06T20:00:24.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.362+0000 7f2fde362700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd80c7ec0 con 0x7f2fd80ceab0 2023-07-06T20:00:24.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.363+0000 7f2fdc8ff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd80cee80 0x7f2fd80aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:24.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.363+0000 7f2fdc8ff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd80cee80 0x7f2fd80aff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32940/0 (socket says 172.21.15.6:32940) 2023-07-06T20:00:24.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.363+0000 7f2fdc8ff700 1 -- 172.21.15.6:0/2073267337 learned_addr learned my addr 172.21.15.6:0/2073267337 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:24.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.363+0000 7f2fd77fe700 1 --2- 172.21.15.6:0/2073267337 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fd80ceab0 0x7f2fd81f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:24.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.363+0000 7f2fdc8ff700 1 -- 172.21.15.6:0/2073267337 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fd80ceab0 msgr2=0x7f2fd81f5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:24.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.363+0000 7f2fdc8ff700 1 --2- 172.21.15.6:0/2073267337 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fd80ceab0 0x7f2fd81f5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:24.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.363+0000 7f2fdc8ff700 1 -- 172.21.15.6:0/2073267337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fd8071dd0 msgr2=0x7f2fd80ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:24.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.363+0000 7f2fdc8ff700 1 --2- 172.21.15.6:0/2073267337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fd8071dd0 0x7f2fd80ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:24.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.363+0000 7f2fdc8ff700 1 -- 172.21.15.6:0/2073267337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd0009a70 con 0x7f2fd80cee80 2023-07-06T20:00:24.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.363+0000 7f2fdc8ff700 1 --2- 172.21.15.6:0/2073267337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd80cee80 0x7f2fd80aff60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2fd806ec50 tx=0x7f2fd0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:24.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.363+0000 7f2fd4ff9700 1 -- 172.21.15.6:0/2073267337 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0012430 con 0x7f2fd80cee80 2023-07-06T20:00:24.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.363+0000 7f2fd4ff9700 1 -- 172.21.15.6:0/2073267337 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd0020070 con 0x7f2fd80cee80 2023-07-06T20:00:24.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.363+0000 7f2fde362700 1 -- 172.21.15.6:0/2073267337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd80b27d0 con 0x7f2fd80cee80 2023-07-06T20:00:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.363+0000 7f2fd4ff9700 1 -- 172.21.15.6:0/2073267337 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0004280 con 0x7f2fd80cee80 2023-07-06T20:00:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.363+0000 7f2fde362700 1 -- 172.21.15.6:0/2073267337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd80b2d00 con 0x7f2fd80cee80 2023-07-06T20:00:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.364+0000 7f2fde362700 1 -- 172.21.15.6:0/2073267337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd8074200 con 0x7f2fd80cee80 2023-07-06T20:00:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.365+0000 7f2fd4ff9700 1 -- 172.21.15.6:0/2073267337 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2fd00043e0 con 0x7f2fd80cee80 2023-07-06T20:00:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.365+0000 7f2fd4ff9700 1 --2- 172.21.15.6:0/2073267337 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2fb806ace0 0x7f2fb806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.365+0000 7f2fd4ff9700 1 -- 172.21.15.6:0/2073267337 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2fd0022070 con 0x7f2fd80cee80 2023-07-06T20:00:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.365+0000 7f2fd7fff700 1 --2- 172.21.15.6:0/2073267337 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2fb806ace0 0x7f2fb806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:24.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.366+0000 7f2fd7fff700 1 --2- 172.21.15.6:0/2073267337 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2fb806ace0 0x7f2fb806d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00011e0 tx=0x7f2fc00079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:24.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.369+0000 7f2fd4ff9700 1 -- 172.21.15.6:0/2073267337 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2fd0056780 con 0x7f2fd80cee80 2023-07-06T20:00:24.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.561+0000 7f2fde362700 1 -- 172.21.15.6:0/2073267337 --> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2fd80ca9a0 con 0x7f2fb806ace0 2023-07-06T20:00:24.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.569+0000 7f2fd4ff9700 1 -- 172.21.15.6:0/2073267337 <== mgr.4110 v2:172.21.15.6:6832/201543369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+305583 (secure 0 0 0) 0x7f2fc00070d0 con 0x7f2fb806ace0 2023-07-06T20:00:24.575 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:24.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.573+0000 7f2fde362700 1 -- 172.21.15.6:0/2073267337 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2fb806ace0 msgr2=0x7f2fb806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:24.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.573+0000 7f2fde362700 1 --2- 172.21.15.6:0/2073267337 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2fb806ace0 0x7f2fb806d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00011e0 tx=0x7f2fc00079b0 comp rx=0 tx=0).stop 2023-07-06T20:00:24.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.573+0000 7f2fde362700 1 -- 172.21.15.6:0/2073267337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd80cee80 msgr2=0x7f2fd80aff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:24.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.573+0000 7f2fde362700 1 --2- 172.21.15.6:0/2073267337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd80cee80 0x7f2fd80aff60 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2fd806ec50 tx=0x7f2fd0004ad0 comp rx=0 tx=0).stop 2023-07-06T20:00:24.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.573+0000 7f2fde362700 1 -- 172.21.15.6:0/2073267337 shutdown_connections 2023-07-06T20:00:24.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.573+0000 7f2fde362700 1 --2- 172.21.15.6:0/2073267337 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2fb806ace0 0x7f2fb806d190 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:24.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.573+0000 7f2fde362700 1 --2- 172.21.15.6:0/2073267337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fd80cee80 0x7f2fd80aff60 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:24.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.573+0000 7f2fde362700 1 --2- 172.21.15.6:0/2073267337 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2fd8071dd0 0x7f2fd80ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:24.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.573+0000 7f2fde362700 1 --2- 172.21.15.6:0/2073267337 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2fd80ceab0 0x7f2fd81f5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:24.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.573+0000 7f2fde362700 1 -- 172.21.15.6:0/2073267337 >> 172.21.15.6:0/2073267337 conn(0x7f2fd80cc420 msgr2=0x7f2fd80cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:24.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.573+0000 7f2fde362700 1 -- 172.21.15.6:0/2073267337 shutdown_connections 2023-07-06T20:00:24.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:24.573+0000 7f2fde362700 1 -- 172.21.15.6:0/2073267337 wait complete. 2023-07-06T20:00:24.580 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-06T20:00:24.587 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2023-07-06T20:00:22.733895+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220296,"kb_used_data":4680,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754424,"statfs":{"total":773094113280,"available":772868530176,"internally_reserved":0,"allocated":4792320,"data_stored":2767608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001222"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.743254+0000","last_change":"2023-07-06T20:00:17.743254+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.743254+0000","last_undegraded":"2023-07-06T20:00:17.743254+0000","last_fullsized":"2023-07-06T20:00:17.743254+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737249+0000","last_change":"2023-07-06T20:00:17.737249+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737249+0000","last_undegraded":"2023-07-06T20:00:17.737249+0000","last_fullsized":"2023-07-06T20:00:17.737249+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740525+0000","last_change":"2023-07-06T20:00:17.740525+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740525+0000","last_undegraded":"2023-07-06T20:00:17.740525+0000","last_fullsized":"2023-07-06T20:00:17.740525+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740208+0000","last_change":"2023-07-06T20:00:17.740208+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740208+0000","last_undegraded":"2023-07-06T20:00:17.740208+0000","last_fullsized":"2023-07-06T20:00:17.740208+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737134+0000","last_change":"2023-07-06T20:00:17.737134+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737134+0000","last_undegraded":"2023-07-06T20:00:17.737134+0000","last_fullsized":"2023-07-06T20:00:17.737134+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737709+0000","last_change":"2023-07-06T20:00:17.737709+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737709+0000","last_undegraded":"2023-07-06T20:00:17.737709+0000","last_fullsized":"2023-07-06T20:00:17.737709+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.741619+0000","last_change":"2023-07-06T20:00:17.741619+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.741619+0000","last_undegraded":"2023-07-06T20:00:17.741619+0000","last_fullsized":"2023-07-06T20:00:17.741619+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739812+0000","last_change":"2023-07-06T20:00:17.739812+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739812+0000","last_undegraded":"2023-07-06T20:00:17.739812+0000","last_fullsized":"2023-07-06T20:00:17.739812+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.747878+0000","last_change":"2023-07-06T20:00:17.747878+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.747878+0000","last_undegraded":"2023-07-06T20:00:17.747878+0000","last_fullsized":"2023-07-06T20:00:17.747878+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740246+0000","last_change":"2023-07-06T20:00:17.740246+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740246+0000","last_undegraded":"2023-07-06T20:00:17.740246+0000","last_fullsized":"2023-07-06T20:00:17.740246+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737847+0000","last_change":"2023-07-06T20:00:17.737847+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737847+0000","last_undegraded":"2023-07-06T20:00:17.737847+0000","last_fullsized":"2023-07-06T20:00:17.737847+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.735950+0000","last_change":"2023-07-06T20:00:17.735950+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.735950+0000","last_undegraded":"2023-07-06T20:00:17.735950+0000","last_fullsized":"2023-07-06T20:00:17.735950+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.735224+0000","last_change":"2023-07-06T20:00:17.735224+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.735224+0000","last_undegraded":"2023-07-06T20:00:17.735224+0000","last_fullsized":"2023-07-06T20:00:17.735224+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740125+0000","last_change":"2023-07-06T20:00:17.740125+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740125+0000","last_undegraded":"2023-07-06T20:00:17.740125+0000","last_fullsized":"2023-07-06T20:00:17.740125+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739659+0000","last_change":"2023-07-06T20:00:17.739659+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739659+0000","last_undegraded":"2023-07-06T20:00:17.739659+0000","last_fullsized":"2023-07-06T20:00:17.739659+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.747954+0000","last_change":"2023-07-06T20:00:17.747954+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.747954+0000","last_undegraded":"2023-07-06T20:00:17.747954+0000","last_fullsized":"2023-07-06T20:00:17.747954+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.741146+0000","last_change":"2023-07-06T20:00:17.741146+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.741146+0000","last_undegraded":"2023-07-06T20:00:17.741146+0000","last_fullsized":"2023-07-06T20:00:17.741146+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.743851+0000","last_change":"2023-07-06T20:00:17.743851+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.743851+0000","last_undegraded":"2023-07-06T20:00:17.743851+0000","last_fullsized":"2023-07-06T20:00:17.743851+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.751695+0000","last_change":"2023-07-06T20:00:17.751695+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.751695+0000","last_undegraded":"2023-07-06T20:00:17.751695+0000","last_fullsized":"2023-07-06T20:00:17.751695+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.735268+0000","last_change":"2023-07-06T20:00:17.735268+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.735268+0000","last_undegraded":"2023-07-06T20:00:17.735268+0000","last_fullsized":"2023-07-06T20:00:17.735268+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.738405+0000","last_change":"2023-07-06T20:00:17.738405+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.738405+0000","last_undegraded":"2023-07-06T20:00:17.738405+0000","last_fullsized":"2023-07-06T20:00:17.738405+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737707+0000","last_change":"2023-07-06T20:00:17.737707+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737707+0000","last_undegraded":"2023-07-06T20:00:17.737707+0000","last_fullsized":"2023-07-06T20:00:17.737707+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.751754+0000","last_change":"2023-07-06T20:00:17.751754+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.751754+0000","last_undegraded":"2023-07-06T20:00:17.751754+0000","last_fullsized":"2023-07-06T20:00:17.751754+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.747413+0000","last_change":"2023-07-06T20:00:17.747413+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.747413+0000","last_undegraded":"2023-07-06T20:00:17.747413+0000","last_fullsized":"2023-07-06T20:00:17.747413+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.747243+0000","last_change":"2023-07-06T20:00:17.747243+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.747243+0000","last_undegraded":"2023-07-06T20:00:17.747243+0000","last_fullsized":"2023-07-06T20:00:17.747243+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.735296+0000","last_change":"2023-07-06T20:00:17.735296+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.735296+0000","last_undegraded":"2023-07-06T20:00:17.735296+0000","last_fullsized":"2023-07-06T20:00:17.735296+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739964+0000","last_change":"2023-07-06T20:00:17.739964+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739964+0000","last_undegraded":"2023-07-06T20:00:17.739964+0000","last_fullsized":"2023-07-06T20:00:17.739964+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737482+0000","last_change":"2023-07-06T20:00:17.737482+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737482+0000","last_undegraded":"2023-07-06T20:00:17.737482+0000","last_fullsized":"2023-07-06T20:00:17.737482+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.746364+0000","last_change":"2023-07-06T20:00:17.746364+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.746364+0000","last_undegraded":"2023-07-06T20:00:17.746364+0000","last_fullsized":"2023-07-06T20:00:17.746364+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.742720+0000","last_change":"2023-07-06T20:00:17.742720+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.742720+0000","last_undegraded":"2023-07-06T20:00:17.742720+0000","last_fullsized":"2023-07-06T20:00:17.742720+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740508+0000","last_change":"2023-07-06T20:00:17.740508+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740508+0000","last_undegraded":"2023-07-06T20:00:17.740508+0000","last_fullsized":"2023-07-06T20:00:17.740508+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.735149+0000","last_change":"2023-07-06T20:00:17.735149+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.735149+0000","last_undegraded":"2023-07-06T20:00:17.735149+0000","last_fullsized":"2023-07-06T20:00:17.735149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.742676+0000","last_change":"2023-07-06T20:00:17.742676+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.742676+0000","last_undegraded":"2023-07-06T20:00:17.742676+0000","last_fullsized":"2023-07-06T20:00:17.742676+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761370+0000","last_change":"2023-07-06T20:00:17.758785+0000","last_active":"2023-07-06T20:00:17.761370+0000","last_peered":"2023-07-06T20:00:17.761370+0000","last_clean":"2023-07-06T20:00:17.761370+0000","last_became_active":"2023-07-06T20:00:17.758511+0000","last_became_peered":"2023-07-06T20:00:17.758511+0000","last_unstale":"2023-07-06T20:00:17.761370+0000","last_undegraded":"2023-07-06T20:00:17.761370+0000","last_fullsized":"2023-07-06T20:00:17.761370+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:11:09.727533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.752192+0000","last_change":"2023-07-06T20:00:17.752192+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.752192+0000","last_undegraded":"2023-07-06T20:00:17.752192+0000","last_fullsized":"2023-07-06T20:00:17.752192+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.758753+0000","last_change":"2023-07-06T20:00:17.754956+0000","last_active":"2023-07-06T20:00:17.758753+0000","last_peered":"2023-07-06T20:00:17.758753+0000","last_clean":"2023-07-06T20:00:17.758753+0000","last_became_active":"2023-07-06T20:00:17.754698+0000","last_became_peered":"2023-07-06T20:00:17.754698+0000","last_unstale":"2023-07-06T20:00:17.758753+0000","last_undegraded":"2023-07-06T20:00:17.758753+0000","last_fullsized":"2023-07-06T20:00:17.758753+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:44:13.823614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.736556+0000","last_change":"2023-07-06T20:00:17.736556+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.736556+0000","last_undegraded":"2023-07-06T20:00:17.736556+0000","last_fullsized":"2023-07-06T20:00:17.736556+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755124+0000","last_change":"2023-07-06T20:00:17.751853+0000","last_active":"2023-07-06T20:00:17.755124+0000","last_peered":"2023-07-06T20:00:17.755124+0000","last_clean":"2023-07-06T20:00:17.755124+0000","last_became_active":"2023-07-06T20:00:17.751574+0000","last_became_peered":"2023-07-06T20:00:17.751574+0000","last_unstale":"2023-07-06T20:00:17.755124+0000","last_undegraded":"2023-07-06T20:00:17.755124+0000","last_fullsized":"2023-07-06T20:00:17.755124+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:21:53.159655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.743759+0000","last_change":"2023-07-06T20:00:17.743759+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.743759+0000","last_undegraded":"2023-07-06T20:00:17.743759+0000","last_fullsized":"2023-07-06T20:00:17.743759+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761674+0000","last_change":"2023-07-06T20:00:17.753933+0000","last_active":"2023-07-06T20:00:17.761674+0000","last_peered":"2023-07-06T20:00:17.761674+0000","last_clean":"2023-07-06T20:00:17.761674+0000","last_became_active":"2023-07-06T20:00:17.753624+0000","last_became_peered":"2023-07-06T20:00:17.753624+0000","last_unstale":"2023-07-06T20:00:17.761674+0000","last_undegraded":"2023-07-06T20:00:17.761674+0000","last_fullsized":"2023-07-06T20:00:17.761674+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:53:29.761935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.741548+0000","last_change":"2023-07-06T20:00:17.741548+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.741548+0000","last_undegraded":"2023-07-06T20:00:17.741548+0000","last_fullsized":"2023-07-06T20:00:17.741548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755524+0000","last_change":"2023-07-06T20:00:17.749676+0000","last_active":"2023-07-06T20:00:17.755524+0000","last_peered":"2023-07-06T20:00:17.755524+0000","last_clean":"2023-07-06T20:00:17.755524+0000","last_became_active":"2023-07-06T20:00:17.749394+0000","last_became_peered":"2023-07-06T20:00:17.749394+0000","last_unstale":"2023-07-06T20:00:17.755524+0000","last_undegraded":"2023-07-06T20:00:17.755524+0000","last_fullsized":"2023-07-06T20:00:17.755524+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:53:29.761935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739684+0000","last_change":"2023-07-06T20:00:17.739684+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739684+0000","last_undegraded":"2023-07-06T20:00:17.739684+0000","last_fullsized":"2023-07-06T20:00:17.739684+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755960+0000","last_change":"2023-07-06T20:00:17.750239+0000","last_active":"2023-07-06T20:00:17.755960+0000","last_peered":"2023-07-06T20:00:17.755960+0000","last_clean":"2023-07-06T20:00:17.755960+0000","last_became_active":"2023-07-06T20:00:17.749871+0000","last_became_peered":"2023-07-06T20:00:17.749871+0000","last_unstale":"2023-07-06T20:00:17.755960+0000","last_undegraded":"2023-07-06T20:00:17.755960+0000","last_fullsized":"2023-07-06T20:00:17.755960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:12:04.119622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739325+0000","last_change":"2023-07-06T20:00:17.739325+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739325+0000","last_undegraded":"2023-07-06T20:00:17.739325+0000","last_fullsized":"2023-07-06T20:00:17.739325+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.753319+0000","last_change":"2023-07-06T20:00:17.748331+0000","last_active":"2023-07-06T20:00:17.753319+0000","last_peered":"2023-07-06T20:00:17.753319+0000","last_clean":"2023-07-06T20:00:17.753319+0000","last_became_active":"2023-07-06T20:00:17.748017+0000","last_became_peered":"2023-07-06T20:00:17.748017+0000","last_unstale":"2023-07-06T20:00:17.753319+0000","last_undegraded":"2023-07-06T20:00:17.753319+0000","last_fullsized":"2023-07-06T20:00:17.753319+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:54:02.894383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.746280+0000","last_change":"2023-07-06T20:00:17.746280+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.746280+0000","last_undegraded":"2023-07-06T20:00:17.746280+0000","last_fullsized":"2023-07-06T20:00:17.746280+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755552+0000","last_change":"2023-07-06T20:00:17.750674+0000","last_active":"2023-07-06T20:00:17.755552+0000","last_peered":"2023-07-06T20:00:17.755552+0000","last_clean":"2023-07-06T20:00:17.755552+0000","last_became_active":"2023-07-06T20:00:17.749956+0000","last_became_peered":"2023-07-06T20:00:17.749956+0000","last_unstale":"2023-07-06T20:00:17.755552+0000","last_undegraded":"2023-07-06T20:00:17.755552+0000","last_fullsized":"2023-07-06T20:00:17.755552+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:24:16.127038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.742449+0000","last_change":"2023-07-06T20:00:17.742449+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.742449+0000","last_undegraded":"2023-07-06T20:00:17.742449+0000","last_fullsized":"2023-07-06T20:00:17.742449+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755884+0000","last_change":"2023-07-06T20:00:17.750053+0000","last_active":"2023-07-06T20:00:17.755884+0000","last_peered":"2023-07-06T20:00:17.755884+0000","last_clean":"2023-07-06T20:00:17.755884+0000","last_became_active":"2023-07-06T20:00:17.749690+0000","last_became_peered":"2023-07-06T20:00:17.749690+0000","last_unstale":"2023-07-06T20:00:17.755884+0000","last_undegraded":"2023-07-06T20:00:17.755884+0000","last_fullsized":"2023-07-06T20:00:17.755884+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:11:32.106916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.742789+0000","last_change":"2023-07-06T20:00:17.742789+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.742789+0000","last_undegraded":"2023-07-06T20:00:17.742789+0000","last_fullsized":"2023-07-06T20:00:17.742789+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761115+0000","last_change":"2023-07-06T20:00:17.756702+0000","last_active":"2023-07-06T20:00:17.761115+0000","last_peered":"2023-07-06T20:00:17.761115+0000","last_clean":"2023-07-06T20:00:17.761115+0000","last_became_active":"2023-07-06T20:00:17.756498+0000","last_became_peered":"2023-07-06T20:00:17.756498+0000","last_unstale":"2023-07-06T20:00:17.761115+0000","last_undegraded":"2023-07-06T20:00:17.761115+0000","last_fullsized":"2023-07-06T20:00:17.761115+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:21:53.159655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739078+0000","last_change":"2023-07-06T20:00:17.739078+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739078+0000","last_undegraded":"2023-07-06T20:00:17.739078+0000","last_fullsized":"2023-07-06T20:00:17.739078+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761813+0000","last_change":"2023-07-06T20:00:17.758181+0000","last_active":"2023-07-06T20:00:17.761813+0000","last_peered":"2023-07-06T20:00:17.761813+0000","last_clean":"2023-07-06T20:00:17.761813+0000","last_became_active":"2023-07-06T20:00:17.757621+0000","last_became_peered":"2023-07-06T20:00:17.757621+0000","last_unstale":"2023-07-06T20:00:17.761813+0000","last_undegraded":"2023-07-06T20:00:17.761813+0000","last_fullsized":"2023-07-06T20:00:17.761813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:11:09.727533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740073+0000","last_change":"2023-07-06T20:00:17.740073+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740073+0000","last_undegraded":"2023-07-06T20:00:17.740073+0000","last_fullsized":"2023-07-06T20:00:17.740073+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.748501+0000","last_change":"2023-07-06T20:00:17.744182+0000","last_active":"2023-07-06T20:00:17.748501+0000","last_peered":"2023-07-06T20:00:17.748501+0000","last_clean":"2023-07-06T20:00:17.748501+0000","last_became_active":"2023-07-06T20:00:17.743898+0000","last_became_peered":"2023-07-06T20:00:17.743898+0000","last_unstale":"2023-07-06T20:00:17.748501+0000","last_undegraded":"2023-07-06T20:00:17.748501+0000","last_fullsized":"2023-07-06T20:00:17.748501+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:52:44.455571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.750181+0000","last_change":"2023-07-06T20:00:17.750181+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.750181+0000","last_undegraded":"2023-07-06T20:00:17.750181+0000","last_fullsized":"2023-07-06T20:00:17.750181+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755541+0000","last_change":"2023-07-06T20:00:17.752168+0000","last_active":"2023-07-06T20:00:17.755541+0000","last_peered":"2023-07-06T20:00:17.755541+0000","last_clean":"2023-07-06T20:00:17.755541+0000","last_became_active":"2023-07-06T20:00:17.751874+0000","last_became_peered":"2023-07-06T20:00:17.751874+0000","last_unstale":"2023-07-06T20:00:17.755541+0000","last_undegraded":"2023-07-06T20:00:17.755541+0000","last_fullsized":"2023-07-06T20:00:17.755541+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:31:05.588401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739186+0000","last_change":"2023-07-06T20:00:17.739186+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739186+0000","last_undegraded":"2023-07-06T20:00:17.739186+0000","last_fullsized":"2023-07-06T20:00:17.739186+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761708+0000","last_change":"2023-07-06T20:00:17.755859+0000","last_active":"2023-07-06T20:00:17.761708+0000","last_peered":"2023-07-06T20:00:17.761708+0000","last_clean":"2023-07-06T20:00:17.761708+0000","last_became_active":"2023-07-06T20:00:17.755572+0000","last_became_peered":"2023-07-06T20:00:17.755572+0000","last_unstale":"2023-07-06T20:00:17.761708+0000","last_undegraded":"2023-07-06T20:00:17.761708+0000","last_fullsized":"2023-07-06T20:00:17.761708+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:09:34.121891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737099+0000","last_change":"2023-07-06T20:00:17.737099+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737099+0000","last_undegraded":"2023-07-06T20:00:17.737099+0000","last_fullsized":"2023-07-06T20:00:17.737099+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.756216+0000","last_change":"2023-07-06T20:00:17.754316+0000","last_active":"2023-07-06T20:00:17.756216+0000","last_peered":"2023-07-06T20:00:17.756216+0000","last_clean":"2023-07-06T20:00:17.756216+0000","last_became_active":"2023-07-06T20:00:17.753974+0000","last_became_peered":"2023-07-06T20:00:17.753974+0000","last_unstale":"2023-07-06T20:00:17.756216+0000","last_undegraded":"2023-07-06T20:00:17.756216+0000","last_fullsized":"2023-07-06T20:00:17.756216+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:04:36.784868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740959+0000","last_change":"2023-07-06T20:00:17.740959+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740959+0000","last_undegraded":"2023-07-06T20:00:17.740959+0000","last_fullsized":"2023-07-06T20:00:17.740959+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755594+0000","last_change":"2023-07-06T20:00:17.750850+0000","last_active":"2023-07-06T20:00:17.755594+0000","last_peered":"2023-07-06T20:00:17.755594+0000","last_clean":"2023-07-06T20:00:17.755594+0000","last_became_active":"2023-07-06T20:00:17.750550+0000","last_became_peered":"2023-07-06T20:00:17.750550+0000","last_unstale":"2023-07-06T20:00:17.755594+0000","last_undegraded":"2023-07-06T20:00:17.755594+0000","last_fullsized":"2023-07-06T20:00:17.755594+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:02:02.761364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.734629+0000","last_change":"2023-07-06T20:00:17.734629+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.734629+0000","last_undegraded":"2023-07-06T20:00:17.734629+0000","last_fullsized":"2023-07-06T20:00:17.734629+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.752051+0000","last_change":"2023-07-06T20:00:17.747641+0000","last_active":"2023-07-06T20:00:17.752051+0000","last_peered":"2023-07-06T20:00:17.752051+0000","last_clean":"2023-07-06T20:00:17.752051+0000","last_became_active":"2023-07-06T20:00:17.747332+0000","last_became_peered":"2023-07-06T20:00:17.747332+0000","last_unstale":"2023-07-06T20:00:17.752051+0000","last_undegraded":"2023-07-06T20:00:17.752051+0000","last_fullsized":"2023-07-06T20:00:17.752051+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:36:08.499704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.740454+0000","last_change":"2023-07-06T20:00:17.740454+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.740454+0000","last_undegraded":"2023-07-06T20:00:17.740454+0000","last_fullsized":"2023-07-06T20:00:17.740454+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.756014+0000","last_change":"2023-07-06T20:00:17.750549+0000","last_active":"2023-07-06T20:00:17.756014+0000","last_peered":"2023-07-06T20:00:17.756014+0000","last_clean":"2023-07-06T20:00:17.756014+0000","last_became_active":"2023-07-06T20:00:17.749747+0000","last_became_peered":"2023-07-06T20:00:17.749747+0000","last_unstale":"2023-07-06T20:00:17.756014+0000","last_undegraded":"2023-07-06T20:00:17.756014+0000","last_fullsized":"2023-07-06T20:00:17.756014+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:15:57.765205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.752039+0000","last_change":"2023-07-06T20:00:17.752039+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.752039+0000","last_undegraded":"2023-07-06T20:00:17.752039+0000","last_fullsized":"2023-07-06T20:00:17.752039+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.753289+0000","last_change":"2023-07-06T20:00:17.749209+0000","last_active":"2023-07-06T20:00:17.753289+0000","last_peered":"2023-07-06T20:00:17.753289+0000","last_clean":"2023-07-06T20:00:17.753289+0000","last_became_active":"2023-07-06T20:00:17.748680+0000","last_became_peered":"2023-07-06T20:00:17.748680+0000","last_unstale":"2023-07-06T20:00:17.753289+0000","last_undegraded":"2023-07-06T20:00:17.753289+0000","last_fullsized":"2023-07-06T20:00:17.753289+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:16:23.089607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.746358+0000","last_change":"2023-07-06T20:00:17.746358+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.746358+0000","last_undegraded":"2023-07-06T20:00:17.746358+0000","last_fullsized":"2023-07-06T20:00:17.746358+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761360+0000","last_change":"2023-07-06T20:00:17.758772+0000","last_active":"2023-07-06T20:00:17.761360+0000","last_peered":"2023-07-06T20:00:17.761360+0000","last_clean":"2023-07-06T20:00:17.761360+0000","last_became_active":"2023-07-06T20:00:17.758536+0000","last_became_peered":"2023-07-06T20:00:17.758536+0000","last_unstale":"2023-07-06T20:00:17.761360+0000","last_undegraded":"2023-07-06T20:00:17.761360+0000","last_fullsized":"2023-07-06T20:00:17.761360+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:01:36.817991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.738198+0000","last_change":"2023-07-06T20:00:17.738198+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.738198+0000","last_undegraded":"2023-07-06T20:00:17.738198+0000","last_fullsized":"2023-07-06T20:00:17.738198+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755503+0000","last_change":"2023-07-06T20:00:17.749103+0000","last_active":"2023-07-06T20:00:17.755503+0000","last_peered":"2023-07-06T20:00:17.755503+0000","last_clean":"2023-07-06T20:00:17.755503+0000","last_became_active":"2023-07-06T20:00:17.748753+0000","last_became_peered":"2023-07-06T20:00:17.748753+0000","last_unstale":"2023-07-06T20:00:17.755503+0000","last_undegraded":"2023-07-06T20:00:17.755503+0000","last_fullsized":"2023-07-06T20:00:17.755503+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:01:43.769188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.744963+0000","last_change":"2023-07-06T20:00:17.744963+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.744963+0000","last_undegraded":"2023-07-06T20:00:17.744963+0000","last_fullsized":"2023-07-06T20:00:17.744963+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761329+0000","last_change":"2023-07-06T20:00:17.757297+0000","last_active":"2023-07-06T20:00:17.761329+0000","last_peered":"2023-07-06T20:00:17.761329+0000","last_clean":"2023-07-06T20:00:17.761329+0000","last_became_active":"2023-07-06T20:00:17.756954+0000","last_became_peered":"2023-07-06T20:00:17.756954+0000","last_unstale":"2023-07-06T20:00:17.761329+0000","last_undegraded":"2023-07-06T20:00:17.761329+0000","last_fullsized":"2023-07-06T20:00:17.761329+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:27:01.557116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.734557+0000","last_change":"2023-07-06T20:00:17.734557+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.734557+0000","last_undegraded":"2023-07-06T20:00:17.734557+0000","last_fullsized":"2023-07-06T20:00:17.734557+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755486+0000","last_change":"2023-07-06T20:00:17.749817+0000","last_active":"2023-07-06T20:00:17.755486+0000","last_peered":"2023-07-06T20:00:17.755486+0000","last_clean":"2023-07-06T20:00:17.755486+0000","last_became_active":"2023-07-06T20:00:17.749463+0000","last_became_peered":"2023-07-06T20:00:17.749463+0000","last_unstale":"2023-07-06T20:00:17.755486+0000","last_undegraded":"2023-07-06T20:00:17.755486+0000","last_fullsized":"2023-07-06T20:00:17.755486+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:03:37.487548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.738238+0000","last_change":"2023-07-06T20:00:17.738238+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.738238+0000","last_undegraded":"2023-07-06T20:00:17.738238+0000","last_fullsized":"2023-07-06T20:00:17.738238+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761738+0000","last_change":"2023-07-06T20:00:17.756010+0000","last_active":"2023-07-06T20:00:17.761738+0000","last_peered":"2023-07-06T20:00:17.761738+0000","last_clean":"2023-07-06T20:00:17.761738+0000","last_became_active":"2023-07-06T20:00:17.755721+0000","last_became_peered":"2023-07-06T20:00:17.755721+0000","last_unstale":"2023-07-06T20:00:17.761738+0000","last_undegraded":"2023-07-06T20:00:17.761738+0000","last_fullsized":"2023-07-06T20:00:17.761738+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:01:36.817991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739513+0000","last_change":"2023-07-06T20:00:17.739513+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739513+0000","last_undegraded":"2023-07-06T20:00:17.739513+0000","last_fullsized":"2023-07-06T20:00:17.739513+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755574+0000","last_change":"2023-07-06T20:00:17.750835+0000","last_active":"2023-07-06T20:00:17.755574+0000","last_peered":"2023-07-06T20:00:17.755574+0000","last_clean":"2023-07-06T20:00:17.755574+0000","last_became_active":"2023-07-06T20:00:17.750359+0000","last_became_peered":"2023-07-06T20:00:17.750359+0000","last_unstale":"2023-07-06T20:00:17.755574+0000","last_undegraded":"2023-07-06T20:00:17.755574+0000","last_fullsized":"2023-07-06T20:00:17.755574+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:23:22.777673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.745377+0000","last_change":"2023-07-06T19:58:47.723855+0000","last_active":"2023-07-06T20:00:17.745377+0000","last_peered":"2023-07-06T20:00:17.745377+0000","last_clean":"2023-07-06T20:00:17.745377+0000","last_became_active":"2023-07-06T19:58:47.723553+0000","last_became_peered":"2023-07-06T19:58:47.723553+0000","last_unstale":"2023-07-06T20:00:17.745377+0000","last_undegraded":"2023-07-06T20:00:17.745377+0000","last_fullsized":"2023-07-06T20:00:17.745377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:20:20.035886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.747848+0000","last_change":"2023-07-06T20:00:17.747848+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.747848+0000","last_undegraded":"2023-07-06T20:00:17.747848+0000","last_fullsized":"2023-07-06T20:00:17.747848+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755295+0000","last_change":"2023-07-06T20:00:17.751341+0000","last_active":"2023-07-06T20:00:17.755295+0000","last_peered":"2023-07-06T20:00:17.755295+0000","last_clean":"2023-07-06T20:00:17.755295+0000","last_became_active":"2023-07-06T20:00:17.751050+0000","last_became_peered":"2023-07-06T20:00:17.751050+0000","last_unstale":"2023-07-06T20:00:17.755295+0000","last_undegraded":"2023-07-06T20:00:17.755295+0000","last_fullsized":"2023-07-06T20:00:17.755295+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:57:19.370748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.737895+0000","last_change":"2023-07-06T19:58:47.705294+0000","last_active":"2023-07-06T20:00:17.737895+0000","last_peered":"2023-07-06T20:00:17.737895+0000","last_clean":"2023-07-06T20:00:17.737895+0000","last_became_active":"2023-07-06T19:58:47.704921+0000","last_became_peered":"2023-07-06T19:58:47.704921+0000","last_unstale":"2023-07-06T20:00:17.737895+0000","last_undegraded":"2023-07-06T20:00:17.737895+0000","last_fullsized":"2023-07-06T20:00:17.737895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:50:37.171246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.738631+0000","last_change":"2023-07-06T20:00:17.738631+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.738631+0000","last_undegraded":"2023-07-06T20:00:17.738631+0000","last_fullsized":"2023-07-06T20:00:17.738631+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761830+0000","last_change":"2023-07-06T20:00:17.758366+0000","last_active":"2023-07-06T20:00:17.761830+0000","last_peered":"2023-07-06T20:00:17.761830+0000","last_clean":"2023-07-06T20:00:17.761830+0000","last_became_active":"2023-07-06T20:00:17.757940+0000","last_became_peered":"2023-07-06T20:00:17.757940+0000","last_unstale":"2023-07-06T20:00:17.761830+0000","last_undegraded":"2023-07-06T20:00:17.761830+0000","last_fullsized":"2023-07-06T20:00:17.761830+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:43:44.061833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.732142+0000","last_change":"2023-07-06T19:58:47.766992+0000","last_active":"2023-07-06T20:00:17.732142+0000","last_peered":"2023-07-06T20:00:17.732142+0000","last_clean":"2023-07-06T20:00:17.732142+0000","last_became_active":"2023-07-06T19:58:47.766697+0000","last_became_peered":"2023-07-06T19:58:47.766697+0000","last_unstale":"2023-07-06T20:00:17.732142+0000","last_undegraded":"2023-07-06T20:00:17.732142+0000","last_fullsized":"2023-07-06T20:00:17.732142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:33:15.971622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.738186+0000","last_change":"2023-07-06T20:00:17.738186+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.738186+0000","last_undegraded":"2023-07-06T20:00:17.738186+0000","last_fullsized":"2023-07-06T20:00:17.738186+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.750938+0000","last_change":"2023-07-06T20:00:17.745505+0000","last_active":"2023-07-06T20:00:17.750938+0000","last_peered":"2023-07-06T20:00:17.750938+0000","last_clean":"2023-07-06T20:00:17.750938+0000","last_became_active":"2023-07-06T20:00:17.745185+0000","last_became_peered":"2023-07-06T20:00:17.745185+0000","last_unstale":"2023-07-06T20:00:17.750938+0000","last_undegraded":"2023-07-06T20:00:17.750938+0000","last_fullsized":"2023-07-06T20:00:17.750938+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:24:34.665958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.737860+0000","last_change":"2023-07-06T19:58:47.704498+0000","last_active":"2023-07-06T20:00:17.737860+0000","last_peered":"2023-07-06T20:00:17.737860+0000","last_clean":"2023-07-06T20:00:17.737860+0000","last_became_active":"2023-07-06T19:58:47.704172+0000","last_became_peered":"2023-07-06T19:58:47.704172+0000","last_unstale":"2023-07-06T20:00:17.737860+0000","last_undegraded":"2023-07-06T20:00:17.737860+0000","last_fullsized":"2023-07-06T20:00:17.737860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:24:23.512468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":203,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.745857+0000","last_change":"2023-07-06T19:58:40.972763+0000","last_active":"2023-07-06T20:00:17.745857+0000","last_peered":"2023-07-06T20:00:17.745857+0000","last_clean":"2023-07-06T20:00:17.745857+0000","last_became_active":"2023-07-06T19:58:40.971570+0000","last_became_peered":"2023-07-06T19:58:40.971570+0000","last_unstale":"2023-07-06T20:00:17.745857+0000","last_undegraded":"2023-07-06T20:00:17.745857+0000","last_fullsized":"2023-07-06T20:00:17.745857+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_clean_scrub_stamp":"2023-07-06T19:58:39.653546+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:25:14.499210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.739541+0000","last_change":"2023-07-06T20:00:17.739541+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.739541+0000","last_undegraded":"2023-07-06T20:00:17.739541+0000","last_fullsized":"2023-07-06T20:00:17.739541+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.757612+0000","last_change":"2023-07-06T20:00:17.755288+0000","last_active":"2023-07-06T20:00:17.757612+0000","last_peered":"2023-07-06T20:00:17.757612+0000","last_clean":"2023-07-06T20:00:17.757612+0000","last_became_active":"2023-07-06T20:00:17.754948+0000","last_became_peered":"2023-07-06T20:00:17.754948+0000","last_unstale":"2023-07-06T20:00:17.757612+0000","last_undegraded":"2023-07-06T20:00:17.757612+0000","last_fullsized":"2023-07-06T20:00:17.757612+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:03:37.487548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.745737+0000","last_change":"2023-07-06T19:58:47.708545+0000","last_active":"2023-07-06T20:00:17.745737+0000","last_peered":"2023-07-06T20:00:17.745737+0000","last_clean":"2023-07-06T20:00:17.745737+0000","last_became_active":"2023-07-06T19:58:47.708230+0000","last_became_peered":"2023-07-06T19:58:47.708230+0000","last_unstale":"2023-07-06T20:00:17.745737+0000","last_undegraded":"2023-07-06T20:00:17.745737+0000","last_fullsized":"2023-07-06T20:00:17.745737+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:03:06.746603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.735958+0000","last_change":"2023-07-06T20:00:17.735958+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.735958+0000","last_undegraded":"2023-07-06T20:00:17.735958+0000","last_fullsized":"2023-07-06T20:00:17.735958+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.760563+0000","last_change":"2023-07-06T20:00:17.757297+0000","last_active":"2023-07-06T20:00:17.760563+0000","last_peered":"2023-07-06T20:00:17.760563+0000","last_clean":"2023-07-06T20:00:17.760563+0000","last_became_active":"2023-07-06T20:00:17.756965+0000","last_became_peered":"2023-07-06T20:00:17.756965+0000","last_unstale":"2023-07-06T20:00:17.760563+0000","last_undegraded":"2023-07-06T20:00:17.760563+0000","last_fullsized":"2023-07-06T20:00:17.760563+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:32:56.954102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.746405+0000","last_change":"2023-07-06T19:58:47.723926+0000","last_active":"2023-07-06T20:00:17.746405+0000","last_peered":"2023-07-06T20:00:17.746405+0000","last_clean":"2023-07-06T20:00:17.746405+0000","last_became_active":"2023-07-06T19:58:47.723646+0000","last_became_peered":"2023-07-06T19:58:47.723646+0000","last_unstale":"2023-07-06T20:00:17.746405+0000","last_undegraded":"2023-07-06T20:00:17.746405+0000","last_fullsized":"2023-07-06T20:00:17.746405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:52:32.856117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737618+0000","last_change":"2023-07-06T20:00:17.737618+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737618+0000","last_undegraded":"2023-07-06T20:00:17.737618+0000","last_fullsized":"2023-07-06T20:00:17.737618+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.755941+0000","last_change":"2023-07-06T20:00:17.749291+0000","last_active":"2023-07-06T20:00:17.755941+0000","last_peered":"2023-07-06T20:00:17.755941+0000","last_clean":"2023-07-06T20:00:17.755941+0000","last_became_active":"2023-07-06T20:00:17.748503+0000","last_became_peered":"2023-07-06T20:00:17.748503+0000","last_unstale":"2023-07-06T20:00:17.755941+0000","last_undegraded":"2023-07-06T20:00:17.755941+0000","last_fullsized":"2023-07-06T20:00:17.755941+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:31:01.135507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.746057+0000","last_change":"2023-07-06T19:58:47.711918+0000","last_active":"2023-07-06T20:00:17.746057+0000","last_peered":"2023-07-06T20:00:17.746057+0000","last_clean":"2023-07-06T20:00:17.746057+0000","last_became_active":"2023-07-06T19:58:47.711591+0000","last_became_peered":"2023-07-06T19:58:47.711591+0000","last_unstale":"2023-07-06T20:00:17.746057+0000","last_undegraded":"2023-07-06T20:00:17.746057+0000","last_fullsized":"2023-07-06T20:00:17.746057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:43:44.671255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-07-06T20:00:17.737149+0000","last_change":"2023-07-06T20:00:17.737149+0000","last_active":"2023-07-06T20:00:17.727619+0000","last_peered":"2023-07-06T20:00:17.727619+0000","last_clean":"2023-07-06T20:00:17.727619+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-06T20:00:17.737149+0000","last_undegraded":"2023-07-06T20:00:17.737149+0000","last_fullsized":"2023-07-06T20:00:17.737149+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.761769+0000","last_change":"2023-07-06T20:00:17.757513+0000","last_active":"2023-07-06T20:00:17.761769+0000","last_peered":"2023-07-06T20:00:17.761769+0000","last_clean":"2023-07-06T20:00:17.761769+0000","last_became_active":"2023-07-06T20:00:17.757216+0000","last_became_peered":"2023-07-06T20:00:17.757216+0000","last_unstale":"2023-07-06T20:00:17.761769+0000","last_undegraded":"2023-07-06T20:00:17.761769+0000","last_fullsized":"2023-07-06T20:00:17.761769+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:19:35.805143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-06T20:00:17.754231+0000","last_change":"2023-07-06T19:58:47.712143+0000","last_active":"2023-07-06T20:00:17.754231+0000","last_peered":"2023-07-06T20:00:17.754231+0000","last_clean":"2023-07-06T20:00:17.754231+0000","last_became_active":"2023-07-06T19:58:47.711788+0000","last_became_peered":"2023-07-06T19:58:47.711788+0000","last_unstale":"2023-07-06T20:00:17.754231+0000","last_undegraded":"2023-07-06T20:00:17.754231+0000","last_fullsized":"2023-07-06T20:00:17.754231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:53:38.913611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":1044480,"data_stored":788727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.624},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.80800000000000005}]},{"osd":4,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.77800000000000002}]},{"osd":5,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.91100000000000003}]},{"osd":6,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":1.0009999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":198359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":3.129,"5min":3.129,"15min":3.129},"last":0.627}]},{"osd":3,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.47099999999999997}]},{"osd":5,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.502}]},{"osd":7,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.68300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":198359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":7.157,"5min":7.157,"15min":7.157},"last":0.34499999999999997}]},{"osd":2,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.26000000000000001}]},{"osd":3,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.29099999999999998}]},{"osd":4,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.504}]},{"osd":7,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.55500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":1044480,"data_stored":788727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.35099999999999998}]},{"osd":3,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.317}]},{"osd":4,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.499},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":3.2029999999999998,"5min":3.2029999999999998,"15min":3.2029999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.47499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":198359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.34399999999999997}]},{"osd":1,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.372}]},{"osd":3,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.38}]},{"osd":4,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":198359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":3.5089999999999999,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.315},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.505},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.439}]},{"osd":5,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.41299999999999998}]},{"osd":6,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.46800000000000003}]},{"osd":7,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.48099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":198359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.47099999999999997}]},{"osd":1,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54200000000000004}]},{"osd":3,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.45300000000000001}]},{"osd":5,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.63200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":450560,"data_stored":198359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":0.441}]},{"osd":1,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.5},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.5870000000000002,"5min":3.5870000000000002,"15min":3.5870000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.6389999999999998,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":8.2859999999999996,"5min":8.2859999999999996,"15min":8.2859999999999996},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.57699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T20:00:27.601 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-06T20:00:27.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.739+0000 7fd3237bb700 1 Processor -- start 2023-07-06T20:00:27.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.740+0000 7fd3237bb700 1 -- start start 2023-07-06T20:00:27.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.740+0000 7fd3237bb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd31c0ceab0 0x7fd31c0caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:27.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.740+0000 7fd3237bb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd31c0cee80 0x7fd31c0716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:27.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.741+0000 7fd3237bb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd31c071c00 0x7fd31c1602c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:27.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.741+0000 7fd3237bb700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd31c0cb400 con 0x7fd31c0cee80 2023-07-06T20:00:27.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.741+0000 7fd3237bb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd31c160ff0 con 0x7fd31c0ceab0 2023-07-06T20:00:27.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.741+0000 7fd3237bb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c072020 con 0x7fd31c071c00 2023-07-06T20:00:27.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.741+0000 7fd320d56700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd31c0cee80 0x7fd31c0716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:27.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.741+0000 7fd320d56700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd31c0cee80 0x7fd31c0716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32946/0 (socket says 172.21.15.6:32946) 2023-07-06T20:00:27.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.741+0000 7fd320d56700 1 -- 172.21.15.6:0/721191922 learned_addr learned my addr 172.21.15.6:0/721191922 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:27.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.741+0000 7fd321d58700 1 --2- 172.21.15.6:0/721191922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd31c071c00 0x7fd31c1602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:27.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.741+0000 7fd321557700 1 --2- 172.21.15.6:0/721191922 >> v2:172.21.15.40:3300/0 conn(0x7fd31c0ceab0 0x7fd31c0caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:27.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.741+0000 7fd320d56700 1 -- 172.21.15.6:0/721191922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd31c071c00 msgr2=0x7fd31c1602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:27.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.741+0000 7fd320d56700 1 --2- 172.21.15.6:0/721191922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd31c071c00 0x7fd31c1602c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:27.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.741+0000 7fd320d56700 1 -- 172.21.15.6:0/721191922 >> v2:172.21.15.40:3300/0 conn(0x7fd31c0ceab0 msgr2=0x7fd31c0caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:27.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.741+0000 7fd320d56700 1 --2- 172.21.15.6:0/721191922 >> v2:172.21.15.40:3300/0 conn(0x7fd31c0ceab0 0x7fd31c0caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:27.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.741+0000 7fd320d56700 1 -- 172.21.15.6:0/721191922 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31c0ca100 con 0x7fd31c0cee80 2023-07-06T20:00:27.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.741+0000 7fd320d56700 1 --2- 172.21.15.6:0/721191922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd31c0cee80 0x7fd31c0716c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd31c0731c0 tx=0x7fd310009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8090035cdb9822b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:27.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.741+0000 7fd30ffff700 1 -- 172.21.15.6:0/721191922 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31000b870 con 0x7fd31c0cee80 2023-07-06T20:00:27.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.741+0000 7fd30ffff700 1 -- 172.21.15.6:0/721191922 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31000b9d0 con 0x7fd31c0cee80 2023-07-06T20:00:27.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.741+0000 7fd30ffff700 1 -- 172.21.15.6:0/721191922 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31000bd60 con 0x7fd31c0cee80 2023-07-06T20:00:27.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.742+0000 7fd3237bb700 1 -- 172.21.15.6:0/721191922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd31c0cee80 msgr2=0x7fd31c0716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:27.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.742+0000 7fd3237bb700 1 --2- 172.21.15.6:0/721191922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd31c0cee80 0x7fd31c0716c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fd31c0731c0 tx=0x7fd310009bd0 comp rx=0 tx=0).stop 2023-07-06T20:00:27.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.742+0000 7fd3237bb700 1 -- 172.21.15.6:0/721191922 shutdown_connections 2023-07-06T20:00:27.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.742+0000 7fd3237bb700 1 --2- 172.21.15.6:0/721191922 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd31c071c00 0x7fd31c1602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:27.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.742+0000 7fd3237bb700 1 --2- 172.21.15.6:0/721191922 >> v2:172.21.15.40:3300/0 conn(0x7fd31c0ceab0 0x7fd31c0caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:27.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.742+0000 7fd3237bb700 1 --2- 172.21.15.6:0/721191922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd31c0cee80 0x7fd31c0716c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:27.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.742+0000 7fd3237bb700 1 -- 172.21.15.6:0/721191922 >> 172.21.15.6:0/721191922 conn(0x7fd31c0cc420 msgr2=0x7fd31c0cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:27.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.742+0000 7fd3237bb700 1 -- 172.21.15.6:0/721191922 shutdown_connections 2023-07-06T20:00:27.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.742+0000 7fd3237bb700 1 -- 172.21.15.6:0/721191922 wait complete. 2023-07-06T20:00:27.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.743+0000 7fd3237bb700 1 Processor -- start 2023-07-06T20:00:27.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.743+0000 7fd3237bb700 1 -- start start 2023-07-06T20:00:27.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.744+0000 7fd3237bb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd31c071c00 0x7fd31c15d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:27.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.744+0000 7fd3237bb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd31c0ceab0 0x7fd31c0b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:27.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.744+0000 7fd3237bb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd31c0cee80 0x7fd31c1488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:27.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.744+0000 7fd3237bb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c15de90 con 0x7fd31c0cee80 2023-07-06T20:00:27.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.744+0000 7fd3237bb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c15e170 con 0x7fd31c071c00 2023-07-06T20:00:27.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.744+0000 7fd3237bb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c15e450 con 0x7fd31c0ceab0 2023-07-06T20:00:27.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.744+0000 7fd321d58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd31c0cee80 0x7fd31c1488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:27.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.744+0000 7fd321d58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd31c0cee80 0x7fd31c1488c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32954/0 (socket says 172.21.15.6:32954) 2023-07-06T20:00:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.744+0000 7fd321d58700 1 -- 172.21.15.6:0/3789011752 learned_addr learned my addr 172.21.15.6:0/3789011752 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.744+0000 7fd320d56700 1 --2- 172.21.15.6:0/3789011752 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd31c0ceab0 0x7fd31c0b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.744+0000 7fd321557700 1 --2- 172.21.15.6:0/3789011752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd31c071c00 0x7fd31c15d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.744+0000 7fd321d58700 1 -- 172.21.15.6:0/3789011752 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd31c0ceab0 msgr2=0x7fd31c0b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.744+0000 7fd321d58700 1 --2- 172.21.15.6:0/3789011752 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd31c0ceab0 0x7fd31c0b3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.744+0000 7fd321d58700 1 -- 172.21.15.6:0/3789011752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd31c071c00 msgr2=0x7fd31c15d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.744+0000 7fd321d58700 1 --2- 172.21.15.6:0/3789011752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd31c071c00 0x7fd31c15d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:27.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.745+0000 7fd321d58700 1 -- 172.21.15.6:0/3789011752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd310009550 con 0x7fd31c0cee80 2023-07-06T20:00:27.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.745+0000 7fd321d58700 1 --2- 172.21.15.6:0/3789011752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd31c0cee80 0x7fd31c1488c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd314007d20 tx=0x7fd31400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:27.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.745+0000 7fd30dffb700 1 -- 172.21.15.6:0/3789011752 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31400ede0 con 0x7fd31c0cee80 2023-07-06T20:00:27.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.745+0000 7fd30dffb700 1 -- 172.21.15.6:0/3789011752 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd314014420 con 0x7fd31c0cee80 2023-07-06T20:00:27.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.745+0000 7fd3237bb700 1 -- 172.21.15.6:0/3789011752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31c15e730 con 0x7fd31c0cee80 2023-07-06T20:00:27.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.745+0000 7fd30dffb700 1 -- 172.21.15.6:0/3789011752 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3140147d0 con 0x7fd31c0cee80 2023-07-06T20:00:27.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.745+0000 7fd3237bb700 1 -- 172.21.15.6:0/3789011752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd31c15dad0 con 0x7fd31c0cee80 2023-07-06T20:00:27.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.746+0000 7fd3237bb700 1 -- 172.21.15.6:0/3789011752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31c15dc60 con 0x7fd31c0cee80 2023-07-06T20:00:27.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.746+0000 7fd30dffb700 1 -- 172.21.15.6:0/3789011752 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd314014930 con 0x7fd31c0cee80 2023-07-06T20:00:27.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.747+0000 7fd30dffb700 1 --2- 172.21.15.6:0/3789011752 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd30006ace0 0x7fd30006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:27.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.747+0000 7fd30dffb700 1 -- 172.21.15.6:0/3789011752 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd314089cc0 con 0x7fd31c0cee80 2023-07-06T20:00:27.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.747+0000 7fd321557700 1 --2- 172.21.15.6:0/3789011752 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd30006ace0 0x7fd30006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:27.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.747+0000 7fd321557700 1 --2- 172.21.15.6:0/3789011752 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd30006ace0 0x7fd30006d190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd31800a990 tx=0x7fd318008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:27.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.751+0000 7fd30dffb700 1 -- 172.21.15.6:0/3789011752 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd314054c30 con 0x7fd31c0cee80 2023-07-06T20:00:27.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.948+0000 7fd3237bb700 1 -- 172.21.15.6:0/3789011752 --> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd31c15e2e0 con 0x7fd30006ace0 2023-07-06T20:00:27.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.956+0000 7fd30dffb700 1 -- 172.21.15.6:0/3789011752 <== mgr.4110 v2:172.21.15.6:6832/201543369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310838 (secure 0 0 0) 0x7fd31c15e2e0 con 0x7fd30006ace0 2023-07-06T20:00:27.963 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:27.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.960+0000 7fd3237bb700 1 -- 172.21.15.6:0/3789011752 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd30006ace0 msgr2=0x7fd30006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:27.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.960+0000 7fd3237bb700 1 --2- 172.21.15.6:0/3789011752 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd30006ace0 0x7fd30006d190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd31800a990 tx=0x7fd318008040 comp rx=0 tx=0).stop 2023-07-06T20:00:27.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.960+0000 7fd3237bb700 1 -- 172.21.15.6:0/3789011752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd31c0cee80 msgr2=0x7fd31c1488c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:27.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.960+0000 7fd3237bb700 1 --2- 172.21.15.6:0/3789011752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd31c0cee80 0x7fd31c1488c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fd314007d20 tx=0x7fd31400e3c0 comp rx=0 tx=0).stop 2023-07-06T20:00:27.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.960+0000 7fd3237bb700 1 -- 172.21.15.6:0/3789011752 shutdown_connections 2023-07-06T20:00:27.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.960+0000 7fd3237bb700 1 --2- 172.21.15.6:0/3789011752 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd30006ace0 0x7fd30006d190 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:27.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.960+0000 7fd3237bb700 1 --2- 172.21.15.6:0/3789011752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd31c0cee80 0x7fd31c1488c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:27.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.960+0000 7fd3237bb700 1 --2- 172.21.15.6:0/3789011752 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd31c071c00 0x7fd31c15d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:27.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.960+0000 7fd3237bb700 1 --2- 172.21.15.6:0/3789011752 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd31c0ceab0 0x7fd31c0b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:27.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.960+0000 7fd3237bb700 1 -- 172.21.15.6:0/3789011752 >> 172.21.15.6:0/3789011752 conn(0x7fd31c0cc420 msgr2=0x7fd31c15ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:27.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.960+0000 7fd3237bb700 1 -- 172.21.15.6:0/3789011752 shutdown_connections 2023-07-06T20:00:27.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:27.960+0000 7fd3237bb700 1 -- 172.21.15.6:0/3789011752 wait complete. 2023-07-06T20:00:27.970 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-06T20:00:27.974 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2023-07-06T20:00:26.734801+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220552,"kb_used_data":4936,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754754168,"statfs":{"total":773094113280,"available":772868268032,"internally_reserved":0,"allocated":5054464,"data_stored":2887700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001711"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.784953+0000","last_change":"2023-07-06T20:00:18.797795+0000","last_active":"2023-07-06T20:00:19.784953+0000","last_peered":"2023-07-06T20:00:19.784953+0000","last_clean":"2023-07-06T20:00:19.784953+0000","last_became_active":"2023-07-06T20:00:18.797506+0000","last_became_peered":"2023-07-06T20:00:18.797506+0000","last_unstale":"2023-07-06T20:00:19.784953+0000","last_undegraded":"2023-07-06T20:00:19.784953+0000","last_fullsized":"2023-07-06T20:00:19.784953+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:54:28.470814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.983173+0000","last_change":"2023-07-06T20:00:18.788878+0000","last_active":"2023-07-06T20:00:19.983173+0000","last_peered":"2023-07-06T20:00:19.983173+0000","last_clean":"2023-07-06T20:00:19.983173+0000","last_became_active":"2023-07-06T20:00:18.788600+0000","last_became_peered":"2023-07-06T20:00:18.788600+0000","last_unstale":"2023-07-06T20:00:19.983173+0000","last_undegraded":"2023-07-06T20:00:19.983173+0000","last_fullsized":"2023-07-06T20:00:19.983173+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:16:25.951721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.982043+0000","last_change":"2023-07-06T20:00:18.770773+0000","last_active":"2023-07-06T20:00:19.982043+0000","last_peered":"2023-07-06T20:00:19.982043+0000","last_clean":"2023-07-06T20:00:19.982043+0000","last_became_active":"2023-07-06T20:00:18.770016+0000","last_became_peered":"2023-07-06T20:00:18.770016+0000","last_unstale":"2023-07-06T20:00:19.982043+0000","last_undegraded":"2023-07-06T20:00:19.982043+0000","last_fullsized":"2023-07-06T20:00:19.982043+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:55:05.307974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.534890+0000","last_change":"2023-07-06T20:00:18.797463+0000","last_active":"2023-07-06T20:00:20.534890+0000","last_peered":"2023-07-06T20:00:20.534890+0000","last_clean":"2023-07-06T20:00:20.534890+0000","last_became_active":"2023-07-06T20:00:18.796991+0000","last_became_peered":"2023-07-06T20:00:18.796991+0000","last_unstale":"2023-07-06T20:00:20.534890+0000","last_undegraded":"2023-07-06T20:00:20.534890+0000","last_fullsized":"2023-07-06T20:00:20.534890+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:35:06.849437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.983170+0000","last_change":"2023-07-06T20:00:18.788729+0000","last_active":"2023-07-06T20:00:19.983170+0000","last_peered":"2023-07-06T20:00:19.983170+0000","last_clean":"2023-07-06T20:00:19.983170+0000","last_became_active":"2023-07-06T20:00:18.788441+0000","last_became_peered":"2023-07-06T20:00:18.788441+0000","last_unstale":"2023-07-06T20:00:19.983170+0000","last_undegraded":"2023-07-06T20:00:19.983170+0000","last_fullsized":"2023-07-06T20:00:19.983170+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:05:21.472424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.758662+0000","last_change":"2023-07-06T20:00:18.793252+0000","last_active":"2023-07-06T20:00:20.758662+0000","last_peered":"2023-07-06T20:00:20.758662+0000","last_clean":"2023-07-06T20:00:20.758662+0000","last_became_active":"2023-07-06T20:00:18.792970+0000","last_became_peered":"2023-07-06T20:00:18.792970+0000","last_unstale":"2023-07-06T20:00:20.758662+0000","last_undegraded":"2023-07-06T20:00:20.758662+0000","last_fullsized":"2023-07-06T20:00:20.758662+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:33:28.246384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.785072+0000","last_change":"2023-07-06T20:00:18.791850+0000","last_active":"2023-07-06T20:00:19.785072+0000","last_peered":"2023-07-06T20:00:19.785072+0000","last_clean":"2023-07-06T20:00:19.785072+0000","last_became_active":"2023-07-06T20:00:18.791463+0000","last_became_peered":"2023-07-06T20:00:18.791463+0000","last_unstale":"2023-07-06T20:00:19.785072+0000","last_undegraded":"2023-07-06T20:00:19.785072+0000","last_fullsized":"2023-07-06T20:00:19.785072+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:31:01.341300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.534645+0000","last_change":"2023-07-06T20:00:18.801014+0000","last_active":"2023-07-06T20:00:20.534645+0000","last_peered":"2023-07-06T20:00:20.534645+0000","last_clean":"2023-07-06T20:00:20.534645+0000","last_became_active":"2023-07-06T20:00:18.799044+0000","last_became_peered":"2023-07-06T20:00:18.799044+0000","last_unstale":"2023-07-06T20:00:20.534645+0000","last_undegraded":"2023-07-06T20:00:20.534645+0000","last_fullsized":"2023-07-06T20:00:20.534645+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:41:37.334198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.535372+0000","last_change":"2023-07-06T20:00:18.782336+0000","last_active":"2023-07-06T20:00:20.535372+0000","last_peered":"2023-07-06T20:00:20.535372+0000","last_clean":"2023-07-06T20:00:20.535372+0000","last_became_active":"2023-07-06T20:00:18.782024+0000","last_became_peered":"2023-07-06T20:00:18.782024+0000","last_unstale":"2023-07-06T20:00:20.535372+0000","last_undegraded":"2023-07-06T20:00:20.535372+0000","last_fullsized":"2023-07-06T20:00:20.535372+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:58:44.135670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.535411+0000","last_change":"2023-07-06T20:00:18.782506+0000","last_active":"2023-07-06T20:00:20.535411+0000","last_peered":"2023-07-06T20:00:20.535411+0000","last_clean":"2023-07-06T20:00:20.535411+0000","last_became_active":"2023-07-06T20:00:18.782193+0000","last_became_peered":"2023-07-06T20:00:18.782193+0000","last_unstale":"2023-07-06T20:00:20.535411+0000","last_undegraded":"2023-07-06T20:00:20.535411+0000","last_fullsized":"2023-07-06T20:00:20.535411+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:23:39.608356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.535033+0000","last_change":"2023-07-06T20:00:18.781463+0000","last_active":"2023-07-06T20:00:20.535033+0000","last_peered":"2023-07-06T20:00:20.535033+0000","last_clean":"2023-07-06T20:00:20.535033+0000","last_became_active":"2023-07-06T20:00:18.781117+0000","last_became_peered":"2023-07-06T20:00:18.781117+0000","last_unstale":"2023-07-06T20:00:20.535033+0000","last_undegraded":"2023-07-06T20:00:20.535033+0000","last_fullsized":"2023-07-06T20:00:20.535033+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:18:48.356378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.983493+0000","last_change":"2023-07-06T20:00:18.778799+0000","last_active":"2023-07-06T20:00:19.983493+0000","last_peered":"2023-07-06T20:00:19.983493+0000","last_clean":"2023-07-06T20:00:19.983493+0000","last_became_active":"2023-07-06T20:00:18.778517+0000","last_became_peered":"2023-07-06T20:00:18.778517+0000","last_unstale":"2023-07-06T20:00:19.983493+0000","last_undegraded":"2023-07-06T20:00:19.983493+0000","last_fullsized":"2023-07-06T20:00:19.983493+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:04:36.677262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.778855+0000","last_change":"2023-07-06T20:00:18.792051+0000","last_active":"2023-07-06T20:00:19.778855+0000","last_peered":"2023-07-06T20:00:19.778855+0000","last_clean":"2023-07-06T20:00:19.778855+0000","last_became_active":"2023-07-06T20:00:18.791781+0000","last_became_peered":"2023-07-06T20:00:18.791781+0000","last_unstale":"2023-07-06T20:00:19.778855+0000","last_undegraded":"2023-07-06T20:00:19.778855+0000","last_fullsized":"2023-07-06T20:00:19.778855+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:40:04.089922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.534797+0000","last_change":"2023-07-06T20:00:18.785276+0000","last_active":"2023-07-06T20:00:20.534797+0000","last_peered":"2023-07-06T20:00:20.534797+0000","last_clean":"2023-07-06T20:00:20.534797+0000","last_became_active":"2023-07-06T20:00:18.784983+0000","last_became_peered":"2023-07-06T20:00:18.784983+0000","last_unstale":"2023-07-06T20:00:20.534797+0000","last_undegraded":"2023-07-06T20:00:20.534797+0000","last_fullsized":"2023-07-06T20:00:20.534797+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:53:54.246586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.758629+0000","last_change":"2023-07-06T20:00:18.792695+0000","last_active":"2023-07-06T20:00:20.758629+0000","last_peered":"2023-07-06T20:00:20.758629+0000","last_clean":"2023-07-06T20:00:20.758629+0000","last_became_active":"2023-07-06T20:00:18.792424+0000","last_became_peered":"2023-07-06T20:00:18.792424+0000","last_unstale":"2023-07-06T20:00:20.758629+0000","last_undegraded":"2023-07-06T20:00:20.758629+0000","last_fullsized":"2023-07-06T20:00:20.758629+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:23:39.608356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.784885+0000","last_change":"2023-07-06T20:00:18.790685+0000","last_active":"2023-07-06T20:00:20.784885+0000","last_peered":"2023-07-06T20:00:20.784885+0000","last_clean":"2023-07-06T20:00:20.784885+0000","last_became_active":"2023-07-06T20:00:18.786798+0000","last_became_peered":"2023-07-06T20:00:18.786798+0000","last_unstale":"2023-07-06T20:00:20.784885+0000","last_undegraded":"2023-07-06T20:00:20.784885+0000","last_fullsized":"2023-07-06T20:00:20.784885+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:42:05.884731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.982163+0000","last_change":"2023-07-06T20:00:18.789031+0000","last_active":"2023-07-06T20:00:19.982163+0000","last_peered":"2023-07-06T20:00:19.982163+0000","last_clean":"2023-07-06T20:00:19.982163+0000","last_became_active":"2023-07-06T20:00:18.788714+0000","last_became_peered":"2023-07-06T20:00:18.788714+0000","last_unstale":"2023-07-06T20:00:19.982163+0000","last_undegraded":"2023-07-06T20:00:19.982163+0000","last_fullsized":"2023-07-06T20:00:19.982163+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:13:54.152588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.981922+0000","last_change":"2023-07-06T20:00:18.784230+0000","last_active":"2023-07-06T20:00:19.981922+0000","last_peered":"2023-07-06T20:00:19.981922+0000","last_clean":"2023-07-06T20:00:19.981922+0000","last_became_active":"2023-07-06T20:00:18.783917+0000","last_became_peered":"2023-07-06T20:00:18.783917+0000","last_unstale":"2023-07-06T20:00:19.981922+0000","last_undegraded":"2023-07-06T20:00:19.981922+0000","last_fullsized":"2023-07-06T20:00:19.981922+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:09:35.202965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.784774+0000","last_change":"2023-07-06T20:00:18.794941+0000","last_active":"2023-07-06T20:00:20.784774+0000","last_peered":"2023-07-06T20:00:20.784774+0000","last_clean":"2023-07-06T20:00:20.784774+0000","last_became_active":"2023-07-06T20:00:18.791352+0000","last_became_peered":"2023-07-06T20:00:18.791352+0000","last_unstale":"2023-07-06T20:00:20.784774+0000","last_undegraded":"2023-07-06T20:00:20.784774+0000","last_fullsized":"2023-07-06T20:00:20.784774+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:10:20.934642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.778857+0000","last_change":"2023-07-06T20:00:18.787228+0000","last_active":"2023-07-06T20:00:19.778857+0000","last_peered":"2023-07-06T20:00:19.778857+0000","last_clean":"2023-07-06T20:00:19.778857+0000","last_became_active":"2023-07-06T20:00:18.786946+0000","last_became_peered":"2023-07-06T20:00:18.786946+0000","last_unstale":"2023-07-06T20:00:19.778857+0000","last_undegraded":"2023-07-06T20:00:19.778857+0000","last_fullsized":"2023-07-06T20:00:19.778857+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:26:02.244867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.758671+0000","last_change":"2023-07-06T20:00:18.794726+0000","last_active":"2023-07-06T20:00:20.758671+0000","last_peered":"2023-07-06T20:00:20.758671+0000","last_clean":"2023-07-06T20:00:20.758671+0000","last_became_active":"2023-07-06T20:00:18.794295+0000","last_became_peered":"2023-07-06T20:00:18.794295+0000","last_unstale":"2023-07-06T20:00:20.758671+0000","last_undegraded":"2023-07-06T20:00:20.758671+0000","last_fullsized":"2023-07-06T20:00:20.758671+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:54:28.470814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.534918+0000","last_change":"2023-07-06T20:00:18.798178+0000","last_active":"2023-07-06T20:00:20.534918+0000","last_peered":"2023-07-06T20:00:20.534918+0000","last_clean":"2023-07-06T20:00:20.534918+0000","last_became_active":"2023-07-06T20:00:18.797887+0000","last_became_peered":"2023-07-06T20:00:18.797887+0000","last_unstale":"2023-07-06T20:00:20.534918+0000","last_undegraded":"2023-07-06T20:00:20.534918+0000","last_fullsized":"2023-07-06T20:00:20.534918+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:37:23.614046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.784614+0000","last_change":"2023-07-06T20:00:18.794588+0000","last_active":"2023-07-06T20:00:20.784614+0000","last_peered":"2023-07-06T20:00:20.784614+0000","last_clean":"2023-07-06T20:00:20.784614+0000","last_became_active":"2023-07-06T20:00:18.791372+0000","last_became_peered":"2023-07-06T20:00:18.791372+0000","last_unstale":"2023-07-06T20:00:20.784614+0000","last_undegraded":"2023-07-06T20:00:20.784614+0000","last_fullsized":"2023-07-06T20:00:20.784614+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:06:26.997156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.784953+0000","last_change":"2023-07-06T20:00:18.793930+0000","last_active":"2023-07-06T20:00:20.784953+0000","last_peered":"2023-07-06T20:00:20.784953+0000","last_clean":"2023-07-06T20:00:20.784953+0000","last_became_active":"2023-07-06T20:00:18.793651+0000","last_became_peered":"2023-07-06T20:00:18.793651+0000","last_unstale":"2023-07-06T20:00:20.784953+0000","last_undegraded":"2023-07-06T20:00:20.784953+0000","last_fullsized":"2023-07-06T20:00:20.784953+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:11:04.455743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.784790+0000","last_change":"2023-07-06T20:00:18.784646+0000","last_active":"2023-07-06T20:00:20.784790+0000","last_peered":"2023-07-06T20:00:20.784790+0000","last_clean":"2023-07-06T20:00:20.784790+0000","last_became_active":"2023-07-06T20:00:18.784372+0000","last_became_peered":"2023-07-06T20:00:18.784372+0000","last_unstale":"2023-07-06T20:00:20.784790+0000","last_undegraded":"2023-07-06T20:00:20.784790+0000","last_fullsized":"2023-07-06T20:00:20.784790+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:19:26.966192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.779108+0000","last_change":"2023-07-06T20:00:18.791356+0000","last_active":"2023-07-06T20:00:19.779108+0000","last_peered":"2023-07-06T20:00:19.779108+0000","last_clean":"2023-07-06T20:00:19.779108+0000","last_became_active":"2023-07-06T20:00:18.791015+0000","last_became_peered":"2023-07-06T20:00:18.791015+0000","last_unstale":"2023-07-06T20:00:19.779108+0000","last_undegraded":"2023-07-06T20:00:19.779108+0000","last_fullsized":"2023-07-06T20:00:19.779108+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:13:11.649414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.982198+0000","last_change":"2023-07-06T20:00:18.773365+0000","last_active":"2023-07-06T20:00:19.982198+0000","last_peered":"2023-07-06T20:00:19.982198+0000","last_clean":"2023-07-06T20:00:19.982198+0000","last_became_active":"2023-07-06T20:00:18.773068+0000","last_became_peered":"2023-07-06T20:00:18.773068+0000","last_unstale":"2023-07-06T20:00:19.982198+0000","last_undegraded":"2023-07-06T20:00:19.982198+0000","last_fullsized":"2023-07-06T20:00:19.982198+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:43:49.927001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.983318+0000","last_change":"2023-07-06T20:00:18.782370+0000","last_active":"2023-07-06T20:00:19.983318+0000","last_peered":"2023-07-06T20:00:19.983318+0000","last_clean":"2023-07-06T20:00:19.983318+0000","last_became_active":"2023-07-06T20:00:18.782092+0000","last_became_peered":"2023-07-06T20:00:18.782092+0000","last_unstale":"2023-07-06T20:00:19.983318+0000","last_undegraded":"2023-07-06T20:00:19.983318+0000","last_fullsized":"2023-07-06T20:00:19.983318+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:40:18.737248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.784867+0000","last_change":"2023-07-06T20:00:18.790747+0000","last_active":"2023-07-06T20:00:20.784867+0000","last_peered":"2023-07-06T20:00:20.784867+0000","last_clean":"2023-07-06T20:00:20.784867+0000","last_became_active":"2023-07-06T20:00:18.786752+0000","last_became_peered":"2023-07-06T20:00:18.786752+0000","last_unstale":"2023-07-06T20:00:20.784867+0000","last_undegraded":"2023-07-06T20:00:20.784867+0000","last_fullsized":"2023-07-06T20:00:20.784867+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:55:26.600087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.981795+0000","last_change":"2023-07-06T20:00:18.780352+0000","last_active":"2023-07-06T20:00:19.981795+0000","last_peered":"2023-07-06T20:00:19.981795+0000","last_clean":"2023-07-06T20:00:19.981795+0000","last_became_active":"2023-07-06T20:00:18.780066+0000","last_became_peered":"2023-07-06T20:00:18.780066+0000","last_unstale":"2023-07-06T20:00:19.981795+0000","last_undegraded":"2023-07-06T20:00:19.981795+0000","last_fullsized":"2023-07-06T20:00:19.981795+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:45:43.882355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.758409+0000","last_change":"2023-07-06T20:00:18.792184+0000","last_active":"2023-07-06T20:00:20.758409+0000","last_peered":"2023-07-06T20:00:20.758409+0000","last_clean":"2023-07-06T20:00:20.758409+0000","last_became_active":"2023-07-06T20:00:18.791925+0000","last_became_peered":"2023-07-06T20:00:18.791925+0000","last_unstale":"2023-07-06T20:00:20.758409+0000","last_undegraded":"2023-07-06T20:00:20.758409+0000","last_fullsized":"2023-07-06T20:00:20.758409+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:20:04.833014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.778693+0000","last_change":"2023-07-06T20:00:18.773744+0000","last_active":"2023-07-06T20:00:19.778693+0000","last_peered":"2023-07-06T20:00:19.778693+0000","last_clean":"2023-07-06T20:00:19.778693+0000","last_became_active":"2023-07-06T20:00:18.773449+0000","last_became_peered":"2023-07-06T20:00:18.773449+0000","last_unstale":"2023-07-06T20:00:19.778693+0000","last_undegraded":"2023-07-06T20:00:19.778693+0000","last_fullsized":"2023-07-06T20:00:19.778693+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:16:55.588037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.782741+0000","last_change":"2023-07-06T20:00:18.791581+0000","last_active":"2023-07-06T20:00:19.782741+0000","last_peered":"2023-07-06T20:00:19.782741+0000","last_clean":"2023-07-06T20:00:19.782741+0000","last_became_active":"2023-07-06T20:00:18.791313+0000","last_became_peered":"2023-07-06T20:00:18.791313+0000","last_unstale":"2023-07-06T20:00:19.782741+0000","last_undegraded":"2023-07-06T20:00:19.782741+0000","last_fullsized":"2023-07-06T20:00:19.782741+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:54:03.896058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"40'4","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.759149+0000","last_change":"2023-07-06T20:00:17.758785+0000","last_active":"2023-07-06T20:00:20.759149+0000","last_peered":"2023-07-06T20:00:20.759149+0000","last_clean":"2023-07-06T20:00:20.759149+0000","last_became_active":"2023-07-06T20:00:17.758511+0000","last_became_peered":"2023-07-06T20:00:17.758511+0000","last_unstale":"2023-07-06T20:00:20.759149+0000","last_undegraded":"2023-07-06T20:00:20.759149+0000","last_fullsized":"2023-07-06T20:00:20.759149+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:40:17.735573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.784449+0000","last_change":"2023-07-06T20:00:18.786438+0000","last_active":"2023-07-06T20:00:20.784449+0000","last_peered":"2023-07-06T20:00:20.784449+0000","last_clean":"2023-07-06T20:00:20.784449+0000","last_became_active":"2023-07-06T20:00:18.786158+0000","last_became_peered":"2023-07-06T20:00:18.786158+0000","last_unstale":"2023-07-06T20:00:20.784449+0000","last_undegraded":"2023-07-06T20:00:20.784449+0000","last_fullsized":"2023-07-06T20:00:20.784449+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:54:08.041729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.982244+0000","last_change":"2023-07-06T20:00:17.754956+0000","last_active":"2023-07-06T20:00:19.982244+0000","last_peered":"2023-07-06T20:00:19.982244+0000","last_clean":"2023-07-06T20:00:19.982244+0000","last_became_active":"2023-07-06T20:00:17.754698+0000","last_became_peered":"2023-07-06T20:00:17.754698+0000","last_unstale":"2023-07-06T20:00:19.982244+0000","last_undegraded":"2023-07-06T20:00:19.982244+0000","last_fullsized":"2023-07-06T20:00:19.982244+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:24:05.555102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.983280+0000","last_change":"2023-07-06T20:00:18.791833+0000","last_active":"2023-07-06T20:00:19.983280+0000","last_peered":"2023-07-06T20:00:19.983280+0000","last_clean":"2023-07-06T20:00:19.983280+0000","last_became_active":"2023-07-06T20:00:18.791558+0000","last_became_peered":"2023-07-06T20:00:18.791558+0000","last_unstale":"2023-07-06T20:00:19.983280+0000","last_undegraded":"2023-07-06T20:00:19.983280+0000","last_fullsized":"2023-07-06T20:00:19.983280+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:31:56.318067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.782926+0000","last_change":"2023-07-06T20:00:17.751853+0000","last_active":"2023-07-06T20:00:19.782926+0000","last_peered":"2023-07-06T20:00:19.782926+0000","last_clean":"2023-07-06T20:00:19.782926+0000","last_became_active":"2023-07-06T20:00:17.751574+0000","last_became_peered":"2023-07-06T20:00:17.751574+0000","last_unstale":"2023-07-06T20:00:19.782926+0000","last_undegraded":"2023-07-06T20:00:19.782926+0000","last_fullsized":"2023-07-06T20:00:19.782926+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:16:23.089607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.782808+0000","last_change":"2023-07-06T20:00:18.796488+0000","last_active":"2023-07-06T20:00:19.782808+0000","last_peered":"2023-07-06T20:00:19.782808+0000","last_clean":"2023-07-06T20:00:19.782808+0000","last_became_active":"2023-07-06T20:00:18.796067+0000","last_became_peered":"2023-07-06T20:00:18.796067+0000","last_unstale":"2023-07-06T20:00:19.782808+0000","last_undegraded":"2023-07-06T20:00:19.782808+0000","last_fullsized":"2023-07-06T20:00:19.782808+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:27:02.558791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.785187+0000","last_change":"2023-07-06T20:00:17.753933+0000","last_active":"2023-07-06T20:00:19.785187+0000","last_peered":"2023-07-06T20:00:19.785187+0000","last_clean":"2023-07-06T20:00:19.785187+0000","last_became_active":"2023-07-06T20:00:17.753624+0000","last_became_peered":"2023-07-06T20:00:17.753624+0000","last_unstale":"2023-07-06T20:00:19.785187+0000","last_undegraded":"2023-07-06T20:00:19.785187+0000","last_fullsized":"2023-07-06T20:00:19.785187+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:59:52.285935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.981795+0000","last_change":"2023-07-06T20:00:18.781516+0000","last_active":"2023-07-06T20:00:19.981795+0000","last_peered":"2023-07-06T20:00:19.981795+0000","last_clean":"2023-07-06T20:00:19.981795+0000","last_became_active":"2023-07-06T20:00:18.781216+0000","last_became_peered":"2023-07-06T20:00:18.781216+0000","last_unstale":"2023-07-06T20:00:19.981795+0000","last_undegraded":"2023-07-06T20:00:19.981795+0000","last_fullsized":"2023-07-06T20:00:19.981795+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:46:26.265813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.758928+0000","last_change":"2023-07-06T20:00:17.749676+0000","last_active":"2023-07-06T20:00:20.758928+0000","last_peered":"2023-07-06T20:00:20.758928+0000","last_clean":"2023-07-06T20:00:20.758928+0000","last_became_active":"2023-07-06T20:00:17.749394+0000","last_became_peered":"2023-07-06T20:00:17.749394+0000","last_unstale":"2023-07-06T20:00:20.758928+0000","last_undegraded":"2023-07-06T20:00:20.758928+0000","last_fullsized":"2023-07-06T20:00:20.758928+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:26:40.280701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.534954+0000","last_change":"2023-07-06T20:00:18.782737+0000","last_active":"2023-07-06T20:00:20.534954+0000","last_peered":"2023-07-06T20:00:20.534954+0000","last_clean":"2023-07-06T20:00:20.534954+0000","last_became_active":"2023-07-06T20:00:18.781643+0000","last_became_peered":"2023-07-06T20:00:18.781643+0000","last_unstale":"2023-07-06T20:00:20.534954+0000","last_undegraded":"2023-07-06T20:00:20.534954+0000","last_fullsized":"2023-07-06T20:00:20.534954+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:13:30.415725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.982171+0000","last_change":"2023-07-06T20:00:17.750239+0000","last_active":"2023-07-06T20:00:19.982171+0000","last_peered":"2023-07-06T20:00:19.982171+0000","last_clean":"2023-07-06T20:00:19.982171+0000","last_became_active":"2023-07-06T20:00:17.749871+0000","last_became_peered":"2023-07-06T20:00:17.749871+0000","last_unstale":"2023-07-06T20:00:19.982171+0000","last_undegraded":"2023-07-06T20:00:19.982171+0000","last_fullsized":"2023-07-06T20:00:19.982171+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:29:49.706526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.534687+0000","last_change":"2023-07-06T20:00:18.799303+0000","last_active":"2023-07-06T20:00:20.534687+0000","last_peered":"2023-07-06T20:00:20.534687+0000","last_clean":"2023-07-06T20:00:20.534687+0000","last_became_active":"2023-07-06T20:00:18.798742+0000","last_became_peered":"2023-07-06T20:00:18.798742+0000","last_unstale":"2023-07-06T20:00:20.534687+0000","last_undegraded":"2023-07-06T20:00:20.534687+0000","last_fullsized":"2023-07-06T20:00:20.534687+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:25:54.552409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.982884+0000","last_change":"2023-07-06T20:00:17.748331+0000","last_active":"2023-07-06T20:00:19.982884+0000","last_peered":"2023-07-06T20:00:19.982884+0000","last_clean":"2023-07-06T20:00:19.982884+0000","last_became_active":"2023-07-06T20:00:17.748017+0000","last_became_peered":"2023-07-06T20:00:17.748017+0000","last_unstale":"2023-07-06T20:00:19.982884+0000","last_undegraded":"2023-07-06T20:00:19.982884+0000","last_fullsized":"2023-07-06T20:00:19.982884+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:55:45.778779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.784319+0000","last_change":"2023-07-06T20:00:18.791237+0000","last_active":"2023-07-06T20:00:20.784319+0000","last_peered":"2023-07-06T20:00:20.784319+0000","last_clean":"2023-07-06T20:00:20.784319+0000","last_became_active":"2023-07-06T20:00:18.790963+0000","last_became_peered":"2023-07-06T20:00:18.790963+0000","last_unstale":"2023-07-06T20:00:20.784319+0000","last_undegraded":"2023-07-06T20:00:20.784319+0000","last_fullsized":"2023-07-06T20:00:20.784319+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:19:38.757805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.534977+0000","last_change":"2023-07-06T20:00:17.750674+0000","last_active":"2023-07-06T20:00:20.534977+0000","last_peered":"2023-07-06T20:00:20.534977+0000","last_clean":"2023-07-06T20:00:20.534977+0000","last_became_active":"2023-07-06T20:00:17.749956+0000","last_became_peered":"2023-07-06T20:00:17.749956+0000","last_unstale":"2023-07-06T20:00:20.534977+0000","last_undegraded":"2023-07-06T20:00:20.534977+0000","last_fullsized":"2023-07-06T20:00:20.534977+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:04:42.384232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.982177+0000","last_change":"2023-07-06T20:00:18.784114+0000","last_active":"2023-07-06T20:00:19.982177+0000","last_peered":"2023-07-06T20:00:19.982177+0000","last_clean":"2023-07-06T20:00:19.982177+0000","last_became_active":"2023-07-06T20:00:18.783809+0000","last_became_peered":"2023-07-06T20:00:18.783809+0000","last_unstale":"2023-07-06T20:00:19.982177+0000","last_undegraded":"2023-07-06T20:00:19.982177+0000","last_fullsized":"2023-07-06T20:00:19.982177+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:53:22.147233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.982282+0000","last_change":"2023-07-06T20:00:17.750053+0000","last_active":"2023-07-06T20:00:19.982282+0000","last_peered":"2023-07-06T20:00:19.982282+0000","last_clean":"2023-07-06T20:00:19.982282+0000","last_became_active":"2023-07-06T20:00:17.749690+0000","last_became_peered":"2023-07-06T20:00:17.749690+0000","last_unstale":"2023-07-06T20:00:19.982282+0000","last_undegraded":"2023-07-06T20:00:19.982282+0000","last_fullsized":"2023-07-06T20:00:19.982282+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:41:37.100185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.784990+0000","last_change":"2023-07-06T20:00:18.792891+0000","last_active":"2023-07-06T20:00:19.784990+0000","last_peered":"2023-07-06T20:00:19.784990+0000","last_clean":"2023-07-06T20:00:19.784990+0000","last_became_active":"2023-07-06T20:00:18.792619+0000","last_became_peered":"2023-07-06T20:00:18.792619+0000","last_unstale":"2023-07-06T20:00:19.784990+0000","last_undegraded":"2023-07-06T20:00:19.784990+0000","last_fullsized":"2023-07-06T20:00:19.784990+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:05:21.472424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.535527+0000","last_change":"2023-07-06T20:00:17.756702+0000","last_active":"2023-07-06T20:00:20.535527+0000","last_peered":"2023-07-06T20:00:20.535527+0000","last_clean":"2023-07-06T20:00:20.535527+0000","last_became_active":"2023-07-06T20:00:17.756498+0000","last_became_peered":"2023-07-06T20:00:17.756498+0000","last_unstale":"2023-07-06T20:00:20.535527+0000","last_undegraded":"2023-07-06T20:00:20.535527+0000","last_fullsized":"2023-07-06T20:00:20.535527+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:54:27.469139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.758947+0000","last_change":"2023-07-06T20:00:18.791066+0000","last_active":"2023-07-06T20:00:20.758947+0000","last_peered":"2023-07-06T20:00:20.758947+0000","last_clean":"2023-07-06T20:00:20.758947+0000","last_became_active":"2023-07-06T20:00:18.790715+0000","last_became_peered":"2023-07-06T20:00:18.790715+0000","last_unstale":"2023-07-06T20:00:20.758947+0000","last_undegraded":"2023-07-06T20:00:20.758947+0000","last_fullsized":"2023-07-06T20:00:20.758947+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:57:06.872501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.785171+0000","last_change":"2023-07-06T20:00:17.758181+0000","last_active":"2023-07-06T20:00:19.785171+0000","last_peered":"2023-07-06T20:00:19.785171+0000","last_clean":"2023-07-06T20:00:19.785171+0000","last_became_active":"2023-07-06T20:00:17.757621+0000","last_became_peered":"2023-07-06T20:00:17.757621+0000","last_unstale":"2023-07-06T20:00:19.785171+0000","last_undegraded":"2023-07-06T20:00:19.785171+0000","last_fullsized":"2023-07-06T20:00:19.785171+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:40:17.735573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.784953+0000","last_change":"2023-07-06T20:00:18.792014+0000","last_active":"2023-07-06T20:00:19.784953+0000","last_peered":"2023-07-06T20:00:19.784953+0000","last_clean":"2023-07-06T20:00:19.784953+0000","last_became_active":"2023-07-06T20:00:18.791717+0000","last_became_peered":"2023-07-06T20:00:18.791717+0000","last_unstale":"2023-07-06T20:00:19.784953+0000","last_undegraded":"2023-07-06T20:00:19.784953+0000","last_fullsized":"2023-07-06T20:00:19.784953+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:55:46.780454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"40'6","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.778990+0000","last_change":"2023-07-06T20:00:17.744182+0000","last_active":"2023-07-06T20:00:19.778990+0000","last_peered":"2023-07-06T20:00:19.778990+0000","last_clean":"2023-07-06T20:00:19.778990+0000","last_became_active":"2023-07-06T20:00:17.743898+0000","last_became_peered":"2023-07-06T20:00:17.743898+0000","last_unstale":"2023-07-06T20:00:19.778990+0000","last_undegraded":"2023-07-06T20:00:19.778990+0000","last_fullsized":"2023-07-06T20:00:19.778990+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:30:36.495117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.784357+0000","last_change":"2023-07-06T20:00:18.793765+0000","last_active":"2023-07-06T20:00:20.784357+0000","last_peered":"2023-07-06T20:00:20.784357+0000","last_clean":"2023-07-06T20:00:20.784357+0000","last_became_active":"2023-07-06T20:00:18.790701+0000","last_became_peered":"2023-07-06T20:00:18.790701+0000","last_unstale":"2023-07-06T20:00:20.784357+0000","last_undegraded":"2023-07-06T20:00:20.784357+0000","last_fullsized":"2023-07-06T20:00:20.784357+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:13:59.267529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.759131+0000","last_change":"2023-07-06T20:00:17.752168+0000","last_active":"2023-07-06T20:00:20.759131+0000","last_peered":"2023-07-06T20:00:20.759131+0000","last_clean":"2023-07-06T20:00:20.759131+0000","last_became_active":"2023-07-06T20:00:17.751874+0000","last_became_peered":"2023-07-06T20:00:17.751874+0000","last_unstale":"2023-07-06T20:00:20.759131+0000","last_undegraded":"2023-07-06T20:00:20.759131+0000","last_fullsized":"2023-07-06T20:00:20.759131+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:31:55.316392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.535123+0000","last_change":"2023-07-06T20:00:18.784613+0000","last_active":"2023-07-06T20:00:20.535123+0000","last_peered":"2023-07-06T20:00:20.535123+0000","last_clean":"2023-07-06T20:00:20.535123+0000","last_became_active":"2023-07-06T20:00:18.782440+0000","last_became_peered":"2023-07-06T20:00:18.782440+0000","last_unstale":"2023-07-06T20:00:20.535123+0000","last_undegraded":"2023-07-06T20:00:20.535123+0000","last_fullsized":"2023-07-06T20:00:20.535123+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:59:24.380937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.784841+0000","last_change":"2023-07-06T20:00:17.755859+0000","last_active":"2023-07-06T20:00:19.784841+0000","last_peered":"2023-07-06T20:00:19.784841+0000","last_clean":"2023-07-06T20:00:19.784841+0000","last_became_active":"2023-07-06T20:00:17.755572+0000","last_became_peered":"2023-07-06T20:00:17.755572+0000","last_unstale":"2023-07-06T20:00:19.784841+0000","last_undegraded":"2023-07-06T20:00:19.784841+0000","last_fullsized":"2023-07-06T20:00:19.784841+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:26:40.280701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.758457+0000","last_change":"2023-07-06T20:00:18.791582+0000","last_active":"2023-07-06T20:00:20.758457+0000","last_peered":"2023-07-06T20:00:20.758457+0000","last_clean":"2023-07-06T20:00:20.758457+0000","last_became_active":"2023-07-06T20:00:18.791321+0000","last_became_peered":"2023-07-06T20:00:18.791321+0000","last_unstale":"2023-07-06T20:00:20.758457+0000","last_undegraded":"2023-07-06T20:00:20.758457+0000","last_fullsized":"2023-07-06T20:00:20.758457+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:59:24.380937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.758547+0000","last_change":"2023-07-06T20:00:17.754316+0000","last_active":"2023-07-06T20:00:20.758547+0000","last_peered":"2023-07-06T20:00:20.758547+0000","last_clean":"2023-07-06T20:00:20.758547+0000","last_became_active":"2023-07-06T20:00:17.753974+0000","last_became_peered":"2023-07-06T20:00:17.753974+0000","last_unstale":"2023-07-06T20:00:20.758547+0000","last_undegraded":"2023-07-06T20:00:20.758547+0000","last_fullsized":"2023-07-06T20:00:20.758547+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:32:00.201485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.785259+0000","last_change":"2023-07-06T20:00:18.797027+0000","last_active":"2023-07-06T20:00:19.785259+0000","last_peered":"2023-07-06T20:00:19.785259+0000","last_clean":"2023-07-06T20:00:19.785259+0000","last_became_active":"2023-07-06T20:00:18.796746+0000","last_became_peered":"2023-07-06T20:00:18.796746+0000","last_unstale":"2023-07-06T20:00:19.785259+0000","last_undegraded":"2023-07-06T20:00:19.785259+0000","last_fullsized":"2023-07-06T20:00:19.785259+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:25:42.486487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"40'8","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.534980+0000","last_change":"2023-07-06T20:00:17.750850+0000","last_active":"2023-07-06T20:00:20.534980+0000","last_peered":"2023-07-06T20:00:20.534980+0000","last_clean":"2023-07-06T20:00:20.534980+0000","last_became_active":"2023-07-06T20:00:17.750550+0000","last_became_peered":"2023-07-06T20:00:17.750550+0000","last_unstale":"2023-07-06T20:00:20.534980+0000","last_undegraded":"2023-07-06T20:00:20.534980+0000","last_fullsized":"2023-07-06T20:00:20.534980+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:57:14.006516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.779118+0000","last_change":"2023-07-06T20:00:18.776952+0000","last_active":"2023-07-06T20:00:19.779118+0000","last_peered":"2023-07-06T20:00:19.779118+0000","last_clean":"2023-07-06T20:00:19.779118+0000","last_became_active":"2023-07-06T20:00:18.776656+0000","last_became_peered":"2023-07-06T20:00:18.776656+0000","last_unstale":"2023-07-06T20:00:19.779118+0000","last_undegraded":"2023-07-06T20:00:19.779118+0000","last_fullsized":"2023-07-06T20:00:19.779118+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:56:52.425528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.778870+0000","last_change":"2023-07-06T20:00:17.747641+0000","last_active":"2023-07-06T20:00:19.778870+0000","last_peered":"2023-07-06T20:00:19.778870+0000","last_clean":"2023-07-06T20:00:19.778870+0000","last_became_active":"2023-07-06T20:00:17.747332+0000","last_became_peered":"2023-07-06T20:00:17.747332+0000","last_unstale":"2023-07-06T20:00:19.778870+0000","last_undegraded":"2023-07-06T20:00:19.778870+0000","last_fullsized":"2023-07-06T20:00:19.778870+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:33:43.637915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.535466+0000","last_change":"2023-07-06T20:00:18.796669+0000","last_active":"2023-07-06T20:00:20.535466+0000","last_peered":"2023-07-06T20:00:20.535466+0000","last_clean":"2023-07-06T20:00:20.535466+0000","last_became_active":"2023-07-06T20:00:18.796359+0000","last_became_peered":"2023-07-06T20:00:18.796359+0000","last_unstale":"2023-07-06T20:00:20.535466+0000","last_undegraded":"2023-07-06T20:00:20.535466+0000","last_fullsized":"2023-07-06T20:00:20.535466+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:55:46.780454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.982024+0000","last_change":"2023-07-06T20:00:17.750549+0000","last_active":"2023-07-06T20:00:19.982024+0000","last_peered":"2023-07-06T20:00:19.982024+0000","last_clean":"2023-07-06T20:00:19.982024+0000","last_became_active":"2023-07-06T20:00:17.749747+0000","last_became_peered":"2023-07-06T20:00:17.749747+0000","last_unstale":"2023-07-06T20:00:19.982024+0000","last_undegraded":"2023-07-06T20:00:19.982024+0000","last_fullsized":"2023-07-06T20:00:19.982024+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:11:50.023006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.784518+0000","last_change":"2023-07-06T20:00:18.795721+0000","last_active":"2023-07-06T20:00:20.784518+0000","last_peered":"2023-07-06T20:00:20.784518+0000","last_clean":"2023-07-06T20:00:20.784518+0000","last_became_active":"2023-07-06T20:00:18.795429+0000","last_became_peered":"2023-07-06T20:00:18.795429+0000","last_unstale":"2023-07-06T20:00:20.784518+0000","last_undegraded":"2023-07-06T20:00:20.784518+0000","last_fullsized":"2023-07-06T20:00:20.784518+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:35:55.432560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"40'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.983176+0000","last_change":"2023-07-06T20:00:17.749209+0000","last_active":"2023-07-06T20:00:19.983176+0000","last_peered":"2023-07-06T20:00:19.983176+0000","last_clean":"2023-07-06T20:00:19.983176+0000","last_became_active":"2023-07-06T20:00:17.748680+0000","last_became_peered":"2023-07-06T20:00:17.748680+0000","last_unstale":"2023-07-06T20:00:19.983176+0000","last_undegraded":"2023-07-06T20:00:19.983176+0000","last_fullsized":"2023-07-06T20:00:19.983176+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:31:00.339625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.784889+0000","last_change":"2023-07-06T20:00:18.795387+0000","last_active":"2023-07-06T20:00:20.784889+0000","last_peered":"2023-07-06T20:00:20.784889+0000","last_clean":"2023-07-06T20:00:20.784889+0000","last_became_active":"2023-07-06T20:00:18.793819+0000","last_became_peered":"2023-07-06T20:00:18.793819+0000","last_unstale":"2023-07-06T20:00:20.784889+0000","last_undegraded":"2023-07-06T20:00:20.784889+0000","last_fullsized":"2023-07-06T20:00:20.784889+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:46:36.068369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.759013+0000","last_change":"2023-07-06T20:00:17.758772+0000","last_active":"2023-07-06T20:00:20.759013+0000","last_peered":"2023-07-06T20:00:20.759013+0000","last_clean":"2023-07-06T20:00:20.759013+0000","last_became_active":"2023-07-06T20:00:17.758536+0000","last_became_peered":"2023-07-06T20:00:17.758536+0000","last_unstale":"2023-07-06T20:00:20.759013+0000","last_undegraded":"2023-07-06T20:00:20.759013+0000","last_fullsized":"2023-07-06T20:00:20.759013+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:31:00.339625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.758574+0000","last_change":"2023-07-06T20:00:18.790997+0000","last_active":"2023-07-06T20:00:20.758574+0000","last_peered":"2023-07-06T20:00:20.758574+0000","last_clean":"2023-07-06T20:00:20.758574+0000","last_became_active":"2023-07-06T20:00:18.790725+0000","last_became_peered":"2023-07-06T20:00:18.790725+0000","last_unstale":"2023-07-06T20:00:20.758574+0000","last_undegraded":"2023-07-06T20:00:20.758574+0000","last_fullsized":"2023-07-06T20:00:20.758574+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:58:44.135670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.759240+0000","last_change":"2023-07-06T20:00:17.749103+0000","last_active":"2023-07-06T20:00:20.759240+0000","last_peered":"2023-07-06T20:00:20.759240+0000","last_clean":"2023-07-06T20:00:20.759240+0000","last_became_active":"2023-07-06T20:00:17.748753+0000","last_became_peered":"2023-07-06T20:00:17.748753+0000","last_unstale":"2023-07-06T20:00:20.759240+0000","last_undegraded":"2023-07-06T20:00:20.759240+0000","last_fullsized":"2023-07-06T20:00:20.759240+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:59:52.285935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.782602+0000","last_change":"2023-07-06T20:00:18.776897+0000","last_active":"2023-07-06T20:00:19.782602+0000","last_peered":"2023-07-06T20:00:19.782602+0000","last_clean":"2023-07-06T20:00:19.782602+0000","last_became_active":"2023-07-06T20:00:18.775604+0000","last_became_peered":"2023-07-06T20:00:18.775604+0000","last_unstale":"2023-07-06T20:00:19.782602+0000","last_undegraded":"2023-07-06T20:00:19.782602+0000","last_fullsized":"2023-07-06T20:00:19.782602+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:09:35.123566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.982932+0000","last_change":"2023-07-06T20:00:17.757297+0000","last_active":"2023-07-06T20:00:19.982932+0000","last_peered":"2023-07-06T20:00:19.982932+0000","last_clean":"2023-07-06T20:00:19.982932+0000","last_became_active":"2023-07-06T20:00:17.756954+0000","last_became_peered":"2023-07-06T20:00:17.756954+0000","last_unstale":"2023-07-06T20:00:19.982932+0000","last_undegraded":"2023-07-06T20:00:19.982932+0000","last_fullsized":"2023-07-06T20:00:19.982932+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:54:27.469139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.778695+0000","last_change":"2023-07-06T20:00:18.775815+0000","last_active":"2023-07-06T20:00:19.778695+0000","last_peered":"2023-07-06T20:00:19.778695+0000","last_clean":"2023-07-06T20:00:19.778695+0000","last_became_active":"2023-07-06T20:00:18.775242+0000","last_became_peered":"2023-07-06T20:00:18.775242+0000","last_unstale":"2023-07-06T20:00:19.778695+0000","last_undegraded":"2023-07-06T20:00:19.778695+0000","last_fullsized":"2023-07-06T20:00:19.778695+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:02:28.634127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.534708+0000","last_change":"2023-07-06T20:00:17.749817+0000","last_active":"2023-07-06T20:00:20.534708+0000","last_peered":"2023-07-06T20:00:20.534708+0000","last_clean":"2023-07-06T20:00:20.534708+0000","last_became_active":"2023-07-06T20:00:17.749463+0000","last_became_peered":"2023-07-06T20:00:17.749463+0000","last_unstale":"2023-07-06T20:00:20.534708+0000","last_undegraded":"2023-07-06T20:00:20.534708+0000","last_fullsized":"2023-07-06T20:00:20.534708+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:49:30.012975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.534687+0000","last_change":"2023-07-06T20:00:18.781850+0000","last_active":"2023-07-06T20:00:20.534687+0000","last_peered":"2023-07-06T20:00:20.534687+0000","last_clean":"2023-07-06T20:00:20.534687+0000","last_became_active":"2023-07-06T20:00:18.781269+0000","last_became_peered":"2023-07-06T20:00:18.781269+0000","last_unstale":"2023-07-06T20:00:20.534687+0000","last_undegraded":"2023-07-06T20:00:20.534687+0000","last_fullsized":"2023-07-06T20:00:20.534687+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:52:08.211186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.784428+0000","last_change":"2023-07-06T20:00:17.756010+0000","last_active":"2023-07-06T20:00:19.784428+0000","last_peered":"2023-07-06T20:00:19.784428+0000","last_clean":"2023-07-06T20:00:19.784428+0000","last_became_active":"2023-07-06T20:00:17.755721+0000","last_became_peered":"2023-07-06T20:00:17.755721+0000","last_unstale":"2023-07-06T20:00:19.784428+0000","last_undegraded":"2023-07-06T20:00:19.784428+0000","last_fullsized":"2023-07-06T20:00:19.784428+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:58:43.133995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.981800+0000","last_change":"2023-07-06T20:00:18.793328+0000","last_active":"2023-07-06T20:00:19.981800+0000","last_peered":"2023-07-06T20:00:19.981800+0000","last_clean":"2023-07-06T20:00:19.981800+0000","last_became_active":"2023-07-06T20:00:18.792953+0000","last_became_peered":"2023-07-06T20:00:18.792953+0000","last_unstale":"2023-07-06T20:00:19.981800+0000","last_undegraded":"2023-07-06T20:00:19.981800+0000","last_fullsized":"2023-07-06T20:00:19.981800+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:45:19.442346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.535326+0000","last_change":"2023-07-06T20:00:17.750835+0000","last_active":"2023-07-06T20:00:20.535326+0000","last_peered":"2023-07-06T20:00:20.535326+0000","last_clean":"2023-07-06T20:00:20.535326+0000","last_became_active":"2023-07-06T20:00:17.750359+0000","last_became_peered":"2023-07-06T20:00:17.750359+0000","last_unstale":"2023-07-06T20:00:20.535326+0000","last_undegraded":"2023-07-06T20:00:20.535326+0000","last_fullsized":"2023-07-06T20:00:20.535326+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:32:00.201485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.782630+0000","last_change":"2023-07-06T19:58:47.723855+0000","last_active":"2023-07-06T20:00:19.782630+0000","last_peered":"2023-07-06T20:00:19.782630+0000","last_clean":"2023-07-06T20:00:19.782630+0000","last_became_active":"2023-07-06T19:58:47.723553+0000","last_became_peered":"2023-07-06T19:58:47.723553+0000","last_unstale":"2023-07-06T20:00:19.782630+0000","last_undegraded":"2023-07-06T20:00:19.782630+0000","last_fullsized":"2023-07-06T20:00:19.782630+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:42:14.023567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.784659+0000","last_change":"2023-07-06T20:00:18.783503+0000","last_active":"2023-07-06T20:00:20.784659+0000","last_peered":"2023-07-06T20:00:20.784659+0000","last_clean":"2023-07-06T20:00:20.784659+0000","last_became_active":"2023-07-06T20:00:18.783206+0000","last_became_peered":"2023-07-06T20:00:18.783206+0000","last_unstale":"2023-07-06T20:00:20.784659+0000","last_undegraded":"2023-07-06T20:00:20.784659+0000","last_fullsized":"2023-07-06T20:00:20.784659+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:11:47.206321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"41'1","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.759064+0000","last_change":"2023-07-06T20:00:17.751341+0000","last_active":"2023-07-06T20:00:20.759064+0000","last_peered":"2023-07-06T20:00:20.759064+0000","last_clean":"2023-07-06T20:00:20.759064+0000","last_became_active":"2023-07-06T20:00:17.751050+0000","last_became_peered":"2023-07-06T20:00:17.751050+0000","last_unstale":"2023-07-06T20:00:20.759064+0000","last_undegraded":"2023-07-06T20:00:20.759064+0000","last_fullsized":"2023-07-06T20:00:20.759064+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:05:20.470749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":49,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.983128+0000","last_change":"2023-07-06T19:58:47.705294+0000","last_active":"2023-07-06T20:00:19.983128+0000","last_peered":"2023-07-06T20:00:19.983128+0000","last_clean":"2023-07-06T20:00:19.983128+0000","last_became_active":"2023-07-06T19:58:47.704921+0000","last_became_peered":"2023-07-06T19:58:47.704921+0000","last_unstale":"2023-07-06T20:00:19.983128+0000","last_undegraded":"2023-07-06T20:00:19.983128+0000","last_fullsized":"2023-07-06T20:00:19.983128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:55:35.832561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.535119+0000","last_change":"2023-07-06T20:00:18.790095+0000","last_active":"2023-07-06T20:00:20.535119+0000","last_peered":"2023-07-06T20:00:20.535119+0000","last_clean":"2023-07-06T20:00:20.535119+0000","last_became_active":"2023-07-06T20:00:18.786970+0000","last_became_peered":"2023-07-06T20:00:18.786970+0000","last_unstale":"2023-07-06T20:00:20.535119+0000","last_undegraded":"2023-07-06T20:00:20.535119+0000","last_fullsized":"2023-07-06T20:00:20.535119+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:20:04.833014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.785137+0000","last_change":"2023-07-06T20:00:17.758366+0000","last_active":"2023-07-06T20:00:19.785137+0000","last_peered":"2023-07-06T20:00:19.785137+0000","last_clean":"2023-07-06T20:00:19.785137+0000","last_became_active":"2023-07-06T20:00:17.757940+0000","last_became_peered":"2023-07-06T20:00:17.757940+0000","last_unstale":"2023-07-06T20:00:19.785137+0000","last_undegraded":"2023-07-06T20:00:19.785137+0000","last_fullsized":"2023-07-06T20:00:19.785137+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T01:31:55.316392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":49,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.778626+0000","last_change":"2023-07-06T19:58:47.766992+0000","last_active":"2023-07-06T20:00:19.778626+0000","last_peered":"2023-07-06T20:00:19.778626+0000","last_clean":"2023-07-06T20:00:19.778626+0000","last_became_active":"2023-07-06T19:58:47.766697+0000","last_became_peered":"2023-07-06T19:58:47.766697+0000","last_unstale":"2023-07-06T20:00:19.778626+0000","last_undegraded":"2023-07-06T20:00:19.778626+0000","last_fullsized":"2023-07-06T20:00:19.778626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:05:31.242589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.535457+0000","last_change":"2023-07-06T20:00:18.781690+0000","last_active":"2023-07-06T20:00:20.535457+0000","last_peered":"2023-07-06T20:00:20.535457+0000","last_clean":"2023-07-06T20:00:20.535457+0000","last_became_active":"2023-07-06T20:00:18.781335+0000","last_became_peered":"2023-07-06T20:00:18.781335+0000","last_unstale":"2023-07-06T20:00:20.535457+0000","last_undegraded":"2023-07-06T20:00:20.535457+0000","last_fullsized":"2023-07-06T20:00:20.535457+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:33:28.246384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.983414+0000","last_change":"2023-07-06T20:00:17.745505+0000","last_active":"2023-07-06T20:00:19.983414+0000","last_peered":"2023-07-06T20:00:19.983414+0000","last_clean":"2023-07-06T20:00:19.983414+0000","last_became_active":"2023-07-06T20:00:17.745185+0000","last_became_peered":"2023-07-06T20:00:17.745185+0000","last_unstale":"2023-07-06T20:00:19.983414+0000","last_undegraded":"2023-07-06T20:00:19.983414+0000","last_fullsized":"2023-07-06T20:00:19.983414+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:25:41.484812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":49,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.983368+0000","last_change":"2023-07-06T19:58:47.704498+0000","last_active":"2023-07-06T20:00:19.983368+0000","last_peered":"2023-07-06T20:00:19.983368+0000","last_clean":"2023-07-06T20:00:19.983368+0000","last_became_active":"2023-07-06T19:58:47.704172+0000","last_became_peered":"2023-07-06T19:58:47.704172+0000","last_unstale":"2023-07-06T20:00:19.983368+0000","last_undegraded":"2023-07-06T20:00:19.983368+0000","last_fullsized":"2023-07-06T20:00:19.983368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:58:22.247670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":207,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.785138+0000","last_change":"2023-07-06T19:58:40.972763+0000","last_active":"2023-07-06T20:00:19.785138+0000","last_peered":"2023-07-06T20:00:19.785138+0000","last_clean":"2023-07-06T20:00:19.785138+0000","last_became_active":"2023-07-06T19:58:40.971570+0000","last_became_peered":"2023-07-06T19:58:40.971570+0000","last_unstale":"2023-07-06T20:00:19.785138+0000","last_undegraded":"2023-07-06T20:00:19.785138+0000","last_fullsized":"2023-07-06T20:00:19.785138+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_clean_scrub_stamp":"2023-07-06T19:58:39.653546+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:14:47.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.784961+0000","last_change":"2023-07-06T20:00:18.800256+0000","last_active":"2023-07-06T20:00:19.784961+0000","last_peered":"2023-07-06T20:00:19.784961+0000","last_clean":"2023-07-06T20:00:19.784961+0000","last_became_active":"2023-07-06T20:00:18.799985+0000","last_became_peered":"2023-07-06T20:00:18.799985+0000","last_unstale":"2023-07-06T20:00:19.784961+0000","last_undegraded":"2023-07-06T20:00:19.784961+0000","last_fullsized":"2023-07-06T20:00:19.784961+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T23:57:06.872501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.782604+0000","last_change":"2023-07-06T20:00:17.755288+0000","last_active":"2023-07-06T20:00:19.782604+0000","last_peered":"2023-07-06T20:00:19.782604+0000","last_clean":"2023-07-06T20:00:19.782604+0000","last_became_active":"2023-07-06T20:00:17.754948+0000","last_became_peered":"2023-07-06T20:00:17.754948+0000","last_unstale":"2023-07-06T20:00:19.782604+0000","last_undegraded":"2023-07-06T20:00:19.782604+0000","last_fullsized":"2023-07-06T20:00:19.782604+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:26:51.571607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.784650+0000","last_change":"2023-07-06T19:58:47.708545+0000","last_active":"2023-07-06T20:00:19.784650+0000","last_peered":"2023-07-06T20:00:19.784650+0000","last_clean":"2023-07-06T20:00:19.784650+0000","last_became_active":"2023-07-06T19:58:47.708230+0000","last_became_peered":"2023-07-06T19:58:47.708230+0000","last_unstale":"2023-07-06T20:00:19.784650+0000","last_undegraded":"2023-07-06T20:00:19.784650+0000","last_fullsized":"2023-07-06T20:00:19.784650+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:22:08.568416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.982926+0000","last_change":"2023-07-06T20:00:18.784931+0000","last_active":"2023-07-06T20:00:19.982926+0000","last_peered":"2023-07-06T20:00:19.982926+0000","last_clean":"2023-07-06T20:00:19.982926+0000","last_became_active":"2023-07-06T20:00:18.784637+0000","last_became_peered":"2023-07-06T20:00:18.784637+0000","last_unstale":"2023-07-06T20:00:19.982926+0000","last_undegraded":"2023-07-06T20:00:19.982926+0000","last_fullsized":"2023-07-06T20:00:19.982926+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:26:41.282376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.782500+0000","last_change":"2023-07-06T20:00:17.757297+0000","last_active":"2023-07-06T20:00:19.782500+0000","last_peered":"2023-07-06T20:00:19.782500+0000","last_clean":"2023-07-06T20:00:19.782500+0000","last_became_active":"2023-07-06T20:00:17.756965+0000","last_became_peered":"2023-07-06T20:00:17.756965+0000","last_unstale":"2023-07-06T20:00:19.782500+0000","last_undegraded":"2023-07-06T20:00:19.782500+0000","last_fullsized":"2023-07-06T20:00:19.782500+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:19:35.805143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.785362+0000","last_change":"2023-07-06T19:58:47.723926+0000","last_active":"2023-07-06T20:00:19.785362+0000","last_peered":"2023-07-06T20:00:19.785362+0000","last_clean":"2023-07-06T20:00:19.785362+0000","last_became_active":"2023-07-06T19:58:47.723646+0000","last_became_peered":"2023-07-06T19:58:47.723646+0000","last_unstale":"2023-07-06T20:00:19.785362+0000","last_undegraded":"2023-07-06T20:00:19.785362+0000","last_fullsized":"2023-07-06T20:00:19.785362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T07:03:05.637321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.759056+0000","last_change":"2023-07-06T20:00:18.790636+0000","last_active":"2023-07-06T20:00:20.759056+0000","last_peered":"2023-07-06T20:00:20.759056+0000","last_clean":"2023-07-06T20:00:20.759056+0000","last_became_active":"2023-07-06T20:00:18.790339+0000","last_became_peered":"2023-07-06T20:00:18.790339+0000","last_unstale":"2023-07-06T20:00:20.759056+0000","last_undegraded":"2023-07-06T20:00:20.759056+0000","last_fullsized":"2023-07-06T20:00:20.759056+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:16:25.951721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.982086+0000","last_change":"2023-07-06T20:00:17.749291+0000","last_active":"2023-07-06T20:00:19.982086+0000","last_peered":"2023-07-06T20:00:19.982086+0000","last_clean":"2023-07-06T20:00:19.982086+0000","last_became_active":"2023-07-06T20:00:17.748503+0000","last_became_peered":"2023-07-06T20:00:17.748503+0000","last_unstale":"2023-07-06T20:00:19.982086+0000","last_undegraded":"2023-07-06T20:00:19.982086+0000","last_fullsized":"2023-07-06T20:00:19.982086+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:11:38.831815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.782787+0000","last_change":"2023-07-06T19:58:47.711918+0000","last_active":"2023-07-06T20:00:19.782787+0000","last_peered":"2023-07-06T20:00:19.782787+0000","last_clean":"2023-07-06T20:00:19.782787+0000","last_became_active":"2023-07-06T19:58:47.711591+0000","last_became_peered":"2023-07-06T19:58:47.711591+0000","last_unstale":"2023-07-06T20:00:19.782787+0000","last_undegraded":"2023-07-06T20:00:19.782787+0000","last_fullsized":"2023-07-06T20:00:19.782787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T06:23:04.627692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.758792+0000","last_change":"2023-07-06T20:00:18.784723+0000","last_active":"2023-07-06T20:00:20.758792+0000","last_peered":"2023-07-06T20:00:20.758792+0000","last_clean":"2023-07-06T20:00:20.758792+0000","last_became_active":"2023-07-06T20:00:18.784422+0000","last_became_peered":"2023-07-06T20:00:18.784422+0000","last_unstale":"2023-07-06T20:00:20.758792+0000","last_undegraded":"2023-07-06T20:00:20.758792+0000","last_fullsized":"2023-07-06T20:00:20.758792+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:17.727619+0000","last_clean_scrub_stamp":"2023-07-06T20:00:17.727619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T20:55:46.780454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:19.784896+0000","last_change":"2023-07-06T20:00:17.757513+0000","last_active":"2023-07-06T20:00:19.784896+0000","last_peered":"2023-07-06T20:00:19.784896+0000","last_clean":"2023-07-06T20:00:19.784896+0000","last_became_active":"2023-07-06T20:00:17.757216+0000","last_became_peered":"2023-07-06T20:00:17.757216+0000","last_unstale":"2023-07-06T20:00:19.784896+0000","last_undegraded":"2023-07-06T20:00:19.784896+0000","last_fullsized":"2023-07-06T20:00:19.784896+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T20:00:16.725944+0000","last_clean_scrub_stamp":"2023-07-06T20:00:16.725944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:33:27.244709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-07-06T20:00:20.785110+0000","last_change":"2023-07-06T19:58:47.712143+0000","last_active":"2023-07-06T20:00:20.785110+0000","last_peered":"2023-07-06T20:00:20.785110+0000","last_clean":"2023-07-06T20:00:20.785110+0000","last_became_active":"2023-07-06T19:58:47.711788+0000","last_became_peered":"2023-07-06T19:58:47.711788+0000","last_unstale":"2023-07-06T20:00:20.785110+0000","last_undegraded":"2023-07-06T20:00:20.785110+0000","last_fullsized":"2023-07-06T20:00:20.785110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T21:13:10.584671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1073152,"data_stored":803238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.748}]},{"osd":5,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.71499999999999997}]},{"osd":6,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.79300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":483328,"data_stored":213452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":3.129,"5min":3.129,"15min":3.129},"last":0.39800000000000002}]},{"osd":3,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.745},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.68400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":479232,"data_stored":212850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":7.157,"5min":7.157,"15min":7.157},"last":0.308}]},{"osd":2,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.375},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.28899999999999998}]},{"osd":3,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.39700000000000002}]},{"osd":4,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.53900000000000003}]},{"osd":5,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.754},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jul 6 19:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.55300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":1073152,"data_stored":803182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"last":0.308}]},{"osd":2,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.373}]},{"osd":4,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.0680000000000001,"5min":3.0680000000000001,"15min":3.0680000000000001},"last":0.71599999999999997}]},{"osd":6,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":3.2029999999999998,"5min":3.2029999999999998,"15min":3.2029999999999998},"last":0.626},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.72899999999999998}]},{"osd":7,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.74299999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":491520,"data_stored":214366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.34100000000000003}]},{"osd":1,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.40999999999999998}]},{"osd":4,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.42699999999999999}]},{"osd":5,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.38},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.439}]},{"osd":6,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Jul 6 19:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.50800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":487424,"data_stored":213418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":3.5089999999999999,"5min":3.5089999999999999,"15min":3.5089999999999999},"last":0.378},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.436}]},{"osd":1,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"last":0.497}]},{"osd":4,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.40000000000000002}]},{"osd":5,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.645,"5min":1.645,"15min":1.645},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.93400000000000005}]},{"osd":6,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.5830000000000002,"5min":2.5830000000000002,"15min":2.5830000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jul 6 19:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.875},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.66500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":487424,"data_stored":214344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.443},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.41299999999999998}]},{"osd":5,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.63}]},{"osd":7,"last update":"Thu Jul 6 19:59:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.78100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":479232,"data_stored":212850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.71999999999999997}]},{"osd":2,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":3.5870000000000002,"5min":3.5870000000000002,"15min":3.5870000000000002},"last":0.749},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.70099999999999996}]},{"osd":3,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.6389999999999998,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":8.2859999999999996,"5min":8.2859999999999996,"15min":8.2859999999999996},"last":0.77300000000000002}]},{"osd":4,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.40400000000000003}]},{"osd":6,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.432}]},{"osd":7,"last update":"Thu Jul 6 19:59:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.54800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-06T20:00:27.983 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-06T20:00:27.984 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-06T20:00:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.145+0000 7fd6886e7700 1 Processor -- start 2023-07-06T20:00:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.145+0000 7fd6886e7700 1 -- start start 2023-07-06T20:00:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.146+0000 7fd6886e7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6800cefe0 0x7fd6800cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.146+0000 7fd6886e7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6800cb210 0x7fd68015cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:28.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.146+0000 7fd6886e7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6800c9d70 con 0x7fd6800cd630 2023-07-06T20:00:28.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.146+0000 7fd6886e7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6800c9810 con 0x7fd6800cb210 2023-07-06T20:00:28.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.146+0000 7fd6886e7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68006bdf0 con 0x7fd6800cefe0 2023-07-06T20:00:28.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.146+0000 7fd686c84700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6800cb210 0x7fd68015cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.146+0000 7fd686c84700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd6800cb210 0x7fd68015cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32964/0 (socket says 172.21.15.6:32964) 2023-07-06T20:00:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.146+0000 7fd686c84700 1 -- 172.21.15.6:0/3857023042 learned_addr learned my addr 172.21.15.6:0/3857023042 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:28.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.146+0000 7fd686483700 1 --2- 172.21.15.6:0/3857023042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6800cefe0 0x7fd6800cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:28.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.146+0000 7fd686c84700 1 -- 172.21.15.6:0/3857023042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6800cefe0 msgr2=0x7fd6800cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:28.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.146+0000 7fd686c84700 1 --2- 172.21.15.6:0/3857023042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6800cefe0 0x7fd6800cf3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:28.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.146+0000 7fd686c84700 1 -- 172.21.15.6:0/3857023042 >> v1:172.21.15.40:6789/0 conn(0x7fd6800cd630 legacy=0x7fd68015c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:28.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.146+0000 7fd686c84700 1 -- 172.21.15.6:0/3857023042 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68006b830 con 0x7fd6800cb210 2023-07-06T20:00:28.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.146+0000 7fd686483700 1 --2- 172.21.15.6:0/3857023042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6800cefe0 0x7fd6800cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T20:00:28.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.147+0000 7fd686c84700 1 --2- 172.21.15.6:0/3857023042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6800cb210 0x7fd68015cbe0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd678009e50 tx=0x7fd67800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0412a15ab62e2e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:28.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.147+0000 7fd685481700 1 -- 172.21.15.6:0/3857023042 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67800e070 con 0x7fd6800cb210 2023-07-06T20:00:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.147+0000 7fd685481700 1 -- 172.21.15.6:0/3857023042 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd678003a20 con 0x7fd6800cb210 2023-07-06T20:00:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.147+0000 7fd685481700 1 -- 172.21.15.6:0/3857023042 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678003dd0 con 0x7fd6800cb210 2023-07-06T20:00:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.147+0000 7fd6886e7700 1 -- 172.21.15.6:0/3857023042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6800cb210 msgr2=0x7fd68015cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.147+0000 7fd6886e7700 1 --2- 172.21.15.6:0/3857023042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6800cb210 0x7fd68015cbe0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd678009e50 tx=0x7fd67800b330 comp rx=0 tx=0).stop 2023-07-06T20:00:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.147+0000 7fd6886e7700 1 -- 172.21.15.6:0/3857023042 shutdown_connections 2023-07-06T20:00:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.147+0000 7fd6886e7700 1 --2- 172.21.15.6:0/3857023042 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6800cefe0 0x7fd6800cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.147+0000 7fd6886e7700 1 --2- 172.21.15.6:0/3857023042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6800cb210 0x7fd68015cbe0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:28.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.147+0000 7fd6886e7700 1 -- 172.21.15.6:0/3857023042 >> 172.21.15.6:0/3857023042 conn(0x7fd6800b0b60 msgr2=0x7fd6800b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:28.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.147+0000 7fd6886e7700 1 -- 172.21.15.6:0/3857023042 shutdown_connections 2023-07-06T20:00:28.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.147+0000 7fd6886e7700 1 -- 172.21.15.6:0/3857023042 wait complete. 2023-07-06T20:00:28.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.149+0000 7fd6886e7700 1 Processor -- start 2023-07-06T20:00:28.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.149+0000 7fd6886e7700 1 -- start start 2023-07-06T20:00:28.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.149+0000 7fd6886e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6800cb210 0x7fd6800c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:28.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.149+0000 7fd6886e7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6800cd630 0x7fd6800b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:28.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.149+0000 7fd6886e7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6800cefe0 0x7fd6800b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:28.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.149+0000 7fd6886e7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6801f40d0 con 0x7fd6800cb210 2023-07-06T20:00:28.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.149+0000 7fd6886e7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6801f3520 con 0x7fd6800cd630 2023-07-06T20:00:28.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.149+0000 7fd6886e7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6801f3730 con 0x7fd6800cefe0 2023-07-06T20:00:28.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.149+0000 7fd686483700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6800cb210 0x7fd6800c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:28.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.149+0000 7fd686483700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6800cb210 0x7fd6800c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32966/0 (socket says 172.21.15.6:32966) 2023-07-06T20:00:28.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.149+0000 7fd686483700 1 -- 172.21.15.6:0/2833034739 learned_addr learned my addr 172.21.15.6:0/2833034739 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:28.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.150+0000 7fd686c84700 1 --2- 172.21.15.6:0/2833034739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6800cefe0 0x7fd6800b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:28.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.150+0000 7fd685c82700 1 --2- 172.21.15.6:0/2833034739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6800cd630 0x7fd6800b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:28.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.150+0000 7fd686483700 1 -- 172.21.15.6:0/2833034739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6800cefe0 msgr2=0x7fd6800b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:28.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.150+0000 7fd686483700 1 --2- 172.21.15.6:0/2833034739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6800cefe0 0x7fd6800b45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:28.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.150+0000 7fd686483700 1 -- 172.21.15.6:0/2833034739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6800cd630 msgr2=0x7fd6800b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:28.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.150+0000 7fd686483700 1 --2- 172.21.15.6:0/2833034739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6800cd630 0x7fd6800b4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.150+0000 7fd686483700 1 -- 172.21.15.6:0/2833034739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd678009b30 con 0x7fd6800cb210 2023-07-06T20:00:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.150+0000 7fd686483700 1 --2- 172.21.15.6:0/2833034739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6800cb210 0x7fd6800c8d10 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd67000c750 tx=0x7fd67000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.150+0000 7fd676ffd700 1 -- 172.21.15.6:0/2833034739 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670011800 con 0x7fd6800cb210 2023-07-06T20:00:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.150+0000 7fd676ffd700 1 -- 172.21.15.6:0/2833034739 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd670011960 con 0x7fd6800cb210 2023-07-06T20:00:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.150+0000 7fd6886e7700 1 -- 172.21.15.6:0/2833034739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6801f3a10 con 0x7fd6800cb210 2023-07-06T20:00:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.150+0000 7fd676ffd700 1 -- 172.21.15.6:0/2833034739 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670011cd0 con 0x7fd6800cb210 2023-07-06T20:00:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.150+0000 7fd6886e7700 1 -- 172.21.15.6:0/2833034739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6800c9250 con 0x7fd6800cb210 2023-07-06T20:00:28.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.151+0000 7fd6886e7700 1 -- 172.21.15.6:0/2833034739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68004eb90 con 0x7fd6800cb210 2023-07-06T20:00:28.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.152+0000 7fd676ffd700 1 -- 172.21.15.6:0/2833034739 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd670021350 con 0x7fd6800cb210 2023-07-06T20:00:28.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.152+0000 7fd676ffd700 1 --2- 172.21.15.6:0/2833034739 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd66406ace0 0x7fd66406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:28.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.152+0000 7fd676ffd700 1 -- 172.21.15.6:0/2833034739 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fd670089510 con 0x7fd6800cb210 2023-07-06T20:00:28.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.152+0000 7fd685c82700 1 --2- 172.21.15.6:0/2833034739 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd66406ace0 0x7fd66406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:28.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.153+0000 7fd685c82700 1 --2- 172.21.15.6:0/2833034739 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd66406ace0 0x7fd66406d190 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd6800b4d70 tx=0x7fd67c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:28.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.156+0000 7fd676ffd700 1 -- 172.21.15.6:0/2833034739 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd670057fa0 con 0x7fd6800cb210 2023-07-06T20:00:28.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.433+0000 7fd6886e7700 1 -- 172.21.15.6:0/2833034739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd680071da0 con 0x7fd6800cb210 2023-07-06T20:00:28.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.437+0000 7fd676ffd700 1 -- 172.21.15.6:0/2833034739 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7fd670057b30 con 0x7fd6800cb210 2023-07-06T20:00:28.440 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-07-06T20:00:28.440 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQDBHKdk4UdrARAA1/eBBdDGSoFnlxWcwFTAdQ== 2023-07-06T20:00:28.440 INFO:teuthology.orchestra.run.smithi006.stdout: caps mds = "allow" 2023-07-06T20:00:28.440 INFO:teuthology.orchestra.run.smithi006.stdout: caps mon = "allow r" 2023-07-06T20:00:28.441 INFO:teuthology.orchestra.run.smithi006.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-06T20:00:28.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.439+0000 7fd6886e7700 1 -- 172.21.15.6:0/2833034739 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd66406ace0 msgr2=0x7fd66406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:28.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.439+0000 7fd6886e7700 1 --2- 172.21.15.6:0/2833034739 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd66406ace0 0x7fd66406d190 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd6800b4d70 tx=0x7fd67c009040 comp rx=0 tx=0).stop 2023-07-06T20:00:28.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.439+0000 7fd6886e7700 1 -- 172.21.15.6:0/2833034739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6800cb210 msgr2=0x7fd6800c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:28.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.439+0000 7fd6886e7700 1 --2- 172.21.15.6:0/2833034739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6800cb210 0x7fd6800c8d10 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd67000c750 tx=0x7fd67000cb10 comp rx=0 tx=0).stop 2023-07-06T20:00:28.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.439+0000 7fd6886e7700 1 -- 172.21.15.6:0/2833034739 shutdown_connections 2023-07-06T20:00:28.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.439+0000 7fd6886e7700 1 --2- 172.21.15.6:0/2833034739 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd66406ace0 0x7fd66406d190 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:28.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.439+0000 7fd6886e7700 1 --2- 172.21.15.6:0/2833034739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6800cb210 0x7fd6800c8d10 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:28.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.439+0000 7fd6886e7700 1 --2- 172.21.15.6:0/2833034739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd6800cefe0 0x7fd6800b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:28.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.439+0000 7fd6886e7700 1 --2- 172.21.15.6:0/2833034739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6800cd630 0x7fd6800b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:28.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.439+0000 7fd6886e7700 1 -- 172.21.15.6:0/2833034739 >> 172.21.15.6:0/2833034739 conn(0x7fd6800b0b60 msgr2=0x7fd6800caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:28.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.439+0000 7fd6886e7700 1 -- 172.21.15.6:0/2833034739 shutdown_connections 2023-07-06T20:00:28.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.439+0000 7fd6886e7700 1 -- 172.21.15.6:0/2833034739 wait complete. 2023-07-06T20:00:28.443 INFO:teuthology.orchestra.run.smithi006.stderr:updated caps for client.0 2023-07-06T20:00:28.459 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-06T20:00:28.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.584+0000 7f3de8ad9700 1 Processor -- start 2023-07-06T20:00:28.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.584+0000 7f3de8ad9700 1 -- start start 2023-07-06T20:00:28.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.585+0000 7f3de8ad9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3de40ceab0 0x7f3de40caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:28.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.585+0000 7f3de8ad9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3de4071dd0 0x7f3de41602c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:28.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.585+0000 7f3de8ad9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de4160ff0 con 0x7f3de40cee80 2023-07-06T20:00:28.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.585+0000 7f3de8ad9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de40cb400 con 0x7f3de40ceab0 2023-07-06T20:00:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.585+0000 7f3de8ad9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40ca100 con 0x7f3de4071dd0 2023-07-06T20:00:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.585+0000 7f3de259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3de40ceab0 0x7f3de40caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.585+0000 7f3de259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3de40ceab0 0x7f3de40caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32974/0 (socket says 172.21.15.6:32974) 2023-07-06T20:00:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.585+0000 7f3de259c700 1 -- 172.21.15.6:0/2929729182 learned_addr learned my addr 172.21.15.6:0/2929729182 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.585+0000 7f3de2d9d700 1 --2- 172.21.15.6:0/2929729182 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3de4071dd0 0x7f3de41602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.585+0000 7f3de259c700 1 -- 172.21.15.6:0/2929729182 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3de4071dd0 msgr2=0x7f3de41602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:28.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.585+0000 7f3de259c700 1 --2- 172.21.15.6:0/2929729182 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3de4071dd0 0x7f3de41602c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:28.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.585+0000 7f3de259c700 1 -- 172.21.15.6:0/2929729182 >> v1:172.21.15.40:6789/0 conn(0x7f3de40cee80 legacy=0x7f3de40716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:28.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.585+0000 7f3de259c700 1 -- 172.21.15.6:0/2929729182 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de40ca3e0 con 0x7f3de40ceab0 2023-07-06T20:00:28.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.586+0000 7f3de259c700 1 --2- 172.21.15.6:0/2929729182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de40ceab0 0x7f3de40caec0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80098f0 tx=0x7f3dd8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1363ebb93c8265aa server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:28.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.586+0000 7f3de159a700 1 -- 172.21.15.6:0/2929729182 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8004230 con 0x7f3de40ceab0 2023-07-06T20:00:28.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.586+0000 7f3de159a700 1 -- 172.21.15.6:0/2929729182 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd8004390 con 0x7f3de40ceab0 2023-07-06T20:00:28.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.586+0000 7f3de159a700 1 -- 172.21.15.6:0/2929729182 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd80036a0 con 0x7f3de40ceab0 2023-07-06T20:00:28.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.586+0000 7f3de8ad9700 1 -- 172.21.15.6:0/2929729182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de40ceab0 msgr2=0x7f3de40caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:28.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.586+0000 7f3de8ad9700 1 --2- 172.21.15.6:0/2929729182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de40ceab0 0x7f3de40caec0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3dd80098f0 tx=0x7f3dd8009c00 comp rx=0 tx=0).stop 2023-07-06T20:00:28.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.586+0000 7f3de8ad9700 1 -- 172.21.15.6:0/2929729182 shutdown_connections 2023-07-06T20:00:28.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.586+0000 7f3de8ad9700 1 --2- 172.21.15.6:0/2929729182 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3de4071dd0 0x7f3de41602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:28.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.586+0000 7f3de8ad9700 1 --2- 172.21.15.6:0/2929729182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de40ceab0 0x7f3de40caec0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:28.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.586+0000 7f3de8ad9700 1 -- 172.21.15.6:0/2929729182 >> 172.21.15.6:0/2929729182 conn(0x7f3de40cc420 msgr2=0x7f3de40cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:28.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.587+0000 7f3de8ad9700 1 -- 172.21.15.6:0/2929729182 shutdown_connections 2023-07-06T20:00:28.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.587+0000 7f3de8ad9700 1 -- 172.21.15.6:0/2929729182 wait complete. 2023-07-06T20:00:28.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.588+0000 7f3de8ad9700 1 Processor -- start 2023-07-06T20:00:28.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.588+0000 7f3de8ad9700 1 -- start start 2023-07-06T20:00:28.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.589+0000 7f3de8ad9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3de4071dd0 0x7f3de415aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:28.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.589+0000 7f3de8ad9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de40ceab0 0x7f3de415b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:28.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.589+0000 7f3de8ad9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3de40cee80 0x7f3de41f53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:28.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.589+0000 7f3de8ad9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de41573f0 con 0x7f3de40ceab0 2023-07-06T20:00:28.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.589+0000 7f3de8ad9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de415ba10 con 0x7f3de40cee80 2023-07-06T20:00:28.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.589+0000 7f3de8ad9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de415bcf0 con 0x7f3de4071dd0 2023-07-06T20:00:28.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.589+0000 7f3de1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de40ceab0 0x7f3de415b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:28.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.589+0000 7f3de1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de40ceab0 0x7f3de415b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32982/0 (socket says 172.21.15.6:32982) 2023-07-06T20:00:28.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.589+0000 7f3de1d9b700 1 -- 172.21.15.6:0/2668216604 learned_addr learned my addr 172.21.15.6:0/2668216604 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:28.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.589+0000 7f3de259c700 1 --2- 172.21.15.6:0/2668216604 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3de4071dd0 0x7f3de415aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:28.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.589+0000 7f3de2d9d700 1 --2- 172.21.15.6:0/2668216604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3de40cee80 0x7f3de41f53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:28.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.589+0000 7f3de1d9b700 1 -- 172.21.15.6:0/2668216604 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3de4071dd0 msgr2=0x7f3de415aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:28.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.589+0000 7f3de1d9b700 1 --2- 172.21.15.6:0/2668216604 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3de4071dd0 0x7f3de415aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:28.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.589+0000 7f3de1d9b700 1 -- 172.21.15.6:0/2668216604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3de40cee80 msgr2=0x7f3de41f53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:28.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.589+0000 7f3de1d9b700 1 --2- 172.21.15.6:0/2668216604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3de40cee80 0x7f3de41f53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:28.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.589+0000 7f3de1d9b700 1 -- 172.21.15.6:0/2668216604 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd8009550 con 0x7f3de40ceab0 2023-07-06T20:00:28.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.589+0000 7f3de1d9b700 1 --2- 172.21.15.6:0/2668216604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de40ceab0 0x7f3de415b3e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3dd400c4d0 tx=0x7f3dd400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:28.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.590+0000 7f3dd2ffd700 1 -- 172.21.15.6:0/2668216604 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4011790 con 0x7f3de40ceab0 2023-07-06T20:00:28.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.590+0000 7f3dd2ffd700 1 -- 172.21.15.6:0/2668216604 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd40118f0 con 0x7f3de40ceab0 2023-07-06T20:00:28.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.590+0000 7f3dd2ffd700 1 -- 172.21.15.6:0/2668216604 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4011ca0 con 0x7f3de40ceab0 2023-07-06T20:00:28.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.590+0000 7f3de8ad9700 1 -- 172.21.15.6:0/2668216604 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de415bfd0 con 0x7f3de40ceab0 2023-07-06T20:00:28.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.590+0000 7f3de8ad9700 1 -- 172.21.15.6:0/2668216604 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de414eb90 con 0x7f3de40ceab0 2023-07-06T20:00:28.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.591+0000 7f3de8ad9700 1 -- 172.21.15.6:0/2668216604 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de4153b80 con 0x7f3de40ceab0 2023-07-06T20:00:28.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.591+0000 7f3dd2ffd700 1 -- 172.21.15.6:0/2668216604 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3dd401c460 con 0x7f3de40ceab0 2023-07-06T20:00:28.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.591+0000 7f3dd2ffd700 1 --2- 172.21.15.6:0/2668216604 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3dc406ace0 0x7f3dc406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:28.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.592+0000 7f3dd2ffd700 1 -- 172.21.15.6:0/2668216604 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3dd40892f0 con 0x7f3de40ceab0 2023-07-06T20:00:28.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.592+0000 7f3de259c700 1 --2- 172.21.15.6:0/2668216604 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3dc406ace0 0x7f3dc406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:28.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.592+0000 7f3de259c700 1 --2- 172.21.15.6:0/2668216604 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3dc406ace0 0x7f3dc406d190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8009130 tx=0x7f3dd8008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:28.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.596+0000 7f3dd2ffd700 1 -- 172.21.15.6:0/2668216604 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3de4153b80 con 0x7f3de40ceab0 2023-07-06T20:00:28.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.843+0000 7f3de8ad9700 1 -- 172.21.15.6:0/2668216604 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3de4153f60 con 0x7f3de40ceab0 2023-07-06T20:00:28.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.843+0000 7f3dd2ffd700 1 -- 172.21.15.6:0/2668216604 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4662 (secure 0 0 0) 0x7f3de4153f60 con 0x7f3de40ceab0 2023-07-06T20:00:28.846 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:28.846 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/554562026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":554562026},{"type":"v1","addr":"172.21.15.40:6834","nonce":554562026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5379,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1231939681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1231939681},{"type":"v1","addr":"172.21.15.6:6835","nonce":1231939681}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5382,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2836488850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":2836488850},{"type":"v1","addr":"172.21.15.6:6837","nonce":2836488850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T20:00:18.163079+0000","modified":"2023-07-06T20:00:21.782010+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5397},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5397":{"gid":5397,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.40:6835/2106779005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":2106779005},{"type":"v1","addr":"172.21.15.40:6835","nonce":2106779005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-06T20:00:28.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.845+0000 7f3de8ad9700 1 -- 172.21.15.6:0/2668216604 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3dc406ace0 msgr2=0x7f3dc406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:28.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.845+0000 7f3de8ad9700 1 --2- 172.21.15.6:0/2668216604 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3dc406ace0 0x7f3dc406d190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8009130 tx=0x7f3dd8008030 comp rx=0 tx=0).stop 2023-07-06T20:00:28.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.845+0000 7f3de8ad9700 1 -- 172.21.15.6:0/2668216604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de40ceab0 msgr2=0x7f3de415b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:28.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.845+0000 7f3de8ad9700 1 --2- 172.21.15.6:0/2668216604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de40ceab0 0x7f3de415b3e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3dd400c4d0 tx=0x7f3dd400c7e0 comp rx=0 tx=0).stop 2023-07-06T20:00:28.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.845+0000 7f3de8ad9700 1 -- 172.21.15.6:0/2668216604 shutdown_connections 2023-07-06T20:00:28.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.845+0000 7f3de8ad9700 1 --2- 172.21.15.6:0/2668216604 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3dc406ace0 0x7f3dc406d190 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:28.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.845+0000 7f3de8ad9700 1 --2- 172.21.15.6:0/2668216604 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3de40cee80 0x7f3de41f53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:28.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.845+0000 7f3de8ad9700 1 --2- 172.21.15.6:0/2668216604 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3de4071dd0 0x7f3de415aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.845+0000 7f3de8ad9700 1 --2- 172.21.15.6:0/2668216604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3de40ceab0 0x7f3de415b3e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.845+0000 7f3de8ad9700 1 -- 172.21.15.6:0/2668216604 >> 172.21.15.6:0/2668216604 conn(0x7f3de40cc420 msgr2=0x7f3de415fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.846+0000 7f3de8ad9700 1 -- 172.21.15.6:0/2668216604 shutdown_connections 2023-07-06T20:00:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:28.846+0000 7f3de8ad9700 1 -- 172.21.15.6:0/2668216604 wait complete. 2023-07-06T20:00:28.849 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 18 2023-07-06T20:00:29.264 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-06T20:00:18.163079+0000', 'modified': '2023-07-06T20:00:21.782010+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5397}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5397': {'gid': 5397, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.40:6835/2106779005', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.40:6833', 'nonce': 2106779005}, {'type': 'v1', 'addr': '172.21.15.40:6835', 'nonce': 2106779005}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-06T20:00:29.264 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-06T20:00:29.265 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-06T20:00:29.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.397+0000 7f822eacb700 1 Processor -- start 2023-07-06T20:00:29.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.397+0000 7f822eacb700 1 -- start start 2023-07-06T20:00:29.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.398+0000 7f822eacb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8228071da0 0x7f82280cb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.398+0000 7f822eacb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f822815cd40 0x7f82280cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.398+0000 7f822eacb700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f822815d2b0 con 0x7f82281592b0 2023-07-06T20:00:29.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.398+0000 7f822eacb700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8228159680 con 0x7f8228071da0 2023-07-06T20:00:29.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.398+0000 7f822eacb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f822815d590 con 0x7f822815cd40 2023-07-06T20:00:29.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.398+0000 7f8227fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8228071da0 0x7f82280cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.398+0000 7f8227fff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f8228071da0 0x7f82280cb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32990/0 (socket says 172.21.15.6:32990) 2023-07-06T20:00:29.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.398+0000 7f8227fff700 1 -- 172.21.15.6:0/2436551050 learned_addr learned my addr 172.21.15.6:0/2436551050 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:29.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.399+0000 7f822d068700 1 --2- 172.21.15.6:0/2436551050 >> v2:172.21.15.40:3300/0 conn(0x7f822815cd40 0x7f82280cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.399+0000 7f8227fff700 1 -- 172.21.15.6:0/2436551050 >> v2:172.21.15.40:3300/0 conn(0x7f822815cd40 msgr2=0x7f82280cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:29.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.399+0000 7f8227fff700 1 --2- 172.21.15.6:0/2436551050 >> v2:172.21.15.40:3300/0 conn(0x7f822815cd40 0x7f82280cb690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.399+0000 7f8227fff700 1 -- 172.21.15.6:0/2436551050 >> v1:172.21.15.40:6789/0 conn(0x7f82281592b0 legacy=0x7f8228071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:29.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.399+0000 7f8227fff700 1 -- 172.21.15.6:0/2436551050 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822815d870 con 0x7f8228071da0 2023-07-06T20:00:29.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.399+0000 7f8227fff700 1 --2- 172.21.15.6:0/2436551050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8228071da0 0x7f82280cb150 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f822815de30 tx=0x7f8214009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ca23a28eaa87bef server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:29.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.399+0000 7f82277fe700 1 -- 172.21.15.6:0/2436551050 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8214004230 con 0x7f8228071da0 2023-07-06T20:00:29.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.399+0000 7f82277fe700 1 -- 172.21.15.6:0/2436551050 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8214004390 con 0x7f8228071da0 2023-07-06T20:00:29.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.399+0000 7f82277fe700 1 -- 172.21.15.6:0/2436551050 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82140036a0 con 0x7f8228071da0 2023-07-06T20:00:29.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.399+0000 7f822eacb700 1 -- 172.21.15.6:0/2436551050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8228071da0 msgr2=0x7f82280cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:29.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.399+0000 7f822eacb700 1 --2- 172.21.15.6:0/2436551050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8228071da0 0x7f82280cb150 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f822815de30 tx=0x7f8214009bd0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.399+0000 7f822eacb700 1 -- 172.21.15.6:0/2436551050 shutdown_connections 2023-07-06T20:00:29.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.399+0000 7f822eacb700 1 --2- 172.21.15.6:0/2436551050 >> v2:172.21.15.40:3300/0 conn(0x7f822815cd40 0x7f82280cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.399+0000 7f822eacb700 1 --2- 172.21.15.6:0/2436551050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8228071da0 0x7f82280cb150 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.399+0000 7f822eacb700 1 -- 172.21.15.6:0/2436551050 >> 172.21.15.6:0/2436551050 conn(0x7f82280cf960 msgr2=0x7f82280cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:29.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.400+0000 7f822eacb700 1 -- 172.21.15.6:0/2436551050 shutdown_connections 2023-07-06T20:00:29.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.400+0000 7f822eacb700 1 -- 172.21.15.6:0/2436551050 wait complete. 2023-07-06T20:00:29.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.401+0000 7f822eacb700 1 Processor -- start 2023-07-06T20:00:29.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.401+0000 7f822eacb700 1 -- start start 2023-07-06T20:00:29.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.402+0000 7f822eacb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8228071da0 0x7f82280c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.402+0000 7f822eacb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82281592b0 0x7f82280c4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.402+0000 7f822eacb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f822815cd40 0x7f82280c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.402+0000 7f822eacb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82280c4050 con 0x7f822815cd40 2023-07-06T20:00:29.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.402+0000 7f822eacb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82281efb70 con 0x7f82281592b0 2023-07-06T20:00:29.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.402+0000 7f822eacb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82281efe10 con 0x7f8228071da0 2023-07-06T20:00:29.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.402+0000 7f822d068700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f822815cd40 0x7f82280c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.402+0000 7f822d068700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f822815cd40 0x7f82280c4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32998/0 (socket says 172.21.15.6:32998) 2023-07-06T20:00:29.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.402+0000 7f822d068700 1 -- 172.21.15.6:0/3963861146 learned_addr learned my addr 172.21.15.6:0/3963861146 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:29.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.402+0000 7f822c867700 1 --2- 172.21.15.6:0/3963861146 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8228071da0 0x7f82280c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.402+0000 7f8227fff700 1 --2- 172.21.15.6:0/3963861146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82281592b0 0x7f82280c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.402+0000 7f822d068700 1 -- 172.21.15.6:0/3963861146 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8228071da0 msgr2=0x7f82280c3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.402+0000 7f822d068700 1 --2- 172.21.15.6:0/3963861146 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8228071da0 0x7f82280c3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.402+0000 7f822d068700 1 -- 172.21.15.6:0/3963861146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82281592b0 msgr2=0x7f82280c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.402+0000 7f822d068700 1 --2- 172.21.15.6:0/3963861146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82281592b0 0x7f82280c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.402+0000 7f822d068700 1 -- 172.21.15.6:0/3963861146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8214009550 con 0x7f822815cd40 2023-07-06T20:00:29.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.402+0000 7f822c867700 1 --2- 172.21.15.6:0/3963861146 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8228071da0 0x7f82280c3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:29.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.402+0000 7f8227fff700 1 --2- 172.21.15.6:0/3963861146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82281592b0 0x7f82280c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:29.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.402+0000 7f822d068700 1 --2- 172.21.15.6:0/3963861146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f822815cd40 0x7f82280c4750 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f822000cd70 tx=0x7f822000a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:29.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.402+0000 7f82257fa700 1 -- 172.21.15.6:0/3963861146 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8220003a20 con 0x7f822815cd40 2023-07-06T20:00:29.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.403+0000 7f82257fa700 1 -- 172.21.15.6:0/3963861146 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8220003b80 con 0x7f822815cd40 2023-07-06T20:00:29.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.403+0000 7f822eacb700 1 -- 172.21.15.6:0/3963861146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82281f00f0 con 0x7f822815cd40 2023-07-06T20:00:29.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.403+0000 7f82257fa700 1 -- 172.21.15.6:0/3963861146 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8220004020 con 0x7f822815cd40 2023-07-06T20:00:29.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.403+0000 7f822eacb700 1 -- 172.21.15.6:0/3963861146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82280b3e90 con 0x7f822815cd40 2023-07-06T20:00:29.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.404+0000 7f82257fa700 1 -- 172.21.15.6:0/3963861146 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8220004180 con 0x7f822815cd40 2023-07-06T20:00:29.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.404+0000 7f82257fa700 1 --2- 172.21.15.6:0/3963861146 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f820c06ace0 0x7f820c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.404+0000 7f82257fa700 1 -- 172.21.15.6:0/3963861146 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8220012070 con 0x7f822815cd40 2023-07-06T20:00:29.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.404+0000 7f822c867700 1 --2- 172.21.15.6:0/3963861146 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f820c06ace0 0x7f820c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.405+0000 7f822c867700 1 --2- 172.21.15.6:0/3963861146 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f820c06ace0 0x7f820c06d190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f821c009910 tx=0x7f821c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:29.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.406+0000 7f823ac50b80 1 Processor -- start 2023-07-06T20:00:29.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.406+0000 7f823ac50b80 1 -- start start 2023-07-06T20:00:29.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.407+0000 7f823ac50b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55ebccef85a0 0x55ebccef8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.407+0000 7f823ac50b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccf17670 0x55ebcced0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.407+0000 7f823ac50b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55ebccf17ae0 0x55ebcced14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.407+0000 7f823ac50b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebccdd5c60 con 0x55ebccf17670 2023-07-06T20:00:29.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.407+0000 7f823ac50b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebcce289f0 con 0x55ebccf17ae0 2023-07-06T20:00:29.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.407+0000 7f823ac50b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ebcce21e80 con 0x55ebccef85a0 2023-07-06T20:00:29.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.407+0000 7f8227fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccf17670 0x55ebcced0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.407+0000 7f8227fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccf17670 0x55ebcced0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33004/0 (socket says 172.21.15.6:33004) 2023-07-06T20:00:29.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.407+0000 7f8227fff700 1 -- 172.21.15.6:0/3409323150 learned_addr learned my addr 172.21.15.6:0/3409323150 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:29.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.408+0000 7f822c867700 1 --2- 172.21.15.6:0/3409323150 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55ebccef85a0 0x55ebccef8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.408+0000 7f8227fff700 1 -- 172.21.15.6:0/3409323150 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55ebccef85a0 msgr2=0x55ebccef8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:29.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.408+0000 7f822d068700 1 --2- 172.21.15.6:0/3409323150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55ebccf17ae0 0x55ebcced14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.408+0000 7f8227fff700 1 --2- 172.21.15.6:0/3409323150 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55ebccef85a0 0x55ebccef8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.408+0000 7f8227fff700 1 -- 172.21.15.6:0/3409323150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55ebccf17ae0 msgr2=0x55ebcced14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:29.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.408+0000 7f8227fff700 1 --2- 172.21.15.6:0/3409323150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55ebccf17ae0 0x55ebcced14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.408+0000 7f8227fff700 1 -- 172.21.15.6:0/3409323150 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebccc4fd90 con 0x55ebccf17670 2023-07-06T20:00:29.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.408+0000 7f8227fff700 1 --2- 172.21.15.6:0/3409323150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccf17670 0x55ebcced0fa0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8214009fd0 tx=0x7f8214010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307156d80037ee9 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:29.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.408+0000 7f82127fc700 1 -- 172.21.15.6:0/3409323150 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8214003850 con 0x55ebccf17670 2023-07-06T20:00:29.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.408+0000 7f82127fc700 1 -- 172.21.15.6:0/3409323150 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82140039b0 con 0x55ebccf17670 2023-07-06T20:00:29.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.408+0000 7f82127fc700 1 -- 172.21.15.6:0/3409323150 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8214003d40 con 0x55ebccf17670 2023-07-06T20:00:29.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.409+0000 7f823ac50b80 1 -- 172.21.15.6:0/3409323150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccf17670 msgr2=0x55ebcced0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:29.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.409+0000 7f823ac50b80 1 --2- 172.21.15.6:0/3409323150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccf17670 0x55ebcced0fa0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8214009fd0 tx=0x7f8214010000 comp rx=0 tx=0).stop 2023-07-06T20:00:29.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.409+0000 7f823ac50b80 1 -- 172.21.15.6:0/3409323150 shutdown_connections 2023-07-06T20:00:29.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.409+0000 7f823ac50b80 1 --2- 172.21.15.6:0/3409323150 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55ebccf17ae0 0x55ebcced14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.409+0000 7f823ac50b80 1 --2- 172.21.15.6:0/3409323150 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55ebccef85a0 0x55ebccef8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.409+0000 7f823ac50b80 1 --2- 172.21.15.6:0/3409323150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccf17670 0x55ebcced0fa0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.409+0000 7f823ac50b80 1 -- 172.21.15.6:0/3409323150 >> 172.21.15.6:0/3409323150 conn(0x55ebccec5e80 msgr2=0x55ebccf161f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:29.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.409+0000 7f823ac50b80 1 -- 172.21.15.6:0/3409323150 shutdown_connections 2023-07-06T20:00:29.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.409+0000 7f823ac50b80 1 -- 172.21.15.6:0/3409323150 wait complete. 2023-07-06T20:00:29.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.409+0000 7f823ac50b80 1 -- start start 2023-07-06T20:00:29.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.409+0000 7f823ac50b80 1 Processor -- start 2023-07-06T20:00:29.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.410+0000 7f823ac50b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55ebccef85a0 0x55ebccefecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.410+0000 7f823ac50b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55ebccf17670 0x55ebccefa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.410+0000 7f823ac50b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccf17ae0 0x55ebccefa930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.410+0000 7f823ac50b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebccdc1a70 con 0x55ebccf17ae0 2023-07-06T20:00:29.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.410+0000 7f823ac50b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebccdc1770 con 0x55ebccef85a0 2023-07-06T20:00:29.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.410+0000 7f823ac50b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ebccca58d0 con 0x55ebccf17670 2023-07-06T20:00:29.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.410+0000 7f823ac50b80 10 client.0 _ll_register_callbacks cb 0x55ebccdbf710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T20:00:29.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.410+0000 7f822d068700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccf17ae0 0x55ebccefa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.410+0000 7f822d068700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccf17ae0 0x55ebccefa930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33012/0 (socket says 172.21.15.6:33012) 2023-07-06T20:00:29.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.410+0000 7f822d068700 1 -- 172.21.15.6:0/2481356659 learned_addr learned my addr 172.21.15.6:0/2481356659 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:29.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.411+0000 7f822c867700 1 --2- 172.21.15.6:0/2481356659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55ebccef85a0 0x55ebccefecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.411+0000 7f8227fff700 1 --2- 172.21.15.6:0/2481356659 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55ebccf17670 0x55ebccefa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.411+0000 7f822d068700 1 -- 172.21.15.6:0/2481356659 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55ebccf17670 msgr2=0x55ebccefa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:29.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.411+0000 7f822d068700 1 --2- 172.21.15.6:0/2481356659 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55ebccf17670 0x55ebccefa3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.411+0000 7f822d068700 1 -- 172.21.15.6:0/2481356659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55ebccef85a0 msgr2=0x55ebccefecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:29.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.411+0000 7f822d068700 1 --2- 172.21.15.6:0/2481356659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55ebccef85a0 0x55ebccefecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.411+0000 7f822d068700 1 -- 172.21.15.6:0/2481356659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822815d870 con 0x55ebccf17ae0 2023-07-06T20:00:29.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.411+0000 7f822d068700 1 --2- 172.21.15.6:0/2481356659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccf17ae0 0x55ebccefa930 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f82200608f0 tx=0x7f822005cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ff47e6df96b562 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:29.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.411+0000 7f82077fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-06T20:00:29.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.411+0000 7f82077fe700 1 -- 172.21.15.6:0/2481356659 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82200702e0 con 0x55ebccf17ae0 2023-07-06T20:00:29.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.411+0000 7f82077fe700 1 -- 172.21.15.6:0/2481356659 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8220056f30 con 0x55ebccf17ae0 2023-07-06T20:00:29.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.411+0000 7f823ac50b80 1 -- 172.21.15.6:0/2481356659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ebccec3490 con 0x55ebccf17ae0 2023-07-06T20:00:29.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.411+0000 7f82077fe700 1 -- 172.21.15.6:0/2481356659 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82200581c0 con 0x55ebccf17ae0 2023-07-06T20:00:29.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.411+0000 7f823ac50b80 10 client.5592 fetch_fsmap learned FSMap version 18 2023-07-06T20:00:29.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.411+0000 7f823ac50b80 1 -- 172.21.15.6:0/2481356659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55ebccc38c10 con 0x55ebccf17ae0 2023-07-06T20:00:29.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.411+0000 7f82077fe700 1 -- 172.21.15.6:0/2481356659 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8220074020 con 0x55ebccf17ae0 2023-07-06T20:00:29.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.411+0000 7f82077fe700 1 -- 172.21.15.6:0/2481356659 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 18) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8220060990 con 0x55ebccf17ae0 2023-07-06T20:00:29.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.411+0000 7f823ac50b80 10 client.5592 fetch_fsmap finished waiting for FSMap version 18 2023-07-06T20:00:29.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.411+0000 7f823ac50b80 10 client.5592 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-06T20:00:29.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.411+0000 7f823ac50b80 20 client.5592 populate_metadata read hostname 'smithi006' 2023-07-06T20:00:29.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.411+0000 7f823ac50b80 1 --2- 172.21.15.6:0/2481356659 >> [v2:172.21.15.40:6833/2106779005,v1:172.21.15.40:6835/2106779005] conn(0x55ebccefc1b0 0x55ebccefc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.411+0000 7f823ac50b80 4 client.5592 mds_command: new command op to 5397 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-06T20:00:29.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.411+0000 7f823ac50b80 1 -- 172.21.15.6:0/2481356659 --> [v2:172.21.15.40:6833/2106779005,v1:172.21.15.40:6835/2106779005] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ebcce1ae60 con 0x55ebccefc1b0 2023-07-06T20:00:29.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.412+0000 7f822c867700 1 --2- 172.21.15.6:0/2481356659 >> [v2:172.21.15.40:6833/2106779005,v1:172.21.15.40:6835/2106779005] conn(0x55ebccefc1b0 0x55ebccefc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.412+0000 7f82077fe700 10 client.5592 ms_handle_connect on v2:172.21.15.40:6833/2106779005 2023-07-06T20:00:29.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.412+0000 7f822c867700 1 --2- 172.21.15.6:0/2481356659 >> [v2:172.21.15.40:6833/2106779005,v1:172.21.15.40:6835/2106779005] conn(0x55ebccefc1b0 0x55ebccefc580 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea424b57a3bb5038 server_cookie=87a2f2d81761111c in_seq=0 out_seq=0 2023-07-06T20:00:29.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.413+0000 7f82077fe700 1 -- 172.21.15.6:0/2481356659 <== mds.0 v2:172.21.15.40:6833/2106779005 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ebcce1ae60 con 0x55ebccefc1b0 2023-07-06T20:00:29.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.413+0000 7f82077fe700 10 client.5592 handle_command_reply: tid=0 2023-07-06T20:00:29.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.413+0000 7f823ac50b80 1 client.5592 shutdown 2023-07-06T20:00:29.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.413+0000 7f823ac50b80 1 -- 172.21.15.6:0/2481356659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccf17ae0 msgr2=0x55ebccefa930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:29.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.413+0000 7f823ac50b80 1 --2- 172.21.15.6:0/2481356659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccf17ae0 0x55ebccefa930 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f82200608f0 tx=0x7f822005cb40 comp rx=0 tx=0).stop 2023-07-06T20:00:29.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.413+0000 7f823ac50b80 1 -- 172.21.15.6:0/2481356659 shutdown_connections 2023-07-06T20:00:29.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.413+0000 7f823ac50b80 1 --2- 172.21.15.6:0/2481356659 >> [v2:172.21.15.40:6833/2106779005,v1:172.21.15.40:6835/2106779005] conn(0x55ebccefc1b0 0x55ebccefc580 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.413+0000 7f823ac50b80 1 --2- 172.21.15.6:0/2481356659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccf17ae0 0x55ebccefa930 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.413+0000 7f823ac50b80 1 --2- 172.21.15.6:0/2481356659 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55ebccef85a0 0x55ebccefecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.413+0000 7f82077fe700 0 client.5592 ms_handle_reset on v2:172.21.15.40:6833/2106779005 2023-07-06T20:00:29.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.413+0000 7f823ac50b80 1 --2- 172.21.15.6:0/2481356659 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55ebccf17670 0x55ebccefa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.413+0000 7f823ac50b80 1 -- 172.21.15.6:0/2481356659 >> 172.21.15.6:0/2481356659 conn(0x55ebccec5e80 msgr2=0x55ebccf19ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:29.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.413+0000 7f823ac50b80 1 -- 172.21.15.6:0/2481356659 shutdown_connections 2023-07-06T20:00:29.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.413+0000 7f823ac50b80 1 -- 172.21.15.6:0/2481356659 wait complete. 2023-07-06T20:00:29.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.414+0000 7f823ac50b80 20 client.5592 trim_cache size 0 max 16384 2023-07-06T20:00:29.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.431+0000 7f823ac50b80 1 Processor -- start 2023-07-06T20:00:29.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.431+0000 7f823ac50b80 1 -- start start 2023-07-06T20:00:29.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.432+0000 7f823ac50b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccef85a0 0x55ebccf161f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.432+0000 7f823ac50b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55ebccf17670 0x55ebccf16730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.432+0000 7f823ac50b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55ebccf17ae0 0x55ebcceca110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.432+0000 7f823ac50b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebccecfc60 con 0x55ebccef85a0 2023-07-06T20:00:29.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.432+0000 7f823ac50b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebcced1c10 con 0x55ebccf17670 2023-07-06T20:00:29.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.432+0000 7f823ac50b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ebccefcf30 con 0x55ebccf17ae0 2023-07-06T20:00:29.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.432+0000 7f822c867700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccef85a0 0x55ebccf161f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.432+0000 7f822c867700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccef85a0 0x55ebccf161f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33016/0 (socket says 172.21.15.6:33016) 2023-07-06T20:00:29.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.432+0000 7f822c867700 1 -- 172.21.15.6:0/485356406 learned_addr learned my addr 172.21.15.6:0/485356406 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:29.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.432+0000 7f822d068700 1 --2- 172.21.15.6:0/485356406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55ebccf17ae0 0x55ebcceca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.432+0000 7f8227fff700 1 --2- 172.21.15.6:0/485356406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55ebccf17670 0x55ebccf16730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.432+0000 7f822c867700 1 -- 172.21.15.6:0/485356406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55ebccf17ae0 msgr2=0x55ebcceca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:29.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.432+0000 7f822c867700 1 --2- 172.21.15.6:0/485356406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55ebccf17ae0 0x55ebcceca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.432+0000 7f822c867700 1 -- 172.21.15.6:0/485356406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55ebccf17670 msgr2=0x55ebccf16730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:29.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.432+0000 7f822c867700 1 --2- 172.21.15.6:0/485356406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55ebccf17670 0x55ebccf16730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.432+0000 7f822c867700 1 -- 172.21.15.6:0/485356406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebccc76200 con 0x55ebccef85a0 2023-07-06T20:00:29.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.432+0000 7f8227fff700 1 --2- 172.21.15.6:0/485356406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55ebccf17670 0x55ebccf16730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-06T20:00:29.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.432+0000 7f822c867700 1 --2- 172.21.15.6:0/485356406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccef85a0 0x55ebccf161f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f821c00d440 tx=0x7f821c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a5c2c99c99c37b server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:29.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.433+0000 7f8212ffd700 1 -- 172.21.15.6:0/485356406 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c019040 con 0x55ebccef85a0 2023-07-06T20:00:29.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.433+0000 7f8212ffd700 1 -- 172.21.15.6:0/485356406 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821c01a040 con 0x55ebccef85a0 2023-07-06T20:00:29.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.433+0000 7f8212ffd700 1 -- 172.21.15.6:0/485356406 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c00de00 con 0x55ebccef85a0 2023-07-06T20:00:29.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.433+0000 7f823ac50b80 1 -- 172.21.15.6:0/485356406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccef85a0 msgr2=0x55ebccf161f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:29.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.433+0000 7f823ac50b80 1 --2- 172.21.15.6:0/485356406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccef85a0 0x55ebccf161f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f821c00d440 tx=0x7f821c013000 comp rx=0 tx=0).stop 2023-07-06T20:00:29.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.433+0000 7f823ac50b80 1 -- 172.21.15.6:0/485356406 shutdown_connections 2023-07-06T20:00:29.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.433+0000 7f823ac50b80 1 --2- 172.21.15.6:0/485356406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccef85a0 0x55ebccf161f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.433+0000 7f823ac50b80 1 --2- 172.21.15.6:0/485356406 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55ebccf17ae0 0x55ebcceca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.433+0000 7f823ac50b80 1 --2- 172.21.15.6:0/485356406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55ebccf17670 0x55ebccf16730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.433+0000 7f823ac50b80 1 -- 172.21.15.6:0/485356406 >> 172.21.15.6:0/485356406 conn(0x55ebccec5e80 msgr2=0x55ebccf3b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:29.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.433+0000 7f823ac50b80 1 -- 172.21.15.6:0/485356406 shutdown_connections 2023-07-06T20:00:29.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.433+0000 7f823ac50b80 1 -- 172.21.15.6:0/485356406 wait complete. 2023-07-06T20:00:29.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.434+0000 7f823ac50b80 1 -- start start 2023-07-06T20:00:29.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.434+0000 7f823ac50b80 1 Processor -- start 2023-07-06T20:00:29.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.435+0000 7f823ac50b80 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55ebccef85a0 0x55ebccf80de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.435+0000 7f823ac50b80 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55ebccf17670 0x55ebccf152b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.435+0000 7f823ac50b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccf17ae0 0x55ebccf157f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.435+0000 7f823ac50b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebccf81590 con 0x55ebccf17ae0 2023-07-06T20:00:29.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.435+0000 7f823ac50b80 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebccefcca0 con 0x55ebccef85a0 2023-07-06T20:00:29.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.435+0000 7f823ac50b80 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ebcceebbe0 con 0x55ebccf17670 2023-07-06T20:00:29.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.435+0000 7f823ac50b80 10 client.0 _ll_register_callbacks cb 0x7f8220058430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-06T20:00:29.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.435+0000 7f822d068700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccf17ae0 0x55ebccf157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.435+0000 7f822d068700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccf17ae0 0x55ebccf157f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33026/0 (socket says 172.21.15.6:33026) 2023-07-06T20:00:29.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.435+0000 7f822d068700 1 -- 172.21.15.6:0/4249870434 learned_addr learned my addr 172.21.15.6:0/4249870434 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:29.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.435+0000 7f8227fff700 1 --2- 172.21.15.6:0/4249870434 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55ebccf17670 0x55ebccf152b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.435+0000 7f822c867700 1 --2- 172.21.15.6:0/4249870434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55ebccef85a0 0x55ebccf80de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.435+0000 7f822d068700 1 -- 172.21.15.6:0/4249870434 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55ebccf17670 msgr2=0x55ebccf152b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:29.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.435+0000 7f822d068700 1 --2- 172.21.15.6:0/4249870434 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55ebccf17670 0x55ebccf152b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.435+0000 7f822d068700 1 -- 172.21.15.6:0/4249870434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55ebccef85a0 msgr2=0x55ebccf80de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:29.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.435+0000 7f822d068700 1 --2- 172.21.15.6:0/4249870434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55ebccef85a0 0x55ebccf80de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.435+0000 7f822d068700 1 -- 172.21.15.6:0/4249870434 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821c00e040 con 0x55ebccf17ae0 2023-07-06T20:00:29.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.435+0000 7f822d068700 1 --2- 172.21.15.6:0/4249870434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccf17ae0 0x55ebccf157f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8220057e30 tx=0x7f8220088000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c32ee6b56ba9e36 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:29.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.435+0000 7f82077fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-07-06T20:00:29.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.436+0000 7f82077fe700 1 -- 172.21.15.6:0/4249870434 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82200702e0 con 0x55ebccf17ae0 2023-07-06T20:00:29.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.436+0000 7f82077fe700 1 -- 172.21.15.6:0/4249870434 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8220075080 con 0x55ebccf17ae0 2023-07-06T20:00:29.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.436+0000 7f823ac50b80 1 -- 172.21.15.6:0/4249870434 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f82140039b0 con 0x55ebccf17ae0 2023-07-06T20:00:29.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.436+0000 7f82077fe700 1 -- 172.21.15.6:0/4249870434 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8220077560 con 0x55ebccf17ae0 2023-07-06T20:00:29.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.436+0000 7f823ac50b80 10 client.5598 fetch_fsmap learned FSMap version 18 2023-07-06T20:00:29.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.436+0000 7f823ac50b80 1 -- 172.21.15.6:0/4249870434 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55ebccc4e260 con 0x55ebccf17ae0 2023-07-06T20:00:29.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.436+0000 7f82077fe700 1 -- 172.21.15.6:0/4249870434 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82140039b0 con 0x55ebccf17ae0 2023-07-06T20:00:29.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.436+0000 7f82077fe700 1 -- 172.21.15.6:0/4249870434 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 18) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f822007e070 con 0x55ebccf17ae0 2023-07-06T20:00:29.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.436+0000 7f823ac50b80 10 client.5598 fetch_fsmap finished waiting for FSMap version 18 2023-07-06T20:00:29.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.436+0000 7f823ac50b80 10 client.5598 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-06T20:00:29.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.436+0000 7f823ac50b80 20 client.5598 populate_metadata read hostname 'smithi006' 2023-07-06T20:00:29.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.436+0000 7f823ac50b80 1 --2- 172.21.15.6:0/4249870434 >> [v2:172.21.15.40:6833/2106779005,v1:172.21.15.40:6835/2106779005] conn(0x55ebcceeadd0 0x55ebcceeb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.436+0000 7f823ac50b80 4 client.5598 mds_command: new command op to 5397 tid=0[{"prefix": "status"}] 2023-07-06T20:00:29.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.436+0000 7f823ac50b80 1 -- 172.21.15.6:0/4249870434 --> [v2:172.21.15.40:6833/2106779005,v1:172.21.15.40:6835/2106779005] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ebccddd000 con 0x55ebcceeadd0 2023-07-06T20:00:29.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.436+0000 7f822c867700 1 --2- 172.21.15.6:0/4249870434 >> [v2:172.21.15.40:6833/2106779005,v1:172.21.15.40:6835/2106779005] conn(0x55ebcceeadd0 0x55ebcceeb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.437+0000 7f822c867700 1 --2- 172.21.15.6:0/4249870434 >> [v2:172.21.15.40:6833/2106779005,v1:172.21.15.40:6835/2106779005] conn(0x55ebcceeadd0 0x55ebcceeb1a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc5463c93f78152e server_cookie=c5b0ae4e8e47e976 in_seq=0 out_seq=0 2023-07-06T20:00:29.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.437+0000 7f82077fe700 10 client.5598 ms_handle_connect on v2:172.21.15.40:6833/2106779005 2023-07-06T20:00:29.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.437+0000 7f82077fe700 1 -- 172.21.15.6:0/4249870434 <== mds.0 v2:172.21.15.40:6833/2106779005 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55ebccddd000 con 0x55ebcceeadd0 2023-07-06T20:00:29.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.437+0000 7f82077fe700 10 client.5598 handle_command_reply: tid=0 2023-07-06T20:00:29.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.437+0000 7f823ac50b80 1 client.5598 shutdown 2023-07-06T20:00:29.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.437+0000 7f823ac50b80 1 -- 172.21.15.6:0/4249870434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccf17ae0 msgr2=0x55ebccf157f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:29.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.437+0000 7f823ac50b80 1 --2- 172.21.15.6:0/4249870434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccf17ae0 0x55ebccf157f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8220057e30 tx=0x7f8220088000 comp rx=0 tx=0).stop 2023-07-06T20:00:29.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.437+0000 7f823ac50b80 1 -- 172.21.15.6:0/4249870434 shutdown_connections 2023-07-06T20:00:29.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.437+0000 7f823ac50b80 1 --2- 172.21.15.6:0/4249870434 >> [v2:172.21.15.40:6833/2106779005,v1:172.21.15.40:6835/2106779005] conn(0x55ebcceeadd0 0x55ebcceeb1a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.437+0000 7f823ac50b80 1 --2- 172.21.15.6:0/4249870434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ebccf17ae0 0x55ebccf157f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.437+0000 7f823ac50b80 1 --2- 172.21.15.6:0/4249870434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55ebccef85a0 0x55ebccf80de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.437+0000 7f82077fe700 0 client.5598 ms_handle_reset on v2:172.21.15.40:6833/2106779005 2023-07-06T20:00:29.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.437+0000 7f823ac50b80 1 --2- 172.21.15.6:0/4249870434 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x55ebccf17670 0x55ebccf152b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.437+0000 7f823ac50b80 1 -- 172.21.15.6:0/4249870434 >> 172.21.15.6:0/4249870434 conn(0x55ebccec5e80 msgr2=0x55ebccf164a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:29.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.437+0000 7f823ac50b80 1 -- 172.21.15.6:0/4249870434 shutdown_connections 2023-07-06T20:00:29.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.437+0000 7f823ac50b80 1 -- 172.21.15.6:0/4249870434 wait complete. 2023-07-06T20:00:29.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.437+0000 7f823ac50b80 20 client.5598 trim_cache size 0 max 16384 2023-07-06T20:00:29.471 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-06T20:00:29.471 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "59b158c6-5d9d-4877-b4e7-a584e294fb2e", 2023-07-06T20:00:29.472 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-07-06T20:00:29.473 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 5397, 2023-07-06T20:00:29.473 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-07-06T20:00:29.473 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-07-06T20:00:29.474 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-07-06T20:00:29.474 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 10.664072876000001, 2023-07-06T20:00:29.474 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 18, 2023-07-06T20:00:29.474 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 41, 2023-07-06T20:00:29.474 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 41, 2023-07-06T20:00:29.474 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 18.684273532999999 2023-07-06T20:00:29.474 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-06T20:00:29.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.438+0000 7f822eacb700 1 -- 172.21.15.6:0/3963861146 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f820c06ace0 msgr2=0x7f820c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:29.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.438+0000 7f822eacb700 1 --2- 172.21.15.6:0/3963861146 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f820c06ace0 0x7f820c06d190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f821c009910 tx=0x7f821c008040 comp rx=0 tx=0).stop 2023-07-06T20:00:29.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.438+0000 7f822eacb700 1 -- 172.21.15.6:0/3963861146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f822815cd40 msgr2=0x7f82280c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:29.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.438+0000 7f822eacb700 1 --2- 172.21.15.6:0/3963861146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f822815cd40 0x7f82280c4750 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f822000cd70 tx=0x7f822000a570 comp rx=0 tx=0).stop 2023-07-06T20:00:29.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.438+0000 7f822eacb700 1 -- 172.21.15.6:0/3963861146 shutdown_connections 2023-07-06T20:00:29.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.438+0000 7f822eacb700 1 --2- 172.21.15.6:0/3963861146 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f820c06ace0 0x7f820c06d190 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.438+0000 7f822eacb700 1 --2- 172.21.15.6:0/3963861146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f822815cd40 0x7f82280c4750 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.438+0000 7f822eacb700 1 --2- 172.21.15.6:0/3963861146 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8228071da0 0x7f82280c3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.438+0000 7f822eacb700 1 --2- 172.21.15.6:0/3963861146 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f82281592b0 0x7f82280c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.438+0000 7f822eacb700 1 -- 172.21.15.6:0/3963861146 >> 172.21.15.6:0/3963861146 conn(0x7f82280cf960 msgr2=0x7f822806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:29.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.438+0000 7f822eacb700 1 -- 172.21.15.6:0/3963861146 shutdown_connections 2023-07-06T20:00:29.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.438+0000 7f822eacb700 1 -- 172.21.15.6:0/3963861146 wait complete. 2023-07-06T20:00:29.478 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-06T20:00:29.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.604+0000 7fb6b2c0b700 1 Processor -- start 2023-07-06T20:00:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.604+0000 7fb6b2c0b700 1 -- start start 2023-07-06T20:00:29.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.605+0000 7fb6b2c0b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6ac157ed0 0x7fb6ac06f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.605+0000 7fb6b2c0b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb6ac15e4c0 0x7fb6ac0ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.605+0000 7fb6b2c0b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ac06e6c0 con 0x7fb6ac0ccbe0 2023-07-06T20:00:29.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.605+0000 7fb6b2c0b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ac06f6a0 con 0x7fb6ac15e4c0 2023-07-06T20:00:29.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.605+0000 7fb6b2c0b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac0cb080 con 0x7fb6ac157ed0 2023-07-06T20:00:29.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.605+0000 7fb6b11a8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb6ac15e4c0 0x7fb6ac0ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.605+0000 7fb6b11a8700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb6ac15e4c0 0x7fb6ac0ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33034/0 (socket says 172.21.15.6:33034) 2023-07-06T20:00:29.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.605+0000 7fb6b11a8700 1 -- 172.21.15.6:0/2929045024 learned_addr learned my addr 172.21.15.6:0/2929045024 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:29.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.605+0000 7fb6b09a7700 1 --2- 172.21.15.6:0/2929045024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6ac157ed0 0x7fb6ac06f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.605+0000 7fb6b11a8700 1 -- 172.21.15.6:0/2929045024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6ac157ed0 msgr2=0x7fb6ac06f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:29.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.605+0000 7fb6b11a8700 1 --2- 172.21.15.6:0/2929045024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6ac157ed0 0x7fb6ac06f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.605+0000 7fb6b11a8700 1 -- 172.21.15.6:0/2929045024 >> v1:172.21.15.40:6789/0 conn(0x7fb6ac0ccbe0 legacy=0x7fb6ac15ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:29.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.606+0000 7fb6b11a8700 1 -- 172.21.15.6:0/2929045024 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ac0cb360 con 0x7fb6ac15e4c0 2023-07-06T20:00:29.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.606+0000 7fb6b09a7700 1 --2- 172.21.15.6:0/2929045024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6ac157ed0 0x7fb6ac06f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:29.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.606+0000 7fb6b11a8700 1 --2- 172.21.15.6:0/2929045024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac15e4c0 0x7fb6ac0ce600 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4009e50 tx=0x7fb6a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72cc1dcc2241bef7 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:29.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.606+0000 7fb6ab7fe700 1 -- 172.21.15.6:0/2929045024 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a400e070 con 0x7fb6ac15e4c0 2023-07-06T20:00:29.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.606+0000 7fb6ab7fe700 1 -- 172.21.15.6:0/2929045024 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a400b9c0 con 0x7fb6ac15e4c0 2023-07-06T20:00:29.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.606+0000 7fb6ab7fe700 1 -- 172.21.15.6:0/2929045024 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a400bd70 con 0x7fb6ac15e4c0 2023-07-06T20:00:29.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.606+0000 7fb6b2c0b700 1 -- 172.21.15.6:0/2929045024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac15e4c0 msgr2=0x7fb6ac0ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:29.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.606+0000 7fb6b2c0b700 1 --2- 172.21.15.6:0/2929045024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac15e4c0 0x7fb6ac0ce600 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4009e50 tx=0x7fb6a400b330 comp rx=0 tx=0).stop 2023-07-06T20:00:29.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.606+0000 7fb6b2c0b700 1 -- 172.21.15.6:0/2929045024 shutdown_connections 2023-07-06T20:00:29.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.606+0000 7fb6b2c0b700 1 --2- 172.21.15.6:0/2929045024 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6ac157ed0 0x7fb6ac06f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.606+0000 7fb6b2c0b700 1 --2- 172.21.15.6:0/2929045024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac15e4c0 0x7fb6ac0ce600 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.606+0000 7fb6b2c0b700 1 -- 172.21.15.6:0/2929045024 >> 172.21.15.6:0/2929045024 conn(0x7fb6ac0d0a30 msgr2=0x7fb6ac0d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:29.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.606+0000 7fb6b2c0b700 1 -- 172.21.15.6:0/2929045024 shutdown_connections 2023-07-06T20:00:29.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.606+0000 7fb6b2c0b700 1 -- 172.21.15.6:0/2929045024 wait complete. 2023-07-06T20:00:29.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.608+0000 7fb6b2c0b700 1 Processor -- start 2023-07-06T20:00:29.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.608+0000 7fb6b2c0b700 1 -- start start 2023-07-06T20:00:29.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.608+0000 7fb6b2c0b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6ac0ccbe0 0x7fb6ac1ef550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.609+0000 7fb6b2c0b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac157ed0 0x7fb6ac1f30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.609+0000 7fb6b2c0b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6ac15e4c0 0x7fb6ac1f3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.609+0000 7fb6b2c0b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac0b1c80 con 0x7fb6ac157ed0 2023-07-06T20:00:29.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.609+0000 7fb6b2c0b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac0b1370 con 0x7fb6ac0ccbe0 2023-07-06T20:00:29.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.609+0000 7fb6b2c0b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac0b6510 con 0x7fb6ac15e4c0 2023-07-06T20:00:29.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.609+0000 7fb6abfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac157ed0 0x7fb6ac1f30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.609+0000 7fb6abfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac157ed0 0x7fb6ac1f30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33038/0 (socket says 172.21.15.6:33038) 2023-07-06T20:00:29.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.609+0000 7fb6abfff700 1 -- 172.21.15.6:0/3900824306 learned_addr learned my addr 172.21.15.6:0/3900824306 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:29.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.609+0000 7fb6b11a8700 1 --2- 172.21.15.6:0/3900824306 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6ac15e4c0 0x7fb6ac1f3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.609+0000 7fb6b09a7700 1 --2- 172.21.15.6:0/3900824306 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6ac0ccbe0 0x7fb6ac1ef550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.609+0000 7fb6abfff700 1 -- 172.21.15.6:0/3900824306 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6ac15e4c0 msgr2=0x7fb6ac1f3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:29.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.609+0000 7fb6abfff700 1 --2- 172.21.15.6:0/3900824306 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6ac15e4c0 0x7fb6ac1f3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.609+0000 7fb6abfff700 1 -- 172.21.15.6:0/3900824306 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6ac0ccbe0 msgr2=0x7fb6ac1ef550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:29.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.609+0000 7fb6abfff700 1 --2- 172.21.15.6:0/3900824306 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6ac0ccbe0 0x7fb6ac1ef550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.609+0000 7fb6abfff700 1 -- 172.21.15.6:0/3900824306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a4009b30 con 0x7fb6ac157ed0 2023-07-06T20:00:29.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.609+0000 7fb6abfff700 1 --2- 172.21.15.6:0/3900824306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac157ed0 0x7fb6ac1f30f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb69800c4e0 tx=0x7fb69800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:29.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.609+0000 7fb6a97fa700 1 -- 172.21.15.6:0/3900824306 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6980052d0 con 0x7fb6ac157ed0 2023-07-06T20:00:29.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.609+0000 7fb6a97fa700 1 -- 172.21.15.6:0/3900824306 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb698005430 con 0x7fb6ac157ed0 2023-07-06T20:00:29.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.609+0000 7fb6b2c0b700 1 -- 172.21.15.6:0/3900824306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ac0b15c0 con 0x7fb6ac157ed0 2023-07-06T20:00:29.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.609+0000 7fb6a97fa700 1 -- 172.21.15.6:0/3900824306 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6980038c0 con 0x7fb6ac157ed0 2023-07-06T20:00:29.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.609+0000 7fb6b2c0b700 1 -- 172.21.15.6:0/3900824306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ac0b6130 con 0x7fb6ac157ed0 2023-07-06T20:00:29.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.610+0000 7fb6b2c0b700 1 -- 172.21.15.6:0/3900824306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6ac15c200 con 0x7fb6ac157ed0 2023-07-06T20:00:29.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.611+0000 7fb6a97fa700 1 -- 172.21.15.6:0/3900824306 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb698003a20 con 0x7fb6ac157ed0 2023-07-06T20:00:29.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.611+0000 7fb6a97fa700 1 --2- 172.21.15.6:0/3900824306 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb69006ace0 0x7fb69006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:29.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.611+0000 7fb6a97fa700 1 -- 172.21.15.6:0/3900824306 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb698088960 con 0x7fb6ac157ed0 2023-07-06T20:00:29.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.611+0000 7fb6b09a7700 1 --2- 172.21.15.6:0/3900824306 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb69006ace0 0x7fb69006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:29.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.612+0000 7fb6b09a7700 1 --2- 172.21.15.6:0/3900824306 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb69006ace0 0x7fb69006d190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0006f10 tx=0x7fb6a0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:29.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.616+0000 7fb6a97fa700 1 -- 172.21.15.6:0/3900824306 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb6980538d0 con 0x7fb6ac157ed0 2023-07-06T20:00:29.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.861+0000 7fb6b2c0b700 1 -- 172.21.15.6:0/3900824306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb6ac06f100 con 0x7fb6ac157ed0 2023-07-06T20:00:29.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.861+0000 7fb6a97fa700 1 -- 172.21.15.6:0/3900824306 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb698017060 con 0x7fb6ac157ed0 2023-07-06T20:00:29.864 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-06T20:00:29.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.863+0000 7fb6b2c0b700 1 -- 172.21.15.6:0/3900824306 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb69006ace0 msgr2=0x7fb69006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:29.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.863+0000 7fb6b2c0b700 1 --2- 172.21.15.6:0/3900824306 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb69006ace0 0x7fb69006d190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0006f10 tx=0x7fb6a0008040 comp rx=0 tx=0).stop 2023-07-06T20:00:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.863+0000 7fb6b2c0b700 1 -- 172.21.15.6:0/3900824306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac157ed0 msgr2=0x7fb6ac1f30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.863+0000 7fb6b2c0b700 1 --2- 172.21.15.6:0/3900824306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac157ed0 0x7fb6ac1f30f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb69800c4e0 tx=0x7fb69800c7f0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.863+0000 7fb6b2c0b700 1 -- 172.21.15.6:0/3900824306 shutdown_connections 2023-07-06T20:00:29.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.863+0000 7fb6b2c0b700 1 --2- 172.21.15.6:0/3900824306 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb69006ace0 0x7fb69006d190 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.863+0000 7fb6b2c0b700 1 --2- 172.21.15.6:0/3900824306 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb6ac15e4c0 0x7fb6ac1f3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.863+0000 7fb6b2c0b700 1 --2- 172.21.15.6:0/3900824306 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6ac0ccbe0 0x7fb6ac1ef550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.863+0000 7fb6b2c0b700 1 --2- 172.21.15.6:0/3900824306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac157ed0 0x7fb6ac1f30f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:29.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.863+0000 7fb6b2c0b700 1 -- 172.21.15.6:0/3900824306 >> 172.21.15.6:0/3900824306 conn(0x7fb6ac0d0a30 msgr2=0x7fb6ac0ce5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:29.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.864+0000 7fb6b2c0b700 1 -- 172.21.15.6:0/3900824306 shutdown_connections 2023-07-06T20:00:29.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:29.864+0000 7fb6b2c0b700 1 -- 172.21.15.6:0/3900824306 wait complete. 2023-07-06T20:00:29.889 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-06T20:00:29.889 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-06T20:00:29.890 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-07-06T20:00:29.890 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-06T20:00:29.890 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-06T20:00:29.890 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-06T20:00:29.891 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-06T20:00:29.891 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-06T20:00:29.891 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T20:00:29.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T20:00:29.892 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-07-06T20:00:29.912 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-06T20:00:29.912 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-06T20:00:29.912 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-07-06T20:00:29.912 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T20:00:29.913 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-07-06T20:00:29.913 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T20:00:29.913 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T20:00:29.913 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-07-06T20:00:29.913 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T20:00:29.913 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-07-06T20:00:29.913 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-06T20:00:29.914 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-07-06T20:00:29.914 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-07-06T20:00:29.914 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 42157sec preferred_lft 42157sec 2023-07-06T20:00:29.914 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-07-06T20:00:29.914 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T20:00:29.914 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-06T20:00:29.914 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-07-06T20:00:29.915 INFO:teuthology.orchestra.run.smithi006.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-06T20:00:29.915 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 42:b9:54:fd:52:19 brd ff:ff:ff:ff:ff:ff 2023-07-06T20:00:29.915 INFO:teuthology.orchestra.run.smithi006.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-06T20:00:29.915 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T20:00:29.915 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::b894:e0ff:feb6:2237/64 scope link 2023-07-06T20:00:29.915 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T20:00:29.916 INFO:teuthology.orchestra.run.smithi006.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T20:00:29.916 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 72:c9:1c:fc:d6:d4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-06T20:00:29.916 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::70c9:1cff:fefc:d6d4/64 scope link 2023-07-06T20:00:29.916 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T20:00:29.916 INFO:teuthology.orchestra.run.smithi006.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-06T20:00:29.916 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 42:b9:54:fd:52:19 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-06T20:00:29.916 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::40b9:54ff:fefd:5219/64 scope link 2023-07-06T20:00:29.916 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-07-06T20:00:29.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T20:00:29.917 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-06T20:00:29.979 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-07-06T20:00:29.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T20:00:29.980 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-07-06T20:00:30.042 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-07-06T20:00:30.043 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-06T20:00:30.043 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-07-06T20:00:30.043 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-07-06T20:00:30.044 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-06T20:00:30.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T20:00:30.046 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-07-06T20:00:30.046 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-07-06T20:00:30.047 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-06T20:00:30.048 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-06T20:00:30.060 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-06T20:00:30.061 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-07-06T20:00:30.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T20:00:30.152 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-06T20:00:30.173 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-06T20:00:30.173 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-06T20:00:30.173 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-06T20:00:30.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T20:00:30.174 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-07-06T20:00:30.241 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T20:00:30.242 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-06T20:00:30.301 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-06T20:00:30.302 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-06T20:00:30.302 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-06T20:00:30.358 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-06T20:00:30.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T20:00:30.359 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-06T20:00:30.446 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-06T20:00:30.446 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-06T20:00:30.446 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-06T20:00:30.455 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-06T20:00:30.455 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-06T20:00:30.456 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-06T20:00:30.456 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.40:3300,172.21.15.40:3301" 2023-07-06T20:00:30.456 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-06T20:00:30.532 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-06T20:00:30.532 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-06T20:00:30.533 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-07-06T20:00:30.533 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.40:3300,172.21.15.40:3301" 2023-07-06T20:00:30.533 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-06T20:00:30.533 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:6789,172.21.15.40:6789,172.21.15.40:6790" 2023-07-06T20:00:30.534 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:6789,172.21.15.40:6789,172.21.15.40:6790:/ 2023-07-06T20:00:30.534 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=59b158c6-5d9d-4877-b4e7-a584e294fb2e" will pass to kernel 2023-07-06T20:00:30.534 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-06T20:00:30.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T20:00:30.536 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-06T20:00:30.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T20:00:30.565 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-06T20:00:30.654 INFO:teuthology.orchestra.run.smithi006.stdout:client5000 2023-07-06T20:00:30.655 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T20:00:30.655 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-06T20:00:30.673 DEBUG:teuthology.orchestra.run.smithi006:> mktemp -d --suffix=xfstests-dev 2023-07-06T20:00:30.729 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.LybHGoQKZdxfstests-dev 2023-07-06T20:00:30.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T20:00:30.730 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.LybHGoQKZdxfstests-dev) 2023-07-06T20:00:30.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T20:00:30.800 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.LybHGoQKZdxfstests-dev) 2023-07-06T20:00:30.861 INFO:teuthology.orchestra.run.smithi006.stderr:Cloning into '/tmp/tmp.LybHGoQKZdxfstests-dev'... 2023-07-06T20:00:31.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T20:00:31.525 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-07-06T20:00:31.587 DEBUG:teuthology.orchestra.run.smithi006:> mktemp -d --suffix=test 2023-07-06T20:00:31.646 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.FMWA5cKBX8test 2023-07-06T20:00:31.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T20:00:31.647 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-07-06T20:00:31.707 DEBUG:teuthology.orchestra.run.smithi006:> mktemp -d --suffix=scratch 2023-07-06T20:00:31.765 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:00:31.765 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "rhel" and "8.6". 2023-07-06T20:00:31.766 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite xfsprogs-qa-devel 2023-07-06T20:00:32.186 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-07-06T20:00:34.240 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:05:00 ago on Thu 06 Jul 2023 07:55:34 PM UTC. 2023-07-06T20:00:35.674 INFO:teuthology.orchestra.run.smithi006.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-07-06T20:00:35.675 INFO:teuthology.orchestra.run.smithi006.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-07-06T20:00:35.677 INFO:teuthology.orchestra.run.smithi006.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-07-06T20:00:35.678 INFO:teuthology.orchestra.run.smithi006.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-07-06T20:00:35.689 INFO:teuthology.orchestra.run.smithi006.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-07-06T20:00:35.690 INFO:teuthology.orchestra.run.smithi006.stdout:Package e2fsprogs-1.45.6-4.el8.x86_64 is already installed. 2023-07-06T20:00:35.690 INFO:teuthology.orchestra.run.smithi006.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-07-06T20:00:35.690 INFO:teuthology.orchestra.run.smithi006.stdout:Package gcc-8.5.0-10.1.el8_6.x86_64 is already installed. 2023-07-06T20:00:35.691 INFO:teuthology.orchestra.run.smithi006.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-07-06T20:00:35.691 INFO:teuthology.orchestra.run.smithi006.stdout:Package lvm2-8:2.03.14-3.el8_6.2.x86_64 is already installed. 2023-07-06T20:00:35.691 INFO:teuthology.orchestra.run.smithi006.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-07-06T20:00:35.692 INFO:teuthology.orchestra.run.smithi006.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-07-06T20:00:35.692 INFO:teuthology.orchestra.run.smithi006.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-07-06T20:00:35.693 INFO:teuthology.orchestra.run.smithi006.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-07-06T20:00:35.694 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-06T20:00:35.695 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-06T20:00:35.696 INFO:teuthology.orchestra.run.smithi006.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-06T20:00:35.697 INFO:teuthology.orchestra.run.smithi006.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-06T20:00:35.699 INFO:teuthology.orchestra.run.smithi006.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-07-06T20:00:35.700 INFO:teuthology.orchestra.run.smithi006.stdout:Package libuuid-devel-2.32.1-35.el8.x86_64 is already installed. 2023-07-06T20:00:35.701 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsprogs-devel-5.0.0-10.el8.x86_64 is already installed. 2023-07-06T20:00:35.705 INFO:teuthology.orchestra.run.smithi006.stdout:Package sqlite-3.26.0-15.el8.x86_64 is already installed. 2023-07-06T20:00:35.711 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-06T20:00:35.838 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2023-07-06T20:00:35.840 INFO:teuthology.orchestra.run.smithi006.stdout:==================================================================================================================== 2023-07-06T20:00:35.840 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2023-07-06T20:00:35.840 INFO:teuthology.orchestra.run.smithi006.stdout:==================================================================================================================== 2023-07-06T20:00:35.841 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2023-07-06T20:00:35.841 INFO:teuthology.orchestra.run.smithi006.stdout: dump x86_64 1:0.4-0.36.b46.el8 rhel-8-for-x86_64-baseos-rpms 164 k 2023-07-06T20:00:35.841 INFO:teuthology.orchestra.run.smithi006.stdout: fio x86_64 3.19-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-06T20:00:35.841 INFO:teuthology.orchestra.run.smithi006.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-07-06T20:00:35.841 INFO:teuthology.orchestra.run.smithi006.stdout: python2 x86_64 2.7.18-10.module+el8.6.0+14191+7fdd52cd rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-06T20:00:35.841 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrading: 2023-07-06T20:00:35.841 INFO:teuthology.orchestra.run.smithi006.stdout: sqlite x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 668 k 2023-07-06T20:00:35.842 INFO:teuthology.orchestra.run.smithi006.stdout: sqlite-libs x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 581 k 2023-07-06T20:00:35.842 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2023-07-06T20:00:35.842 INFO:teuthology.orchestra.run.smithi006.stdout: daxctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 42 k 2023-07-06T20:00:35.842 INFO:teuthology.orchestra.run.smithi006.stdout: libpmemblk x86_64 1.6.1-1.el8 rhel-8-for-x86_64-appstream-rpms 92 k 2023-07-06T20:00:35.842 INFO:teuthology.orchestra.run.smithi006.stdout: ndctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 79 k 2023-07-06T20:00:35.842 INFO:teuthology.orchestra.run.smithi006.stdout: python2-libs x86_64 2.7.18-10.module+el8.6.0+14191+7fdd52cd rhel-8-for-x86_64-appstream-rpms 6.0 M 2023-07-06T20:00:35.843 INFO:teuthology.orchestra.run.smithi006.stdout: python2-pip-wheel noarch 9.0.3-19.module+el8.6.0+13001+ad200bd9 rhel-8-for-x86_64-appstream-rpms 892 k 2023-07-06T20:00:35.843 INFO:teuthology.orchestra.run.smithi006.stdout: python2-setuptools-wheel noarch 39.0.1-13.module+el8.4.0+9442+27d0e81c rhel-8-for-x86_64-appstream-rpms 287 k 2023-07-06T20:00:35.843 INFO:teuthology.orchestra.run.smithi006.stdout: python2-wheel-wheel noarch 1:0.31.1-3.module+el8.5.0+12203+77770ab7 rhel-8-for-x86_64-appstream-rpms 45 k 2023-07-06T20:00:35.843 INFO:teuthology.orchestra.run.smithi006.stdout: rmt x86_64 2:1.5.3-13.el8 rhel-8-for-x86_64-baseos-rpms 51 k 2023-07-06T20:00:35.843 INFO:teuthology.orchestra.run.smithi006.stdout:Installing weak dependencies: 2023-07-06T20:00:35.843 INFO:teuthology.orchestra.run.smithi006.stdout: python2-pip noarch 9.0.3-19.module+el8.6.0+13001+ad200bd9 rhel-8-for-x86_64-appstream-rpms 1.6 M 2023-07-06T20:00:35.844 INFO:teuthology.orchestra.run.smithi006.stdout: python2-setuptools noarch 39.0.1-13.module+el8.4.0+9442+27d0e81c rhel-8-for-x86_64-appstream-rpms 642 k 2023-07-06T20:00:35.844 INFO:teuthology.orchestra.run.smithi006.stdout:Enabling module streams: 2023-07-06T20:00:35.844 INFO:teuthology.orchestra.run.smithi006.stdout: python27 2.7 2023-07-06T20:00:35.844 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:35.844 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2023-07-06T20:00:35.844 INFO:teuthology.orchestra.run.smithi006.stdout:==================================================================================================================== 2023-07-06T20:00:35.844 INFO:teuthology.orchestra.run.smithi006.stdout:Install 14 Packages 2023-07-06T20:00:35.844 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrade 2 Packages 2023-07-06T20:00:35.845 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:35.845 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 12 M 2023-07-06T20:00:35.846 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2023-07-06T20:00:36.352 INFO:teuthology.orchestra.run.smithi006.stdout:(1/16): python2-setuptools-wheel-39.0.1-13.modu 804 kB/s | 287 kB 00:00 2023-07-06T20:00:36.389 INFO:teuthology.orchestra.run.smithi006.stdout:(2/16): indent-2.2.13-2.el8.x86_64.rpm 472 kB/s | 187 kB 00:00 2023-07-06T20:00:36.414 INFO:teuthology.orchestra.run.smithi006.stdout:(3/16): python2-setuptools-39.0.1-13.module+el8 1.5 MB/s | 642 kB 00:00 2023-07-06T20:00:36.540 INFO:teuthology.orchestra.run.smithi006.stdout:(4/16): fio-3.19-3.el8.x86_64.rpm 3.5 MB/s | 538 kB 00:00 2023-07-06T20:00:36.567 INFO:teuthology.orchestra.run.smithi006.stdout:(5/16): python2-wheel-wheel-0.31.1-3.module+el8 209 kB/s | 45 kB 00:00 2023-07-06T20:00:36.682 INFO:teuthology.orchestra.run.smithi006.stdout:(6/16): libpmemblk-1.6.1-1.el8.x86_64.rpm 344 kB/s | 92 kB 00:00 2023-07-06T20:00:36.782 INFO:teuthology.orchestra.run.smithi006.stdout:(7/16): python2-2.7.18-10.module+el8.6.0+14191+ 454 kB/s | 110 kB 00:00 2023-07-06T20:00:36.983 INFO:teuthology.orchestra.run.smithi006.stdout:(8/16): python2-libs-2.7.18-10.module+el8.6.0+1 14 MB/s | 6.0 MB 00:00 2023-07-06T20:00:37.041 INFO:teuthology.orchestra.run.smithi006.stdout:(9/16): python2-pip-9.0.3-19.module+el8.6.0+130 4.6 MB/s | 1.6 MB 00:00 2023-07-06T20:00:37.083 INFO:teuthology.orchestra.run.smithi006.stdout:(10/16): python2-pip-wheel-9.0.3-19.module+el8. 2.9 MB/s | 892 kB 00:00 2023-07-06T20:00:37.208 INFO:teuthology.orchestra.run.smithi006.stdout:(11/16): rmt-1.5.3-13.el8.x86_64.rpm 309 kB/s | 51 kB 00:00 2023-07-06T20:00:37.276 INFO:teuthology.orchestra.run.smithi006.stdout:(12/16): daxctl-libs-71.1-3.el8.x86_64.rpm 217 kB/s | 42 kB 00:00 2023-07-06T20:00:37.301 INFO:teuthology.orchestra.run.smithi006.stdout:(13/16): dump-0.4-0.36.b46.el8.x86_64.rpm 517 kB/s | 164 kB 00:00 2023-07-06T20:00:37.506 INFO:teuthology.orchestra.run.smithi006.stdout:(14/16): ndctl-libs-71.1-3.el8.x86_64.rpm 265 kB/s | 79 kB 00:00 2023-07-06T20:00:37.553 INFO:teuthology.orchestra.run.smithi006.stdout:(15/16): sqlite-3.26.0-16.el8_6.x86_64.rpm 2.4 MB/s | 668 kB 00:00 2023-07-06T20:00:37.685 INFO:teuthology.orchestra.run.smithi006.stdout:(16/16): sqlite-libs-3.26.0-16.el8_6.x86_64.rpm 1.5 MB/s | 581 kB 00:00 2023-07-06T20:00:37.686 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2023-07-06T20:00:37.686 INFO:teuthology.orchestra.run.smithi006.stdout:Total 6.4 MB/s | 12 MB 00:01 2023-07-06T20:00:37.908 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2023-07-06T20:00:37.948 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2023-07-06T20:00:37.949 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2023-07-06T20:00:38.145 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2023-07-06T20:00:38.152 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2023-07-06T20:00:38.915 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2023-07-06T20:00:39.148 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : sqlite-libs-3.26.0-16.el8_6.x86_64 1/18 2023-07-06T20:00:39.375 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : daxctl-libs-71.1-3.el8.x86_64 2/18 2023-07-06T20:00:39.475 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: daxctl-libs-71.1-3.el8.x86_64 2/18 2023-07-06T20:00:39.675 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ndctl-libs-71.1-3.el8.x86_64 3/18 2023-07-06T20:00:39.750 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ndctl-libs-71.1-3.el8.x86_64 3/18 2023-07-06T20:00:39.933 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 4/18 2023-07-06T20:00:40.015 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 4/18 2023-07-06T20:00:40.173 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 5/18 2023-07-06T20:00:40.348 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad 6/18 2023-07-06T20:00:40.631 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module+el8.4.0+ 7/18 2023-07-06T20:00:41.265 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python2-setuptools-39.0.1-13.module+el8.4.0+9442+2 8/18 2023-07-06T20:00:41.516 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9 9/18 2023-07-06T20:00:41.693 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 10/18 2023-07-06T20:00:42.893 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 10/18 2023-07-06T20:00:43.177 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52 11/18 2023-07-06T20:00:43.507 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 12/18 2023-07-06T20:00:43.783 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : fio-3.19-3.el8.x86_64 13/18 2023-07-06T20:00:44.054 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : sqlite-3.26.0-16.el8_6.x86_64 14/18 2023-07-06T20:00:44.226 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+1220 15/18 2023-07-06T20:00:44.442 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : indent-2.2.13-2.el8.x86_64 16/18 2023-07-06T20:00:44.700 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : sqlite-3.26.0-15.el8.x86_64 17/18 2023-07-06T20:00:44.890 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-07-06T20:00:45.193 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-07-06T20:00:45.194 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : indent-2.2.13-2.el8.x86_64 1/18 2023-07-06T20:00:45.194 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module+el8.4.0+ 2/18 2023-07-06T20:00:45.194 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python2-setuptools-39.0.1-13.module+el8.4.0+9442+2 3/18 2023-07-06T20:00:45.194 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+1220 4/18 2023-07-06T20:00:45.194 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : fio-3.19-3.el8.x86_64 5/18 2023-07-06T20:00:45.194 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 6/18 2023-07-06T20:00:45.194 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 7/18 2023-07-06T20:00:45.195 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52 8/18 2023-07-06T20:00:45.195 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9 9/18 2023-07-06T20:00:45.195 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad 10/18 2023-07-06T20:00:45.195 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 11/18 2023-07-06T20:00:45.195 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 12/18 2023-07-06T20:00:45.195 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : daxctl-libs-71.1-3.el8.x86_64 13/18 2023-07-06T20:00:45.195 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ndctl-libs-71.1-3.el8.x86_64 14/18 2023-07-06T20:00:45.195 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : sqlite-3.26.0-16.el8_6.x86_64 15/18 2023-07-06T20:00:45.196 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : sqlite-3.26.0-15.el8.x86_64 16/18 2023-07-06T20:00:45.196 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : sqlite-libs-3.26.0-16.el8_6.x86_64 17/18 2023-07-06T20:00:46.459 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-07-06T20:00:46.459 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:05:12 ago on Thu 06 Jul 2023 07:55:34 PM UTC. 2023-07-06T20:00:49.948 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:00:49.952 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:00:53.969 INFO:teuthology.orchestra.run.smithi006.stdout:Installed products updated. 2023-07-06T20:00:54.181 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:54.182 INFO:teuthology.orchestra.run.smithi006.stdout:Upgraded: 2023-07-06T20:00:54.182 INFO:teuthology.orchestra.run.smithi006.stdout: sqlite-3.26.0-16.el8_6.x86_64 sqlite-libs-3.26.0-16.el8_6.x86_64 2023-07-06T20:00:54.182 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2023-07-06T20:00:54.182 INFO:teuthology.orchestra.run.smithi006.stdout: daxctl-libs-71.1-3.el8.x86_64 2023-07-06T20:00:54.182 INFO:teuthology.orchestra.run.smithi006.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-07-06T20:00:54.182 INFO:teuthology.orchestra.run.smithi006.stdout: fio-3.19-3.el8.x86_64 2023-07-06T20:00:54.182 INFO:teuthology.orchestra.run.smithi006.stdout: indent-2.2.13-2.el8.x86_64 2023-07-06T20:00:54.183 INFO:teuthology.orchestra.run.smithi006.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-07-06T20:00:54.183 INFO:teuthology.orchestra.run.smithi006.stdout: ndctl-libs-71.1-3.el8.x86_64 2023-07-06T20:00:54.183 INFO:teuthology.orchestra.run.smithi006.stdout: python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x86_64 2023-07-06T20:00:54.183 INFO:teuthology.orchestra.run.smithi006.stdout: python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x86_64 2023-07-06T20:00:54.183 INFO:teuthology.orchestra.run.smithi006.stdout: python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9.noarch 2023-07-06T20:00:54.184 INFO:teuthology.orchestra.run.smithi006.stdout: python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad200bd9.noarch 2023-07-06T20:00:54.184 INFO:teuthology.orchestra.run.smithi006.stdout: python2-setuptools-39.0.1-13.module+el8.4.0+9442+27d0e81c.noarch 2023-07-06T20:00:54.185 INFO:teuthology.orchestra.run.smithi006.stdout: python2-setuptools-wheel-39.0.1-13.module+el8.4.0+9442+27d0e81c.noarch 2023-07-06T20:00:54.185 INFO:teuthology.orchestra.run.smithi006.stdout: python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+12203+77770ab7.noarch 2023-07-06T20:00:54.185 INFO:teuthology.orchestra.run.smithi006.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-07-06T20:00:54.185 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:54.185 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2023-07-06T20:00:54.704 DEBUG:teuthology.orchestra.run.smithi006:> sudo useradd -m fsgqa 2023-07-06T20:00:54.734 INFO:teuthology.orchestra.run.smithi006.stderr:useradd: user 'fsgqa' already exists 2023-07-06T20:00:54.735 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-07-06T20:00:54.736 DEBUG:teuthology.orchestra.run.smithi006:> sudo groupadd fsgqa 2023-07-06T20:00:54.807 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-07-06T20:00:54.808 INFO:teuthology.orchestra.run.smithi006.stderr:groupadd: group 'fsgqa' already exists 2023-07-06T20:00:54.808 DEBUG:teuthology.orchestra.run.smithi006:> sudo useradd fsgqa2 2023-07-06T20:00:55.770 DEBUG:teuthology.orchestra.run.smithi006:> sudo useradd 123456-fsgqa 2023-07-06T20:00:56.644 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-07-06T20:00:56.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.793+0000 7f52fa44a700 1 Processor -- start 2023-07-06T20:00:56.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.793+0000 7f52fa44a700 1 -- start start 2023-07-06T20:00:56.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.794+0000 7f52fa44a700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52f406f160 0x7f52f415ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:56.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.794+0000 7f52fa44a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f52f415e2f0 0x7f52f40ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:56.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.794+0000 7f52fa44a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f40cd2f0 con 0x7f52f4157ed0 2023-07-06T20:00:56.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.794+0000 7f52fa44a700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f415e790 con 0x7f52f406f160 2023-07-06T20:00:56.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.794+0000 7f52fa44a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f406e6c0 con 0x7f52f415e2f0 2023-07-06T20:00:56.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.794+0000 7f52f37fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52f406f160 0x7f52f415ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:56.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.794+0000 7f52f37fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f52f406f160 0x7f52f415ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33070/0 (socket says 172.21.15.6:33070) 2023-07-06T20:00:56.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.794+0000 7f52f37fe700 1 -- 172.21.15.6:0/3663254098 learned_addr learned my addr 172.21.15.6:0/3663254098 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:56.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.794+0000 7f52f89e7700 1 --2- 172.21.15.6:0/3663254098 >> v2:172.21.15.40:3300/0 conn(0x7f52f415e2f0 0x7f52f40ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:56.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.795+0000 7f52f37fe700 1 -- 172.21.15.6:0/3663254098 >> v2:172.21.15.40:3300/0 conn(0x7f52f415e2f0 msgr2=0x7f52f40ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:56.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.795+0000 7f52f37fe700 1 --2- 172.21.15.6:0/3663254098 >> v2:172.21.15.40:3300/0 conn(0x7f52f415e2f0 0x7f52f40ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:56.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.795+0000 7f52f37fe700 1 -- 172.21.15.6:0/3663254098 >> v1:172.21.15.40:6789/0 conn(0x7f52f4157ed0 legacy=0x7f52f40ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:56.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.795+0000 7f52f37fe700 1 -- 172.21.15.6:0/3663254098 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f40cb080 con 0x7f52f406f160 2023-07-06T20:00:56.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.795+0000 7f52f37fe700 1 --2- 172.21.15.6:0/3663254098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f406f160 0x7f52f415ddb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f52f40afd30 tx=0x7f52e4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422f2fc5c7172a13 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:56.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.795+0000 7f52f2ffd700 1 -- 172.21.15.6:0/3663254098 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4004230 con 0x7f52f406f160 2023-07-06T20:00:56.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.795+0000 7f52f2ffd700 1 -- 172.21.15.6:0/3663254098 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e4004390 con 0x7f52f406f160 2023-07-06T20:00:56.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.795+0000 7f52f2ffd700 1 -- 172.21.15.6:0/3663254098 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e40036a0 con 0x7f52f406f160 2023-07-06T20:00:56.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.795+0000 7f52fa44a700 1 -- 172.21.15.6:0/3663254098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f406f160 msgr2=0x7f52f415ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.795+0000 7f52fa44a700 1 --2- 172.21.15.6:0/3663254098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f406f160 0x7f52f415ddb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f52f40afd30 tx=0x7f52e4009bd0 comp rx=0 tx=0).stop 2023-07-06T20:00:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.795+0000 7f52fa44a700 1 -- 172.21.15.6:0/3663254098 shutdown_connections 2023-07-06T20:00:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.795+0000 7f52fa44a700 1 --2- 172.21.15.6:0/3663254098 >> v2:172.21.15.40:3300/0 conn(0x7f52f415e2f0 0x7f52f40ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.795+0000 7f52fa44a700 1 --2- 172.21.15.6:0/3663254098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f406f160 0x7f52f415ddb0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.795+0000 7f52fa44a700 1 -- 172.21.15.6:0/3663254098 >> 172.21.15.6:0/3663254098 conn(0x7f52f40d0a30 msgr2=0x7f52f40d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.796+0000 7f52fa44a700 1 -- 172.21.15.6:0/3663254098 shutdown_connections 2023-07-06T20:00:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.796+0000 7f52fa44a700 1 -- 172.21.15.6:0/3663254098 wait complete. 2023-07-06T20:00:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.797+0000 7f52fa44a700 1 Processor -- start 2023-07-06T20:00:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.797+0000 7f52fa44a700 1 -- start start 2023-07-06T20:00:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.798+0000 7f52fa44a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52f406f160 0x7f52f40c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.798+0000 7f52fa44a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f4157ed0 0x7f52f41591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.798+0000 7f52fa44a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52f415e2f0 0x7f52f4159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.798+0000 7f52fa44a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f40b6820 con 0x7f52f4157ed0 2023-07-06T20:00:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.798+0000 7f52fa44a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f4145a50 con 0x7f52f406f160 2023-07-06T20:00:56.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.798+0000 7f52fa44a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f41439e0 con 0x7f52f415e2f0 2023-07-06T20:00:56.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.798+0000 7f52f37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f4157ed0 0x7f52f41591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:56.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.798+0000 7f52f37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f4157ed0 0x7f52f41591c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33076/0 (socket says 172.21.15.6:33076) 2023-07-06T20:00:56.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.798+0000 7f52f37fe700 1 -- 172.21.15.6:0/4153881832 learned_addr learned my addr 172.21.15.6:0/4153881832 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:56.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.798+0000 7f52f3fff700 1 --2- 172.21.15.6:0/4153881832 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52f406f160 0x7f52f40c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:56.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.798+0000 7f52f89e7700 1 --2- 172.21.15.6:0/4153881832 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52f415e2f0 0x7f52f4159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:56.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.798+0000 7f52f37fe700 1 -- 172.21.15.6:0/4153881832 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52f415e2f0 msgr2=0x7f52f4159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:56.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.798+0000 7f52f37fe700 1 --2- 172.21.15.6:0/4153881832 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52f415e2f0 0x7f52f4159700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:56.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.798+0000 7f52f37fe700 1 -- 172.21.15.6:0/4153881832 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52f406f160 msgr2=0x7f52f40c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:56.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.798+0000 7f52f37fe700 1 --2- 172.21.15.6:0/4153881832 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52f406f160 0x7f52f40c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:56.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.798+0000 7f52f37fe700 1 -- 172.21.15.6:0/4153881832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e4009550 con 0x7f52f4157ed0 2023-07-06T20:00:56.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.798+0000 7f52f89e7700 1 --2- 172.21.15.6:0/4153881832 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52f415e2f0 0x7f52f4159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-06T20:00:56.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.798+0000 7f52f37fe700 1 --2- 172.21.15.6:0/4153881832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f4157ed0 0x7f52f41591c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f52e4009c10 tx=0x7f52e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:56.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.798+0000 7f52f0ff9700 1 -- 172.21.15.6:0/4153881832 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4003ea0 con 0x7f52f4157ed0 2023-07-06T20:00:56.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.798+0000 7f52f0ff9700 1 -- 172.21.15.6:0/4153881832 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e4011630 con 0x7f52f4157ed0 2023-07-06T20:00:56.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.798+0000 7f52fa44a700 1 -- 172.21.15.6:0/4153881832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f4143cc0 con 0x7f52f4157ed0 2023-07-06T20:00:56.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.799+0000 7f52f0ff9700 1 -- 172.21.15.6:0/4153881832 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e40119a0 con 0x7f52f4157ed0 2023-07-06T20:00:56.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.799+0000 7f52fa44a700 1 -- 172.21.15.6:0/4153881832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f4144280 con 0x7f52f4157ed0 2023-07-06T20:00:56.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.800+0000 7f52fa44a700 1 -- 172.21.15.6:0/4153881832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f406a810 con 0x7f52f4157ed0 2023-07-06T20:00:56.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.800+0000 7f52f0ff9700 1 -- 172.21.15.6:0/4153881832 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f52e4011b00 con 0x7f52f4157ed0 2023-07-06T20:00:56.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.800+0000 7f52f0ff9700 1 --2- 172.21.15.6:0/4153881832 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f52e006ace0 0x7f52e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:56.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.800+0000 7f52f0ff9700 1 -- 172.21.15.6:0/4153881832 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f52e408ab90 con 0x7f52f4157ed0 2023-07-06T20:00:56.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.800+0000 7f52f3fff700 1 --2- 172.21.15.6:0/4153881832 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f52e006ace0 0x7f52e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:56.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.801+0000 7f52f3fff700 1 --2- 172.21.15.6:0/4153881832 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f52e006ace0 0x7f52e006d190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f52e8007fd0 tx=0x7f52e8007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:56.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:56.805+0000 7f52f0ff9700 1 -- 172.21.15.6:0/4153881832 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f52e4055b70 con 0x7f52f4157ed0 2023-07-06T20:00:57.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.086+0000 7f52fa44a700 1 -- 172.21.15.6:0/4153881832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f52f40b69b0 con 0x7f52f4157ed0 2023-07-06T20:00:57.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.086+0000 7f52f0ff9700 1 -- 172.21.15.6:0/4153881832 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1264 (secure 0 0 0) 0x7f52e401f500 con 0x7f52f4157ed0 2023-07-06T20:00:57.088 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:00:57.088 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":1,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","modified":"2023-07-06T19:57:51.689274Z","created":"2023-07-06T19:57:51.689274Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3300","nonce":0},{"type":"v1","addr":"172.21.15.40:6789","nonce":0}]},"addr":"172.21.15.40:6789/0","public_addr":"172.21.15.40:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:3301","nonce":0},{"type":"v1","addr":"172.21.15.40:6790","nonce":0}]},"addr":"172.21.15.40:6790/0","public_addr":"172.21.15.40:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-07-06T20:00:57.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.088+0000 7f52fa44a700 1 -- 172.21.15.6:0/4153881832 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f52e006ace0 msgr2=0x7f52e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:57.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.088+0000 7f52fa44a700 1 --2- 172.21.15.6:0/4153881832 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f52e006ace0 0x7f52e006d190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f52e8007fd0 tx=0x7f52e8007ec0 comp rx=0 tx=0).stop 2023-07-06T20:00:57.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.088+0000 7f52fa44a700 1 -- 172.21.15.6:0/4153881832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f4157ed0 msgr2=0x7f52f41591c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:57.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.088+0000 7f52fa44a700 1 --2- 172.21.15.6:0/4153881832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f4157ed0 0x7f52f41591c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f52e4009c10 tx=0x7f52e4004750 comp rx=0 tx=0).stop 2023-07-06T20:00:57.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.088+0000 7f52fa44a700 1 -- 172.21.15.6:0/4153881832 shutdown_connections 2023-07-06T20:00:57.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.088+0000 7f52fa44a700 1 --2- 172.21.15.6:0/4153881832 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f52e006ace0 0x7f52e006d190 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:57.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.088+0000 7f52fa44a700 1 --2- 172.21.15.6:0/4153881832 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52f415e2f0 0x7f52f4159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:57.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.088+0000 7f52fa44a700 1 --2- 172.21.15.6:0/4153881832 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f52f406f160 0x7f52f40c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:57.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.088+0000 7f52fa44a700 1 --2- 172.21.15.6:0/4153881832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52f4157ed0 0x7f52f41591c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:57.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.088+0000 7f52fa44a700 1 -- 172.21.15.6:0/4153881832 >> 172.21.15.6:0/4153881832 conn(0x7f52f40d0a30 msgr2=0x7f52f40cff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:57.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.088+0000 7f52fa44a700 1 -- 172.21.15.6:0/4153881832 shutdown_connections 2023-07-06T20:00:57.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.088+0000 7f52fa44a700 1 -- 172.21.15.6:0/4153881832 wait complete. 2023-07-06T20:00:57.091 INFO:teuthology.orchestra.run.smithi006.stderr:dumped monmap epoch 1 2023-07-06T20:00:57.104 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-07-06T20:00:57.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.250+0000 7f5220caf700 1 Processor -- start 2023-07-06T20:00:57.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.250+0000 7f5220caf700 1 -- start start 2023-07-06T20:00:57.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.251+0000 7f5220caf700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f521c0cd9d0 0x7f521c15cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:57.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.251+0000 7f5220caf700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f521c0d0c00 0x7f521c06a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:57.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.251+0000 7f5220caf700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f521c0d11c0 con 0x7f521c0b21c0 2023-07-06T20:00:57.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.251+0000 7f5220caf700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f521c0d14a0 con 0x7f521c0d0c00 2023-07-06T20:00:57.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.251+0000 7f5220caf700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f521c0d1780 con 0x7f521c0cd9d0 2023-07-06T20:00:57.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.251+0000 7f521ad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f521c0d0c00 0x7f521c06a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:57.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.251+0000 7f521ad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f521c0d0c00 0x7f521c06a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33086/0 (socket says 172.21.15.6:33086) 2023-07-06T20:00:57.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.251+0000 7f521ad9d700 1 -- 172.21.15.6:0/1400014392 learned_addr learned my addr 172.21.15.6:0/1400014392 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:57.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.251+0000 7f5219d9b700 1 --2- 172.21.15.6:0/1400014392 >> v2:172.21.15.40:3300/0 conn(0x7f521c0cd9d0 0x7f521c15cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:57.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.252+0000 7f521ad9d700 1 -- 172.21.15.6:0/1400014392 >> v2:172.21.15.40:3300/0 conn(0x7f521c0cd9d0 msgr2=0x7f521c15cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:57.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.252+0000 7f521ad9d700 1 --2- 172.21.15.6:0/1400014392 >> v2:172.21.15.40:3300/0 conn(0x7f521c0cd9d0 0x7f521c15cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:57.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.252+0000 7f521ad9d700 1 -- 172.21.15.6:0/1400014392 >> v1:172.21.15.40:6789/0 conn(0x7f521c0b21c0 legacy=0x7f521c0cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-06T20:00:57.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.252+0000 7f521ad9d700 1 -- 172.21.15.6:0/1400014392 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c0d1a60 con 0x7f521c0d0c00 2023-07-06T20:00:57.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.252+0000 7f521ad9d700 1 --2- 172.21.15.6:0/1400014392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f521c0d0c00 0x7f521c06a0d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f521c0cdda0 tx=0x7f521400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4edf0162ea2ef11 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:57.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.252+0000 7f521959a700 1 -- 172.21.15.6:0/1400014392 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521400e070 con 0x7f521c0d0c00 2023-07-06T20:00:57.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.252+0000 7f521959a700 1 -- 172.21.15.6:0/1400014392 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5214003a20 con 0x7f521c0d0c00 2023-07-06T20:00:57.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.252+0000 7f521959a700 1 -- 172.21.15.6:0/1400014392 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5214003dd0 con 0x7f521c0d0c00 2023-07-06T20:00:57.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.252+0000 7f5220caf700 1 -- 172.21.15.6:0/1400014392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f521c0d0c00 msgr2=0x7f521c06a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:57.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.252+0000 7f5220caf700 1 --2- 172.21.15.6:0/1400014392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f521c0d0c00 0x7f521c06a0d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f521c0cdda0 tx=0x7f521400b330 comp rx=0 tx=0).stop 2023-07-06T20:00:57.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.253+0000 7f5220caf700 1 -- 172.21.15.6:0/1400014392 shutdown_connections 2023-07-06T20:00:57.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.253+0000 7f5220caf700 1 --2- 172.21.15.6:0/1400014392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f521c0d0c00 0x7f521c06a0d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:57.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.253+0000 7f5220caf700 1 --2- 172.21.15.6:0/1400014392 >> v2:172.21.15.40:3300/0 conn(0x7f521c0cd9d0 0x7f521c15cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:57.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.253+0000 7f5220caf700 1 -- 172.21.15.6:0/1400014392 >> 172.21.15.6:0/1400014392 conn(0x7f521c0d3900 msgr2=0x7f521c0b4760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:57.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.253+0000 7f5220caf700 1 -- 172.21.15.6:0/1400014392 shutdown_connections 2023-07-06T20:00:57.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.253+0000 7f5220caf700 1 -- 172.21.15.6:0/1400014392 wait complete. 2023-07-06T20:00:57.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.254+0000 7f5220caf700 1 Processor -- start 2023-07-06T20:00:57.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.254+0000 7f5220caf700 1 -- start start 2023-07-06T20:00:57.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.255+0000 7f5220caf700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f521c0b21c0 0x7f521c14d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:57.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.255+0000 7f5220caf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f521c0cd9d0 0x7f521c1e69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:57.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.255+0000 7f5220caf700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f521c0d0c00 0x7f521c15ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:57.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.255+0000 7f5220caf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521c1e7370 con 0x7f521c0cd9d0 2023-07-06T20:00:57.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.255+0000 7f5220caf700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521c14d640 con 0x7f521c0b21c0 2023-07-06T20:00:57.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.255+0000 7f5220caf700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521c0b6be0 con 0x7f521c0d0c00 2023-07-06T20:00:57.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.255+0000 7f5219d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f521c0cd9d0 0x7f521c1e69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:57.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.255+0000 7f5219d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f521c0cd9d0 0x7f521c1e69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33090/0 (socket says 172.21.15.6:33090) 2023-07-06T20:00:57.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.255+0000 7f5219d9b700 1 -- 172.21.15.6:0/2649206504 learned_addr learned my addr 172.21.15.6:0/2649206504 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-06T20:00:57.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.255+0000 7f521a59c700 1 --2- 172.21.15.6:0/2649206504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f521c0b21c0 0x7f521c14d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:57.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.255+0000 7f521ad9d700 1 --2- 172.21.15.6:0/2649206504 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f521c0d0c00 0x7f521c15ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:57.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.255+0000 7f5219d9b700 1 -- 172.21.15.6:0/2649206504 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f521c0d0c00 msgr2=0x7f521c15ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:57.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.255+0000 7f5219d9b700 1 --2- 172.21.15.6:0/2649206504 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f521c0d0c00 0x7f521c15ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:57.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.255+0000 7f5219d9b700 1 -- 172.21.15.6:0/2649206504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f521c0b21c0 msgr2=0x7f521c14d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:57.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.255+0000 7f5219d9b700 1 --2- 172.21.15.6:0/2649206504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f521c0b21c0 0x7f521c14d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:57.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.255+0000 7f5219d9b700 1 -- 172.21.15.6:0/2649206504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5214009b30 con 0x7f521c0cd9d0 2023-07-06T20:00:57.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.255+0000 7f5219d9b700 1 --2- 172.21.15.6:0/2649206504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f521c0cd9d0 0x7f521c1e69b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f521000e7e0 tx=0x7f521000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:57.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.256+0000 7f520affd700 1 -- 172.21.15.6:0/2649206504 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f521000c070 con 0x7f521c0cd9d0 2023-07-06T20:00:57.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.256+0000 7f520affd700 1 -- 172.21.15.6:0/2649206504 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5210013630 con 0x7f521c0cd9d0 2023-07-06T20:00:57.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.256+0000 7f5220caf700 1 -- 172.21.15.6:0/2649206504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f521c0b6ec0 con 0x7f521c0cd9d0 2023-07-06T20:00:57.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.256+0000 7f520affd700 1 -- 172.21.15.6:0/2649206504 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52100139e0 con 0x7f521c0cd9d0 2023-07-06T20:00:57.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.256+0000 7f5220caf700 1 -- 172.21.15.6:0/2649206504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f521c0b7480 con 0x7f521c0cd9d0 2023-07-06T20:00:57.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.257+0000 7f5220caf700 1 -- 172.21.15.6:0/2649206504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f521c0ce380 con 0x7f521c0cd9d0 2023-07-06T20:00:57.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.257+0000 7f520affd700 1 -- 172.21.15.6:0/2649206504 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5210013b40 con 0x7f521c0cd9d0 2023-07-06T20:00:57.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.258+0000 7f520affd700 1 --2- 172.21.15.6:0/2649206504 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f51fc06ace0 0x7f51fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-06T20:00:57.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.258+0000 7f520affd700 1 -- 172.21.15.6:0/2649206504 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f5210089000 con 0x7f521c0cd9d0 2023-07-06T20:00:57.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.258+0000 7f521a59c700 1 --2- 172.21.15.6:0/2649206504 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f51fc06ace0 0x7f51fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-06T20:00:57.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.258+0000 7f521a59c700 1 --2- 172.21.15.6:0/2649206504 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f51fc06ace0 0x7f51fc06d190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f520c007fd0 tx=0x7f520c007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-06T20:00:57.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.266+0000 7f520affd700 1 -- 172.21.15.6:0/2649206504 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5210053f40 con 0x7f521c0cd9d0 2023-07-06T20:00:57.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.545+0000 7f5220caf700 1 -- 172.21.15.6:0/2649206504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f521c04eb90 con 0x7f521c0cd9d0 2023-07-06T20:00:57.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.546+0000 7f520affd700 1 -- 172.21.15.6:0/2649206504 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7f5210057560 con 0x7f521c0cd9d0 2023-07-06T20:00:57.547 INFO:teuthology.orchestra.run.smithi006.stdout:[client.admin] 2023-07-06T20:00:57.548 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== 2023-07-06T20:00:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.548+0000 7f5220caf700 1 -- 172.21.15.6:0/2649206504 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f51fc06ace0 msgr2=0x7f51fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.548+0000 7f5220caf700 1 --2- 172.21.15.6:0/2649206504 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f51fc06ace0 0x7f51fc06d190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f520c007fd0 tx=0x7f520c007ec0 comp rx=0 tx=0).stop 2023-07-06T20:00:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.548+0000 7f5220caf700 1 -- 172.21.15.6:0/2649206504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f521c0cd9d0 msgr2=0x7f521c1e69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-06T20:00:57.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.548+0000 7f5220caf700 1 --2- 172.21.15.6:0/2649206504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f521c0cd9d0 0x7f521c1e69b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f521000e7e0 tx=0x7f521000eaf0 comp rx=0 tx=0).stop 2023-07-06T20:00:57.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.548+0000 7f5220caf700 1 -- 172.21.15.6:0/2649206504 shutdown_connections 2023-07-06T20:00:57.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.548+0000 7f5220caf700 1 --2- 172.21.15.6:0/2649206504 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f51fc06ace0 0x7f51fc06d190 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:57.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.548+0000 7f5220caf700 1 --2- 172.21.15.6:0/2649206504 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f521c0d0c00 0x7f521c15ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:57.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.548+0000 7f5220caf700 1 --2- 172.21.15.6:0/2649206504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f521c0b21c0 0x7f521c14d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:57.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.548+0000 7f5220caf700 1 --2- 172.21.15.6:0/2649206504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f521c0cd9d0 0x7f521c1e69b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-06T20:00:57.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.548+0000 7f5220caf700 1 -- 172.21.15.6:0/2649206504 >> 172.21.15.6:0/2649206504 conn(0x7f521c0d3900 msgr2=0x7f521c0b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-06T20:00:57.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.548+0000 7f5220caf700 1 -- 172.21.15.6:0/2649206504 shutdown_connections 2023-07-06T20:00:57.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-06T20:00:57.548+0000 7f5220caf700 1 -- 172.21.15.6:0/2649206504 wait complete. 2023-07-06T20:00:57.563 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T20:00:57.563 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/tmp/tmp.LybHGoQKZdxfstests-dev/local.config 2023-07-06T20:00:57.657 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.6:6789:/test export TEST_DIR=/tmp/tmp.FMWA5cKBX8test export SCRATCH_DEV=172.21.15.6:6789:/scratch export SCRATCH_MNT=/tmp/tmp.EQx4TaXM2Pscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g==" 2023-07-06T20:00:57.657 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-06T20:00:57.658 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/tmp/tmp.LybHGoQKZdxfstests-dev/ceph.exclude 2023-07-06T20:00:57.724 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo make) 2023-07-06T20:00:57.803 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize -cfi 2023-07-06T20:00:58.157 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize: putting auxiliary files in '.'. 2023-07-06T20:00:58.158 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize: copying file './config.guess' 2023-07-06T20:00:58.162 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize: copying file './config.sub' 2023-07-06T20:00:58.164 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize: copying file './install-sh' 2023-07-06T20:00:58.173 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize: copying file './ltmain.sh' 2023-07-06T20:00:58.189 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-07-06T20:00:58.190 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-07-06T20:00:58.206 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-07-06T20:00:58.206 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-07-06T20:00:58.207 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-07-06T20:00:58.207 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-07-06T20:00:58.213 INFO:teuthology.orchestra.run.smithi006.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-07-06T20:00:58.214 INFO:teuthology.orchestra.run.smithi006.stdout:cp include/install-sh . 2023-07-06T20:00:58.219 INFO:teuthology.orchestra.run.smithi006.stdout:aclocal -I m4 2023-07-06T20:00:59.396 INFO:teuthology.orchestra.run.smithi006.stdout:autoheader 2023-07-06T20:00:59.733 INFO:teuthology.orchestra.run.smithi006.stdout:autoconf 2023-07-06T20:00:59.901 INFO:teuthology.orchestra.run.smithi006.stdout:./configure \ 2023-07-06T20:00:59.901 INFO:teuthology.orchestra.run.smithi006.stdout: --libexecdir=/usr/lib \ 2023-07-06T20:00:59.901 INFO:teuthology.orchestra.run.smithi006.stdout: --exec_prefix=/var/lib 2023-07-06T20:01:00.353 INFO:teuthology.orchestra.run.smithi006.stdout:checking build system type... x86_64-pc-linux-gnu 2023-07-06T20:01:00.353 INFO:teuthology.orchestra.run.smithi006.stdout:checking host system type... x86_64-pc-linux-gnu 2023-07-06T20:01:00.353 INFO:teuthology.orchestra.run.smithi006.stdout:checking how to print strings... printf 2023-07-06T20:01:00.353 INFO:teuthology.orchestra.run.smithi006.stdout:checking for gcc... gcc 2023-07-06T20:01:00.609 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether the C compiler works... yes 2023-07-06T20:01:00.610 INFO:teuthology.orchestra.run.smithi006.stdout:checking for C compiler default output file name... a.out 2023-07-06T20:01:00.641 INFO:teuthology.orchestra.run.smithi006.stdout:checking for suffix of executables... 2023-07-06T20:01:00.704 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether we are cross compiling... no 2023-07-06T20:01:00.723 INFO:teuthology.orchestra.run.smithi006.stdout:checking for suffix of object files... o 2023-07-06T20:01:00.740 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether we are using the GNU C compiler... yes 2023-07-06T20:01:00.758 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether gcc accepts -g... yes 2023-07-06T20:01:00.786 INFO:teuthology.orchestra.run.smithi006.stdout:checking for gcc option to accept ISO C89... none needed 2023-07-06T20:01:00.789 INFO:teuthology.orchestra.run.smithi006.stdout:checking for a sed that does not truncate output... /bin/sed 2023-07-06T20:01:00.791 INFO:teuthology.orchestra.run.smithi006.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-07-06T20:01:00.792 INFO:teuthology.orchestra.run.smithi006.stdout:checking for egrep... /bin/grep -E 2023-07-06T20:01:00.793 INFO:teuthology.orchestra.run.smithi006.stdout:checking for fgrep... /bin/grep -F 2023-07-06T20:01:00.800 INFO:teuthology.orchestra.run.smithi006.stdout:checking for ld used by gcc... /bin/ld 2023-07-06T20:01:00.800 INFO:teuthology.orchestra.run.smithi006.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-07-06T20:01:00.803 INFO:teuthology.orchestra.run.smithi006.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-07-06T20:01:00.821 INFO:teuthology.orchestra.run.smithi006.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-07-06T20:01:00.821 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether ln -s works... yes 2023-07-06T20:01:00.825 INFO:teuthology.orchestra.run.smithi006.stdout:checking the maximum length of command line arguments... 1572864 2023-07-06T20:01:00.827 INFO:teuthology.orchestra.run.smithi006.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-07-06T20:01:00.827 INFO:teuthology.orchestra.run.smithi006.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-07-06T20:01:00.827 INFO:teuthology.orchestra.run.smithi006.stdout:checking for /bin/ld option to reload object files... -r 2023-07-06T20:01:00.828 INFO:teuthology.orchestra.run.smithi006.stdout:checking for objdump... objdump 2023-07-06T20:01:00.828 INFO:teuthology.orchestra.run.smithi006.stdout:checking how to recognize dependent libraries... pass_all 2023-07-06T20:01:00.829 INFO:teuthology.orchestra.run.smithi006.stdout:checking for dlltool... no 2023-07-06T20:01:00.829 INFO:teuthology.orchestra.run.smithi006.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-07-06T20:01:00.829 INFO:teuthology.orchestra.run.smithi006.stdout:checking for ar... ar 2023-07-06T20:01:00.856 INFO:teuthology.orchestra.run.smithi006.stdout:checking for archiver @FILE support... @ 2023-07-06T20:01:00.856 INFO:teuthology.orchestra.run.smithi006.stdout:checking for strip... strip 2023-07-06T20:01:00.856 INFO:teuthology.orchestra.run.smithi006.stdout:checking for ranlib... ranlib 2023-07-06T20:01:00.857 INFO:teuthology.orchestra.run.smithi006.stdout:checking for gawk... gawk 2023-07-06T20:01:00.908 INFO:teuthology.orchestra.run.smithi006.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-07-06T20:01:00.909 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sysroot... no 2023-07-06T20:01:00.912 INFO:teuthology.orchestra.run.smithi006.stdout:checking for a working dd... /bin/dd 2023-07-06T20:01:00.915 INFO:teuthology.orchestra.run.smithi006.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-07-06T20:01:00.928 INFO:teuthology.orchestra.run.smithi006.stdout:checking for mt... no 2023-07-06T20:01:00.931 INFO:teuthology.orchestra.run.smithi006.stdout:checking if : is a manifest tool... no 2023-07-06T20:01:00.981 INFO:teuthology.orchestra.run.smithi006.stdout:checking how to run the C preprocessor... gcc -E 2023-07-06T20:01:01.103 INFO:teuthology.orchestra.run.smithi006.stdout:checking for ANSI C header files... yes 2023-07-06T20:01:01.123 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/types.h... yes 2023-07-06T20:01:01.152 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/stat.h... yes 2023-07-06T20:01:01.175 INFO:teuthology.orchestra.run.smithi006.stdout:checking for stdlib.h... yes 2023-07-06T20:01:01.200 INFO:teuthology.orchestra.run.smithi006.stdout:checking for string.h... yes 2023-07-06T20:01:01.225 INFO:teuthology.orchestra.run.smithi006.stdout:checking for memory.h... yes 2023-07-06T20:01:01.249 INFO:teuthology.orchestra.run.smithi006.stdout:checking for strings.h... yes 2023-07-06T20:01:01.277 INFO:teuthology.orchestra.run.smithi006.stdout:checking for inttypes.h... yes 2023-07-06T20:01:01.302 INFO:teuthology.orchestra.run.smithi006.stdout:checking for stdint.h... yes 2023-07-06T20:01:01.350 INFO:teuthology.orchestra.run.smithi006.stdout:checking for unistd.h... yes 2023-07-06T20:01:01.380 INFO:teuthology.orchestra.run.smithi006.stdout:checking for dlfcn.h... yes 2023-07-06T20:01:01.381 INFO:teuthology.orchestra.run.smithi006.stdout:checking for objdir... .libs 2023-07-06T20:01:01.448 INFO:teuthology.orchestra.run.smithi006.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-07-06T20:01:01.448 INFO:teuthology.orchestra.run.smithi006.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-07-06T20:01:01.464 INFO:teuthology.orchestra.run.smithi006.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-07-06T20:01:01.484 INFO:teuthology.orchestra.run.smithi006.stdout:checking if gcc static flag -static works... no 2023-07-06T20:01:01.504 INFO:teuthology.orchestra.run.smithi006.stdout:checking if gcc supports -c -o file.o... yes 2023-07-06T20:01:01.505 INFO:teuthology.orchestra.run.smithi006.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-07-06T20:01:01.510 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-07-06T20:01:01.536 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether -lc should be explicitly linked in... no 2023-07-06T20:01:01.579 INFO:teuthology.orchestra.run.smithi006.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-07-06T20:01:01.579 INFO:teuthology.orchestra.run.smithi006.stdout:checking how to hardcode library paths into programs... immediate 2023-07-06T20:01:01.591 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether stripping libraries is possible... yes 2023-07-06T20:01:01.591 INFO:teuthology.orchestra.run.smithi006.stdout:checking if libtool supports shared libraries... yes 2023-07-06T20:01:01.591 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether to build shared libraries... yes 2023-07-06T20:01:01.592 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether to build static libraries... yes 2023-07-06T20:01:01.597 INFO:teuthology.orchestra.run.smithi006.stdout:checking for gcc... (cached) gcc 2023-07-06T20:01:01.612 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-07-06T20:01:01.613 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether gcc accepts -g... (cached) yes 2023-07-06T20:01:01.613 INFO:teuthology.orchestra.run.smithi006.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-07-06T20:01:01.613 INFO:teuthology.orchestra.run.smithi006.stdout:checking for gmake... /usr/bin/gmake 2023-07-06T20:01:01.614 INFO:teuthology.orchestra.run.smithi006.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-07-06T20:01:01.617 INFO:teuthology.orchestra.run.smithi006.stdout:checking for tar... /bin/tar 2023-07-06T20:01:01.617 INFO:teuthology.orchestra.run.smithi006.stdout:checking for gzip... /bin/gzip 2023-07-06T20:01:01.622 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether gcc -MM is supported... yes 2023-07-06T20:01:01.622 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sort... /bin/sort 2023-07-06T20:01:01.623 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether ln -s works... yes 2023-07-06T20:01:01.623 INFO:teuthology.orchestra.run.smithi006.stdout:checking for rpm... /bin/rpm 2023-07-06T20:01:01.625 INFO:teuthology.orchestra.run.smithi006.stdout:checking for rpmbuild... no 2023-07-06T20:01:01.660 INFO:teuthology.orchestra.run.smithi006.stdout:checking assert.h usability... yes 2023-07-06T20:01:01.667 INFO:teuthology.orchestra.run.smithi006.stdout:checking assert.h presence... yes 2023-07-06T20:01:01.667 INFO:teuthology.orchestra.run.smithi006.stdout:checking for assert.h... yes 2023-07-06T20:01:01.696 INFO:teuthology.orchestra.run.smithi006.stdout:checking bstring.h usability... no 2023-07-06T20:01:01.702 INFO:teuthology.orchestra.run.smithi006.stdout:checking bstring.h presence... no 2023-07-06T20:01:01.703 INFO:teuthology.orchestra.run.smithi006.stdout:checking for bstring.h... no 2023-07-06T20:01:01.729 INFO:teuthology.orchestra.run.smithi006.stdout:checking libgen.h usability... yes 2023-07-06T20:01:01.734 INFO:teuthology.orchestra.run.smithi006.stdout:checking libgen.h presence... yes 2023-07-06T20:01:01.735 INFO:teuthology.orchestra.run.smithi006.stdout:checking for libgen.h... yes 2023-07-06T20:01:01.763 INFO:teuthology.orchestra.run.smithi006.stdout:checking dirent.h usability... yes 2023-07-06T20:01:01.770 INFO:teuthology.orchestra.run.smithi006.stdout:checking dirent.h presence... yes 2023-07-06T20:01:01.770 INFO:teuthology.orchestra.run.smithi006.stdout:checking for dirent.h... yes 2023-07-06T20:01:01.817 INFO:teuthology.orchestra.run.smithi006.stdout:checking errno.h usability... yes 2023-07-06T20:01:01.824 INFO:teuthology.orchestra.run.smithi006.stdout:checking errno.h presence... yes 2023-07-06T20:01:01.825 INFO:teuthology.orchestra.run.smithi006.stdout:checking for errno.h... yes 2023-07-06T20:01:01.852 INFO:teuthology.orchestra.run.smithi006.stdout:checking malloc.h usability... yes 2023-07-06T20:01:01.860 INFO:teuthology.orchestra.run.smithi006.stdout:checking malloc.h presence... yes 2023-07-06T20:01:01.860 INFO:teuthology.orchestra.run.smithi006.stdout:checking for malloc.h... yes 2023-07-06T20:01:01.886 INFO:teuthology.orchestra.run.smithi006.stdout:checking uuid.h usability... no 2023-07-06T20:01:01.896 INFO:teuthology.orchestra.run.smithi006.stdout:checking uuid.h presence... no 2023-07-06T20:01:01.897 INFO:teuthology.orchestra.run.smithi006.stdout:checking for uuid.h... no 2023-07-06T20:01:01.923 INFO:teuthology.orchestra.run.smithi006.stdout:checking uuid/uuid.h usability... yes 2023-07-06T20:01:01.933 INFO:teuthology.orchestra.run.smithi006.stdout:checking uuid/uuid.h presence... yes 2023-07-06T20:01:01.933 INFO:teuthology.orchestra.run.smithi006.stdout:checking for uuid/uuid.h... yes 2023-07-06T20:01:01.960 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/uuid.h usability... no 2023-07-06T20:01:01.972 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/uuid.h presence... no 2023-07-06T20:01:01.973 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/uuid.h... no 2023-07-06T20:01:02.004 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/file.h usability... yes 2023-07-06T20:01:02.011 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/file.h presence... yes 2023-07-06T20:01:02.012 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/file.h... yes 2023-07-06T20:01:02.040 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/fcntl.h usability... yes 2023-07-06T20:01:02.049 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/fcntl.h presence... yes 2023-07-06T20:01:02.049 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/fcntl.h... yes 2023-07-06T20:01:02.073 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/syssgi.h usability... no 2023-07-06T20:01:02.084 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/syssgi.h presence... no 2023-07-06T20:01:02.084 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/syssgi.h... no 2023-07-06T20:01:02.126 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/param.h usability... yes 2023-07-06T20:01:02.137 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/param.h presence... yes 2023-07-06T20:01:02.137 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/param.h... yes 2023-07-06T20:01:02.142 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/stat.h... (cached) yes 2023-07-06T20:01:02.170 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/statvfs.h usability... yes 2023-07-06T20:01:02.176 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/statvfs.h presence... yes 2023-07-06T20:01:02.177 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/statvfs.h... yes 2023-07-06T20:01:02.204 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/time.h usability... yes 2023-07-06T20:01:02.211 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/time.h presence... yes 2023-07-06T20:01:02.212 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/time.h... yes 2023-07-06T20:01:02.250 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/ioctl.h usability... yes 2023-07-06T20:01:02.259 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/ioctl.h presence... yes 2023-07-06T20:01:02.260 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/ioctl.h... yes 2023-07-06T20:01:02.295 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/wait.h usability... yes 2023-07-06T20:01:02.304 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/wait.h presence... yes 2023-07-06T20:01:02.305 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/wait.h... yes 2023-07-06T20:01:02.309 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/types.h... (cached) yes 2023-07-06T20:01:02.314 INFO:teuthology.orchestra.run.smithi006.stdout:checking for strings.h... (cached) yes 2023-07-06T20:01:02.341 INFO:teuthology.orchestra.run.smithi006.stdout:checking err.h usability... yes 2023-07-06T20:01:02.351 INFO:teuthology.orchestra.run.smithi006.stdout:checking err.h presence... yes 2023-07-06T20:01:02.351 INFO:teuthology.orchestra.run.smithi006.stdout:checking for err.h... yes 2023-07-06T20:01:02.376 INFO:teuthology.orchestra.run.smithi006.stdout:checking linux/falloc.h usability... yes 2023-07-06T20:01:02.383 INFO:teuthology.orchestra.run.smithi006.stdout:checking linux/falloc.h presence... yes 2023-07-06T20:01:02.383 INFO:teuthology.orchestra.run.smithi006.stdout:checking for linux/falloc.h... yes 2023-07-06T20:01:02.409 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-07-06T20:01:02.418 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-07-06T20:01:02.418 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/fs/xfs_fsops.h... no 2023-07-06T20:01:02.441 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/fs/xfs_itable.h usability... no 2023-07-06T20:01:02.452 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/fs/xfs_itable.h presence... no 2023-07-06T20:01:02.452 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/fs/xfs_itable.h... no 2023-07-06T20:01:02.475 INFO:teuthology.orchestra.run.smithi006.stdout:checking xfs/platform_defs.h usability... no 2023-07-06T20:01:02.484 INFO:teuthology.orchestra.run.smithi006.stdout:checking xfs/platform_defs.h presence... no 2023-07-06T20:01:02.484 INFO:teuthology.orchestra.run.smithi006.stdout:checking for xfs/platform_defs.h... no 2023-07-06T20:01:02.507 INFO:teuthology.orchestra.run.smithi006.stdout:checking btrfs/ioctl.h usability... no 2023-07-06T20:01:02.520 INFO:teuthology.orchestra.run.smithi006.stdout:checking btrfs/ioctl.h presence... no 2023-07-06T20:01:02.521 INFO:teuthology.orchestra.run.smithi006.stdout:checking for btrfs/ioctl.h... no 2023-07-06T20:01:02.540 INFO:teuthology.orchestra.run.smithi006.stdout:checking cifs/ioctl.h usability... no 2023-07-06T20:01:02.550 INFO:teuthology.orchestra.run.smithi006.stdout:checking cifs/ioctl.h presence... no 2023-07-06T20:01:02.550 INFO:teuthology.orchestra.run.smithi006.stdout:checking for cifs/ioctl.h... no 2023-07-06T20:01:02.576 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/mman.h usability... yes 2023-07-06T20:01:02.583 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/mman.h presence... yes 2023-07-06T20:01:02.584 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/mman.h... yes 2023-07-06T20:01:02.599 INFO:teuthology.orchestra.run.smithi006.stdout:checking for xfs/xfs_log_format.h... no 2023-07-06T20:01:02.634 INFO:teuthology.orchestra.run.smithi006.stdout:checking for uuid_compare... no 2023-07-06T20:01:02.664 INFO:teuthology.orchestra.run.smithi006.stdout:checking for uuid_compare in -luuid... yes 2023-07-06T20:01:02.715 INFO:teuthology.orchestra.run.smithi006.stdout:checking for xfs/xfs.h... yes 2023-07-06T20:01:02.725 INFO:teuthology.orchestra.run.smithi006.stdout:checking for xfs/libxfs.h... no 2023-07-06T20:01:02.741 INFO:teuthology.orchestra.run.smithi006.stdout:checking whether xlog_assign_lsn is declared... no 2023-07-06T20:01:02.769 INFO:teuthology.orchestra.run.smithi006.stdout:checking for xfs/xqm.h... yes 2023-07-06T20:01:02.815 INFO:teuthology.orchestra.run.smithi006.stdout:checking xfsctl from xfs/xfs.h... ok 2023-07-06T20:01:02.838 INFO:teuthology.orchestra.run.smithi006.stdout:checking xfs/handle.h usability... yes 2023-07-06T20:01:02.845 INFO:teuthology.orchestra.run.smithi006.stdout:checking xfs/handle.h presence... yes 2023-07-06T20:01:02.845 INFO:teuthology.orchestra.run.smithi006.stdout:checking for xfs/handle.h... yes 2023-07-06T20:01:02.885 INFO:teuthology.orchestra.run.smithi006.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-07-06T20:01:02.924 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/acl.h usability... yes 2023-07-06T20:01:02.932 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/acl.h presence... yes 2023-07-06T20:01:02.933 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/acl.h... yes 2023-07-06T20:01:02.963 INFO:teuthology.orchestra.run.smithi006.stdout:checking acl/libacl.h usability... yes 2023-07-06T20:01:02.972 INFO:teuthology.orchestra.run.smithi006.stdout:checking acl/libacl.h presence... yes 2023-07-06T20:01:02.972 INFO:teuthology.orchestra.run.smithi006.stdout:checking for acl/libacl.h... yes 2023-07-06T20:01:03.004 INFO:teuthology.orchestra.run.smithi006.stdout:checking for acl_init in -lacl... yes 2023-07-06T20:01:03.026 INFO:teuthology.orchestra.run.smithi006.stdout:checking gdbm-ndbm.h usability... no 2023-07-06T20:01:03.036 INFO:teuthology.orchestra.run.smithi006.stdout:checking gdbm-ndbm.h presence... no 2023-07-06T20:01:03.037 INFO:teuthology.orchestra.run.smithi006.stdout:checking for gdbm-ndbm.h... no 2023-07-06T20:01:03.061 INFO:teuthology.orchestra.run.smithi006.stdout:checking gdbm/ndbm.h usability... no 2023-07-06T20:01:03.068 INFO:teuthology.orchestra.run.smithi006.stdout:checking gdbm/ndbm.h presence... no 2023-07-06T20:01:03.069 INFO:teuthology.orchestra.run.smithi006.stdout:checking for gdbm/ndbm.h... no 2023-07-06T20:01:03.090 INFO:teuthology.orchestra.run.smithi006.stdout:checking ndbm.h usability... no 2023-07-06T20:01:03.098 INFO:teuthology.orchestra.run.smithi006.stdout:checking ndbm.h presence... no 2023-07-06T20:01:03.098 INFO:teuthology.orchestra.run.smithi006.stdout:checking for ndbm.h... no 2023-07-06T20:01:03.123 INFO:teuthology.orchestra.run.smithi006.stdout:checking libaio.h usability... yes 2023-07-06T20:01:03.134 INFO:teuthology.orchestra.run.smithi006.stdout:checking libaio.h presence... yes 2023-07-06T20:01:03.134 INFO:teuthology.orchestra.run.smithi006.stdout:checking for libaio.h... yes 2023-07-06T20:01:03.157 INFO:teuthology.orchestra.run.smithi006.stdout:checking liburing.h usability... no 2023-07-06T20:01:03.165 INFO:teuthology.orchestra.run.smithi006.stdout:checking liburing.h presence... no 2023-07-06T20:01:03.166 INFO:teuthology.orchestra.run.smithi006.stdout:checking for liburing.h... no 2023-07-06T20:01:03.187 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/capability.h usability... no 2023-07-06T20:01:03.196 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/capability.h presence... no 2023-07-06T20:01:03.197 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/capability.h... no 2023-07-06T20:01:03.219 INFO:teuthology.orchestra.run.smithi006.stdout:checking linux/fiemap.h usability... yes 2023-07-06T20:01:03.226 INFO:teuthology.orchestra.run.smithi006.stdout:checking linux/fiemap.h presence... yes 2023-07-06T20:01:03.226 INFO:teuthology.orchestra.run.smithi006.stdout:checking for linux/fiemap.h... yes 2023-07-06T20:01:03.259 INFO:teuthology.orchestra.run.smithi006.stdout:checking for fallocate... yes 2023-07-06T20:01:03.296 INFO:teuthology.orchestra.run.smithi006.stdout:checking for open_by_handle_at... yes 2023-07-06T20:01:03.317 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/prctl.h usability... yes 2023-07-06T20:01:03.324 INFO:teuthology.orchestra.run.smithi006.stdout:checking sys/prctl.h presence... yes 2023-07-06T20:01:03.325 INFO:teuthology.orchestra.run.smithi006.stdout:checking for sys/prctl.h... yes 2023-07-06T20:01:03.348 INFO:teuthology.orchestra.run.smithi006.stdout:checking linux/fs.h usability... yes 2023-07-06T20:01:03.356 INFO:teuthology.orchestra.run.smithi006.stdout:checking linux/fs.h presence... yes 2023-07-06T20:01:03.357 INFO:teuthology.orchestra.run.smithi006.stdout:checking for linux/fs.h... yes 2023-07-06T20:01:03.379 INFO:teuthology.orchestra.run.smithi006.stdout:checking btrfsutil.h usability... no 2023-07-06T20:01:03.387 INFO:teuthology.orchestra.run.smithi006.stdout:checking btrfsutil.h presence... no 2023-07-06T20:01:03.387 INFO:teuthology.orchestra.run.smithi006.stdout:checking for btrfsutil.h... no 2023-07-06T20:01:03.423 INFO:teuthology.orchestra.run.smithi006.stdout:checking for copy_file_range... yes 2023-07-06T20:01:03.456 INFO:teuthology.orchestra.run.smithi006.stdout:checking for SEEK_DATA... yes 2023-07-06T20:01:03.503 INFO:teuthology.orchestra.run.smithi006.stdout:checking for BMV_OF_SHARED... yes 2023-07-06T20:01:03.542 INFO:teuthology.orchestra.run.smithi006.stdout:checking for nftw... yes 2023-07-06T20:01:03.606 INFO:teuthology.orchestra.run.smithi006.stdout:checking for RLIMIT_NOFILE... yes 2023-07-06T20:01:03.625 INFO:teuthology.orchestra.run.smithi006.stdout:checking for FIEXCHANGE_RANGE... no 2023-07-06T20:01:03.655 INFO:teuthology.orchestra.run.smithi006.stdout:checking for renameat2... yes 2023-07-06T20:01:03.687 INFO:teuthology.orchestra.run.smithi006.stdout:checking for reallocarray... yes 2023-07-06T20:01:03.701 INFO:teuthology.orchestra.run.smithi006.stdout:checking for struct mount_attr... no 2023-07-06T20:01:03.744 INFO:teuthology.orchestra.run.smithi006.stdout:checking for struct btrfs_qgroup_limit... yes 2023-07-06T20:01:03.780 INFO:teuthology.orchestra.run.smithi006.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-07-06T20:01:03.814 INFO:teuthology.orchestra.run.smithi006.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-07-06T20:01:03.848 INFO:teuthology.orchestra.run.smithi006.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-07-06T20:01:03.883 INFO:teuthology.orchestra.run.smithi006.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-07-06T20:01:03.917 INFO:teuthology.orchestra.run.smithi006.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-07-06T20:01:03.954 INFO:teuthology.orchestra.run.smithi006.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-07-06T20:01:03.979 INFO:teuthology.orchestra.run.smithi006.stdout:checking linux/btrfs.h usability... yes 2023-07-06T20:01:03.987 INFO:teuthology.orchestra.run.smithi006.stdout:checking linux/btrfs.h presence... yes 2023-07-06T20:01:03.987 INFO:teuthology.orchestra.run.smithi006.stdout:checking for linux/btrfs.h... yes 2023-07-06T20:01:04.016 INFO:teuthology.orchestra.run.smithi006.stdout:checking linux/btrfs_tree.h usability... yes 2023-07-06T20:01:04.024 INFO:teuthology.orchestra.run.smithi006.stdout:checking linux/btrfs_tree.h presence... yes 2023-07-06T20:01:04.024 INFO:teuthology.orchestra.run.smithi006.stdout:checking for linux/btrfs_tree.h... yes 2023-07-06T20:01:04.054 INFO:teuthology.orchestra.run.smithi006.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-07-06T20:01:04.072 INFO:teuthology.orchestra.run.smithi006.stdout:configure: creating ./config.status 2023-07-06T20:01:04.373 INFO:teuthology.orchestra.run.smithi006.stdout:config.status: creating include/builddefs 2023-07-06T20:01:04.383 INFO:teuthology.orchestra.run.smithi006.stdout:config.status: creating include/config.h 2023-07-06T20:01:04.391 INFO:teuthology.orchestra.run.smithi006.stdout:config.status: executing libtool commands 2023-07-06T20:01:04.430 INFO:teuthology.orchestra.run.smithi006.stdout:Building include 2023-07-06T20:01:04.432 INFO:teuthology.orchestra.run.smithi006.stdout:Building lib 2023-07-06T20:01:04.435 INFO:teuthology.orchestra.run.smithi006.stdout: [LTDEP] 2023-07-06T20:01:04.540 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] dataascii.lo 2023-07-06T20:01:04.654 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] databin.lo 2023-07-06T20:01:04.795 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] datapid.lo 2023-07-06T20:01:04.895 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] file_lock.lo 2023-07-06T20:01:05.056 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] forker.lo 2023-07-06T20:01:05.184 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] pattern.lo 2023-07-06T20:01:05.301 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] open_flags.lo 2023-07-06T20:01:05.436 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] random_range.lo 2023-07-06T20:01:05.651 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] string_to_tokens.lo 2023-07-06T20:01:05.752 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] str_to_bytes.lo 2023-07-06T20:01:05.878 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] tlibio.lo 2023-07-06T20:01:06.097 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] write_log.lo 2023-07-06T20:01:06.324 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] random.lo 2023-07-06T20:01:06.436 INFO:teuthology.orchestra.run.smithi006.stdout: [LD] 2023-07-06T20:01:06.515 INFO:teuthology.orchestra.run.smithi006.stdout:Building ltp 2023-07-06T20:01:06.518 INFO:teuthology.orchestra.run.smithi006.stdout: [DEP] 2023-07-06T20:01:06.650 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] doio 2023-07-06T20:01:07.268 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fsstress 2023-07-06T20:01:08.514 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fsx 2023-07-06T20:01:09.330 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] growfiles 2023-07-06T20:01:09.808 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] iogen 2023-07-06T20:01:10.139 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-stress 2023-07-06T20:01:10.531 INFO:teuthology.orchestra.run.smithi006.stdout:Building src 2023-07-06T20:01:10.536 INFO:teuthology.orchestra.run.smithi006.stdout: [DEP] 2023-07-06T20:01:11.961 INFO:teuthology.orchestra.run.smithi006.stdout: [DEP] 2023-07-06T20:01:11.987 INFO:teuthology.orchestra.run.smithi006.stdout: [DEP] 2023-07-06T20:01:11.995 INFO:teuthology.orchestra.run.smithi006.stdout: [DEP] 2023-07-06T20:01:12.182 INFO:teuthology.orchestra.run.smithi006.stdout: [DEP] 2023-07-06T20:01:12.203 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] dirstress 2023-07-06T20:01:12.423 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fill 2023-07-06T20:01:12.567 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fill2 2023-07-06T20:01:12.780 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] getpagesize 2023-07-06T20:01:12.909 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] holes 2023-07-06T20:01:13.090 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] lstat64 2023-07-06T20:01:13.260 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] nametest 2023-07-06T20:01:13.482 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] permname 2023-07-06T20:01:13.668 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] randholes 2023-07-06T20:01:13.900 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] runas 2023-07-06T20:01:14.064 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] truncfile 2023-07-06T20:01:14.232 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] usemem 2023-07-06T20:01:14.372 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] mmapcat 2023-07-06T20:01:14.512 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] append_reader 2023-07-06T20:01:14.658 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] append_writer 2023-07-06T20:01:14.797 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] dirperf 2023-07-06T20:01:15.006 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] metaperf 2023-07-06T20:01:15.244 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] devzero 2023-07-06T20:01:15.407 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] feature 2023-07-06T20:01:15.607 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] alloc 2023-07-06T20:01:15.808 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fault 2023-07-06T20:01:15.958 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fstest 2023-07-06T20:01:16.178 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_access_root 2023-07-06T20:01:16.323 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] godown 2023-07-06T20:01:16.480 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] resvtest 2023-07-06T20:01:16.656 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] writemod 2023-07-06T20:01:16.792 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] writev_on_pagefault 2023-07-06T20:01:16.941 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] makeextents 2023-07-06T20:01:17.109 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] itrash 2023-07-06T20:01:17.255 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] rename 2023-07-06T20:01:17.387 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] multi_open_unlink 2023-07-06T20:01:17.541 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] unwritten_sync 2023-07-06T20:01:17.709 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] genhashnames 2023-07-06T20:01:17.885 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_holes 2023-07-06T20:01:18.024 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_mmap_writev 2023-07-06T20:01:18.163 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_truncate_cmtime 2023-07-06T20:01:18.312 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] dirhash_collide 2023-07-06T20:01:18.482 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_rename_overwrite 2023-07-06T20:01:18.615 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] holetest 2023-07-06T20:01:18.820 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_truncate_self 2023-07-06T20:01:18.954 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] af_unix 2023-07-06T20:01:19.097 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_mmap_stale_pmd 2023-07-06T20:01:19.242 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_mmap_cow_race 2023-07-06T20:01:19.396 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_mmap_fallocate 2023-07-06T20:01:19.538 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fsync-err 2023-07-06T20:01:19.711 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_mmap_write_ro 2023-07-06T20:01:19.855 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_ext4_dax_journal_corruption 2023-07-06T20:01:20.011 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_ext4_dax_inline_corruption 2023-07-06T20:01:20.115 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:01:20.119 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:01:20.151 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_ofd_locks 2023-07-06T20:01:20.340 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_mmap_collision 2023-07-06T20:01:20.525 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] mmap-write-concurrent 2023-07-06T20:01:20.685 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_get_file_time 2023-07-06T20:01:20.822 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_create_short_dirs 2023-07-06T20:01:20.978 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_create_long_dirs 2023-07-06T20:01:21.137 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_enospc 2023-07-06T20:01:21.306 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_mmap_writev_overlap 2023-07-06T20:01:21.468 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] checkpoint_journal 2023-07-06T20:01:21.609 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] mmap-rw-fault 2023-07-06T20:01:21.780 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] allocstale 2023-07-06T20:01:21.936 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_mmap_cow_memory_failure 2023-07-06T20:01:22.096 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fake-dump-rootino 2023-07-06T20:01:22.238 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] dio-buf-fault 2023-07-06T20:01:22.383 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] xfsctl 2023-07-06T20:01:22.559 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] bstat 2023-07-06T20:01:22.748 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_mtab 2023-07-06T20:01:22.926 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] getdevicesize 2023-07-06T20:01:23.060 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] preallo_rw_pattern_reader 2023-07-06T20:01:23.209 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] preallo_rw_pattern_writer 2023-07-06T20:01:23.359 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] ftrunc 2023-07-06T20:01:23.498 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] trunc 2023-07-06T20:01:23.650 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fs_perms 2023-07-06T20:01:23.805 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] testx 2023-07-06T20:01:23.930 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] looptest 2023-07-06T20:01:24.111 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] locktest 2023-07-06T20:01:24.402 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] unwritten_mmap 2023-07-06T20:01:24.549 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] bulkstat_unlink_test 2023-07-06T20:01:24.743 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] deduperace 2023-07-06T20:01:24.921 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] bulkstat_unlink_test_modified 2023-07-06T20:01:25.105 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_dir_offset 2023-07-06T20:01:25.245 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_futimens 2023-07-06T20:01:25.379 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_immutable 2023-07-06T20:01:25.968 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] stale_handle 2023-07-06T20:01:26.130 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] pwrite_mmap_blocked 2023-07-06T20:01:26.274 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_dir_offset2 2023-07-06T20:01:26.455 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] seek_sanity_test 2023-07-06T20:01:26.844 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] seek_copy_test 2023-07-06T20:01:27.010 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_readdir_1 2023-07-06T20:01:27.151 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_readdir_2 2023-07-06T20:01:27.292 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fsync-tester 2023-07-06T20:01:27.529 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] nsexec 2023-07-06T20:01:27.691 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] cloner 2023-07-06T20:01:27.859 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] renameat2 2023-07-06T20:01:28.017 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_getcwd 2023-07-06T20:01:28.166 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] e4compact 2023-07-06T20:01:28.356 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] test-nextquota 2023-07-06T20:01:28.512 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] punch-alternating 2023-07-06T20:01:28.672 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] attr-list-by-handle-cursor-test 2023-07-06T20:01:28.834 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] listxattr 2023-07-06T20:01:28.974 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] dio-interleaved 2023-07-06T20:01:29.120 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_dir_type 2023-07-06T20:01:29.267 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] dio-invalidate-cache 2023-07-06T20:01:29.458 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] stat_test 2023-07-06T20:01:29.735 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_encrypted_d_revalidate 2023-07-06T20:01:29.895 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] attr_replace_test 2023-07-06T20:01:30.049 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] swapon 2023-07-06T20:01:30.202 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] mkswap 2023-07-06T20:01:30.345 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_attr_corruption 2023-07-06T20:01:30.487 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_open_tmpfiles 2023-07-06T20:01:30.660 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fscrypt-crypt-util 2023-07-06T20:01:31.256 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] bulkstat_null_ocount 2023-07-06T20:01:31.405 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] splice-test 2023-07-06T20:01:31.705 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] chprojid_fail 2023-07-06T20:01:31.857 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] detached_mounts_propagation 2023-07-06T20:01:32.027 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] ext4_resize 2023-07-06T20:01:32.169 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_readdir_3 2023-07-06T20:01:32.349 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] splice2pipe 2023-07-06T20:01:32.503 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] uuid_ioctl 2023-07-06T20:01:32.652 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fiemap-tester 2023-07-06T20:01:32.900 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_stripealign 2023-07-06T20:01:33.048 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] open_by_handle 2023-07-06T20:01:33.289 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] t_mmap_dio 2023-07-06T20:01:33.438 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] xfsfind 2023-07-06T20:01:33.620 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] fssum 2023-07-06T20:01:34.027 INFO:teuthology.orchestra.run.smithi006.stdout:Building log-writes 2023-07-06T20:01:34.032 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] replay-log 2023-07-06T20:01:34.324 INFO:teuthology.orchestra.run.smithi006.stdout:Building perf 2023-07-06T20:01:34.327 INFO:teuthology.orchestra.run.smithi006.stdout:Building aio-dio-regress 2023-07-06T20:01:34.333 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-dio-append-write-fallocate-race 2023-07-06T20:01:34.498 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-dio-fcntl-race 2023-07-06T20:01:34.652 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-dio-subblock-eof-read 2023-07-06T20:01:34.792 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-dio-append-write-read-race 2023-07-06T20:01:34.961 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-dio-invalidate-readahead 2023-07-06T20:01:35.120 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-dio-write-verify 2023-07-06T20:01:35.302 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-07-06T20:01:35.434 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-last-ref-held-by-io 2023-07-06T20:01:35.599 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-dio-cycle-write 2023-07-06T20:01:35.776 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-dio-extend-stat 2023-07-06T20:01:35.936 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-07-06T20:01:36.065 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-dio-hole-filling-race 2023-07-06T20:01:36.209 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-dio-invalidate-failure 2023-07-06T20:01:36.362 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aiodio_sparse2 2023-07-06T20:01:36.567 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aiocp 2023-07-06T20:01:36.780 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-dio-cow-race 2023-07-06T20:01:36.932 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] aio-dio-eof-race 2023-07-06T20:01:37.109 INFO:teuthology.orchestra.run.smithi006.stdout:Building vfs 2023-07-06T20:01:37.111 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] vfstest 2023-07-06T20:01:38.861 INFO:teuthology.orchestra.run.smithi006.stdout: [CC] mount-idmapped 2023-07-06T20:01:39.208 INFO:teuthology.orchestra.run.smithi006.stdout:Building m4 2023-07-06T20:01:39.211 INFO:teuthology.orchestra.run.smithi006.stdout:Building common 2023-07-06T20:01:39.214 INFO:teuthology.orchestra.run.smithi006.stdout:Building tests 2023-07-06T20:01:39.220 INFO:teuthology.orchestra.run.smithi006.stdout:Building perf 2023-07-06T20:01:39.224 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/perf/group.list 2023-07-06T20:01:39.235 INFO:teuthology.orchestra.run.smithi006.stdout:Building ext4 2023-07-06T20:01:39.240 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/ext4/group.list 2023-07-06T20:01:39.275 INFO:teuthology.orchestra.run.smithi006.stdout:Building ocfs2 2023-07-06T20:01:39.279 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/ocfs2/group.list 2023-07-06T20:01:39.292 INFO:teuthology.orchestra.run.smithi006.stdout:Building overlay 2023-07-06T20:01:39.297 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/overlay/group.list 2023-07-06T20:01:39.332 INFO:teuthology.orchestra.run.smithi006.stdout:Building cifs 2023-07-06T20:01:39.341 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/cifs/group.list 2023-07-06T20:01:39.348 INFO:teuthology.orchestra.run.smithi006.stdout:Building generic 2023-07-06T20:01:39.354 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/generic/group.list 2023-07-06T20:01:39.447 INFO:teuthology.orchestra.run.smithi006.stdout:Building shared 2023-07-06T20:01:39.452 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/shared/group.list 2023-07-06T20:01:39.467 INFO:teuthology.orchestra.run.smithi006.stdout:Building nfs 2023-07-06T20:01:39.472 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/nfs/group.list 2023-07-06T20:01:39.486 INFO:teuthology.orchestra.run.smithi006.stdout:Building f2fs 2023-07-06T20:01:39.493 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/f2fs/group.list 2023-07-06T20:01:39.506 INFO:teuthology.orchestra.run.smithi006.stdout:Building udf 2023-07-06T20:01:39.511 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/udf/group.list 2023-07-06T20:01:39.524 INFO:teuthology.orchestra.run.smithi006.stdout:Building ceph 2023-07-06T20:01:39.526 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/ceph/group.list 2023-07-06T20:01:39.540 INFO:teuthology.orchestra.run.smithi006.stdout:Building xfs 2023-07-06T20:01:39.553 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/xfs/group.list 2023-07-06T20:01:39.639 INFO:teuthology.orchestra.run.smithi006.stdout:Building btrfs 2023-07-06T20:01:39.647 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/btrfs/group.list 2023-07-06T20:01:39.700 INFO:teuthology.orchestra.run.smithi006.stdout:Building tmpfs 2023-07-06T20:01:39.709 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/tmpfs/group.list 2023-07-06T20:01:39.717 INFO:teuthology.orchestra.run.smithi006.stdout:Building selftest 2023-07-06T20:01:39.725 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/selftest/group.list 2023-07-06T20:01:39.735 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo make install) 2023-07-06T20:01:39.779 INFO:teuthology.orchestra.run.smithi006.stdout:Building include 2023-07-06T20:01:39.779 INFO:teuthology.orchestra.run.smithi006.stdout:Building lib 2023-07-06T20:01:39.781 INFO:teuthology.orchestra.run.smithi006.stdout:Building ltp 2023-07-06T20:01:39.786 INFO:teuthology.orchestra.run.smithi006.stdout:Building src 2023-07-06T20:01:39.818 INFO:teuthology.orchestra.run.smithi006.stdout:Building log-writes 2023-07-06T20:01:39.824 INFO:teuthology.orchestra.run.smithi006.stdout:Building perf 2023-07-06T20:01:39.825 INFO:teuthology.orchestra.run.smithi006.stdout:Building aio-dio-regress 2023-07-06T20:01:39.833 INFO:teuthology.orchestra.run.smithi006.stdout:Building vfs 2023-07-06T20:01:39.833 INFO:teuthology.orchestra.run.smithi006.stdout:Building m4 2023-07-06T20:01:39.835 INFO:teuthology.orchestra.run.smithi006.stdout:Building common 2023-07-06T20:01:39.840 INFO:teuthology.orchestra.run.smithi006.stdout:Building tests 2023-07-06T20:01:39.852 INFO:teuthology.orchestra.run.smithi006.stdout:Building perf 2023-07-06T20:01:39.852 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/perf/group.list 2023-07-06T20:01:39.860 INFO:teuthology.orchestra.run.smithi006.stdout:Building ext4 2023-07-06T20:01:39.865 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/ext4/group.list 2023-07-06T20:01:39.899 INFO:teuthology.orchestra.run.smithi006.stdout:Building ocfs2 2023-07-06T20:01:39.904 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/ocfs2/group.list 2023-07-06T20:01:39.916 INFO:teuthology.orchestra.run.smithi006.stdout:Building overlay 2023-07-06T20:01:39.921 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/overlay/group.list 2023-07-06T20:01:39.956 INFO:teuthology.orchestra.run.smithi006.stdout:Building cifs 2023-07-06T20:01:39.961 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/cifs/group.list 2023-07-06T20:01:39.973 INFO:teuthology.orchestra.run.smithi006.stdout:Building generic 2023-07-06T20:01:39.984 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/generic/group.list 2023-07-06T20:01:40.070 INFO:teuthology.orchestra.run.smithi006.stdout:Building shared 2023-07-06T20:01:40.077 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/shared/group.list 2023-07-06T20:01:40.090 INFO:teuthology.orchestra.run.smithi006.stdout:Building nfs 2023-07-06T20:01:40.095 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/nfs/group.list 2023-07-06T20:01:40.109 INFO:teuthology.orchestra.run.smithi006.stdout:Building f2fs 2023-07-06T20:01:40.116 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/f2fs/group.list 2023-07-06T20:01:40.129 INFO:teuthology.orchestra.run.smithi006.stdout:Building udf 2023-07-06T20:01:40.134 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/udf/group.list 2023-07-06T20:01:40.147 INFO:teuthology.orchestra.run.smithi006.stdout:Building ceph 2023-07-06T20:01:40.151 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/ceph/group.list 2023-07-06T20:01:40.162 INFO:teuthology.orchestra.run.smithi006.stdout:Building xfs 2023-07-06T20:01:40.170 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/xfs/group.list 2023-07-06T20:01:40.260 INFO:teuthology.orchestra.run.smithi006.stdout:Building btrfs 2023-07-06T20:01:40.266 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/btrfs/group.list 2023-07-06T20:01:40.319 INFO:teuthology.orchestra.run.smithi006.stdout:Building tmpfs 2023-07-06T20:01:40.324 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/tmpfs/group.list 2023-07-06T20:01:40.339 INFO:teuthology.orchestra.run.smithi006.stdout:Building selftest 2023-07-06T20:01:40.341 INFO:teuthology.orchestra.run.smithi006.stdout: [GROUP] /tmp/tmp.LybHGoQKZdxfstests-dev/tests/selftest/group.list 2023-07-06T20:01:40.353 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-07-06T20:01:40.355 INFO:teuthology.orchestra.run.smithi006.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-06T20:01:40.356 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-07-06T20:01:40.356 INFO:teuthology.orchestra.run.smithi006.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-06T20:01:40.357 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-07-06T20:01:40.358 INFO:teuthology.orchestra.run.smithi006.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-07-06T20:01:40.369 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-07-06T20:01:40.445 INFO:teuthology.orchestra.run.smithi006.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-07-06T20:01:40.454 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-07-06T20:01:40.473 INFO:teuthology.orchestra.run.smithi006.stdout:Building log-writes 2023-07-06T20:01:40.474 INFO:teuthology.orchestra.run.smithi006.stdout:Building perf 2023-07-06T20:01:40.478 INFO:teuthology.orchestra.run.smithi006.stdout:Building aio-dio-regress 2023-07-06T20:01:40.484 INFO:teuthology.orchestra.run.smithi006.stdout:Building vfs 2023-07-06T20:01:40.485 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake -C log-writes install 2023-07-06T20:01:40.486 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-07-06T20:01:40.497 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-07-06T20:01:40.504 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake -C perf install 2023-07-06T20:01:40.505 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-07-06T20:01:40.514 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-07-06T20:01:40.537 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-07-06T20:01:40.539 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-07-06T20:01:40.548 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 aio-dio-append-write-fallocate-race aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-hole-filling-race aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-07-06T20:01:40.605 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake -C vfs install 2023-07-06T20:01:40.605 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-07-06T20:01:40.614 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-07-06T20:01:40.625 INFO:teuthology.orchestra.run.smithi006.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-07-06T20:01:40.636 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-07-06T20:01:41.861 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-07-06T20:01:41.958 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-07-06T20:01:41.990 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-07-06T20:01:41.990 INFO:teuthology.orchestra.run.smithi006.stdout:gmake[1]: Nothing to be done for 'install'. 2023-07-06T20:01:41.990 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-07-06T20:01:41.991 INFO:teuthology.orchestra.run.smithi006.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-07-06T20:01:42.000 INFO:teuthology.orchestra.run.smithi006.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-07-06T20:01:42.136 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-07-06T20:01:42.137 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LybHGoQKZdxfstests-dev/tests/btrfs/ install 2023-07-06T20:01:42.140 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-07-06T20:01:42.149 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 290 291 299 /var/lib/xfstests/tests/btrfs 2023-07-06T20:01:42.971 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-07-06T20:01:42.979 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 057.out 175.out 186.out 240.out 069.out 092.out 077.out 140.out 265.out 236.out 108.out 204.out 177.out 194.out 234.out 249.out 109.out 033.out 082.out 252.out 270.out 040.out 176.out 202.out 137.out 034.out 125.out 014.out 165.out 181.out 152.out 142.out 264.out 192.out 148.out 282.out 267.out 052.out 228.out 183.out 094.out 273.out 251.out 110.out 043.out 209.out 151.out 206.out 195.out 274.out 215.out 115.out 015.out 250.out 191.out 281.out 046.out 051.out 244.out 219.out 119.out 019.out 128.out 232.out 248.out 162.out 147.out 197.out 196.out 242.out 004.out 189.out 220.out 120.out 020.out 102.out 263.out 171.out 261.out 045.out 217.out 117.out 017.out 072.out 068.out 048.out 062.out 038.out 084.out 129.out 233.out 066.out 029.out 229.out 103.out 254.out 111.out 011.out 243.out 275.out 134.out 170.out 260.out 157.out 143.out 133.out 286.out 161.out 246.out 216.out 116.out 016.out 155.out 118.out 287.out 067.out 010.out 238.out 138.out 095.out 184.out 160.out 190.out 291.out 081.out 024.out 071.out 061.out 047.out 200.out 100.out 025.out 139.out 258.out 185.out 269.out 208.out 039.out 222.out 035.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 106.out 009.out 167.out 003.out 211.out 158.out 085.out 146.out 188.out 104.out 089.out 086.out 279.out 225.out 174.out 156.out 135.out 257.out 124.out 172.out 058.out 262.out 036.out 042.out 193.out 097.out 271.out 283.out 083.out 199.out 099.out 278.out 053.out 164.out 239.out 241.out 002.out 178.out 141.out 214.out 114.out 074.out 056.out 012.out 041.out 223.out 150.out 123.out 179.out 144.out 032.out 277.out 205.out 136.out 005.out 096.out 198.out 008.out 280.out 050.out 105.out 027.out 187.out 091.out 153.out 088.out 285.out 044.out 201.out 101.out 001.out 266.out 237.out 065.out 231.out 227.out 075.out 131.out 213.out 113.out 013.out 031.out 182.out 272.out 078.out 173.out 259.out 210.out 132.out 037.out 093.out 235.out 127.out 230.out 166.out 130.out 023.out 073.out 030.out 203.out 063.out 055.out 245.out 145.out 159.out 122.out 076.out 022.out 006.out 284.out 299.out 224.out 154.out 276.out 149.out 064.out 218.out 018.out 168.out 007.out 079.out 054.out 059.out 049.out 226.out 163.out 126.out 121.out 026.out 180.out 268.out 253.out 255.out 090.out 221.out 087.out 212.out 112.out 256.out 021.out 247.out 028.out 107.out /var/lib/xfstests/tests/btrfs 2023-07-06T20:01:43.802 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LybHGoQKZdxfstests-dev/tests/ceph/ install 2023-07-06T20:01:43.804 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-07-06T20:01:43.813 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-07-06T20:01:43.834 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-07-06T20:01:43.842 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-07-06T20:01:43.865 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LybHGoQKZdxfstests-dev/tests/cifs/ install 2023-07-06T20:01:43.865 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-07-06T20:01:43.873 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-07-06T20:01:43.883 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-07-06T20:01:43.891 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-07-06T20:01:43.901 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LybHGoQKZdxfstests-dev/tests/ext4/ install 2023-07-06T20:01:43.901 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-07-06T20:01:43.911 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-07-06T20:01:44.108 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-07-06T20:01:44.123 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 305.out 005.out 008.out 035.out 036.out 308.out 050.out 040.out 306.out 007.out 021.out 046.out 012.out 009.out 033.out 045.out 034.out 056.out 047.out 018.out 023.out 302.out 020.out 002.out 014.out 024.out 013.out 031.out 015.out 304.out 004.out 048.out 038.out 052.out 303.out 029.out 011.out 027.out 042.out 044.out 055.out 030.out 058.out 003.out 017.out 043.out 053.out 016.out 059.out 037.out 301.out 010.out 022.out 006.out 057.out 025.out 026.out 271.out 051.out 041.out 307.out 019.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-07-06T20:01:44.325 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LybHGoQKZdxfstests-dev/tests/f2fs/ install 2023-07-06T20:01:44.326 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-07-06T20:01:44.335 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-07-06T20:01:44.346 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-07-06T20:01:44.355 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-07-06T20:01:44.367 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LybHGoQKZdxfstests-dev/tests/generic/ install 2023-07-06T20:01:44.371 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-07-06T20:01:44.381 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 /var/lib/xfstests/tests/generic 2023-07-06T20:01:46.436 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-07-06T20:01:46.445 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 050.out.xfsquota 035.out.nfs 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 208.out 433.out 670.out 040.out 104.out 575.out 537.out 683.out 497.out 337.out 702.out 460.out 149.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 403.out 593.out 571.out 243.out 592.out 282.out 472.out 468.out 628.out 528.out 607.out 428.out 659.out 407.out 228.out 128.out 171.out 028.out 620.out 273.out 474.out 492.out 609.out 707.out 693.out 595.out 506.out 268.out 632.out 532.out 591.out 281.out 471.out 619.out 519.out 013.out 419.out 319.out 177.out 523.out 119.out 019.out 727.out 372.out 686.out 312.out 718.out 143.out 716.out 161.out 516.out 518.out 538.out 655.out 216.out 116.out 016.out 155.out 338.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 457.out 333.out 258.out 362.out 379.out 691.out 039.out 173.out 498.out 665.out 098.out 711.out 290.out 480.out 706.out 060.out 406.out 306.out 106.out 642.out 447.out 217.out 120.out 191.out 411.out 357.out 481.out 211.out 158.out 014.out 182.out 370.out 188.out 030.out 099.out 585.out 724.out 721.out 624.out 524.out 174.out 156.out 324.out 224.out 313.out 355.out 124.out 382.out 672.out 278.out 063.out 058.out 384.out 296.out 042.out 193.out 271.out 465.out 473.out 335.out 247.out 509.out 568.out 441.out 440.out 475.out 548.out 356.out 341.out 094.out 241.out 600.out 089.out 714.out 614.out 514.out 414.out 314.out 416.out 214.out 381.out 056.out 041.out 057.out 340.out 358.out 572.out 586.out 521.out 240.out 549.out 095.out 633.out 434.out 140.out 708.out 533.out 508.out 408.out 308.out 476.out 087.out 199.out 458.out 233.out 639.out 443.out 540.out 397.out 053.out 279.out 276.out 448.out 164.out 376.out 589.out 587.out 339.out 294.out 352.out 484.out 489.out 139.out 317.out 399.out 220.out 552.out 695.out 017.out 677.out 097.out 175.out 315.out 295.out 580.out 075.out 186.out 452.out 679.out 292.out 252.out 077.out 167.out 688.out 206.out 348.out 394.out 651.out 184.out 466.out 697.out 495.out 725.out 109.out 482.out 625.out 283.out 525.out 488.out 496.out 325.out 551.out 225.out 322.out 636.out 125.out 715.out 192.out 544.out 515.out 650.out 152.out 658.out 563.out 393.out 578.out 015.out 392.out 682.out 684.out 550.out 052.out 652.out 534.out 351.out 583.out 451.out 450.out 463.out 251.out 267.out 176.out 069.out 644.out 065.out 487.out 615.out 395.out 676.out 415.out 344.out 215.out 115.out 444.out 027.out 250.out 391.out 674.out 464.out 705.out 536.out 577.out 439.out 244.out 336.out 144.out 505.out 405.out 342.out 205.out 136.out 598.out 363.out 036.out 198.out 723.out 008.out 390.out 680.out 605.out 305.out 105.out 005.out 367.out 291.out 719.out 323.out 685.out 562.out 570.out 388.out 527.out 237.out 151.out 227.out 163.out 332.out 661.out 582.out 232.out 478.out 584.out 462.out 597.out 412.out 132.out 179.out 037.out 293.out 499.out 638.out 353.out 020.out 660.out 561.out 141.out 076.out 668.out 044.out 648.out 387.out 594.out 438.out 265.out 289.out 574.out 006.out 690.out 284.out 567.out 299.out 456.out 461.out 477.out 307.out 647.out 493.out 107.out 007.out 380.out 526.out 479.out 426.out 150.out 326.out 082.out 226.out 413.out 126.out 025.out 121.out 026.out 021.out 485.out 694.out 347.out 275.out 090.out 361.out 564.out 302.out 432.out 002.out 558.out 162.out 147.out 288.out 197.out 033.out 396.out 051.out 350.out 547.out 047.out 024.out 360.out 543.out 261.out 045.out 692.out 255.out 726.out 378.out 346.out 048.out 062.out 626.out 529.out 231.out 343.out 662.out 425.out 329.out 165.out 334.out 103.out 003.out 129.out 423.out 371.out 234.out 183.out 671.out 645.out 673.out 190.out 486.out 223.out 123.out 262.out 669.out 023.out 459.out 616.out 032.out 266.out 146.out 398.out 728.out 696.out 427.out 590.out 280.out 470.out 455.out 187.out 091.out 046.out 374.out 631.out 328.out 260.out 654.out 359.out 531.out 649.out 301.out 101.out 635.out 623.out 385.out 331.out 556.out 713.out 613.out 513.out 622.out 131.out 213.out 634.out 031.out 565.out 630.out 675.out 272.out 530.out 510.out 627.out 573.out 576.out 430.out 310.out 569.out 454.out 259.out 210.out 449.out 327.out 330.out 067.out 093.out 604.out 287.out 127.out 699.out 166.out 130.out 219.out 073.out 603.out 503.out 303.out 203.out 354.out 157.out 386.out 349.out 055.out 245.out 709.out 522.out 422.out 222.out 159.out 539.out 249.out 122.out 689.out 022.out 681.out 424.out 321.out 066.out 490.out 435.out 375.out 134.out 154.out 566.out 618.out 501.out 418.out 318.out 542.out 218.out 118.out 018.out 377.out 172.out 168.out 079.out 469.out 054.out 059.out 049.out 442.out 657.out 621.out 180.out 270.out 253.out 421.out 712.out 612.out 667.out 512.out 494.out 221.out 212.out 112.out 256.out 012.out 029.out 195.out 554.out 148.out 185.out 596.out 720.out 248.out 196.out 520.out 242.out 420.out 285.out 320.out 629.out 230.out 602.out 502.out 402.out 102.out 717.out 617.out 517.out 429.out 417.out 365.out 092.out 117.out 664.out 072.out 068.out 229.out 038.out 084.out 369.out 611.out 511.out 311.out 368.out 637.out 111.out 011.out 257.out 194.out 170.out 606.out 133.out 286.out 043.out 437.out 545.out 559.out 710.out 610.out 687.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 096.out 114.out 113.out 074.out 581.out 145.out 641.out 491.out 081.out 071.out 083.out 653.out 700.out 064.out 400.out 300.out 200.out 100.out 646.out 541.out 445.out 269.out 546.out 656.out 698.out 553.out 178.out 298.out 446.out 080.out 070.out 608.out 507.out 409.out 309.out 209.out 108.out 009.out 643.out 004.out 557.out 453.out 666.out 236.out 078.out 364.out 555.out 383.out 085.out 704.out 588.out 504.out 404.out 304.out 204.out 535.out 345.out 246.out 467.out 086.out 254.out 207.out 142.out 235.out 436.out 703.out 135.out 264.out 431.out 678.out 373.out 316.out 169.out 640.out 579.out 297.out 153.out 560.out 663.out 599.out /var/lib/xfstests/tests/generic 2023-07-06T20:01:48.545 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LybHGoQKZdxfstests-dev/tests/nfs/ install 2023-07-06T20:01:48.546 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-07-06T20:01:48.555 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-07-06T20:01:48.564 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-07-06T20:01:48.574 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-07-06T20:01:48.585 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LybHGoQKZdxfstests-dev/tests/ocfs2/ install 2023-07-06T20:01:48.586 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-07-06T20:01:48.596 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-07-06T20:01:48.603 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-07-06T20:01:48.613 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-07-06T20:01:48.620 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LybHGoQKZdxfstests-dev/tests/overlay/ install 2023-07-06T20:01:48.622 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-07-06T20:01:48.631 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-07-06T20:01:48.907 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-07-06T20:01:48.916 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 019.out 034.out 018.out 024.out 077.out 069.out 020.out 102.out 014.out 013.out 031.out 015.out 117.out 017.out 072.out 068.out 063.out 048.out 062.out 038.out 026.out 042.out 052.out 110.out 067.out 029.out 111.out 055.out 112.out 073.out 078.out 030.out 058.out 003.out 045.out 023.out 043.out 053.out 109.out 036.out 116.out 016.out 065.out 010.out 001.out 022.out 106.out 007.out 006.out 115.out 057.out 113.out 114.out 074.out 046.out 071.out 061.out 025.out 051.out 011.out 041.out 047.out 100.out 064.out 107.out 104.out 028.out 076.out 054.out 059.out 008.out 049.out 032.out 039.out 021.out 005.out 002.out 035.out 108.out 070.out 060.out 050.out 027.out 105.out 009.out 004.out 037.out 044.out 012.out 101.out 103.out 033.out 066.out 040.out 056.out 075.out /var/lib/xfstests/tests/overlay 2023-07-06T20:01:49.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LybHGoQKZdxfstests-dev/tests/perf/ install 2023-07-06T20:01:49.194 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-07-06T20:01:49.204 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-07-06T20:01:49.212 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-07-06T20:01:49.222 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-07-06T20:01:49.230 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LybHGoQKZdxfstests-dev/tests/selftest/ install 2023-07-06T20:01:49.232 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-07-06T20:01:49.241 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-07-06T20:01:49.264 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-07-06T20:01:49.272 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-07-06T20:01:49.296 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LybHGoQKZdxfstests-dev/tests/shared/ install 2023-07-06T20:01:49.297 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-07-06T20:01:49.306 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-07-06T20:01:49.321 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-07-06T20:01:49.331 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-07-06T20:01:49.347 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LybHGoQKZdxfstests-dev/tests/tmpfs/ install 2023-07-06T20:01:49.347 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-07-06T20:01:49.357 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-07-06T20:01:49.364 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-07-06T20:01:49.373 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-07-06T20:01:49.381 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LybHGoQKZdxfstests-dev/tests/udf/ install 2023-07-06T20:01:49.385 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-07-06T20:01:49.392 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-07-06T20:01:49.402 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-07-06T20:01:49.410 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-07-06T20:01:49.420 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.LybHGoQKZdxfstests-dev/tests/xfs/ install 2023-07-06T20:01:49.424 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-07-06T20:01:49.433 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-07-06T20:01:50.186 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:01:50.189 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:01:51.379 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-07-06T20:01:51.388 INFO:teuthology.orchestra.run.smithi006.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 040.out 304.out 349.out 457.out 537.out 295.out 497.out 337.out 385.out 082.out 270.out 460.out 149.out 759.out 502.out 088.out 366.out 202.out 137.out 746.out 110.out 468.out 018.out 593.out 571.out 567.out 592.out 282.out 267.out 728.out 178.out 799.out 528.out 769.out 428.out 507.out 407.out 228.out 128.out 171.out 183.out 247.out 273.out 474.out 109.out 595.out 506.out 732.out 268.out 035.out 113.out 532.out 591.out 281.out 471.out 723.out 519.out 319.out 467.out 523.out 119.out 775.out 727.out 372.out 503.out 526.out 329.out 165.out 229.out 103.out 129.out 371.out 234.out 738.out 078.out 718.out 143.out 716.out 161.out 516.out 416.out 116.out 043.out 155.out 338.out 067.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 047.out 772.out 258.out 379.out 322.out 039.out 173.out 222.out 742.out 098.out 426.out 290.out 480.out 060.out 406.out 306.out 141.out 106.out 006.out 167.out 191.out 017.out 542.out 211.out 783.out 485.out 442.out 099.out 177.out 174.out 156.out 771.out 324.out 224.out 313.out 124.out 758.out 278.out 058.out 741.out 384.out 773.out 042.out 193.out 392.out 768.out 399.out 473.out 770.out 709.out 755.out 364.out 209.out 441.out 440.out 157.out 740.out 356.out 197.out 341.out 187.out 094.out 241.out 501.out 089.out 540.out 365.out 514.out 414.out 314.out 214.out 381.out 056.out 041.out 340.out 793.out 358.out 572.out 568.out 586.out 240.out 549.out 092.out 439.out 434.out 140.out 708.out 265.out 508.out 408.out 308.out 208.out 737.out 204.out 535.out 104.out 733.out 544.out 059.out 249.out 335.out 142.out 235.out 575.out 253.out 715.out 533.out 264.out 431.out 784.out 433.out 316.out 169.out 579.out 297.out 393.out 333.out 476.out 087.out 199.out 739.out 068.out 233.out 752.out 736.out 443.out 086.out 053.out 749.out 279.out 276.out 711.out 164.out 589.out 587.out 339.out 577.out 294.out 352.out 458.out 498.out 489.out 139.out 774.out 790.out 552.out 781.out 357.out 065.out 186.out 452.out 069.out 252.out 585.out 751.out 724.out 206.out 190.out 794.out 348.out 184.out 435.out 466.out 248.out 725.out 785.out 482.out 750.out 525.out 496.out 325.out 176.out 225.out 125.out 789.out 192.out 296.out 152.out 563.out 246.out 551.out 436.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 534.out 351.out 430.out 583.out 305.out 451.out 425.out 450.out 744.out 251.out 444.out 487.out 762.out 465.out 395.out 515.out 415.out 389.out 315.out 215.out 115.out 015.out 027.out 250.out 344.out 046.out 051.out 536.out 254.out 030.out 244.out 336.out 028.out 150.out 144.out 505.out 342.out 136.out 005.out 036.out 198.out 008.out 390.out 405.out 588.out 205.out 105.out 367.out 291.out 437.out 719.out 323.out 363.out 562.out 382.out 570.out 388.out 527.out 158.out 766.out 019.out 237.out 151.out 760.out 227.out 163.out 332.out 796.out 232.out 478.out 584.out 462.out 220.out 412.out 132.out 179.out 037.out 293.out 492.out 499.out 112.out 748.out 020.out 786.out 063.out 561.out 076.out 044.out 014.out 362.out 387.out 594.out 438.out 721.out 289.out 574.out 284.out 548.out 299.out 419.out 521.out 581.out 461.out 477.out 307.out 726.out 107.out 007.out 448.out 262.out 380.out 093.out 479.out 547.out 326.out 226.out 345.out 126.out 025.out 121.out 447.out 761.out 580.out 013.out 347.out 275.out 090.out 361.out 564.out 788.out 066.out 455.out 432.out 747.out 558.out 162.out 147.out 288.out 050.out 396.out 576.out 350.out 354.out 298.out 301.out 360.out 543.out 261.out 734.out 045.out 292.out 255.out 729.out 378.out 346.out 048.out 062.out 529.out 231.out 343.out 486.out 223.out 123.out 023.out 459.out 032.out 798.out 146.out 398.out 168.out 427.out 590.out 280.out 470.out 484.out 491.out 767.out 016.out 488.out 731.out 782.out 374.out 285.out 127.out 328.out 260.out 359.out 531.out 376.out 101.out 266.out 331.out 791.out 743.out 556.out 713.out 024.out 513.out 131.out 213.out 730.out 095.out 031.out 565.out 182.out 272.out 530.out 754.out 573.out 454.out 259.out 449.out 327.out 330.out 777.out 493.out 010.out 287.out 230.out 166.out 130.out 219.out 073.out 370.out 135.out 303.out 203.out 003.out 355.out 386.out 560.out 055.out 245.out 243.out 522.out 787.out 745.out 422.out 394.out 159.out 539.out 524.out 122.out 022.out 424.out 779.out 490.out 795.out 353.out 423.out 134.out 154.out 764.out 271.out 518.out 418.out 318.out 077.out 218.out 118.out 757.out 377.out 172.out 034.out 079.out 469.out 054.out 049.out 765.out 021.out 002.out 456.out 180.out 421.out 712.out 403.out 321.out 057.out 512.out 494.out 221.out 312.out 212.out 538.out 256.out 012.out 195.out 283.out 554.out 397.out 185.out 373.out 720.out 481.out 196.out 520.out 242.out 026.out 420.out 188.out 320.out 555.out 120.out 153.out 402.out 302.out 102.out 717.out 517.out 429.out 417.out 317.out 217.out 117.out 475.out 072.out 778.out 097.out 038.out 084.out 369.out 511.out 148.out 411.out 029.out 311.out 368.out 111.out 011.out 257.out 194.out 170.out 133.out 286.out 756.out 175.out 545.out 714.out 559.out 710.out 510.out 413.out 410.out 310.out 210.out 401.out 201.out 001.out 495.out 114.out 753.out 074.out 145.out 797.out 464.out 091.out 081.out 083.out 800.out 064.out 400.out 300.out 200.out 100.out 375.out 541.out 445.out 269.out 546.out 780.out 553.out 763.out 446.out 080.out 070.out 509.out 409.out 309.out 207.out 108.out 009.out 391.out 004.out 557.out 453.out 236.out 566.out 582.out 735.out 383.out 085.out 334.out 504.out 404.out 776.out /var/lib/xfstests/tests/xfs 2023-07-06T20:01:53.372 INFO:teuthology.orchestra.run.smithi006.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-07-06T20:01:53.380 INFO:teuthology.orchestra.run.smithi006.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-07-06T20:01:53.389 INFO:teuthology.orchestra.run.smithi006.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-07-06T20:01:53.399 INFO:teuthology.orchestra.run.smithi006.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-07-06T20:01:53.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-06T20:01:53.410 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec ls tests/generic) 2023-07-06T20:01:53.428 INFO:teuthology.orchestra.run.smithi006.stdout:001 2023-07-06T20:01:53.428 INFO:teuthology.orchestra.run.smithi006.stdout:001.out 2023-07-06T20:01:53.429 INFO:teuthology.orchestra.run.smithi006.stdout:002 2023-07-06T20:01:53.429 INFO:teuthology.orchestra.run.smithi006.stdout:002.out 2023-07-06T20:01:53.429 INFO:teuthology.orchestra.run.smithi006.stdout:003 2023-07-06T20:01:53.429 INFO:teuthology.orchestra.run.smithi006.stdout:003.out 2023-07-06T20:01:53.429 INFO:teuthology.orchestra.run.smithi006.stdout:004 2023-07-06T20:01:53.429 INFO:teuthology.orchestra.run.smithi006.stdout:004.out 2023-07-06T20:01:53.430 INFO:teuthology.orchestra.run.smithi006.stdout:005 2023-07-06T20:01:53.430 INFO:teuthology.orchestra.run.smithi006.stdout:005.out 2023-07-06T20:01:53.430 INFO:teuthology.orchestra.run.smithi006.stdout:006 2023-07-06T20:01:53.430 INFO:teuthology.orchestra.run.smithi006.stdout:006.out 2023-07-06T20:01:53.430 INFO:teuthology.orchestra.run.smithi006.stdout:007 2023-07-06T20:01:53.430 INFO:teuthology.orchestra.run.smithi006.stdout:007.out 2023-07-06T20:01:53.430 INFO:teuthology.orchestra.run.smithi006.stdout:008 2023-07-06T20:01:53.431 INFO:teuthology.orchestra.run.smithi006.stdout:008.out 2023-07-06T20:01:53.431 INFO:teuthology.orchestra.run.smithi006.stdout:009 2023-07-06T20:01:53.431 INFO:teuthology.orchestra.run.smithi006.stdout:009.out 2023-07-06T20:01:53.431 INFO:teuthology.orchestra.run.smithi006.stdout:010 2023-07-06T20:01:53.431 INFO:teuthology.orchestra.run.smithi006.stdout:010.out 2023-07-06T20:01:53.431 INFO:teuthology.orchestra.run.smithi006.stdout:011 2023-07-06T20:01:53.431 INFO:teuthology.orchestra.run.smithi006.stdout:011.out 2023-07-06T20:01:53.432 INFO:teuthology.orchestra.run.smithi006.stdout:012 2023-07-06T20:01:53.432 INFO:teuthology.orchestra.run.smithi006.stdout:012.out 2023-07-06T20:01:53.432 INFO:teuthology.orchestra.run.smithi006.stdout:013 2023-07-06T20:01:53.432 INFO:teuthology.orchestra.run.smithi006.stdout:013.out 2023-07-06T20:01:53.432 INFO:teuthology.orchestra.run.smithi006.stdout:014 2023-07-06T20:01:53.432 INFO:teuthology.orchestra.run.smithi006.stdout:014.out 2023-07-06T20:01:53.433 INFO:teuthology.orchestra.run.smithi006.stdout:015 2023-07-06T20:01:53.433 INFO:teuthology.orchestra.run.smithi006.stdout:015.out 2023-07-06T20:01:53.433 INFO:teuthology.orchestra.run.smithi006.stdout:016 2023-07-06T20:01:53.433 INFO:teuthology.orchestra.run.smithi006.stdout:016.out 2023-07-06T20:01:53.433 INFO:teuthology.orchestra.run.smithi006.stdout:017 2023-07-06T20:01:53.435 INFO:teuthology.orchestra.run.smithi006.stdout:017.out 2023-07-06T20:01:53.435 INFO:teuthology.orchestra.run.smithi006.stdout:018 2023-07-06T20:01:53.435 INFO:teuthology.orchestra.run.smithi006.stdout:018.out 2023-07-06T20:01:53.435 INFO:teuthology.orchestra.run.smithi006.stdout:019 2023-07-06T20:01:53.436 INFO:teuthology.orchestra.run.smithi006.stdout:019.out 2023-07-06T20:01:53.436 INFO:teuthology.orchestra.run.smithi006.stdout:020 2023-07-06T20:01:53.436 INFO:teuthology.orchestra.run.smithi006.stdout:020.out 2023-07-06T20:01:53.436 INFO:teuthology.orchestra.run.smithi006.stdout:021 2023-07-06T20:01:53.436 INFO:teuthology.orchestra.run.smithi006.stdout:021.out 2023-07-06T20:01:53.436 INFO:teuthology.orchestra.run.smithi006.stdout:022 2023-07-06T20:01:53.437 INFO:teuthology.orchestra.run.smithi006.stdout:022.out 2023-07-06T20:01:53.437 INFO:teuthology.orchestra.run.smithi006.stdout:023 2023-07-06T20:01:53.437 INFO:teuthology.orchestra.run.smithi006.stdout:023.out 2023-07-06T20:01:53.437 INFO:teuthology.orchestra.run.smithi006.stdout:024 2023-07-06T20:01:53.437 INFO:teuthology.orchestra.run.smithi006.stdout:024.out 2023-07-06T20:01:53.437 INFO:teuthology.orchestra.run.smithi006.stdout:025 2023-07-06T20:01:53.437 INFO:teuthology.orchestra.run.smithi006.stdout:025.out 2023-07-06T20:01:53.438 INFO:teuthology.orchestra.run.smithi006.stdout:026 2023-07-06T20:01:53.438 INFO:teuthology.orchestra.run.smithi006.stdout:026.out 2023-07-06T20:01:53.438 INFO:teuthology.orchestra.run.smithi006.stdout:027 2023-07-06T20:01:53.438 INFO:teuthology.orchestra.run.smithi006.stdout:027.out 2023-07-06T20:01:53.438 INFO:teuthology.orchestra.run.smithi006.stdout:028 2023-07-06T20:01:53.438 INFO:teuthology.orchestra.run.smithi006.stdout:028.out 2023-07-06T20:01:53.438 INFO:teuthology.orchestra.run.smithi006.stdout:029 2023-07-06T20:01:53.438 INFO:teuthology.orchestra.run.smithi006.stdout:029.out 2023-07-06T20:01:53.439 INFO:teuthology.orchestra.run.smithi006.stdout:030 2023-07-06T20:01:53.439 INFO:teuthology.orchestra.run.smithi006.stdout:030.out 2023-07-06T20:01:53.439 INFO:teuthology.orchestra.run.smithi006.stdout:031 2023-07-06T20:01:53.439 INFO:teuthology.orchestra.run.smithi006.stdout:031.out 2023-07-06T20:01:53.439 INFO:teuthology.orchestra.run.smithi006.stdout:032 2023-07-06T20:01:53.439 INFO:teuthology.orchestra.run.smithi006.stdout:032.out 2023-07-06T20:01:53.439 INFO:teuthology.orchestra.run.smithi006.stdout:033 2023-07-06T20:01:53.440 INFO:teuthology.orchestra.run.smithi006.stdout:033.out 2023-07-06T20:01:53.440 INFO:teuthology.orchestra.run.smithi006.stdout:034 2023-07-06T20:01:53.440 INFO:teuthology.orchestra.run.smithi006.stdout:034.out 2023-07-06T20:01:53.440 INFO:teuthology.orchestra.run.smithi006.stdout:035 2023-07-06T20:01:53.440 INFO:teuthology.orchestra.run.smithi006.stdout:035.cfg 2023-07-06T20:01:53.440 INFO:teuthology.orchestra.run.smithi006.stdout:035.out.default 2023-07-06T20:01:53.441 INFO:teuthology.orchestra.run.smithi006.stdout:035.out.nfs 2023-07-06T20:01:53.441 INFO:teuthology.orchestra.run.smithi006.stdout:036 2023-07-06T20:01:53.441 INFO:teuthology.orchestra.run.smithi006.stdout:036.out 2023-07-06T20:01:53.441 INFO:teuthology.orchestra.run.smithi006.stdout:037 2023-07-06T20:01:53.442 INFO:teuthology.orchestra.run.smithi006.stdout:037.out 2023-07-06T20:01:53.442 INFO:teuthology.orchestra.run.smithi006.stdout:038 2023-07-06T20:01:53.445 INFO:teuthology.orchestra.run.smithi006.stdout:038.out 2023-07-06T20:01:53.445 INFO:teuthology.orchestra.run.smithi006.stdout:039 2023-07-06T20:01:53.446 INFO:teuthology.orchestra.run.smithi006.stdout:039.out 2023-07-06T20:01:53.446 INFO:teuthology.orchestra.run.smithi006.stdout:040 2023-07-06T20:01:53.446 INFO:teuthology.orchestra.run.smithi006.stdout:040.out 2023-07-06T20:01:53.446 INFO:teuthology.orchestra.run.smithi006.stdout:041 2023-07-06T20:01:53.446 INFO:teuthology.orchestra.run.smithi006.stdout:041.out 2023-07-06T20:01:53.446 INFO:teuthology.orchestra.run.smithi006.stdout:042 2023-07-06T20:01:53.446 INFO:teuthology.orchestra.run.smithi006.stdout:042.out 2023-07-06T20:01:53.447 INFO:teuthology.orchestra.run.smithi006.stdout:043 2023-07-06T20:01:53.447 INFO:teuthology.orchestra.run.smithi006.stdout:043.out 2023-07-06T20:01:53.447 INFO:teuthology.orchestra.run.smithi006.stdout:044 2023-07-06T20:01:53.447 INFO:teuthology.orchestra.run.smithi006.stdout:044.out 2023-07-06T20:01:53.447 INFO:teuthology.orchestra.run.smithi006.stdout:045 2023-07-06T20:01:53.447 INFO:teuthology.orchestra.run.smithi006.stdout:045.out 2023-07-06T20:01:53.447 INFO:teuthology.orchestra.run.smithi006.stdout:046 2023-07-06T20:01:53.448 INFO:teuthology.orchestra.run.smithi006.stdout:046.out 2023-07-06T20:01:53.448 INFO:teuthology.orchestra.run.smithi006.stdout:047 2023-07-06T20:01:53.448 INFO:teuthology.orchestra.run.smithi006.stdout:047.out 2023-07-06T20:01:53.448 INFO:teuthology.orchestra.run.smithi006.stdout:048 2023-07-06T20:01:53.448 INFO:teuthology.orchestra.run.smithi006.stdout:048.out 2023-07-06T20:01:53.448 INFO:teuthology.orchestra.run.smithi006.stdout:049 2023-07-06T20:01:53.448 INFO:teuthology.orchestra.run.smithi006.stdout:049.out 2023-07-06T20:01:53.449 INFO:teuthology.orchestra.run.smithi006.stdout:050 2023-07-06T20:01:53.449 INFO:teuthology.orchestra.run.smithi006.stdout:050.cfg 2023-07-06T20:01:53.449 INFO:teuthology.orchestra.run.smithi006.stdout:050.out.default 2023-07-06T20:01:53.449 INFO:teuthology.orchestra.run.smithi006.stdout:050.out.nojournal 2023-07-06T20:01:53.449 INFO:teuthology.orchestra.run.smithi006.stdout:050.out.xfsquota 2023-07-06T20:01:53.449 INFO:teuthology.orchestra.run.smithi006.stdout:051 2023-07-06T20:01:53.449 INFO:teuthology.orchestra.run.smithi006.stdout:051.out 2023-07-06T20:01:53.450 INFO:teuthology.orchestra.run.smithi006.stdout:052 2023-07-06T20:01:53.450 INFO:teuthology.orchestra.run.smithi006.stdout:052.out 2023-07-06T20:01:53.450 INFO:teuthology.orchestra.run.smithi006.stdout:053 2023-07-06T20:01:53.450 INFO:teuthology.orchestra.run.smithi006.stdout:053.out 2023-07-06T20:01:53.450 INFO:teuthology.orchestra.run.smithi006.stdout:054 2023-07-06T20:01:53.450 INFO:teuthology.orchestra.run.smithi006.stdout:054.out 2023-07-06T20:01:53.450 INFO:teuthology.orchestra.run.smithi006.stdout:055 2023-07-06T20:01:53.450 INFO:teuthology.orchestra.run.smithi006.stdout:055.out 2023-07-06T20:01:53.451 INFO:teuthology.orchestra.run.smithi006.stdout:056 2023-07-06T20:01:53.451 INFO:teuthology.orchestra.run.smithi006.stdout:056.out 2023-07-06T20:01:53.451 INFO:teuthology.orchestra.run.smithi006.stdout:057 2023-07-06T20:01:53.451 INFO:teuthology.orchestra.run.smithi006.stdout:057.out 2023-07-06T20:01:53.451 INFO:teuthology.orchestra.run.smithi006.stdout:058 2023-07-06T20:01:53.451 INFO:teuthology.orchestra.run.smithi006.stdout:058.out 2023-07-06T20:01:53.451 INFO:teuthology.orchestra.run.smithi006.stdout:059 2023-07-06T20:01:53.451 INFO:teuthology.orchestra.run.smithi006.stdout:059.out 2023-07-06T20:01:53.452 INFO:teuthology.orchestra.run.smithi006.stdout:060 2023-07-06T20:01:53.452 INFO:teuthology.orchestra.run.smithi006.stdout:060.out 2023-07-06T20:01:53.452 INFO:teuthology.orchestra.run.smithi006.stdout:061 2023-07-06T20:01:53.452 INFO:teuthology.orchestra.run.smithi006.stdout:061.out 2023-07-06T20:01:53.452 INFO:teuthology.orchestra.run.smithi006.stdout:062 2023-07-06T20:01:53.452 INFO:teuthology.orchestra.run.smithi006.stdout:062.out 2023-07-06T20:01:53.453 INFO:teuthology.orchestra.run.smithi006.stdout:063 2023-07-06T20:01:53.453 INFO:teuthology.orchestra.run.smithi006.stdout:063.out 2023-07-06T20:01:53.453 INFO:teuthology.orchestra.run.smithi006.stdout:064 2023-07-06T20:01:53.453 INFO:teuthology.orchestra.run.smithi006.stdout:064.out 2023-07-06T20:01:53.454 INFO:teuthology.orchestra.run.smithi006.stdout:065 2023-07-06T20:01:53.454 INFO:teuthology.orchestra.run.smithi006.stdout:065.out 2023-07-06T20:01:53.454 INFO:teuthology.orchestra.run.smithi006.stdout:066 2023-07-06T20:01:53.454 INFO:teuthology.orchestra.run.smithi006.stdout:066.out 2023-07-06T20:01:53.454 INFO:teuthology.orchestra.run.smithi006.stdout:067 2023-07-06T20:01:53.454 INFO:teuthology.orchestra.run.smithi006.stdout:067.out 2023-07-06T20:01:53.454 INFO:teuthology.orchestra.run.smithi006.stdout:068 2023-07-06T20:01:53.455 INFO:teuthology.orchestra.run.smithi006.stdout:068.out 2023-07-06T20:01:53.455 INFO:teuthology.orchestra.run.smithi006.stdout:069 2023-07-06T20:01:53.455 INFO:teuthology.orchestra.run.smithi006.stdout:069.out 2023-07-06T20:01:53.455 INFO:teuthology.orchestra.run.smithi006.stdout:070 2023-07-06T20:01:53.456 INFO:teuthology.orchestra.run.smithi006.stdout:070.out 2023-07-06T20:01:53.456 INFO:teuthology.orchestra.run.smithi006.stdout:071 2023-07-06T20:01:53.456 INFO:teuthology.orchestra.run.smithi006.stdout:071.out 2023-07-06T20:01:53.456 INFO:teuthology.orchestra.run.smithi006.stdout:072 2023-07-06T20:01:53.456 INFO:teuthology.orchestra.run.smithi006.stdout:072.out 2023-07-06T20:01:53.456 INFO:teuthology.orchestra.run.smithi006.stdout:073 2023-07-06T20:01:53.456 INFO:teuthology.orchestra.run.smithi006.stdout:073.out 2023-07-06T20:01:53.457 INFO:teuthology.orchestra.run.smithi006.stdout:074 2023-07-06T20:01:53.457 INFO:teuthology.orchestra.run.smithi006.stdout:074.out 2023-07-06T20:01:53.457 INFO:teuthology.orchestra.run.smithi006.stdout:075 2023-07-06T20:01:53.457 INFO:teuthology.orchestra.run.smithi006.stdout:075.out 2023-07-06T20:01:53.457 INFO:teuthology.orchestra.run.smithi006.stdout:076 2023-07-06T20:01:53.457 INFO:teuthology.orchestra.run.smithi006.stdout:076.out 2023-07-06T20:01:53.457 INFO:teuthology.orchestra.run.smithi006.stdout:077 2023-07-06T20:01:53.457 INFO:teuthology.orchestra.run.smithi006.stdout:077.out 2023-07-06T20:01:53.458 INFO:teuthology.orchestra.run.smithi006.stdout:078 2023-07-06T20:01:53.458 INFO:teuthology.orchestra.run.smithi006.stdout:078.out 2023-07-06T20:01:53.458 INFO:teuthology.orchestra.run.smithi006.stdout:079 2023-07-06T20:01:53.458 INFO:teuthology.orchestra.run.smithi006.stdout:079.out 2023-07-06T20:01:53.458 INFO:teuthology.orchestra.run.smithi006.stdout:080 2023-07-06T20:01:53.459 INFO:teuthology.orchestra.run.smithi006.stdout:080.out 2023-07-06T20:01:53.459 INFO:teuthology.orchestra.run.smithi006.stdout:081 2023-07-06T20:01:53.459 INFO:teuthology.orchestra.run.smithi006.stdout:081.out 2023-07-06T20:01:53.459 INFO:teuthology.orchestra.run.smithi006.stdout:082 2023-07-06T20:01:53.459 INFO:teuthology.orchestra.run.smithi006.stdout:082.out 2023-07-06T20:01:53.459 INFO:teuthology.orchestra.run.smithi006.stdout:083 2023-07-06T20:01:53.459 INFO:teuthology.orchestra.run.smithi006.stdout:083.out 2023-07-06T20:01:53.460 INFO:teuthology.orchestra.run.smithi006.stdout:084 2023-07-06T20:01:53.460 INFO:teuthology.orchestra.run.smithi006.stdout:084.out 2023-07-06T20:01:53.460 INFO:teuthology.orchestra.run.smithi006.stdout:085 2023-07-06T20:01:53.460 INFO:teuthology.orchestra.run.smithi006.stdout:085.out 2023-07-06T20:01:53.460 INFO:teuthology.orchestra.run.smithi006.stdout:086 2023-07-06T20:01:53.460 INFO:teuthology.orchestra.run.smithi006.stdout:086.out 2023-07-06T20:01:53.460 INFO:teuthology.orchestra.run.smithi006.stdout:087 2023-07-06T20:01:53.460 INFO:teuthology.orchestra.run.smithi006.stdout:087.out 2023-07-06T20:01:53.461 INFO:teuthology.orchestra.run.smithi006.stdout:088 2023-07-06T20:01:53.461 INFO:teuthology.orchestra.run.smithi006.stdout:088.out 2023-07-06T20:01:53.461 INFO:teuthology.orchestra.run.smithi006.stdout:089 2023-07-06T20:01:53.461 INFO:teuthology.orchestra.run.smithi006.stdout:089.out 2023-07-06T20:01:53.461 INFO:teuthology.orchestra.run.smithi006.stdout:090 2023-07-06T20:01:53.461 INFO:teuthology.orchestra.run.smithi006.stdout:090.out 2023-07-06T20:01:53.461 INFO:teuthology.orchestra.run.smithi006.stdout:091 2023-07-06T20:01:53.462 INFO:teuthology.orchestra.run.smithi006.stdout:091.out 2023-07-06T20:01:53.462 INFO:teuthology.orchestra.run.smithi006.stdout:092 2023-07-06T20:01:53.462 INFO:teuthology.orchestra.run.smithi006.stdout:092.out 2023-07-06T20:01:53.462 INFO:teuthology.orchestra.run.smithi006.stdout:093 2023-07-06T20:01:53.462 INFO:teuthology.orchestra.run.smithi006.stdout:093.out 2023-07-06T20:01:53.462 INFO:teuthology.orchestra.run.smithi006.stdout:094 2023-07-06T20:01:53.462 INFO:teuthology.orchestra.run.smithi006.stdout:094.out 2023-07-06T20:01:53.473 INFO:teuthology.orchestra.run.smithi006.stdout:095 2023-07-06T20:01:53.474 INFO:teuthology.orchestra.run.smithi006.stdout:095.out 2023-07-06T20:01:53.474 INFO:teuthology.orchestra.run.smithi006.stdout:096 2023-07-06T20:01:53.474 INFO:teuthology.orchestra.run.smithi006.stdout:096.out 2023-07-06T20:01:53.474 INFO:teuthology.orchestra.run.smithi006.stdout:097 2023-07-06T20:01:53.475 INFO:teuthology.orchestra.run.smithi006.stdout:097.out 2023-07-06T20:01:53.475 INFO:teuthology.orchestra.run.smithi006.stdout:098 2023-07-06T20:01:53.475 INFO:teuthology.orchestra.run.smithi006.stdout:098.out 2023-07-06T20:01:53.475 INFO:teuthology.orchestra.run.smithi006.stdout:099 2023-07-06T20:01:53.475 INFO:teuthology.orchestra.run.smithi006.stdout:099.out 2023-07-06T20:01:53.476 INFO:teuthology.orchestra.run.smithi006.stdout:100 2023-07-06T20:01:53.476 INFO:teuthology.orchestra.run.smithi006.stdout:100.out 2023-07-06T20:01:53.476 INFO:teuthology.orchestra.run.smithi006.stdout:101 2023-07-06T20:01:53.476 INFO:teuthology.orchestra.run.smithi006.stdout:101.out 2023-07-06T20:01:53.476 INFO:teuthology.orchestra.run.smithi006.stdout:102 2023-07-06T20:01:53.477 INFO:teuthology.orchestra.run.smithi006.stdout:102.out 2023-07-06T20:01:53.477 INFO:teuthology.orchestra.run.smithi006.stdout:103 2023-07-06T20:01:53.477 INFO:teuthology.orchestra.run.smithi006.stdout:103.out 2023-07-06T20:01:53.478 INFO:teuthology.orchestra.run.smithi006.stdout:104 2023-07-06T20:01:53.478 INFO:teuthology.orchestra.run.smithi006.stdout:104.out 2023-07-06T20:01:53.478 INFO:teuthology.orchestra.run.smithi006.stdout:105 2023-07-06T20:01:53.479 INFO:teuthology.orchestra.run.smithi006.stdout:105.out 2023-07-06T20:01:53.479 INFO:teuthology.orchestra.run.smithi006.stdout:106 2023-07-06T20:01:53.479 INFO:teuthology.orchestra.run.smithi006.stdout:106.out 2023-07-06T20:01:53.479 INFO:teuthology.orchestra.run.smithi006.stdout:107 2023-07-06T20:01:53.480 INFO:teuthology.orchestra.run.smithi006.stdout:107.out 2023-07-06T20:01:53.480 INFO:teuthology.orchestra.run.smithi006.stdout:108 2023-07-06T20:01:53.480 INFO:teuthology.orchestra.run.smithi006.stdout:108.out 2023-07-06T20:01:53.481 INFO:teuthology.orchestra.run.smithi006.stdout:109 2023-07-06T20:01:53.481 INFO:teuthology.orchestra.run.smithi006.stdout:109.out 2023-07-06T20:01:53.481 INFO:teuthology.orchestra.run.smithi006.stdout:110 2023-07-06T20:01:53.481 INFO:teuthology.orchestra.run.smithi006.stdout:110.out 2023-07-06T20:01:53.482 INFO:teuthology.orchestra.run.smithi006.stdout:111 2023-07-06T20:01:53.484 INFO:teuthology.orchestra.run.smithi006.stdout:111.out 2023-07-06T20:01:53.484 INFO:teuthology.orchestra.run.smithi006.stdout:112 2023-07-06T20:01:53.484 INFO:teuthology.orchestra.run.smithi006.stdout:112.out 2023-07-06T20:01:53.484 INFO:teuthology.orchestra.run.smithi006.stdout:113 2023-07-06T20:01:53.484 INFO:teuthology.orchestra.run.smithi006.stdout:113.out 2023-07-06T20:01:53.485 INFO:teuthology.orchestra.run.smithi006.stdout:114 2023-07-06T20:01:53.485 INFO:teuthology.orchestra.run.smithi006.stdout:114.out 2023-07-06T20:01:53.485 INFO:teuthology.orchestra.run.smithi006.stdout:115 2023-07-06T20:01:53.485 INFO:teuthology.orchestra.run.smithi006.stdout:115.out 2023-07-06T20:01:53.485 INFO:teuthology.orchestra.run.smithi006.stdout:116 2023-07-06T20:01:53.485 INFO:teuthology.orchestra.run.smithi006.stdout:116.out 2023-07-06T20:01:53.485 INFO:teuthology.orchestra.run.smithi006.stdout:117 2023-07-06T20:01:53.485 INFO:teuthology.orchestra.run.smithi006.stdout:117.out 2023-07-06T20:01:53.486 INFO:teuthology.orchestra.run.smithi006.stdout:118 2023-07-06T20:01:53.486 INFO:teuthology.orchestra.run.smithi006.stdout:118.out 2023-07-06T20:01:53.486 INFO:teuthology.orchestra.run.smithi006.stdout:119 2023-07-06T20:01:53.486 INFO:teuthology.orchestra.run.smithi006.stdout:119.out 2023-07-06T20:01:53.486 INFO:teuthology.orchestra.run.smithi006.stdout:120 2023-07-06T20:01:53.486 INFO:teuthology.orchestra.run.smithi006.stdout:120.out 2023-07-06T20:01:53.486 INFO:teuthology.orchestra.run.smithi006.stdout:121 2023-07-06T20:01:53.487 INFO:teuthology.orchestra.run.smithi006.stdout:121.out 2023-07-06T20:01:53.487 INFO:teuthology.orchestra.run.smithi006.stdout:122 2023-07-06T20:01:53.487 INFO:teuthology.orchestra.run.smithi006.stdout:122.out 2023-07-06T20:01:53.487 INFO:teuthology.orchestra.run.smithi006.stdout:123 2023-07-06T20:01:53.487 INFO:teuthology.orchestra.run.smithi006.stdout:123.out 2023-07-06T20:01:53.487 INFO:teuthology.orchestra.run.smithi006.stdout:124 2023-07-06T20:01:53.487 INFO:teuthology.orchestra.run.smithi006.stdout:124.out 2023-07-06T20:01:53.487 INFO:teuthology.orchestra.run.smithi006.stdout:125 2023-07-06T20:01:53.488 INFO:teuthology.orchestra.run.smithi006.stdout:125.out 2023-07-06T20:01:53.488 INFO:teuthology.orchestra.run.smithi006.stdout:126 2023-07-06T20:01:53.489 INFO:teuthology.orchestra.run.smithi006.stdout:126.out 2023-07-06T20:01:53.489 INFO:teuthology.orchestra.run.smithi006.stdout:127 2023-07-06T20:01:53.490 INFO:teuthology.orchestra.run.smithi006.stdout:127.out 2023-07-06T20:01:53.490 INFO:teuthology.orchestra.run.smithi006.stdout:128 2023-07-06T20:01:53.490 INFO:teuthology.orchestra.run.smithi006.stdout:128.out 2023-07-06T20:01:53.490 INFO:teuthology.orchestra.run.smithi006.stdout:129 2023-07-06T20:01:53.490 INFO:teuthology.orchestra.run.smithi006.stdout:129.out 2023-07-06T20:01:53.491 INFO:teuthology.orchestra.run.smithi006.stdout:130 2023-07-06T20:01:53.491 INFO:teuthology.orchestra.run.smithi006.stdout:130.out 2023-07-06T20:01:53.491 INFO:teuthology.orchestra.run.smithi006.stdout:131 2023-07-06T20:01:53.491 INFO:teuthology.orchestra.run.smithi006.stdout:131.out 2023-07-06T20:01:53.491 INFO:teuthology.orchestra.run.smithi006.stdout:132 2023-07-06T20:01:53.491 INFO:teuthology.orchestra.run.smithi006.stdout:132.out 2023-07-06T20:01:53.491 INFO:teuthology.orchestra.run.smithi006.stdout:133 2023-07-06T20:01:53.492 INFO:teuthology.orchestra.run.smithi006.stdout:133.out 2023-07-06T20:01:53.492 INFO:teuthology.orchestra.run.smithi006.stdout:134 2023-07-06T20:01:53.492 INFO:teuthology.orchestra.run.smithi006.stdout:134.out 2023-07-06T20:01:53.492 INFO:teuthology.orchestra.run.smithi006.stdout:135 2023-07-06T20:01:53.492 INFO:teuthology.orchestra.run.smithi006.stdout:135.out 2023-07-06T20:01:53.492 INFO:teuthology.orchestra.run.smithi006.stdout:136 2023-07-06T20:01:53.492 INFO:teuthology.orchestra.run.smithi006.stdout:136.out 2023-07-06T20:01:53.493 INFO:teuthology.orchestra.run.smithi006.stdout:137 2023-07-06T20:01:53.493 INFO:teuthology.orchestra.run.smithi006.stdout:137.out 2023-07-06T20:01:53.493 INFO:teuthology.orchestra.run.smithi006.stdout:138 2023-07-06T20:01:53.493 INFO:teuthology.orchestra.run.smithi006.stdout:138.out 2023-07-06T20:01:53.493 INFO:teuthology.orchestra.run.smithi006.stdout:139 2023-07-06T20:01:53.493 INFO:teuthology.orchestra.run.smithi006.stdout:139.out 2023-07-06T20:01:53.493 INFO:teuthology.orchestra.run.smithi006.stdout:140 2023-07-06T20:01:53.493 INFO:teuthology.orchestra.run.smithi006.stdout:140.out 2023-07-06T20:01:53.494 INFO:teuthology.orchestra.run.smithi006.stdout:141 2023-07-06T20:01:53.494 INFO:teuthology.orchestra.run.smithi006.stdout:141.out 2023-07-06T20:01:53.494 INFO:teuthology.orchestra.run.smithi006.stdout:142 2023-07-06T20:01:53.494 INFO:teuthology.orchestra.run.smithi006.stdout:142.out 2023-07-06T20:01:53.494 INFO:teuthology.orchestra.run.smithi006.stdout:143 2023-07-06T20:01:53.494 INFO:teuthology.orchestra.run.smithi006.stdout:143.out 2023-07-06T20:01:53.494 INFO:teuthology.orchestra.run.smithi006.stdout:144 2023-07-06T20:01:53.494 INFO:teuthology.orchestra.run.smithi006.stdout:144.out 2023-07-06T20:01:53.495 INFO:teuthology.orchestra.run.smithi006.stdout:145 2023-07-06T20:01:53.495 INFO:teuthology.orchestra.run.smithi006.stdout:145.out 2023-07-06T20:01:53.495 INFO:teuthology.orchestra.run.smithi006.stdout:146 2023-07-06T20:01:53.495 INFO:teuthology.orchestra.run.smithi006.stdout:146.out 2023-07-06T20:01:53.496 INFO:teuthology.orchestra.run.smithi006.stdout:147 2023-07-06T20:01:53.496 INFO:teuthology.orchestra.run.smithi006.stdout:147.out 2023-07-06T20:01:53.496 INFO:teuthology.orchestra.run.smithi006.stdout:148 2023-07-06T20:01:53.497 INFO:teuthology.orchestra.run.smithi006.stdout:148.out 2023-07-06T20:01:53.497 INFO:teuthology.orchestra.run.smithi006.stdout:149 2023-07-06T20:01:53.497 INFO:teuthology.orchestra.run.smithi006.stdout:149.out 2023-07-06T20:01:53.497 INFO:teuthology.orchestra.run.smithi006.stdout:150 2023-07-06T20:01:53.498 INFO:teuthology.orchestra.run.smithi006.stdout:150.out 2023-07-06T20:01:53.498 INFO:teuthology.orchestra.run.smithi006.stdout:151 2023-07-06T20:01:53.498 INFO:teuthology.orchestra.run.smithi006.stdout:151.out 2023-07-06T20:01:53.498 INFO:teuthology.orchestra.run.smithi006.stdout:152 2023-07-06T20:01:53.498 INFO:teuthology.orchestra.run.smithi006.stdout:152.out 2023-07-06T20:01:53.500 INFO:teuthology.orchestra.run.smithi006.stdout:153 2023-07-06T20:01:53.500 INFO:teuthology.orchestra.run.smithi006.stdout:153.out 2023-07-06T20:01:53.500 INFO:teuthology.orchestra.run.smithi006.stdout:154 2023-07-06T20:01:53.506 INFO:teuthology.orchestra.run.smithi006.stdout:154.out 2023-07-06T20:01:53.507 INFO:teuthology.orchestra.run.smithi006.stdout:155 2023-07-06T20:01:53.507 INFO:teuthology.orchestra.run.smithi006.stdout:155.out 2023-07-06T20:01:53.507 INFO:teuthology.orchestra.run.smithi006.stdout:156 2023-07-06T20:01:53.507 INFO:teuthology.orchestra.run.smithi006.stdout:156.out 2023-07-06T20:01:53.507 INFO:teuthology.orchestra.run.smithi006.stdout:157 2023-07-06T20:01:53.507 INFO:teuthology.orchestra.run.smithi006.stdout:157.out 2023-07-06T20:01:53.507 INFO:teuthology.orchestra.run.smithi006.stdout:158 2023-07-06T20:01:53.508 INFO:teuthology.orchestra.run.smithi006.stdout:158.out 2023-07-06T20:01:53.508 INFO:teuthology.orchestra.run.smithi006.stdout:159 2023-07-06T20:01:53.508 INFO:teuthology.orchestra.run.smithi006.stdout:159.out 2023-07-06T20:01:53.508 INFO:teuthology.orchestra.run.smithi006.stdout:160 2023-07-06T20:01:53.508 INFO:teuthology.orchestra.run.smithi006.stdout:160.out 2023-07-06T20:01:53.508 INFO:teuthology.orchestra.run.smithi006.stdout:161 2023-07-06T20:01:53.508 INFO:teuthology.orchestra.run.smithi006.stdout:161.out 2023-07-06T20:01:53.509 INFO:teuthology.orchestra.run.smithi006.stdout:162 2023-07-06T20:01:53.509 INFO:teuthology.orchestra.run.smithi006.stdout:162.out 2023-07-06T20:01:53.509 INFO:teuthology.orchestra.run.smithi006.stdout:163 2023-07-06T20:01:53.509 INFO:teuthology.orchestra.run.smithi006.stdout:163.out 2023-07-06T20:01:53.510 INFO:teuthology.orchestra.run.smithi006.stdout:164 2023-07-06T20:01:53.510 INFO:teuthology.orchestra.run.smithi006.stdout:164.out 2023-07-06T20:01:53.510 INFO:teuthology.orchestra.run.smithi006.stdout:165 2023-07-06T20:01:53.510 INFO:teuthology.orchestra.run.smithi006.stdout:165.out 2023-07-06T20:01:53.510 INFO:teuthology.orchestra.run.smithi006.stdout:166 2023-07-06T20:01:53.510 INFO:teuthology.orchestra.run.smithi006.stdout:166.out 2023-07-06T20:01:53.510 INFO:teuthology.orchestra.run.smithi006.stdout:167 2023-07-06T20:01:53.511 INFO:teuthology.orchestra.run.smithi006.stdout:167.out 2023-07-06T20:01:53.511 INFO:teuthology.orchestra.run.smithi006.stdout:168 2023-07-06T20:01:53.511 INFO:teuthology.orchestra.run.smithi006.stdout:168.out 2023-07-06T20:01:53.511 INFO:teuthology.orchestra.run.smithi006.stdout:169 2023-07-06T20:01:53.511 INFO:teuthology.orchestra.run.smithi006.stdout:169.out 2023-07-06T20:01:53.511 INFO:teuthology.orchestra.run.smithi006.stdout:170 2023-07-06T20:01:53.511 INFO:teuthology.orchestra.run.smithi006.stdout:170.out 2023-07-06T20:01:53.512 INFO:teuthology.orchestra.run.smithi006.stdout:171 2023-07-06T20:01:53.512 INFO:teuthology.orchestra.run.smithi006.stdout:171.out 2023-07-06T20:01:53.512 INFO:teuthology.orchestra.run.smithi006.stdout:172 2023-07-06T20:01:53.512 INFO:teuthology.orchestra.run.smithi006.stdout:172.out 2023-07-06T20:01:53.512 INFO:teuthology.orchestra.run.smithi006.stdout:173 2023-07-06T20:01:53.512 INFO:teuthology.orchestra.run.smithi006.stdout:173.out 2023-07-06T20:01:53.512 INFO:teuthology.orchestra.run.smithi006.stdout:174 2023-07-06T20:01:53.512 INFO:teuthology.orchestra.run.smithi006.stdout:174.out 2023-07-06T20:01:53.513 INFO:teuthology.orchestra.run.smithi006.stdout:175 2023-07-06T20:01:53.513 INFO:teuthology.orchestra.run.smithi006.stdout:175.out 2023-07-06T20:01:53.513 INFO:teuthology.orchestra.run.smithi006.stdout:176 2023-07-06T20:01:53.513 INFO:teuthology.orchestra.run.smithi006.stdout:176.out 2023-07-06T20:01:53.513 INFO:teuthology.orchestra.run.smithi006.stdout:177 2023-07-06T20:01:53.513 INFO:teuthology.orchestra.run.smithi006.stdout:177.out 2023-07-06T20:01:53.513 INFO:teuthology.orchestra.run.smithi006.stdout:178 2023-07-06T20:01:53.513 INFO:teuthology.orchestra.run.smithi006.stdout:178.out 2023-07-06T20:01:53.514 INFO:teuthology.orchestra.run.smithi006.stdout:179 2023-07-06T20:01:53.514 INFO:teuthology.orchestra.run.smithi006.stdout:179.out 2023-07-06T20:01:53.514 INFO:teuthology.orchestra.run.smithi006.stdout:180 2023-07-06T20:01:53.514 INFO:teuthology.orchestra.run.smithi006.stdout:180.out 2023-07-06T20:01:53.514 INFO:teuthology.orchestra.run.smithi006.stdout:181 2023-07-06T20:01:53.514 INFO:teuthology.orchestra.run.smithi006.stdout:181.out 2023-07-06T20:01:53.514 INFO:teuthology.orchestra.run.smithi006.stdout:182 2023-07-06T20:01:53.515 INFO:teuthology.orchestra.run.smithi006.stdout:182.out 2023-07-06T20:01:53.515 INFO:teuthology.orchestra.run.smithi006.stdout:183 2023-07-06T20:01:53.515 INFO:teuthology.orchestra.run.smithi006.stdout:183.out 2023-07-06T20:01:53.515 INFO:teuthology.orchestra.run.smithi006.stdout:184 2023-07-06T20:01:53.515 INFO:teuthology.orchestra.run.smithi006.stdout:184.out 2023-07-06T20:01:53.515 INFO:teuthology.orchestra.run.smithi006.stdout:185 2023-07-06T20:01:53.515 INFO:teuthology.orchestra.run.smithi006.stdout:185.out 2023-07-06T20:01:53.515 INFO:teuthology.orchestra.run.smithi006.stdout:186 2023-07-06T20:01:53.516 INFO:teuthology.orchestra.run.smithi006.stdout:186.out 2023-07-06T20:01:53.516 INFO:teuthology.orchestra.run.smithi006.stdout:187 2023-07-06T20:01:53.516 INFO:teuthology.orchestra.run.smithi006.stdout:187.out 2023-07-06T20:01:53.516 INFO:teuthology.orchestra.run.smithi006.stdout:188 2023-07-06T20:01:53.517 INFO:teuthology.orchestra.run.smithi006.stdout:188.out 2023-07-06T20:01:53.517 INFO:teuthology.orchestra.run.smithi006.stdout:189 2023-07-06T20:01:53.517 INFO:teuthology.orchestra.run.smithi006.stdout:189.out 2023-07-06T20:01:53.517 INFO:teuthology.orchestra.run.smithi006.stdout:190 2023-07-06T20:01:53.517 INFO:teuthology.orchestra.run.smithi006.stdout:190.out 2023-07-06T20:01:53.517 INFO:teuthology.orchestra.run.smithi006.stdout:191 2023-07-06T20:01:53.517 INFO:teuthology.orchestra.run.smithi006.stdout:191.out 2023-07-06T20:01:53.518 INFO:teuthology.orchestra.run.smithi006.stdout:192 2023-07-06T20:01:53.518 INFO:teuthology.orchestra.run.smithi006.stdout:192.out 2023-07-06T20:01:53.518 INFO:teuthology.orchestra.run.smithi006.stdout:193 2023-07-06T20:01:53.518 INFO:teuthology.orchestra.run.smithi006.stdout:193.out 2023-07-06T20:01:53.518 INFO:teuthology.orchestra.run.smithi006.stdout:194 2023-07-06T20:01:53.518 INFO:teuthology.orchestra.run.smithi006.stdout:194.out 2023-07-06T20:01:53.518 INFO:teuthology.orchestra.run.smithi006.stdout:195 2023-07-06T20:01:53.518 INFO:teuthology.orchestra.run.smithi006.stdout:195.out 2023-07-06T20:01:53.519 INFO:teuthology.orchestra.run.smithi006.stdout:196 2023-07-06T20:01:53.519 INFO:teuthology.orchestra.run.smithi006.stdout:196.out 2023-07-06T20:01:53.519 INFO:teuthology.orchestra.run.smithi006.stdout:197 2023-07-06T20:01:53.519 INFO:teuthology.orchestra.run.smithi006.stdout:197.out 2023-07-06T20:01:53.519 INFO:teuthology.orchestra.run.smithi006.stdout:198 2023-07-06T20:01:53.519 INFO:teuthology.orchestra.run.smithi006.stdout:198.out 2023-07-06T20:01:53.519 INFO:teuthology.orchestra.run.smithi006.stdout:199 2023-07-06T20:01:53.520 INFO:teuthology.orchestra.run.smithi006.stdout:199.out 2023-07-06T20:01:53.520 INFO:teuthology.orchestra.run.smithi006.stdout:200 2023-07-06T20:01:53.520 INFO:teuthology.orchestra.run.smithi006.stdout:200.out 2023-07-06T20:01:53.520 INFO:teuthology.orchestra.run.smithi006.stdout:201 2023-07-06T20:01:53.521 INFO:teuthology.orchestra.run.smithi006.stdout:201.out 2023-07-06T20:01:53.521 INFO:teuthology.orchestra.run.smithi006.stdout:202 2023-07-06T20:01:53.521 INFO:teuthology.orchestra.run.smithi006.stdout:202.out 2023-07-06T20:01:53.521 INFO:teuthology.orchestra.run.smithi006.stdout:203 2023-07-06T20:01:53.521 INFO:teuthology.orchestra.run.smithi006.stdout:203.out 2023-07-06T20:01:53.521 INFO:teuthology.orchestra.run.smithi006.stdout:204 2023-07-06T20:01:53.521 INFO:teuthology.orchestra.run.smithi006.stdout:204.out 2023-07-06T20:01:53.521 INFO:teuthology.orchestra.run.smithi006.stdout:205 2023-07-06T20:01:53.522 INFO:teuthology.orchestra.run.smithi006.stdout:205.out 2023-07-06T20:01:53.522 INFO:teuthology.orchestra.run.smithi006.stdout:206 2023-07-06T20:01:53.523 INFO:teuthology.orchestra.run.smithi006.stdout:206.out 2023-07-06T20:01:53.524 INFO:teuthology.orchestra.run.smithi006.stdout:207 2023-07-06T20:01:53.524 INFO:teuthology.orchestra.run.smithi006.stdout:207.out 2023-07-06T20:01:53.524 INFO:teuthology.orchestra.run.smithi006.stdout:208 2023-07-06T20:01:53.525 INFO:teuthology.orchestra.run.smithi006.stdout:208.out 2023-07-06T20:01:53.525 INFO:teuthology.orchestra.run.smithi006.stdout:209 2023-07-06T20:01:53.525 INFO:teuthology.orchestra.run.smithi006.stdout:209.out 2023-07-06T20:01:53.525 INFO:teuthology.orchestra.run.smithi006.stdout:210 2023-07-06T20:01:53.526 INFO:teuthology.orchestra.run.smithi006.stdout:210.out 2023-07-06T20:01:53.526 INFO:teuthology.orchestra.run.smithi006.stdout:211 2023-07-06T20:01:53.526 INFO:teuthology.orchestra.run.smithi006.stdout:211.out 2023-07-06T20:01:53.527 INFO:teuthology.orchestra.run.smithi006.stdout:212 2023-07-06T20:01:53.527 INFO:teuthology.orchestra.run.smithi006.stdout:212.out 2023-07-06T20:01:53.527 INFO:teuthology.orchestra.run.smithi006.stdout:213 2023-07-06T20:01:53.527 INFO:teuthology.orchestra.run.smithi006.stdout:213.out 2023-07-06T20:01:53.528 INFO:teuthology.orchestra.run.smithi006.stdout:214 2023-07-06T20:01:53.528 INFO:teuthology.orchestra.run.smithi006.stdout:214.out 2023-07-06T20:01:53.528 INFO:teuthology.orchestra.run.smithi006.stdout:215 2023-07-06T20:01:53.529 INFO:teuthology.orchestra.run.smithi006.stdout:215.out 2023-07-06T20:01:53.529 INFO:teuthology.orchestra.run.smithi006.stdout:216 2023-07-06T20:01:53.530 INFO:teuthology.orchestra.run.smithi006.stdout:216.out 2023-07-06T20:01:53.530 INFO:teuthology.orchestra.run.smithi006.stdout:217 2023-07-06T20:01:53.530 INFO:teuthology.orchestra.run.smithi006.stdout:217.out 2023-07-06T20:01:53.531 INFO:teuthology.orchestra.run.smithi006.stdout:218 2023-07-06T20:01:53.531 INFO:teuthology.orchestra.run.smithi006.stdout:218.out 2023-07-06T20:01:53.531 INFO:teuthology.orchestra.run.smithi006.stdout:219 2023-07-06T20:01:53.531 INFO:teuthology.orchestra.run.smithi006.stdout:219.out 2023-07-06T20:01:53.532 INFO:teuthology.orchestra.run.smithi006.stdout:220 2023-07-06T20:01:53.532 INFO:teuthology.orchestra.run.smithi006.stdout:220.out 2023-07-06T20:01:53.532 INFO:teuthology.orchestra.run.smithi006.stdout:221 2023-07-06T20:01:53.532 INFO:teuthology.orchestra.run.smithi006.stdout:221.out 2023-07-06T20:01:53.533 INFO:teuthology.orchestra.run.smithi006.stdout:222 2023-07-06T20:01:53.533 INFO:teuthology.orchestra.run.smithi006.stdout:222.out 2023-07-06T20:01:53.533 INFO:teuthology.orchestra.run.smithi006.stdout:223 2023-07-06T20:01:53.533 INFO:teuthology.orchestra.run.smithi006.stdout:223.out 2023-07-06T20:01:53.534 INFO:teuthology.orchestra.run.smithi006.stdout:224 2023-07-06T20:01:53.534 INFO:teuthology.orchestra.run.smithi006.stdout:224.out 2023-07-06T20:01:53.534 INFO:teuthology.orchestra.run.smithi006.stdout:225 2023-07-06T20:01:53.535 INFO:teuthology.orchestra.run.smithi006.stdout:225.out 2023-07-06T20:01:53.535 INFO:teuthology.orchestra.run.smithi006.stdout:226 2023-07-06T20:01:53.535 INFO:teuthology.orchestra.run.smithi006.stdout:226.out 2023-07-06T20:01:53.535 INFO:teuthology.orchestra.run.smithi006.stdout:227 2023-07-06T20:01:53.536 INFO:teuthology.orchestra.run.smithi006.stdout:227.out 2023-07-06T20:01:53.536 INFO:teuthology.orchestra.run.smithi006.stdout:228 2023-07-06T20:01:53.536 INFO:teuthology.orchestra.run.smithi006.stdout:228.out 2023-07-06T20:01:53.537 INFO:teuthology.orchestra.run.smithi006.stdout:229 2023-07-06T20:01:53.537 INFO:teuthology.orchestra.run.smithi006.stdout:229.out 2023-07-06T20:01:53.537 INFO:teuthology.orchestra.run.smithi006.stdout:230 2023-07-06T20:01:53.537 INFO:teuthology.orchestra.run.smithi006.stdout:230.out 2023-07-06T20:01:53.538 INFO:teuthology.orchestra.run.smithi006.stdout:231 2023-07-06T20:01:53.538 INFO:teuthology.orchestra.run.smithi006.stdout:231.out 2023-07-06T20:01:53.538 INFO:teuthology.orchestra.run.smithi006.stdout:232 2023-07-06T20:01:53.539 INFO:teuthology.orchestra.run.smithi006.stdout:232.out 2023-07-06T20:01:53.539 INFO:teuthology.orchestra.run.smithi006.stdout:233 2023-07-06T20:01:53.539 INFO:teuthology.orchestra.run.smithi006.stdout:233.out 2023-07-06T20:01:53.540 INFO:teuthology.orchestra.run.smithi006.stdout:234 2023-07-06T20:01:53.540 INFO:teuthology.orchestra.run.smithi006.stdout:234.out 2023-07-06T20:01:53.541 INFO:teuthology.orchestra.run.smithi006.stdout:235 2023-07-06T20:01:53.541 INFO:teuthology.orchestra.run.smithi006.stdout:235.out 2023-07-06T20:01:53.541 INFO:teuthology.orchestra.run.smithi006.stdout:236 2023-07-06T20:01:53.541 INFO:teuthology.orchestra.run.smithi006.stdout:236.out 2023-07-06T20:01:53.542 INFO:teuthology.orchestra.run.smithi006.stdout:237 2023-07-06T20:01:53.542 INFO:teuthology.orchestra.run.smithi006.stdout:237.out 2023-07-06T20:01:53.542 INFO:teuthology.orchestra.run.smithi006.stdout:238 2023-07-06T20:01:53.542 INFO:teuthology.orchestra.run.smithi006.stdout:238.out 2023-07-06T20:01:53.543 INFO:teuthology.orchestra.run.smithi006.stdout:239 2023-07-06T20:01:53.543 INFO:teuthology.orchestra.run.smithi006.stdout:239.out 2023-07-06T20:01:53.543 INFO:teuthology.orchestra.run.smithi006.stdout:240 2023-07-06T20:01:53.543 INFO:teuthology.orchestra.run.smithi006.stdout:240.out 2023-07-06T20:01:53.544 INFO:teuthology.orchestra.run.smithi006.stdout:241 2023-07-06T20:01:53.544 INFO:teuthology.orchestra.run.smithi006.stdout:241.out 2023-07-06T20:01:53.544 INFO:teuthology.orchestra.run.smithi006.stdout:242 2023-07-06T20:01:53.545 INFO:teuthology.orchestra.run.smithi006.stdout:242.out 2023-07-06T20:01:53.545 INFO:teuthology.orchestra.run.smithi006.stdout:243 2023-07-06T20:01:53.545 INFO:teuthology.orchestra.run.smithi006.stdout:243.out 2023-07-06T20:01:53.545 INFO:teuthology.orchestra.run.smithi006.stdout:244 2023-07-06T20:01:53.546 INFO:teuthology.orchestra.run.smithi006.stdout:244.out 2023-07-06T20:01:53.546 INFO:teuthology.orchestra.run.smithi006.stdout:245 2023-07-06T20:01:53.546 INFO:teuthology.orchestra.run.smithi006.stdout:245.out 2023-07-06T20:01:53.546 INFO:teuthology.orchestra.run.smithi006.stdout:246 2023-07-06T20:01:53.547 INFO:teuthology.orchestra.run.smithi006.stdout:246.out 2023-07-06T20:01:53.547 INFO:teuthology.orchestra.run.smithi006.stdout:247 2023-07-06T20:01:53.547 INFO:teuthology.orchestra.run.smithi006.stdout:247.out 2023-07-06T20:01:53.548 INFO:teuthology.orchestra.run.smithi006.stdout:248 2023-07-06T20:01:53.548 INFO:teuthology.orchestra.run.smithi006.stdout:248.out 2023-07-06T20:01:53.548 INFO:teuthology.orchestra.run.smithi006.stdout:249 2023-07-06T20:01:53.548 INFO:teuthology.orchestra.run.smithi006.stdout:249.out 2023-07-06T20:01:53.549 INFO:teuthology.orchestra.run.smithi006.stdout:250 2023-07-06T20:01:53.549 INFO:teuthology.orchestra.run.smithi006.stdout:250.out 2023-07-06T20:01:53.549 INFO:teuthology.orchestra.run.smithi006.stdout:251 2023-07-06T20:01:53.550 INFO:teuthology.orchestra.run.smithi006.stdout:251.out 2023-07-06T20:01:53.550 INFO:teuthology.orchestra.run.smithi006.stdout:252 2023-07-06T20:01:53.551 INFO:teuthology.orchestra.run.smithi006.stdout:252.out 2023-07-06T20:01:53.551 INFO:teuthology.orchestra.run.smithi006.stdout:253 2023-07-06T20:01:53.551 INFO:teuthology.orchestra.run.smithi006.stdout:253.out 2023-07-06T20:01:53.551 INFO:teuthology.orchestra.run.smithi006.stdout:254 2023-07-06T20:01:53.552 INFO:teuthology.orchestra.run.smithi006.stdout:254.out 2023-07-06T20:01:53.552 INFO:teuthology.orchestra.run.smithi006.stdout:255 2023-07-06T20:01:53.552 INFO:teuthology.orchestra.run.smithi006.stdout:255.out 2023-07-06T20:01:53.553 INFO:teuthology.orchestra.run.smithi006.stdout:256 2023-07-06T20:01:53.553 INFO:teuthology.orchestra.run.smithi006.stdout:256.out 2023-07-06T20:01:53.553 INFO:teuthology.orchestra.run.smithi006.stdout:257 2023-07-06T20:01:53.553 INFO:teuthology.orchestra.run.smithi006.stdout:257.out 2023-07-06T20:01:53.554 INFO:teuthology.orchestra.run.smithi006.stdout:258 2023-07-06T20:01:53.554 INFO:teuthology.orchestra.run.smithi006.stdout:258.out 2023-07-06T20:01:53.554 INFO:teuthology.orchestra.run.smithi006.stdout:259 2023-07-06T20:01:53.554 INFO:teuthology.orchestra.run.smithi006.stdout:259.out 2023-07-06T20:01:53.555 INFO:teuthology.orchestra.run.smithi006.stdout:260 2023-07-06T20:01:53.555 INFO:teuthology.orchestra.run.smithi006.stdout:260.out 2023-07-06T20:01:53.555 INFO:teuthology.orchestra.run.smithi006.stdout:261 2023-07-06T20:01:53.555 INFO:teuthology.orchestra.run.smithi006.stdout:261.out 2023-07-06T20:01:53.556 INFO:teuthology.orchestra.run.smithi006.stdout:262 2023-07-06T20:01:53.556 INFO:teuthology.orchestra.run.smithi006.stdout:262.out 2023-07-06T20:01:53.556 INFO:teuthology.orchestra.run.smithi006.stdout:263 2023-07-06T20:01:53.556 INFO:teuthology.orchestra.run.smithi006.stdout:263.out 2023-07-06T20:01:53.556 INFO:teuthology.orchestra.run.smithi006.stdout:264 2023-07-06T20:01:53.556 INFO:teuthology.orchestra.run.smithi006.stdout:264.out 2023-07-06T20:01:53.557 INFO:teuthology.orchestra.run.smithi006.stdout:265 2023-07-06T20:01:53.557 INFO:teuthology.orchestra.run.smithi006.stdout:265.out 2023-07-06T20:01:53.557 INFO:teuthology.orchestra.run.smithi006.stdout:266 2023-07-06T20:01:53.557 INFO:teuthology.orchestra.run.smithi006.stdout:266.out 2023-07-06T20:01:53.557 INFO:teuthology.orchestra.run.smithi006.stdout:267 2023-07-06T20:01:53.557 INFO:teuthology.orchestra.run.smithi006.stdout:267.out 2023-07-06T20:01:53.557 INFO:teuthology.orchestra.run.smithi006.stdout:268 2023-07-06T20:01:53.558 INFO:teuthology.orchestra.run.smithi006.stdout:268.out 2023-07-06T20:01:53.558 INFO:teuthology.orchestra.run.smithi006.stdout:269 2023-07-06T20:01:53.558 INFO:teuthology.orchestra.run.smithi006.stdout:269.out 2023-07-06T20:01:53.558 INFO:teuthology.orchestra.run.smithi006.stdout:270 2023-07-06T20:01:53.558 INFO:teuthology.orchestra.run.smithi006.stdout:270.out 2023-07-06T20:01:53.558 INFO:teuthology.orchestra.run.smithi006.stdout:271 2023-07-06T20:01:53.558 INFO:teuthology.orchestra.run.smithi006.stdout:271.out 2023-07-06T20:01:53.559 INFO:teuthology.orchestra.run.smithi006.stdout:272 2023-07-06T20:01:53.559 INFO:teuthology.orchestra.run.smithi006.stdout:272.out 2023-07-06T20:01:53.559 INFO:teuthology.orchestra.run.smithi006.stdout:273 2023-07-06T20:01:53.559 INFO:teuthology.orchestra.run.smithi006.stdout:273.out 2023-07-06T20:01:53.559 INFO:teuthology.orchestra.run.smithi006.stdout:274 2023-07-06T20:01:53.559 INFO:teuthology.orchestra.run.smithi006.stdout:274.out 2023-07-06T20:01:53.560 INFO:teuthology.orchestra.run.smithi006.stdout:275 2023-07-06T20:01:53.560 INFO:teuthology.orchestra.run.smithi006.stdout:275.out 2023-07-06T20:01:53.560 INFO:teuthology.orchestra.run.smithi006.stdout:276 2023-07-06T20:01:53.560 INFO:teuthology.orchestra.run.smithi006.stdout:276.out 2023-07-06T20:01:53.561 INFO:teuthology.orchestra.run.smithi006.stdout:277 2023-07-06T20:01:53.561 INFO:teuthology.orchestra.run.smithi006.stdout:277.out 2023-07-06T20:01:53.562 INFO:teuthology.orchestra.run.smithi006.stdout:278 2023-07-06T20:01:53.562 INFO:teuthology.orchestra.run.smithi006.stdout:278.out 2023-07-06T20:01:53.562 INFO:teuthology.orchestra.run.smithi006.stdout:279 2023-07-06T20:01:53.562 INFO:teuthology.orchestra.run.smithi006.stdout:279.out 2023-07-06T20:01:53.563 INFO:teuthology.orchestra.run.smithi006.stdout:280 2023-07-06T20:01:53.563 INFO:teuthology.orchestra.run.smithi006.stdout:280.out 2023-07-06T20:01:53.563 INFO:teuthology.orchestra.run.smithi006.stdout:281 2023-07-06T20:01:53.564 INFO:teuthology.orchestra.run.smithi006.stdout:281.out 2023-07-06T20:01:53.564 INFO:teuthology.orchestra.run.smithi006.stdout:282 2023-07-06T20:01:53.564 INFO:teuthology.orchestra.run.smithi006.stdout:282.out 2023-07-06T20:01:53.564 INFO:teuthology.orchestra.run.smithi006.stdout:283 2023-07-06T20:01:53.565 INFO:teuthology.orchestra.run.smithi006.stdout:283.out 2023-07-06T20:01:53.565 INFO:teuthology.orchestra.run.smithi006.stdout:284 2023-07-06T20:01:53.565 INFO:teuthology.orchestra.run.smithi006.stdout:284.out 2023-07-06T20:01:53.566 INFO:teuthology.orchestra.run.smithi006.stdout:285 2023-07-06T20:01:53.566 INFO:teuthology.orchestra.run.smithi006.stdout:285.out 2023-07-06T20:01:53.566 INFO:teuthology.orchestra.run.smithi006.stdout:286 2023-07-06T20:01:53.566 INFO:teuthology.orchestra.run.smithi006.stdout:286.out 2023-07-06T20:01:53.567 INFO:teuthology.orchestra.run.smithi006.stdout:287 2023-07-06T20:01:53.567 INFO:teuthology.orchestra.run.smithi006.stdout:287.out 2023-07-06T20:01:53.567 INFO:teuthology.orchestra.run.smithi006.stdout:288 2023-07-06T20:01:53.567 INFO:teuthology.orchestra.run.smithi006.stdout:288.out 2023-07-06T20:01:53.568 INFO:teuthology.orchestra.run.smithi006.stdout:289 2023-07-06T20:01:53.568 INFO:teuthology.orchestra.run.smithi006.stdout:289.out 2023-07-06T20:01:53.569 INFO:teuthology.orchestra.run.smithi006.stdout:290 2023-07-06T20:01:53.569 INFO:teuthology.orchestra.run.smithi006.stdout:290.out 2023-07-06T20:01:53.569 INFO:teuthology.orchestra.run.smithi006.stdout:291 2023-07-06T20:01:53.569 INFO:teuthology.orchestra.run.smithi006.stdout:291.out 2023-07-06T20:01:53.570 INFO:teuthology.orchestra.run.smithi006.stdout:292 2023-07-06T20:01:53.570 INFO:teuthology.orchestra.run.smithi006.stdout:292.out 2023-07-06T20:01:53.570 INFO:teuthology.orchestra.run.smithi006.stdout:293 2023-07-06T20:01:53.570 INFO:teuthology.orchestra.run.smithi006.stdout:293.out 2023-07-06T20:01:53.571 INFO:teuthology.orchestra.run.smithi006.stdout:294 2023-07-06T20:01:53.572 INFO:teuthology.orchestra.run.smithi006.stdout:294.out 2023-07-06T20:01:53.572 INFO:teuthology.orchestra.run.smithi006.stdout:295 2023-07-06T20:01:53.572 INFO:teuthology.orchestra.run.smithi006.stdout:295.out 2023-07-06T20:01:53.572 INFO:teuthology.orchestra.run.smithi006.stdout:296 2023-07-06T20:01:53.573 INFO:teuthology.orchestra.run.smithi006.stdout:296.out 2023-07-06T20:01:53.573 INFO:teuthology.orchestra.run.smithi006.stdout:297 2023-07-06T20:01:53.573 INFO:teuthology.orchestra.run.smithi006.stdout:297.out 2023-07-06T20:01:53.574 INFO:teuthology.orchestra.run.smithi006.stdout:298 2023-07-06T20:01:53.574 INFO:teuthology.orchestra.run.smithi006.stdout:298.out 2023-07-06T20:01:53.574 INFO:teuthology.orchestra.run.smithi006.stdout:299 2023-07-06T20:01:53.574 INFO:teuthology.orchestra.run.smithi006.stdout:299.out 2023-07-06T20:01:53.575 INFO:teuthology.orchestra.run.smithi006.stdout:300 2023-07-06T20:01:53.575 INFO:teuthology.orchestra.run.smithi006.stdout:300.out 2023-07-06T20:01:53.575 INFO:teuthology.orchestra.run.smithi006.stdout:301 2023-07-06T20:01:53.576 INFO:teuthology.orchestra.run.smithi006.stdout:301.out 2023-07-06T20:01:53.576 INFO:teuthology.orchestra.run.smithi006.stdout:302 2023-07-06T20:01:53.576 INFO:teuthology.orchestra.run.smithi006.stdout:302.out 2023-07-06T20:01:53.576 INFO:teuthology.orchestra.run.smithi006.stdout:303 2023-07-06T20:01:53.577 INFO:teuthology.orchestra.run.smithi006.stdout:303.out 2023-07-06T20:01:53.577 INFO:teuthology.orchestra.run.smithi006.stdout:304 2023-07-06T20:01:53.578 INFO:teuthology.orchestra.run.smithi006.stdout:304.out 2023-07-06T20:01:53.578 INFO:teuthology.orchestra.run.smithi006.stdout:305 2023-07-06T20:01:53.578 INFO:teuthology.orchestra.run.smithi006.stdout:305.out 2023-07-06T20:01:53.578 INFO:teuthology.orchestra.run.smithi006.stdout:306 2023-07-06T20:01:53.579 INFO:teuthology.orchestra.run.smithi006.stdout:306.out 2023-07-06T20:01:53.579 INFO:teuthology.orchestra.run.smithi006.stdout:307 2023-07-06T20:01:53.579 INFO:teuthology.orchestra.run.smithi006.stdout:307.out 2023-07-06T20:01:53.580 INFO:teuthology.orchestra.run.smithi006.stdout:308 2023-07-06T20:01:53.580 INFO:teuthology.orchestra.run.smithi006.stdout:308.out 2023-07-06T20:01:53.580 INFO:teuthology.orchestra.run.smithi006.stdout:309 2023-07-06T20:01:53.580 INFO:teuthology.orchestra.run.smithi006.stdout:309.out 2023-07-06T20:01:53.581 INFO:teuthology.orchestra.run.smithi006.stdout:310 2023-07-06T20:01:53.581 INFO:teuthology.orchestra.run.smithi006.stdout:310.out 2023-07-06T20:01:53.582 INFO:teuthology.orchestra.run.smithi006.stdout:311 2023-07-06T20:01:53.582 INFO:teuthology.orchestra.run.smithi006.stdout:311.out 2023-07-06T20:01:53.583 INFO:teuthology.orchestra.run.smithi006.stdout:312 2023-07-06T20:01:53.584 INFO:teuthology.orchestra.run.smithi006.stdout:312.out 2023-07-06T20:01:53.584 INFO:teuthology.orchestra.run.smithi006.stdout:313 2023-07-06T20:01:53.584 INFO:teuthology.orchestra.run.smithi006.stdout:313.out 2023-07-06T20:01:53.585 INFO:teuthology.orchestra.run.smithi006.stdout:314 2023-07-06T20:01:53.585 INFO:teuthology.orchestra.run.smithi006.stdout:314.out 2023-07-06T20:01:53.586 INFO:teuthology.orchestra.run.smithi006.stdout:315 2023-07-06T20:01:53.587 INFO:teuthology.orchestra.run.smithi006.stdout:315.out 2023-07-06T20:01:53.587 INFO:teuthology.orchestra.run.smithi006.stdout:316 2023-07-06T20:01:53.587 INFO:teuthology.orchestra.run.smithi006.stdout:316.out 2023-07-06T20:01:53.587 INFO:teuthology.orchestra.run.smithi006.stdout:317 2023-07-06T20:01:53.588 INFO:teuthology.orchestra.run.smithi006.stdout:317.out 2023-07-06T20:01:53.588 INFO:teuthology.orchestra.run.smithi006.stdout:318 2023-07-06T20:01:53.588 INFO:teuthology.orchestra.run.smithi006.stdout:318.out 2023-07-06T20:01:53.589 INFO:teuthology.orchestra.run.smithi006.stdout:319 2023-07-06T20:01:53.589 INFO:teuthology.orchestra.run.smithi006.stdout:319.out 2023-07-06T20:01:53.589 INFO:teuthology.orchestra.run.smithi006.stdout:320 2023-07-06T20:01:53.590 INFO:teuthology.orchestra.run.smithi006.stdout:320.out 2023-07-06T20:01:53.590 INFO:teuthology.orchestra.run.smithi006.stdout:321 2023-07-06T20:01:53.590 INFO:teuthology.orchestra.run.smithi006.stdout:321.out 2023-07-06T20:01:53.590 INFO:teuthology.orchestra.run.smithi006.stdout:322 2023-07-06T20:01:53.591 INFO:teuthology.orchestra.run.smithi006.stdout:322.out 2023-07-06T20:01:53.591 INFO:teuthology.orchestra.run.smithi006.stdout:323 2023-07-06T20:01:53.591 INFO:teuthology.orchestra.run.smithi006.stdout:323.out 2023-07-06T20:01:53.592 INFO:teuthology.orchestra.run.smithi006.stdout:324 2023-07-06T20:01:53.593 INFO:teuthology.orchestra.run.smithi006.stdout:324.out 2023-07-06T20:01:53.593 INFO:teuthology.orchestra.run.smithi006.stdout:325 2023-07-06T20:01:53.593 INFO:teuthology.orchestra.run.smithi006.stdout:325.out 2023-07-06T20:01:53.594 INFO:teuthology.orchestra.run.smithi006.stdout:326 2023-07-06T20:01:53.594 INFO:teuthology.orchestra.run.smithi006.stdout:326.out 2023-07-06T20:01:53.594 INFO:teuthology.orchestra.run.smithi006.stdout:327 2023-07-06T20:01:53.594 INFO:teuthology.orchestra.run.smithi006.stdout:327.out 2023-07-06T20:01:53.595 INFO:teuthology.orchestra.run.smithi006.stdout:328 2023-07-06T20:01:53.595 INFO:teuthology.orchestra.run.smithi006.stdout:328.out 2023-07-06T20:01:53.595 INFO:teuthology.orchestra.run.smithi006.stdout:329 2023-07-06T20:01:53.596 INFO:teuthology.orchestra.run.smithi006.stdout:329.out 2023-07-06T20:01:53.596 INFO:teuthology.orchestra.run.smithi006.stdout:330 2023-07-06T20:01:53.596 INFO:teuthology.orchestra.run.smithi006.stdout:330.out 2023-07-06T20:01:53.597 INFO:teuthology.orchestra.run.smithi006.stdout:331 2023-07-06T20:01:53.597 INFO:teuthology.orchestra.run.smithi006.stdout:331.out 2023-07-06T20:01:53.597 INFO:teuthology.orchestra.run.smithi006.stdout:332 2023-07-06T20:01:53.597 INFO:teuthology.orchestra.run.smithi006.stdout:332.out 2023-07-06T20:01:53.598 INFO:teuthology.orchestra.run.smithi006.stdout:333 2023-07-06T20:01:53.598 INFO:teuthology.orchestra.run.smithi006.stdout:333.out 2023-07-06T20:01:53.598 INFO:teuthology.orchestra.run.smithi006.stdout:334 2023-07-06T20:01:53.598 INFO:teuthology.orchestra.run.smithi006.stdout:334.out 2023-07-06T20:01:53.599 INFO:teuthology.orchestra.run.smithi006.stdout:335 2023-07-06T20:01:53.599 INFO:teuthology.orchestra.run.smithi006.stdout:335.out 2023-07-06T20:01:53.599 INFO:teuthology.orchestra.run.smithi006.stdout:336 2023-07-06T20:01:53.600 INFO:teuthology.orchestra.run.smithi006.stdout:336.out 2023-07-06T20:01:53.600 INFO:teuthology.orchestra.run.smithi006.stdout:337 2023-07-06T20:01:53.600 INFO:teuthology.orchestra.run.smithi006.stdout:337.out 2023-07-06T20:01:53.600 INFO:teuthology.orchestra.run.smithi006.stdout:338 2023-07-06T20:01:53.601 INFO:teuthology.orchestra.run.smithi006.stdout:338.out 2023-07-06T20:01:53.601 INFO:teuthology.orchestra.run.smithi006.stdout:339 2023-07-06T20:01:53.601 INFO:teuthology.orchestra.run.smithi006.stdout:339.out 2023-07-06T20:01:53.602 INFO:teuthology.orchestra.run.smithi006.stdout:340 2023-07-06T20:01:53.602 INFO:teuthology.orchestra.run.smithi006.stdout:340.out 2023-07-06T20:01:53.602 INFO:teuthology.orchestra.run.smithi006.stdout:341 2023-07-06T20:01:53.603 INFO:teuthology.orchestra.run.smithi006.stdout:341.out 2023-07-06T20:01:53.603 INFO:teuthology.orchestra.run.smithi006.stdout:342 2023-07-06T20:01:53.604 INFO:teuthology.orchestra.run.smithi006.stdout:342.out 2023-07-06T20:01:53.604 INFO:teuthology.orchestra.run.smithi006.stdout:343 2023-07-06T20:01:53.604 INFO:teuthology.orchestra.run.smithi006.stdout:343.out 2023-07-06T20:01:53.604 INFO:teuthology.orchestra.run.smithi006.stdout:344 2023-07-06T20:01:53.605 INFO:teuthology.orchestra.run.smithi006.stdout:344.out 2023-07-06T20:01:53.605 INFO:teuthology.orchestra.run.smithi006.stdout:345 2023-07-06T20:01:53.605 INFO:teuthology.orchestra.run.smithi006.stdout:345.out 2023-07-06T20:01:53.605 INFO:teuthology.orchestra.run.smithi006.stdout:346 2023-07-06T20:01:53.606 INFO:teuthology.orchestra.run.smithi006.stdout:346.out 2023-07-06T20:01:53.606 INFO:teuthology.orchestra.run.smithi006.stdout:347 2023-07-06T20:01:53.606 INFO:teuthology.orchestra.run.smithi006.stdout:347.out 2023-07-06T20:01:53.606 INFO:teuthology.orchestra.run.smithi006.stdout:348 2023-07-06T20:01:53.607 INFO:teuthology.orchestra.run.smithi006.stdout:348.out 2023-07-06T20:01:53.607 INFO:teuthology.orchestra.run.smithi006.stdout:349 2023-07-06T20:01:53.607 INFO:teuthology.orchestra.run.smithi006.stdout:349.out 2023-07-06T20:01:53.608 INFO:teuthology.orchestra.run.smithi006.stdout:350 2023-07-06T20:01:53.608 INFO:teuthology.orchestra.run.smithi006.stdout:350.out 2023-07-06T20:01:53.608 INFO:teuthology.orchestra.run.smithi006.stdout:351 2023-07-06T20:01:53.608 INFO:teuthology.orchestra.run.smithi006.stdout:351.out 2023-07-06T20:01:53.609 INFO:teuthology.orchestra.run.smithi006.stdout:352 2023-07-06T20:01:53.609 INFO:teuthology.orchestra.run.smithi006.stdout:352.out 2023-07-06T20:01:53.609 INFO:teuthology.orchestra.run.smithi006.stdout:353 2023-07-06T20:01:53.609 INFO:teuthology.orchestra.run.smithi006.stdout:353.out 2023-07-06T20:01:53.609 INFO:teuthology.orchestra.run.smithi006.stdout:354 2023-07-06T20:01:53.609 INFO:teuthology.orchestra.run.smithi006.stdout:354.out 2023-07-06T20:01:53.610 INFO:teuthology.orchestra.run.smithi006.stdout:355 2023-07-06T20:01:53.610 INFO:teuthology.orchestra.run.smithi006.stdout:355.out 2023-07-06T20:01:53.610 INFO:teuthology.orchestra.run.smithi006.stdout:356 2023-07-06T20:01:53.610 INFO:teuthology.orchestra.run.smithi006.stdout:356.out 2023-07-06T20:01:53.610 INFO:teuthology.orchestra.run.smithi006.stdout:357 2023-07-06T20:01:53.610 INFO:teuthology.orchestra.run.smithi006.stdout:357.out 2023-07-06T20:01:53.610 INFO:teuthology.orchestra.run.smithi006.stdout:358 2023-07-06T20:01:53.611 INFO:teuthology.orchestra.run.smithi006.stdout:358.out 2023-07-06T20:01:53.611 INFO:teuthology.orchestra.run.smithi006.stdout:359 2023-07-06T20:01:53.611 INFO:teuthology.orchestra.run.smithi006.stdout:359.out 2023-07-06T20:01:53.611 INFO:teuthology.orchestra.run.smithi006.stdout:360 2023-07-06T20:01:53.611 INFO:teuthology.orchestra.run.smithi006.stdout:360.out 2023-07-06T20:01:53.612 INFO:teuthology.orchestra.run.smithi006.stdout:361 2023-07-06T20:01:53.612 INFO:teuthology.orchestra.run.smithi006.stdout:361.out 2023-07-06T20:01:53.612 INFO:teuthology.orchestra.run.smithi006.stdout:362 2023-07-06T20:01:53.612 INFO:teuthology.orchestra.run.smithi006.stdout:362.out 2023-07-06T20:01:53.612 INFO:teuthology.orchestra.run.smithi006.stdout:363 2023-07-06T20:01:53.612 INFO:teuthology.orchestra.run.smithi006.stdout:363.out 2023-07-06T20:01:53.612 INFO:teuthology.orchestra.run.smithi006.stdout:364 2023-07-06T20:01:53.613 INFO:teuthology.orchestra.run.smithi006.stdout:364.out 2023-07-06T20:01:53.613 INFO:teuthology.orchestra.run.smithi006.stdout:365 2023-07-06T20:01:53.616 INFO:teuthology.orchestra.run.smithi006.stdout:365.out 2023-07-06T20:01:53.617 INFO:teuthology.orchestra.run.smithi006.stdout:366 2023-07-06T20:01:53.617 INFO:teuthology.orchestra.run.smithi006.stdout:366.out 2023-07-06T20:01:53.617 INFO:teuthology.orchestra.run.smithi006.stdout:367 2023-07-06T20:01:53.617 INFO:teuthology.orchestra.run.smithi006.stdout:367.out 2023-07-06T20:01:53.618 INFO:teuthology.orchestra.run.smithi006.stdout:368 2023-07-06T20:01:53.618 INFO:teuthology.orchestra.run.smithi006.stdout:368.out 2023-07-06T20:01:53.618 INFO:teuthology.orchestra.run.smithi006.stdout:369 2023-07-06T20:01:53.618 INFO:teuthology.orchestra.run.smithi006.stdout:369.out 2023-07-06T20:01:53.619 INFO:teuthology.orchestra.run.smithi006.stdout:370 2023-07-06T20:01:53.619 INFO:teuthology.orchestra.run.smithi006.stdout:370.out 2023-07-06T20:01:53.619 INFO:teuthology.orchestra.run.smithi006.stdout:371 2023-07-06T20:01:53.620 INFO:teuthology.orchestra.run.smithi006.stdout:371.out 2023-07-06T20:01:53.620 INFO:teuthology.orchestra.run.smithi006.stdout:372 2023-07-06T20:01:53.622 INFO:teuthology.orchestra.run.smithi006.stdout:372.out 2023-07-06T20:01:53.622 INFO:teuthology.orchestra.run.smithi006.stdout:373 2023-07-06T20:01:53.624 INFO:teuthology.orchestra.run.smithi006.stdout:373.out 2023-07-06T20:01:53.624 INFO:teuthology.orchestra.run.smithi006.stdout:374 2023-07-06T20:01:53.624 INFO:teuthology.orchestra.run.smithi006.stdout:374.out 2023-07-06T20:01:53.624 INFO:teuthology.orchestra.run.smithi006.stdout:375 2023-07-06T20:01:53.624 INFO:teuthology.orchestra.run.smithi006.stdout:375.out 2023-07-06T20:01:53.625 INFO:teuthology.orchestra.run.smithi006.stdout:376 2023-07-06T20:01:53.625 INFO:teuthology.orchestra.run.smithi006.stdout:376.out 2023-07-06T20:01:53.625 INFO:teuthology.orchestra.run.smithi006.stdout:377 2023-07-06T20:01:53.625 INFO:teuthology.orchestra.run.smithi006.stdout:377.out 2023-07-06T20:01:53.625 INFO:teuthology.orchestra.run.smithi006.stdout:378 2023-07-06T20:01:53.625 INFO:teuthology.orchestra.run.smithi006.stdout:378.out 2023-07-06T20:01:53.625 INFO:teuthology.orchestra.run.smithi006.stdout:379 2023-07-06T20:01:53.626 INFO:teuthology.orchestra.run.smithi006.stdout:379.out 2023-07-06T20:01:53.626 INFO:teuthology.orchestra.run.smithi006.stdout:380 2023-07-06T20:01:53.626 INFO:teuthology.orchestra.run.smithi006.stdout:380.out 2023-07-06T20:01:53.626 INFO:teuthology.orchestra.run.smithi006.stdout:381 2023-07-06T20:01:53.626 INFO:teuthology.orchestra.run.smithi006.stdout:381.out 2023-07-06T20:01:53.626 INFO:teuthology.orchestra.run.smithi006.stdout:382 2023-07-06T20:01:53.627 INFO:teuthology.orchestra.run.smithi006.stdout:382.out 2023-07-06T20:01:53.627 INFO:teuthology.orchestra.run.smithi006.stdout:383 2023-07-06T20:01:53.627 INFO:teuthology.orchestra.run.smithi006.stdout:383.out 2023-07-06T20:01:53.627 INFO:teuthology.orchestra.run.smithi006.stdout:384 2023-07-06T20:01:53.627 INFO:teuthology.orchestra.run.smithi006.stdout:384.out 2023-07-06T20:01:53.627 INFO:teuthology.orchestra.run.smithi006.stdout:385 2023-07-06T20:01:53.627 INFO:teuthology.orchestra.run.smithi006.stdout:385.out 2023-07-06T20:01:53.628 INFO:teuthology.orchestra.run.smithi006.stdout:386 2023-07-06T20:01:53.628 INFO:teuthology.orchestra.run.smithi006.stdout:386.out 2023-07-06T20:01:53.628 INFO:teuthology.orchestra.run.smithi006.stdout:387 2023-07-06T20:01:53.628 INFO:teuthology.orchestra.run.smithi006.stdout:387.out 2023-07-06T20:01:53.628 INFO:teuthology.orchestra.run.smithi006.stdout:388 2023-07-06T20:01:53.628 INFO:teuthology.orchestra.run.smithi006.stdout:388.out 2023-07-06T20:01:53.628 INFO:teuthology.orchestra.run.smithi006.stdout:389 2023-07-06T20:01:53.629 INFO:teuthology.orchestra.run.smithi006.stdout:389.out 2023-07-06T20:01:53.629 INFO:teuthology.orchestra.run.smithi006.stdout:390 2023-07-06T20:01:53.629 INFO:teuthology.orchestra.run.smithi006.stdout:390.out 2023-07-06T20:01:53.629 INFO:teuthology.orchestra.run.smithi006.stdout:391 2023-07-06T20:01:53.629 INFO:teuthology.orchestra.run.smithi006.stdout:391.out 2023-07-06T20:01:53.629 INFO:teuthology.orchestra.run.smithi006.stdout:392 2023-07-06T20:01:53.630 INFO:teuthology.orchestra.run.smithi006.stdout:392.out 2023-07-06T20:01:53.630 INFO:teuthology.orchestra.run.smithi006.stdout:393 2023-07-06T20:01:53.630 INFO:teuthology.orchestra.run.smithi006.stdout:393.out 2023-07-06T20:01:53.630 INFO:teuthology.orchestra.run.smithi006.stdout:394 2023-07-06T20:01:53.630 INFO:teuthology.orchestra.run.smithi006.stdout:394.out 2023-07-06T20:01:53.631 INFO:teuthology.orchestra.run.smithi006.stdout:395 2023-07-06T20:01:53.631 INFO:teuthology.orchestra.run.smithi006.stdout:395.out 2023-07-06T20:01:53.631 INFO:teuthology.orchestra.run.smithi006.stdout:396 2023-07-06T20:01:53.631 INFO:teuthology.orchestra.run.smithi006.stdout:396.out 2023-07-06T20:01:53.631 INFO:teuthology.orchestra.run.smithi006.stdout:397 2023-07-06T20:01:53.632 INFO:teuthology.orchestra.run.smithi006.stdout:397.out 2023-07-06T20:01:53.632 INFO:teuthology.orchestra.run.smithi006.stdout:398 2023-07-06T20:01:53.632 INFO:teuthology.orchestra.run.smithi006.stdout:398.out 2023-07-06T20:01:53.633 INFO:teuthology.orchestra.run.smithi006.stdout:399 2023-07-06T20:01:53.633 INFO:teuthology.orchestra.run.smithi006.stdout:399.out 2023-07-06T20:01:53.633 INFO:teuthology.orchestra.run.smithi006.stdout:400 2023-07-06T20:01:53.633 INFO:teuthology.orchestra.run.smithi006.stdout:400.out 2023-07-06T20:01:53.633 INFO:teuthology.orchestra.run.smithi006.stdout:401 2023-07-06T20:01:53.633 INFO:teuthology.orchestra.run.smithi006.stdout:401.out 2023-07-06T20:01:53.634 INFO:teuthology.orchestra.run.smithi006.stdout:402 2023-07-06T20:01:53.634 INFO:teuthology.orchestra.run.smithi006.stdout:402.out 2023-07-06T20:01:53.634 INFO:teuthology.orchestra.run.smithi006.stdout:403 2023-07-06T20:01:53.634 INFO:teuthology.orchestra.run.smithi006.stdout:403.out 2023-07-06T20:01:53.635 INFO:teuthology.orchestra.run.smithi006.stdout:404 2023-07-06T20:01:53.635 INFO:teuthology.orchestra.run.smithi006.stdout:404.out 2023-07-06T20:01:53.635 INFO:teuthology.orchestra.run.smithi006.stdout:405 2023-07-06T20:01:53.635 INFO:teuthology.orchestra.run.smithi006.stdout:405.out 2023-07-06T20:01:53.635 INFO:teuthology.orchestra.run.smithi006.stdout:406 2023-07-06T20:01:53.635 INFO:teuthology.orchestra.run.smithi006.stdout:406.out 2023-07-06T20:01:53.636 INFO:teuthology.orchestra.run.smithi006.stdout:407 2023-07-06T20:01:53.636 INFO:teuthology.orchestra.run.smithi006.stdout:407.out 2023-07-06T20:01:53.636 INFO:teuthology.orchestra.run.smithi006.stdout:408 2023-07-06T20:01:53.636 INFO:teuthology.orchestra.run.smithi006.stdout:408.out 2023-07-06T20:01:53.637 INFO:teuthology.orchestra.run.smithi006.stdout:409 2023-07-06T20:01:53.637 INFO:teuthology.orchestra.run.smithi006.stdout:409.out 2023-07-06T20:01:53.637 INFO:teuthology.orchestra.run.smithi006.stdout:410 2023-07-06T20:01:53.637 INFO:teuthology.orchestra.run.smithi006.stdout:410.out 2023-07-06T20:01:53.637 INFO:teuthology.orchestra.run.smithi006.stdout:411 2023-07-06T20:01:53.637 INFO:teuthology.orchestra.run.smithi006.stdout:411.out 2023-07-06T20:01:53.637 INFO:teuthology.orchestra.run.smithi006.stdout:412 2023-07-06T20:01:53.638 INFO:teuthology.orchestra.run.smithi006.stdout:412.out 2023-07-06T20:01:53.638 INFO:teuthology.orchestra.run.smithi006.stdout:413 2023-07-06T20:01:53.638 INFO:teuthology.orchestra.run.smithi006.stdout:413.out 2023-07-06T20:01:53.638 INFO:teuthology.orchestra.run.smithi006.stdout:414 2023-07-06T20:01:53.638 INFO:teuthology.orchestra.run.smithi006.stdout:414.out 2023-07-06T20:01:53.638 INFO:teuthology.orchestra.run.smithi006.stdout:415 2023-07-06T20:01:53.638 INFO:teuthology.orchestra.run.smithi006.stdout:415.out 2023-07-06T20:01:53.638 INFO:teuthology.orchestra.run.smithi006.stdout:416 2023-07-06T20:01:53.639 INFO:teuthology.orchestra.run.smithi006.stdout:416.out 2023-07-06T20:01:53.639 INFO:teuthology.orchestra.run.smithi006.stdout:417 2023-07-06T20:01:53.639 INFO:teuthology.orchestra.run.smithi006.stdout:417.out 2023-07-06T20:01:53.639 INFO:teuthology.orchestra.run.smithi006.stdout:418 2023-07-06T20:01:53.640 INFO:teuthology.orchestra.run.smithi006.stdout:418.out 2023-07-06T20:01:53.641 INFO:teuthology.orchestra.run.smithi006.stdout:419 2023-07-06T20:01:53.641 INFO:teuthology.orchestra.run.smithi006.stdout:419.out 2023-07-06T20:01:53.642 INFO:teuthology.orchestra.run.smithi006.stdout:420 2023-07-06T20:01:53.643 INFO:teuthology.orchestra.run.smithi006.stdout:420.out 2023-07-06T20:01:53.643 INFO:teuthology.orchestra.run.smithi006.stdout:421 2023-07-06T20:01:53.643 INFO:teuthology.orchestra.run.smithi006.stdout:421.out 2023-07-06T20:01:53.644 INFO:teuthology.orchestra.run.smithi006.stdout:422 2023-07-06T20:01:53.644 INFO:teuthology.orchestra.run.smithi006.stdout:422.out 2023-07-06T20:01:53.645 INFO:teuthology.orchestra.run.smithi006.stdout:423 2023-07-06T20:01:53.645 INFO:teuthology.orchestra.run.smithi006.stdout:423.out 2023-07-06T20:01:53.645 INFO:teuthology.orchestra.run.smithi006.stdout:424 2023-07-06T20:01:53.646 INFO:teuthology.orchestra.run.smithi006.stdout:424.out 2023-07-06T20:01:53.646 INFO:teuthology.orchestra.run.smithi006.stdout:425 2023-07-06T20:01:53.646 INFO:teuthology.orchestra.run.smithi006.stdout:425.out 2023-07-06T20:01:53.647 INFO:teuthology.orchestra.run.smithi006.stdout:426 2023-07-06T20:01:53.647 INFO:teuthology.orchestra.run.smithi006.stdout:426.out 2023-07-06T20:01:53.647 INFO:teuthology.orchestra.run.smithi006.stdout:427 2023-07-06T20:01:53.648 INFO:teuthology.orchestra.run.smithi006.stdout:427.out 2023-07-06T20:01:53.648 INFO:teuthology.orchestra.run.smithi006.stdout:428 2023-07-06T20:01:53.648 INFO:teuthology.orchestra.run.smithi006.stdout:428.out 2023-07-06T20:01:53.648 INFO:teuthology.orchestra.run.smithi006.stdout:429 2023-07-06T20:01:53.649 INFO:teuthology.orchestra.run.smithi006.stdout:429.out 2023-07-06T20:01:53.649 INFO:teuthology.orchestra.run.smithi006.stdout:430 2023-07-06T20:01:53.650 INFO:teuthology.orchestra.run.smithi006.stdout:430.out 2023-07-06T20:01:53.650 INFO:teuthology.orchestra.run.smithi006.stdout:431 2023-07-06T20:01:53.650 INFO:teuthology.orchestra.run.smithi006.stdout:431.out 2023-07-06T20:01:53.652 INFO:teuthology.orchestra.run.smithi006.stdout:432 2023-07-06T20:01:53.652 INFO:teuthology.orchestra.run.smithi006.stdout:432.out 2023-07-06T20:01:53.653 INFO:teuthology.orchestra.run.smithi006.stdout:433 2023-07-06T20:01:53.654 INFO:teuthology.orchestra.run.smithi006.stdout:433.out 2023-07-06T20:01:53.654 INFO:teuthology.orchestra.run.smithi006.stdout:434 2023-07-06T20:01:53.655 INFO:teuthology.orchestra.run.smithi006.stdout:434.out 2023-07-06T20:01:53.656 INFO:teuthology.orchestra.run.smithi006.stdout:435 2023-07-06T20:01:53.656 INFO:teuthology.orchestra.run.smithi006.stdout:435.out 2023-07-06T20:01:53.657 INFO:teuthology.orchestra.run.smithi006.stdout:436 2023-07-06T20:01:53.657 INFO:teuthology.orchestra.run.smithi006.stdout:436.out 2023-07-06T20:01:53.657 INFO:teuthology.orchestra.run.smithi006.stdout:437 2023-07-06T20:01:53.658 INFO:teuthology.orchestra.run.smithi006.stdout:437.out 2023-07-06T20:01:53.658 INFO:teuthology.orchestra.run.smithi006.stdout:438 2023-07-06T20:01:53.658 INFO:teuthology.orchestra.run.smithi006.stdout:438.out 2023-07-06T20:01:53.659 INFO:teuthology.orchestra.run.smithi006.stdout:439 2023-07-06T20:01:53.659 INFO:teuthology.orchestra.run.smithi006.stdout:439.out 2023-07-06T20:01:53.659 INFO:teuthology.orchestra.run.smithi006.stdout:440 2023-07-06T20:01:53.659 INFO:teuthology.orchestra.run.smithi006.stdout:440.out 2023-07-06T20:01:53.660 INFO:teuthology.orchestra.run.smithi006.stdout:441 2023-07-06T20:01:53.660 INFO:teuthology.orchestra.run.smithi006.stdout:441.out 2023-07-06T20:01:53.660 INFO:teuthology.orchestra.run.smithi006.stdout:442 2023-07-06T20:01:53.661 INFO:teuthology.orchestra.run.smithi006.stdout:442.out 2023-07-06T20:01:53.661 INFO:teuthology.orchestra.run.smithi006.stdout:443 2023-07-06T20:01:53.661 INFO:teuthology.orchestra.run.smithi006.stdout:443.out 2023-07-06T20:01:53.662 INFO:teuthology.orchestra.run.smithi006.stdout:444 2023-07-06T20:01:53.662 INFO:teuthology.orchestra.run.smithi006.stdout:444.out 2023-07-06T20:01:53.662 INFO:teuthology.orchestra.run.smithi006.stdout:445 2023-07-06T20:01:53.662 INFO:teuthology.orchestra.run.smithi006.stdout:445.out 2023-07-06T20:01:53.662 INFO:teuthology.orchestra.run.smithi006.stdout:446 2023-07-06T20:01:53.663 INFO:teuthology.orchestra.run.smithi006.stdout:446.out 2023-07-06T20:01:53.663 INFO:teuthology.orchestra.run.smithi006.stdout:447 2023-07-06T20:01:53.663 INFO:teuthology.orchestra.run.smithi006.stdout:447.out 2023-07-06T20:01:53.663 INFO:teuthology.orchestra.run.smithi006.stdout:448 2023-07-06T20:01:53.663 INFO:teuthology.orchestra.run.smithi006.stdout:448.out 2023-07-06T20:01:53.664 INFO:teuthology.orchestra.run.smithi006.stdout:449 2023-07-06T20:01:53.664 INFO:teuthology.orchestra.run.smithi006.stdout:449.out 2023-07-06T20:01:53.664 INFO:teuthology.orchestra.run.smithi006.stdout:450 2023-07-06T20:01:53.664 INFO:teuthology.orchestra.run.smithi006.stdout:450.out 2023-07-06T20:01:53.664 INFO:teuthology.orchestra.run.smithi006.stdout:451 2023-07-06T20:01:53.664 INFO:teuthology.orchestra.run.smithi006.stdout:451.out 2023-07-06T20:01:53.665 INFO:teuthology.orchestra.run.smithi006.stdout:452 2023-07-06T20:01:53.665 INFO:teuthology.orchestra.run.smithi006.stdout:452.out 2023-07-06T20:01:53.666 INFO:teuthology.orchestra.run.smithi006.stdout:453 2023-07-06T20:01:53.666 INFO:teuthology.orchestra.run.smithi006.stdout:453.out 2023-07-06T20:01:53.666 INFO:teuthology.orchestra.run.smithi006.stdout:454 2023-07-06T20:01:53.666 INFO:teuthology.orchestra.run.smithi006.stdout:454.out 2023-07-06T20:01:53.666 INFO:teuthology.orchestra.run.smithi006.stdout:455 2023-07-06T20:01:53.669 INFO:teuthology.orchestra.run.smithi006.stdout:455.out 2023-07-06T20:01:53.669 INFO:teuthology.orchestra.run.smithi006.stdout:456 2023-07-06T20:01:53.677 INFO:teuthology.orchestra.run.smithi006.stdout:456.out 2023-07-06T20:01:53.677 INFO:teuthology.orchestra.run.smithi006.stdout:457 2023-07-06T20:01:53.678 INFO:teuthology.orchestra.run.smithi006.stdout:457.out 2023-07-06T20:01:53.678 INFO:teuthology.orchestra.run.smithi006.stdout:458 2023-07-06T20:01:53.678 INFO:teuthology.orchestra.run.smithi006.stdout:458.out 2023-07-06T20:01:53.678 INFO:teuthology.orchestra.run.smithi006.stdout:459 2023-07-06T20:01:53.678 INFO:teuthology.orchestra.run.smithi006.stdout:459.out 2023-07-06T20:01:53.678 INFO:teuthology.orchestra.run.smithi006.stdout:460 2023-07-06T20:01:53.678 INFO:teuthology.orchestra.run.smithi006.stdout:460.out 2023-07-06T20:01:53.678 INFO:teuthology.orchestra.run.smithi006.stdout:461 2023-07-06T20:01:53.679 INFO:teuthology.orchestra.run.smithi006.stdout:461.out 2023-07-06T20:01:53.679 INFO:teuthology.orchestra.run.smithi006.stdout:462 2023-07-06T20:01:53.679 INFO:teuthology.orchestra.run.smithi006.stdout:462.out 2023-07-06T20:01:53.679 INFO:teuthology.orchestra.run.smithi006.stdout:463 2023-07-06T20:01:53.682 INFO:teuthology.orchestra.run.smithi006.stdout:463.out 2023-07-06T20:01:53.682 INFO:teuthology.orchestra.run.smithi006.stdout:464 2023-07-06T20:01:53.682 INFO:teuthology.orchestra.run.smithi006.stdout:464.out 2023-07-06T20:01:53.683 INFO:teuthology.orchestra.run.smithi006.stdout:465 2023-07-06T20:01:53.683 INFO:teuthology.orchestra.run.smithi006.stdout:465.out 2023-07-06T20:01:53.683 INFO:teuthology.orchestra.run.smithi006.stdout:466 2023-07-06T20:01:53.684 INFO:teuthology.orchestra.run.smithi006.stdout:466.out 2023-07-06T20:01:53.684 INFO:teuthology.orchestra.run.smithi006.stdout:467 2023-07-06T20:01:53.684 INFO:teuthology.orchestra.run.smithi006.stdout:467.out 2023-07-06T20:01:53.684 INFO:teuthology.orchestra.run.smithi006.stdout:468 2023-07-06T20:01:53.685 INFO:teuthology.orchestra.run.smithi006.stdout:468.out 2023-07-06T20:01:53.685 INFO:teuthology.orchestra.run.smithi006.stdout:469 2023-07-06T20:01:53.685 INFO:teuthology.orchestra.run.smithi006.stdout:469.out 2023-07-06T20:01:53.685 INFO:teuthology.orchestra.run.smithi006.stdout:470 2023-07-06T20:01:53.688 INFO:teuthology.orchestra.run.smithi006.stdout:470.out 2023-07-06T20:01:53.688 INFO:teuthology.orchestra.run.smithi006.stdout:471 2023-07-06T20:01:53.688 INFO:teuthology.orchestra.run.smithi006.stdout:471.out 2023-07-06T20:01:53.688 INFO:teuthology.orchestra.run.smithi006.stdout:472 2023-07-06T20:01:53.688 INFO:teuthology.orchestra.run.smithi006.stdout:472.out 2023-07-06T20:01:53.688 INFO:teuthology.orchestra.run.smithi006.stdout:473 2023-07-06T20:01:53.689 INFO:teuthology.orchestra.run.smithi006.stdout:473.out 2023-07-06T20:01:53.689 INFO:teuthology.orchestra.run.smithi006.stdout:474 2023-07-06T20:01:53.689 INFO:teuthology.orchestra.run.smithi006.stdout:474.out 2023-07-06T20:01:53.689 INFO:teuthology.orchestra.run.smithi006.stdout:475 2023-07-06T20:01:53.689 INFO:teuthology.orchestra.run.smithi006.stdout:475.out 2023-07-06T20:01:53.689 INFO:teuthology.orchestra.run.smithi006.stdout:476 2023-07-06T20:01:53.689 INFO:teuthology.orchestra.run.smithi006.stdout:476.out 2023-07-06T20:01:53.689 INFO:teuthology.orchestra.run.smithi006.stdout:477 2023-07-06T20:01:53.690 INFO:teuthology.orchestra.run.smithi006.stdout:477.out 2023-07-06T20:01:53.690 INFO:teuthology.orchestra.run.smithi006.stdout:478 2023-07-06T20:01:53.690 INFO:teuthology.orchestra.run.smithi006.stdout:478.out 2023-07-06T20:01:53.690 INFO:teuthology.orchestra.run.smithi006.stdout:479 2023-07-06T20:01:53.690 INFO:teuthology.orchestra.run.smithi006.stdout:479.out 2023-07-06T20:01:53.690 INFO:teuthology.orchestra.run.smithi006.stdout:480 2023-07-06T20:01:53.690 INFO:teuthology.orchestra.run.smithi006.stdout:480.out 2023-07-06T20:01:53.690 INFO:teuthology.orchestra.run.smithi006.stdout:481 2023-07-06T20:01:53.691 INFO:teuthology.orchestra.run.smithi006.stdout:481.out 2023-07-06T20:01:53.691 INFO:teuthology.orchestra.run.smithi006.stdout:482 2023-07-06T20:01:53.691 INFO:teuthology.orchestra.run.smithi006.stdout:482.out 2023-07-06T20:01:53.691 INFO:teuthology.orchestra.run.smithi006.stdout:483 2023-07-06T20:01:53.691 INFO:teuthology.orchestra.run.smithi006.stdout:483.out 2023-07-06T20:01:53.691 INFO:teuthology.orchestra.run.smithi006.stdout:484 2023-07-06T20:01:53.691 INFO:teuthology.orchestra.run.smithi006.stdout:484.out 2023-07-06T20:01:53.692 INFO:teuthology.orchestra.run.smithi006.stdout:485 2023-07-06T20:01:53.692 INFO:teuthology.orchestra.run.smithi006.stdout:485.out 2023-07-06T20:01:53.692 INFO:teuthology.orchestra.run.smithi006.stdout:486 2023-07-06T20:01:53.692 INFO:teuthology.orchestra.run.smithi006.stdout:486.out 2023-07-06T20:01:53.692 INFO:teuthology.orchestra.run.smithi006.stdout:487 2023-07-06T20:01:53.692 INFO:teuthology.orchestra.run.smithi006.stdout:487.out 2023-07-06T20:01:53.692 INFO:teuthology.orchestra.run.smithi006.stdout:488 2023-07-06T20:01:53.692 INFO:teuthology.orchestra.run.smithi006.stdout:488.out 2023-07-06T20:01:53.693 INFO:teuthology.orchestra.run.smithi006.stdout:489 2023-07-06T20:01:53.693 INFO:teuthology.orchestra.run.smithi006.stdout:489.out 2023-07-06T20:01:53.693 INFO:teuthology.orchestra.run.smithi006.stdout:490 2023-07-06T20:01:53.693 INFO:teuthology.orchestra.run.smithi006.stdout:490.out 2023-07-06T20:01:53.693 INFO:teuthology.orchestra.run.smithi006.stdout:491 2023-07-06T20:01:53.693 INFO:teuthology.orchestra.run.smithi006.stdout:491.out 2023-07-06T20:01:53.693 INFO:teuthology.orchestra.run.smithi006.stdout:492 2023-07-06T20:01:53.694 INFO:teuthology.orchestra.run.smithi006.stdout:492.out 2023-07-06T20:01:53.694 INFO:teuthology.orchestra.run.smithi006.stdout:493 2023-07-06T20:01:53.694 INFO:teuthology.orchestra.run.smithi006.stdout:493.out 2023-07-06T20:01:53.694 INFO:teuthology.orchestra.run.smithi006.stdout:494 2023-07-06T20:01:53.694 INFO:teuthology.orchestra.run.smithi006.stdout:494.out 2023-07-06T20:01:53.694 INFO:teuthology.orchestra.run.smithi006.stdout:495 2023-07-06T20:01:53.694 INFO:teuthology.orchestra.run.smithi006.stdout:495.out 2023-07-06T20:01:53.694 INFO:teuthology.orchestra.run.smithi006.stdout:496 2023-07-06T20:01:53.695 INFO:teuthology.orchestra.run.smithi006.stdout:496.out 2023-07-06T20:01:53.695 INFO:teuthology.orchestra.run.smithi006.stdout:497 2023-07-06T20:01:53.695 INFO:teuthology.orchestra.run.smithi006.stdout:497.out 2023-07-06T20:01:53.695 INFO:teuthology.orchestra.run.smithi006.stdout:498 2023-07-06T20:01:53.695 INFO:teuthology.orchestra.run.smithi006.stdout:498.out 2023-07-06T20:01:53.695 INFO:teuthology.orchestra.run.smithi006.stdout:499 2023-07-06T20:01:53.695 INFO:teuthology.orchestra.run.smithi006.stdout:499.out 2023-07-06T20:01:53.695 INFO:teuthology.orchestra.run.smithi006.stdout:500 2023-07-06T20:01:53.696 INFO:teuthology.orchestra.run.smithi006.stdout:500.out 2023-07-06T20:01:53.696 INFO:teuthology.orchestra.run.smithi006.stdout:501 2023-07-06T20:01:53.701 INFO:teuthology.orchestra.run.smithi006.stdout:501.out 2023-07-06T20:01:53.702 INFO:teuthology.orchestra.run.smithi006.stdout:502 2023-07-06T20:01:53.702 INFO:teuthology.orchestra.run.smithi006.stdout:502.out 2023-07-06T20:01:53.702 INFO:teuthology.orchestra.run.smithi006.stdout:503 2023-07-06T20:01:53.703 INFO:teuthology.orchestra.run.smithi006.stdout:503.out 2023-07-06T20:01:53.703 INFO:teuthology.orchestra.run.smithi006.stdout:504 2023-07-06T20:01:53.703 INFO:teuthology.orchestra.run.smithi006.stdout:504.out 2023-07-06T20:01:53.703 INFO:teuthology.orchestra.run.smithi006.stdout:505 2023-07-06T20:01:53.704 INFO:teuthology.orchestra.run.smithi006.stdout:505.out 2023-07-06T20:01:53.704 INFO:teuthology.orchestra.run.smithi006.stdout:506 2023-07-06T20:01:53.704 INFO:teuthology.orchestra.run.smithi006.stdout:506.out 2023-07-06T20:01:53.704 INFO:teuthology.orchestra.run.smithi006.stdout:507 2023-07-06T20:01:53.705 INFO:teuthology.orchestra.run.smithi006.stdout:507.out 2023-07-06T20:01:53.705 INFO:teuthology.orchestra.run.smithi006.stdout:508 2023-07-06T20:01:53.705 INFO:teuthology.orchestra.run.smithi006.stdout:508.out 2023-07-06T20:01:53.705 INFO:teuthology.orchestra.run.smithi006.stdout:509 2023-07-06T20:01:53.706 INFO:teuthology.orchestra.run.smithi006.stdout:509.out 2023-07-06T20:01:53.706 INFO:teuthology.orchestra.run.smithi006.stdout:510 2023-07-06T20:01:53.706 INFO:teuthology.orchestra.run.smithi006.stdout:510.out 2023-07-06T20:01:53.712 INFO:teuthology.orchestra.run.smithi006.stdout:511 2023-07-06T20:01:53.713 INFO:teuthology.orchestra.run.smithi006.stdout:511.out 2023-07-06T20:01:53.713 INFO:teuthology.orchestra.run.smithi006.stdout:512 2023-07-06T20:01:53.713 INFO:teuthology.orchestra.run.smithi006.stdout:512.out 2023-07-06T20:01:53.714 INFO:teuthology.orchestra.run.smithi006.stdout:513 2023-07-06T20:01:53.714 INFO:teuthology.orchestra.run.smithi006.stdout:513.out 2023-07-06T20:01:53.714 INFO:teuthology.orchestra.run.smithi006.stdout:514 2023-07-06T20:01:53.714 INFO:teuthology.orchestra.run.smithi006.stdout:514.out 2023-07-06T20:01:53.715 INFO:teuthology.orchestra.run.smithi006.stdout:515 2023-07-06T20:01:53.715 INFO:teuthology.orchestra.run.smithi006.stdout:515.out 2023-07-06T20:01:53.715 INFO:teuthology.orchestra.run.smithi006.stdout:516 2023-07-06T20:01:53.715 INFO:teuthology.orchestra.run.smithi006.stdout:516.out 2023-07-06T20:01:53.716 INFO:teuthology.orchestra.run.smithi006.stdout:517 2023-07-06T20:01:53.716 INFO:teuthology.orchestra.run.smithi006.stdout:517.out 2023-07-06T20:01:53.716 INFO:teuthology.orchestra.run.smithi006.stdout:518 2023-07-06T20:01:53.716 INFO:teuthology.orchestra.run.smithi006.stdout:518.out 2023-07-06T20:01:53.717 INFO:teuthology.orchestra.run.smithi006.stdout:519 2023-07-06T20:01:53.717 INFO:teuthology.orchestra.run.smithi006.stdout:519.out 2023-07-06T20:01:53.717 INFO:teuthology.orchestra.run.smithi006.stdout:520 2023-07-06T20:01:53.717 INFO:teuthology.orchestra.run.smithi006.stdout:520.out 2023-07-06T20:01:53.717 INFO:teuthology.orchestra.run.smithi006.stdout:521 2023-07-06T20:01:53.717 INFO:teuthology.orchestra.run.smithi006.stdout:521.out 2023-07-06T20:01:53.718 INFO:teuthology.orchestra.run.smithi006.stdout:522 2023-07-06T20:01:53.718 INFO:teuthology.orchestra.run.smithi006.stdout:522.out 2023-07-06T20:01:53.718 INFO:teuthology.orchestra.run.smithi006.stdout:523 2023-07-06T20:01:53.718 INFO:teuthology.orchestra.run.smithi006.stdout:523.out 2023-07-06T20:01:53.718 INFO:teuthology.orchestra.run.smithi006.stdout:524 2023-07-06T20:01:53.718 INFO:teuthology.orchestra.run.smithi006.stdout:524.out 2023-07-06T20:01:53.718 INFO:teuthology.orchestra.run.smithi006.stdout:525 2023-07-06T20:01:53.719 INFO:teuthology.orchestra.run.smithi006.stdout:525.out 2023-07-06T20:01:53.719 INFO:teuthology.orchestra.run.smithi006.stdout:526 2023-07-06T20:01:53.719 INFO:teuthology.orchestra.run.smithi006.stdout:526.out 2023-07-06T20:01:53.719 INFO:teuthology.orchestra.run.smithi006.stdout:527 2023-07-06T20:01:53.719 INFO:teuthology.orchestra.run.smithi006.stdout:527.out 2023-07-06T20:01:53.719 INFO:teuthology.orchestra.run.smithi006.stdout:528 2023-07-06T20:01:53.719 INFO:teuthology.orchestra.run.smithi006.stdout:528.out 2023-07-06T20:01:53.719 INFO:teuthology.orchestra.run.smithi006.stdout:529 2023-07-06T20:01:53.720 INFO:teuthology.orchestra.run.smithi006.stdout:529.out 2023-07-06T20:01:53.720 INFO:teuthology.orchestra.run.smithi006.stdout:530 2023-07-06T20:01:53.720 INFO:teuthology.orchestra.run.smithi006.stdout:530.out 2023-07-06T20:01:53.721 INFO:teuthology.orchestra.run.smithi006.stdout:531 2023-07-06T20:01:53.721 INFO:teuthology.orchestra.run.smithi006.stdout:531.out 2023-07-06T20:01:53.721 INFO:teuthology.orchestra.run.smithi006.stdout:532 2023-07-06T20:01:53.721 INFO:teuthology.orchestra.run.smithi006.stdout:532.out 2023-07-06T20:01:53.721 INFO:teuthology.orchestra.run.smithi006.stdout:533 2023-07-06T20:01:53.721 INFO:teuthology.orchestra.run.smithi006.stdout:533.out 2023-07-06T20:01:53.722 INFO:teuthology.orchestra.run.smithi006.stdout:534 2023-07-06T20:01:53.722 INFO:teuthology.orchestra.run.smithi006.stdout:534.out 2023-07-06T20:01:53.722 INFO:teuthology.orchestra.run.smithi006.stdout:535 2023-07-06T20:01:53.722 INFO:teuthology.orchestra.run.smithi006.stdout:535.out 2023-07-06T20:01:53.722 INFO:teuthology.orchestra.run.smithi006.stdout:536 2023-07-06T20:01:53.722 INFO:teuthology.orchestra.run.smithi006.stdout:536.out 2023-07-06T20:01:53.723 INFO:teuthology.orchestra.run.smithi006.stdout:537 2023-07-06T20:01:53.723 INFO:teuthology.orchestra.run.smithi006.stdout:537.out 2023-07-06T20:01:53.723 INFO:teuthology.orchestra.run.smithi006.stdout:538 2023-07-06T20:01:53.723 INFO:teuthology.orchestra.run.smithi006.stdout:538.out 2023-07-06T20:01:53.723 INFO:teuthology.orchestra.run.smithi006.stdout:539 2023-07-06T20:01:53.724 INFO:teuthology.orchestra.run.smithi006.stdout:539.out 2023-07-06T20:01:53.724 INFO:teuthology.orchestra.run.smithi006.stdout:540 2023-07-06T20:01:53.724 INFO:teuthology.orchestra.run.smithi006.stdout:540.out 2023-07-06T20:01:53.724 INFO:teuthology.orchestra.run.smithi006.stdout:541 2023-07-06T20:01:53.724 INFO:teuthology.orchestra.run.smithi006.stdout:541.out 2023-07-06T20:01:53.724 INFO:teuthology.orchestra.run.smithi006.stdout:542 2023-07-06T20:01:53.724 INFO:teuthology.orchestra.run.smithi006.stdout:542.out 2023-07-06T20:01:53.725 INFO:teuthology.orchestra.run.smithi006.stdout:543 2023-07-06T20:01:53.725 INFO:teuthology.orchestra.run.smithi006.stdout:543.out 2023-07-06T20:01:53.725 INFO:teuthology.orchestra.run.smithi006.stdout:544 2023-07-06T20:01:53.725 INFO:teuthology.orchestra.run.smithi006.stdout:544.out 2023-07-06T20:01:53.725 INFO:teuthology.orchestra.run.smithi006.stdout:545 2023-07-06T20:01:53.725 INFO:teuthology.orchestra.run.smithi006.stdout:545.out 2023-07-06T20:01:53.725 INFO:teuthology.orchestra.run.smithi006.stdout:546 2023-07-06T20:01:53.725 INFO:teuthology.orchestra.run.smithi006.stdout:546.out 2023-07-06T20:01:53.726 INFO:teuthology.orchestra.run.smithi006.stdout:547 2023-07-06T20:01:53.726 INFO:teuthology.orchestra.run.smithi006.stdout:547.out 2023-07-06T20:01:53.726 INFO:teuthology.orchestra.run.smithi006.stdout:548 2023-07-06T20:01:53.726 INFO:teuthology.orchestra.run.smithi006.stdout:548.out 2023-07-06T20:01:53.726 INFO:teuthology.orchestra.run.smithi006.stdout:549 2023-07-06T20:01:53.726 INFO:teuthology.orchestra.run.smithi006.stdout:549.out 2023-07-06T20:01:53.726 INFO:teuthology.orchestra.run.smithi006.stdout:550 2023-07-06T20:01:53.726 INFO:teuthology.orchestra.run.smithi006.stdout:550.out 2023-07-06T20:01:53.727 INFO:teuthology.orchestra.run.smithi006.stdout:551 2023-07-06T20:01:53.727 INFO:teuthology.orchestra.run.smithi006.stdout:551.out 2023-07-06T20:01:53.727 INFO:teuthology.orchestra.run.smithi006.stdout:552 2023-07-06T20:01:53.727 INFO:teuthology.orchestra.run.smithi006.stdout:552.out 2023-07-06T20:01:53.727 INFO:teuthology.orchestra.run.smithi006.stdout:553 2023-07-06T20:01:53.727 INFO:teuthology.orchestra.run.smithi006.stdout:553.out 2023-07-06T20:01:53.727 INFO:teuthology.orchestra.run.smithi006.stdout:554 2023-07-06T20:01:53.727 INFO:teuthology.orchestra.run.smithi006.stdout:554.out 2023-07-06T20:01:53.728 INFO:teuthology.orchestra.run.smithi006.stdout:555 2023-07-06T20:01:53.728 INFO:teuthology.orchestra.run.smithi006.stdout:555.out 2023-07-06T20:01:53.728 INFO:teuthology.orchestra.run.smithi006.stdout:556 2023-07-06T20:01:53.728 INFO:teuthology.orchestra.run.smithi006.stdout:556.out 2023-07-06T20:01:53.728 INFO:teuthology.orchestra.run.smithi006.stdout:557 2023-07-06T20:01:53.728 INFO:teuthology.orchestra.run.smithi006.stdout:557.out 2023-07-06T20:01:53.728 INFO:teuthology.orchestra.run.smithi006.stdout:558 2023-07-06T20:01:53.729 INFO:teuthology.orchestra.run.smithi006.stdout:558.out 2023-07-06T20:01:53.729 INFO:teuthology.orchestra.run.smithi006.stdout:559 2023-07-06T20:01:53.729 INFO:teuthology.orchestra.run.smithi006.stdout:559.out 2023-07-06T20:01:53.729 INFO:teuthology.orchestra.run.smithi006.stdout:560 2023-07-06T20:01:53.729 INFO:teuthology.orchestra.run.smithi006.stdout:560.out 2023-07-06T20:01:53.729 INFO:teuthology.orchestra.run.smithi006.stdout:561 2023-07-06T20:01:53.729 INFO:teuthology.orchestra.run.smithi006.stdout:561.out 2023-07-06T20:01:53.729 INFO:teuthology.orchestra.run.smithi006.stdout:562 2023-07-06T20:01:53.730 INFO:teuthology.orchestra.run.smithi006.stdout:562.out 2023-07-06T20:01:53.730 INFO:teuthology.orchestra.run.smithi006.stdout:563 2023-07-06T20:01:53.730 INFO:teuthology.orchestra.run.smithi006.stdout:563.out 2023-07-06T20:01:53.730 INFO:teuthology.orchestra.run.smithi006.stdout:564 2023-07-06T20:01:53.730 INFO:teuthology.orchestra.run.smithi006.stdout:564.out 2023-07-06T20:01:53.730 INFO:teuthology.orchestra.run.smithi006.stdout:565 2023-07-06T20:01:53.730 INFO:teuthology.orchestra.run.smithi006.stdout:565.out 2023-07-06T20:01:53.730 INFO:teuthology.orchestra.run.smithi006.stdout:566 2023-07-06T20:01:53.731 INFO:teuthology.orchestra.run.smithi006.stdout:566.out 2023-07-06T20:01:53.731 INFO:teuthology.orchestra.run.smithi006.stdout:567 2023-07-06T20:01:53.731 INFO:teuthology.orchestra.run.smithi006.stdout:567.out 2023-07-06T20:01:53.731 INFO:teuthology.orchestra.run.smithi006.stdout:568 2023-07-06T20:01:53.732 INFO:teuthology.orchestra.run.smithi006.stdout:568.out 2023-07-06T20:01:53.732 INFO:teuthology.orchestra.run.smithi006.stdout:569 2023-07-06T20:01:53.732 INFO:teuthology.orchestra.run.smithi006.stdout:569.out 2023-07-06T20:01:53.732 INFO:teuthology.orchestra.run.smithi006.stdout:570 2023-07-06T20:01:53.732 INFO:teuthology.orchestra.run.smithi006.stdout:570.out 2023-07-06T20:01:53.734 INFO:teuthology.orchestra.run.smithi006.stdout:571 2023-07-06T20:01:53.734 INFO:teuthology.orchestra.run.smithi006.stdout:571.out 2023-07-06T20:01:53.734 INFO:teuthology.orchestra.run.smithi006.stdout:572 2023-07-06T20:01:53.734 INFO:teuthology.orchestra.run.smithi006.stdout:572.out 2023-07-06T20:01:53.734 INFO:teuthology.orchestra.run.smithi006.stdout:573 2023-07-06T20:01:53.734 INFO:teuthology.orchestra.run.smithi006.stdout:573.out 2023-07-06T20:01:53.735 INFO:teuthology.orchestra.run.smithi006.stdout:574 2023-07-06T20:01:53.735 INFO:teuthology.orchestra.run.smithi006.stdout:574.out 2023-07-06T20:01:53.735 INFO:teuthology.orchestra.run.smithi006.stdout:575 2023-07-06T20:01:53.735 INFO:teuthology.orchestra.run.smithi006.stdout:575.out 2023-07-06T20:01:53.735 INFO:teuthology.orchestra.run.smithi006.stdout:576 2023-07-06T20:01:53.735 INFO:teuthology.orchestra.run.smithi006.stdout:576.out 2023-07-06T20:01:53.736 INFO:teuthology.orchestra.run.smithi006.stdout:577 2023-07-06T20:01:53.736 INFO:teuthology.orchestra.run.smithi006.stdout:577.out 2023-07-06T20:01:53.736 INFO:teuthology.orchestra.run.smithi006.stdout:578 2023-07-06T20:01:53.736 INFO:teuthology.orchestra.run.smithi006.stdout:578.out 2023-07-06T20:01:53.736 INFO:teuthology.orchestra.run.smithi006.stdout:579 2023-07-06T20:01:53.736 INFO:teuthology.orchestra.run.smithi006.stdout:579.out 2023-07-06T20:01:53.736 INFO:teuthology.orchestra.run.smithi006.stdout:580 2023-07-06T20:01:53.736 INFO:teuthology.orchestra.run.smithi006.stdout:580.out 2023-07-06T20:01:53.737 INFO:teuthology.orchestra.run.smithi006.stdout:581 2023-07-06T20:01:53.737 INFO:teuthology.orchestra.run.smithi006.stdout:581.out 2023-07-06T20:01:53.737 INFO:teuthology.orchestra.run.smithi006.stdout:582 2023-07-06T20:01:53.737 INFO:teuthology.orchestra.run.smithi006.stdout:582.out 2023-07-06T20:01:53.737 INFO:teuthology.orchestra.run.smithi006.stdout:583 2023-07-06T20:01:53.737 INFO:teuthology.orchestra.run.smithi006.stdout:583.out 2023-07-06T20:01:53.737 INFO:teuthology.orchestra.run.smithi006.stdout:584 2023-07-06T20:01:53.737 INFO:teuthology.orchestra.run.smithi006.stdout:584.out 2023-07-06T20:01:53.738 INFO:teuthology.orchestra.run.smithi006.stdout:585 2023-07-06T20:01:53.738 INFO:teuthology.orchestra.run.smithi006.stdout:585.out 2023-07-06T20:01:53.738 INFO:teuthology.orchestra.run.smithi006.stdout:586 2023-07-06T20:01:53.738 INFO:teuthology.orchestra.run.smithi006.stdout:586.out 2023-07-06T20:01:53.738 INFO:teuthology.orchestra.run.smithi006.stdout:587 2023-07-06T20:01:53.739 INFO:teuthology.orchestra.run.smithi006.stdout:587.out 2023-07-06T20:01:53.739 INFO:teuthology.orchestra.run.smithi006.stdout:588 2023-07-06T20:01:53.739 INFO:teuthology.orchestra.run.smithi006.stdout:588.out 2023-07-06T20:01:53.739 INFO:teuthology.orchestra.run.smithi006.stdout:589 2023-07-06T20:01:53.740 INFO:teuthology.orchestra.run.smithi006.stdout:589.out 2023-07-06T20:01:53.746 INFO:teuthology.orchestra.run.smithi006.stdout:590 2023-07-06T20:01:53.747 INFO:teuthology.orchestra.run.smithi006.stdout:590.out 2023-07-06T20:01:53.747 INFO:teuthology.orchestra.run.smithi006.stdout:591 2023-07-06T20:01:53.747 INFO:teuthology.orchestra.run.smithi006.stdout:591.out 2023-07-06T20:01:53.748 INFO:teuthology.orchestra.run.smithi006.stdout:592 2023-07-06T20:01:53.748 INFO:teuthology.orchestra.run.smithi006.stdout:592.out 2023-07-06T20:01:53.752 INFO:teuthology.orchestra.run.smithi006.stdout:593 2023-07-06T20:01:53.752 INFO:teuthology.orchestra.run.smithi006.stdout:593.out 2023-07-06T20:01:53.753 INFO:teuthology.orchestra.run.smithi006.stdout:594 2023-07-06T20:01:53.753 INFO:teuthology.orchestra.run.smithi006.stdout:594.out 2023-07-06T20:01:53.753 INFO:teuthology.orchestra.run.smithi006.stdout:595 2023-07-06T20:01:53.754 INFO:teuthology.orchestra.run.smithi006.stdout:595.out 2023-07-06T20:01:53.754 INFO:teuthology.orchestra.run.smithi006.stdout:596 2023-07-06T20:01:53.754 INFO:teuthology.orchestra.run.smithi006.stdout:596.out 2023-07-06T20:01:53.767 INFO:teuthology.orchestra.run.smithi006.stdout:597 2023-07-06T20:01:53.767 INFO:teuthology.orchestra.run.smithi006.stdout:597.out 2023-07-06T20:01:53.767 INFO:teuthology.orchestra.run.smithi006.stdout:598 2023-07-06T20:01:53.768 INFO:teuthology.orchestra.run.smithi006.stdout:598.out 2023-07-06T20:01:53.771 INFO:teuthology.orchestra.run.smithi006.stdout:599 2023-07-06T20:01:53.772 INFO:teuthology.orchestra.run.smithi006.stdout:599.out 2023-07-06T20:01:53.772 INFO:teuthology.orchestra.run.smithi006.stdout:600 2023-07-06T20:01:53.772 INFO:teuthology.orchestra.run.smithi006.stdout:600.out 2023-07-06T20:01:53.772 INFO:teuthology.orchestra.run.smithi006.stdout:601 2023-07-06T20:01:53.772 INFO:teuthology.orchestra.run.smithi006.stdout:601.out 2023-07-06T20:01:53.773 INFO:teuthology.orchestra.run.smithi006.stdout:602 2023-07-06T20:01:53.773 INFO:teuthology.orchestra.run.smithi006.stdout:602.out 2023-07-06T20:01:53.773 INFO:teuthology.orchestra.run.smithi006.stdout:603 2023-07-06T20:01:53.773 INFO:teuthology.orchestra.run.smithi006.stdout:603.out 2023-07-06T20:01:53.773 INFO:teuthology.orchestra.run.smithi006.stdout:604 2023-07-06T20:01:53.773 INFO:teuthology.orchestra.run.smithi006.stdout:604.out 2023-07-06T20:01:53.773 INFO:teuthology.orchestra.run.smithi006.stdout:605 2023-07-06T20:01:53.774 INFO:teuthology.orchestra.run.smithi006.stdout:605.out 2023-07-06T20:01:53.774 INFO:teuthology.orchestra.run.smithi006.stdout:606 2023-07-06T20:01:53.774 INFO:teuthology.orchestra.run.smithi006.stdout:606.out 2023-07-06T20:01:53.774 INFO:teuthology.orchestra.run.smithi006.stdout:607 2023-07-06T20:01:53.774 INFO:teuthology.orchestra.run.smithi006.stdout:607.out 2023-07-06T20:01:53.774 INFO:teuthology.orchestra.run.smithi006.stdout:608 2023-07-06T20:01:53.774 INFO:teuthology.orchestra.run.smithi006.stdout:608.out 2023-07-06T20:01:53.774 INFO:teuthology.orchestra.run.smithi006.stdout:609 2023-07-06T20:01:53.775 INFO:teuthology.orchestra.run.smithi006.stdout:609.out 2023-07-06T20:01:53.775 INFO:teuthology.orchestra.run.smithi006.stdout:610 2023-07-06T20:01:53.775 INFO:teuthology.orchestra.run.smithi006.stdout:610.out 2023-07-06T20:01:53.780 INFO:teuthology.orchestra.run.smithi006.stdout:611 2023-07-06T20:01:53.781 INFO:teuthology.orchestra.run.smithi006.stdout:611.out 2023-07-06T20:01:53.781 INFO:teuthology.orchestra.run.smithi006.stdout:612 2023-07-06T20:01:53.781 INFO:teuthology.orchestra.run.smithi006.stdout:612.out 2023-07-06T20:01:53.781 INFO:teuthology.orchestra.run.smithi006.stdout:613 2023-07-06T20:01:53.782 INFO:teuthology.orchestra.run.smithi006.stdout:613.out 2023-07-06T20:01:53.782 INFO:teuthology.orchestra.run.smithi006.stdout:614 2023-07-06T20:01:53.782 INFO:teuthology.orchestra.run.smithi006.stdout:614.out 2023-07-06T20:01:53.783 INFO:teuthology.orchestra.run.smithi006.stdout:615 2023-07-06T20:01:53.783 INFO:teuthology.orchestra.run.smithi006.stdout:615.out 2023-07-06T20:01:53.783 INFO:teuthology.orchestra.run.smithi006.stdout:616 2023-07-06T20:01:53.784 INFO:teuthology.orchestra.run.smithi006.stdout:616.out 2023-07-06T20:01:53.784 INFO:teuthology.orchestra.run.smithi006.stdout:617 2023-07-06T20:01:53.784 INFO:teuthology.orchestra.run.smithi006.stdout:617.out 2023-07-06T20:01:53.785 INFO:teuthology.orchestra.run.smithi006.stdout:618 2023-07-06T20:01:53.785 INFO:teuthology.orchestra.run.smithi006.stdout:618.out 2023-07-06T20:01:53.785 INFO:teuthology.orchestra.run.smithi006.stdout:619 2023-07-06T20:01:53.785 INFO:teuthology.orchestra.run.smithi006.stdout:619.out 2023-07-06T20:01:53.786 INFO:teuthology.orchestra.run.smithi006.stdout:620 2023-07-06T20:01:53.786 INFO:teuthology.orchestra.run.smithi006.stdout:620.out 2023-07-06T20:01:53.786 INFO:teuthology.orchestra.run.smithi006.stdout:621 2023-07-06T20:01:53.789 INFO:teuthology.orchestra.run.smithi006.stdout:621.out 2023-07-06T20:01:53.789 INFO:teuthology.orchestra.run.smithi006.stdout:622 2023-07-06T20:01:53.790 INFO:teuthology.orchestra.run.smithi006.stdout:622.out 2023-07-06T20:01:53.790 INFO:teuthology.orchestra.run.smithi006.stdout:623 2023-07-06T20:01:53.791 INFO:teuthology.orchestra.run.smithi006.stdout:623.out 2023-07-06T20:01:53.791 INFO:teuthology.orchestra.run.smithi006.stdout:624 2023-07-06T20:01:53.791 INFO:teuthology.orchestra.run.smithi006.stdout:624.out 2023-07-06T20:01:53.792 INFO:teuthology.orchestra.run.smithi006.stdout:625 2023-07-06T20:01:53.802 INFO:teuthology.orchestra.run.smithi006.stdout:625.out 2023-07-06T20:01:53.803 INFO:teuthology.orchestra.run.smithi006.stdout:626 2023-07-06T20:01:53.803 INFO:teuthology.orchestra.run.smithi006.stdout:626.out 2023-07-06T20:01:53.803 INFO:teuthology.orchestra.run.smithi006.stdout:627 2023-07-06T20:01:53.803 INFO:teuthology.orchestra.run.smithi006.stdout:627.out 2023-07-06T20:01:53.803 INFO:teuthology.orchestra.run.smithi006.stdout:628 2023-07-06T20:01:53.803 INFO:teuthology.orchestra.run.smithi006.stdout:628.out 2023-07-06T20:01:53.804 INFO:teuthology.orchestra.run.smithi006.stdout:629 2023-07-06T20:01:53.804 INFO:teuthology.orchestra.run.smithi006.stdout:629.out 2023-07-06T20:01:53.804 INFO:teuthology.orchestra.run.smithi006.stdout:630 2023-07-06T20:01:53.804 INFO:teuthology.orchestra.run.smithi006.stdout:630.out 2023-07-06T20:01:53.804 INFO:teuthology.orchestra.run.smithi006.stdout:631 2023-07-06T20:01:53.804 INFO:teuthology.orchestra.run.smithi006.stdout:631.out 2023-07-06T20:01:53.804 INFO:teuthology.orchestra.run.smithi006.stdout:632 2023-07-06T20:01:53.805 INFO:teuthology.orchestra.run.smithi006.stdout:632.out 2023-07-06T20:01:53.805 INFO:teuthology.orchestra.run.smithi006.stdout:633 2023-07-06T20:01:53.805 INFO:teuthology.orchestra.run.smithi006.stdout:633.out 2023-07-06T20:01:53.806 INFO:teuthology.orchestra.run.smithi006.stdout:634 2023-07-06T20:01:53.806 INFO:teuthology.orchestra.run.smithi006.stdout:634.out 2023-07-06T20:01:53.806 INFO:teuthology.orchestra.run.smithi006.stdout:635 2023-07-06T20:01:53.806 INFO:teuthology.orchestra.run.smithi006.stdout:635.out 2023-07-06T20:01:53.806 INFO:teuthology.orchestra.run.smithi006.stdout:636 2023-07-06T20:01:53.806 INFO:teuthology.orchestra.run.smithi006.stdout:636.out 2023-07-06T20:01:53.806 INFO:teuthology.orchestra.run.smithi006.stdout:637 2023-07-06T20:01:53.806 INFO:teuthology.orchestra.run.smithi006.stdout:637.out 2023-07-06T20:01:53.807 INFO:teuthology.orchestra.run.smithi006.stdout:638 2023-07-06T20:01:53.807 INFO:teuthology.orchestra.run.smithi006.stdout:638.out 2023-07-06T20:01:53.807 INFO:teuthology.orchestra.run.smithi006.stdout:639 2023-07-06T20:01:53.807 INFO:teuthology.orchestra.run.smithi006.stdout:639.out 2023-07-06T20:01:53.807 INFO:teuthology.orchestra.run.smithi006.stdout:640 2023-07-06T20:01:53.807 INFO:teuthology.orchestra.run.smithi006.stdout:640.out 2023-07-06T20:01:53.807 INFO:teuthology.orchestra.run.smithi006.stdout:641 2023-07-06T20:01:53.807 INFO:teuthology.orchestra.run.smithi006.stdout:641.out 2023-07-06T20:01:53.808 INFO:teuthology.orchestra.run.smithi006.stdout:642 2023-07-06T20:01:53.808 INFO:teuthology.orchestra.run.smithi006.stdout:642.out 2023-07-06T20:01:53.808 INFO:teuthology.orchestra.run.smithi006.stdout:643 2023-07-06T20:01:53.808 INFO:teuthology.orchestra.run.smithi006.stdout:643.out 2023-07-06T20:01:53.808 INFO:teuthology.orchestra.run.smithi006.stdout:644 2023-07-06T20:01:53.808 INFO:teuthology.orchestra.run.smithi006.stdout:644.out 2023-07-06T20:01:53.809 INFO:teuthology.orchestra.run.smithi006.stdout:645 2023-07-06T20:01:53.809 INFO:teuthology.orchestra.run.smithi006.stdout:645.out 2023-07-06T20:01:53.809 INFO:teuthology.orchestra.run.smithi006.stdout:646 2023-07-06T20:01:53.809 INFO:teuthology.orchestra.run.smithi006.stdout:646.out 2023-07-06T20:01:53.809 INFO:teuthology.orchestra.run.smithi006.stdout:647 2023-07-06T20:01:53.809 INFO:teuthology.orchestra.run.smithi006.stdout:647.out 2023-07-06T20:01:53.809 INFO:teuthology.orchestra.run.smithi006.stdout:648 2023-07-06T20:01:53.809 INFO:teuthology.orchestra.run.smithi006.stdout:648.out 2023-07-06T20:01:53.810 INFO:teuthology.orchestra.run.smithi006.stdout:649 2023-07-06T20:01:53.810 INFO:teuthology.orchestra.run.smithi006.stdout:649.out 2023-07-06T20:01:53.810 INFO:teuthology.orchestra.run.smithi006.stdout:650 2023-07-06T20:01:53.810 INFO:teuthology.orchestra.run.smithi006.stdout:650.out 2023-07-06T20:01:53.810 INFO:teuthology.orchestra.run.smithi006.stdout:651 2023-07-06T20:01:53.810 INFO:teuthology.orchestra.run.smithi006.stdout:651.out 2023-07-06T20:01:53.810 INFO:teuthology.orchestra.run.smithi006.stdout:652 2023-07-06T20:01:53.811 INFO:teuthology.orchestra.run.smithi006.stdout:652.out 2023-07-06T20:01:53.811 INFO:teuthology.orchestra.run.smithi006.stdout:653 2023-07-06T20:01:53.811 INFO:teuthology.orchestra.run.smithi006.stdout:653.out 2023-07-06T20:01:53.811 INFO:teuthology.orchestra.run.smithi006.stdout:654 2023-07-06T20:01:53.811 INFO:teuthology.orchestra.run.smithi006.stdout:654.out 2023-07-06T20:01:53.811 INFO:teuthology.orchestra.run.smithi006.stdout:655 2023-07-06T20:01:53.811 INFO:teuthology.orchestra.run.smithi006.stdout:655.out 2023-07-06T20:01:53.811 INFO:teuthology.orchestra.run.smithi006.stdout:656 2023-07-06T20:01:53.812 INFO:teuthology.orchestra.run.smithi006.stdout:656.out 2023-07-06T20:01:53.812 INFO:teuthology.orchestra.run.smithi006.stdout:657 2023-07-06T20:01:53.812 INFO:teuthology.orchestra.run.smithi006.stdout:657.out 2023-07-06T20:01:53.826 INFO:teuthology.orchestra.run.smithi006.stdout:658 2023-07-06T20:01:53.826 INFO:teuthology.orchestra.run.smithi006.stdout:658.out 2023-07-06T20:01:53.827 INFO:teuthology.orchestra.run.smithi006.stdout:659 2023-07-06T20:01:53.827 INFO:teuthology.orchestra.run.smithi006.stdout:659.out 2023-07-06T20:01:53.827 INFO:teuthology.orchestra.run.smithi006.stdout:660 2023-07-06T20:01:53.827 INFO:teuthology.orchestra.run.smithi006.stdout:660.out 2023-07-06T20:01:53.828 INFO:teuthology.orchestra.run.smithi006.stdout:661 2023-07-06T20:01:53.828 INFO:teuthology.orchestra.run.smithi006.stdout:661.out 2023-07-06T20:01:53.828 INFO:teuthology.orchestra.run.smithi006.stdout:662 2023-07-06T20:01:53.828 INFO:teuthology.orchestra.run.smithi006.stdout:662.out 2023-07-06T20:01:53.829 INFO:teuthology.orchestra.run.smithi006.stdout:663 2023-07-06T20:01:53.829 INFO:teuthology.orchestra.run.smithi006.stdout:663.out 2023-07-06T20:01:53.829 INFO:teuthology.orchestra.run.smithi006.stdout:664 2023-07-06T20:01:53.829 INFO:teuthology.orchestra.run.smithi006.stdout:664.out 2023-07-06T20:01:53.830 INFO:teuthology.orchestra.run.smithi006.stdout:665 2023-07-06T20:01:53.830 INFO:teuthology.orchestra.run.smithi006.stdout:665.out 2023-07-06T20:01:53.830 INFO:teuthology.orchestra.run.smithi006.stdout:666 2023-07-06T20:01:53.830 INFO:teuthology.orchestra.run.smithi006.stdout:666.out 2023-07-06T20:01:53.831 INFO:teuthology.orchestra.run.smithi006.stdout:667 2023-07-06T20:01:53.831 INFO:teuthology.orchestra.run.smithi006.stdout:667.out 2023-07-06T20:01:53.831 INFO:teuthology.orchestra.run.smithi006.stdout:668 2023-07-06T20:01:53.832 INFO:teuthology.orchestra.run.smithi006.stdout:668.out 2023-07-06T20:01:53.832 INFO:teuthology.orchestra.run.smithi006.stdout:669 2023-07-06T20:01:53.832 INFO:teuthology.orchestra.run.smithi006.stdout:669.out 2023-07-06T20:01:53.833 INFO:teuthology.orchestra.run.smithi006.stdout:670 2023-07-06T20:01:53.833 INFO:teuthology.orchestra.run.smithi006.stdout:670.out 2023-07-06T20:01:53.833 INFO:teuthology.orchestra.run.smithi006.stdout:671 2023-07-06T20:01:53.834 INFO:teuthology.orchestra.run.smithi006.stdout:671.out 2023-07-06T20:01:53.834 INFO:teuthology.orchestra.run.smithi006.stdout:672 2023-07-06T20:01:53.834 INFO:teuthology.orchestra.run.smithi006.stdout:672.out 2023-07-06T20:01:53.834 INFO:teuthology.orchestra.run.smithi006.stdout:673 2023-07-06T20:01:53.835 INFO:teuthology.orchestra.run.smithi006.stdout:673.out 2023-07-06T20:01:53.835 INFO:teuthology.orchestra.run.smithi006.stdout:674 2023-07-06T20:01:53.835 INFO:teuthology.orchestra.run.smithi006.stdout:674.out 2023-07-06T20:01:53.836 INFO:teuthology.orchestra.run.smithi006.stdout:675 2023-07-06T20:01:53.836 INFO:teuthology.orchestra.run.smithi006.stdout:675.out 2023-07-06T20:01:53.837 INFO:teuthology.orchestra.run.smithi006.stdout:676 2023-07-06T20:01:53.837 INFO:teuthology.orchestra.run.smithi006.stdout:676.out 2023-07-06T20:01:53.837 INFO:teuthology.orchestra.run.smithi006.stdout:677 2023-07-06T20:01:53.838 INFO:teuthology.orchestra.run.smithi006.stdout:677.out 2023-07-06T20:01:53.838 INFO:teuthology.orchestra.run.smithi006.stdout:678 2023-07-06T20:01:53.838 INFO:teuthology.orchestra.run.smithi006.stdout:678.out 2023-07-06T20:01:53.838 INFO:teuthology.orchestra.run.smithi006.stdout:679 2023-07-06T20:01:53.839 INFO:teuthology.orchestra.run.smithi006.stdout:679.out 2023-07-06T20:01:53.839 INFO:teuthology.orchestra.run.smithi006.stdout:680 2023-07-06T20:01:53.839 INFO:teuthology.orchestra.run.smithi006.stdout:680.out 2023-07-06T20:01:53.839 INFO:teuthology.orchestra.run.smithi006.stdout:681 2023-07-06T20:01:53.840 INFO:teuthology.orchestra.run.smithi006.stdout:681.out 2023-07-06T20:01:53.840 INFO:teuthology.orchestra.run.smithi006.stdout:682 2023-07-06T20:01:53.840 INFO:teuthology.orchestra.run.smithi006.stdout:682.out 2023-07-06T20:01:53.840 INFO:teuthology.orchestra.run.smithi006.stdout:683 2023-07-06T20:01:53.841 INFO:teuthology.orchestra.run.smithi006.stdout:683.out 2023-07-06T20:01:53.841 INFO:teuthology.orchestra.run.smithi006.stdout:684 2023-07-06T20:01:53.841 INFO:teuthology.orchestra.run.smithi006.stdout:684.out 2023-07-06T20:01:53.842 INFO:teuthology.orchestra.run.smithi006.stdout:685 2023-07-06T20:01:53.842 INFO:teuthology.orchestra.run.smithi006.stdout:685.out 2023-07-06T20:01:53.842 INFO:teuthology.orchestra.run.smithi006.stdout:686 2023-07-06T20:01:53.842 INFO:teuthology.orchestra.run.smithi006.stdout:686.out 2023-07-06T20:01:53.843 INFO:teuthology.orchestra.run.smithi006.stdout:687 2023-07-06T20:01:53.843 INFO:teuthology.orchestra.run.smithi006.stdout:687.out 2023-07-06T20:01:53.843 INFO:teuthology.orchestra.run.smithi006.stdout:688 2023-07-06T20:01:53.843 INFO:teuthology.orchestra.run.smithi006.stdout:688.out 2023-07-06T20:01:53.843 INFO:teuthology.orchestra.run.smithi006.stdout:689 2023-07-06T20:01:53.843 INFO:teuthology.orchestra.run.smithi006.stdout:689.out 2023-07-06T20:01:53.844 INFO:teuthology.orchestra.run.smithi006.stdout:690 2023-07-06T20:01:53.844 INFO:teuthology.orchestra.run.smithi006.stdout:690.out 2023-07-06T20:01:53.844 INFO:teuthology.orchestra.run.smithi006.stdout:691 2023-07-06T20:01:53.844 INFO:teuthology.orchestra.run.smithi006.stdout:691.out 2023-07-06T20:01:53.844 INFO:teuthology.orchestra.run.smithi006.stdout:692 2023-07-06T20:01:53.844 INFO:teuthology.orchestra.run.smithi006.stdout:692.out 2023-07-06T20:01:53.844 INFO:teuthology.orchestra.run.smithi006.stdout:693 2023-07-06T20:01:53.844 INFO:teuthology.orchestra.run.smithi006.stdout:693.out 2023-07-06T20:01:53.845 INFO:teuthology.orchestra.run.smithi006.stdout:694 2023-07-06T20:01:53.845 INFO:teuthology.orchestra.run.smithi006.stdout:694.out 2023-07-06T20:01:53.845 INFO:teuthology.orchestra.run.smithi006.stdout:695 2023-07-06T20:01:53.845 INFO:teuthology.orchestra.run.smithi006.stdout:695.out 2023-07-06T20:01:53.845 INFO:teuthology.orchestra.run.smithi006.stdout:696 2023-07-06T20:01:53.845 INFO:teuthology.orchestra.run.smithi006.stdout:696.out 2023-07-06T20:01:53.845 INFO:teuthology.orchestra.run.smithi006.stdout:697 2023-07-06T20:01:53.845 INFO:teuthology.orchestra.run.smithi006.stdout:697.out 2023-07-06T20:01:53.846 INFO:teuthology.orchestra.run.smithi006.stdout:698 2023-07-06T20:01:53.846 INFO:teuthology.orchestra.run.smithi006.stdout:698.out 2023-07-06T20:01:53.846 INFO:teuthology.orchestra.run.smithi006.stdout:699 2023-07-06T20:01:53.846 INFO:teuthology.orchestra.run.smithi006.stdout:699.out 2023-07-06T20:01:53.846 INFO:teuthology.orchestra.run.smithi006.stdout:700 2023-07-06T20:01:53.847 INFO:teuthology.orchestra.run.smithi006.stdout:700.out 2023-07-06T20:01:53.847 INFO:teuthology.orchestra.run.smithi006.stdout:701 2023-07-06T20:01:53.847 INFO:teuthology.orchestra.run.smithi006.stdout:701.out 2023-07-06T20:01:53.847 INFO:teuthology.orchestra.run.smithi006.stdout:702 2023-07-06T20:01:53.847 INFO:teuthology.orchestra.run.smithi006.stdout:702.out 2023-07-06T20:01:53.847 INFO:teuthology.orchestra.run.smithi006.stdout:703 2023-07-06T20:01:53.848 INFO:teuthology.orchestra.run.smithi006.stdout:703.out 2023-07-06T20:01:53.848 INFO:teuthology.orchestra.run.smithi006.stdout:704 2023-07-06T20:01:53.848 INFO:teuthology.orchestra.run.smithi006.stdout:704.out 2023-07-06T20:01:53.848 INFO:teuthology.orchestra.run.smithi006.stdout:705 2023-07-06T20:01:53.848 INFO:teuthology.orchestra.run.smithi006.stdout:705.out 2023-07-06T20:01:53.848 INFO:teuthology.orchestra.run.smithi006.stdout:706 2023-07-06T20:01:53.848 INFO:teuthology.orchestra.run.smithi006.stdout:706.out 2023-07-06T20:01:53.848 INFO:teuthology.orchestra.run.smithi006.stdout:707 2023-07-06T20:01:53.849 INFO:teuthology.orchestra.run.smithi006.stdout:707.out 2023-07-06T20:01:53.849 INFO:teuthology.orchestra.run.smithi006.stdout:708 2023-07-06T20:01:53.849 INFO:teuthology.orchestra.run.smithi006.stdout:708.out 2023-07-06T20:01:53.849 INFO:teuthology.orchestra.run.smithi006.stdout:709 2023-07-06T20:01:53.849 INFO:teuthology.orchestra.run.smithi006.stdout:709.out 2023-07-06T20:01:53.849 INFO:teuthology.orchestra.run.smithi006.stdout:710 2023-07-06T20:01:53.849 INFO:teuthology.orchestra.run.smithi006.stdout:710.out 2023-07-06T20:01:53.849 INFO:teuthology.orchestra.run.smithi006.stdout:711 2023-07-06T20:01:53.850 INFO:teuthology.orchestra.run.smithi006.stdout:711.out 2023-07-06T20:01:53.850 INFO:teuthology.orchestra.run.smithi006.stdout:712 2023-07-06T20:01:53.850 INFO:teuthology.orchestra.run.smithi006.stdout:712.out 2023-07-06T20:01:53.850 INFO:teuthology.orchestra.run.smithi006.stdout:713 2023-07-06T20:01:53.850 INFO:teuthology.orchestra.run.smithi006.stdout:713.out 2023-07-06T20:01:53.850 INFO:teuthology.orchestra.run.smithi006.stdout:714 2023-07-06T20:01:53.850 INFO:teuthology.orchestra.run.smithi006.stdout:714.out 2023-07-06T20:01:53.850 INFO:teuthology.orchestra.run.smithi006.stdout:715 2023-07-06T20:01:53.851 INFO:teuthology.orchestra.run.smithi006.stdout:715.out 2023-07-06T20:01:53.851 INFO:teuthology.orchestra.run.smithi006.stdout:716 2023-07-06T20:01:53.851 INFO:teuthology.orchestra.run.smithi006.stdout:716.out 2023-07-06T20:01:53.851 INFO:teuthology.orchestra.run.smithi006.stdout:717 2023-07-06T20:01:53.851 INFO:teuthology.orchestra.run.smithi006.stdout:717.out 2023-07-06T20:01:53.851 INFO:teuthology.orchestra.run.smithi006.stdout:718 2023-07-06T20:01:53.851 INFO:teuthology.orchestra.run.smithi006.stdout:718.out 2023-07-06T20:01:53.851 INFO:teuthology.orchestra.run.smithi006.stdout:719 2023-07-06T20:01:53.852 INFO:teuthology.orchestra.run.smithi006.stdout:719.out 2023-07-06T20:01:53.852 INFO:teuthology.orchestra.run.smithi006.stdout:720 2023-07-06T20:01:53.853 INFO:teuthology.orchestra.run.smithi006.stdout:720.out 2023-07-06T20:01:53.854 INFO:teuthology.orchestra.run.smithi006.stdout:721 2023-07-06T20:01:53.854 INFO:teuthology.orchestra.run.smithi006.stdout:721.out 2023-07-06T20:01:53.854 INFO:teuthology.orchestra.run.smithi006.stdout:722 2023-07-06T20:01:53.854 INFO:teuthology.orchestra.run.smithi006.stdout:722.out 2023-07-06T20:01:53.854 INFO:teuthology.orchestra.run.smithi006.stdout:723 2023-07-06T20:01:53.857 INFO:teuthology.orchestra.run.smithi006.stdout:723.out 2023-07-06T20:01:53.857 INFO:teuthology.orchestra.run.smithi006.stdout:724 2023-07-06T20:01:53.857 INFO:teuthology.orchestra.run.smithi006.stdout:724.out 2023-07-06T20:01:53.858 INFO:teuthology.orchestra.run.smithi006.stdout:725 2023-07-06T20:01:53.858 INFO:teuthology.orchestra.run.smithi006.stdout:725.out 2023-07-06T20:01:53.858 INFO:teuthology.orchestra.run.smithi006.stdout:726 2023-07-06T20:01:53.858 INFO:teuthology.orchestra.run.smithi006.stdout:726.out 2023-07-06T20:01:53.858 INFO:teuthology.orchestra.run.smithi006.stdout:727 2023-07-06T20:01:53.858 INFO:teuthology.orchestra.run.smithi006.stdout:727.out 2023-07-06T20:01:53.858 INFO:teuthology.orchestra.run.smithi006.stdout:728 2023-07-06T20:01:53.859 INFO:teuthology.orchestra.run.smithi006.stdout:728.out 2023-07-06T20:01:53.859 INFO:teuthology.orchestra.run.smithi006.stdout:group.list 2023-07-06T20:01:53.859 INFO:teuthology.orchestra.run.smithi006.stdout:Makefile 2023-07-06T20:01:53.859 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-07-06T20:01:54.158 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:01:54.162 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:01:54.162 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:01:54.164 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:01:54.164 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:01:59.294 INFO:teuthology.orchestra.run.smithi006.stdout:generic/001 5s 2023-07-06T20:01:59.299 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/001 2023-07-06T20:01:59.299 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:01:59.301 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:02:00.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:02:00.077 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-07-06T20:02:00.299 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:02:00.304 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:02:00.304 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:02:00.306 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:02:00.307 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:02:00.807 INFO:teuthology.orchestra.run.smithi006.stdout:generic/002 0s 2023-07-06T20:02:00.812 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/002 2023-07-06T20:02:00.812 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:02:00.813 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:02:00.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:02:00.911 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-07-06T20:02:01.236 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:02:01.253 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:02:01.254 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:02:01.254 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:02:01.254 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:02:01.568 INFO:teuthology.orchestra.run.smithi006.stdout:generic/003 [not run] atime not maintained by ceph 2023-07-06T20:02:01.572 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/003 2023-07-06T20:02:01.574 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/003 2023-07-06T20:02:01.574 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:02:01.575 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:02:01.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:02:01.599 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-07-06T20:02:01.836 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:02:01.844 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:02:01.844 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:02:01.844 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:02:01.845 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:02:02.175 INFO:teuthology.orchestra.run.smithi006.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-07-06T20:02:02.179 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/004 2023-07-06T20:02:02.180 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/004 2023-07-06T20:02:02.180 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:02:02.186 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:02:02.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:02:02.212 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-07-06T20:02:02.436 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:02:02.440 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:02:02.441 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:02:02.442 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:02:02.442 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:02:02.972 INFO:teuthology.orchestra.run.smithi006.stdout:generic/005 0s 2023-07-06T20:02:02.973 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/005 2023-07-06T20:02:02.973 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:02:02.973 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:02:03.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:02:03.079 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-07-06T20:02:03.311 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:02:03.315 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:02:03.315 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:02:03.316 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:02:03.316 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:02:20.257 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:02:20.260 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:02:29.104 INFO:teuthology.orchestra.run.smithi006.stdout:generic/006 26s 2023-07-06T20:02:29.108 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/006 2023-07-06T20:02:29.108 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:02:29.110 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:02:29.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:02:29.166 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-07-06T20:02:29.607 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:02:29.612 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:02:29.612 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:02:29.613 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:02:29.613 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:02:50.318 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:02:50.329 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:03:20.778 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:03:20.781 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:03:22.587 INFO:teuthology.orchestra.run.smithi006.stdout:generic/007 53s 2023-07-06T20:03:22.591 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/007 2023-07-06T20:03:22.592 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:03:22.594 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:03:22.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:03:22.669 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-07-06T20:03:22.890 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:03:22.899 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:03:22.899 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:03:22.901 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:03:22.901 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:03:23.325 INFO:teuthology.orchestra.run.smithi006.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-06T20:03:23.329 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/008 2023-07-06T20:03:23.329 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/008 2023-07-06T20:03:23.329 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:03:23.331 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:03:23.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:03:23.355 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-07-06T20:03:23.563 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:03:23.568 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:03:23.568 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:03:23.568 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:03:23.569 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:03:23.959 INFO:teuthology.orchestra.run.smithi006.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-06T20:03:23.963 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/009 2023-07-06T20:03:23.963 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/009 2023-07-06T20:03:23.963 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:03:23.965 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:03:23.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:03:23.991 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-07-06T20:03:24.197 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:03:24.201 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:03:24.202 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:03:24.202 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:03:24.203 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:03:24.503 INFO:teuthology.orchestra.run.smithi006.stdout:generic/010 [not run] /tmp/tmp.LybHGoQKZdxfstests-dev/src/dbtest not built 2023-07-06T20:03:24.508 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/010 2023-07-06T20:03:24.508 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/010 2023-07-06T20:03:24.509 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:03:24.510 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:03:24.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:03:24.536 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-07-06T20:03:24.748 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:03:24.752 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:03:24.753 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:03:24.754 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:03:24.754 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:03:50.843 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:03:50.846 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:04:01.220 INFO:teuthology.orchestra.run.smithi006.stdout:generic/011 37s 2023-07-06T20:04:01.226 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/011 2023-07-06T20:04:01.226 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:04:01.228 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:04:01.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:04:01.540 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-07-06T20:04:01.768 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:04:01.769 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:04:01.769 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:04:01.770 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:04:01.770 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:04:02.175 INFO:teuthology.orchestra.run.smithi006.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T20:04:02.178 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/012 2023-07-06T20:04:02.179 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/012 2023-07-06T20:04:02.179 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:04:02.181 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:04:02.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:04:02.252 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-07-06T20:04:02.561 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:04:02.565 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:04:02.565 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:04:02.566 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:04:02.567 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:04:21.307 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:04:21.312 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:04:51.820 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:04:51.822 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:04:57.776 INFO:teuthology.orchestra.run.smithi006.stdout:generic/013 55s 2023-07-06T20:04:57.841 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/013 2023-07-06T20:04:57.842 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:04:57.844 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:04:57.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:04:57.886 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-07-06T20:04:58.189 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:04:58.196 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:04:58.197 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:04:58.198 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:04:58.198 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:05:21.894 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:05:21.898 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:05:52.325 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:05:52.331 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:06:22.858 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:06:22.867 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:06:52.975 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:06:52.978 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:07:23.370 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:07:23.380 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:07:53.693 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:07:53.707 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:08:23.819 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:08:23.838 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:08:53.931 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:08:53.933 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:09:24.063 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:09:24.081 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:09:49.950 INFO:teuthology.orchestra.run.smithi006.stdout:generic/014 291s 2023-07-06T20:09:49.963 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/014 2023-07-06T20:09:49.963 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:09:49.970 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:09:50.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:09:50.022 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-07-06T20:09:50.392 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:09:50.401 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:09:50.401 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:09:50.403 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:09:50.403 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:09:50.914 INFO:teuthology.orchestra.run.smithi006.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-06T20:09:50.919 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/015 2023-07-06T20:09:50.919 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/015 2023-07-06T20:09:50.919 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:09:50.929 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:09:50.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:09:50.951 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-07-06T20:09:51.314 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:09:51.317 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:09:51.318 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:09:51.319 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:09:51.319 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:09:52.082 INFO:teuthology.orchestra.run.smithi006.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T20:09:52.087 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/016 2023-07-06T20:09:52.088 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/016 2023-07-06T20:09:52.088 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:09:52.094 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:09:52.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:09:52.322 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-07-06T20:09:52.788 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:09:52.794 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:09:52.795 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:09:52.796 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:09:52.796 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:09:53.352 INFO:teuthology.orchestra.run.smithi006.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-06T20:09:53.357 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/017 2023-07-06T20:09:53.357 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/017 2023-07-06T20:09:53.357 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:09:53.359 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:09:53.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:09:53.401 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-07-06T20:09:53.798 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:09:53.807 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:09:53.808 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:09:53.810 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:09:53.810 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:09:54.175 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:09:54.177 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:09:54.519 INFO:teuthology.orchestra.run.smithi006.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-07-06T20:09:54.535 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/018 2023-07-06T20:09:54.536 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/018 2023-07-06T20:09:54.536 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:09:54.538 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:09:54.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:09:54.574 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-07-06T20:09:54.946 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:09:54.952 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:09:54.952 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:09:54.953 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:09:54.953 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:09:55.453 INFO:teuthology.orchestra.run.smithi006.stdout:generic/019 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T20:09:55.466 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/019 2023-07-06T20:09:55.466 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/019 2023-07-06T20:09:55.466 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:09:55.468 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:09:55.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:09:55.496 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-07-06T20:09:55.880 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:09:55.889 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:09:55.890 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:09:55.890 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:09:55.891 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:10:00.397 INFO:teuthology.orchestra.run.smithi006.stdout:generic/020 4s 2023-07-06T20:10:00.456 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/020 2023-07-06T20:10:00.456 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:10:00.462 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:10:00.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:10:00.681 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-07-06T20:10:01.215 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:10:01.220 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:10:01.220 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:10:01.221 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:10:01.222 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:10:01.918 INFO:teuthology.orchestra.run.smithi006.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T20:10:01.924 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/021 2023-07-06T20:10:01.924 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/021 2023-07-06T20:10:01.924 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:10:01.926 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:10:02.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:10:02.271 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-07-06T20:10:02.652 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:10:02.656 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:10:02.656 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:10:02.657 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:10:02.657 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:10:03.252 INFO:teuthology.orchestra.run.smithi006.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T20:10:03.261 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/022 2023-07-06T20:10:03.261 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/022 2023-07-06T20:10:03.262 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:10:03.271 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:10:03.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:10:03.540 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-07-06T20:10:03.992 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:10:03.996 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:10:03.996 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:10:03.998 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:10:03.998 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:10:24.256 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:10:24.259 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:10:54.339 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:10:54.342 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:10:55.988 INFO:teuthology.orchestra.run.smithi006.stdout:generic/023 51s 2023-07-06T20:10:56.031 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/023 2023-07-06T20:10:56.032 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:10:56.032 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:10:56.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:10:56.428 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-07-06T20:10:56.802 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:10:56.807 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:10:56.808 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:10:56.809 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:10:56.809 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:10:57.368 INFO:teuthology.orchestra.run.smithi006.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-07-06T20:10:57.376 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/024 2023-07-06T20:10:57.376 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/024 2023-07-06T20:10:57.376 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:10:57.380 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:10:57.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:10:57.663 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-07-06T20:10:58.097 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:10:58.102 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:10:58.103 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:10:58.104 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:10:58.104 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:10:58.657 INFO:teuthology.orchestra.run.smithi006.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-07-06T20:10:58.668 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/025 2023-07-06T20:10:58.669 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/025 2023-07-06T20:10:58.669 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:10:58.671 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:10:59.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:10:59.036 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-07-06T20:10:59.405 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:10:59.415 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:10:59.416 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:10:59.419 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:10:59.420 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:10:59.983 INFO:teuthology.orchestra.run.smithi006.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-07-06T20:10:59.989 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/026 2023-07-06T20:10:59.989 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/026 2023-07-06T20:10:59.989 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:10:59.996 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:00.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:00.048 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-07-06T20:11:00.396 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:00.401 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:00.403 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:00.404 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:00.404 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:00.902 INFO:teuthology.orchestra.run.smithi006.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-06T20:11:00.911 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/027 2023-07-06T20:11:00.911 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/027 2023-07-06T20:11:00.911 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:00.914 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:00.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:00.948 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-07-06T20:11:01.355 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:01.359 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:01.360 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:01.361 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:01.361 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:06.872 INFO:teuthology.orchestra.run.smithi006.stdout:generic/028 5s 2023-07-06T20:11:06.877 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/028 2023-07-06T20:11:06.878 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:06.880 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:06.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:06.922 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-07-06T20:11:07.319 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:07.327 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:07.327 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:07.329 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:07.329 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:13.669 INFO:teuthology.orchestra.run.smithi006.stdout:generic/029 6s 2023-07-06T20:11:13.679 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/029 2023-07-06T20:11:13.679 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:13.684 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:13.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:13.700 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-07-06T20:11:14.129 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:14.143 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:14.144 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:14.145 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:14.146 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:16.421 INFO:teuthology.orchestra.run.smithi006.stdout:generic/030 2s 2023-07-06T20:11:16.438 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/030 2023-07-06T20:11:16.438 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:16.442 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:16.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:16.459 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-07-06T20:11:16.806 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:16.822 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:16.823 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:16.824 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:16.824 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:17.481 INFO:teuthology.orchestra.run.smithi006.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-07-06T20:11:17.497 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/031 2023-07-06T20:11:17.498 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/031 2023-07-06T20:11:17.498 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:17.504 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:17.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:17.533 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-07-06T20:11:17.894 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:17.905 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:17.905 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:17.906 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:17.907 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:18.460 INFO:teuthology.orchestra.run.smithi006.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T20:11:18.469 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/032 2023-07-06T20:11:18.469 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/032 2023-07-06T20:11:18.469 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:18.471 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:18.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:18.522 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-07-06T20:11:18.921 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:18.926 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:18.926 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:18.931 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:18.932 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:19.596 INFO:teuthology.orchestra.run.smithi006.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-06T20:11:19.601 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/033 2023-07-06T20:11:19.601 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/033 2023-07-06T20:11:19.601 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:19.606 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:19.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:19.635 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-07-06T20:11:19.976 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:19.987 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:19.987 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:19.988 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:19.988 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:20.508 INFO:teuthology.orchestra.run.smithi006.stdout:generic/034 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T20:11:20.513 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/034 2023-07-06T20:11:20.513 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/034 2023-07-06T20:11:20.513 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:20.516 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:20.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:20.544 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-07-06T20:11:20.941 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:20.947 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:20.948 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:20.949 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:20.949 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:21.547 INFO:teuthology.orchestra.run.smithi006.stdout:generic/035 0s 2023-07-06T20:11:21.558 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/035 2023-07-06T20:11:21.559 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:21.566 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:21.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:21.767 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-07-06T20:11:22.313 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:22.324 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:22.324 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:22.329 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:22.330 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:24.410 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:11:24.417 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:11:32.989 INFO:teuthology.orchestra.run.smithi006.stdout:generic/036 10s 2023-07-06T20:11:32.997 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/036 2023-07-06T20:11:32.998 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:33.000 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:33.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:33.290 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-07-06T20:11:33.798 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:33.802 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:33.803 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:33.804 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:33.804 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:39.490 INFO:teuthology.orchestra.run.smithi006.stdout:generic/037 5s 2023-07-06T20:11:39.501 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/037 2023-07-06T20:11:39.502 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:39.503 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:39.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:39.512 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-07-06T20:11:39.735 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:39.739 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:39.740 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:39.740 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:39.741 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:40.091 INFO:teuthology.orchestra.run.smithi006.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T20:11:40.095 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/038 2023-07-06T20:11:40.096 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/038 2023-07-06T20:11:40.096 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:40.097 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:40.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:40.129 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-07-06T20:11:40.352 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:40.357 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:40.357 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:40.358 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:40.358 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:40.691 INFO:teuthology.orchestra.run.smithi006.stdout:generic/039 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T20:11:40.695 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/039 2023-07-06T20:11:40.695 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/039 2023-07-06T20:11:40.695 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:40.697 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:40.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:40.730 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-07-06T20:11:40.938 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:40.942 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:40.943 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:40.944 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:40.944 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:41.292 INFO:teuthology.orchestra.run.smithi006.stdout:generic/040 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T20:11:41.296 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/040 2023-07-06T20:11:41.296 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/040 2023-07-06T20:11:41.297 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:41.298 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:41.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:41.325 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-07-06T20:11:41.559 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:41.563 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:41.564 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:41.565 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:41.565 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:41.895 INFO:teuthology.orchestra.run.smithi006.stdout:generic/041 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T20:11:41.899 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/041 2023-07-06T20:11:41.899 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/041 2023-07-06T20:11:41.899 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:41.901 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:41.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:41.937 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-07-06T20:11:42.162 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:42.166 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:42.167 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:42.168 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:42.168 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:42.644 INFO:teuthology.orchestra.run.smithi006.stdout:generic/042 [not run] ceph does not support shutdown 2023-07-06T20:11:42.661 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/042 2023-07-06T20:11:42.662 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/042 2023-07-06T20:11:42.662 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:42.663 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:42.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:42.686 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-07-06T20:11:42.903 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:42.907 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:42.908 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:42.909 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:42.909 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:43.391 INFO:teuthology.orchestra.run.smithi006.stdout:generic/043 [not run] ceph does not support shutdown 2023-07-06T20:11:43.411 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/043 2023-07-06T20:11:43.411 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/043 2023-07-06T20:11:43.411 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:43.412 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:43.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:43.435 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-07-06T20:11:43.648 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:43.653 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:43.653 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:43.654 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:43.654 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:44.156 INFO:teuthology.orchestra.run.smithi006.stdout:generic/044 [not run] ceph does not support shutdown 2023-07-06T20:11:44.177 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/044 2023-07-06T20:11:44.177 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/044 2023-07-06T20:11:44.177 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:44.179 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:44.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:44.204 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-07-06T20:11:44.416 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:44.420 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:44.421 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:44.421 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:44.422 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:44.892 INFO:teuthology.orchestra.run.smithi006.stdout:generic/045 [not run] ceph does not support shutdown 2023-07-06T20:11:44.920 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/045 2023-07-06T20:11:44.921 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/045 2023-07-06T20:11:44.921 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:44.923 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:44.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:44.946 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-07-06T20:11:45.158 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:45.163 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:45.163 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:45.164 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:45.164 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:45.647 INFO:teuthology.orchestra.run.smithi006.stdout:generic/046 [not run] ceph does not support shutdown 2023-07-06T20:11:45.667 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/046 2023-07-06T20:11:45.667 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/046 2023-07-06T20:11:45.668 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:45.669 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:45.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:45.692 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-07-06T20:11:45.909 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:45.913 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:45.914 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:45.914 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:45.915 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:46.404 INFO:teuthology.orchestra.run.smithi006.stdout:generic/047 [not run] ceph does not support shutdown 2023-07-06T20:11:46.424 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/047 2023-07-06T20:11:46.425 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/047 2023-07-06T20:11:46.425 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:46.426 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:46.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:46.449 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-07-06T20:11:46.661 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:46.665 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:46.666 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:46.667 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:46.667 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:47.187 INFO:teuthology.orchestra.run.smithi006.stdout:generic/048 [not run] ceph does not support shutdown 2023-07-06T20:11:47.204 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/048 2023-07-06T20:11:47.204 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/048 2023-07-06T20:11:47.205 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:47.206 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:47.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:47.233 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-07-06T20:11:47.451 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:47.455 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:47.455 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:47.456 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:47.456 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:47.925 INFO:teuthology.orchestra.run.smithi006.stdout:generic/049 [not run] ceph does not support shutdown 2023-07-06T20:11:47.943 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/049 2023-07-06T20:11:47.943 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/049 2023-07-06T20:11:47.943 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:47.945 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:47.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:47.975 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-07-06T20:11:48.213 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:48.217 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:48.218 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:48.219 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:48.219 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:48.728 INFO:teuthology.orchestra.run.smithi006.stdout:generic/050 [not run] ceph does not support shutdown 2023-07-06T20:11:48.751 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/050 2023-07-06T20:11:48.751 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/050 2023-07-06T20:11:48.751 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:48.753 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:48.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:48.782 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-07-06T20:11:49.001 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:49.005 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:49.005 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:49.006 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:49.006 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:49.511 INFO:teuthology.orchestra.run.smithi006.stdout:generic/051 [not run] ceph does not support shutdown 2023-07-06T20:11:49.515 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/051 2023-07-06T20:11:49.515 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/051 2023-07-06T20:11:49.516 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:49.517 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:49.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:49.543 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-07-06T20:11:49.753 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:49.758 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:49.758 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:49.759 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:49.759 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:50.236 INFO:teuthology.orchestra.run.smithi006.stdout:generic/052 [not run] ceph does not support shutdown 2023-07-06T20:11:50.252 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/052 2023-07-06T20:11:50.252 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/052 2023-07-06T20:11:50.252 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:50.254 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:50.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:50.272 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-07-06T20:11:50.484 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:50.488 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:50.488 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:50.489 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:50.489 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:51.494 INFO:teuthology.orchestra.run.smithi006.stdout:generic/053 1s 2023-07-06T20:11:51.501 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/053 2023-07-06T20:11:51.501 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:51.503 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:51.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:51.512 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-07-06T20:11:51.720 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:51.724 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:51.725 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:51.726 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:51.726 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:52.246 INFO:teuthology.orchestra.run.smithi006.stdout:generic/054 [not run] ceph does not support shutdown 2023-07-06T20:11:52.273 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/054 2023-07-06T20:11:52.273 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/054 2023-07-06T20:11:52.273 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:52.275 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:52.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:52.299 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-07-06T20:11:52.536 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:52.540 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:52.540 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:52.541 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:52.541 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:53.023 INFO:teuthology.orchestra.run.smithi006.stdout:generic/055 [not run] ceph does not support shutdown 2023-07-06T20:11:53.042 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/055 2023-07-06T20:11:53.042 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/055 2023-07-06T20:11:53.042 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:53.044 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:53.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:53.067 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-07-06T20:11:53.284 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:53.288 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:53.288 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:53.289 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:53.289 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:53.674 INFO:teuthology.orchestra.run.smithi006.stdout:generic/056 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T20:11:53.678 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/056 2023-07-06T20:11:53.678 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/056 2023-07-06T20:11:53.678 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:53.680 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:53.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:53.707 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-07-06T20:11:53.945 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:53.949 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:53.950 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:53.951 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:53.951 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:54.309 INFO:teuthology.orchestra.run.smithi006.stdout:generic/057 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T20:11:54.313 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/057 2023-07-06T20:11:54.313 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/057 2023-07-06T20:11:54.313 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:54.315 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:54.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:54.344 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-07-06T20:11:54.520 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:11:54.523 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:11:54.568 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:54.572 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:54.572 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:54.573 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:54.573 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:55.024 INFO:teuthology.orchestra.run.smithi006.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T20:11:55.028 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/058 2023-07-06T20:11:55.028 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/058 2023-07-06T20:11:55.028 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:55.030 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:55.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:55.298 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-07-06T20:11:55.636 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:55.640 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:55.641 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:55.642 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:55.643 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:55.960 INFO:teuthology.orchestra.run.smithi006.stdout:generic/059 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T20:11:55.965 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/059 2023-07-06T20:11:55.965 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/059 2023-07-06T20:11:55.965 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:55.967 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:55.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:55.994 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-07-06T20:11:56.199 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:56.203 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:56.203 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:56.204 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:56.205 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:56.634 INFO:teuthology.orchestra.run.smithi006.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T20:11:56.638 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/060 2023-07-06T20:11:56.638 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/060 2023-07-06T20:11:56.638 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:56.640 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:56.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:56.937 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-07-06T20:11:57.213 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:57.217 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:57.217 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:57.218 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:57.219 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:57.638 INFO:teuthology.orchestra.run.smithi006.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T20:11:57.642 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/061 2023-07-06T20:11:57.642 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/061 2023-07-06T20:11:57.643 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:11:57.644 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:11:58.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:11:58.021 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-07-06T20:11:58.266 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:11:58.270 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:11:58.271 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:11:58.271 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:11:58.271 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:00.234 INFO:teuthology.orchestra.run.smithi006.stdout:generic/062 2s 2023-07-06T20:12:00.242 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/062 2023-07-06T20:12:00.242 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:12:00.244 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:00.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:12:00.252 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-07-06T20:12:00.466 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:12:00.471 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:12:00.471 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:12:00.472 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:12:00.473 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:00.917 INFO:teuthology.orchestra.run.smithi006.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T20:12:00.921 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/063 2023-07-06T20:12:00.921 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/063 2023-07-06T20:12:00.921 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:12:00.923 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:01.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:12:01.100 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-07-06T20:12:01.523 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:12:01.527 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:12:01.527 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:12:01.528 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:12:01.529 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:01.892 INFO:teuthology.orchestra.run.smithi006.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-06T20:12:01.896 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/064 2023-07-06T20:12:01.897 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/064 2023-07-06T20:12:01.897 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:12:01.898 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:01.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:12:01.930 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-07-06T20:12:02.153 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:12:02.157 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:12:02.157 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:12:02.158 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:12:02.158 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:02.520 INFO:teuthology.orchestra.run.smithi006.stdout:generic/065 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T20:12:02.524 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/065 2023-07-06T20:12:02.524 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/065 2023-07-06T20:12:02.524 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:12:02.526 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:02.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:12:02.549 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-07-06T20:12:02.756 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:12:02.760 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:12:02.761 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:12:02.761 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:12:02.762 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:03.090 INFO:teuthology.orchestra.run.smithi006.stdout:generic/066 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T20:12:03.094 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/066 2023-07-06T20:12:03.094 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/066 2023-07-06T20:12:03.094 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:12:03.096 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:03.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:12:03.122 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-07-06T20:12:03.362 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:12:03.366 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:12:03.366 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:12:03.367 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:12:03.367 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:03.716 INFO:teuthology.orchestra.run.smithi006.stdout:generic/067 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T20:12:03.720 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/067 2023-07-06T20:12:03.720 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/067 2023-07-06T20:12:03.720 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:12:03.722 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:03.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:12:03.750 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-07-06T20:12:03.963 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:12:03.968 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:12:03.968 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:12:03.969 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:12:03.969 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:04.339 INFO:teuthology.orchestra.run.smithi006.stdout:generic/068 [not run] ceph does not support freezing 2023-07-06T20:12:04.343 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/068 2023-07-06T20:12:04.343 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/068 2023-07-06T20:12:04.344 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:12:04.345 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:04.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:12:04.369 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-07-06T20:12:04.593 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:12:04.597 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:12:04.597 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:12:04.598 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:12:04.598 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:11.451 INFO:teuthology.orchestra.run.smithi006.stdout:generic/069 7s 2023-07-06T20:12:11.457 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/069 2023-07-06T20:12:11.457 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:12:11.459 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:11.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:12:11.468 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-07-06T20:12:11.691 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:12:11.695 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:12:11.695 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:12:11.696 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:12:11.696 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:24.605 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:12:24.610 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:12:41.230 INFO:teuthology.orchestra.run.smithi006.stdout:generic/070 30s 2023-07-06T20:12:41.236 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/070 2023-07-06T20:12:41.236 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:12:41.239 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:41.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:12:41.670 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-07-06T20:12:42.100 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:12:42.106 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:12:42.107 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:12:42.108 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:12:42.108 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:42.731 INFO:teuthology.orchestra.run.smithi006.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-06T20:12:42.735 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/071 2023-07-06T20:12:42.736 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/071 2023-07-06T20:12:42.736 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:12:42.738 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:42.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:12:42.778 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-07-06T20:12:43.177 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:12:43.182 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:12:43.182 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:12:43.187 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:12:43.187 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:43.826 INFO:teuthology.orchestra.run.smithi006.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-07-06T20:12:43.832 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/072 2023-07-06T20:12:43.832 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/072 2023-07-06T20:12:43.832 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:12:43.837 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:43.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:12:43.876 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-07-06T20:12:44.251 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:12:44.257 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:12:44.257 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:12:44.258 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:12:44.259 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:44.800 INFO:teuthology.orchestra.run.smithi006.stdout:generic/073 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T20:12:44.804 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/073 2023-07-06T20:12:44.804 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/073 2023-07-06T20:12:44.804 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:12:44.806 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:44.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:12:44.830 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-07-06T20:12:45.237 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:12:45.242 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:12:45.242 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:12:45.244 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:12:45.244 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:12:54.718 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:12:54.721 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:12:55.496 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-07-06T20:12:55.491+0000 7f3a28953700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 111087) UID: 0 2023-07-06T20:12:55.498 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-07-06T20:12:55.497+0000 7f627fdc9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 111087) UID: 0 2023-07-06T20:13:06.202 INFO:teuthology.orchestra.run.smithi006.stdout:generic/074 21s 2023-07-06T20:13:06.210 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/074 2023-07-06T20:13:06.210 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:13:06.213 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:13:06.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:13:06.632 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-07-06T20:13:07.222 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:13:07.229 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:13:07.231 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:13:07.237 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:13:07.237 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:13:48.065 INFO:teuthology.orchestra.run.smithi006.stdout:generic/075 41s 2023-07-06T20:13:48.083 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/075 2023-07-06T20:13:48.083 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:13:48.086 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:13:48.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:13:48.517 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-07-06T20:13:48.870 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:13:48.880 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:13:48.880 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:13:48.881 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:13:48.881 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:13:49.351 INFO:teuthology.orchestra.run.smithi006.stdout:generic/076 [not run] require 172.21.15.6:6789:/scratch to be local device 2023-07-06T20:13:49.357 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/076 2023-07-06T20:13:49.357 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/076 2023-07-06T20:13:49.357 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:13:49.359 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:13:49.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:13:49.385 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-07-06T20:13:49.790 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:13:49.798 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:13:49.799 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:13:49.800 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:13:49.800 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:13:52.984 INFO:teuthology.orchestra.run.smithi006.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-06T20:13:52.993 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/077 2023-07-06T20:13:52.993 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/077 2023-07-06T20:13:52.993 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:13:52.996 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:13:53.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:13:53.315 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-07-06T20:13:53.871 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:13:53.877 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:13:53.878 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:13:53.879 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:13:53.879 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:13:54.421 INFO:teuthology.orchestra.run.smithi006.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-07-06T20:13:54.426 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/078 2023-07-06T20:13:54.426 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/078 2023-07-06T20:13:54.426 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:13:54.430 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:13:54.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:13:54.828 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-07-06T20:13:55.226 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:13:55.235 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:13:55.236 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:13:55.238 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:13:55.238 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:13:55.847 INFO:teuthology.orchestra.run.smithi006.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-07-06T20:13:55.851 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/079 2023-07-06T20:13:55.851 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/079 2023-07-06T20:13:55.852 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:13:55.853 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:13:55.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:13:55.900 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-07-06T20:13:56.291 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:13:56.297 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:13:56.297 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:13:56.298 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:13:56.299 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:13:58.913 INFO:teuthology.orchestra.run.smithi006.stdout:generic/080 2s 2023-07-06T20:13:58.918 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/080 2023-07-06T20:13:58.918 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:13:58.923 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:13:58.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:13:58.966 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-07-06T20:13:59.361 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:13:59.365 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:13:59.366 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:13:59.367 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:13:59.367 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:13:59.936 INFO:teuthology.orchestra.run.smithi006.stdout:generic/081 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T20:13:59.942 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/081 2023-07-06T20:13:59.942 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/081 2023-07-06T20:13:59.942 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:13:59.944 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:13:59.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:13:59.968 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-07-06T20:14:00.319 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:14:00.329 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:14:00.329 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:14:00.333 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:14:00.333 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:14:00.843 INFO:teuthology.orchestra.run.smithi006.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T20:14:00.848 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/082 2023-07-06T20:14:00.848 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/082 2023-07-06T20:14:00.848 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:14:00.854 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:14:00.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:14:00.893 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-07-06T20:14:01.260 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:14:01.265 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:14:01.266 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:14:01.267 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:14:01.267 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:14:01.734 INFO:teuthology.orchestra.run.smithi006.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-06T20:14:01.739 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/083 2023-07-06T20:14:01.739 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/083 2023-07-06T20:14:01.739 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:14:01.741 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:14:01.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:14:01.773 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-07-06T20:14:02.141 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:14:02.147 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:14:02.147 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:14:02.149 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:14:02.149 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:14:11.275 INFO:teuthology.orchestra.run.smithi006.stdout:generic/084 9s 2023-07-06T20:14:11.306 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/084 2023-07-06T20:14:11.306 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:14:11.309 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:14:11.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:14:11.334 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-07-06T20:14:11.687 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:14:11.692 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:14:11.692 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:14:11.693 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:14:11.694 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:14:12.395 INFO:teuthology.orchestra.run.smithi006.stdout:generic/085 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T20:14:12.401 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/085 2023-07-06T20:14:12.402 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/085 2023-07-06T20:14:12.402 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:14:12.404 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:14:12.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:14:12.442 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-07-06T20:14:12.782 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:14:12.787 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:14:12.790 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:14:12.792 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:14:12.792 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:14:13.375 INFO:teuthology.orchestra.run.smithi006.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T20:14:13.380 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/086 2023-07-06T20:14:13.380 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/086 2023-07-06T20:14:13.381 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:14:13.383 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:14:13.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:14:13.414 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-07-06T20:14:13.787 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:14:13.801 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:14:13.802 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:14:13.803 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:14:13.803 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:14:14.448 INFO:teuthology.orchestra.run.smithi006.stdout:generic/087 0s 2023-07-06T20:14:14.465 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/087 2023-07-06T20:14:14.465 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:14:14.468 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:14:14.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:14:14.741 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-07-06T20:14:15.279 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:14:15.285 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:14:15.288 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:14:15.289 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:14:15.289 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:14:15.870 INFO:teuthology.orchestra.run.smithi006.stdout:generic/088 0s 2023-07-06T20:14:15.878 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/088 2023-07-06T20:14:15.878 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:14:15.881 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:14:16.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:14:16.157 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-07-06T20:14:16.672 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:14:16.685 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:14:16.685 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:14:16.686 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:14:16.686 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:15:57.416 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:15:57.419 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:16:27.488 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:16:27.492 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:16:57.557 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:16:57.560 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:17:27.617 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:17:27.619 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:17:58.257 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:17:58.259 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:18:28.338 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:18:28.340 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:18:28.376 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-07-06T20:18:28.374+0000 7f3a28953700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 111454) UID: 0 2023-07-06T20:18:28.376 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-07-06T20:18:28.374+0000 7f627fdc9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 111454) UID: 0 2023-07-06T20:21:24.804 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:21:24.807 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:21:54.877 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:21:54.879 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:22:25.306 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:22:25.310 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:22:25.348 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-07-06T20:22:25.345+0000 7f3a28953700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 111560) UID: 0 2023-07-06T20:22:25.348 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-07-06T20:22:25.345+0000 7f627fdc9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 111560) UID: 0 2023-07-06T20:22:52.458 INFO:teuthology.orchestra.run.smithi006.stdout:generic/089 516s 2023-07-06T20:22:52.519 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/089 2023-07-06T20:22:52.519 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:22:52.521 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:22:54.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:22:54.109 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-07-06T20:22:54.338 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:22:54.342 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:22:54.342 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:22:54.343 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:22:54.343 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:22:55.220 INFO:teuthology.orchestra.run.smithi006.stdout:generic/090 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T20:22:55.235 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/090 2023-07-06T20:22:55.235 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/090 2023-07-06T20:22:55.235 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:22:55.243 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:22:55.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:22:55.377 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-07-06T20:22:55.597 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:22:55.601 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:22:55.602 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:22:55.602 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:22:55.603 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:24:45.465 INFO:teuthology.orchestra.run.smithi006.stdout:generic/091 110s 2023-07-06T20:24:45.469 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/091 2023-07-06T20:24:45.470 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:24:45.472 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:24:45.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:24:45.827 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-07-06T20:24:46.128 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:24:46.132 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:24:46.132 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:24:46.133 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:24:46.133 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:24:46.482 INFO:teuthology.orchestra.run.smithi006.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T20:24:46.486 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/092 2023-07-06T20:24:46.486 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/092 2023-07-06T20:24:46.487 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:24:46.488 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:24:46.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:24:46.519 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-07-06T20:24:46.742 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:24:46.746 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:24:46.747 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:24:46.748 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:24:46.748 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:24:47.277 INFO:teuthology.orchestra.run.smithi006.stdout:generic/093 1s 2023-07-06T20:24:47.282 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/093 2023-07-06T20:24:47.283 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:24:47.284 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:24:47.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:24:47.614 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-07-06T20:24:47.914 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:24:47.917 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:24:47.918 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:24:47.919 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:24:47.919 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:24:48.312 INFO:teuthology.orchestra.run.smithi006.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-06T20:24:48.316 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/094 2023-07-06T20:24:48.317 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/094 2023-07-06T20:24:48.317 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:24:48.318 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:24:48.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:24:48.630 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-07-06T20:24:48.957 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:24:48.961 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:24:48.962 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:24:48.962 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:24:48.963 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:03.304 INFO:teuthology.orchestra.run.smithi006.stdout:generic/095 14s 2023-07-06T20:25:03.316 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/095 2023-07-06T20:25:03.317 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:25:03.318 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:03.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:25:03.343 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-07-06T20:25:03.845 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:25:03.849 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:25:03.849 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:25:03.850 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:25:03.850 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:04.293 INFO:teuthology.orchestra.run.smithi006.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-06T20:25:04.297 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/096 2023-07-06T20:25:04.297 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/096 2023-07-06T20:25:04.297 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:25:04.299 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:04.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:25:04.321 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-07-06T20:25:04.551 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:25:04.555 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:25:04.556 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:25:04.557 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:25:04.557 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:05.466 INFO:teuthology.orchestra.run.smithi006.stdout:generic/097 1s 2023-07-06T20:25:05.471 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/097 2023-07-06T20:25:05.471 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:25:05.473 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:05.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:25:05.499 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-07-06T20:25:05.720 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:25:05.724 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:25:05.725 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:25:05.726 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:25:05.726 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:07.686 INFO:teuthology.orchestra.run.smithi006.stdout:generic/098 2s 2023-07-06T20:25:07.690 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/098 2023-07-06T20:25:07.691 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:25:07.693 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:07.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:25:07.701 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-07-06T20:25:07.922 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:25:07.926 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:25:07.927 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:25:07.927 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:25:07.928 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:08.262 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:25:08.265 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:25:08.928 INFO:teuthology.orchestra.run.smithi006.stdout:generic/099 0s 2023-07-06T20:25:08.932 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/099 2023-07-06T20:25:08.933 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:25:08.935 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:09.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:25:09.202 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-07-06T20:25:09.557 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:25:09.561 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:25:09.562 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:25:09.563 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:25:09.563 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:21.469 INFO:teuthology.orchestra.run.smithi006.stdout:generic/100 12s 2023-07-06T20:25:21.474 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/100 2023-07-06T20:25:21.475 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:25:21.476 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:25.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:25:25.351 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-07-06T20:25:25.628 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:25:25.632 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:25:25.633 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:25:25.634 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:25:25.634 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:26.017 INFO:teuthology.orchestra.run.smithi006.stdout:generic/101 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T20:25:26.021 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/101 2023-07-06T20:25:26.022 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/101 2023-07-06T20:25:26.022 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:25:26.023 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:26.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:25:26.149 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-07-06T20:25:26.377 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:25:26.381 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:25:26.382 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:25:26.383 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:25:26.383 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:26.725 INFO:teuthology.orchestra.run.smithi006.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-06T20:25:26.729 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/102 2023-07-06T20:25:26.729 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/102 2023-07-06T20:25:26.729 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:25:26.731 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:26.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:25:26.764 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-07-06T20:25:26.988 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:25:26.992 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:25:26.993 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:25:26.994 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:25:26.994 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:27.341 INFO:teuthology.orchestra.run.smithi006.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T20:25:27.345 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/103 2023-07-06T20:25:27.345 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/103 2023-07-06T20:25:27.345 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:25:27.347 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:27.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:25:27.681 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-07-06T20:25:27.965 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:25:27.969 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:25:27.970 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:25:27.970 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:25:27.971 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:28.322 INFO:teuthology.orchestra.run.smithi006.stdout:generic/104 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T20:25:28.326 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/104 2023-07-06T20:25:28.326 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/104 2023-07-06T20:25:28.327 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:25:28.328 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:28.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:25:28.367 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-07-06T20:25:28.583 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:25:28.588 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:25:28.588 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:25:28.589 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:25:28.589 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:29.607 INFO:teuthology.orchestra.run.smithi006.stdout:generic/105 1s 2023-07-06T20:25:29.613 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/105 2023-07-06T20:25:29.613 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:25:29.615 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:29.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:25:29.625 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-07-06T20:25:29.844 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:25:29.848 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:25:29.848 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:25:29.849 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:25:29.849 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:30.232 INFO:teuthology.orchestra.run.smithi006.stdout:generic/106 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T20:25:30.236 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/106 2023-07-06T20:25:30.236 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/106 2023-07-06T20:25:30.236 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:25:30.238 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:30.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:25:30.262 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-07-06T20:25:30.501 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:25:30.505 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:25:30.506 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:25:30.507 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:25:30.507 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:30.860 INFO:teuthology.orchestra.run.smithi006.stdout:generic/107 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T20:25:30.864 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/107 2023-07-06T20:25:30.865 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/107 2023-07-06T20:25:30.865 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:25:30.867 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:30.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:25:30.889 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-07-06T20:25:31.113 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:25:31.117 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:25:31.118 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:25:31.119 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:25:31.119 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:31.549 INFO:teuthology.orchestra.run.smithi006.stdout:generic/108 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T20:25:31.553 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/108 2023-07-06T20:25:31.553 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/108 2023-07-06T20:25:31.553 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:25:31.555 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:31.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:25:31.590 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-07-06T20:25:31.811 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:25:31.815 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:25:31.815 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:25:31.816 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:25:31.816 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:38.426 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:25:38.429 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:25:42.825 INFO:teuthology.orchestra.run.smithi006.stdout:generic/109 10s 2023-07-06T20:25:42.836 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/109 2023-07-06T20:25:42.837 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:25:42.841 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:25:42.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:25:42.857 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-07-06T20:25:43.824 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:25:43.828 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:25:43.829 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:25:43.830 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:25:43.830 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:26:05.803 INFO:teuthology.orchestra.run.smithi006.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T20:26:05.807 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/110 2023-07-06T20:26:05.808 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/110 2023-07-06T20:26:05.808 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:26:05.809 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:26:06.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:26:06.214 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-07-06T20:26:06.608 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:26:06.612 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:26:06.612 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:26:06.613 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:26:06.614 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:26:06.992 INFO:teuthology.orchestra.run.smithi006.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T20:26:06.996 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/111 2023-07-06T20:26:06.996 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/111 2023-07-06T20:26:06.996 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:26:06.998 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:26:07.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:26:07.406 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-07-06T20:26:07.632 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:26:07.636 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:26:07.637 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:26:07.637 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:26:07.638 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:26:08.724 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:26:08.727 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:26:23.076 INFO:teuthology.orchestra.run.smithi006.stdout:generic/112 16s 2023-07-06T20:26:23.081 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/112 2023-07-06T20:26:23.081 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:26:23.082 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:26:23.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:26:23.373 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-07-06T20:26:23.701 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:26:23.704 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:26:23.705 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:26:23.706 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:26:23.706 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:26:39.014 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:26:39.124 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:26:40.187 INFO:teuthology.orchestra.run.smithi006.stdout:generic/113 17s 2023-07-06T20:26:40.192 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/113 2023-07-06T20:26:40.192 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:26:40.194 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:26:40.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:26:40.596 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-07-06T20:26:40.898 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:26:40.902 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:26:40.903 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:26:40.903 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:26:40.904 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:26:41.373 INFO:teuthology.orchestra.run.smithi006.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-07-06T20:26:41.377 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/114 2023-07-06T20:26:41.378 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/114 2023-07-06T20:26:41.378 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:26:41.380 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:26:41.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:26:41.409 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-07-06T20:26:41.647 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:26:41.651 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:26:41.652 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:26:41.652 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:26:41.653 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:26:42.021 INFO:teuthology.orchestra.run.smithi006.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T20:26:42.025 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/115 2023-07-06T20:26:42.025 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/115 2023-07-06T20:26:42.026 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:26:42.027 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:26:42.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:26:42.420 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-07-06T20:26:42.659 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:26:42.663 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:26:42.664 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:26:42.665 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:26:42.665 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:26:43.045 INFO:teuthology.orchestra.run.smithi006.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T20:26:43.049 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/116 2023-07-06T20:26:43.050 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/116 2023-07-06T20:26:43.050 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:26:43.052 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:26:43.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:26:43.466 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-07-06T20:26:43.700 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:26:43.704 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:26:43.705 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:26:43.705 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:26:43.705 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:26:57.499 INFO:teuthology.orchestra.run.smithi006.stdout:generic/117 14s 2023-07-06T20:26:57.509 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/117 2023-07-06T20:26:57.509 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:26:57.511 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:26:57.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:26:57.520 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-07-06T20:26:57.768 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:26:57.772 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:26:57.772 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:26:57.773 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:26:57.773 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:26:58.533 INFO:teuthology.orchestra.run.smithi006.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T20:26:58.537 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/118 2023-07-06T20:26:58.538 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/118 2023-07-06T20:26:58.538 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:26:58.539 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:26:58.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:26:58.887 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-07-06T20:26:59.157 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:26:59.161 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:26:59.161 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:26:59.162 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:26:59.162 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:26:59.626 INFO:teuthology.orchestra.run.smithi006.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T20:26:59.630 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/119 2023-07-06T20:26:59.630 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/119 2023-07-06T20:26:59.630 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:26:59.632 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:26:59.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:26:59.967 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-07-06T20:27:00.258 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:27:00.262 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:27:00.263 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:27:00.263 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:27:00.263 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:27:00.594 INFO:teuthology.orchestra.run.smithi006.stdout:generic/120 [not run] atime not maintained by ceph 2023-07-06T20:27:00.598 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/120 2023-07-06T20:27:00.598 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/120 2023-07-06T20:27:00.599 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:27:00.600 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:27:00.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:27:00.623 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-07-06T20:27:00.847 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:27:00.852 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:27:00.852 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:27:00.853 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:27:00.853 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:27:01.220 INFO:teuthology.orchestra.run.smithi006.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-06T20:27:01.224 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/121 2023-07-06T20:27:01.225 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/121 2023-07-06T20:27:01.226 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:27:01.226 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:27:01.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:27:01.568 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-07-06T20:27:01.864 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:27:01.868 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:27:01.869 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:27:01.869 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:27:01.870 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:27:02.244 INFO:teuthology.orchestra.run.smithi006.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-06T20:27:02.248 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/122 2023-07-06T20:27:02.248 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/122 2023-07-06T20:27:02.249 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:27:02.250 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:27:02.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:27:02.598 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-07-06T20:27:02.894 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:27:02.898 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:27:02.899 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:27:02.900 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:27:02.900 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:27:03.514 INFO:teuthology.orchestra.run.smithi006.stdout:generic/123 0s 2023-07-06T20:27:03.519 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/123 2023-07-06T20:27:03.519 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:27:03.521 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:27:03.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:27:03.830 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-07-06T20:27:04.167 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:27:04.171 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:27:04.172 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:27:04.173 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:27:04.173 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:27:06.750 INFO:teuthology.orchestra.run.smithi006.stdout:generic/124 2s 2023-07-06T20:27:06.756 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/124 2023-07-06T20:27:06.757 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:27:06.759 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:27:07.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:27:07.101 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-07-06T20:27:07.603 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:27:07.607 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:27:07.608 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:27:07.609 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:27:07.609 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:27:09.698 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:27:09.701 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:27:39.770 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:27:39.773 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:28:09.171 INFO:teuthology.orchestra.run.smithi006.stdout:generic/125 62s 2023-07-06T20:28:09.177 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/125 2023-07-06T20:28:09.177 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:28:09.179 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:28:09.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:28:09.482 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-07-06T20:28:09.810 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:28:09.814 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:28:09.815 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:28:09.815 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:28:09.815 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:28:09.844 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:28:09.846 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:28:10.336 INFO:teuthology.orchestra.run.smithi006.stdout:generic/126 0s 2023-07-06T20:28:10.344 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/126 2023-07-06T20:28:10.344 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:28:10.345 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:28:10.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:28:10.762 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-07-06T20:28:11.022 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:28:11.026 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:28:11.026 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:28:11.027 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:28:11.027 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:28:39.946 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:28:39.949 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:29:10.017 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:29:10.019 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:29:40.090 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:29:40.092 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:30:10.163 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:30:10.165 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:30:40.269 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:30:40.272 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:31:10.352 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:31:10.354 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:31:40.437 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:31:40.440 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:32:10.505 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:32:10.508 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:32:40.578 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:32:40.580 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:33:10.973 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:33:10.975 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:33:41.033 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:33:41.036 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:34:11.102 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:34:11.105 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:34:41.271 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:34:41.273 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:35:11.331 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:35:11.334 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:35:41.420 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:35:41.423 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:36:11.547 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:36:11.553 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:36:41.625 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:36:41.627 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:37:11.877 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:37:11.879 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:37:31.836 INFO:teuthology.orchestra.run.smithi006.stdout:generic/127 560s 2023-07-06T20:37:31.840 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/127 2023-07-06T20:37:31.841 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:37:31.843 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:37:32.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:37:32.113 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-07-06T20:37:32.519 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:37:32.523 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:37:32.524 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:37:32.525 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:37:32.525 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:37:33.731 INFO:teuthology.orchestra.run.smithi006.stdout:generic/128 1s 2023-07-06T20:37:33.750 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/128 2023-07-06T20:37:33.751 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:37:33.752 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:37:33.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:37:33.761 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-07-06T20:37:33.984 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:37:33.988 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:37:33.988 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:37:33.989 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:37:33.989 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:37:41.941 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:37:41.944 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:38:12.008 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:38:12.025 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:38:42.120 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:38:42.124 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:38:42.210 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-06T20:38:42.209+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113584) UID: 0 2023-07-06T20:38:42.211 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-06T20:38:42.209+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113584) UID: 0 2023-07-06T20:38:42.211 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-06T20:38:42.209+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113584) UID: 0 2023-07-06T20:38:42.212 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-06T20:38:42.209+0000 7ff734335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113584) UID: 0 2023-07-06T20:43:02.967 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:43:02.980 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:43:03.133 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-06T20:43:03.131+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 261830) UID: 0 2023-07-06T20:43:03.133 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-06T20:43:03.132+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 261830) UID: 0 2023-07-06T20:43:03.134 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-06T20:43:03.132+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 261830) UID: 0 2023-07-06T20:43:03.134 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T20:43:03.132+0000 7fec49f76700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 261830) UID: 0 2023-07-06T20:47:38.065 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:47:38.068 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:47:38.144 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-06T20:47:38.141+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113725) UID: 0 2023-07-06T20:47:38.157 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-06T20:47:38.144+0000 7fc177dad700 -1 received signal: Hangup from (PID: 113725) UID: 0 2023-07-06T20:47:38.158 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-06T20:47:38.143+0000 7ff734335700 -1 received signal: Hangup from (PID: 113725) UID: 0 2023-07-06T20:47:38.188 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-06T20:47:38.141+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 113725) UID: 0 2023-07-06T20:47:38.220 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-06T20:47:38.215+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 261896) UID: 0 2023-07-06T20:47:38.221 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-06T20:47:38.215+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 261896) UID: 0 2023-07-06T20:47:38.226 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T20:47:38.218+0000 7fec49f76700 -1 received signal: Hangup from (PID: 261896) UID: 0 2023-07-06T20:47:38.239 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-06T20:47:38.218+0000 7fad36019700 -1 Fail to open '/proc/261896/cmdline' error = (2) No such file or directory 2023-07-06T20:47:38.240 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-06T20:47:38.218+0000 7fad36019700 -1 received signal: Hangup from (PID: 261896) UID: 0 2023-07-06T20:56:16.652 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:56:16.678 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T20:56:16.987 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-06T20:56:16.984+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 262001) UID: 0 2023-07-06T20:56:16.987 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-06T20:56:16.984+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 262001) UID: 0 2023-07-06T20:56:16.988 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-06T20:56:16.984+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 262001) UID: 0 2023-07-06T20:56:16.988 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T20:56:16.985+0000 7fec49f76700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 262001) UID: 0 2023-07-06T20:56:17.438 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-06T20:56:17.436+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114021) UID: 0 2023-07-06T20:56:17.439 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-06T20:56:17.436+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114021) UID: 0 2023-07-06T20:56:17.439 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-06T20:56:17.436+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114021) UID: 0 2023-07-06T20:56:17.440 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-06T20:56:17.437+0000 7ff734335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 114021) UID: 0 2023-07-06T20:58:35.115 INFO:teuthology.orchestra.run.smithi006.stdout:generic/129 1261s 2023-07-06T20:58:35.137 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/129 2023-07-06T20:58:35.137 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:58:35.184 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:58:35.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:58:35.193 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-07-06T20:58:35.633 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:58:35.637 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:58:35.638 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:58:35.639 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:58:35.639 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:58:49.436 INFO:teuthology.orchestra.run.smithi006.stdout:generic/130 14s 2023-07-06T20:58:49.444 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/130 2023-07-06T20:58:49.444 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:58:49.446 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:58:49.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:58:49.456 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-07-06T20:58:49.695 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:58:49.699 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:58:49.699 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:58:49.700 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:58:49.700 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:58:51.443 INFO:teuthology.orchestra.run.smithi006.stdout:generic/131 2s 2023-07-06T20:58:51.456 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/131 2023-07-06T20:58:51.456 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:58:51.458 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:58:52.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:58:52.010 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-07-06T20:58:52.572 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:58:52.589 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:58:52.589 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:58:52.590 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:58:52.590 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:59:07.363 INFO:teuthology.orchestra.run.smithi006.stdout:generic/132 15s 2023-07-06T20:59:07.369 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/132 2023-07-06T20:59:07.369 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T20:59:07.371 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T20:59:07.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T20:59:07.381 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-07-06T20:59:07.660 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T20:59:07.663 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T20:59:07.664 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T20:59:07.665 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T20:59:07.665 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:02:51.602 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:02:51.607 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:03:21.723 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:03:21.726 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:03:26.603 INFO:teuthology.orchestra.run.smithi006.stdout:generic/133 259s 2023-07-06T21:03:26.608 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/133 2023-07-06T21:03:26.608 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:26.610 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:26.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:26.746 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-07-06T21:03:27.455 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:27.459 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:27.460 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:27.461 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:27.461 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:27.836 INFO:teuthology.orchestra.run.smithi006.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:03:27.840 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/134 2023-07-06T21:03:27.840 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/134 2023-07-06T21:03:27.841 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:27.842 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:28.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:28.281 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-07-06T21:03:28.510 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:28.514 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:28.515 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:28.515 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:28.516 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:29.710 INFO:teuthology.orchestra.run.smithi006.stdout:generic/135 1s 2023-07-06T21:03:29.715 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/135 2023-07-06T21:03:29.715 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:29.717 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:29.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:29.726 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-07-06T21:03:29.951 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:29.955 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:29.956 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:29.956 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:29.957 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:30.334 INFO:teuthology.orchestra.run.smithi006.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-06T21:03:30.338 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/136 2023-07-06T21:03:30.338 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/136 2023-07-06T21:03:30.339 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:30.340 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:30.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:30.745 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-07-06T21:03:31.004 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:31.008 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:31.008 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:31.009 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:31.009 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:31.393 INFO:teuthology.orchestra.run.smithi006.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:03:31.398 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/137 2023-07-06T21:03:31.398 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/137 2023-07-06T21:03:31.398 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:31.400 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:31.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:31.742 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-07-06T21:03:32.065 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:32.069 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:32.070 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:32.071 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:32.071 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:32.446 INFO:teuthology.orchestra.run.smithi006.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:03:32.450 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/138 2023-07-06T21:03:32.450 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/138 2023-07-06T21:03:32.450 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:32.452 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:32.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:32.545 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-07-06T21:03:33.104 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:33.108 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:33.109 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:33.110 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:33.110 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:33.503 INFO:teuthology.orchestra.run.smithi006.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:03:33.507 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/139 2023-07-06T21:03:33.507 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/139 2023-07-06T21:03:33.507 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:33.509 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:33.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:33.943 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-07-06T21:03:34.190 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:34.194 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:34.194 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:34.195 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:34.195 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:34.583 INFO:teuthology.orchestra.run.smithi006.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:03:34.587 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/140 2023-07-06T21:03:34.588 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/140 2023-07-06T21:03:34.588 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:34.590 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:34.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:34.866 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-07-06T21:03:35.248 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:35.252 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:35.252 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:35.254 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:35.254 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:35.846 INFO:teuthology.orchestra.run.smithi006.stdout:generic/141 0s 2023-07-06T21:03:35.851 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/141 2023-07-06T21:03:35.851 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:35.853 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:35.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:35.862 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-07-06T21:03:36.083 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:36.087 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:36.088 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:36.089 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:36.089 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:36.492 INFO:teuthology.orchestra.run.smithi006.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:03:36.496 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/142 2023-07-06T21:03:36.497 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/142 2023-07-06T21:03:36.497 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:36.498 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:36.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:36.868 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-07-06T21:03:37.170 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:37.175 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:37.175 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:37.176 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:37.176 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:37.564 INFO:teuthology.orchestra.run.smithi006.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:03:37.568 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/143 2023-07-06T21:03:37.568 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/143 2023-07-06T21:03:37.568 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:37.570 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:37.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:37.988 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-07-06T21:03:38.235 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:38.239 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:38.240 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:38.240 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:38.241 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:38.616 INFO:teuthology.orchestra.run.smithi006.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:03:38.620 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/144 2023-07-06T21:03:38.620 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/144 2023-07-06T21:03:38.620 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:38.623 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:39.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:39.028 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-07-06T21:03:39.282 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:39.286 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:39.287 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:39.289 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:39.290 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:39.664 INFO:teuthology.orchestra.run.smithi006.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:03:39.667 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/145 2023-07-06T21:03:39.667 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/145 2023-07-06T21:03:39.668 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:39.669 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:39.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:39.946 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-07-06T21:03:40.345 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:40.349 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:40.350 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:40.351 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:40.351 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:40.748 INFO:teuthology.orchestra.run.smithi006.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:03:40.752 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/146 2023-07-06T21:03:40.753 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/146 2023-07-06T21:03:40.753 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:40.754 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:41.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:41.146 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-07-06T21:03:41.426 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:41.430 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:41.430 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:41.431 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:41.431 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:41.818 INFO:teuthology.orchestra.run.smithi006.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:03:41.822 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/147 2023-07-06T21:03:41.822 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/147 2023-07-06T21:03:41.823 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:41.823 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:42.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:42.071 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-07-06T21:03:42.500 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:42.504 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:42.505 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:42.505 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:42.505 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:42.898 INFO:teuthology.orchestra.run.smithi006.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:03:42.902 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/148 2023-07-06T21:03:42.902 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/148 2023-07-06T21:03:42.902 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:42.904 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:43.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:43.323 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-07-06T21:03:43.577 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:43.581 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:43.582 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:43.583 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:43.583 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:43.971 INFO:teuthology.orchestra.run.smithi006.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:03:43.975 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/149 2023-07-06T21:03:43.975 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/149 2023-07-06T21:03:43.975 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:43.977 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:44.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:44.377 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-07-06T21:03:44.665 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:44.669 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:44.669 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:44.670 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:44.670 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:45.059 INFO:teuthology.orchestra.run.smithi006.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:03:45.063 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/150 2023-07-06T21:03:45.063 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/150 2023-07-06T21:03:45.063 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:45.065 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:45.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:45.470 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-07-06T21:03:45.725 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:45.729 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:45.729 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:45.730 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:45.730 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:46.116 INFO:teuthology.orchestra.run.smithi006.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:03:46.120 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/151 2023-07-06T21:03:46.120 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/151 2023-07-06T21:03:46.120 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:46.122 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:46.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:46.440 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-07-06T21:03:46.793 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:46.797 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:46.797 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:46.798 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:46.799 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:47.185 INFO:teuthology.orchestra.run.smithi006.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:03:47.189 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/152 2023-07-06T21:03:47.189 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/152 2023-07-06T21:03:47.189 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:47.191 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:47.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:47.608 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-07-06T21:03:47.862 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:47.866 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:47.867 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:47.868 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:47.868 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:48.245 INFO:teuthology.orchestra.run.smithi006.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:03:48.249 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/153 2023-07-06T21:03:48.249 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/153 2023-07-06T21:03:48.249 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:48.251 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:48.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:48.640 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-07-06T21:03:48.917 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:48.921 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:48.922 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:48.923 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:48.923 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:49.283 INFO:teuthology.orchestra.run.smithi006.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:03:49.287 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/154 2023-07-06T21:03:49.287 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/154 2023-07-06T21:03:49.287 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:49.289 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:49.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:49.596 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-07-06T21:03:49.953 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:49.957 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:49.958 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:49.958 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:49.958 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:50.355 INFO:teuthology.orchestra.run.smithi006.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:03:50.359 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/155 2023-07-06T21:03:50.360 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/155 2023-07-06T21:03:50.360 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:50.362 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:50.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:50.630 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-07-06T21:03:51.032 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:51.036 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:51.037 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:51.037 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:51.038 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:51.416 INFO:teuthology.orchestra.run.smithi006.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:03:51.420 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/156 2023-07-06T21:03:51.420 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/156 2023-07-06T21:03:51.420 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:51.422 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:51.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:51.643 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-07-06T21:03:51.791 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:03:51.824 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:03:52.085 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:52.089 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:52.089 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:52.090 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:52.090 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:52.461 INFO:teuthology.orchestra.run.smithi006.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:03:52.465 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/157 2023-07-06T21:03:52.466 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/157 2023-07-06T21:03:52.466 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:52.468 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:52.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:52.848 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-07-06T21:03:53.135 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:53.139 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:53.140 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:53.140 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:53.141 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:53.528 INFO:teuthology.orchestra.run.smithi006.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-06T21:03:53.533 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/158 2023-07-06T21:03:53.533 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/158 2023-07-06T21:03:53.533 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:53.535 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:53.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:53.796 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-07-06T21:03:54.196 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:54.200 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:54.201 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:54.202 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:54.202 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:54.593 INFO:teuthology.orchestra.run.smithi006.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-07-06T21:03:54.597 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/159 2023-07-06T21:03:54.597 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/159 2023-07-06T21:03:54.597 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:54.599 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:54.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:54.634 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-07-06T21:03:54.857 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:54.861 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:54.861 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:54.862 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:54.862 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:55.253 INFO:teuthology.orchestra.run.smithi006.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-07-06T21:03:55.257 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/160 2023-07-06T21:03:55.258 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/160 2023-07-06T21:03:55.258 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:55.259 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:55.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:55.293 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-07-06T21:03:55.522 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:55.526 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:55.526 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:55.527 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:55.528 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:56.422 INFO:teuthology.orchestra.run.smithi006.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:03:56.453 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/161 2023-07-06T21:03:56.453 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/161 2023-07-06T21:03:56.454 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:56.461 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:56.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:56.511 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-07-06T21:03:56.747 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:56.752 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:56.752 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:56.753 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:56.754 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:57.308 INFO:teuthology.orchestra.run.smithi006.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-07-06T21:03:57.571 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/162 2023-07-06T21:03:57.571 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/162 2023-07-06T21:03:57.571 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:57.718 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:57.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:57.758 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-07-06T21:03:57.984 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:57.988 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:57.989 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:57.989 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:57.990 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:58.551 INFO:teuthology.orchestra.run.smithi006.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-07-06T21:03:58.680 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/163 2023-07-06T21:03:58.681 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/163 2023-07-06T21:03:58.681 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:03:58.684 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:03:58.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:03:58.979 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-07-06T21:03:59.245 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:03:59.249 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:03:59.250 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:03:59.250 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:03:59.251 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:00.200 INFO:teuthology.orchestra.run.smithi006.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:00.207 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/164 2023-07-06T21:04:00.208 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/164 2023-07-06T21:04:00.208 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:00.232 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:00.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:00.262 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-07-06T21:04:00.495 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:00.499 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:00.499 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:00.500 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:00.500 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:01.478 INFO:teuthology.orchestra.run.smithi006.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:01.491 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/165 2023-07-06T21:04:01.492 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/165 2023-07-06T21:04:01.492 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:01.496 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:01.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:01.532 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-07-06T21:04:01.754 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:01.759 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:01.759 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:01.760 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:01.760 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:02.732 INFO:teuthology.orchestra.run.smithi006.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:02.739 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/166 2023-07-06T21:04:02.739 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/166 2023-07-06T21:04:02.739 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:02.741 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:02.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:02.777 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-07-06T21:04:02.996 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:03.001 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:03.001 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:03.002 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:03.002 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:03.823 INFO:teuthology.orchestra.run.smithi006.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:03.832 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/167 2023-07-06T21:04:03.832 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/167 2023-07-06T21:04:03.832 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:03.848 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:03.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:03.995 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-07-06T21:04:04.223 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:04.227 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:04.228 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:04.229 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:04.229 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:05.065 INFO:teuthology.orchestra.run.smithi006.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:05.073 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/168 2023-07-06T21:04:05.073 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/168 2023-07-06T21:04:05.073 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:05.171 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:05.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:05.236 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-07-06T21:04:05.461 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:05.465 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:05.465 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:05.466 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:05.467 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:06.312 INFO:teuthology.orchestra.run.smithi006.stdout:generic/169 1s 2023-07-06T21:04:06.317 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/169 2023-07-06T21:04:06.317 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:06.319 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:06.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:06.328 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-07-06T21:04:06.554 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:06.558 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:06.558 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:06.559 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:06.559 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:07.472 INFO:teuthology.orchestra.run.smithi006.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:07.542 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/170 2023-07-06T21:04:07.542 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/170 2023-07-06T21:04:07.543 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:07.545 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:07.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:07.577 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-07-06T21:04:07.800 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:07.804 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:07.805 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:07.806 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:07.806 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:08.745 INFO:teuthology.orchestra.run.smithi006.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:08.750 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/171 2023-07-06T21:04:08.750 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/171 2023-07-06T21:04:08.750 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:08.762 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:08.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:08.833 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-07-06T21:04:09.076 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:09.080 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:09.081 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:09.082 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:09.082 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:10.098 INFO:teuthology.orchestra.run.smithi006.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:10.108 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/172 2023-07-06T21:04:10.109 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/172 2023-07-06T21:04:10.109 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:10.111 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:10.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:10.140 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-07-06T21:04:10.362 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:10.366 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:10.367 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:10.368 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:10.368 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:11.257 INFO:teuthology.orchestra.run.smithi006.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:11.327 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/173 2023-07-06T21:04:11.327 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/173 2023-07-06T21:04:11.327 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:11.327 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:11.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:11.389 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-07-06T21:04:11.624 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:11.628 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:11.629 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:11.629 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:11.630 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:12.587 INFO:teuthology.orchestra.run.smithi006.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:12.612 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/174 2023-07-06T21:04:12.612 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/174 2023-07-06T21:04:12.613 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:12.616 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:12.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:12.647 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-07-06T21:04:12.873 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:12.877 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:12.877 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:12.878 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:12.879 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:13.777 INFO:teuthology.orchestra.run.smithi006.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:13.864 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/175 2023-07-06T21:04:13.864 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/175 2023-07-06T21:04:13.864 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:13.867 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:13.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:13.908 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-07-06T21:04:14.133 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:14.137 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:14.137 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:14.138 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:14.138 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:14.879 INFO:teuthology.orchestra.run.smithi006.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:14.886 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/176 2023-07-06T21:04:14.886 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/176 2023-07-06T21:04:14.886 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:14.889 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:15.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:15.131 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-07-06T21:04:15.397 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:15.401 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:15.401 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:15.402 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:15.402 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:15.929 INFO:teuthology.orchestra.run.smithi006.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-06T21:04:15.934 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/177 2023-07-06T21:04:15.934 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/177 2023-07-06T21:04:15.934 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:15.936 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:16.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:16.176 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-07-06T21:04:16.583 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:16.587 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:16.587 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:16.588 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:16.588 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:16.985 INFO:teuthology.orchestra.run.smithi006.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:04:16.989 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/178 2023-07-06T21:04:16.990 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/178 2023-07-06T21:04:16.990 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:16.991 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:17.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:17.316 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-07-06T21:04:17.662 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:17.666 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:17.666 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:17.667 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:17.667 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:18.048 INFO:teuthology.orchestra.run.smithi006.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:04:18.052 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/179 2023-07-06T21:04:18.052 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/179 2023-07-06T21:04:18.052 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:18.054 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:18.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:18.420 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-07-06T21:04:18.701 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:18.705 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:18.705 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:18.706 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:18.706 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:19.102 INFO:teuthology.orchestra.run.smithi006.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:04:19.106 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/180 2023-07-06T21:04:19.106 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/180 2023-07-06T21:04:19.107 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:19.108 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:19.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:19.518 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-07-06T21:04:19.762 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:19.766 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:19.766 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:19.767 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:19.767 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:20.141 INFO:teuthology.orchestra.run.smithi006.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:04:20.145 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/181 2023-07-06T21:04:20.146 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/181 2023-07-06T21:04:20.146 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:20.148 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:20.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:20.392 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-07-06T21:04:20.815 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:20.820 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:20.820 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:20.821 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:20.821 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:21.263 INFO:teuthology.orchestra.run.smithi006.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-06T21:04:21.267 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/182 2023-07-06T21:04:21.267 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/182 2023-07-06T21:04:21.267 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:21.269 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:21.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:21.548 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-07-06T21:04:21.921 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:21.924 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:21.925 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:21.926 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:21.926 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:21.936 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:04:21.938 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:04:22.845 INFO:teuthology.orchestra.run.smithi006.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:22.909 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/183 2023-07-06T21:04:22.909 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/183 2023-07-06T21:04:22.909 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:22.945 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:22.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:22.980 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-07-06T21:04:23.206 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:23.209 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:23.210 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:23.211 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:23.211 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:23.590 INFO:teuthology.orchestra.run.smithi006.stdout:generic/184 0s 2023-07-06T21:04:23.595 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/184 2023-07-06T21:04:23.595 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:23.597 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:23.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:23.640 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-07-06T21:04:23.876 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:23.879 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:23.880 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:23.881 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:23.881 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:24.639 INFO:teuthology.orchestra.run.smithi006.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:24.876 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/185 2023-07-06T21:04:24.877 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/185 2023-07-06T21:04:24.877 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:24.881 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:24.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:24.918 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-07-06T21:04:25.158 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:25.162 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:25.162 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:25.163 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:25.163 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:25.879 INFO:teuthology.orchestra.run.smithi006.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:25.894 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/186 2023-07-06T21:04:25.895 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/186 2023-07-06T21:04:25.895 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:25.912 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:26.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:26.151 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-07-06T21:04:26.375 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:26.380 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:26.380 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:26.381 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:26.381 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:27.223 INFO:teuthology.orchestra.run.smithi006.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:27.311 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/187 2023-07-06T21:04:27.312 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/187 2023-07-06T21:04:27.312 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:27.348 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:27.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:27.394 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-07-06T21:04:27.617 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:27.621 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:27.622 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:27.622 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:27.623 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:28.594 INFO:teuthology.orchestra.run.smithi006.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:28.606 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/188 2023-07-06T21:04:28.606 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/188 2023-07-06T21:04:28.606 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:28.609 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:28.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:28.633 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-07-06T21:04:28.860 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:28.864 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:28.864 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:28.865 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:28.866 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:29.575 INFO:teuthology.orchestra.run.smithi006.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:29.776 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/189 2023-07-06T21:04:29.776 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/189 2023-07-06T21:04:29.776 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:29.795 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:29.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:29.868 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-07-06T21:04:30.112 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:30.116 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:30.116 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:30.117 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:30.117 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:30.991 INFO:teuthology.orchestra.run.smithi006.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:31.026 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/190 2023-07-06T21:04:31.026 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/190 2023-07-06T21:04:31.026 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:31.075 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:31.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:31.149 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-07-06T21:04:31.370 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:31.374 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:31.375 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:31.376 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:31.376 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:32.368 INFO:teuthology.orchestra.run.smithi006.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:32.380 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/191 2023-07-06T21:04:32.380 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/191 2023-07-06T21:04:32.381 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:32.393 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:32.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:32.429 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-07-06T21:04:32.650 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:32.654 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:32.654 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:32.655 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:32.655 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:33.016 INFO:teuthology.orchestra.run.smithi006.stdout:generic/192 [not run] atime not maintained by ceph 2023-07-06T21:04:33.020 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/192 2023-07-06T21:04:33.020 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/192 2023-07-06T21:04:33.021 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:33.022 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:33.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:33.051 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-07-06T21:04:33.271 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:33.275 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:33.276 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:33.277 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:33.277 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:34.216 INFO:teuthology.orchestra.run.smithi006.stdout:generic/193 1s 2023-07-06T21:04:34.221 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/193 2023-07-06T21:04:34.222 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:34.223 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:34.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:34.556 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-07-06T21:04:34.889 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:34.893 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:34.894 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:34.895 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:34.896 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:35.824 INFO:teuthology.orchestra.run.smithi006.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:35.873 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/194 2023-07-06T21:04:35.873 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/194 2023-07-06T21:04:35.873 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:35.886 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:35.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:35.925 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-07-06T21:04:36.152 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:36.156 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:36.156 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:36.157 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:36.157 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:37.099 INFO:teuthology.orchestra.run.smithi006.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:37.148 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/195 2023-07-06T21:04:37.148 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/195 2023-07-06T21:04:37.149 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:37.151 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:37.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:37.183 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-07-06T21:04:37.406 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:37.410 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:37.410 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:37.411 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:37.411 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:38.311 INFO:teuthology.orchestra.run.smithi006.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:38.317 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/196 2023-07-06T21:04:38.317 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/196 2023-07-06T21:04:38.317 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:38.320 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:38.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:38.399 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-07-06T21:04:38.625 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:38.630 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:38.630 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:38.631 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:38.631 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:39.587 INFO:teuthology.orchestra.run.smithi006.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:39.594 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/197 2023-07-06T21:04:39.595 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/197 2023-07-06T21:04:39.595 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:39.597 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:39.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:39.637 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-07-06T21:04:39.873 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:39.877 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:39.878 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:39.879 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:39.879 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:40.621 INFO:teuthology.orchestra.run.smithi006.stdout:generic/198 0s 2023-07-06T21:04:40.626 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/198 2023-07-06T21:04:40.626 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:40.628 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:40.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:40.746 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-07-06T21:04:41.360 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:41.364 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:41.365 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:41.366 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:41.366 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:42.330 INFO:teuthology.orchestra.run.smithi006.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:42.334 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/199 2023-07-06T21:04:42.335 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/199 2023-07-06T21:04:42.335 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:42.337 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:42.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:42.367 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-07-06T21:04:42.600 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:42.604 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:42.605 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:42.606 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:42.606 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:43.307 INFO:teuthology.orchestra.run.smithi006.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:43.359 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/200 2023-07-06T21:04:43.360 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/200 2023-07-06T21:04:43.360 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:43.458 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:43.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:43.595 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-07-06T21:04:43.834 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:43.838 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:43.838 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:43.839 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:43.840 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:44.652 INFO:teuthology.orchestra.run.smithi006.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:44.659 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/201 2023-07-06T21:04:44.659 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/201 2023-07-06T21:04:44.659 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:44.663 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:44.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:44.848 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-07-06T21:04:45.095 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:45.099 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:45.099 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:45.100 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:45.100 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:45.906 INFO:teuthology.orchestra.run.smithi006.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:45.981 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/202 2023-07-06T21:04:45.982 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/202 2023-07-06T21:04:45.982 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:45.985 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:46.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:46.100 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-07-06T21:04:46.346 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:46.350 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:46.350 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:46.351 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:46.351 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:47.223 INFO:teuthology.orchestra.run.smithi006.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:47.298 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/203 2023-07-06T21:04:47.298 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/203 2023-07-06T21:04:47.298 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:47.304 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:47.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:47.349 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-07-06T21:04:47.588 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:47.592 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:47.593 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:47.593 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:47.594 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:50.071 INFO:teuthology.orchestra.run.smithi006.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-06T21:04:50.076 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/204 2023-07-06T21:04:50.076 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/204 2023-07-06T21:04:50.076 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:50.078 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:50.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:50.104 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-07-06T21:04:50.341 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:50.345 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:50.346 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:50.346 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:50.347 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:51.293 INFO:teuthology.orchestra.run.smithi006.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:51.314 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/205 2023-07-06T21:04:51.315 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/205 2023-07-06T21:04:51.315 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:51.323 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:51.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:51.353 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-07-06T21:04:51.587 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:51.591 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:51.591 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:51.592 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:51.593 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:52.228 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:04:52.325 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:04:52.439 INFO:teuthology.orchestra.run.smithi006.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:04:52.473 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/206 2023-07-06T21:04:52.473 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/206 2023-07-06T21:04:52.473 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:04:52.477 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:04:52.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:04:52.584 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-07-06T21:04:52.809 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:04:52.813 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:04:52.814 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:04:52.814 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:04:52.815 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:05:02.006 INFO:teuthology.orchestra.run.smithi006.stdout:generic/207 9s 2023-07-06T21:05:02.011 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/207 2023-07-06T21:05:02.011 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:05:02.013 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:05:02.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:05:02.391 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-07-06T21:05:02.657 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:05:02.661 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:05:02.662 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:05:02.663 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:05:02.663 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:05:22.634 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:05:22.637 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:05:52.018 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-06T21:05:52.017+0000 7fad2c3f0700 -1 bdev(0x55d67134c000 /var/lib/ceph/osd/ceph-0/block) debug_aio_unlink stalled aio 0x55d673e51c10 since 2023-07-06T21:05:31.848929+0000, timeout is 5s 2023-07-06T21:05:52.709 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:05:52.712 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:06:23.337 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:06:23.342 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:06:53.670 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:06:53.674 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:07:23.739 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:07:23.742 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:07:23.799 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-06T21:07:23.797+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115978) UID: 0 2023-07-06T21:07:23.800 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-06T21:07:23.797+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115978) UID: 0 2023-07-06T21:07:23.800 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-06T21:07:23.797+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115978) UID: 0 2023-07-06T21:07:23.801 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-06T21:07:23.797+0000 7ff734335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 115978) UID: 0 2023-07-06T21:08:23.229 INFO:teuthology.orchestra.run.smithi006.stdout:generic/208 201s 2023-07-06T21:08:23.288 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/208 2023-07-06T21:08:23.289 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:08:23.290 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:08:23.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:08:23.683 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-07-06T21:08:23.969 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:08:23.973 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:08:23.973 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:08:23.974 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:08:23.974 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:08:56.859 INFO:teuthology.orchestra.run.smithi006.stdout:generic/209 32s 2023-07-06T21:08:56.864 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/209 2023-07-06T21:08:56.865 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:08:56.867 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:08:57.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:08:57.060 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-07-06T21:08:57.510 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:08:57.514 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:08:57.515 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:08:57.516 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:08:57.516 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:08:57.972 INFO:teuthology.orchestra.run.smithi006.stdout:generic/210 0s 2023-07-06T21:08:57.977 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/210 2023-07-06T21:08:57.978 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:08:57.979 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:08:58.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:08:58.252 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-07-06T21:08:58.617 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:08:58.622 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:08:58.622 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:08:58.623 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:08:58.623 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:08:59.154 INFO:teuthology.orchestra.run.smithi006.stdout:generic/211 1s 2023-07-06T21:08:59.159 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/211 2023-07-06T21:08:59.160 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:08:59.161 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:08:59.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:08:59.202 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-07-06T21:08:59.427 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:08:59.431 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:08:59.431 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:08:59.432 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:08:59.432 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:08:59.888 INFO:teuthology.orchestra.run.smithi006.stdout:generic/212 0s 2023-07-06T21:08:59.893 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/212 2023-07-06T21:08:59.893 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:08:59.895 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:08:59.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:08:59.937 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-07-06T21:09:00.170 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:00.175 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:00.175 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:00.176 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:00.176 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:00.562 INFO:teuthology.orchestra.run.smithi006.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T21:09:00.566 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/213 2023-07-06T21:09:00.566 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/213 2023-07-06T21:09:00.566 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:00.568 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:00.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:00.593 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-07-06T21:09:00.815 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:00.819 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:00.819 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:00.820 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:00.820 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:01.191 INFO:teuthology.orchestra.run.smithi006.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T21:09:01.195 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/214 2023-07-06T21:09:01.195 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/214 2023-07-06T21:09:01.196 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:01.197 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:01.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:01.221 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-07-06T21:09:01.445 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:01.449 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:01.449 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:01.450 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:01.450 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:03.870 INFO:teuthology.orchestra.run.smithi006.stdout:generic/215 2s 2023-07-06T21:09:03.876 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/215 2023-07-06T21:09:03.876 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:03.878 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:03.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:03.929 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-07-06T21:09:04.161 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:04.165 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:04.166 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:04.167 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:04.167 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:05.134 INFO:teuthology.orchestra.run.smithi006.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:09:05.155 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/216 2023-07-06T21:09:05.156 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/216 2023-07-06T21:09:05.156 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:05.165 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:05.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:05.197 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-07-06T21:09:05.421 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:05.425 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:05.426 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:05.426 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:05.427 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:06.406 INFO:teuthology.orchestra.run.smithi006.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:09:06.424 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/217 2023-07-06T21:09:06.425 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/217 2023-07-06T21:09:06.425 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:06.429 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:06.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:06.458 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-07-06T21:09:06.681 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:06.685 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:06.686 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:06.686 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:06.687 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:07.566 INFO:teuthology.orchestra.run.smithi006.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:09:07.636 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/218 2023-07-06T21:09:07.636 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/218 2023-07-06T21:09:07.636 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:07.639 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:07.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:07.681 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-07-06T21:09:07.908 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:07.912 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:07.912 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:07.913 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:07.913 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:08.263 INFO:teuthology.orchestra.run.smithi006.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T21:09:08.267 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/219 2023-07-06T21:09:08.267 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/219 2023-07-06T21:09:08.267 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:08.269 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:08.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:08.301 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-07-06T21:09:08.526 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:08.530 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:08.530 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:08.531 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:08.531 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:09.324 INFO:teuthology.orchestra.run.smithi006.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:09:09.342 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/220 2023-07-06T21:09:09.343 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/220 2023-07-06T21:09:09.343 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:09.388 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:09.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:09.515 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-07-06T21:09:09.743 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:09.747 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:09.747 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:09.748 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:09.748 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:11.123 INFO:teuthology.orchestra.run.smithi006.stdout:generic/221 2s 2023-07-06T21:09:11.129 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/221 2023-07-06T21:09:11.129 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:11.132 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:11.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:11.174 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-07-06T21:09:11.405 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:11.410 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:11.410 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:11.411 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:11.411 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:12.289 INFO:teuthology.orchestra.run.smithi006.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:09:12.295 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/222 2023-07-06T21:09:12.296 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/222 2023-07-06T21:09:12.296 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:12.298 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:12.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:12.394 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-07-06T21:09:12.618 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:12.622 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:12.622 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:12.623 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:12.623 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:13.002 INFO:teuthology.orchestra.run.smithi006.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T21:09:13.005 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/223 2023-07-06T21:09:13.006 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/223 2023-07-06T21:09:13.006 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:13.007 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:13.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:13.046 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-07-06T21:09:13.272 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:13.276 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:13.277 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:13.278 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:13.278 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:13.631 INFO:teuthology.orchestra.run.smithi006.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-06T21:09:13.635 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/224 2023-07-06T21:09:13.636 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/224 2023-07-06T21:09:13.636 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:13.638 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:13.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:13.663 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-07-06T21:09:13.884 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:13.888 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:13.889 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:13.890 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:13.890 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:14.291 INFO:teuthology.orchestra.run.smithi006.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-06T21:09:14.295 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/225 2023-07-06T21:09:14.296 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/225 2023-07-06T21:09:14.296 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:14.298 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:14.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:14.661 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-07-06T21:09:14.961 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:14.965 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:14.966 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:14.967 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:14.967 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:15.377 INFO:teuthology.orchestra.run.smithi006.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-06T21:09:15.385 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/226 2023-07-06T21:09:15.385 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/226 2023-07-06T21:09:15.386 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:15.386 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:15.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:15.419 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-07-06T21:09:15.640 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:15.644 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:15.645 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:15.646 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:15.646 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:16.534 INFO:teuthology.orchestra.run.smithi006.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:09:16.570 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/227 2023-07-06T21:09:16.571 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/227 2023-07-06T21:09:16.571 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:16.594 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:16.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:16.631 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-07-06T21:09:16.857 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:16.861 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:16.862 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:16.863 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:16.863 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:17.254 INFO:teuthology.orchestra.run.smithi006.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T21:09:17.258 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/228 2023-07-06T21:09:17.258 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/228 2023-07-06T21:09:17.258 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:17.260 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:17.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:17.294 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-07-06T21:09:17.518 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:17.523 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:17.523 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:17.524 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:17.524 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:18.435 INFO:teuthology.orchestra.run.smithi006.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:09:18.484 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/229 2023-07-06T21:09:18.484 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/229 2023-07-06T21:09:18.484 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:18.506 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:18.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:18.534 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-07-06T21:09:18.766 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:18.770 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:18.771 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:18.771 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:18.772 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:19.135 INFO:teuthology.orchestra.run.smithi006.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T21:09:19.140 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/230 2023-07-06T21:09:19.140 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/230 2023-07-06T21:09:19.140 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:19.142 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:19.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:19.166 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-07-06T21:09:19.390 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:19.394 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:19.395 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:19.395 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:19.396 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:19.753 INFO:teuthology.orchestra.run.smithi006.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T21:09:19.757 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/231 2023-07-06T21:09:19.757 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/231 2023-07-06T21:09:19.758 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:19.759 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:19.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:19.795 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-07-06T21:09:20.023 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:20.027 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:20.028 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:20.028 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:20.029 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:20.398 INFO:teuthology.orchestra.run.smithi006.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T21:09:20.403 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/232 2023-07-06T21:09:20.403 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/232 2023-07-06T21:09:20.403 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:20.405 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:20.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:20.435 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-07-06T21:09:20.659 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:20.664 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:20.664 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:20.665 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:20.665 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:21.000 INFO:teuthology.orchestra.run.smithi006.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T21:09:21.005 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/233 2023-07-06T21:09:21.005 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/233 2023-07-06T21:09:21.005 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:21.006 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:21.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:21.039 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-07-06T21:09:21.262 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:21.266 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:21.267 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:21.268 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:21.268 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:21.613 INFO:teuthology.orchestra.run.smithi006.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T21:09:21.617 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/234 2023-07-06T21:09:21.617 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/234 2023-07-06T21:09:21.618 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:21.619 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:21.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:21.642 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-07-06T21:09:21.867 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:21.871 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:21.872 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:21.873 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:21.873 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:22.217 INFO:teuthology.orchestra.run.smithi006.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T21:09:22.221 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/235 2023-07-06T21:09:22.221 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/235 2023-07-06T21:09:22.221 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:22.223 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:22.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:22.253 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-07-06T21:09:22.473 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:22.477 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:22.478 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:22.479 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:22.479 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:23.908 INFO:teuthology.orchestra.run.smithi006.stdout:generic/236 1s 2023-07-06T21:09:23.913 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/236 2023-07-06T21:09:23.914 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:23.915 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:24.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:24.342 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-07-06T21:09:24.574 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:24.578 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:24.579 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:24.580 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:24.580 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:25.004 INFO:teuthology.orchestra.run.smithi006.stdout:generic/237 0s 2023-07-06T21:09:25.008 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/237 2023-07-06T21:09:25.009 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:25.011 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:25.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:25.424 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-07-06T21:09:25.694 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:25.698 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:25.698 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:25.699 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:25.699 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:26.492 INFO:teuthology.orchestra.run.smithi006.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:09:26.503 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/238 2023-07-06T21:09:26.504 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/238 2023-07-06T21:09:26.504 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:09:26.504 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:09:26.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:09:26.695 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-07-06T21:09:26.923 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:09:26.927 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:09:26.927 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:09:26.928 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:09:26.928 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:10:35.402 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:10:35.428 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:10:35.650 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-07-06T21:10:35.646+0000 7f3a28953700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 116046) UID: 0 2023-07-06T21:10:35.659 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-07-06T21:10:35.655+0000 7f627fdc9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 116046) UID: 0 2023-07-06T21:11:26.075 INFO:teuthology.orchestra.run.smithi006.stdout:generic/239 119s 2023-07-06T21:11:26.080 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/239 2023-07-06T21:11:26.080 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:11:26.082 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:11:26.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:11:26.417 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-07-06T21:11:26.721 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:11:26.725 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:11:26.725 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:11:26.726 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:11:26.726 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:11:27.608 INFO:teuthology.orchestra.run.smithi006.stdout:generic/240 1s 2023-07-06T21:11:27.665 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/240 2023-07-06T21:11:27.665 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:11:27.667 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:11:27.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:11:27.869 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-07-06T21:11:28.307 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:11:28.312 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:11:28.312 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:11:28.313 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:11:28.313 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:12:43.465 INFO:teuthology.orchestra.run.smithi006.stdout:generic/241 75s 2023-07-06T21:12:43.471 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/241 2023-07-06T21:12:43.471 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:12:43.473 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:12:44.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:12:44.195 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-07-06T21:12:44.846 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:12:44.854 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:12:44.864 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:12:44.865 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:12:44.866 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:12:46.232 INFO:teuthology.orchestra.run.smithi006.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:12:46.274 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/242 2023-07-06T21:12:46.274 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/242 2023-07-06T21:12:46.274 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:12:46.356 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:12:46.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:12:46.529 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-07-06T21:12:46.798 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:12:46.802 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:12:46.803 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:12:46.803 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:12:46.803 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:12:47.641 INFO:teuthology.orchestra.run.smithi006.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:12:47.650 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/243 2023-07-06T21:12:47.650 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/243 2023-07-06T21:12:47.650 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:12:47.674 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:12:47.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:12:47.790 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-07-06T21:12:48.014 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:12:48.019 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:12:48.019 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:12:48.020 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:12:48.020 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:12:48.390 INFO:teuthology.orchestra.run.smithi006.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T21:12:48.394 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/244 2023-07-06T21:12:48.394 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/244 2023-07-06T21:12:48.394 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:12:48.396 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:12:48.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:12:48.420 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-07-06T21:12:48.643 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:12:48.647 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:12:48.648 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:12:48.648 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:12:48.649 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:12:49.081 INFO:teuthology.orchestra.run.smithi006.stdout:generic/245 1s 2023-07-06T21:12:49.086 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/245 2023-07-06T21:12:49.086 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:12:49.088 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:12:49.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:12:49.374 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-07-06T21:12:49.731 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:12:49.735 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:12:49.736 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:12:49.736 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:12:49.737 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:12:50.130 INFO:teuthology.orchestra.run.smithi006.stdout:generic/246 1s 2023-07-06T21:12:50.135 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/246 2023-07-06T21:12:50.135 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:12:50.137 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:12:50.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:12:50.323 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-07-06T21:12:50.791 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:12:50.795 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:12:50.796 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:12:50.797 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:12:50.797 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:12:57.045 INFO:teuthology.orchestra.run.smithi006.stdout:generic/247 6s 2023-07-06T21:12:57.050 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/247 2023-07-06T21:12:57.050 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:12:57.052 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:12:57.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:12:57.061 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-07-06T21:12:57.297 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:12:57.301 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:12:57.301 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:12:57.302 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:12:57.302 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:12:57.685 INFO:teuthology.orchestra.run.smithi006.stdout:generic/248 0s 2023-07-06T21:12:57.690 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/248 2023-07-06T21:12:57.690 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:12:57.692 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:12:57.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:12:57.733 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-07-06T21:12:57.953 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:12:57.957 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:12:57.958 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:12:57.958 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:12:57.959 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:12:58.563 INFO:teuthology.orchestra.run.smithi006.stdout:generic/249 0s 2023-07-06T21:12:58.568 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/249 2023-07-06T21:12:58.568 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:12:58.570 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:12:58.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:12:58.837 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-07-06T21:12:59.249 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:12:59.253 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:12:59.254 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:12:59.255 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:12:59.255 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:12:59.668 INFO:teuthology.orchestra.run.smithi006.stdout:generic/250 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T21:12:59.672 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/250 2023-07-06T21:12:59.672 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/250 2023-07-06T21:12:59.673 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:12:59.674 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:12:59.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:12:59.703 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-07-06T21:12:59.929 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:12:59.929 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:12:59.930 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:12:59.931 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:12:59.931 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:00.472 INFO:teuthology.orchestra.run.smithi006.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:13:00.494 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/251 2023-07-06T21:13:00.494 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/251 2023-07-06T21:13:00.495 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:13:00.496 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:00.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:13:00.520 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-07-06T21:13:00.749 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:13:00.753 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:13:00.754 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:13:00.755 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:13:00.755 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:01.123 INFO:teuthology.orchestra.run.smithi006.stdout:generic/252 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T21:13:01.127 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/252 2023-07-06T21:13:01.127 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/252 2023-07-06T21:13:01.127 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:13:01.129 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:01.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:13:01.159 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-07-06T21:13:01.393 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:13:01.397 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:13:01.398 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:13:01.398 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:13:01.398 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:02.182 INFO:teuthology.orchestra.run.smithi006.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:13:02.213 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/253 2023-07-06T21:13:02.213 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/253 2023-07-06T21:13:02.213 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:13:02.229 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:02.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:13:02.384 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-07-06T21:13:02.611 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:13:02.615 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:13:02.616 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:13:02.617 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:13:02.617 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:03.461 INFO:teuthology.orchestra.run.smithi006.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:13:03.597 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/254 2023-07-06T21:13:03.597 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/254 2023-07-06T21:13:03.597 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:13:03.599 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:03.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:13:03.624 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-07-06T21:13:03.849 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:13:03.853 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:13:03.854 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:13:03.855 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:13:03.855 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:04.325 INFO:teuthology.orchestra.run.smithi006.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T21:13:04.329 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/255 2023-07-06T21:13:04.330 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/255 2023-07-06T21:13:04.330 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:13:04.332 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:04.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:13:04.586 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-07-06T21:13:04.988 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:13:04.992 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:13:04.993 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:13:04.994 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:13:04.994 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:05.609 INFO:teuthology.orchestra.run.smithi006.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-06T21:13:05.613 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/256 2023-07-06T21:13:05.613 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/256 2023-07-06T21:13:05.614 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:13:05.615 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:05.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:13:05.650 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-07-06T21:13:05.882 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:13:05.886 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:13:05.887 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:13:05.888 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:13:05.888 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:06.870 INFO:teuthology.orchestra.run.smithi006.stdout:generic/257 0s 2023-07-06T21:13:06.875 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/257 2023-07-06T21:13:06.875 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:13:06.877 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:07.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:13:07.395 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-07-06T21:13:07.636 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:13:07.641 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:13:07.641 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:13:07.642 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:13:07.642 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:07.994 INFO:teuthology.orchestra.run.smithi006.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-07-06T21:13:07.999 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/258 2023-07-06T21:13:07.999 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/258 2023-07-06T21:13:07.999 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:13:08.002 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:08.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:13:08.105 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-07-06T21:13:08.380 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:13:08.384 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:13:08.385 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:13:08.385 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:13:08.386 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:09.159 INFO:teuthology.orchestra.run.smithi006.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:13:09.210 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/259 2023-07-06T21:13:09.210 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/259 2023-07-06T21:13:09.210 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:13:09.376 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:09.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:13:09.404 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-07-06T21:13:09.646 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:13:09.650 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:13:09.651 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:13:09.652 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:13:09.652 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:10.164 INFO:teuthology.orchestra.run.smithi006.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:13:10.182 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/260 2023-07-06T21:13:10.182 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/260 2023-07-06T21:13:10.182 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:13:10.184 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:10.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:13:10.211 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-07-06T21:13:10.435 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:13:10.440 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:13:10.440 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:13:10.441 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:13:10.441 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:11.294 INFO:teuthology.orchestra.run.smithi006.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:13:11.301 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/261 2023-07-06T21:13:11.302 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/261 2023-07-06T21:13:11.302 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:13:11.339 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:11.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:13:11.438 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-07-06T21:13:11.668 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:13:11.673 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:13:11.674 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:13:11.674 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:13:11.674 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:12.611 INFO:teuthology.orchestra.run.smithi006.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:13:12.660 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/262 2023-07-06T21:13:12.660 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/262 2023-07-06T21:13:12.661 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:13:12.662 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:12.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:13:12.697 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-07-06T21:13:12.938 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:13:12.942 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:13:12.943 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:13:12.944 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:13:12.944 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:54.039 INFO:teuthology.orchestra.run.smithi006.stdout:generic/263 41s 2023-07-06T21:13:54.044 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/263 2023-07-06T21:13:54.044 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:13:54.046 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:54.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:13:54.314 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-07-06T21:13:54.697 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:13:54.701 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:13:54.701 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:13:54.702 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:13:54.702 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:55.445 INFO:teuthology.orchestra.run.smithi006.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:13:55.581 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/264 2023-07-06T21:13:55.581 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/264 2023-07-06T21:13:55.582 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:13:55.613 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:55.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:13:55.671 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-07-06T21:13:55.898 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:13:55.903 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:13:55.903 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:13:55.904 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:13:55.904 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:56.829 INFO:teuthology.orchestra.run.smithi006.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:13:56.846 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/265 2023-07-06T21:13:56.846 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/265 2023-07-06T21:13:56.846 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:13:56.854 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:56.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:13:56.896 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-07-06T21:13:57.122 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:13:57.126 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:13:57.127 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:13:57.127 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:13:57.127 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:58.076 INFO:teuthology.orchestra.run.smithi006.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:13:58.096 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/266 2023-07-06T21:13:58.097 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/266 2023-07-06T21:13:58.097 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:13:58.103 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:58.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:13:58.133 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-07-06T21:13:58.357 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:13:58.361 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:13:58.362 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:13:58.363 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:13:58.363 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:59.295 INFO:teuthology.orchestra.run.smithi006.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:13:59.318 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/267 2023-07-06T21:13:59.319 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/267 2023-07-06T21:13:59.319 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:13:59.327 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:13:59.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:13:59.364 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-07-06T21:13:59.588 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:13:59.592 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:13:59.592 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:13:59.600 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:13:59.601 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:00.605 INFO:teuthology.orchestra.run.smithi006.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:14:00.612 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/268 2023-07-06T21:14:00.613 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/268 2023-07-06T21:14:00.613 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:00.615 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:00.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:00.643 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-07-06T21:14:00.870 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:00.874 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:00.875 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:00.875 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:00.876 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:01.227 INFO:teuthology.orchestra.run.smithi006.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-06T21:14:01.230 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/269 2023-07-06T21:14:01.231 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/269 2023-07-06T21:14:01.231 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:01.232 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:01.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:01.255 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-07-06T21:14:01.491 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:01.495 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:01.495 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:01.496 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:01.496 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:01.851 INFO:teuthology.orchestra.run.smithi006.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T21:14:01.856 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/270 2023-07-06T21:14:01.856 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/270 2023-07-06T21:14:01.857 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:01.858 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:01.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:01.885 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-07-06T21:14:02.122 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:02.126 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:02.127 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:02.127 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:02.127 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:03.115 INFO:teuthology.orchestra.run.smithi006.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:14:03.161 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/271 2023-07-06T21:14:03.161 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/271 2023-07-06T21:14:03.161 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:03.178 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:03.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:03.253 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-07-06T21:14:03.500 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:03.505 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:03.505 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:03.506 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:03.506 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:04.535 INFO:teuthology.orchestra.run.smithi006.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:14:04.559 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/272 2023-07-06T21:14:04.559 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/272 2023-07-06T21:14:04.560 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:04.563 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:04.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:04.599 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-07-06T21:14:04.855 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:04.859 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:04.860 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:04.861 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:04.861 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:05.223 INFO:teuthology.orchestra.run.smithi006.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-06T21:14:05.227 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/273 2023-07-06T21:14:05.227 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/273 2023-07-06T21:14:05.227 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:05.229 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:05.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:05.255 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-07-06T21:14:05.484 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:05.488 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:05.488 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:05.489 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:05.489 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:05.851 INFO:teuthology.orchestra.run.smithi006.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-06T21:14:05.855 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/274 2023-07-06T21:14:05.855 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/274 2023-07-06T21:14:05.855 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:05.857 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:05.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:05.895 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-07-06T21:14:06.129 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:06.132 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:06.133 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:06.134 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:06.134 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:06.480 INFO:teuthology.orchestra.run.smithi006.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-06T21:14:06.484 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/275 2023-07-06T21:14:06.484 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/275 2023-07-06T21:14:06.485 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:06.490 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:06.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:06.509 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-07-06T21:14:06.735 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:06.739 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:06.740 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:06.741 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:06.741 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:07.627 INFO:teuthology.orchestra.run.smithi006.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:14:07.638 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/276 2023-07-06T21:14:07.638 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/276 2023-07-06T21:14:07.638 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:07.641 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:07.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:07.755 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-07-06T21:14:08.009 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:08.014 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:08.014 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:08.015 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:08.015 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:08.420 INFO:teuthology.orchestra.run.smithi006.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-07-06T21:14:08.424 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/277 2023-07-06T21:14:08.425 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/277 2023-07-06T21:14:08.425 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:08.427 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:08.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:08.463 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-07-06T21:14:08.707 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:08.711 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:08.712 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:08.712 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:08.713 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:09.735 INFO:teuthology.orchestra.run.smithi006.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:14:09.748 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/278 2023-07-06T21:14:09.749 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/278 2023-07-06T21:14:09.749 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:09.755 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:09.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:09.793 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-07-06T21:14:10.036 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:10.039 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:10.040 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:10.041 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:10.041 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:10.926 INFO:teuthology.orchestra.run.smithi006.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:14:11.044 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/279 2023-07-06T21:14:11.044 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/279 2023-07-06T21:14:11.045 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:11.048 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:11.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:11.107 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-07-06T21:14:11.118 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:14:11.161 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:14:11.338 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:11.342 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:11.343 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:11.343 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:11.343 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:11.712 INFO:teuthology.orchestra.run.smithi006.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T21:14:11.716 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/280 2023-07-06T21:14:11.716 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/280 2023-07-06T21:14:11.716 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:11.718 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:11.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:11.743 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-07-06T21:14:11.971 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:11.976 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:11.977 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:11.978 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:11.978 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:12.890 INFO:teuthology.orchestra.run.smithi006.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:14:12.896 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/281 2023-07-06T21:14:12.897 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/281 2023-07-06T21:14:12.898 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:12.901 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:12.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:12.998 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-07-06T21:14:13.242 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:13.246 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:13.247 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:13.247 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:13.248 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:14.065 INFO:teuthology.orchestra.run.smithi006.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:14:14.191 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/282 2023-07-06T21:14:14.192 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/282 2023-07-06T21:14:14.192 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:14.248 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:14.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:14.297 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-07-06T21:14:14.518 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:14.521 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:14.522 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:14.523 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:14.523 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:15.523 INFO:teuthology.orchestra.run.smithi006.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:14:15.578 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/283 2023-07-06T21:14:15.578 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/283 2023-07-06T21:14:15.578 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:15.581 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:15.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:15.616 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-07-06T21:14:15.839 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:15.843 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:15.843 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:15.844 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:16.536 INFO:teuthology.orchestra.run.smithi006.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:14:16.550 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/284 2023-07-06T21:14:16.550 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/284 2023-07-06T21:14:16.550 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:16.588 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:16.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:16.818 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-07-06T21:14:17.099 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:17.103 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:17.104 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:17.104 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:17.105 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:18.572 INFO:teuthology.orchestra.run.smithi006.stdout:generic/285 1s 2023-07-06T21:14:18.585 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/285 2023-07-06T21:14:18.585 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:18.586 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:19.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:19.014 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-07-06T21:14:19.705 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:19.710 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:19.711 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:19.712 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:19.712 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:20.371 INFO:teuthology.orchestra.run.smithi006.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T21:14:20.377 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/286 2023-07-06T21:14:20.377 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/286 2023-07-06T21:14:20.377 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:20.380 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:20.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:20.442 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-07-06T21:14:20.925 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:20.932 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:20.933 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:20.934 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:20.934 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:22.159 INFO:teuthology.orchestra.run.smithi006.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:14:22.165 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/287 2023-07-06T21:14:22.166 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/287 2023-07-06T21:14:22.166 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:22.351 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:22.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:22.404 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-07-06T21:14:22.919 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:22.939 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:22.940 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:22.942 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:22.942 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:23.798 INFO:teuthology.orchestra.run.smithi006.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:23.825 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/288 2023-07-06T21:14:23.826 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/288 2023-07-06T21:14:23.826 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:23.829 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:23.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:23.870 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-07-06T21:14:24.395 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:24.404 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:24.405 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:24.409 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:24.410 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:25.714 INFO:teuthology.orchestra.run.smithi006.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:14:25.720 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/289 2023-07-06T21:14:25.721 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/289 2023-07-06T21:14:25.721 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:25.748 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:25.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:25.798 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-07-06T21:14:26.020 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:26.022 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:26.024 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:26.025 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:26.025 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:26.943 INFO:teuthology.orchestra.run.smithi006.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:14:27.018 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/290 2023-07-06T21:14:27.018 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/290 2023-07-06T21:14:27.019 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:27.027 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:27.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:27.055 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-07-06T21:14:27.284 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:27.288 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:27.289 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:27.290 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:27.290 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:28.157 INFO:teuthology.orchestra.run.smithi006.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:14:28.248 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/291 2023-07-06T21:14:28.249 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/291 2023-07-06T21:14:28.249 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:28.331 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:28.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:28.364 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-07-06T21:14:28.600 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:28.604 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:28.605 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:28.605 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:28.606 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:29.441 INFO:teuthology.orchestra.run.smithi006.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:14:29.618 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/292 2023-07-06T21:14:29.619 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/292 2023-07-06T21:14:29.619 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:29.619 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:29.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:29.666 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-07-06T21:14:29.898 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:29.902 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:29.903 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:29.904 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:29.904 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:30.765 INFO:teuthology.orchestra.run.smithi006.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:14:30.780 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/293 2023-07-06T21:14:30.781 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/293 2023-07-06T21:14:30.781 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:30.785 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:30.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:30.925 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-07-06T21:14:31.185 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:31.190 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:31.191 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:31.192 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:31.192 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:32.137 INFO:teuthology.orchestra.run.smithi006.stdout:generic/294 1s 2023-07-06T21:14:32.189 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/294 2023-07-06T21:14:32.190 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:32.205 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:32.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:32.264 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-07-06T21:14:32.564 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:32.569 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:32.569 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:32.570 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:32.570 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:33.557 INFO:teuthology.orchestra.run.smithi006.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:14:33.570 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/295 2023-07-06T21:14:33.571 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/295 2023-07-06T21:14:33.571 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:33.580 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:33.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:33.630 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-07-06T21:14:33.859 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:33.863 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:33.863 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:33.864 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:33.864 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:34.680 INFO:teuthology.orchestra.run.smithi006.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:14:34.789 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/296 2023-07-06T21:14:34.790 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/296 2023-07-06T21:14:34.790 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:34.806 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:34.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:34.907 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-07-06T21:14:35.150 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:35.154 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:35.155 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:35.155 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:35.156 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:36.050 INFO:teuthology.orchestra.run.smithi006.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:14:36.068 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/297 2023-07-06T21:14:36.069 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/297 2023-07-06T21:14:36.069 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:36.071 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:36.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:36.220 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-07-06T21:14:36.447 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:36.451 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:36.452 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:36.453 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:36.453 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:37.246 INFO:teuthology.orchestra.run.smithi006.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:14:37.297 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/298 2023-07-06T21:14:37.297 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/298 2023-07-06T21:14:37.298 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:37.304 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:37.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:37.549 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-07-06T21:14:37.778 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:37.782 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:37.782 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:37.783 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:37.783 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:38.203 INFO:teuthology.orchestra.run.smithi006.stdout:generic/299 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T21:14:38.207 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/299 2023-07-06T21:14:38.208 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/299 2023-07-06T21:14:38.208 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:38.209 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:38.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:38.241 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-07-06T21:14:38.463 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:38.467 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:38.468 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:38.469 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:38.469 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:38.896 INFO:teuthology.orchestra.run.smithi006.stdout:generic/300 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T21:14:38.900 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/300 2023-07-06T21:14:38.900 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/300 2023-07-06T21:14:38.900 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:38.902 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:38.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:38.991 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-07-06T21:14:39.233 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:39.237 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:39.238 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:39.238 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:39.238 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:40.283 INFO:teuthology.orchestra.run.smithi006.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:14:40.290 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/301 2023-07-06T21:14:40.291 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/301 2023-07-06T21:14:40.291 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:40.292 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:40.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:40.318 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-07-06T21:14:40.562 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:40.566 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:40.566 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:40.567 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:40.568 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:41.299 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:14:41.304 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:14:41.565 INFO:teuthology.orchestra.run.smithi006.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:14:41.590 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/302 2023-07-06T21:14:41.590 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/302 2023-07-06T21:14:41.591 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:41.593 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:41.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:41.630 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-07-06T21:14:41.864 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:41.869 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:41.869 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:41.870 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:41.870 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:42.262 INFO:teuthology.orchestra.run.smithi006.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:14:42.266 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/303 2023-07-06T21:14:42.266 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/303 2023-07-06T21:14:42.266 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:42.268 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:42.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:42.707 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-07-06T21:14:42.983 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:42.987 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:42.988 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:42.989 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:42.989 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:43.372 INFO:teuthology.orchestra.run.smithi006.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-06T21:14:43.376 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/304 2023-07-06T21:14:43.377 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/304 2023-07-06T21:14:43.377 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:43.379 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:43.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:43.785 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-07-06T21:14:44.067 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:44.072 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:44.072 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:44.073 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:44.073 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:45.001 INFO:teuthology.orchestra.run.smithi006.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:14:45.037 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/305 2023-07-06T21:14:45.038 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/305 2023-07-06T21:14:45.038 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:45.051 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:45.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:45.090 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-07-06T21:14:45.324 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:45.328 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:45.329 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:45.330 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:45.330 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:46.426 INFO:teuthology.orchestra.run.smithi006.stdout:generic/306 1s 2023-07-06T21:14:46.433 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/306 2023-07-06T21:14:46.433 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:46.435 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:46.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:46.751 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-07-06T21:14:47.066 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:47.071 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:47.072 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:47.072 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:47.072 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:48.927 INFO:teuthology.orchestra.run.smithi006.stdout:generic/307 1s 2023-07-06T21:14:48.932 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/307 2023-07-06T21:14:48.933 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:48.934 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:48.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:48.944 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-07-06T21:14:49.177 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:49.182 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:49.183 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:49.183 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:49.183 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:49.577 INFO:teuthology.orchestra.run.smithi006.stdout:generic/308 0s 2023-07-06T21:14:49.582 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/308 2023-07-06T21:14:49.583 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:49.585 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:49.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:49.616 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-07-06T21:14:49.840 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:49.844 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:49.845 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:49.846 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:49.846 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:51.262 INFO:teuthology.orchestra.run.smithi006.stdout:generic/309 1s 2023-07-06T21:14:51.298 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/309 2023-07-06T21:14:51.298 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:14:51.301 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:14:51.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:14:51.449 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-07-06T21:14:51.956 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:14:51.960 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:14:51.961 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:14:51.961 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:14:51.962 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:15:11.666 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:15:11.671 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:15:41.739 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:15:41.741 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:16:09.188 INFO:teuthology.orchestra.run.smithi006.stdout:generic/310 77s 2023-07-06T21:16:09.193 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/310 2023-07-06T21:16:09.193 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:16:09.195 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:09.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:16:09.662 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-07-06T21:16:10.144 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:16:10.148 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:16:10.148 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:16:10.149 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:16:10.149 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:10.537 INFO:teuthology.orchestra.run.smithi006.stdout:generic/311 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T21:16:10.541 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/311 2023-07-06T21:16:10.541 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/311 2023-07-06T21:16:10.541 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:16:10.543 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:10.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:16:10.576 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-07-06T21:16:10.799 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:16:10.804 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:16:10.804 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:16:10.805 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:16:10.805 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:11.135 INFO:teuthology.orchestra.run.smithi006.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T21:16:11.140 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/312 2023-07-06T21:16:11.140 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/312 2023-07-06T21:16:11.140 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:16:11.141 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:11.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:16:11.169 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-07-06T21:16:11.395 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:16:11.399 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:16:11.400 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:16:11.401 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:16:11.401 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:11.842 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:16:11.845 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:16:15.796 INFO:teuthology.orchestra.run.smithi006.stdout:generic/313 4s 2023-07-06T21:16:15.802 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/313 2023-07-06T21:16:15.802 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:16:15.804 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:15.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:16:15.835 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-07-06T21:16:16.062 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:16:16.067 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:16:16.067 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:16:16.068 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:16:16.068 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:16.633 INFO:teuthology.orchestra.run.smithi006.stdout:generic/314 0s 2023-07-06T21:16:16.638 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/314 2023-07-06T21:16:16.638 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:16:16.640 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:16.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:16:16.666 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-07-06T21:16:16.887 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:16:16.891 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:16:16.892 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:16:16.892 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:16:16.893 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:17.248 INFO:teuthology.orchestra.run.smithi006.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-06T21:16:17.252 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/315 2023-07-06T21:16:17.252 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/315 2023-07-06T21:16:17.252 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:16:17.254 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:17.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:16:17.282 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-07-06T21:16:17.503 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:16:17.507 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:16:17.508 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:16:17.509 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:16:17.509 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:17.966 INFO:teuthology.orchestra.run.smithi006.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-06T21:16:17.970 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/316 2023-07-06T21:16:17.971 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/316 2023-07-06T21:16:17.971 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:16:17.973 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:18.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:16:18.325 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-07-06T21:16:18.630 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:16:18.634 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:16:18.634 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:16:18.635 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:16:18.635 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:19.658 INFO:teuthology.orchestra.run.smithi006.stdout:generic/317 1s 2023-07-06T21:16:19.663 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/317 2023-07-06T21:16:19.663 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:16:19.665 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:19.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:16:19.674 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-07-06T21:16:19.895 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:16:19.899 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:16:19.899 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:16:19.900 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:16:19.900 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:20.748 INFO:teuthology.orchestra.run.smithi006.stdout:generic/318 0s 2023-07-06T21:16:20.753 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/318 2023-07-06T21:16:20.753 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:16:20.755 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:20.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:16:20.764 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-07-06T21:16:20.982 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:16:20.986 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:16:20.987 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:16:20.988 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:16:20.989 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:21.563 INFO:teuthology.orchestra.run.smithi006.stdout:generic/319 0s 2023-07-06T21:16:21.568 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/319 2023-07-06T21:16:21.568 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:16:21.570 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:21.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:16:21.579 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-07-06T21:16:21.803 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:16:21.807 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:16:21.808 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:16:21.809 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:16:21.809 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:22.148 INFO:teuthology.orchestra.run.smithi006.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-06T21:16:22.152 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/320 2023-07-06T21:16:22.152 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/320 2023-07-06T21:16:22.152 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:16:22.154 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:22.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:16:22.184 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-07-06T21:16:22.409 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:16:22.413 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:16:22.414 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:16:22.414 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:16:22.415 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:22.748 INFO:teuthology.orchestra.run.smithi006.stdout:generic/321 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T21:16:22.752 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/321 2023-07-06T21:16:22.752 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/321 2023-07-06T21:16:22.752 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:16:22.754 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:22.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:16:22.779 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-07-06T21:16:23.005 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:16:23.010 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:16:23.010 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:16:23.011 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:16:23.011 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:23.364 INFO:teuthology.orchestra.run.smithi006.stdout:generic/322 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T21:16:23.368 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/322 2023-07-06T21:16:23.369 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/322 2023-07-06T21:16:23.369 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:16:23.370 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:23.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:16:23.397 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-07-06T21:16:23.625 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:16:23.629 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:16:23.630 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:16:23.632 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:16:23.633 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:16:41.906 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:16:41.909 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:17:11.976 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:17:11.979 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:17:42.307 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:17:42.309 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:17:42.352 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-06T21:17:42.349+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 368764) UID: 0 2023-07-06T21:17:42.352 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-06T21:17:42.349+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 368764) UID: 0 2023-07-06T21:17:42.353 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T21:17:42.349+0000 7fec49f76700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 368764) UID: 0 2023-07-06T21:17:42.353 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-06T21:17:42.349+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 368764) UID: 0 2023-07-06T21:18:25.040 INFO:teuthology.orchestra.run.smithi006.stdout:generic/323 122s 2023-07-06T21:18:25.052 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/323 2023-07-06T21:18:25.053 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:18:25.054 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:25.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:18:25.329 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-07-06T21:18:27.201 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:18:27.205 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:18:27.205 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:18:27.206 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:18:27.206 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:27.549 INFO:teuthology.orchestra.run.smithi006.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-07-06T21:18:27.553 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/324 2023-07-06T21:18:27.553 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/324 2023-07-06T21:18:27.553 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:18:27.555 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:27.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:18:27.576 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-07-06T21:18:27.814 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:18:27.819 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:18:27.819 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:18:27.819 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:18:27.820 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:28.377 INFO:teuthology.orchestra.run.smithi006.stdout:generic/325 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T21:18:28.380 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/325 2023-07-06T21:18:28.381 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/325 2023-07-06T21:18:28.381 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:18:28.383 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:28.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:18:28.406 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-07-06T21:18:28.637 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:18:28.641 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:18:28.641 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:18:28.642 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:18:28.642 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:29.528 INFO:teuthology.orchestra.run.smithi006.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:18:29.544 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/326 2023-07-06T21:18:29.544 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/326 2023-07-06T21:18:29.544 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:18:29.599 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:29.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:18:29.661 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-07-06T21:18:29.885 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:18:29.889 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:18:29.889 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:18:29.890 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:18:29.890 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:30.709 INFO:teuthology.orchestra.run.smithi006.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:18:30.715 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/327 2023-07-06T21:18:30.716 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/327 2023-07-06T21:18:30.716 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:18:30.758 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:30.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:18:30.922 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-07-06T21:18:31.147 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:18:31.151 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:18:31.152 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:18:31.153 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:18:31.153 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:31.935 INFO:teuthology.orchestra.run.smithi006.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:18:32.092 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/328 2023-07-06T21:18:32.092 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/328 2023-07-06T21:18:32.092 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:18:32.093 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:32.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:18:32.171 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-07-06T21:18:32.405 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:18:32.410 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:18:32.410 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:18:32.411 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:18:32.411 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:33.679 INFO:teuthology.orchestra.run.smithi006.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:18:33.685 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/329 2023-07-06T21:18:33.685 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/329 2023-07-06T21:18:33.686 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:18:33.688 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:33.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:18:33.761 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-07-06T21:18:33.986 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:18:33.990 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:18:33.991 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:18:33.991 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:18:33.992 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:34.813 INFO:teuthology.orchestra.run.smithi006.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:18:34.819 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/330 2023-07-06T21:18:34.819 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/330 2023-07-06T21:18:34.820 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:18:34.939 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:35.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:18:35.025 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-07-06T21:18:35.248 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:18:35.252 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:18:35.252 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:18:35.253 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:18:35.253 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:36.286 INFO:teuthology.orchestra.run.smithi006.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:18:36.317 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/331 2023-07-06T21:18:36.317 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/331 2023-07-06T21:18:36.317 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:18:36.320 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:36.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:18:36.366 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-07-06T21:18:36.588 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:18:36.592 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:18:36.592 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:18:36.593 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:18:36.593 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:37.415 INFO:teuthology.orchestra.run.smithi006.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:18:37.426 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/332 2023-07-06T21:18:37.426 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/332 2023-07-06T21:18:37.427 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:18:37.429 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:37.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:18:37.631 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-07-06T21:18:37.858 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:18:37.864 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:18:37.865 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:18:37.865 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:18:37.865 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:38.767 INFO:teuthology.orchestra.run.smithi006.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:18:38.773 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/333 2023-07-06T21:18:38.774 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/333 2023-07-06T21:18:38.774 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:18:38.776 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:38.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:18:38.880 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-07-06T21:18:39.110 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:18:39.113 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:18:39.114 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:18:39.115 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:18:39.115 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:40.036 INFO:teuthology.orchestra.run.smithi006.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:18:40.069 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/334 2023-07-06T21:18:40.070 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/334 2023-07-06T21:18:40.070 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:18:40.073 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:40.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:18:40.168 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-07-06T21:18:40.471 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:18:40.475 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:18:40.475 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:18:40.476 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:18:40.476 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:40.923 INFO:teuthology.orchestra.run.smithi006.stdout:generic/335 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T21:18:40.927 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/335 2023-07-06T21:18:40.927 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/335 2023-07-06T21:18:40.927 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:18:40.929 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:40.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:18:40.964 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-07-06T21:18:41.188 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:18:41.192 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:18:41.193 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:18:41.194 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:18:41.194 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:42.134 INFO:teuthology.orchestra.run.smithi006.stdout:generic/336 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T21:18:42.139 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/336 2023-07-06T21:18:42.139 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/336 2023-07-06T21:18:42.139 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:18:42.141 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:42.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:18:42.165 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-07-06T21:18:42.387 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:18:42.392 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:18:42.393 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:18:42.393 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:18:42.394 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:43.203 INFO:teuthology.orchestra.run.smithi006.stdout:generic/337 1s 2023-07-06T21:18:43.212 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/337 2023-07-06T21:18:43.213 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:18:43.214 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:43.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:18:43.223 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-07-06T21:18:43.445 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:18:43.449 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:18:43.450 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:18:43.450 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:18:43.451 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:44.164 INFO:teuthology.orchestra.run.smithi006.stdout:generic/338 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T21:18:44.168 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/338 2023-07-06T21:18:44.168 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/338 2023-07-06T21:18:44.169 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:18:44.170 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:18:44.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:18:44.199 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-07-06T21:18:44.418 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:18:44.422 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:18:44.423 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:18:44.424 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:18:44.424 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:19:39.410 INFO:teuthology.orchestra.run.smithi006.stdout:generic/339 55s 2023-07-06T21:19:39.415 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/339 2023-07-06T21:19:39.415 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:19:39.417 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:19:39.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:19:39.427 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-07-06T21:19:39.674 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:19:39.678 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:19:39.679 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:19:39.680 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:19:39.680 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:19:43.063 INFO:teuthology.orchestra.run.smithi006.stdout:generic/340 3s 2023-07-06T21:19:43.078 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/340 2023-07-06T21:19:43.078 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:19:43.097 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:19:43.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:19:43.127 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-07-06T21:19:43.777 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:19:43.780 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:19:43.781 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:19:43.782 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:19:43.782 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:19:44.166 INFO:teuthology.orchestra.run.smithi006.stdout:generic/341 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T21:19:44.170 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/341 2023-07-06T21:19:44.171 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/341 2023-07-06T21:19:44.171 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:19:44.173 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:19:44.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:19:44.206 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-07-06T21:19:44.428 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:19:44.433 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:19:44.433 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:19:44.434 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:19:44.434 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:19:44.805 INFO:teuthology.orchestra.run.smithi006.stdout:generic/342 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T21:19:44.815 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/342 2023-07-06T21:19:44.815 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/342 2023-07-06T21:19:44.815 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:19:44.815 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:19:44.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:19:44.844 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-07-06T21:19:45.066 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:19:45.070 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:19:45.070 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:19:45.071 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:19:45.071 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:19:45.462 INFO:teuthology.orchestra.run.smithi006.stdout:generic/343 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T21:19:45.466 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/343 2023-07-06T21:19:45.467 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/343 2023-07-06T21:19:45.467 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:19:45.469 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:19:45.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:19:45.499 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-07-06T21:19:45.742 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:19:45.746 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:19:45.746 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:19:45.747 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:19:45.747 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:19:51.356 INFO:teuthology.orchestra.run.smithi006.stdout:generic/344 6s 2023-07-06T21:19:51.459 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/344 2023-07-06T21:19:51.459 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:19:51.464 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:19:51.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:19:51.536 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-07-06T21:19:52.176 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:19:52.201 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:19:52.201 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:19:52.203 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:19:52.203 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:19:57.745 INFO:teuthology.orchestra.run.smithi006.stdout:generic/345 5s 2023-07-06T21:19:57.824 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/345 2023-07-06T21:19:57.825 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:19:57.879 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:19:57.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:19:57.923 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-07-06T21:19:58.438 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:19:58.448 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:19:58.449 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:19:58.452 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:19:58.452 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:02.080 INFO:teuthology.orchestra.run.smithi006.stdout:generic/346 4s 2023-07-06T21:20:02.092 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/346 2023-07-06T21:20:02.092 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:02.105 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:02.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:02.139 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-07-06T21:20:02.711 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:02.717 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:02.728 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:02.751 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:02.751 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:03.173 INFO:teuthology.orchestra.run.smithi006.stdout:generic/347 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T21:20:03.177 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/347 2023-07-06T21:20:03.177 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/347 2023-07-06T21:20:03.178 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:03.179 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:03.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:03.203 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-07-06T21:20:03.429 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:03.433 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:03.434 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:03.435 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:03.435 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:03.824 INFO:teuthology.orchestra.run.smithi006.stdout:generic/348 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T21:20:03.828 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/348 2023-07-06T21:20:03.828 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/348 2023-07-06T21:20:03.828 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:03.830 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:03.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:03.869 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-07-06T21:20:04.098 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:04.102 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:04.103 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:04.104 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:04.104 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:04.567 INFO:teuthology.orchestra.run.smithi006.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-06T21:20:04.571 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/349 2023-07-06T21:20:04.571 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/349 2023-07-06T21:20:04.571 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:04.573 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:04.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:04.605 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-07-06T21:20:04.827 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:04.831 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:04.831 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:04.832 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:04.832 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:06.199 INFO:teuthology.orchestra.run.smithi006.stdout:generic/350 1s 2023-07-06T21:20:06.203 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/350 2023-07-06T21:20:06.203 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:06.205 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:06.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:06.215 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-07-06T21:20:06.458 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:06.463 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:06.463 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:06.464 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:06.464 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:06.900 INFO:teuthology.orchestra.run.smithi006.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T21:20:06.904 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/351 2023-07-06T21:20:06.905 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/351 2023-07-06T21:20:06.905 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:06.907 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:06.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:06.934 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-07-06T21:20:07.159 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:07.163 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:07.164 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:07.164 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:07.165 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:07.938 INFO:teuthology.orchestra.run.smithi006.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:20:08.110 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/352 2023-07-06T21:20:08.110 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/352 2023-07-06T21:20:08.110 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:08.112 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:08.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:08.146 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-07-06T21:20:08.368 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:08.372 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:08.373 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:08.374 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:08.374 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:09.131 INFO:teuthology.orchestra.run.smithi006.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:20:09.236 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/353 2023-07-06T21:20:09.237 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/353 2023-07-06T21:20:09.237 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:09.254 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:09.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:09.345 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-07-06T21:20:09.571 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:09.575 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:09.576 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:09.577 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:09.577 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:23.848 INFO:teuthology.orchestra.run.smithi006.stdout:generic/354 14s 2023-07-06T21:20:23.859 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/354 2023-07-06T21:20:23.860 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:23.862 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:23.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:23.875 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-07-06T21:20:24.336 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:24.347 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:24.348 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:24.357 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:24.357 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:25.317 INFO:teuthology.orchestra.run.smithi006.stdout:generic/355 1s 2023-07-06T21:20:25.321 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/355 2023-07-06T21:20:25.322 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:25.324 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:25.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:25.726 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-07-06T21:20:25.984 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:25.988 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:25.988 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:25.989 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:25.989 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:26.615 INFO:teuthology.orchestra.run.smithi006.stdout:generic/356 [not run] swapfiles are not supported 2023-07-06T21:20:26.619 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/356 2023-07-06T21:20:26.620 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/356 2023-07-06T21:20:26.620 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:26.621 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:26.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:26.651 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-07-06T21:20:26.873 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:26.877 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:26.878 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:26.879 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:26.879 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:27.500 INFO:teuthology.orchestra.run.smithi006.stdout:generic/357 [not run] swapfiles are not supported 2023-07-06T21:20:27.504 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/357 2023-07-06T21:20:27.504 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/357 2023-07-06T21:20:27.504 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:27.506 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:27.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:27.537 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-07-06T21:20:27.766 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:27.771 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:27.771 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:27.773 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:27.773 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:28.556 INFO:teuthology.orchestra.run.smithi006.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:20:28.608 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/358 2023-07-06T21:20:28.608 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/358 2023-07-06T21:20:28.609 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:28.723 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:28.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:28.761 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-07-06T21:20:29.005 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:29.009 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:29.010 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:29.011 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:29.011 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:29.979 INFO:teuthology.orchestra.run.smithi006.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:20:29.993 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/359 2023-07-06T21:20:29.993 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/359 2023-07-06T21:20:29.993 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:29.997 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:30.023 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:30.024 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-07-06T21:20:30.267 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:30.271 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:30.272 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:30.273 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:30.273 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:30.676 INFO:teuthology.orchestra.run.smithi006.stdout:generic/360 0s 2023-07-06T21:20:30.681 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/360 2023-07-06T21:20:30.681 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:30.683 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:30.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:30.721 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-07-06T21:20:30.944 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:31.180 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:31.180 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:31.180 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:31.180 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:31.291 INFO:teuthology.orchestra.run.smithi006.stdout:generic/361 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T21:20:31.294 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/361 2023-07-06T21:20:31.294 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/361 2023-07-06T21:20:31.295 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:31.297 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:31.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:31.320 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-07-06T21:20:31.545 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:31.549 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:31.549 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:31.550 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:31.551 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:31.883 INFO:teuthology.orchestra.run.smithi006.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-06T21:20:31.887 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/362 2023-07-06T21:20:31.887 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/362 2023-07-06T21:20:31.887 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:31.889 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:31.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:31.912 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-07-06T21:20:32.135 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:32.139 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:32.139 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:32.140 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:32.140 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:32.479 INFO:teuthology.orchestra.run.smithi006.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-06T21:20:32.483 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/363 2023-07-06T21:20:32.483 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/363 2023-07-06T21:20:32.484 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:32.485 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:32.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:32.514 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-07-06T21:20:32.739 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:32.743 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:32.744 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:32.745 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:32.745 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:33.075 INFO:teuthology.orchestra.run.smithi006.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-06T21:20:33.079 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/364 2023-07-06T21:20:33.079 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/364 2023-07-06T21:20:33.079 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:33.081 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:33.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:33.106 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-07-06T21:20:33.331 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:33.335 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:33.336 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:33.337 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:33.337 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:33.669 INFO:teuthology.orchestra.run.smithi006.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-06T21:20:33.674 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/365 2023-07-06T21:20:33.674 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/365 2023-07-06T21:20:33.674 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:33.676 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:33.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:33.706 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-07-06T21:20:33.931 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:33.935 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:33.935 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:33.936 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:33.937 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:34.281 INFO:teuthology.orchestra.run.smithi006.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-06T21:20:34.285 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/366 2023-07-06T21:20:34.285 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/366 2023-07-06T21:20:34.285 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:34.287 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:34.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:34.310 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-07-06T21:20:34.532 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:34.536 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:34.536 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:34.537 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:34.538 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:34.876 INFO:teuthology.orchestra.run.smithi006.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-06T21:20:34.880 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/367 2023-07-06T21:20:34.880 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/367 2023-07-06T21:20:34.881 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:34.882 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:34.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:34.909 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-07-06T21:20:35.131 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:35.135 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:35.135 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:35.136 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:35.136 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:35.478 INFO:teuthology.orchestra.run.smithi006.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-06T21:20:35.482 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/368 2023-07-06T21:20:35.483 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/368 2023-07-06T21:20:35.483 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:35.484 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:35.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:35.515 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-07-06T21:20:35.748 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:35.752 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:35.752 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:35.753 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:35.753 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:36.098 INFO:teuthology.orchestra.run.smithi006.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-06T21:20:36.102 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/369 2023-07-06T21:20:36.102 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/369 2023-07-06T21:20:36.102 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:36.104 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:36.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:36.134 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-07-06T21:20:36.356 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:36.361 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:36.361 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:36.362 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:36.362 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:36.656 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:20:36.659 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:20:36.700 INFO:teuthology.orchestra.run.smithi006.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-07-06T21:20:36.703 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/370 2023-07-06T21:20:36.704 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/370 2023-07-06T21:20:36.704 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:36.706 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:36.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:36.735 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-07-06T21:20:37.001 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:37.005 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:37.005 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:37.006 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:37.006 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:37.354 INFO:teuthology.orchestra.run.smithi006.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T21:20:37.358 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/371 2023-07-06T21:20:37.358 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/371 2023-07-06T21:20:37.359 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:37.360 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:37.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:37.398 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-07-06T21:20:37.625 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:37.629 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:37.630 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:37.631 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:37.631 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:38.519 INFO:teuthology.orchestra.run.smithi006.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:20:38.556 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/372 2023-07-06T21:20:38.556 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/372 2023-07-06T21:20:38.556 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:38.568 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:38.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:38.602 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-07-06T21:20:38.831 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:38.836 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:38.836 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:38.837 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:38.837 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:39.746 INFO:teuthology.orchestra.run.smithi006.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:20:39.805 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/373 2023-07-06T21:20:39.805 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/373 2023-07-06T21:20:39.805 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:39.809 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:39.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:39.836 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-07-06T21:20:40.062 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:40.067 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:40.067 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:40.068 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:40.068 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:40.632 INFO:teuthology.orchestra.run.smithi006.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-07-06T21:20:40.907 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/374 2023-07-06T21:20:40.907 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/374 2023-07-06T21:20:40.907 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:40.919 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:41.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:41.076 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-07-06T21:20:41.295 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:41.299 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:41.300 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:41.301 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:41.301 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:41.764 INFO:teuthology.orchestra.run.smithi006.stdout:generic/375 0s 2023-07-06T21:20:41.768 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/375 2023-07-06T21:20:41.769 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:41.770 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:41.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:41.974 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-07-06T21:20:42.422 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:42.426 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:42.427 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:42.428 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:42.428 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:42.788 INFO:teuthology.orchestra.run.smithi006.stdout:generic/376 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T21:20:42.793 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/376 2023-07-06T21:20:42.793 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/376 2023-07-06T21:20:42.793 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:42.795 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:42.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:42.819 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-07-06T21:20:43.062 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:43.067 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:43.067 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:43.068 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:43.068 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:43.691 INFO:teuthology.orchestra.run.smithi006.stdout:generic/377 0s 2023-07-06T21:20:43.696 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/377 2023-07-06T21:20:43.697 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:43.698 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:43.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:43.708 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-07-06T21:20:43.930 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:43.934 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:43.934 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:43.935 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:43.936 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:44.425 INFO:teuthology.orchestra.run.smithi006.stdout:generic/378 0s 2023-07-06T21:20:44.430 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/378 2023-07-06T21:20:44.431 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:44.432 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:44.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:44.862 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-07-06T21:20:45.091 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:45.095 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:45.096 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:45.096 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:45.097 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:45.475 INFO:teuthology.orchestra.run.smithi006.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T21:20:45.479 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/379 2023-07-06T21:20:45.480 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/379 2023-07-06T21:20:45.480 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:45.482 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:45.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:45.510 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-07-06T21:20:45.736 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:45.741 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:45.741 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:45.742 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:45.742 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:46.072 INFO:teuthology.orchestra.run.smithi006.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T21:20:46.076 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/380 2023-07-06T21:20:46.076 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/380 2023-07-06T21:20:46.077 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:46.079 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:46.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:46.116 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-07-06T21:20:46.338 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:46.342 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:46.342 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:46.343 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:46.343 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:46.683 INFO:teuthology.orchestra.run.smithi006.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T21:20:46.687 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/381 2023-07-06T21:20:46.688 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/381 2023-07-06T21:20:46.688 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:46.690 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:46.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:46.714 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-07-06T21:20:46.941 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:46.945 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:46.946 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:46.947 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:46.947 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:47.284 INFO:teuthology.orchestra.run.smithi006.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T21:20:47.288 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/382 2023-07-06T21:20:47.288 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/382 2023-07-06T21:20:47.288 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:47.290 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:47.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:47.329 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-07-06T21:20:47.563 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:47.567 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:47.568 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:47.569 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:47.569 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:47.914 INFO:teuthology.orchestra.run.smithi006.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T21:20:47.918 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/383 2023-07-06T21:20:47.918 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/383 2023-07-06T21:20:47.918 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:47.920 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:47.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:47.951 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-07-06T21:20:48.172 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:48.176 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:48.177 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:48.178 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:48.178 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:48.523 INFO:teuthology.orchestra.run.smithi006.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T21:20:48.527 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/384 2023-07-06T21:20:48.528 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/384 2023-07-06T21:20:48.528 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:48.529 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:48.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:48.553 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-07-06T21:20:48.777 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:48.781 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:48.782 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:48.782 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:48.783 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:49.129 INFO:teuthology.orchestra.run.smithi006.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T21:20:49.133 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/385 2023-07-06T21:20:49.133 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/385 2023-07-06T21:20:49.134 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:49.135 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:49.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:49.162 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-07-06T21:20:49.394 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:49.398 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:49.398 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:49.399 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:49.399 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:49.736 INFO:teuthology.orchestra.run.smithi006.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T21:20:49.741 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/386 2023-07-06T21:20:49.741 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/386 2023-07-06T21:20:49.741 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:49.743 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:49.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:49.771 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-07-06T21:20:50.004 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:50.008 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:50.009 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:50.010 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:50.010 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:50.776 INFO:teuthology.orchestra.run.smithi006.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:20:50.779 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/387 2023-07-06T21:20:50.779 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/387 2023-07-06T21:20:50.779 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:50.791 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:50.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:50.996 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-07-06T21:20:51.238 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:51.242 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:51.243 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:51.244 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:51.244 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:51.635 INFO:teuthology.orchestra.run.smithi006.stdout:generic/388 [not run] require 172.21.15.6:6789:/scratch to be local device 2023-07-06T21:20:51.640 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/388 2023-07-06T21:20:51.640 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/388 2023-07-06T21:20:51.640 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:51.642 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:51.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:51.667 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-07-06T21:20:51.897 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:51.901 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:51.901 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:51.902 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:51.902 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:52.264 INFO:teuthology.orchestra.run.smithi006.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-07-06T21:20:52.268 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/389 2023-07-06T21:20:52.268 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/389 2023-07-06T21:20:52.268 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:52.270 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:52.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:52.298 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-07-06T21:20:52.536 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:52.541 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:52.541 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:52.542 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:52.542 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:52.890 INFO:teuthology.orchestra.run.smithi006.stdout:generic/390 [not run] ceph does not support freezing 2023-07-06T21:20:52.894 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/390 2023-07-06T21:20:52.895 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/390 2023-07-06T21:20:52.895 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:52.896 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:52.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:52.920 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-07-06T21:20:53.150 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:53.154 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:53.154 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:53.155 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:53.155 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:53.509 INFO:teuthology.orchestra.run.smithi006.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T21:20:53.513 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/391 2023-07-06T21:20:53.513 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/391 2023-07-06T21:20:53.514 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:53.515 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:53.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:53.546 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-07-06T21:20:53.768 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:53.772 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:53.773 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:53.774 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:53.774 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:54.299 INFO:teuthology.orchestra.run.smithi006.stdout:generic/392 [not run] ceph does not support shutdown 2023-07-06T21:20:54.324 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/392 2023-07-06T21:20:54.324 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/392 2023-07-06T21:20:54.324 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:54.326 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:54.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:54.351 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-07-06T21:20:54.585 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:54.590 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:54.590 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:54.591 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:54.591 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:55.739 INFO:teuthology.orchestra.run.smithi006.stdout:generic/393 1s 2023-07-06T21:20:55.744 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/393 2023-07-06T21:20:55.744 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:55.746 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:55.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:55.755 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-07-06T21:20:55.984 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:55.988 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:55.989 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:55.990 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:55.990 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:56.378 INFO:teuthology.orchestra.run.smithi006.stdout:generic/394 0s 2023-07-06T21:20:56.383 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/394 2023-07-06T21:20:56.383 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:56.385 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:56.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:56.513 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-07-06T21:20:57.107 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:57.114 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:57.114 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:57.118 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:57.119 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:58.004 INFO:teuthology.orchestra.run.smithi006.stdout:generic/395 [not run] kernel does not support ceph encryption 2023-07-06T21:20:58.031 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/395 2023-07-06T21:20:58.031 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/395 2023-07-06T21:20:58.031 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:58.032 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:58.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:58.059 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-07-06T21:20:58.464 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:58.471 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:58.472 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:58.474 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:58.475 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:59.064 INFO:teuthology.orchestra.run.smithi006.stdout:generic/396 [not run] kernel does not support ceph encryption 2023-07-06T21:20:59.084 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/396 2023-07-06T21:20:59.084 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/396 2023-07-06T21:20:59.085 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:59.086 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:59.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:20:59.111 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-07-06T21:20:59.347 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:20:59.347 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:20:59.347 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:20:59.348 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:20:59.348 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:20:59.948 INFO:teuthology.orchestra.run.smithi006.stdout:generic/397 [not run] kernel does not support ceph encryption 2023-07-06T21:20:59.975 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/397 2023-07-06T21:20:59.976 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/397 2023-07-06T21:20:59.976 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:20:59.978 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:00.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:00.006 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-07-06T21:21:00.233 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:00.237 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:00.237 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:00.238 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:00.239 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:00.817 INFO:teuthology.orchestra.run.smithi006.stdout:generic/398 [not run] kernel does not support ceph encryption 2023-07-06T21:21:00.839 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/398 2023-07-06T21:21:00.839 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/398 2023-07-06T21:21:00.839 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:00.841 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:00.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:00.867 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-07-06T21:21:01.095 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:01.099 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:01.099 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:01.100 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:01.100 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:01.665 INFO:teuthology.orchestra.run.smithi006.stdout:generic/399 [not run] kernel does not support ceph encryption 2023-07-06T21:21:01.694 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/399 2023-07-06T21:21:01.694 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/399 2023-07-06T21:21:01.695 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:01.696 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:01.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:01.722 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-07-06T21:21:01.947 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:01.951 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:01.951 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:01.952 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:01.952 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:02.290 INFO:teuthology.orchestra.run.smithi006.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T21:21:02.294 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/400 2023-07-06T21:21:02.294 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/400 2023-07-06T21:21:02.295 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:02.296 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:02.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:02.323 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-07-06T21:21:02.545 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:02.549 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:02.550 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:02.551 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:02.551 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:03.610 INFO:teuthology.orchestra.run.smithi006.stdout:generic/401 1s 2023-07-06T21:21:03.622 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/401 2023-07-06T21:21:03.623 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:03.625 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:03.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:03.634 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-07-06T21:21:03.872 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:03.876 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:03.877 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:03.878 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:03.878 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:04.448 INFO:teuthology.orchestra.run.smithi006.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-07-06T21:21:04.463 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/402 2023-07-06T21:21:04.463 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/402 2023-07-06T21:21:04.464 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:04.465 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:04.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:04.494 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-07-06T21:21:04.721 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:04.726 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:04.727 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:04.728 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:04.728 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:05.486 INFO:teuthology.orchestra.run.smithi006.stdout:generic/403 1s 2023-07-06T21:21:05.491 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/403 2023-07-06T21:21:05.491 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:05.493 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:05.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:05.502 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-07-06T21:21:05.729 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:05.733 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:05.734 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:05.735 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:05.735 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:06.095 INFO:teuthology.orchestra.run.smithi006.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T21:21:06.099 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/404 2023-07-06T21:21:06.099 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/404 2023-07-06T21:21:06.099 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:06.101 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:06.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:06.130 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-07-06T21:21:06.360 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:06.362 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:06.362 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:06.363 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:06.363 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:06.725 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:21:06.728 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:21:06.764 INFO:teuthology.orchestra.run.smithi006.stdout:generic/405 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T21:21:06.768 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/405 2023-07-06T21:21:06.769 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/405 2023-07-06T21:21:06.769 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:06.770 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:06.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:06.798 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-07-06T21:21:07.072 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:07.076 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:07.076 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:07.077 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:07.078 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:08.920 INFO:teuthology.orchestra.run.smithi006.stdout:generic/406 1s 2023-07-06T21:21:08.924 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/406 2023-07-06T21:21:08.925 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:08.927 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:08.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:08.936 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-07-06T21:21:09.168 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:09.172 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:09.173 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:09.174 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:09.174 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:09.566 INFO:teuthology.orchestra.run.smithi006.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:21:09.570 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/407 2023-07-06T21:21:09.570 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/407 2023-07-06T21:21:09.570 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:09.572 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:10.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:10.003 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-07-06T21:21:10.300 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:10.305 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:10.305 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:10.306 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:10.306 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:10.685 INFO:teuthology.orchestra.run.smithi006.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-06T21:21:10.689 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/408 2023-07-06T21:21:10.690 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/408 2023-07-06T21:21:10.690 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:10.691 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:11.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:11.049 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-07-06T21:21:11.334 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:11.338 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:11.338 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:11.339 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:11.339 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:11.687 INFO:teuthology.orchestra.run.smithi006.stdout:generic/409 [not run] require 172.21.15.6:6789:/scratch to be local device 2023-07-06T21:21:11.691 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/409 2023-07-06T21:21:11.691 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/409 2023-07-06T21:21:11.692 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:11.693 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:11.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:11.715 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-07-06T21:21:11.940 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:11.944 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:11.945 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:11.945 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:11.945 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:12.284 INFO:teuthology.orchestra.run.smithi006.stdout:generic/410 [not run] require 172.21.15.6:6789:/scratch to be local device 2023-07-06T21:21:12.288 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/410 2023-07-06T21:21:12.288 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/410 2023-07-06T21:21:12.288 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:12.290 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:12.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:12.329 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-07-06T21:21:12.555 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:12.559 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:12.560 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:12.561 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:12.561 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:12.920 INFO:teuthology.orchestra.run.smithi006.stdout:generic/411 [not run] require 172.21.15.6:6789:/scratch to be local device 2023-07-06T21:21:12.924 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/411 2023-07-06T21:21:12.924 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/411 2023-07-06T21:21:12.924 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:12.926 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:12.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:12.951 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-07-06T21:21:13.172 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:13.177 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:13.177 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:13.178 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:13.178 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:13.969 INFO:teuthology.orchestra.run.smithi006.stdout:generic/412 0s 2023-07-06T21:21:13.974 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/412 2023-07-06T21:21:13.975 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:13.976 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:13.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:13.985 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-07-06T21:21:14.209 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:14.213 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:14.214 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:14.214 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:14.215 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:14.723 INFO:teuthology.orchestra.run.smithi006.stdout:generic/413 [not run] mount 172.21.15.6:6789:/scratch with dax failed 2023-07-06T21:21:14.727 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/413 2023-07-06T21:21:14.728 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/413 2023-07-06T21:21:14.728 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:14.729 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:14.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:14.751 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-07-06T21:21:14.979 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:14.984 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:14.985 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:14.985 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:14.986 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:15.682 INFO:teuthology.orchestra.run.smithi006.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:21:15.778 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/414 2023-07-06T21:21:15.779 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/414 2023-07-06T21:21:15.779 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:15.844 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:15.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:15.972 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-07-06T21:21:16.196 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:16.202 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:16.202 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:16.203 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:16.203 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:17.021 INFO:teuthology.orchestra.run.smithi006.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:21:17.050 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/415 2023-07-06T21:21:17.050 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/415 2023-07-06T21:21:17.050 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:17.092 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:17.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:17.183 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-07-06T21:21:17.431 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:17.435 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:17.435 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:17.436 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:17.437 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:17.788 INFO:teuthology.orchestra.run.smithi006.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-06T21:21:17.792 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/416 2023-07-06T21:21:17.793 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/416 2023-07-06T21:21:17.793 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:17.794 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:17.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:17.823 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-07-06T21:21:18.049 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:18.053 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:18.053 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:18.054 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:18.054 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:18.566 INFO:teuthology.orchestra.run.smithi006.stdout:generic/417 [not run] ceph does not support shutdown 2023-07-06T21:21:18.591 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/417 2023-07-06T21:21:18.591 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/417 2023-07-06T21:21:18.591 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:18.593 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:18.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:18.616 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-07-06T21:21:18.841 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:18.846 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:18.847 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:18.848 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:18.848 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:19.224 INFO:teuthology.orchestra.run.smithi006.stdout:generic/418 [not run] require 172.21.15.6:6789:/test to be valid block disk 2023-07-06T21:21:19.229 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/418 2023-07-06T21:21:19.229 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/418 2023-07-06T21:21:19.229 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:19.231 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:19.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:19.268 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-07-06T21:21:19.493 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:19.498 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:19.498 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:19.499 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:19.499 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:20.053 INFO:teuthology.orchestra.run.smithi006.stdout:generic/419 [not run] kernel does not support ceph encryption 2023-07-06T21:21:20.073 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/419 2023-07-06T21:21:20.073 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/419 2023-07-06T21:21:20.074 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:20.075 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:20.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:20.096 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-07-06T21:21:20.318 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:20.322 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:20.323 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:20.324 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:20.324 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:20.806 INFO:teuthology.orchestra.run.smithi006.stdout:generic/420 0s 2023-07-06T21:21:20.808 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/420 2023-07-06T21:21:20.809 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:20.811 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:21.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:21.246 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-07-06T21:21:21.487 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:21.491 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:21.492 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:21.493 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:21.493 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:22.069 INFO:teuthology.orchestra.run.smithi006.stdout:generic/421 [not run] kernel does not support ceph encryption 2023-07-06T21:21:22.090 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/421 2023-07-06T21:21:22.090 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/421 2023-07-06T21:21:22.091 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:22.092 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:22.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:22.123 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-07-06T21:21:22.348 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:22.352 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:22.353 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:22.353 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:22.354 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:22.720 INFO:teuthology.orchestra.run.smithi006.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-06T21:21:22.724 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/422 2023-07-06T21:21:22.725 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/422 2023-07-06T21:21:22.725 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:22.727 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:22.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:22.756 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-07-06T21:21:22.980 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:22.984 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:22.984 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:22.985 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:22.985 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:23.427 INFO:teuthology.orchestra.run.smithi006.stdout:generic/423 0s 2023-07-06T21:21:23.432 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/423 2023-07-06T21:21:23.432 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:23.434 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:23.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:23.814 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-07-06T21:21:24.091 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:24.095 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:24.096 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:24.096 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:24.097 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:24.462 INFO:teuthology.orchestra.run.smithi006.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-07-06T21:21:24.467 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/424 2023-07-06T21:21:24.467 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/424 2023-07-06T21:21:24.467 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:24.469 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:24.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:24.505 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-07-06T21:21:24.727 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:24.731 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:24.732 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:24.732 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:24.733 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:25.126 INFO:teuthology.orchestra.run.smithi006.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-07-06T21:21:25.130 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/425 2023-07-06T21:21:25.131 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/425 2023-07-06T21:21:25.131 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:21:25.133 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:25.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:21:25.543 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-07-06T21:21:25.773 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:21:25.777 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:21:25.777 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:21:25.778 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:21:25.778 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:21:36.801 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:21:36.804 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:22:05.559 INFO:teuthology.orchestra.run.smithi006.stdout:generic/426 40s 2023-07-06T21:22:05.617 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/426 2023-07-06T21:22:05.618 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:22:05.620 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:22:06.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:22:06.114 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-07-06T21:22:06.870 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:22:06.873 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:22:07.134 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:22:07.138 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:22:07.139 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:22:07.139 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:22:07.140 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:22:07.603 INFO:teuthology.orchestra.run.smithi006.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-06T21:22:07.608 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/427 2023-07-06T21:22:07.608 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/427 2023-07-06T21:22:07.608 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:22:07.610 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:22:07.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:22:07.649 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-07-06T21:22:07.874 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:22:07.877 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:22:07.878 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:22:07.879 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:22:07.879 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:22:08.272 INFO:teuthology.orchestra.run.smithi006.stdout:generic/428 0s 2023-07-06T21:22:08.278 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/428 2023-07-06T21:22:08.278 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:22:08.280 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:22:08.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:22:08.313 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-07-06T21:22:08.550 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:22:08.550 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:22:08.550 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:22:08.551 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:22:08.551 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:22:09.119 INFO:teuthology.orchestra.run.smithi006.stdout:generic/429 [not run] kernel does not support ceph encryption 2023-07-06T21:22:09.139 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/429 2023-07-06T21:22:09.140 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/429 2023-07-06T21:22:09.140 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:22:09.141 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:22:09.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:22:09.170 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-07-06T21:22:09.403 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:22:09.408 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:22:09.408 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:22:09.409 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:22:09.409 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:22:09.864 INFO:teuthology.orchestra.run.smithi006.stdout:generic/430 0s 2023-07-06T21:22:09.872 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/430 2023-07-06T21:22:09.872 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:22:09.872 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:22:10.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:22:10.162 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-07-06T21:22:10.530 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:22:10.534 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:22:10.535 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:22:10.536 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:22:10.537 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:22:10.981 INFO:teuthology.orchestra.run.smithi006.stdout:generic/431 0s 2023-07-06T21:22:10.985 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/431 2023-07-06T21:22:10.986 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:22:10.988 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:22:11.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:22:11.424 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-07-06T21:22:11.654 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:22:11.658 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:22:11.659 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:22:11.659 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:22:11.660 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:22:12.091 INFO:teuthology.orchestra.run.smithi006.stdout:generic/432 1s 2023-07-06T21:22:12.095 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/432 2023-07-06T21:22:12.096 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:22:12.098 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:22:12.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:22:12.317 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-07-06T21:22:12.757 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:22:12.760 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:22:12.761 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:22:12.762 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:22:12.762 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:22:13.179 INFO:teuthology.orchestra.run.smithi006.stdout:generic/433 1s 2023-07-06T21:22:13.184 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/433 2023-07-06T21:22:13.185 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:22:13.186 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:22:13.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:22:13.274 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-07-06T21:22:13.842 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:22:13.846 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:22:13.847 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:22:13.847 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:22:13.848 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:22:14.271 INFO:teuthology.orchestra.run.smithi006.stdout:generic/434 0s 2023-07-06T21:22:14.276 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/434 2023-07-06T21:22:14.277 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:22:14.278 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:22:14.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:22:14.584 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-07-06T21:22:14.933 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:22:14.938 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:22:14.939 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:22:14.940 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:22:14.940 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:22:15.510 INFO:teuthology.orchestra.run.smithi006.stdout:generic/435 [not run] kernel does not support ceph encryption 2023-07-06T21:22:15.529 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/435 2023-07-06T21:22:15.530 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/435 2023-07-06T21:22:15.530 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:22:15.531 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:22:15.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:22:15.556 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-07-06T21:22:15.780 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:22:15.785 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:22:15.785 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:22:15.786 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:22:15.786 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:22:16.550 INFO:teuthology.orchestra.run.smithi006.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T21:22:16.556 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/436 2023-07-06T21:22:16.556 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/436 2023-07-06T21:22:16.557 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:22:16.557 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:22:16.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:22:16.977 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-07-06T21:22:17.203 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:22:17.207 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:22:17.208 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:22:17.209 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:22:17.209 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:22:18.230 INFO:teuthology.orchestra.run.smithi006.stdout:generic/437 1s 2023-07-06T21:22:18.234 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/437 2023-07-06T21:22:18.235 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:22:18.237 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:22:18.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:22:18.266 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-07-06T21:22:18.490 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:22:18.495 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:22:18.496 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:22:18.496 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:22:18.496 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:22:37.086 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:22:37.088 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:22:37.126 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-07-06T21:22:37.124+0000 7f3a28953700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 116426) UID: 0 2023-07-06T21:22:37.127 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-07-06T21:22:37.124+0000 7f627fdc9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 116426) UID: 0 2023-07-06T21:23:23.194 INFO:teuthology.orchestra.run.smithi006.stdout:generic/438 65s 2023-07-06T21:23:23.199 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/438 2023-07-06T21:23:23.200 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:23:23.201 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:23:23.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:23:23.230 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-07-06T21:23:23.463 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:23:23.468 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:23:23.468 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:23:23.469 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:23:23.469 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:23:24.623 INFO:teuthology.orchestra.run.smithi006.stdout:generic/439 1s 2023-07-06T21:23:24.628 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/439 2023-07-06T21:23:24.629 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:23:24.630 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:23:24.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:23:24.660 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-07-06T21:23:24.882 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:23:24.886 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:23:24.887 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:23:24.887 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:23:24.888 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:23:25.443 INFO:teuthology.orchestra.run.smithi006.stdout:generic/440 [not run] kernel does not support ceph encryption 2023-07-06T21:23:25.467 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/440 2023-07-06T21:23:25.468 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/440 2023-07-06T21:23:25.468 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:23:25.469 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:23:25.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:23:25.494 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-07-06T21:23:25.714 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:23:25.719 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:23:25.719 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:23:25.720 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:23:25.720 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:23:26.148 INFO:teuthology.orchestra.run.smithi006.stdout:generic/441 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T21:23:26.152 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/441 2023-07-06T21:23:26.153 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/441 2023-07-06T21:23:26.153 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:23:26.154 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:23:26.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:23:26.185 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-07-06T21:23:26.415 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:23:26.419 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:23:26.420 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:23:26.421 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:23:26.421 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:23:26.771 INFO:teuthology.orchestra.run.smithi006.stdout:generic/442 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T21:23:26.776 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/442 2023-07-06T21:23:26.776 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/442 2023-07-06T21:23:26.776 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:23:26.778 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:23:26.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:23:26.802 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-07-06T21:23:27.021 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:23:27.025 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:23:27.025 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:23:27.026 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:23:27.026 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:23:27.403 INFO:teuthology.orchestra.run.smithi006.stdout:generic/443 0s 2023-07-06T21:23:27.408 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/443 2023-07-06T21:23:27.409 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:23:27.410 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:23:27.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:23:27.439 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-07-06T21:23:27.658 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:23:27.662 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:23:27.662 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:23:27.663 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:23:27.663 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:23:28.077 INFO:teuthology.orchestra.run.smithi006.stdout:generic/444 1s 2023-07-06T21:23:28.085 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/444 2023-07-06T21:23:28.085 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:23:28.086 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:23:28.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:23:28.129 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-07-06T21:23:28.353 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:23:28.358 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:23:28.358 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:23:28.359 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:23:28.359 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:23:29.080 INFO:teuthology.orchestra.run.smithi006.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T21:23:29.084 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/445 2023-07-06T21:23:29.084 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/445 2023-07-06T21:23:29.084 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:23:29.086 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:23:29.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:23:29.408 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-07-06T21:23:29.709 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:23:29.713 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:23:29.714 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:23:29.715 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:23:29.715 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:23:54.574 INFO:teuthology.orchestra.run.smithi006.stdout:generic/446 25s 2023-07-06T21:23:54.580 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/446 2023-07-06T21:23:54.581 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:23:54.583 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:23:54.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:23:54.592 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-07-06T21:23:54.813 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:23:54.817 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:23:54.817 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:23:54.818 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:23:54.818 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:23:55.691 INFO:teuthology.orchestra.run.smithi006.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:23:55.698 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/447 2023-07-06T21:23:55.699 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/447 2023-07-06T21:23:55.699 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:23:55.710 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:23:55.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:23:55.803 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-07-06T21:23:56.026 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:23:56.030 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:23:56.031 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:23:56.032 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:23:56.032 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:23:57.238 INFO:teuthology.orchestra.run.smithi006.stdout:generic/448 1s 2023-07-06T21:23:57.243 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/448 2023-07-06T21:23:57.244 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:23:57.245 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:23:57.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:23:57.631 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-07-06T21:23:57.904 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:23:57.908 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:23:57.908 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:23:57.909 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:23:57.910 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:23:58.290 INFO:teuthology.orchestra.run.smithi006.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-06T21:23:58.294 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/449 2023-07-06T21:23:58.294 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/449 2023-07-06T21:23:58.294 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:23:58.296 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:23:58.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:23:58.722 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-07-06T21:23:58.954 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:23:58.958 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:23:58.959 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:23:58.960 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:23:58.960 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:23:59.773 INFO:teuthology.orchestra.run.smithi006.stdout:generic/450 0s 2023-07-06T21:23:59.778 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/450 2023-07-06T21:23:59.779 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:23:59.780 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:00.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:24:00.121 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-07-06T21:24:00.403 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:24:00.407 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:24:00.408 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:24:00.408 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:24:00.409 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:30.878 INFO:teuthology.orchestra.run.smithi006.stdout:generic/451 30s 2023-07-06T21:24:30.883 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/451 2023-07-06T21:24:30.883 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:24:30.885 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:31.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:24:31.234 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-07-06T21:24:31.523 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:24:31.528 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:24:31.529 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:24:31.530 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:24:31.530 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:32.140 INFO:teuthology.orchestra.run.smithi006.stdout:generic/452 1s 2023-07-06T21:24:32.145 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/452 2023-07-06T21:24:32.145 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:24:32.147 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:32.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:24:32.156 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-07-06T21:24:32.384 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:24:32.388 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:24:32.389 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:24:32.390 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:24:32.390 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:32.735 INFO:teuthology.orchestra.run.smithi006.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-07-06T21:24:32.739 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/453 2023-07-06T21:24:32.739 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/453 2023-07-06T21:24:32.740 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:24:32.741 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:32.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:24:32.765 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-07-06T21:24:32.984 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:24:32.989 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:24:32.989 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:24:32.990 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:24:32.990 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:33.343 INFO:teuthology.orchestra.run.smithi006.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-07-06T21:24:33.347 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/454 2023-07-06T21:24:33.347 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/454 2023-07-06T21:24:33.347 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:24:33.349 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:33.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:24:33.386 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-07-06T21:24:33.610 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:24:33.614 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:24:33.615 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:24:33.615 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:24:33.615 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:34.023 INFO:teuthology.orchestra.run.smithi006.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2023-07-06T21:24:34.027 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/455 2023-07-06T21:24:34.027 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/455 2023-07-06T21:24:34.027 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:24:34.029 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:34.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:24:34.049 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-07-06T21:24:34.271 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:24:34.275 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:24:34.275 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:24:34.276 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:24:34.276 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:34.653 INFO:teuthology.orchestra.run.smithi006.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T21:24:34.657 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/456 2023-07-06T21:24:34.657 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/456 2023-07-06T21:24:34.658 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:24:34.659 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:34.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:24:34.687 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-07-06T21:24:34.909 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:24:34.913 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:24:34.914 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:24:34.915 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:24:34.916 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:36.068 INFO:teuthology.orchestra.run.smithi006.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:24:36.086 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/457 2023-07-06T21:24:36.086 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/457 2023-07-06T21:24:36.087 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:24:36.090 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:36.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:24:36.142 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-07-06T21:24:36.365 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:24:36.369 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:24:36.369 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:24:36.370 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:24:36.371 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:37.179 INFO:teuthology.orchestra.run.smithi006.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T21:24:37.281 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/458 2023-07-06T21:24:37.281 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/458 2023-07-06T21:24:37.281 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:24:37.299 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:37.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:24:37.343 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-07-06T21:24:37.565 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:24:37.569 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:24:37.570 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:24:37.571 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:24:37.571 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:38.121 INFO:teuthology.orchestra.run.smithi006.stdout:generic/459 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T21:24:38.125 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/459 2023-07-06T21:24:38.125 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/459 2023-07-06T21:24:38.126 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:24:38.127 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:38.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:24:38.152 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-07-06T21:24:38.380 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:24:38.384 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:24:38.385 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:24:38.386 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:24:38.386 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:40.323 INFO:teuthology.orchestra.run.smithi006.stdout:generic/460 2s 2023-07-06T21:24:40.328 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/460 2023-07-06T21:24:40.328 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:24:40.330 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:40.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:24:40.339 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-07-06T21:24:40.596 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:24:40.600 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:24:40.601 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:24:40.602 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:24:40.602 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:41.150 INFO:teuthology.orchestra.run.smithi006.stdout:generic/461 [not run] ceph does not support shutdown 2023-07-06T21:24:41.154 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/461 2023-07-06T21:24:41.154 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/461 2023-07-06T21:24:41.154 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:24:41.156 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:41.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:24:41.180 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-07-06T21:24:41.406 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:24:41.411 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:24:41.411 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:24:41.412 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:24:41.412 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:42.094 INFO:teuthology.orchestra.run.smithi006.stdout:generic/462 [not run] mount 172.21.15.6:6789:/scratch with dax failed 2023-07-06T21:24:42.098 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/462 2023-07-06T21:24:42.098 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/462 2023-07-06T21:24:42.098 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:24:42.100 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:42.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:24:42.122 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-07-06T21:24:42.345 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:24:42.349 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:24:42.350 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:24:42.351 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:24:42.351 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:42.728 INFO:teuthology.orchestra.run.smithi006.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-07-06T21:24:42.733 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/463 2023-07-06T21:24:42.734 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/463 2023-07-06T21:24:42.734 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:24:42.735 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:24:43.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:24:43.150 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-07-06T21:24:43.380 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:24:43.384 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:24:43.384 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:24:43.385 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:24:43.385 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:25:10.607 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:25:10.615 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:25:40.591 INFO:teuthology.orchestra.run.smithi006.stdout:generic/464 57s 2023-07-06T21:25:40.596 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/464 2023-07-06T21:25:40.597 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:25:40.598 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:25:40.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:25:40.607 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-07-06T21:25:40.830 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:25:40.835 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:25:40.835 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:25:40.836 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:25:40.836 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:25:40.924 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:25:40.928 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:25:45.516 INFO:teuthology.orchestra.run.smithi006.stdout:generic/465 4s 2023-07-06T21:25:45.527 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/465 2023-07-06T21:25:45.527 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:25:45.528 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:25:45.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:25:45.537 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-07-06T21:25:45.763 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:25:45.767 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:25:45.768 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:25:45.768 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:25:45.768 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:25:46.367 INFO:teuthology.orchestra.run.smithi006.stdout:generic/466 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T21:25:46.372 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/466 2023-07-06T21:25:46.372 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/466 2023-07-06T21:25:46.372 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:25:46.374 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:25:46.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:25:46.408 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-07-06T21:25:46.628 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:25:46.638 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:25:46.638 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:25:46.638 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:25:46.638 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:26:10.987 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:26:11.015 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:26:41.577 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:26:41.603 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:26:44.733 INFO:teuthology.orchestra.run.smithi006.stdout:generic/467 58s 2023-07-06T21:26:44.808 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/467 2023-07-06T21:26:44.809 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:26:44.817 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:26:45.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:26:45.288 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-07-06T21:26:46.274 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:26:46.278 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:26:46.279 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:26:46.279 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:26:46.280 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:26:46.948 INFO:teuthology.orchestra.run.smithi006.stdout:generic/468 [not run] ceph does not support shutdown 2023-07-06T21:26:46.968 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/468 2023-07-06T21:26:46.969 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/468 2023-07-06T21:26:46.969 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:26:46.970 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:26:47.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:26:47.003 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-07-06T21:26:47.225 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:26:47.229 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:26:47.229 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:26:47.230 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:26:47.231 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:26:47.581 INFO:teuthology.orchestra.run.smithi006.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-06T21:26:47.585 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/469 2023-07-06T21:26:47.585 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/469 2023-07-06T21:26:47.586 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:26:47.587 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:26:47.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:26:47.618 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-07-06T21:26:47.840 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:26:47.844 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:26:47.845 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:26:47.846 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:26:47.846 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:26:48.246 INFO:teuthology.orchestra.run.smithi006.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-07-06T21:26:48.250 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/470 2023-07-06T21:26:48.251 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/470 2023-07-06T21:26:48.251 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:26:48.253 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:26:48.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:26:48.281 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-07-06T21:26:48.501 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:26:48.506 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:26:48.506 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:26:48.507 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:26:48.507 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:26:48.921 INFO:teuthology.orchestra.run.smithi006.stdout:generic/471 [not run] xfs_io pwrite -V 1 -b 4k -N failed (old kernel/wrong fs?) 2023-07-06T21:26:48.925 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/471 2023-07-06T21:26:48.925 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/471 2023-07-06T21:26:48.925 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:26:48.927 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:26:49.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:26:49.308 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-07-06T21:26:49.564 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:26:49.568 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:26:49.569 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:26:49.569 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:26:49.569 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:26:50.183 INFO:teuthology.orchestra.run.smithi006.stdout:generic/472 [not run] swapfiles are not supported 2023-07-06T21:26:50.187 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/472 2023-07-06T21:26:50.188 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/472 2023-07-06T21:26:50.188 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:26:50.189 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:26:50.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:26:50.217 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-07-06T21:26:50.436 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:26:50.441 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:26:50.441 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:26:50.442 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:26:50.442 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:26:50.858 INFO:teuthology.orchestra.run.smithi006.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-06T21:26:50.862 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/473 2023-07-06T21:26:50.862 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/473 2023-07-06T21:26:50.863 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:26:50.864 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:26:50.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:26:50.898 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-07-06T21:26:51.124 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:26:51.129 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:26:51.129 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:26:51.130 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:26:51.130 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:26:51.661 INFO:teuthology.orchestra.run.smithi006.stdout:generic/474 [not run] ceph does not support shutdown 2023-07-06T21:26:51.692 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/474 2023-07-06T21:26:51.692 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/474 2023-07-06T21:26:51.692 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:26:51.693 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:26:51.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:26:51.719 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-07-06T21:26:51.942 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:26:51.946 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:26:51.946 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:26:51.947 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:26:51.947 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:26:52.335 INFO:teuthology.orchestra.run.smithi006.stdout:generic/475 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T21:26:52.339 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/475 2023-07-06T21:26:52.339 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/475 2023-07-06T21:26:52.339 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T21:26:52.341 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:26:52.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T21:26:52.374 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-07-06T21:26:52.601 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T21:26:52.606 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T21:26:52.606 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T21:26:52.607 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T21:26:52.607 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T21:27:12.256 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:27:12.290 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:27:42.741 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:27:42.856 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:27:43.280 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T21:27:43.277+0000 7fec49f76700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 624374) UID: 0 2023-07-06T21:27:43.284 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-06T21:27:43.282+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 624374) UID: 0 2023-07-06T21:27:43.285 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-06T21:27:43.282+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 624374) UID: 0 2023-07-06T21:27:43.286 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-06T21:27:43.284+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 624374) UID: 0 2023-07-06T21:32:03.413 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:32:03.424 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:32:03.661 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-06T21:32:03.658+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 624455) UID: 0 2023-07-06T21:32:03.661 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-06T21:32:03.658+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 624455) UID: 0 2023-07-06T21:32:03.661 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-06T21:32:03.658+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 624455) UID: 0 2023-07-06T21:32:03.662 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T21:32:03.658+0000 7fec49f76700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 624455) UID: 0 2023-07-06T21:36:34.211 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:36:34.213 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:36:34.281 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-06T21:36:34.279+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117232) UID: 0 2023-07-06T21:36:34.281 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-06T21:36:34.279+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117232) UID: 0 2023-07-06T21:36:34.282 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-06T21:36:34.279+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117232) UID: 0 2023-07-06T21:36:34.282 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-06T21:36:34.279+0000 7ff734335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117232) UID: 0 2023-07-06T21:41:33.497 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:41:33.507 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:41:33.595 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-06T21:41:33.593+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117309) UID: 0 2023-07-06T21:41:33.596 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-06T21:41:33.593+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117309) UID: 0 2023-07-06T21:41:33.596 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-06T21:41:33.593+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117309) UID: 0 2023-07-06T21:41:33.597 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-06T21:41:33.593+0000 7ff734335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117309) UID: 0 2023-07-06T21:46:03.778 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:46:03.798 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T21:46:04.203 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-07-06T21:46:04.201+0000 7f3a28953700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 117371) UID: 0 2023-07-06T21:46:04.216 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-07-06T21:46:04.206+0000 7f627fdc9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 117371) UID: 0 2023-07-06T21:50:59.270 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-06T21:50:59.267+0000 7ff734335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117435) UID: 0 2023-07-06T21:50:59.271 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-06T21:50:59.267+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117435) UID: 0 2023-07-06T21:50:59.271 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-06T21:50:59.269+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117435) UID: 0 2023-07-06T21:50:59.279 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-06T21:50:59.264+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117435) UID: 0 2023-07-06T22:00:25.323 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:00:25.381 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:00:25.634 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-07-06T22:00:25.630+0000 7f3a28953700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 117558) UID: 0 2023-07-06T22:00:25.635 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-07-06T22:00:25.630+0000 7f627fdc9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 117558) UID: 0 2023-07-06T22:00:26.631 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T22:00:26.625+0000 7fec49f76700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 624935) UID: 0 2023-07-06T22:00:26.638 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-06T22:00:26.630+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 624935) UID: 0 2023-07-06T22:00:26.639 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-06T22:00:26.626+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 624935) UID: 0 2023-07-06T22:00:26.639 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-06T22:00:26.630+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 624935) UID: 0 2023-07-06T22:18:50.273 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:18:50.320 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:18:50.491 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-07-06T22:18:50.488+0000 7f3a28953700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 117801) UID: 0 2023-07-06T22:18:50.492 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-07-06T22:18:50.488+0000 7f627fdc9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 117801) UID: 0 2023-07-06T22:24:30.088 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-06T22:24:30.084+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117870) UID: 0 2023-07-06T22:24:30.089 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-06T22:24:30.084+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117870) UID: 0 2023-07-06T22:24:30.090 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-06T22:24:30.080+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117870) UID: 0 2023-07-06T22:24:30.090 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-06T22:24:30.084+0000 7ff734335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 117870) UID: 0 2023-07-06T22:27:20.275 INFO:teuthology.orchestra.run.smithi006.stdout:generic/476 3628s 2023-07-06T22:27:20.295 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/476 2023-07-06T22:27:20.295 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:27:20.298 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:27:20.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:27:20.309 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-07-06T22:27:34.856 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:27:34.860 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:27:34.860 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:27:34.861 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:27:34.861 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:38:23.700 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:38:23.704 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:38:23.782 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-07-06T22:38:23.780+0000 7f627fdc9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 118023) UID: 0 2023-07-06T22:38:23.784 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-07-06T22:38:23.780+0000 7f3a28953700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 118023) UID: 0 2023-07-06T22:38:25.351 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-06T22:38:25.350+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 625931) UID: 0 2023-07-06T22:38:25.352 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-06T22:38:25.350+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 625931) UID: 0 2023-07-06T22:38:25.353 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T22:38:25.352+0000 7fec49f76700 -1 Fail to open '/proc/625931/cmdline' error = (2) No such file or directory 2023-07-06T22:38:25.353 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T22:38:25.352+0000 7fec49f76700 -1 received signal: Hangup from (PID: 625931) UID: 0 2023-07-06T22:38:25.353 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-06T22:38:25.352+0000 7fad36019700 -1 Fail to open '/proc/625931/cmdline' error = (2) No such file or directory 2023-07-06T22:38:25.353 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-06T22:38:25.352+0000 7fad36019700 -1 received signal: Hangup from (PID: 625931) UID: 0 2023-07-06T22:38:32.422 INFO:teuthology.orchestra.run.smithi006.stdout:generic/477 29s 2023-07-06T22:38:32.596 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/477 2023-07-06T22:38:32.596 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:38:32.617 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:38:32.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:38:32.893 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-07-06T22:38:35.856 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:38:35.865 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:38:35.865 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:38:35.866 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:38:35.866 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:04.619 INFO:teuthology.orchestra.run.smithi006.stdout:generic/478 28s 2023-07-06T22:39:04.626 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/478 2023-07-06T22:39:04.626 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:04.634 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:04.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:04.697 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-07-06T22:39:05.249 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:05.261 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:05.261 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:05.264 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:05.264 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:06.170 INFO:teuthology.orchestra.run.smithi006.stdout:generic/479 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T22:39:06.175 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/479 2023-07-06T22:39:06.175 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/479 2023-07-06T22:39:06.175 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:06.178 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:06.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:06.237 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-07-06T22:39:06.700 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:06.707 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:06.720 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:06.722 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:06.722 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:07.445 INFO:teuthology.orchestra.run.smithi006.stdout:generic/480 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T22:39:07.453 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/480 2023-07-06T22:39:07.453 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/480 2023-07-06T22:39:07.453 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:07.456 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:07.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:07.520 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-07-06T22:39:08.035 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:08.040 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:08.041 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:08.047 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:08.047 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:08.723 INFO:teuthology.orchestra.run.smithi006.stdout:generic/481 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T22:39:08.729 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/481 2023-07-06T22:39:08.730 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/481 2023-07-06T22:39:08.730 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:08.738 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:08.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:08.778 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-07-06T22:39:09.316 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:09.321 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:09.321 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:09.323 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:09.323 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:10.081 INFO:teuthology.orchestra.run.smithi006.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2023-07-06T22:39:10.103 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/482 2023-07-06T22:39:10.103 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/482 2023-07-06T22:39:10.103 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:10.108 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:10.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:10.150 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-07-06T22:39:10.669 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:10.680 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:10.681 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:10.682 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:10.682 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:11.287 INFO:teuthology.orchestra.run.smithi006.stdout:generic/483 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T22:39:11.299 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/483 2023-07-06T22:39:11.299 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/483 2023-07-06T22:39:11.299 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:11.302 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:11.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:11.338 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-07-06T22:39:11.817 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:11.827 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:11.828 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:11.838 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:11.838 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:12.518 INFO:teuthology.orchestra.run.smithi006.stdout:generic/484 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T22:39:12.524 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/484 2023-07-06T22:39:12.524 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/484 2023-07-06T22:39:12.524 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:12.527 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:12.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:12.561 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-07-06T22:39:13.087 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:13.093 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:13.097 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:13.100 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:13.100 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:13.726 INFO:teuthology.orchestra.run.smithi006.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-06T22:39:13.731 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/485 2023-07-06T22:39:13.731 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/485 2023-07-06T22:39:13.732 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:13.735 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:13.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:13.793 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-07-06T22:39:14.357 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:14.362 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:14.363 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:14.364 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:14.364 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:15.512 INFO:teuthology.orchestra.run.smithi006.stdout:generic/486 1s 2023-07-06T22:39:15.537 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/486 2023-07-06T22:39:15.538 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:15.548 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:15.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:15.569 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-07-06T22:39:16.055 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:16.061 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:16.061 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:16.062 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:16.062 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:16.731 INFO:teuthology.orchestra.run.smithi006.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2023-07-06T22:39:16.740 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/487 2023-07-06T22:39:16.740 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/487 2023-07-06T22:39:16.740 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:16.743 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:16.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:16.782 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-07-06T22:39:17.302 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:17.307 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:17.308 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:17.310 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:17.310 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:17.975 INFO:teuthology.orchestra.run.smithi006.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-06T22:39:17.980 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/488 2023-07-06T22:39:17.980 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/488 2023-07-06T22:39:17.981 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:17.983 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:18.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:18.053 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-07-06T22:39:18.569 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:18.589 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:18.590 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:18.594 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:18.595 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:19.225 INFO:teuthology.orchestra.run.smithi006.stdout:generic/489 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T22:39:19.232 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/489 2023-07-06T22:39:19.232 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/489 2023-07-06T22:39:19.232 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:19.234 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:19.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:19.273 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-07-06T22:39:19.731 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:19.742 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:19.743 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:19.746 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:19.747 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:22.588 INFO:teuthology.orchestra.run.smithi006.stdout:generic/490 2s 2023-07-06T22:39:22.603 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/490 2023-07-06T22:39:22.603 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:22.605 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:22.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:22.822 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-07-06T22:39:23.603 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:23.608 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:23.608 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:23.609 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:23.609 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:24.341 INFO:teuthology.orchestra.run.smithi006.stdout:generic/491 [not run] ceph does not support freezing 2023-07-06T22:39:24.348 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/491 2023-07-06T22:39:24.348 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/491 2023-07-06T22:39:24.348 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:24.350 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:24.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:24.386 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-07-06T22:39:24.857 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:24.872 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:24.873 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:24.874 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:24.874 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:25.436 INFO:teuthology.orchestra.run.smithi006.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2023-07-06T22:39:25.453 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/492 2023-07-06T22:39:25.453 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/492 2023-07-06T22:39:25.453 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:25.459 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:25.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:25.497 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-07-06T22:39:25.968 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:25.973 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:25.974 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:25.983 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:25.984 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:27.204 INFO:teuthology.orchestra.run.smithi006.stdout:generic/493 [not run] swapfiles are not supported 2023-07-06T22:39:27.209 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/493 2023-07-06T22:39:27.210 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/493 2023-07-06T22:39:27.210 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:27.213 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:27.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:27.258 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-07-06T22:39:27.755 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:27.759 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:27.759 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:27.761 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:27.761 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:28.833 INFO:teuthology.orchestra.run.smithi006.stdout:generic/494 [not run] swapfiles are not supported 2023-07-06T22:39:28.840 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/494 2023-07-06T22:39:28.841 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/494 2023-07-06T22:39:28.841 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:28.843 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:28.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:28.899 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-07-06T22:39:29.445 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:29.473 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:29.474 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:29.475 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:29.475 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:30.555 INFO:teuthology.orchestra.run.smithi006.stdout:generic/495 [not run] swapfiles are not supported 2023-07-06T22:39:30.575 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/495 2023-07-06T22:39:30.575 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/495 2023-07-06T22:39:30.575 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:30.577 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:30.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:30.623 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-07-06T22:39:31.104 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:31.109 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:31.110 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:31.111 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:31.111 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:32.175 INFO:teuthology.orchestra.run.smithi006.stdout:generic/496 [not run] swapfiles are not supported 2023-07-06T22:39:32.188 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/496 2023-07-06T22:39:32.188 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/496 2023-07-06T22:39:32.188 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:32.191 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:32.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:32.228 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-07-06T22:39:32.658 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:32.670 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:32.675 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:32.676 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:32.676 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:33.770 INFO:teuthology.orchestra.run.smithi006.stdout:generic/497 [not run] swapfiles are not supported 2023-07-06T22:39:33.783 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/497 2023-07-06T22:39:33.783 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/497 2023-07-06T22:39:33.783 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:33.793 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:33.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:33.843 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-07-06T22:39:34.313 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:34.325 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:34.326 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:34.333 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:34.333 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:35.126 INFO:teuthology.orchestra.run.smithi006.stdout:generic/498 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T22:39:35.135 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/498 2023-07-06T22:39:35.135 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/498 2023-07-06T22:39:35.135 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:35.137 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:35.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:35.225 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-07-06T22:39:35.684 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:35.699 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:35.699 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:35.701 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:35.701 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:36.436 INFO:teuthology.orchestra.run.smithi006.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-06T22:39:36.441 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/499 2023-07-06T22:39:36.441 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/499 2023-07-06T22:39:36.441 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:36.447 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:36.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:36.497 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-07-06T22:39:36.905 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:36.910 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:36.910 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:36.912 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:36.912 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:37.743 INFO:teuthology.orchestra.run.smithi006.stdout:generic/500 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T22:39:37.752 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/500 2023-07-06T22:39:37.752 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/500 2023-07-06T22:39:37.752 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:37.756 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:37.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:37.805 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-07-06T22:39:38.335 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:38.341 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:38.342 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:38.343 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:38.343 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:39.872 INFO:teuthology.orchestra.run.smithi006.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T22:39:39.882 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/501 2023-07-06T22:39:39.882 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/501 2023-07-06T22:39:39.883 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:39.887 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:39.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:39.988 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-07-06T22:39:40.392 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:40.396 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:40.396 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:40.397 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:40.397 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:41.116 INFO:teuthology.orchestra.run.smithi006.stdout:generic/502 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T22:39:41.138 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/502 2023-07-06T22:39:41.138 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/502 2023-07-06T22:39:41.138 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:41.148 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:41.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:41.191 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-07-06T22:39:41.692 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:41.705 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:41.706 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:41.707 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:41.707 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:42.462 INFO:teuthology.orchestra.run.smithi006.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T22:39:42.478 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/503 2023-07-06T22:39:42.478 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/503 2023-07-06T22:39:42.478 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:42.480 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:42.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:42.541 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-07-06T22:39:43.069 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:43.080 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:43.080 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:43.082 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:43.082 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:43.729 INFO:teuthology.orchestra.run.smithi006.stdout:generic/504 0s 2023-07-06T22:39:43.738 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/504 2023-07-06T22:39:43.738 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:43.740 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:43.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:43.801 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-07-06T22:39:44.309 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:44.313 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:44.313 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:44.315 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:44.315 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:45.218 INFO:teuthology.orchestra.run.smithi006.stdout:generic/505 [not run] ceph does not support shutdown 2023-07-06T22:39:45.244 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/505 2023-07-06T22:39:45.244 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/505 2023-07-06T22:39:45.244 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:45.246 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:45.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:45.292 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-07-06T22:39:45.707 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:45.713 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:45.722 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:45.723 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:45.723 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:46.377 INFO:teuthology.orchestra.run.smithi006.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-06T22:39:46.382 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/506 2023-07-06T22:39:46.383 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/506 2023-07-06T22:39:46.383 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:46.386 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:46.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:46.421 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-07-06T22:39:46.870 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:46.875 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:46.875 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:46.876 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:46.876 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:47.571 INFO:teuthology.orchestra.run.smithi006.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-07-06T22:39:47.577 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/507 2023-07-06T22:39:47.577 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/507 2023-07-06T22:39:47.577 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:47.580 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:47.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:47.642 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-07-06T22:39:48.104 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:48.110 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:48.111 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:48.112 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:48.112 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:48.708 INFO:teuthology.orchestra.run.smithi006.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2023-07-06T22:39:48.714 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/508 2023-07-06T22:39:48.714 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/508 2023-07-06T22:39:48.714 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:48.716 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:48.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:48.757 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-07-06T22:39:49.270 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:49.280 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:49.280 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:49.281 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:49.281 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:50.012 INFO:teuthology.orchestra.run.smithi006.stdout:generic/509 [not run] O_TMPFILE is not supported 2023-07-06T22:39:50.020 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/509 2023-07-06T22:39:50.020 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/509 2023-07-06T22:39:50.020 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:50.023 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:50.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:50.057 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-07-06T22:39:50.510 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:50.521 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:50.522 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:50.523 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:50.524 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:51.121 INFO:teuthology.orchestra.run.smithi006.stdout:generic/510 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T22:39:51.131 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/510 2023-07-06T22:39:51.131 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/510 2023-07-06T22:39:51.132 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:51.143 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:51.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:51.181 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-07-06T22:39:51.675 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:51.687 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:51.690 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:51.694 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:51.694 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:52.300 INFO:teuthology.orchestra.run.smithi006.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-07-06T22:39:52.308 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/511 2023-07-06T22:39:52.308 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/511 2023-07-06T22:39:52.308 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:52.311 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:52.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:52.361 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-07-06T22:39:52.926 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:52.945 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:52.945 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:52.946 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:52.947 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:53.667 INFO:teuthology.orchestra.run.smithi006.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-06T22:39:53.682 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/512 2023-07-06T22:39:53.682 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/512 2023-07-06T22:39:53.682 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:53.684 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:53.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:53.724 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-07-06T22:39:54.181 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:54.190 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:54.193 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:54.195 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:54.196 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:55.601 INFO:teuthology.orchestra.run.smithi006.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T22:39:55.698 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/513 2023-07-06T22:39:55.699 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/513 2023-07-06T22:39:55.699 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:55.723 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:55.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:55.799 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-07-06T22:39:56.291 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:56.304 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:56.305 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:56.306 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:56.306 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:57.751 INFO:teuthology.orchestra.run.smithi006.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T22:39:57.783 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/514 2023-07-06T22:39:57.784 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/514 2023-07-06T22:39:57.784 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:57.799 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:57.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:57.838 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-07-06T22:39:58.343 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:39:58.348 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:39:58.348 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:39:58.349 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:39:58.350 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:59.799 INFO:teuthology.orchestra.run.smithi006.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T22:39:59.839 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/515 2023-07-06T22:39:59.840 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/515 2023-07-06T22:39:59.840 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:39:59.843 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:39:59.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:39:59.888 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-07-06T22:40:00.348 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:40:00.354 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:40:00.354 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:40:00.359 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:40:00.359 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:40:01.081 INFO:teuthology.orchestra.run.smithi006.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2023-07-06T22:40:01.085 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/516 2023-07-06T22:40:01.086 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/516 2023-07-06T22:40:01.086 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:40:01.096 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:40:01.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:40:01.613 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-07-06T22:40:02.154 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:40:02.183 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:40:02.183 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:40:02.187 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:40:02.188 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:40:03.210 INFO:teuthology.orchestra.run.smithi006.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-07-06T22:40:03.345 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/517 2023-07-06T22:40:03.345 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/517 2023-07-06T22:40:03.345 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:40:03.566 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:40:03.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:40:03.755 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-07-06T22:40:04.212 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:40:04.227 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:40:04.230 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:40:04.232 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:40:04.232 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:40:05.540 INFO:teuthology.orchestra.run.smithi006.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-06T22:40:05.650 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/518 2023-07-06T22:40:05.651 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/518 2023-07-06T22:40:05.651 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:40:05.667 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:40:05.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:40:05.737 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-07-06T22:40:06.243 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:40:06.256 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:40:06.256 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:40:06.257 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:40:06.258 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:40:06.931 INFO:teuthology.orchestra.run.smithi006.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2023-07-06T22:40:06.936 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/519 2023-07-06T22:40:06.936 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/519 2023-07-06T22:40:06.937 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:40:06.938 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:40:07.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:40:07.425 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-07-06T22:40:07.966 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:40:07.972 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:40:07.972 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:40:07.973 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:40:07.974 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:40:08.578 INFO:teuthology.orchestra.run.smithi006.stdout:generic/520 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-06T22:40:08.583 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/520 2023-07-06T22:40:08.584 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/520 2023-07-06T22:40:08.584 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-06T22:40:08.587 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:40:08.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-06T22:40:08.613 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-07-06T22:40:09.124 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-06T22:40:09.135 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-06T22:40:09.135 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-06T22:40:09.137 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-06T22:40:09.137 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-06T22:44:54.103 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-06T22:44:54.101+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118084) UID: 0 2023-07-06T22:44:54.104 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-06T22:44:54.101+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118084) UID: 0 2023-07-06T22:44:54.104 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-06T22:44:54.102+0000 7fec6f39a700 -1 Fail to open '/proc/118084/cmdline' error = (2) No such file or directory 2023-07-06T22:44:54.104 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-06T22:44:54.102+0000 7fec6f39a700 -1 received signal: Hangup from (PID: 118084) UID: 0 2023-07-06T22:44:54.105 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-06T22:44:54.102+0000 7ff734335700 -1 Fail to open '/proc/118084/cmdline' error = (2) No such file or directory 2023-07-06T22:44:54.105 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-06T22:44:54.102+0000 7ff734335700 -1 received signal: Hangup from (PID: 118084) UID: 0 2023-07-06T22:48:49.242 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:48:49.249 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:48:49.394 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-06T22:48:49.393+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 647786) UID: 0 2023-07-06T22:48:49.395 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-06T22:48:49.393+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 647786) UID: 0 2023-07-06T22:48:49.395 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-06T22:48:49.393+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 647786) UID: 0 2023-07-06T22:48:49.396 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T22:48:49.394+0000 7fec49f76700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 647786) UID: 0 2023-07-06T22:55:36.792 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:55:36.795 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:56:08.898 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:56:08.904 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:56:39.214 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:56:39.219 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:56:39.270 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-06T22:56:39.268+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118274) UID: 0 2023-07-06T22:56:39.271 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-06T22:56:39.268+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118274) UID: 0 2023-07-06T22:56:39.271 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-06T22:56:39.268+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118274) UID: 0 2023-07-06T22:56:39.272 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-06T22:56:39.268+0000 7ff734335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118274) UID: 0 2023-07-06T22:59:52.580 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:59:52.583 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T22:59:52.674 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-06T22:59:52.672+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 647975) UID: 0 2023-07-06T22:59:52.675 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-06T22:59:52.672+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 647975) UID: 0 2023-07-06T22:59:52.675 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-06T22:59:52.672+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 647975) UID: 0 2023-07-06T22:59:52.676 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T22:59:52.674+0000 7fec49f76700 -1 Fail to open '/proc/647975/cmdline' error = (2) No such file or directory 2023-07-06T22:59:52.676 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T22:59:52.674+0000 7fec49f76700 -1 received signal: Hangup from (PID: 647975) UID: 0 2023-07-06T23:03:17.549 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:03:17.557 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:03:47.656 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:03:47.659 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:04:18.181 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:04:18.184 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:04:48.262 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:04:48.266 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:05:18.369 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:05:18.373 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:05:48.471 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:05:48.474 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:06:18.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:06:18.562 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:06:48.641 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:06:48.647 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:07:18.740 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:07:18.743 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:07:49.132 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:07:49.134 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:07:49.189 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-06T23:07:49.187+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118613) UID: 0 2023-07-06T23:07:49.189 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-06T23:07:49.187+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118613) UID: 0 2023-07-06T23:07:49.190 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-06T23:07:49.187+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118613) UID: 0 2023-07-06T23:07:49.190 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-06T23:07:49.187+0000 7ff734335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118613) UID: 0 2023-07-06T23:11:05.989 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:11:05.992 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:11:36.109 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:11:36.112 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:12:06.191 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:12:06.195 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:12:36.267 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:12:36.276 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:13:06.341 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:13:06.344 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:13:06.392 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-06T23:13:06.390+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118767) UID: 0 2023-07-06T23:13:06.392 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-06T23:13:06.390+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118767) UID: 0 2023-07-06T23:13:06.393 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-06T23:13:06.390+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118767) UID: 0 2023-07-06T23:13:06.393 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-06T23:13:06.390+0000 7ff734335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118767) UID: 0 2023-07-06T23:16:24.544 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:16:24.547 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:16:56.277 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:16:56.282 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:17:26.820 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:17:26.822 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:17:57.099 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:17:57.101 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:18:27.409 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:18:27.411 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:18:57.605 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:18:57.612 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:18:57.678 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-06T23:18:57.675+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 648600) UID: 0 2023-07-06T23:18:57.679 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T23:18:57.677+0000 7fec49f76700 -1 Fail to open '/proc/648600/cmdline' error = (2) No such file or directory 2023-07-06T23:18:57.679 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T23:18:57.677+0000 7fec49f76700 -1 received signal: Hangup from (PID: 648600) UID: 0 2023-07-06T23:18:57.683 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-06T23:18:57.675+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 648600) UID: 0 2023-07-06T23:18:57.687 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-06T23:18:57.675+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 648600) UID: 0 2023-07-06T23:22:25.068 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:22:25.071 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:22:25.160 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T23:22:25.157+0000 7fec49f76700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 648663) UID: 0 2023-07-06T23:22:25.160 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-06T23:22:25.157+0000 7fab95f25700 -1 Fail to open '/proc/648663/cmdline' error = (2) No such file or directory 2023-07-06T23:22:25.161 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-06T23:22:25.157+0000 7fab95f25700 -1 received signal: Hangup from (PID: 648663) UID: 0 2023-07-06T23:22:25.161 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-06T23:22:25.157+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 648663) UID: 0 2023-07-06T23:22:25.162 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-06T23:22:25.157+0000 7fb5a42e0700 -1 Fail to open '/proc/648663/cmdline' error = (2) No such file or directory 2023-07-06T23:22:25.163 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-06T23:22:25.157+0000 7fb5a42e0700 -1 received signal: Hangup from (PID: 648663) UID: 0 2023-07-06T23:26:10.192 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:26:10.195 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:26:40.271 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:26:40.279 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:27:10.373 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:27:10.375 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:27:40.452 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:27:40.454 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:28:10.818 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:28:10.822 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:28:10.872 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-06T23:28:10.870+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119150) UID: 0 2023-07-06T23:28:10.873 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-06T23:28:10.870+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119150) UID: 0 2023-07-06T23:28:10.873 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-06T23:28:10.870+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119150) UID: 0 2023-07-06T23:28:10.873 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-06T23:28:10.871+0000 7ff734335700 -1 Fail to open '/proc/119150/cmdline' error = (2) No such file or directory 2023-07-06T23:28:10.873 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-06T23:28:10.871+0000 7ff734335700 -1 received signal: Hangup from (PID: 119150) UID: 0 2023-07-06T23:31:25.358 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:31:25.361 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:31:25.429 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-06T23:31:25.425+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 648875) UID: 0 2023-07-06T23:31:25.429 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-06T23:31:25.426+0000 7fb5a42e0700 -1 received signal: Hangup from (PID: 648875) UID: 0 2023-07-06T23:31:25.430 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-06T23:31:25.427+0000 7fab95f25700 -1 Fail to open '/proc/648875/cmdline' error = (2) No such file or directory 2023-07-06T23:31:25.430 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-06T23:31:25.427+0000 7fab95f25700 -1 received signal: Hangup from (PID: 648875) UID: 0 2023-07-06T23:31:25.435 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T23:31:25.427+0000 7fec49f76700 -1 Fail to open '/proc/648875/cmdline' error = (2) No such file or directory 2023-07-06T23:31:25.435 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T23:31:25.427+0000 7fec49f76700 -1 received signal: Hangup from (PID: 648875) UID: 0 2023-07-06T23:35:13.007 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:35:13.010 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:35:43.462 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:35:43.465 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:36:13.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:36:13.563 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:36:43.653 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:36:43.659 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:37:13.737 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:37:13.741 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:37:13.793 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-06T23:37:13.791+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119358) UID: 0 2023-07-06T23:37:13.794 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-06T23:37:13.791+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119358) UID: 0 2023-07-06T23:37:13.794 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-06T23:37:13.791+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119358) UID: 0 2023-07-06T23:37:13.795 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-06T23:37:13.792+0000 7ff734335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119358) UID: 0 2023-07-06T23:40:30.966 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:40:30.972 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:40:31.065 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-06T23:40:31.061+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 649084) UID: 0 2023-07-06T23:40:31.065 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-06T23:40:31.061+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 649084) UID: 0 2023-07-06T23:40:31.066 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-06T23:40:31.062+0000 7fab95f25700 -1 Fail to open '/proc/649084/cmdline' error = (2) No such file or directory 2023-07-06T23:40:31.066 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-06T23:40:31.062+0000 7fab95f25700 -1 received signal: Hangup from (PID: 649084) UID: 0 2023-07-06T23:40:31.066 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T23:40:31.062+0000 7fec49f76700 -1 Fail to open '/proc/649084/cmdline' error = (2) No such file or directory 2023-07-06T23:40:31.066 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T23:40:31.063+0000 7fec49f76700 -1 received signal: Hangup from (PID: 649084) UID: 0 2023-07-06T23:44:08.149 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:44:08.155 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:44:08.210 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-06T23:44:08.208+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 649135) UID: 0 2023-07-06T23:44:08.212 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-06T23:44:08.209+0000 7fad36019700 -1 Fail to open '/proc/649135/cmdline' error = (2) No such file or directory 2023-07-06T23:44:08.212 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-06T23:44:08.209+0000 7fad36019700 -1 received signal: Hangup from (PID: 649135) UID: 0 2023-07-06T23:44:08.212 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-06T23:44:08.209+0000 7fab95f25700 -1 Fail to open '/proc/649135/cmdline' error = (2) No such file or directory 2023-07-06T23:44:08.212 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-06T23:44:08.209+0000 7fab95f25700 -1 received signal: Hangup from (PID: 649135) UID: 0 2023-07-06T23:44:08.213 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T23:44:08.209+0000 7fec49f76700 -1 Fail to open '/proc/649135/cmdline' error = (2) No such file or directory 2023-07-06T23:44:08.213 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T23:44:08.209+0000 7fec49f76700 -1 received signal: Hangup from (PID: 649135) UID: 0 2023-07-06T23:47:45.300 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:47:45.303 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:48:15.396 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:48:15.400 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:48:45.493 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:48:45.498 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:49:15.575 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:49:15.580 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:49:45.691 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:49:45.693 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:50:15.796 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:50:15.799 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:50:45.902 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:50:45.905 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:50:45.944 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-06T23:50:45.941+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119677) UID: 0 2023-07-06T23:50:45.944 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-06T23:50:45.941+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119677) UID: 0 2023-07-06T23:50:45.945 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-06T23:50:45.941+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119677) UID: 0 2023-07-06T23:50:45.945 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-06T23:50:45.941+0000 7ff734335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 119677) UID: 0 2023-07-06T23:54:02.450 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:54:02.455 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:54:32.575 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:54:32.577 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:55:02.677 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:55:02.679 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:55:32.755 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:55:32.758 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:56:02.831 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:56:02.834 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:56:33.017 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:56:33.021 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:57:03.113 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:57:03.115 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:57:33.433 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:57:33.436 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:58:03.716 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:58:03.719 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:58:33.799 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:58:33.802 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:59:03.887 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:59:03.890 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-06T23:59:03.984 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-06T23:59:03.982+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 649650) UID: 0 2023-07-06T23:59:03.984 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-06T23:59:03.982+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 649650) UID: 0 2023-07-06T23:59:03.984 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-06T23:59:03.982+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 649650) UID: 0 2023-07-06T23:59:03.985 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-06T23:59:03.982+0000 7fec49f76700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 649650) UID: 0 2023-07-07T00:02:33.611 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:02:33.617 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:02:33.844 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-07T00:02:33.842+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120060) UID: 0 2023-07-07T00:02:33.845 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T00:02:33.843+0000 7ff734335700 -1 Fail to open '/proc/120060/cmdline' error = (2) No such file or directory 2023-07-07T00:02:33.845 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T00:02:33.843+0000 7ff734335700 -1 received signal: Hangup from (PID: 120060) UID: 0 2023-07-07T00:02:33.845 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-07T00:02:33.842+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120060) UID: 0 2023-07-07T00:02:33.847 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-07T00:02:33.842+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120060) UID: 0 2023-07-07T00:08:51.316 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:08:51.320 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:08:51.402 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-07T00:08:51.401+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 649864) UID: 0 2023-07-07T00:08:51.403 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-07T00:08:51.401+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 649864) UID: 0 2023-07-07T00:08:51.403 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-07T00:08:51.401+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 649864) UID: 0 2023-07-07T00:08:51.405 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-07T00:08:51.402+0000 7fec49f76700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 649864) UID: 0 2023-07-07T00:13:00.222 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:13:00.225 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:13:00.303 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-07T00:13:00.302+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 649925) UID: 0 2023-07-07T00:13:00.304 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-07T00:13:00.302+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 649925) UID: 0 2023-07-07T00:13:00.305 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-07T00:13:00.303+0000 7fb5a42e0700 -1 Fail to open '/proc/649925/cmdline' error = (2) No such file or directory 2023-07-07T00:13:00.305 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-07T00:13:00.303+0000 7fb5a42e0700 -1 received signal: Hangup from (PID: 649925) UID: 0 2023-07-07T00:13:00.305 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-07T00:13:00.303+0000 7fec49f76700 -1 Fail to open '/proc/649925/cmdline' error = (2) No such file or directory 2023-07-07T00:13:00.305 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-07T00:13:00.303+0000 7fec49f76700 -1 received signal: Hangup from (PID: 649925) UID: 0 2023-07-07T00:16:45.231 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:16:45.236 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:16:45.305 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-07-07T00:16:45.305+0000 7f627fdc9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 120309) UID: 0 2023-07-07T00:16:45.307 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-07-07T00:16:45.305+0000 7f3a28953700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 120309) UID: 0 2023-07-07T00:20:10.940 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:20:10.944 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:20:41.202 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:20:41.205 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:21:11.288 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:21:11.293 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:21:42.005 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:21:42.017 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:22:12.281 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:22:12.284 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:22:42.377 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:22:42.380 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:23:00.511 INFO:teuthology.orchestra.run.smithi006.stdout:generic/521 6171s 2023-07-07T00:23:00.526 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/521 2023-07-07T00:23:00.527 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T00:23:00.534 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T00:23:00.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T00:23:00.896 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-07-07T00:23:01.606 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T00:23:01.616 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T00:23:01.616 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T00:23:01.618 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T00:23:01.618 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T00:23:12.466 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:23:12.468 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:23:42.776 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:23:42.779 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:24:12.864 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:24:12.867 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:24:42.951 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:24:42.956 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:25:13.050 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:25:13.053 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:25:43.498 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:25:43.501 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:26:13.605 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:26:13.608 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:26:43.681 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:26:43.683 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:27:13.746 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:27:13.751 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:27:43.853 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:27:43.855 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:28:13.935 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:28:13.938 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:28:44.472 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:28:44.477 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:29:14.552 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:29:14.555 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:29:44.652 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:29:44.655 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:30:14.737 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:30:14.740 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:30:14.859 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-07T00:30:14.858+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120866) UID: 0 2023-07-07T00:30:14.860 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-07T00:30:14.859+0000 7fec6f39a700 -1 received signal: Hangup from (PID: 120866) UID: 0 2023-07-07T00:30:14.865 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-07T00:30:14.858+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120866) UID: 0 2023-07-07T00:30:14.867 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T00:30:14.864+0000 7ff734335700 -1 Fail to open '/proc/120866/cmdline' error = (2) No such file or directory 2023-07-07T00:30:14.867 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T00:30:14.864+0000 7ff734335700 -1 received signal: Hangup from (PID: 120866) UID: 0 2023-07-07T00:33:40.256 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:33:40.260 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:33:40.368 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-07T00:33:40.367+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 651093) UID: 0 2023-07-07T00:33:40.368 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-07T00:33:40.367+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 651093) UID: 0 2023-07-07T00:33:40.369 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-07T00:33:40.367+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 651093) UID: 0 2023-07-07T00:33:40.369 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-07T00:33:40.367+0000 7fec49f76700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 651093) UID: 0 2023-07-07T00:33:40.375 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-07T00:33:40.373+0000 7fb9bd783700 -1 Fail to open '/proc/120929/cmdline' error = (2) No such file or directory 2023-07-07T00:33:40.375 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-07T00:33:40.373+0000 7fb9bd783700 -1 received signal: Hangup from (PID: 120929) UID: 0 2023-07-07T00:33:40.379 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-07T00:33:40.372+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120929) UID: 0 2023-07-07T00:33:40.379 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-07T00:33:40.372+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120929) UID: 0 2023-07-07T00:33:40.380 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T00:33:40.373+0000 7ff734335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 120929) UID: 0 2023-07-07T00:40:11.008 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:40:11.012 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:40:11.091 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-07T00:40:11.090+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 651170) UID: 0 2023-07-07T00:40:11.091 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-07T00:40:11.090+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 651170) UID: 0 2023-07-07T00:40:11.092 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-07T00:40:11.092+0000 7fab95f25700 -1 received signal: Hangup from (PID: 651170) UID: 0 2023-07-07T00:40:11.093 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-07T00:40:11.092+0000 7fec49f76700 -1 received signal: Hangup from (PID: 651170) UID: 0 2023-07-07T00:44:03.014 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:44:03.023 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:44:33.126 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:44:33.128 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:45:03.225 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:45:03.228 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:45:33.298 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:45:33.301 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:46:03.404 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:46:03.410 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:46:33.729 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:46:33.733 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:47:03.810 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:47:03.812 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:47:33.892 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:47:33.894 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:48:03.967 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:48:03.969 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:48:34.056 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:48:34.058 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:49:04.413 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:49:04.416 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:49:34.523 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:49:34.533 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:49:34.593 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-07T00:49:34.592+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121533) UID: 0 2023-07-07T00:49:34.594 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-07T00:49:34.592+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121533) UID: 0 2023-07-07T00:49:34.594 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-07T00:49:34.592+0000 7fec6f39a700 -1 Fail to open '/proc/121533/cmdline' error = (2) No such file or directory 2023-07-07T00:49:34.594 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-07T00:49:34.592+0000 7fec6f39a700 -1 received signal: Hangup from (PID: 121533) UID: 0 2023-07-07T00:49:34.594 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T00:49:34.592+0000 7ff734335700 -1 Fail to open '/proc/121533/cmdline' error = (2) No such file or directory 2023-07-07T00:49:34.595 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T00:49:34.592+0000 7ff734335700 -1 received signal: Hangup from (PID: 121533) UID: 0 2023-07-07T00:53:01.284 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:53:01.287 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:53:31.381 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:53:31.385 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:54:01.464 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:54:01.472 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:54:31.551 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:54:31.553 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:55:01.641 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:55:01.644 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:55:32.270 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:55:32.273 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:56:02.360 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:56:02.363 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:56:32.443 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:56:32.447 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:57:02.521 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:57:02.524 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:57:32.613 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:57:32.620 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:58:02.702 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:58:02.705 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:58:32.806 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:58:32.810 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T00:58:32.865 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-07T00:58:32.864+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121869) UID: 0 2023-07-07T00:58:32.866 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-07T00:58:32.865+0000 7fec6f39a700 -1 received signal: Hangup from (PID: 121869) UID: 0 2023-07-07T00:58:32.867 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-07T00:58:32.865+0000 7fc177dad700 -1 Fail to open '/proc/121869/cmdline' error = (2) No such file or directory 2023-07-07T00:58:32.867 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-07T00:58:32.865+0000 7fc177dad700 -1 received signal: Hangup from (PID: 121869) UID: 0 2023-07-07T00:58:32.867 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T00:58:32.865+0000 7ff734335700 -1 received signal: Hangup from (PID: 121869) UID: 0 2023-07-07T01:01:55.170 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:01:55.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:02:25.260 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:02:25.262 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:02:55.325 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:02:55.328 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:03:25.406 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:03:25.409 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:03:25.499 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-07T01:03:25.498+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 651992) UID: 0 2023-07-07T01:03:25.500 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-07T01:03:25.498+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 651992) UID: 0 2023-07-07T01:03:25.500 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-07T01:03:25.499+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 651992) UID: 0 2023-07-07T01:03:25.501 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-07T01:03:25.500+0000 7fec49f76700 -1 Fail to open '/proc/651992/cmdline' error = (2) No such file or directory 2023-07-07T01:03:25.501 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-07T01:03:25.500+0000 7fec49f76700 -1 received signal: Hangup from (PID: 651992) UID: 0 2023-07-07T01:06:46.570 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:06:46.574 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:06:46.623 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-07T01:06:46.623+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122060) UID: 0 2023-07-07T01:06:46.624 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-07T01:06:46.623+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122060) UID: 0 2023-07-07T01:06:46.624 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-07T01:06:46.623+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122060) UID: 0 2023-07-07T01:06:46.624 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T01:06:46.624+0000 7ff734335700 -1 Fail to open '/proc/122060/cmdline' error = (2) No such file or directory 2023-07-07T01:06:46.625 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T01:06:46.624+0000 7ff734335700 -1 received signal: Hangup from (PID: 122060) UID: 0 2023-07-07T01:06:46.640 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-07T01:06:46.639+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 652042) UID: 0 2023-07-07T01:06:46.640 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-07T01:06:46.639+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 652042) UID: 0 2023-07-07T01:06:46.641 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-07T01:06:46.640+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 652042) UID: 0 2023-07-07T01:06:46.641 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-07T01:06:46.640+0000 7fec49f76700 -1 Fail to open '/proc/652042/cmdline' error = (2) No such file or directory 2023-07-07T01:06:46.641 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-07T01:06:46.640+0000 7fec49f76700 -1 received signal: Hangup from (PID: 652042) UID: 0 2023-07-07T01:10:17.176 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:10:17.179 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:10:47.286 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:10:47.288 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:11:17.384 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:11:17.387 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:11:17.451 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-07T01:11:17.450+0000 7fec49f76700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 652157) UID: 0 2023-07-07T01:11:17.452 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-07T01:11:17.451+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 652157) UID: 0 2023-07-07T01:11:17.452 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-07T01:11:17.451+0000 7fab95f25700 -1 Fail to open '/proc/652157/cmdline' error = (2) No such file or directory 2023-07-07T01:11:17.453 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-07T01:11:17.451+0000 7fab95f25700 -1 received signal: Hangup from (PID: 652157) UID: 0 2023-07-07T01:11:17.455 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-07T01:11:17.451+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 652157) UID: 0 2023-07-07T01:14:43.163 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:14:43.168 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:15:13.286 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:15:13.289 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:15:43.405 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:15:43.408 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:16:13.518 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:16:13.520 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:16:43.607 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:16:43.609 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:17:13.673 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:17:13.679 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:17:44.116 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:17:44.119 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:18:14.469 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:18:14.472 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:18:44.873 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:18:44.876 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:19:15.226 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:19:15.232 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:19:45.317 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:19:45.320 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:20:15.399 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:20:15.402 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:20:45.510 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:20:45.513 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:21:15.614 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:21:15.617 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:21:45.878 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:21:45.882 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:21:45.949 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-07T01:21:45.948+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 652778) UID: 0 2023-07-07T01:21:45.949 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-07T01:21:45.948+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 652778) UID: 0 2023-07-07T01:21:45.950 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-07T01:21:45.948+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 652778) UID: 0 2023-07-07T01:21:45.950 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-07T01:21:45.948+0000 7fec49f76700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 652778) UID: 0 2023-07-07T01:25:08.946 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:25:08.956 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:25:39.057 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:25:39.059 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:26:09.159 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:26:09.162 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:26:39.260 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:26:39.263 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:27:09.809 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:27:09.812 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:27:09.879 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-07T01:27:09.877+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122720) UID: 0 2023-07-07T01:27:09.879 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-07T01:27:09.877+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122720) UID: 0 2023-07-07T01:27:09.880 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T01:27:09.877+0000 7ff734335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122720) UID: 0 2023-07-07T01:27:09.881 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-07T01:27:09.877+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 122720) UID: 0 2023-07-07T01:33:34.094 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:33:34.097 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:33:34.170 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-07-07T01:33:34.169+0000 7f3a28953700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 122807) UID: 0 2023-07-07T01:33:34.170 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-07-07T01:33:34.169+0000 7f627fdc9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 122807) UID: 0 2023-07-07T01:33:34.199 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-07T01:33:34.197+0000 7fec49f76700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 653012) UID: 0 2023-07-07T01:33:34.202 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-07T01:33:34.201+0000 7fad36019700 -1 Fail to open '/proc/653012/cmdline' error = (2) No such file or directory 2023-07-07T01:33:34.202 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-07T01:33:34.201+0000 7fad36019700 -1 received signal: Hangup from (PID: 653012) UID: 0 2023-07-07T01:33:34.202 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-07T01:33:34.199+0000 7fb5a42e0700 -1 Fail to open '/proc/653012/cmdline' error = (2) No such file or directory 2023-07-07T01:33:34.203 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-07T01:33:34.199+0000 7fb5a42e0700 -1 received signal: Hangup from (PID: 653012) UID: 0 2023-07-07T01:33:34.203 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-07T01:33:34.201+0000 7fab95f25700 -1 Fail to open '/proc/653012/cmdline' error = (2) No such file or directory 2023-07-07T01:33:34.203 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-07T01:33:34.201+0000 7fab95f25700 -1 received signal: Hangup from (PID: 653012) UID: 0 2023-07-07T01:35:06.548 INFO:teuthology.orchestra.run.smithi006.stdout:generic/522 4325s 2023-07-07T01:35:06.595 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/522 2023-07-07T01:35:06.595 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:35:06.599 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:06.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:35:06.650 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-07-07T01:35:07.557 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:35:07.568 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:35:07.569 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:35:07.571 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:35:07.571 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:08.748 INFO:teuthology.orchestra.run.smithi006.stdout:generic/523 1s 2023-07-07T01:35:08.756 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/523 2023-07-07T01:35:08.756 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:35:08.759 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:08.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:35:08.782 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-07-07T01:35:09.242 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:35:09.247 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:35:09.249 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:35:09.250 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:35:09.250 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:16.991 INFO:teuthology.orchestra.run.smithi006.stdout:generic/524 7s 2023-07-07T01:35:17.005 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/524 2023-07-07T01:35:17.006 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:35:17.008 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:17.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:35:17.019 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-07-07T01:35:17.557 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:35:17.567 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:35:17.567 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:35:17.568 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:35:17.568 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:18.610 INFO:teuthology.orchestra.run.smithi006.stdout:generic/525 [not run] filesystem does not support huge file size 2023-07-07T01:35:18.647 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/525 2023-07-07T01:35:18.647 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/525 2023-07-07T01:35:18.647 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:35:18.650 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:18.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:35:18.710 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-07-07T01:35:19.171 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:35:19.181 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:35:19.188 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:35:19.190 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:35:19.190 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:19.935 INFO:teuthology.orchestra.run.smithi006.stdout:generic/526 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-07T01:35:19.940 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/526 2023-07-07T01:35:19.940 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/526 2023-07-07T01:35:19.940 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:35:19.943 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:20.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:35:20.011 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-07-07T01:35:20.524 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:35:20.537 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:35:20.537 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:35:20.539 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:35:20.539 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:21.231 INFO:teuthology.orchestra.run.smithi006.stdout:generic/527 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-07T01:35:21.242 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/527 2023-07-07T01:35:21.243 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/527 2023-07-07T01:35:21.243 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:35:21.245 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:21.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:35:21.288 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-07-07T01:35:21.696 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:35:21.709 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:35:21.716 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:35:21.723 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:35:21.723 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:23.222 INFO:teuthology.orchestra.run.smithi006.stdout:generic/528 1s 2023-07-07T01:35:23.262 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/528 2023-07-07T01:35:23.262 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:35:23.264 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:23.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:35:23.590 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-07-07T01:35:24.284 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:35:24.292 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:35:24.293 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:35:24.295 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:35:24.295 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:26.129 INFO:teuthology.orchestra.run.smithi006.stdout:generic/529 2s 2023-07-07T01:35:26.134 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/529 2023-07-07T01:35:26.135 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:35:26.137 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:26.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:35:26.148 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-07-07T01:35:26.590 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:35:26.596 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:35:26.597 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:35:26.598 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:35:26.598 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:27.497 INFO:teuthology.orchestra.run.smithi006.stdout:generic/530 [not run] ceph does not support shutdown 2023-07-07T01:35:27.521 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/530 2023-07-07T01:35:27.521 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/530 2023-07-07T01:35:27.521 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:35:27.523 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:27.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:35:27.589 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-07-07T01:35:28.120 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:35:28.139 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:35:28.140 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:35:28.148 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:35:28.149 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:28.790 INFO:teuthology.orchestra.run.smithi006.stdout:generic/531 [not run] O_TMPFILE is not supported 2023-07-07T01:35:28.799 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/531 2023-07-07T01:35:28.799 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/531 2023-07-07T01:35:28.799 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:35:28.802 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:28.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:35:28.840 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-07-07T01:35:29.339 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:35:29.350 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:35:29.351 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:35:29.352 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:35:29.352 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:30.118 INFO:teuthology.orchestra.run.smithi006.stdout:generic/532 1s 2023-07-07T01:35:30.127 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/532 2023-07-07T01:35:30.127 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:35:30.129 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:30.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:35:30.194 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-07-07T01:35:30.456 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:35:30.460 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:35:30.460 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:35:30.461 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:35:30.461 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:32.099 INFO:teuthology.orchestra.run.smithi006.stdout:generic/533 2s 2023-07-07T01:35:32.106 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/533 2023-07-07T01:35:32.107 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:35:32.109 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:32.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:35:32.148 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-07-07T01:35:32.659 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:35:32.675 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:35:32.675 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:35:32.676 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:35:32.677 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:33.310 INFO:teuthology.orchestra.run.smithi006.stdout:generic/534 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-07T01:35:33.315 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/534 2023-07-07T01:35:33.315 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/534 2023-07-07T01:35:33.315 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:35:33.317 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:33.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:35:33.357 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-07-07T01:35:33.768 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:35:33.772 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:35:33.773 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:35:33.774 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:35:33.774 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:34.428 INFO:teuthology.orchestra.run.smithi006.stdout:generic/535 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-07T01:35:34.432 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/535 2023-07-07T01:35:34.433 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/535 2023-07-07T01:35:34.433 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:35:34.437 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:34.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:35:34.475 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-07-07T01:35:34.923 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:35:34.940 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:35:34.940 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:35:34.941 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:35:34.942 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:35.930 INFO:teuthology.orchestra.run.smithi006.stdout:generic/536 [not run] ceph does not support shutdown 2023-07-07T01:35:35.976 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/536 2023-07-07T01:35:35.976 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/536 2023-07-07T01:35:35.976 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:35:35.979 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:36.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:35:36.052 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-07-07T01:35:36.590 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:35:36.599 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:35:36.599 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:35:36.607 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:35:36.607 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:37.452 INFO:teuthology.orchestra.run.smithi006.stdout:generic/537 [not run] FSTRIM not supported 2023-07-07T01:35:37.485 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/537 2023-07-07T01:35:37.485 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/537 2023-07-07T01:35:37.485 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:35:37.494 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:35:37.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:35:37.533 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-07-07T01:35:38.018 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:35:38.030 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:35:38.031 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:35:38.036 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:35:38.036 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:37:00.896 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:37:00.899 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:37:30.996 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:37:30.998 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:37:31.038 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-07T01:37:31.038+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123389) UID: 0 2023-07-07T01:37:31.039 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-07T01:37:31.038+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123389) UID: 0 2023-07-07T01:37:31.039 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-07T01:37:31.038+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123389) UID: 0 2023-07-07T01:37:31.040 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T01:37:31.040+0000 7ff734335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123389) UID: 0 2023-07-07T01:40:55.392 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:40:55.397 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:40:55.484 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-07T01:40:55.483+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123458) UID: 0 2023-07-07T01:40:55.485 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-07T01:40:55.483+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123458) UID: 0 2023-07-07T01:40:55.485 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T01:40:55.483+0000 7ff734335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123458) UID: 0 2023-07-07T01:40:55.485 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-07T01:40:55.483+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 123458) UID: 0 2023-07-07T01:44:38.947 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:44:38.949 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:44:39.022 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-07T01:44:39.020+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 667968) UID: 0 2023-07-07T01:44:39.022 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-07T01:44:39.020+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 667968) UID: 0 2023-07-07T01:44:39.023 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-07T01:44:39.020+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 667968) UID: 0 2023-07-07T01:44:39.023 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-07T01:44:39.021+0000 7fec49f76700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 667968) UID: 0 2023-07-07T01:45:08.983 INFO:teuthology.orchestra.run.smithi006.stdout:generic/538 570s 2023-07-07T01:45:08.999 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/538 2023-07-07T01:45:09.000 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:45:09.002 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:09.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:45:09.342 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-07-07T01:45:09.991 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:45:09.998 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:45:09.999 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:45:10.002 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:45:10.002 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:13.298 INFO:teuthology.orchestra.run.smithi006.stdout:generic/539 3s 2023-07-07T01:45:13.311 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/539 2023-07-07T01:45:13.311 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:45:13.317 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:13.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:45:13.821 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-07-07T01:45:14.366 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:45:14.384 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:45:14.385 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:45:14.386 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:45:14.387 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:15.873 INFO:teuthology.orchestra.run.smithi006.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T01:45:15.887 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/540 2023-07-07T01:45:15.888 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/540 2023-07-07T01:45:15.888 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:45:15.900 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:15.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:45:15.955 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-07-07T01:45:16.465 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:45:16.470 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:45:16.471 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:45:16.472 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:45:16.472 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:17.981 INFO:teuthology.orchestra.run.smithi006.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T01:45:18.056 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/541 2023-07-07T01:45:18.056 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/541 2023-07-07T01:45:18.056 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:45:18.060 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:18.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:45:18.200 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-07-07T01:45:18.669 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:45:18.678 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:45:18.678 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:45:18.682 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:45:18.682 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:19.894 INFO:teuthology.orchestra.run.smithi006.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T01:45:19.905 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/542 2023-07-07T01:45:19.905 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/542 2023-07-07T01:45:19.906 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:45:20.048 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:20.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:45:20.272 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-07-07T01:45:20.793 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:45:20.809 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:45:20.810 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:45:20.811 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:45:20.811 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:22.256 INFO:teuthology.orchestra.run.smithi006.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T01:45:22.298 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/543 2023-07-07T01:45:22.298 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/543 2023-07-07T01:45:22.298 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:45:22.302 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:22.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:45:22.350 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-07-07T01:45:22.906 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:45:22.928 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:45:22.928 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:45:22.932 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:45:22.932 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:24.373 INFO:teuthology.orchestra.run.smithi006.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T01:45:24.401 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/544 2023-07-07T01:45:24.401 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/544 2023-07-07T01:45:24.401 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:45:24.432 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:24.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:45:24.490 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-07-07T01:45:24.986 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:45:24.993 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:45:24.995 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:45:24.997 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:45:24.997 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:25.856 INFO:teuthology.orchestra.run.smithi006.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-07-07T01:45:25.862 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/545 2023-07-07T01:45:25.862 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/545 2023-07-07T01:45:25.862 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:45:25.865 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:25.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:45:25.936 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-07-07T01:45:26.439 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:45:26.448 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:45:26.448 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:45:26.450 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:45:26.450 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:27.274 INFO:teuthology.orchestra.run.smithi006.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T01:45:27.283 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/546 2023-07-07T01:45:27.284 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/546 2023-07-07T01:45:27.284 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:45:27.286 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:27.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:45:27.343 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-07-07T01:45:27.863 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:45:27.871 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:45:27.871 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:45:27.872 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:45:27.873 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:28.624 INFO:teuthology.orchestra.run.smithi006.stdout:generic/547 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-07T01:45:28.629 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/547 2023-07-07T01:45:28.629 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/547 2023-07-07T01:45:28.630 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:45:28.638 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:28.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:45:28.677 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-07-07T01:45:29.270 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:45:29.275 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:45:29.279 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:45:29.280 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:45:29.280 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:30.413 INFO:teuthology.orchestra.run.smithi006.stdout:generic/548 [not run] kernel does not support ceph encryption 2023-07-07T01:45:30.449 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/548 2023-07-07T01:45:30.449 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/548 2023-07-07T01:45:30.449 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:45:30.454 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:30.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:45:30.502 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-07-07T01:45:30.975 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:45:30.980 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:45:30.981 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:45:30.983 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:45:30.983 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:32.414 INFO:teuthology.orchestra.run.smithi006.stdout:generic/549 [not run] kernel does not support ceph encryption 2023-07-07T01:45:32.447 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/549 2023-07-07T01:45:32.448 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/549 2023-07-07T01:45:32.448 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:45:32.450 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:32.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:45:32.503 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-07-07T01:45:33.045 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:45:33.068 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:45:33.068 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:45:33.069 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:45:33.070 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:34.204 INFO:teuthology.orchestra.run.smithi006.stdout:generic/550 [not run] kernel does not support ceph encryption 2023-07-07T01:45:34.241 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/550 2023-07-07T01:45:34.241 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/550 2023-07-07T01:45:34.241 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T01:45:34.251 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:45:34.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T01:45:34.298 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-07-07T01:45:34.852 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T01:45:34.866 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T01:45:34.867 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T01:45:34.868 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T01:45:34.868 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T01:48:32.193 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:48:32.196 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:49:02.302 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:49:02.305 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:49:32.389 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:49:32.391 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:50:02.471 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:50:02.474 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:50:32.551 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:50:32.554 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:51:02.642 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:51:02.650 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:51:32.733 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:51:32.736 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:52:03.376 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:52:03.378 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:52:33.513 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:52:33.515 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:53:03.578 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:53:03.580 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:53:33.685 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:53:33.687 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:54:03.758 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:54:03.761 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:54:34.082 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:54:34.085 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:55:04.454 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:55:04.457 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:55:34.513 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:55:34.515 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:56:04.707 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:56:04.709 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:56:34.775 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:56:34.778 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:56:34.830 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-07T01:56:34.829+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125961) UID: 0 2023-07-07T01:56:34.830 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-07T01:56:34.829+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125961) UID: 0 2023-07-07T01:56:34.831 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-07T01:56:34.829+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125961) UID: 0 2023-07-07T01:56:34.831 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T01:56:34.829+0000 7ff734335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 125961) UID: 0 2023-07-07T01:56:34.833 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-07T01:56:34.831+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 677847) UID: 0 2023-07-07T01:56:34.833 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-07T01:56:34.831+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 677847) UID: 0 2023-07-07T01:56:34.833 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-07T01:56:34.831+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 677847) UID: 0 2023-07-07T01:56:34.834 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-07T01:56:34.831+0000 7fec49f76700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 677847) UID: 0 2023-07-07T01:59:33.981 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T01:59:33.984 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:00:04.056 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:00:04.059 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:00:34.374 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:00:34.377 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:01:04.445 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:01:04.448 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:01:34.499 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:01:34.501 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:02:04.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:02:04.562 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:02:34.637 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:02:34.639 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:03:04.683 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:03:04.686 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:03:04.727 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-07T02:03:04.726+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 678558) UID: 0 2023-07-07T02:03:04.728 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-07T02:03:04.726+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 678558) UID: 0 2023-07-07T02:03:04.728 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-07T02:03:04.726+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 678558) UID: 0 2023-07-07T02:03:04.729 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-07T02:03:04.726+0000 7fec49f76700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 678558) UID: 0 2023-07-07T02:03:07.499 INFO:teuthology.orchestra.run.smithi006.stdout:generic/551 1052s 2023-07-07T02:03:07.604 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/551 2023-07-07T02:03:07.605 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:07.606 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:07.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:07.616 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-07-07T02:03:08.537 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:08.542 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:08.542 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:08.543 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:08.543 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:09.200 INFO:teuthology.orchestra.run.smithi006.stdout:generic/552 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-07T02:03:09.205 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/552 2023-07-07T02:03:09.205 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/552 2023-07-07T02:03:09.205 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:09.208 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:09.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:09.247 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-07-07T02:03:09.484 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:09.489 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:09.489 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:09.490 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:09.490 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:09.924 INFO:teuthology.orchestra.run.smithi006.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) 2023-07-07T02:03:09.928 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/553 2023-07-07T02:03:09.928 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/553 2023-07-07T02:03:09.929 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:09.930 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:10.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:10.147 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-07-07T02:03:10.650 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:10.654 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:10.655 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:10.656 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:10.656 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:11.443 INFO:teuthology.orchestra.run.smithi006.stdout:generic/554 [not run] swapfiles are not supported 2023-07-07T02:03:11.447 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/554 2023-07-07T02:03:11.448 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/554 2023-07-07T02:03:11.448 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:11.450 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:11.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:11.850 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-07-07T02:03:12.146 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:12.150 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:12.150 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:12.151 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:12.152 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:12.592 INFO:teuthology.orchestra.run.smithi006.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) 2023-07-07T02:03:12.597 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/555 2023-07-07T02:03:12.597 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/555 2023-07-07T02:03:12.597 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:12.599 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:13.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:13.035 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-07-07T02:03:13.316 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:13.320 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:13.321 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:13.322 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:13.322 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:13.717 INFO:teuthology.orchestra.run.smithi006.stdout:generic/556 [not run] ceph does not support casefold feature 2023-07-07T02:03:13.720 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/556 2023-07-07T02:03:13.721 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/556 2023-07-07T02:03:13.721 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:13.723 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:13.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:13.747 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-07-07T02:03:13.984 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:13.988 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:13.988 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:13.989 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:13.990 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:14.362 INFO:teuthology.orchestra.run.smithi006.stdout:generic/557 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-07T02:03:14.366 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/557 2023-07-07T02:03:14.367 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/557 2023-07-07T02:03:14.367 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:14.368 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:14.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:14.394 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-07-07T02:03:14.622 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:14.626 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:14.626 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:14.627 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:14.628 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:15.014 INFO:teuthology.orchestra.run.smithi006.stdout:generic/558 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-07-07T02:03:15.018 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/558 2023-07-07T02:03:15.018 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/558 2023-07-07T02:03:15.019 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:15.020 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:15.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:15.048 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-07-07T02:03:15.276 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:15.280 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:15.280 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:15.281 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:15.281 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:15.635 INFO:teuthology.orchestra.run.smithi006.stdout:generic/559 [not run] duperemove utility required, skipped this test 2023-07-07T02:03:15.639 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/559 2023-07-07T02:03:15.639 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/559 2023-07-07T02:03:15.639 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:15.641 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:15.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:15.669 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-07-07T02:03:15.913 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:15.917 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:15.917 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:15.918 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:15.918 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:16.290 INFO:teuthology.orchestra.run.smithi006.stdout:generic/560 [not run] duperemove utility required, skipped this test 2023-07-07T02:03:16.294 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/560 2023-07-07T02:03:16.294 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/560 2023-07-07T02:03:16.295 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:16.296 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:16.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:16.326 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-07-07T02:03:16.565 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:16.569 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:16.570 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:16.571 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:16.571 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:16.951 INFO:teuthology.orchestra.run.smithi006.stdout:generic/561 [not run] duperemove utility required, skipped this test 2023-07-07T02:03:16.955 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/561 2023-07-07T02:03:16.956 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/561 2023-07-07T02:03:16.956 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:16.958 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:16.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:16.981 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-07-07T02:03:17.217 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:17.221 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:17.221 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:17.222 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:17.222 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:18.102 INFO:teuthology.orchestra.run.smithi006.stdout:generic/562 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T02:03:18.110 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/562 2023-07-07T02:03:18.110 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/562 2023-07-07T02:03:18.111 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:18.114 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:18.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:18.294 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-07-07T02:03:18.550 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:18.554 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:18.555 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:18.556 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:18.556 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:18.988 INFO:teuthology.orchestra.run.smithi006.stdout:generic/563 [not run] cgroup2 not mounted on /sys/fs/cgroup 2023-07-07T02:03:18.992 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/563 2023-07-07T02:03:18.992 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/563 2023-07-07T02:03:18.992 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:18.994 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:19.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:19.025 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-07-07T02:03:19.268 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:19.272 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:19.273 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:19.274 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:19.274 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:19.742 INFO:teuthology.orchestra.run.smithi006.stdout:generic/564 [not run] xfs_io copy_range doesn't support -f 2023-07-07T02:03:19.746 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/564 2023-07-07T02:03:19.747 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/564 2023-07-07T02:03:19.747 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:19.748 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:20.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:20.129 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-07-07T02:03:20.470 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:20.474 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:20.475 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:20.476 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:20.476 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:21.320 INFO:teuthology.orchestra.run.smithi006.stdout:generic/565 1s 2023-07-07T02:03:21.325 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/565 2023-07-07T02:03:21.325 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:21.327 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:21.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:21.414 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-07-07T02:03:22.034 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:22.039 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:22.039 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:22.040 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:22.040 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:22.422 INFO:teuthology.orchestra.run.smithi006.stdout:generic/566 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T02:03:22.426 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/566 2023-07-07T02:03:22.426 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/566 2023-07-07T02:03:22.426 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:22.428 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:22.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:22.455 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-07-07T02:03:22.689 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:22.693 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:22.694 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:22.695 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:22.695 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:23.630 INFO:teuthology.orchestra.run.smithi006.stdout:generic/567 1s 2023-07-07T02:03:23.635 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/567 2023-07-07T02:03:23.635 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:23.638 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:23.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:23.646 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-07-07T02:03:23.873 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:23.878 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:23.878 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:23.879 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:23.879 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:24.281 INFO:teuthology.orchestra.run.smithi006.stdout:generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T02:03:24.285 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/568 2023-07-07T02:03:24.285 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/568 2023-07-07T02:03:24.285 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:24.287 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:24.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:24.325 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-07-07T02:03:24.553 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:24.557 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:24.557 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:24.558 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:24.558 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:24.956 INFO:teuthology.orchestra.run.smithi006.stdout:generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T02:03:24.960 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/569 2023-07-07T02:03:24.960 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/569 2023-07-07T02:03:24.961 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:24.962 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:25.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:25.003 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-07-07T02:03:25.235 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:25.239 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:25.240 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:25.241 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:25.241 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:25.645 INFO:teuthology.orchestra.run.smithi006.stdout:generic/570 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-07T02:03:25.649 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/570 2023-07-07T02:03:25.649 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/570 2023-07-07T02:03:25.649 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:25.651 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:25.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:25.680 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-07-07T02:03:25.916 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:25.920 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:25.921 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:25.922 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:25.922 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:26.645 INFO:teuthology.orchestra.run.smithi006.stdout:generic/571 [not run] Require fcntl setlease support 2023-07-07T02:03:26.649 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/571 2023-07-07T02:03:26.649 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/571 2023-07-07T02:03:26.650 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:26.652 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:26.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:26.685 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-07-07T02:03:26.919 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:26.923 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:26.923 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:26.924 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:26.925 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:27.291 INFO:teuthology.orchestra.run.smithi006.stdout:generic/572 [not run] fsverity utility required, skipped this test 2023-07-07T02:03:27.295 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/572 2023-07-07T02:03:27.296 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/572 2023-07-07T02:03:27.296 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:27.298 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:27.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:27.330 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-07-07T02:03:27.565 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:27.569 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:27.570 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:27.571 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:27.571 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:27.927 INFO:teuthology.orchestra.run.smithi006.stdout:generic/573 [not run] fsverity utility required, skipped this test 2023-07-07T02:03:27.931 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/573 2023-07-07T02:03:27.931 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/573 2023-07-07T02:03:27.931 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:27.933 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:27.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:27.968 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-07-07T02:03:28.203 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:28.207 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:28.208 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:28.209 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:28.209 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:28.568 INFO:teuthology.orchestra.run.smithi006.stdout:generic/574 [not run] fsverity utility required, skipped this test 2023-07-07T02:03:28.571 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/574 2023-07-07T02:03:28.572 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/574 2023-07-07T02:03:28.572 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:28.574 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:28.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:28.605 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-07-07T02:03:28.836 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:28.841 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:28.841 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:28.842 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:28.842 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:29.196 INFO:teuthology.orchestra.run.smithi006.stdout:generic/575 [not run] fsverity utility required, skipped this test 2023-07-07T02:03:29.200 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/575 2023-07-07T02:03:29.200 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/575 2023-07-07T02:03:29.200 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:29.202 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:29.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:29.238 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-07-07T02:03:29.488 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:29.492 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:29.493 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:29.494 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:29.494 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:29.917 INFO:teuthology.orchestra.run.smithi006.stdout:generic/576 [not run] fsverity utility required, skipped this test 2023-07-07T02:03:29.921 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/576 2023-07-07T02:03:29.922 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/576 2023-07-07T02:03:29.922 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:29.924 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:29.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:29.950 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-07-07T02:03:30.185 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:30.189 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:30.189 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:30.190 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:30.190 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:30.550 INFO:teuthology.orchestra.run.smithi006.stdout:generic/577 [not run] fsverity utility required, skipped this test 2023-07-07T02:03:30.554 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/577 2023-07-07T02:03:30.554 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/577 2023-07-07T02:03:30.555 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:30.556 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:30.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:30.581 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-07-07T02:03:30.805 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:30.809 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:30.809 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:30.810 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:30.811 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:31.264 INFO:teuthology.orchestra.run.smithi006.stdout:generic/578 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T02:03:31.268 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/578 2023-07-07T02:03:31.268 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/578 2023-07-07T02:03:31.268 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:31.270 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:31.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:31.747 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-07-07T02:03:31.984 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:31.988 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:31.989 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:31.990 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:31.990 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:32.388 INFO:teuthology.orchestra.run.smithi006.stdout:generic/579 [not run] fsverity utility required, skipped this test 2023-07-07T02:03:32.392 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/579 2023-07-07T02:03:32.392 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/579 2023-07-07T02:03:32.392 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:32.394 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:32.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:32.428 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-07-07T02:03:32.658 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:32.662 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:32.663 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:32.664 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:32.664 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:33.269 INFO:teuthology.orchestra.run.smithi006.stdout:generic/580 [not run] kernel does not support ceph encryption 2023-07-07T02:03:33.294 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/580 2023-07-07T02:03:33.294 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/580 2023-07-07T02:03:33.295 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:33.296 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:33.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:33.324 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-07-07T02:03:33.565 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:33.570 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:33.570 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:33.571 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:33.571 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:35.187 INFO:teuthology.orchestra.run.smithi006.stdout:generic/581 [not run] kernel does not support ceph encryption 2023-07-07T02:03:35.210 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/581 2023-07-07T02:03:35.210 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/581 2023-07-07T02:03:35.210 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:35.212 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:35.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:35.238 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-07-07T02:03:35.482 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:35.486 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:35.487 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:35.488 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:35.488 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:36.133 INFO:teuthology.orchestra.run.smithi006.stdout:generic/582 [not run] kernel does not support ceph encryption 2023-07-07T02:03:36.163 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/582 2023-07-07T02:03:36.163 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/582 2023-07-07T02:03:36.163 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:36.165 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:36.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:36.188 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-07-07T02:03:36.415 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:36.419 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:36.420 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:36.421 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:36.421 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:37.006 INFO:teuthology.orchestra.run.smithi006.stdout:generic/583 [not run] kernel does not support ceph encryption 2023-07-07T02:03:37.031 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/583 2023-07-07T02:03:37.031 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/583 2023-07-07T02:03:37.031 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:37.033 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:37.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:37.062 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-07-07T02:03:37.298 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:37.302 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:37.303 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:37.304 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:37.304 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:37.909 INFO:teuthology.orchestra.run.smithi006.stdout:generic/584 [not run] kernel does not support ceph encryption 2023-07-07T02:03:37.932 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/584 2023-07-07T02:03:37.933 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/584 2023-07-07T02:03:37.933 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:37.934 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:37.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:37.964 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-07-07T02:03:38.205 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:38.209 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:38.209 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:38.210 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:38.210 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:39.382 INFO:teuthology.orchestra.run.smithi006.stdout:generic/585 [not run] kernel doesn't support renameat2 syscall 2023-07-07T02:03:39.386 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/585 2023-07-07T02:03:39.386 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/585 2023-07-07T02:03:39.386 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:39.388 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:39.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:39.568 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-07-07T02:03:40.072 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:40.076 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:40.077 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:40.077 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:40.078 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:40.811 INFO:teuthology.orchestra.run.smithi006.stdout:generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T02:03:40.843 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/586 2023-07-07T02:03:40.843 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/586 2023-07-07T02:03:40.843 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:40.843 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:41.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:41.034 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-07-07T02:03:41.537 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:41.541 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:41.541 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:41.542 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:41.543 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:41.964 INFO:teuthology.orchestra.run.smithi006.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T02:03:41.968 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/587 2023-07-07T02:03:41.969 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/587 2023-07-07T02:03:41.969 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:41.971 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:41.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:41.996 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-07-07T02:03:42.243 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:42.248 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:42.248 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:42.249 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:42.249 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:43.297 INFO:teuthology.orchestra.run.smithi006.stdout:generic/588 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T02:03:43.316 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/588 2023-07-07T02:03:43.316 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/588 2023-07-07T02:03:43.316 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:43.318 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:43.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:43.347 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-07-07T02:03:43.578 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:43.582 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:43.582 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:43.583 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:43.584 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:43.988 INFO:teuthology.orchestra.run.smithi006.stdout:generic/589 [not run] require 172.21.15.6:6789:/scratch to be local device 2023-07-07T02:03:43.992 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/589 2023-07-07T02:03:43.992 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/589 2023-07-07T02:03:43.992 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:43.994 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:44.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:44.031 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-07-07T02:03:44.278 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:44.283 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:44.283 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:44.284 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:44.284 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:44.651 INFO:teuthology.orchestra.run.smithi006.stdout:generic/590 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T02:03:44.655 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/590 2023-07-07T02:03:44.655 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/590 2023-07-07T02:03:44.655 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:44.657 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:44.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:44.696 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-07-07T02:03:44.946 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:44.950 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:44.951 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:44.952 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:44.952 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:45.485 INFO:teuthology.orchestra.run.smithi006.stdout:generic/591 0s 2023-07-07T02:03:45.490 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/591 2023-07-07T02:03:45.490 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:45.492 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:45.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:45.736 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-07-07T02:03:46.191 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:46.195 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:46.196 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:46.197 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:46.197 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:46.805 INFO:teuthology.orchestra.run.smithi006.stdout:generic/592 [not run] kernel does not support ceph encryption 2023-07-07T02:03:46.821 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/592 2023-07-07T02:03:46.822 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/592 2023-07-07T02:03:46.822 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:46.823 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:46.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:46.849 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-07-07T02:03:47.080 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:47.084 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:47.085 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:47.086 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:47.086 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:47.720 INFO:teuthology.orchestra.run.smithi006.stdout:generic/593 [not run] kernel does not support ceph encryption 2023-07-07T02:03:47.746 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/593 2023-07-07T02:03:47.746 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/593 2023-07-07T02:03:47.746 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:47.748 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:47.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:47.777 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-07-07T02:03:48.006 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:48.012 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:48.012 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:48.013 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:48.014 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:48.404 INFO:teuthology.orchestra.run.smithi006.stdout:generic/594 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T02:03:48.408 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/594 2023-07-07T02:03:48.408 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/594 2023-07-07T02:03:48.409 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:48.411 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:48.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:48.438 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-07-07T02:03:48.684 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:48.688 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:48.688 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:48.689 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:48.690 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:49.276 INFO:teuthology.orchestra.run.smithi006.stdout:generic/595 [not run] kernel does not support ceph encryption 2023-07-07T02:03:49.299 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/595 2023-07-07T02:03:49.299 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/595 2023-07-07T02:03:49.299 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:49.301 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:49.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:49.327 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-07-07T02:03:49.564 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:49.569 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:49.569 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:49.570 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:49.570 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:50.036 INFO:teuthology.orchestra.run.smithi006.stdout:generic/596 [not run] file system doesn't support chattr +S 2023-07-07T02:03:50.041 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/596 2023-07-07T02:03:50.041 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/596 2023-07-07T02:03:50.041 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:50.043 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:50.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:50.078 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-07-07T02:03:50.305 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:50.310 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:50.310 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:50.311 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:50.311 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:51.325 INFO:teuthology.orchestra.run.smithi006.stdout:generic/597 1s 2023-07-07T02:03:51.329 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/597 2023-07-07T02:03:51.330 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:51.332 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:51.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:51.658 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-07-07T02:03:52.029 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:52.033 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:52.033 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:52.034 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:52.034 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:52.827 INFO:teuthology.orchestra.run.smithi006.stdout:generic/598 0s 2023-07-07T02:03:52.833 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/598 2023-07-07T02:03:52.833 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:52.835 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:53.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:53.200 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-07-07T02:03:53.527 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:53.532 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:53.532 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:53.533 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:53.533 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:54.084 INFO:teuthology.orchestra.run.smithi006.stdout:generic/599 [not run] ceph does not support shutdown 2023-07-07T02:03:54.102 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/599 2023-07-07T02:03:54.102 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/599 2023-07-07T02:03:54.102 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:54.104 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:54.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:54.134 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-07-07T02:03:54.380 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:54.384 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:54.384 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:54.385 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:54.386 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:54.778 INFO:teuthology.orchestra.run.smithi006.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T02:03:54.782 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/600 2023-07-07T02:03:54.782 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/600 2023-07-07T02:03:54.782 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:54.784 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:54.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:54.806 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-07-07T02:03:55.043 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:55.047 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:55.048 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:55.049 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:55.049 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:55.412 INFO:teuthology.orchestra.run.smithi006.stdout:generic/601 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T02:03:55.416 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/601 2023-07-07T02:03:55.416 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/601 2023-07-07T02:03:55.416 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:55.418 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:55.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:55.447 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-07-07T02:03:55.693 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:55.697 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:55.697 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:55.698 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:55.698 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:56.305 INFO:teuthology.orchestra.run.smithi006.stdout:generic/602 [not run] kernel does not support ceph encryption 2023-07-07T02:03:56.327 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/602 2023-07-07T02:03:56.327 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/602 2023-07-07T02:03:56.327 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:56.329 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:56.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:56.356 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-07-07T02:03:56.599 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:56.603 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:56.604 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:56.605 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:56.605 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:56.989 INFO:teuthology.orchestra.run.smithi006.stdout:generic/603 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T02:03:56.993 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/603 2023-07-07T02:03:56.994 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/603 2023-07-07T02:03:56.994 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:03:56.996 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:03:57.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:03:57.026 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-07-07T02:03:57.264 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:03:57.268 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:03:57.269 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:03:57.270 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:03:57.270 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:01.172 INFO:teuthology.orchestra.run.smithi006.stdout:generic/604 4s 2023-07-07T02:04:01.177 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/604 2023-07-07T02:04:01.178 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:01.180 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:01.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:01.189 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-07-07T02:04:01.416 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:01.420 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:01.420 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:01.421 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:01.421 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:02.925 INFO:teuthology.orchestra.run.smithi006.stdout:generic/605 [not run] mount 172.21.15.6:6789:/scratch with dax=always failed 2023-07-07T02:04:02.929 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/605 2023-07-07T02:04:02.929 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/605 2023-07-07T02:04:02.929 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:02.931 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:02.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:02.957 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-07-07T02:04:03.187 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:03.192 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:03.192 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:03.193 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:03.193 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:04.119 INFO:teuthology.orchestra.run.smithi006.stdout:generic/606 [not run] mount 172.21.15.6:6789:/scratch with dax=always failed 2023-07-07T02:04:04.123 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/606 2023-07-07T02:04:04.123 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/606 2023-07-07T02:04:04.124 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:04.126 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:04.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:04.157 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-07-07T02:04:04.378 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:04.382 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:04.382 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:04.383 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:04.384 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:04.758 INFO:teuthology.orchestra.run.smithi006.stdout:generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) 2023-07-07T02:04:04.762 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/607 2023-07-07T02:04:04.762 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/607 2023-07-07T02:04:04.762 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:04.764 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:05.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:05.191 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-07-07T02:04:05.457 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:05.461 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:05.462 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:05.462 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:05.463 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:05.953 INFO:teuthology.orchestra.run.smithi006.stdout:generic/608 [not run] mount 172.21.15.6:6789:/scratch with dax=always failed 2023-07-07T02:04:05.957 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/608 2023-07-07T02:04:05.958 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/608 2023-07-07T02:04:05.958 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:05.960 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:05.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:05.986 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-07-07T02:04:06.221 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:06.225 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:06.226 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:06.227 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:06.227 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:06.792 INFO:teuthology.orchestra.run.smithi006.stdout:generic/609 0s 2023-07-07T02:04:06.797 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/609 2023-07-07T02:04:06.798 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:06.800 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:06.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:06.897 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-07-07T02:04:07.494 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:07.498 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:07.498 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:07.499 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:07.500 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:07.944 INFO:teuthology.orchestra.run.smithi006.stdout:generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-07T02:04:07.948 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/610 2023-07-07T02:04:07.948 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/610 2023-07-07T02:04:07.949 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:07.950 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:07.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:07.981 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-07-07T02:04:08.237 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:08.241 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:08.241 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:08.242 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:08.242 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:09.044 INFO:teuthology.orchestra.run.smithi006.stdout:generic/611 1s 2023-07-07T02:04:09.049 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/611 2023-07-07T02:04:09.049 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:09.051 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:09.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:09.060 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-07-07T02:04:09.283 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:09.288 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:09.288 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:09.289 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:09.289 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:09.718 INFO:teuthology.orchestra.run.smithi006.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T02:04:09.722 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/612 2023-07-07T02:04:09.722 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/612 2023-07-07T02:04:09.722 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:09.724 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:09.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:09.892 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-07-07T02:04:10.426 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:10.431 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:10.431 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:10.432 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:10.432 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:10.994 INFO:teuthology.orchestra.run.smithi006.stdout:generic/613 [not run] kernel does not support ceph encryption 2023-07-07T02:04:11.020 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/613 2023-07-07T02:04:11.020 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/613 2023-07-07T02:04:11.020 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:11.022 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:11.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:11.045 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-07-07T02:04:11.265 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:11.270 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:11.270 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:11.271 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:11.271 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:11.829 INFO:teuthology.orchestra.run.smithi006.stdout:generic/614 [not run] test requires delayed allocation buffered writes 2023-07-07T02:04:11.864 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/614 2023-07-07T02:04:11.864 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/614 2023-07-07T02:04:11.865 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:11.866 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:11.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:11.904 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-07-07T02:04:12.131 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:12.135 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:12.136 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:12.137 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:12.137 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:47.316 INFO:teuthology.orchestra.run.smithi006.stdout:generic/615 35s 2023-07-07T02:04:47.355 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/615 2023-07-07T02:04:47.356 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:47.357 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:47.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:47.367 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-07-07T02:04:47.603 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:47.607 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:47.608 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:47.609 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:47.609 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:48.004 INFO:teuthology.orchestra.run.smithi006.stdout:generic/616 [not run] kernel does not support IO_URING 2023-07-07T02:04:48.008 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/616 2023-07-07T02:04:48.008 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/616 2023-07-07T02:04:48.009 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:48.010 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:48.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:48.049 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-07-07T02:04:48.277 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:48.282 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:48.282 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:48.283 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:48.283 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:48.826 INFO:teuthology.orchestra.run.smithi006.stdout:generic/617 [not run] kernel does not support IO_URING 2023-07-07T02:04:48.830 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/617 2023-07-07T02:04:48.831 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/617 2023-07-07T02:04:48.831 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:48.833 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:48.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:48.870 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-07-07T02:04:49.099 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:49.103 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:49.104 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:49.105 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:49.105 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:50.134 INFO:teuthology.orchestra.run.smithi006.stdout:generic/618 1s 2023-07-07T02:04:50.139 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/618 2023-07-07T02:04:50.139 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:50.141 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:50.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:50.150 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-07-07T02:04:50.375 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:50.379 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:50.380 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:50.381 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:50.381 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:50.749 INFO:teuthology.orchestra.run.smithi006.stdout:generic/619 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T02:04:50.753 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/619 2023-07-07T02:04:50.753 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/619 2023-07-07T02:04:50.753 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:50.755 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:50.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:50.788 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-07-07T02:04:51.031 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:51.035 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:51.035 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:51.036 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:51.036 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:51.445 INFO:teuthology.orchestra.run.smithi006.stdout:generic/620 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-07T02:04:51.449 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/620 2023-07-07T02:04:51.450 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/620 2023-07-07T02:04:51.450 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:51.452 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:51.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:51.480 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-07-07T02:04:51.726 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:51.730 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:51.730 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:51.731 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:51.731 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:52.343 INFO:teuthology.orchestra.run.smithi006.stdout:generic/621 [not run] kernel does not support ceph encryption 2023-07-07T02:04:52.370 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/621 2023-07-07T02:04:52.371 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/621 2023-07-07T02:04:52.371 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:52.372 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:52.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:52.407 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-07-07T02:04:52.635 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:52.639 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:52.639 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:52.640 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:52.640 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:53.204 INFO:teuthology.orchestra.run.smithi006.stdout:generic/622 [not run] ceph does not support shutdown 2023-07-07T02:04:53.226 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/622 2023-07-07T02:04:53.226 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/622 2023-07-07T02:04:53.227 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:53.229 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:53.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:53.261 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-07-07T02:04:53.492 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:53.496 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:53.496 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:53.497 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:53.498 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:54.014 INFO:teuthology.orchestra.run.smithi006.stdout:generic/623 [not run] ceph does not support shutdown 2023-07-07T02:04:54.037 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/623 2023-07-07T02:04:54.038 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/623 2023-07-07T02:04:54.038 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:54.040 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:54.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:54.070 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-07-07T02:04:54.293 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:54.298 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:54.298 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:54.299 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:54.299 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:54.647 INFO:teuthology.orchestra.run.smithi006.stdout:generic/624 [not run] fsverity utility required, skipped this test 2023-07-07T02:04:54.650 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/624 2023-07-07T02:04:54.651 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/624 2023-07-07T02:04:54.651 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:54.653 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:54.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:54.687 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-07-07T02:04:54.918 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:54.922 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:54.922 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:54.923 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:54.923 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:55.294 INFO:teuthology.orchestra.run.smithi006.stdout:generic/625 [not run] fsverity utility required, skipped this test 2023-07-07T02:04:55.298 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/625 2023-07-07T02:04:55.298 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/625 2023-07-07T02:04:55.298 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:55.300 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:55.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:55.336 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-07-07T02:04:55.561 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:55.565 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:55.565 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:55.566 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:55.567 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:55.955 INFO:teuthology.orchestra.run.smithi006.stdout:generic/626 [not run] kernel doesn't support renameat2 syscall 2023-07-07T02:04:55.959 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/626 2023-07-07T02:04:55.959 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/626 2023-07-07T02:04:55.959 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:55.961 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:56.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:56.301 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-07-07T02:04:56.645 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:56.649 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:56.649 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:56.650 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:56.650 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:57.049 INFO:teuthology.orchestra.run.smithi006.stdout:generic/627 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-07T02:04:57.053 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/627 2023-07-07T02:04:57.053 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/627 2023-07-07T02:04:57.053 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:57.055 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:57.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:57.096 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-07-07T02:04:57.334 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:57.338 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:57.338 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:57.339 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:57.340 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:58.132 INFO:teuthology.orchestra.run.smithi006.stdout:generic/628 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T02:04:58.323 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/628 2023-07-07T02:04:58.323 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/628 2023-07-07T02:04:58.324 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:58.332 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:58.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:58.361 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-07-07T02:04:58.594 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:58.598 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:58.598 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:58.599 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:58.599 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:58.947 INFO:teuthology.orchestra.run.smithi006.stdout:generic/629 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-07T02:04:58.951 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/629 2023-07-07T02:04:58.951 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/629 2023-07-07T02:04:58.951 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:04:58.953 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:58.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:04:58.977 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-07-07T02:04:59.209 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:04:59.213 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:04:59.213 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:04:59.214 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:04:59.214 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:04:59.785 INFO:teuthology.orchestra.run.smithi006.stdout:generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-07-07T02:05:00.040 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/630 2023-07-07T02:05:00.041 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/630 2023-07-07T02:05:00.041 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:05:00.087 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:05:00.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:05:00.263 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-07-07T02:05:00.491 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:05:00.495 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:05:00.496 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:05:00.497 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:05:00.497 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:05:31.961 INFO:teuthology.orchestra.run.smithi006.stdout:generic/631 - output mismatch (see /tmp/tmp.LybHGoQKZdxfstests-dev/results//generic/631.out.bad) 2023-07-07T02:05:31.972 INFO:teuthology.orchestra.run.smithi006.stdout: --- tests/generic/631.out 2023-07-06 20:00:31.461358113 +0000 2023-07-07T02:05:31.972 INFO:teuthology.orchestra.run.smithi006.stdout: +++ /tmp/tmp.LybHGoQKZdxfstests-dev/results//generic/631.out.bad 2023-07-07 02:05:31.950819528 +0000 2023-07-07T02:05:31.972 INFO:teuthology.orchestra.run.smithi006.stdout: @@ -1,2 +1,3164 @@ 2023-07-07T02:05:31.972 INFO:teuthology.orchestra.run.smithi006.stdout: QA output created by 631 2023-07-07T02:05:31.972 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.972 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.973 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.973 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.973 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.973 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:31.973 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.973 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.973 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:31.973 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf' 2023-07-07T02:05:31.974 INFO:teuthology.orchestra.run.smithi006.stdout: +: No such file or directory 2023-07-07T02:05:31.974 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:31.974 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:31.974 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:31.974 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:31.974 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:31.974 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:31.975 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:31.975 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:31.975 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.975 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:31.975 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:31.975 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:31.975 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:31.975 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:31.976 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:31.976 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:31.976 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:31.976 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:31.976 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:31.976 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.976 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:31.976 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:31.977 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:31.977 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:31.977 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:31.977 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.977 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.977 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.977 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.977 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.978 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:31.978 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.978 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:31.978 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:31.978 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:31.978 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:31.978 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:31.979 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.979 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:31.979 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.979 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:31.979 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:31.979 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:31.979 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:31.979 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.980 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:31.980 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:31.980 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:31.980 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:31.980 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:31.980 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:31.980 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:31.980 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:31.981 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:31.981 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:31.981 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:31.981 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:31.981 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:31.981 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:31.981 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:31.981 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:31.982 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.982 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.982 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.982 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.982 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.982 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:31.982 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.983 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.983 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:31.983 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:31.983 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.983 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:31.983 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:31.983 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-07-07T02:05:31.984 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:31.984 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:31.984 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:31.984 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf'cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-07-07T02:05:31.984 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:31.984 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:31.984 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:31.984 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directorymv: 2023-07-07T02:05:31.985 INFO:teuthology.orchestra.run.smithi006.stdout: +cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:31.985 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:31.985 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:31.985 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:31.985 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:31.985 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:31.985 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:31.986 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:31.986 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:31.986 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:31.986 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:31.986 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:31.986 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:31.986 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:31.986 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.987 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.987 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.987 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.987 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.987 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:31.987 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.987 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:31.987 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:31.988 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:31.988 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:31.988 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:31.988 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.988 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:31.988 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.988 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:31.988 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:31.989 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:31.989 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:31.989 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:31.989 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:31.989 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.989 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:31.989 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:31.989 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:31.990 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:31.990 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:31.990 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:31.990 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:31.990 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.990 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:31.990 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:31.990 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:31.991 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:31.991 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:31.991 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:31.991 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.991 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.991 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.991 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.991 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.992 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:31.992 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.992 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:31.992 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:31.992 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:31.992 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:31.992 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:31.993 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.993 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:31.993 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:31.993 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:31.993 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:31.993 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.993 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:31.993 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:31.994 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:31.994 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:31.994 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:31.994 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:31.994 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.994 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.994 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.994 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.995 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.995 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:31.995 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.995 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:31.995 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:31.995 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:31.995 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:31.995 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:31.996 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.996 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:31.996 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:31.996 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:31.996 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:31.996 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:31.996 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.997 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.997 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:31.997 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:31.997 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:31.997 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:31.997 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:31.997 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:31.997 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:31.998 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:31.998 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:31.998 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:31.998 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.998 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:31.998 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:31.998 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:31.998 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:31.999 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:31.999 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.999 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:31.999 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.999 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.999 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:31.999 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:31.999 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.000 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.000 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.000 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.000 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.000 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.000 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.000 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.000 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.001 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.001 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.001 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.001 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.001 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.001 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.001 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.001 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.002 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.002 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.002 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.002 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.002 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.002 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.002 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.003 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.003 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.003 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.003 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.003 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.003 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.003 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.003 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.004 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.004 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.004 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.004 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.004 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.004 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.004 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.004 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.005 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.005 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.005 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.005 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.005 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.005 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.005 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.005 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.006 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.006 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.006 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.006 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.006 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.006 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.006 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.006 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.007 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.007 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.007 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.007 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.007 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.007 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.007 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.008 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.008 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.008 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.008 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.008 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.008 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.008 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.008 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.009 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.009 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.009 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.009 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.009 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.009 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.009 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.009 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.010 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.010 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.010 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.010 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.010 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.010 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.010 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.010 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.011 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.011 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.011 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.011 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.011 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.011 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.011 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.011 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.012 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.012 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.012 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.012 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.012 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.012 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.012 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.013 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.013 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.013 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.013 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.013 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.013 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.013 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.013 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.014 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.014 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.014 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.014 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.014 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.014 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.014 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.014 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.015 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.015 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.015 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.015 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.015 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.015 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.015 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.015 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.016 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.016 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.016 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.016 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.016 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.016 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.016 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.016 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.017 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.017 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.017 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.017 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.017 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.017 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.017 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.017 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.018 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.018 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.018 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.018 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.018 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.018 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.018 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.018 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.019 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.019 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.019 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.019 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.019 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.019 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.019 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.019 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.020 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.020 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.020 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.020 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.020 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.020 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.020 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.021 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.021 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.021 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.021 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.021 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.021 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.021 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.021 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.022 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.022 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.022 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.022 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.022 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.022 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.022 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.022 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.023 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.023 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.023 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.023 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.023 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.023 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.023 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.023 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.024 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.024 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.024 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.024 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.024 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.024 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.024 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.025 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.025 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.025 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.025 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.025 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.025 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.025 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.025 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.026 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.026 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.026 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.026 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.026 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.026 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.026 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.026 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.027 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.027 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.027 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.027 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.027 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.027 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.027 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.027 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.028 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.028 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.028 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.028 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.028 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.028 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.028 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.028 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.029 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.029 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.029 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.029 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.029 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.029 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.029 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.029 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.030 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.030 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.030 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.030 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.030 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.030 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.030 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.030 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.031 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.031 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.031 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.031 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.031 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.031 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.031 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.031 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.032 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.032 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.032 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.032 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.032 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.032 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.032 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.032 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.033 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.033 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.033 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.033 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.033 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.033 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.033 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.033 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.034 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.034 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.034 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.034 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.034 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.034 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.034 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.034 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.035 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.035 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.035 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.035 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.035 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.035 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.035 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.035 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.036 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.036 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.036 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.036 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.036 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.036 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.036 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.037 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.037 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.037 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.037 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.037 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.037 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.037 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.037 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.038 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.038 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.038 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.038 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.038 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.038 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.038 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.038 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.039 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.039 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.039 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.039 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.039 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.039 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.039 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.039 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.040 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.040 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.040 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.040 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.040 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.040 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.040 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.041 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.041 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.041 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.041 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.041 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.041 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.041 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.041 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.042 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.042 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.042 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.042 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.042 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.042 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.042 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.042 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.043 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.043 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.043 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.043 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.043 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.043 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.043 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.043 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.044 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.044 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.044 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.044 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.044 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.044 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.044 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.045 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.045 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.045 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.045 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.045 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.045 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.045 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.045 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.046 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.046 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.046 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.046 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.046 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.046 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.046 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.046 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.047 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.047 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.047 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.047 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.047 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.047 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.047 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.047 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.048 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.048 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.048 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.048 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.048 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.048 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.048 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.048 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.049 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.049 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.049 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.049 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.049 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.049 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.049 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.049 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.050 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.050 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.050 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.050 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.050 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.050 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.050 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.050 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.051 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.051 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.051 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.051 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.051 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.051 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.051 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.051 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.052 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.052 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.052 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.052 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.052 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.052 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.052 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.053 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.053 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.053 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.053 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.053 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.053 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.053 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.053 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.054 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.054 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.054 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.054 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.054 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.054 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.054 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.054 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted./tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.055 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.055 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.055 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.055 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.055 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.055 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.055 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.055 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.056 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.056 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.056 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.056 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.056 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.056 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.056 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.056 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.057 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.057 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.057 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.057 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.057 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.057 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.057 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.057 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.058 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.058 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.058 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.058 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.058 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.058 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.058 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.058 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.059 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.059 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.059 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.059 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.059 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.059 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.059 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.060 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.060 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.060 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.060 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.060 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.060 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.060 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.060 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.061 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.061 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.061 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.061 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.061 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.061 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.061 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.061 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.062 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.062 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.062 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.062 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.062 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.062 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.062 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.062 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.063 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.063 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.063 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.063 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.063 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.063 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.063 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.063 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.064 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.064 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.064 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.064 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.064 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.064 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.064 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.065 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.065 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.065 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.065 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.065 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.065 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.065 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.065 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.066 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.066 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.066 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.066 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.066 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.066 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.066 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.066 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.067 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: touch: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf'cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.067 INFO:teuthology.orchestra.run.smithi006.stdout: +: No such file or directory 2023-07-07T02:05:32.067 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.067 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.067 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.067 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.067 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.067 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.068 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.068 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.068 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.068 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.068 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.068 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.068 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.068 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.069 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.069 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.069 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.069 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.069 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.069 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.069 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.069 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.070 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.070 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.070 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.070 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.070 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.070 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.070 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.070 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.071 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.071 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.071 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.071 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.071 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.071 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.071 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.071 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.072 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.072 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.072 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.072 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.072 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.072 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.072 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.073 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.073 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.073 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.073 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted./tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.073 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.073 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.073 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.073 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.074 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.074 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.074 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.074 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.074 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.074 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.074 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.074 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.075 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.075 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.075 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.075 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.075 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.075 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.075 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.075 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.076 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.076 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.076 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.076 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.076 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.076 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.076 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.076 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.077 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.077 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.077 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.077 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.077 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.077 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.077 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.077 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.078 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.078 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.078 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.078 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.078 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.078 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.078 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.078 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.079 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.079 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.079 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.079 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.079 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.079 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.079 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.079 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.080 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.080 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.080 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.080 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.080 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.080 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.080 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.080 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.081 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf'umount: : No such file or directory/tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.081 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.081 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.081 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.081 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.081 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.081 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.081 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.082 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.082 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.082 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.082 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.082 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.082 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.082 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.083 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.083 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.083 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.083 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.083 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.083 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.083 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.083 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.084 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.084 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.084 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.084 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.084 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.084 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.084 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.084 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.085 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.085 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.085 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.085 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.085 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.085 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.085 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.085 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.086 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.086 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.086 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.086 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.086 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.086 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.086 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.086 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.087 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.087 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.087 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.087 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.087 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.087 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.087 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.087 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.088 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.088 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.088 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.088 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.088 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.088 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.088 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.088 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.089 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.089 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.089 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.089 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.089 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.089 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.089 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.089 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.090 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.090 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.090 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.090 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.090 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.090 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.090 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.090 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.091 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.091 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.091 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: touch: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf' 2023-07-07T02:05:32.091 INFO:teuthology.orchestra.run.smithi006.stdout: +: No such file or directory 2023-07-07T02:05:32.091 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.091 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.091 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.091 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.092 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.092 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.092 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.092 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.092 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.092 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.092 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.093 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.093 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.093 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.093 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.093 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.093 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.093 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.093 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.094 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.094 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.094 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.094 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.094 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.094 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.094 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.094 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.095 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.095 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.095 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.095 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.095 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.095 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.095 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.095 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.096 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.096 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.096 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.096 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.096 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.096 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.096 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.097 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.097 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.097 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.097 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.097 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.097 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.097 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.097 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.098 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.098 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.098 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.098 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.098 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.098 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.098 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.099 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.099 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.099 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.099 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.099 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.099 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.099 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.099 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.100 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.100 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.100 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.100 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.100 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.100 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.100 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.100 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.101 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.101 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.101 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.101 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.101 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.101 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.101 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.101 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.102 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.102 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.102 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.102 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.102 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.102 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.102 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.102 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.103 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.103 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.103 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.103 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: mv: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted.cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf' 2023-07-07T02:05:32.103 INFO:teuthology.orchestra.run.smithi006.stdout: +: No such file or directory 2023-07-07T02:05:32.103 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.103 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.104 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.104 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.104 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.104 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.104 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.104 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.104 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.104 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.105 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.105 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.105 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.105 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.105 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.105 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.105 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.105 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.106 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.106 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.106 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.106 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.106 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.106 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.106 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.106 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.107 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.107 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.107 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.107 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.107 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.107 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.107 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.107 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.108 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.108 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.108 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.108 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.108 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.108 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.108 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.108 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.109 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.109 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.109 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.109 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.109 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.109 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.109 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.109 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.110 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.110 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.110 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.110 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.110 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.110 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.110 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.110 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.111 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.111 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.111 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.111 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.111 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.111 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.111 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.111 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.112 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.112 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.112 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-07-07T02:05:32.112 INFO:teuthology.orchestra.run.smithi006.stdout: +/tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.112 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.112 INFO:teuthology.orchestra.run.smithi006.stdout: +: No such file or directory 2023-07-07T02:05:32.112 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.113 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.113 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.113 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.113 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.113 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.113 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.113 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.113 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.114 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.114 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.114 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.114 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.114 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.114 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.114 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.114 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.115 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.115 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.115 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.115 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.115 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.115 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.115 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.115 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.116 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.116 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.116 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.116 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.116 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.116 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.116 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.116 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.117 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.117 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.117 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.117 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.117 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.117 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.117 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.117 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.118 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.118 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.118 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.118 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.118 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.118 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.118 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.119 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.119 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.119 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.119 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.119 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.119 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.119 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.119 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.120 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.120 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.120 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.120 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.120 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.120 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.120 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.120 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.121 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.121 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.121 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.121 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.121 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.121 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.121 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.121 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.122 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.122 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.122 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.122 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.122 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.122 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.122 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.122 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.123 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.123 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.123 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.123 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.123 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.123 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.123 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.123 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.124 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.124 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.124 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.124 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.124 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.124 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.124 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.125 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.125 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.125 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.125 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.125 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.125 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.125 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.125 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.126 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.126 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.126 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.126 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.126 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.126 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.126 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.126 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.127 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.127 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.127 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.127 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.127 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.127 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.127 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.127 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.128 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.128 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.128 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.128 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.128 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.128 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.128 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.128 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.129 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.129 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.129 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.129 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.129 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.129 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.129 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.129 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.130 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.130 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.130 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.130 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.130 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.130 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.130 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.130 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.131 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.131 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.131 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.131 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.131 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.131 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.131 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.131 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.132 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.132 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.132 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.132 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.132 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.132 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-07-07T02:05:32.132 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.133 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.133 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.133 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.133 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.133 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.133 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.133 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.133 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.134 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.134 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.134 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.134 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.134 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.134 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.134 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.134 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.135 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.135 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.135 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.135 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf'/tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.: No such file or directory 2023-07-07T02:05:32.135 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.135 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.135 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.135 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.136 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.136 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.136 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.136 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.136 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.136 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.136 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.137 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.137 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.137 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.137 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.137 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.137 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.137 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.137 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.138 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.138 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.138 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.138 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.138 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.138 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.138 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.138 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.139 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.139 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.139 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.139 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.139 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.139 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.139 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.139 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.140 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.140 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.140 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.140 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.140 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.140 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.140 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.140 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.141 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.141 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.141 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.141 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.141 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.141 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.141 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.141 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.142 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.142 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.142 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.142 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.142 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.142 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.142 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.143 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.143 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.143 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.143 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.143 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.143 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.143 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.143 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.144 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.144 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.144 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.144 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.144 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.144 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.144 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.144 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.145 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.145 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.145 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.145 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.145 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.145 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.145 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.145 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.146 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.146 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.146 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.146 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.146 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.146 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.146 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.146 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.147 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.147 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.147 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.147 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.147 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.147 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.147 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.147 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.148 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.148 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.148 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.148 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.148 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.148 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.148 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.148 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.149 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.149 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.149 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.149 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.149 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.149 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.149 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.149 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.150 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.150 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.150 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.150 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.150 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.150 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.150 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.150 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.151 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.151 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.151 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.151 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.151 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.151 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.151 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.151 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.152 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.152 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.152 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.152 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.152 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.152 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.152 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.153 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.153 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.153 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.153 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.153 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.153 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.153 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.154 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.154 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.154 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.154 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.154 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.154 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.154 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.154 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.155 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.155 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.155 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf'cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.155 INFO:teuthology.orchestra.run.smithi006.stdout: +: No such file or directory 2023-07-07T02:05:32.155 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.155 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.155 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.155 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.156 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.156 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.156 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.156 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.156 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.156 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.156 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.156 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.157 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.157 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.157 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.157 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.157 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.157 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.157 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.157 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.158 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.158 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.158 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.158 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.158 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.158 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.158 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.158 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.159 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.159 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.159 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.159 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.159 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.159 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.159 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.159 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.160 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.160 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.160 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.160 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.160 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.160 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.160 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.161 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.161 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.161 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.161 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.161 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.161 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.161 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.161 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.162 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.162 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.162 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.162 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.162 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.162 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.162 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.162 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.163 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.163 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.163 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.163 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.163 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.163 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.163 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.163 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.164 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.164 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.164 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.164 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.164 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.164 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.164 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.165 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.165 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.165 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.165 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.165 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.165 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.165 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.165 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.166 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.166 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.166 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.166 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.166 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.166 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.166 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.166 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.167 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.167 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.167 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.167 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.167 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.167 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.167 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.167 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.168 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.168 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.168 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.168 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.168 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.168 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.168 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.168 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.169 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.169 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.169 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.169 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.169 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.169 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.169 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.169 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.170 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.170 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.170 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.170 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.170 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.170 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.170 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.170 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.171 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.171 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.171 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.171 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.171 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.171 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.171 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.171 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.172 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.172 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.172 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.172 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.172 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.172 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.172 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.173 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.173 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.173 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.173 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.173 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.173 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.173 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.173 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.174 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.174 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.174 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.174 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.174 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.174 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.174 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.174 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.175 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.175 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.175 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.175 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.175 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.175 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.175 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.175 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.176 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.176 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.176 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.176 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.176 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.176 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.176 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.176 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.177 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.177 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.177 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.177 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.177 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.177 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.177 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.177 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.178 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.178 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.178 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.178 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.178 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.178 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.178 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.178 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.179 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.179 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.179 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.179 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.179 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.179 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.179 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.179 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.180 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.180 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.180 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.180 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.180 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.180 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.180 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.181 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.181 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.181 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.181 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.181 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.181 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.181 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.181 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.182 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.182 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.182 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.182 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.182 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.182 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.182 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.182 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.183 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.183 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.183 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.183 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.183 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.183 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.183 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.183 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.184 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.184 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.184 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.184 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.184 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.184 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.184 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.184 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.185 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.185 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.185 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.185 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.185 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.185 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.185 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.185 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.186 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.186 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.186 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.186 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.186 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.186 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.186 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.186 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.187 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.187 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.187 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.187 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.187 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.187 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.187 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.187 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.188 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.188 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.188 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.188 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.188 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.188 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.188 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.188 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.189 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.189 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.189 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.189 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.189 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.189 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.189 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.189 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.190 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.190 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.190 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.190 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.190 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.190 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.190 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.190 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.191 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.191 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.191 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.191 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.191 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.191 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.191 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.191 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.192 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.192 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.192 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.192 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.192 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.192 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.192 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.193 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.193 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.193 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.193 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.193 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.193 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.193 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.193 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.194 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.194 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.194 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.194 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.194 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.194 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.194 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.194 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.195 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.195 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.195 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf'mount: : No such file or directory/tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.195 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.195 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.195 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.195 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.195 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.196 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.196 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.196 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.196 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.196 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.196 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.196 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.197 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.197 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.197 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.197 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.197 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.197 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.197 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.197 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.198 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.198 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.198 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.198 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.198 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.198 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.198 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.198 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.199 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.199 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.199 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.199 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.199 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.199 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.199 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.199 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.200 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.200 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.200 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.200 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.200 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.200 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.200 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.200 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.201 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.201 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.201 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.201 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.201 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.201 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.201 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.201 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.202 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.202 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.202 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.202 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.202 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.202 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.202 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.202 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.203 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.203 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.203 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.203 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.203 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.203 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.203 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.203 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.204 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.204 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.204 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.204 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.204 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.204 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.204 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.205 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.205 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-07-07T02:05:32.205 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.205 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.205 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.205 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.205 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.205 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.206 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf' 2023-07-07T02:05:32.206 INFO:teuthology.orchestra.run.smithi006.stdout: +: No such file or directory 2023-07-07T02:05:32.206 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.206 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.206 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.206 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.206 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.206 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.207 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.207 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.207 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.207 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.207 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.207 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.207 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.207 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.208 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.208 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.208 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.208 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.208 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.208 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.208 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.209 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.209 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf' 2023-07-07T02:05:32.209 INFO:teuthology.orchestra.run.smithi006.stdout: +: No such file or directory 2023-07-07T02:05:32.209 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.209 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.209 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf'cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-07-07T02:05:32.209 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.209 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.210 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.210 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.210 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.210 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.210 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.210 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-07-07T02:05:32.210 INFO:teuthology.orchestra.run.smithi006.stdout: +/tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.210 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.211 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.211 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.211 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.211 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.211 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.211 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.211 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.211 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.212 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.212 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.212 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.212 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.212 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.212 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.212 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.212 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.213 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.213 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.213 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.213 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.213 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.213 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.213 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.214 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.214 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.214 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.214 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.214 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-07-07T02:05:32.214 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.214 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.214 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.215 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf'cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-07-07T02:05:32.215 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.215 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.215 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-07-07T02:05:32.215 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.215 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.215 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.215 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.216 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.216 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.216 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.216 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.216 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.216 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.216 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.216 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.217 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.217 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.217 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.217 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.217 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.217 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.217 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.217 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.218 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.218 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.218 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.218 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.218 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.218 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.218 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.218 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.219 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.219 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.219 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.219 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.219 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.219 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.219 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.219 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.220 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.220 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.220 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.220 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.220 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.220 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.220 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.220 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.221 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.221 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.221 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.221 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.221 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.221 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.221 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.221 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.222 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.222 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.222 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.222 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.222 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.222 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.223 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.223 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.223 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.223 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.223 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.223 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.223 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.223 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.224 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.224 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.224 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.224 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.224 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.224 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.224 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.224 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.225 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.225 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.225 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf' 2023-07-07T02:05:32.225 INFO:teuthology.orchestra.run.smithi006.stdout: +: No such file or directory 2023-07-07T02:05:32.225 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.225 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.225 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.225 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.226 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.226 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.226 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.226 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.226 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.226 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.226 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.226 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.227 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.227 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.227 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.227 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.227 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.227 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.227 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.227 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.228 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.228 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.228 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.228 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.228 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.228 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.228 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.229 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.229 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.229 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.229 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.229 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.229 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.229 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.229 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.230 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.230 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.230 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.230 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.230 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.230 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.230 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.230 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.231 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.231 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.231 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.231 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.231 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.231 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.231 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.231 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.232 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.232 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.232 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.232 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.232 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.232 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.232 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.232 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.233 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.233 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.233 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.233 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.233 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.233 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.233 INFO:teuthology.orchestra.run.smithi006.stdout: +: No such file or directorymv: 2023-07-07T02:05:32.233 INFO:teuthology.orchestra.run.smithi006.stdout: +cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.234 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.234 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.234 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.234 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.234 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.234 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.234 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.234 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.235 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.235 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.235 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.235 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.235 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.235 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.235 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.235 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.236 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.236 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.236 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.236 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.236 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.236 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.236 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.236 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.237 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.237 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.237 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.237 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.237 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.237 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.237 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.237 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.238 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.238 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.238 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.238 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.238 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.238 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.238 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.238 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.239 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.239 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.239 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.239 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.239 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.239 INFO:teuthology.orchestra.run.smithi006.stdout: +: No such file or directory 2023-07-07T02:05:32.239 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.239 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.240 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.240 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.240 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.240 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.240 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.240 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.240 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.241 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.241 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.241 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.241 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.241 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.241 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.241 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.241 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.242 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.242 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.242 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.242 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.242 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.242 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.242 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.242 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.243 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.243 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.243 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.243 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.243 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.243 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.243 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.243 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.244 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.244 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.244 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.244 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.244 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.244 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.244 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.244 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.245 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.245 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.245 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.245 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.245 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.245 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.245 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.245 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.246 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.246 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.246 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.246 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.246 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.246 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.246 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.246 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.247 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.247 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.247 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.247 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.247 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.247 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.247 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.247 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.248 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.248 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.248 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.248 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.248 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.248 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.248 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.249 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.249 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.249 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.249 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.249 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.249 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.249 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.249 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.250 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.250 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.250 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.250 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.250 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.250 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.250 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.250 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.251 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.251 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.251 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.251 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.251 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.251 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.251 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.251 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.252 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.252 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.252 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.252 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.252 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.252 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.252 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.252 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.253 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.253 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.253 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.253 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.253 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.253 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.253 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.253 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.254 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.254 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.254 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.254 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.254 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.254 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.254 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.254 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.255 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.255 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.255 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.255 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.255 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.255 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.255 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.255 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.256 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.256 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.256 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.256 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.256 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.256 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.256 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.256 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.257 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.257 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.257 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.257 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.257 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.257 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.257 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.257 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.258 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.258 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.258 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.258 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.258 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.258 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.258 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.258 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.259 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.259 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.259 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.259 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.259 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.259 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.259 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.259 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.260 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.260 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.260 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.260 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.260 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.260 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.260 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.260 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.261 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.261 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.261 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.261 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.261 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.261 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted./tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.261 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.261 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.262 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.262 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.262 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.262 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.262 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.262 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.262 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.262 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.263 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.263 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.263 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.263 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.263 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.263 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.263 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.264 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.264 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.264 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.264 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.264 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.264 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.264 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.264 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.265 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.265 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.265 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.265 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.265 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.265 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.265 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.265 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.266 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.266 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.266 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.266 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.266 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.266 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.266 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.266 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.267 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.267 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.267 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.267 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.267 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.267 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.267 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.267 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.268 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.268 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.268 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.268 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.268 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.268 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.268 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.269 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.269 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.269 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.269 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.269 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.269 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.269 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.269 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.270 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.270 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.270 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.270 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.270 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.270 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.270 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.270 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.271 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.271 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.271 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.271 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.271 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.271 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.271 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.271 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.272 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.272 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.272 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.272 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.272 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.272 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.272 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.272 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.273 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.273 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.273 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.273 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.273 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.273 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.273 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.273 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.274 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.274 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.274 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.274 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.274 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.274 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.274 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.274 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.275 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.275 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.275 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.275 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.275 INFO:teuthology.orchestra.run.smithi006.stdout: +/tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.275 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.275 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.275 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.276 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.276 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.276 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.276 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.276 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.276 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.276 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.277 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.277 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.277 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.277 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.277 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.277 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.277 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.277 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.278 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.278 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.278 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.278 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.278 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.278 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.278 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.278 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.279 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.279 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.279 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.279 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.279 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.279 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.279 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.279 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.280 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.280 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.280 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.280 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.280 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.280 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.280 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.280 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.281 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.281 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.281 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.281 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.281 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.281 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.281 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.282 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.282 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.282 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.282 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.282 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.282 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.282 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.282 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.283 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.283 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.283 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.283 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.283 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.283 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.283 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.283 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.284 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.284 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.284 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.284 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.284 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.284 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.284 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.284 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.285 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.285 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-07-07T02:05:32.285 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.285 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.285 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.285 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.285 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.285 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.286 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.286 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.286 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.286 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.286 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.286 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.286 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.286 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.287 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.287 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.287 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.287 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.287 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.287 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.287 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.287 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.288 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.288 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.288 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.288 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.288 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.288 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.288 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.289 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.289 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.289 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.289 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.289 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.289 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.289 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.289 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.290 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.290 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.290 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.290 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.290 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.290 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.290 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.290 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.291 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.291 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.291 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.291 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.291 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.291 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.291 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.291 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.292 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.292 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.292 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.292 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.292 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.292 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.292 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.292 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.293 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.293 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.293 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.293 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.293 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.293 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.293 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.294 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.294 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.294 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.294 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.294 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.294 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.294 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.294 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.295 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.295 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.295 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.295 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.295 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.295 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.295 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.295 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.296 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.296 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.296 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.296 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.296 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.296 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.296 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.296 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.297 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.297 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.297 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.297 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.297 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.297 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.297 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.297 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.298 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.298 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.298 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.298 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.298 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.298 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.298 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.298 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.299 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.299 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.299 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.299 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.299 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.299 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.299 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.299 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.300 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.300 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.300 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.300 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.300 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.300 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.300 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.301 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.301 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.301 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.301 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.301 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.301 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.301 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.301 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.302 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.302 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.302 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.302 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.302 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.302 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.302 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf'cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-07-07T02:05:32.302 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.303 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-07-07T02:05:32.303 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.303 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.303 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.303 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.303 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.303 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.303 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.304 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.304 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.304 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.304 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.304 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.304 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.304 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.304 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.305 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.305 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.305 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.305 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.305 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.305 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.305 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.305 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.306 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.306 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.306 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.306 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.306 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.306 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.306 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.306 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.307 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.307 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.307 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.307 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.307 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.307 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.307 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.307 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.308 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.308 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.308 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.308 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.308 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.308 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.308 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.308 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.309 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.309 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.309 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.309 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.309 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.309 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.309 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.309 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.310 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.310 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.310 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.310 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.310 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.310 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.310 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.310 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.311 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.311 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.311 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.311 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.311 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.311 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.311 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.312 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.312 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.312 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.312 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.312 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.312 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.312 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.312 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.313 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.313 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.313 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: mv: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.313 INFO:teuthology.orchestra.run.smithi006.stdout: +: No such file or directory 2023-07-07T02:05:32.313 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.313 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.313 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.313 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.314 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.314 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.314 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.314 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.314 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.314 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.314 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.314 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.315 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.315 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.315 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.315 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.315 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.315 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.315 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.315 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.316 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.316 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.316 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.316 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.316 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.316 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.316 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.316 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.317 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.317 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.317 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.317 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.317 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.317 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.317 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.317 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.318 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.318 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.318 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.318 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.318 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.318 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.318 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.318 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.319 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.319 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.319 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.319 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.319 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.319 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.319 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.319 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.320 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.320 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.320 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.320 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.320 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.320 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.320 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.321 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.321 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.321 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.321 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.321 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.321 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.321 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.322 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.322 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.322 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.322 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.322 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.322 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.322 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.322 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.323 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.323 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.323 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.323 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.323 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.323 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.323 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.323 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.324 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.324 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.324 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.324 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.324 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.324 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.324 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.324 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.325 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.325 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.325 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.325 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.325 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.325 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.325 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.325 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-07-07T02:05:32.326 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.326 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.326 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf' 2023-07-07T02:05:32.326 INFO:teuthology.orchestra.run.smithi006.stdout: +: No such file or directory 2023-07-07T02:05:32.326 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.326 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.326 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.326 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.327 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.327 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.327 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.327 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.327 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.327 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.327 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.327 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.328 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.328 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.328 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.328 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.328 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.328 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.328 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.329 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.329 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.329 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.329 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.329 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.329 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.329 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.329 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.330 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.330 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.330 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.330 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.330 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.330 INFO:teuthology.orchestra.run.smithi006.stdout: +: No such file or directory 2023-07-07T02:05:32.330 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.330 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.331 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.331 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.331 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.331 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.331 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.331 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.331 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.331 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.332 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.332 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.332 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.332 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.332 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.332 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.332 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.332 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.333 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.333 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.333 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.333 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.333 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.333 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.333 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.334 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.334 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.334 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.334 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.334 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.334 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.334 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.334 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.335 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.335 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.335 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.335 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.335 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.335 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.335 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.335 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.336 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.336 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.336 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.336 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.336 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.336 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.336 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.336 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.337 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.337 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf'mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.337 INFO:teuthology.orchestra.run.smithi006.stdout: +: No such file or directory 2023-07-07T02:05:32.337 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.337 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.337 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.337 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.337 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.338 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.338 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.338 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.338 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.338 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.338 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.338 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.338 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.339 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.339 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.339 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.339 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.339 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.339 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.339 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.339 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.340 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.340 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.340 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.340 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.340 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.340 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.340 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.340 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.341 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.341 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.341 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.341 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.341 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.341 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.341 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.341 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.342 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.342 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.342 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.342 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.342 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.342 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.342 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.343 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.343 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.343 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.343 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.343 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.343 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.343 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.343 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.344 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.344 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.344 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.344 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.344 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.344 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.344 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.344 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.345 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.345 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.345 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.345 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.345 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.345 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.345 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.345 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.346 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.346 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.346 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.346 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.346 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.346 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.346 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.346 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.347 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.347 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.347 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.347 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.347 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.347 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.347 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.347 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.348 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.348 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.348 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.348 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.348 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.348 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.348 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.348 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.349 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.349 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.349 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.349 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.349 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.349 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.349 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.349 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.350 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.350 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.350 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.350 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.350 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.350 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.350 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.350 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.351 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.351 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.351 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.351 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.351 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.351 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.351 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.352 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.352 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.352 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.352 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.352 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.352 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.352 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.352 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.353 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.353 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.353 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.353 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.353 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.353 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.353 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.353 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.354 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.354 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.354 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.354 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.354 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.354 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.354 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.354 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.355 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.355 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.355 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.355 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.355 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.355 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.355 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.356 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.356 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.356 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.356 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.356 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.356 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.356 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.356 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf' 2023-07-07T02:05:32.357 INFO:teuthology.orchestra.run.smithi006.stdout: +: No such file or directory 2023-07-07T02:05:32.357 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.357 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.357 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.357 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.357 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.357 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.357 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.358 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.358 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.358 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.358 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.358 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.358 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.358 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.358 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.359 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.359 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.359 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.359 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.359 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.359 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.359 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.359 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.360 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.360 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.360 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.360 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.360 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.360 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.360 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.361 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.361 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.361 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.361 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.361 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.361 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.361 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.361 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.362 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.362 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.362 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.362 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.362 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.362 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.362 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.362 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.363 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.363 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.363 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.363 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.363 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.363 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.363 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.363 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.364 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.364 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.364 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.364 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.364 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.364 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.364 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.365 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.365 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.365 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.365 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.365 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.365 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.365 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.365 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.366 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.366 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.366 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.367 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.367 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.367 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.367 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.368 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.368 INFO:teuthology.orchestra.run.smithi006.stdout: + 2023-07-07T02:05:32.368 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.368 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.368 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.368 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.368 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.369 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.369 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.369 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.369 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.369 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.369 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.370 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.370 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.370 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.370 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.370 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.370 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.370 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.371 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.371 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.371 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.371 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.371 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.371 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.371 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.371 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.372 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.372 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.372 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.372 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.372 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.372 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.372 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.373 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.373 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.373 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.373 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.373 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.373 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.373 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.373 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.374 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.374 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged2/etc/access.conf': No such file or directory 2023-07-07T02:05:32.374 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged1/etc/access.conf': No such file or directory 2023-07-07T02:05:32.374 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged2: not mounted. 2023-07-07T02:05:32.374 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.374 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged1: not mounted. 2023-07-07T02:05:32.374 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.374 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.375 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.375 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged0/etc/access.conf': No such file or directory 2023-07-07T02:05:32.375 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged0: not mounted. 2023-07-07T02:05:32.375 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.375 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.375 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.375 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.376 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged5/etc/access.conf': No such file or directory 2023-07-07T02:05:32.376 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged5: not mounted. 2023-07-07T02:05:32.376 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.376 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.376 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.376 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.376 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged3/etc/access.conf': No such file or directory 2023-07-07T02:05:32.376 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged3: not mounted. 2023-07-07T02:05:32.377 INFO:teuthology.orchestra.run.smithi006.stdout: +mount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-07-07T02:05:32.377 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.377 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.377 INFO:teuthology.orchestra.run.smithi006.stdout: +mv: cannot stat '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.377 INFO:teuthology.orchestra.run.smithi006.stdout: +touch: cannot touch '/tmp/tmp.EQx4TaXM2Pscratch/merged4/etc/access.conf': No such file or directory 2023-07-07T02:05:32.377 INFO:teuthology.orchestra.run.smithi006.stdout: +umount: /tmp/tmp.EQx4TaXM2Pscratch/merged4: not mounted. 2023-07-07T02:05:32.377 INFO:teuthology.orchestra.run.smithi006.stdout: Silence is golden. 2023-07-07T02:05:32.378 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:05:32.378 INFO:teuthology.orchestra.run.smithi006.stdout:HINT: You _MAY_ be missing kernel fix: 2023-07-07T02:05:32.378 INFO:teuthology.orchestra.run.smithi006.stdout: 6da1b4b1ab36 xfs: fix an ABBA deadlock in xfs_rename 2023-07-07T02:05:32.378 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:05:32.378 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/631 2023-07-07T02:05:32.378 INFO:teuthology.orchestra.run.smithi006.stdout:Failures: generic/631 2023-07-07T02:05:32.378 INFO:teuthology.orchestra.run.smithi006.stdout:Failed 1 of 1 tests 2023-07-07T02:05:32.379 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-07T02:05:32.380 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:05:32.380 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-07-07T02:05:32.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-07-07T02:05:32.381 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-07-07T02:05:32.645 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:05:32.649 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:05:32.650 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:05:32.651 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:05:32.651 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:06:14.323 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:06:14.326 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:06:44.401 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:06:44.404 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:07:04.326 INFO:teuthology.orchestra.run.smithi006.stdout:generic/632 92s 2023-07-07T02:07:04.332 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/632 2023-07-07T02:07:04.332 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:07:04.334 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:07:04.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:07:04.373 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-07-07T02:07:04.604 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:07:04.608 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:07:04.609 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:07:04.610 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:07:04.610 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:07:05.320 INFO:teuthology.orchestra.run.smithi006.stdout:generic/633 1s 2023-07-07T02:07:05.325 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/633 2023-07-07T02:07:05.325 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:07:05.327 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:07:05.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:07:05.765 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-07-07T02:07:06.011 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:07:06.015 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:07:06.015 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:07:06.016 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:07:06.017 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:07:07.224 INFO:teuthology.orchestra.run.smithi006.stdout:generic/634 1s 2023-07-07T02:07:07.228 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/634 2023-07-07T02:07:07.229 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:07:07.231 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:07:07.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:07:07.240 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-07-07T02:07:07.462 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:07:07.466 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:07:07.467 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:07:07.468 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:07:07.468 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:07:07.981 INFO:teuthology.orchestra.run.smithi006.stdout:generic/635 [not run] ceph does not support shutdown 2023-07-07T02:07:08.011 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/635 2023-07-07T02:07:08.011 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/635 2023-07-07T02:07:08.011 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:07:08.013 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:07:08.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:07:08.047 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-07-07T02:07:08.271 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:07:08.275 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:07:08.275 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:07:08.276 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:07:08.277 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:07:08.876 INFO:teuthology.orchestra.run.smithi006.stdout:generic/636 [not run] swapfiles are not supported 2023-07-07T02:07:08.880 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/636 2023-07-07T02:07:08.880 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/636 2023-07-07T02:07:08.880 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:07:08.882 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:07:08.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:07:08.920 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-07-07T02:07:09.141 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:07:09.145 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:07:09.146 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:07:09.147 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:07:09.147 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:07:09.865 INFO:teuthology.orchestra.run.smithi006.stdout:generic/637 0s 2023-07-07T02:07:09.870 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/637 2023-07-07T02:07:09.870 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:07:09.872 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:07:10.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:07:10.303 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-07-07T02:07:10.567 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:07:10.572 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:07:10.572 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:07:10.573 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:07:10.573 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:07:10.971 INFO:teuthology.orchestra.run.smithi006.stdout:generic/638 0s 2023-07-07T02:07:10.976 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/638 2023-07-07T02:07:10.977 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:07:10.979 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:07:11.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:07:11.017 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-07-07T02:07:11.259 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:07:11.263 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:07:11.264 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:07:11.264 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:07:11.265 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:07:11.814 INFO:teuthology.orchestra.run.smithi006.stdout:generic/639 0s 2023-07-07T02:07:11.819 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/639 2023-07-07T02:07:11.819 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:07:11.821 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:07:11.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:07:11.861 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-07-07T02:07:12.085 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:07:12.089 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:07:12.090 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:07:12.091 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:07:12.091 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:07:12.472 INFO:teuthology.orchestra.run.smithi006.stdout:generic/640 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-07T02:07:12.476 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/640 2023-07-07T02:07:12.476 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/640 2023-07-07T02:07:12.476 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:07:12.478 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:07:12.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:07:12.506 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-07-07T02:07:12.734 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:07:12.738 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:07:12.739 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:07:12.740 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:07:12.740 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:07:13.352 INFO:teuthology.orchestra.run.smithi006.stdout:generic/641 [not run] swapfiles are not supported 2023-07-07T02:07:13.356 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/641 2023-07-07T02:07:13.357 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/641 2023-07-07T02:07:13.357 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:07:13.359 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:07:13.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:07:13.384 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-07-07T02:07:13.629 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:07:13.634 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:07:13.634 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:07:13.635 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:07:13.635 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:07:14.466 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:07:14.468 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:07:44.531 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:07:44.534 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:08:14.596 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:08:14.599 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:08:45.102 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:08:45.105 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:09:15.175 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:09:15.178 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:09:45.641 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:09:45.643 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:10:15.942 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:10:15.945 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:10:15.986 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-07-07T02:10:15.984+0000 7f3a28953700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 126835) UID: 0 2023-07-07T02:10:15.987 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-07-07T02:10:15.984+0000 7f627fdc9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 126835) UID: 0 2023-07-07T02:13:28.197 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:13:28.200 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:13:28.805 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-07T02:13:28.804+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126894) UID: 0 2023-07-07T02:13:28.805 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-07T02:13:28.804+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126894) UID: 0 2023-07-07T02:13:28.806 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-07T02:13:28.805+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126894) UID: 0 2023-07-07T02:13:28.806 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T02:13:28.805+0000 7ff734335700 -1 Fail to open '/proc/126894/cmdline' error = (2) No such file or directory 2023-07-07T02:13:28.806 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T02:13:28.805+0000 7ff734335700 -1 received signal: Hangup from (PID: 126894) UID: 0 2023-07-07T02:16:22.874 INFO:teuthology.orchestra.run.smithi006.stdout:generic/642 549s 2023-07-07T02:16:22.878 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/642 2023-07-07T02:16:22.878 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:16:22.880 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:16:22.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:16:22.890 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-07-07T02:16:27.283 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:16:27.287 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:16:27.288 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:16:27.289 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:16:27.289 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:17:16.185 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:17:16.188 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:17:16.224 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-07-07T02:17:16.222+0000 7f3a28953700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 126945) UID: 0 2023-07-07T02:17:16.224 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-07-07T02:17:16.222+0000 7f627fdc9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 126945) UID: 0 2023-07-07T02:20:12.697 INFO:teuthology.orchestra.run.smithi006.stdout:generic/643 [not run] swapfiles are not supported 2023-07-07T02:20:12.701 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/643 2023-07-07T02:20:12.702 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/643 2023-07-07T02:20:12.702 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:20:12.704 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:20:12.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:20:12.738 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-07-07T02:20:13.060 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:20:13.065 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:20:13.065 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:20:13.066 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:20:13.066 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:20:13.421 INFO:teuthology.orchestra.run.smithi006.stdout:generic/644 [not run] kernel does not support mount_setattr syscall 2023-07-07T02:20:13.425 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/644 2023-07-07T02:20:13.426 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/644 2023-07-07T02:20:13.426 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:20:13.427 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:20:13.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:20:13.453 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-07-07T02:20:13.688 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:20:13.692 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:20:13.693 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:20:13.693 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:20:13.694 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:20:14.036 INFO:teuthology.orchestra.run.smithi006.stdout:generic/645 [not run] kernel does not support mount_setattr syscall 2023-07-07T02:20:14.040 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/645 2023-07-07T02:20:14.040 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/645 2023-07-07T02:20:14.040 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:20:14.042 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:20:14.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:20:14.075 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-07-07T02:20:14.316 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:20:14.320 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:20:14.321 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:20:14.321 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:20:14.322 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:20:14.849 INFO:teuthology.orchestra.run.smithi006.stdout:generic/646 [not run] ceph does not support shutdown 2023-07-07T02:20:14.865 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/646 2023-07-07T02:20:14.865 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/646 2023-07-07T02:20:14.866 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:20:14.867 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:20:14.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:20:14.892 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-07-07T02:20:15.118 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:20:15.122 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:20:15.122 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:20:15.123 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:20:15.124 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:20:15.706 INFO:teuthology.orchestra.run.smithi006.stdout:generic/647 0s 2023-07-07T02:20:15.712 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/647 2023-07-07T02:20:15.712 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:20:15.714 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:20:16.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:20:16.095 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-07-07T02:20:16.381 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:20:16.385 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:20:16.385 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:20:16.386 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:20:16.386 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:20:17.380 INFO:teuthology.orchestra.run.smithi006.stdout:generic/648 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T02:20:17.387 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/648 2023-07-07T02:20:17.387 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/648 2023-07-07T02:20:17.388 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:20:17.392 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:20:17.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:20:17.426 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-07-07T02:20:17.649 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:20:17.653 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:20:17.654 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:20:17.655 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:20:17.655 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:20:18.063 INFO:teuthology.orchestra.run.smithi006.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph 2023-07-07T02:20:18.067 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/649 2023-07-07T02:20:18.067 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/649 2023-07-07T02:20:18.067 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T02:20:18.069 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:20:18.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T02:20:18.325 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-07-07T02:20:18.744 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T02:20:18.748 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T02:20:18.748 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T02:20:18.750 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T02:20:18.750 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T02:21:55.352 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:21:55.369 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:21:55.610 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-07T02:21:55.609+0000 7fad36019700 -1 Fail to open '/proc/782330/cmdline' error = (2) No such file or directory 2023-07-07T02:21:55.610 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-07T02:21:55.609+0000 7fad36019700 -1 received signal: Hangup from (PID: 782330) UID: 0 2023-07-07T02:21:55.611 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-07T02:21:55.609+0000 7fab95f25700 -1 Fail to open '/proc/782330/cmdline' error = (2) No such file or directory 2023-07-07T02:21:55.611 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-07T02:21:55.609+0000 7fab95f25700 -1 received signal: Hangup from (PID: 782330) UID: 0 2023-07-07T02:21:55.611 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-07T02:21:55.609+0000 7fb5a42e0700 -1 Fail to open '/proc/782330/cmdline' error = (2) No such file or directory 2023-07-07T02:21:55.611 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-07T02:21:55.609+0000 7fb5a42e0700 -1 received signal: Hangup from (PID: 782330) UID: 0 2023-07-07T02:21:55.612 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-07T02:21:55.609+0000 7fec49f76700 -1 Fail to open '/proc/782330/cmdline' error = (2) No such file or directory 2023-07-07T02:21:55.612 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-07T02:21:55.609+0000 7fec49f76700 -1 received signal: Hangup from (PID: 782330) UID: 0 2023-07-07T02:30:58.198 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:30:58.252 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:30:58.349 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-07T02:30:58.341+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127512) UID: 0 2023-07-07T02:30:58.349 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-07T02:30:58.343+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127512) UID: 0 2023-07-07T02:30:58.349 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T02:30:58.346+0000 7ff734335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127512) UID: 0 2023-07-07T02:30:58.350 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-07T02:30:58.346+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 127512) UID: 0 2023-07-07T02:38:10.116 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:38:10.189 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:38:10.265 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-07-07T02:38:10.263+0000 7f3a28953700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 127678) UID: 0 2023-07-07T02:38:10.266 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-07-07T02:38:10.263+0000 7f627fdc9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 127678) UID: 0 2023-07-07T02:38:10.757 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-07T02:38:10.755+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 788055) UID: 0 2023-07-07T02:38:10.758 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-07T02:38:10.755+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 788055) UID: 0 2023-07-07T02:38:10.758 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-07T02:38:10.756+0000 7fec49f76700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 788055) UID: 0 2023-07-07T02:38:10.758 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-07T02:38:10.755+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 788055) UID: 0 2023-07-07T02:47:04.182 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:47:04.236 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:47:34.923 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:47:35.106 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:48:06.004 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:48:06.011 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:48:36.118 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:48:36.242 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:49:06.716 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:49:06.726 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:49:36.818 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:49:36.826 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:50:06.900 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:50:06.925 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:50:37.220 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:50:37.245 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:51:08.005 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:51:08.009 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:51:08.055 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-07T02:51:08.055+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128125) UID: 0 2023-07-07T02:51:08.056 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-07T02:51:08.055+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128125) UID: 0 2023-07-07T02:51:08.056 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-07T02:51:08.055+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128125) UID: 0 2023-07-07T02:51:08.057 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T02:51:08.055+0000 7ff734335700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128125) UID: 0 2023-07-07T02:54:40.505 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:54:40.607 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T02:54:40.816 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-07T02:54:40.815+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 793499) UID: 0 2023-07-07T02:54:40.825 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-07T02:54:40.815+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 793499) UID: 0 2023-07-07T02:54:40.831 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-07T02:54:40.815+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 793499) UID: 0 2023-07-07T02:54:40.831 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-07T02:54:40.815+0000 7fec49f76700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 793499) UID: 0 2023-07-07T03:03:59.195 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:03:59.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:03:59.390 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-07-07T03:03:59.388+0000 7f3a28953700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 128476) UID: 0 2023-07-07T03:03:59.391 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-07-07T03:03:59.390+0000 7f627fdc9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 128476) UID: 0 2023-07-07T03:07:53.853 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:07:53.865 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:08:23.969 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:08:23.972 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:08:54.057 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:08:54.065 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:08:54.114 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-07T03:08:54.113+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128586) UID: 0 2023-07-07T03:08:54.114 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-07T03:08:54.113+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128586) UID: 0 2023-07-07T03:08:54.115 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-07T03:08:54.114+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128586) UID: 0 2023-07-07T03:08:54.119 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T03:08:54.118+0000 7ff734335700 -1 received signal: Hangup from (PID: 128586) UID: 0 2023-07-07T03:10:20.838 INFO:teuthology.orchestra.run.smithi006.stdout:generic/650 3002s 2023-07-07T03:10:20.859 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/650 2023-07-07T03:10:20.859 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:10:20.861 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:21.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:10:21.080 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2023-07-07T03:10:21.882 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:10:21.896 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:10:21.896 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:10:21.898 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:10:21.898 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:23.339 INFO:teuthology.orchestra.run.smithi006.stdout:generic/651 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T03:10:23.367 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/651 2023-07-07T03:10:23.367 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/651 2023-07-07T03:10:23.367 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:10:23.379 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:23.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:10:23.428 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2023-07-07T03:10:23.849 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:10:23.858 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:10:23.858 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:10:23.863 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:10:23.863 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:25.250 INFO:teuthology.orchestra.run.smithi006.stdout:generic/652 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T03:10:25.268 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/652 2023-07-07T03:10:25.268 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/652 2023-07-07T03:10:25.268 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:10:25.285 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:25.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:10:25.350 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2023-07-07T03:10:25.727 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:10:25.731 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:10:25.732 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:10:25.733 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:10:25.734 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:27.124 INFO:teuthology.orchestra.run.smithi006.stdout:generic/653 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T03:10:27.142 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/653 2023-07-07T03:10:27.142 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/653 2023-07-07T03:10:27.142 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:10:27.147 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:27.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:10:27.201 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2023-07-07T03:10:27.595 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:10:27.599 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:10:27.600 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:10:27.601 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:10:27.601 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:28.731 INFO:teuthology.orchestra.run.smithi006.stdout:generic/654 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T03:10:28.745 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/654 2023-07-07T03:10:28.745 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/654 2023-07-07T03:10:28.746 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:10:28.749 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:29.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:10:29.036 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2023-07-07T03:10:29.434 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:10:29.440 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:10:29.441 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:10:29.442 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:10:29.442 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:30.661 INFO:teuthology.orchestra.run.smithi006.stdout:generic/655 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T03:10:30.797 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/655 2023-07-07T03:10:30.797 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/655 2023-07-07T03:10:30.797 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:10:30.806 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:30.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:10:30.848 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2023-07-07T03:10:31.262 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:10:31.270 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:10:31.271 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:10:31.272 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:10:31.272 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:31.809 INFO:teuthology.orchestra.run.smithi006.stdout:generic/656 [not run] kernel does not support mount_setattr syscall 2023-07-07T03:10:31.818 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/656 2023-07-07T03:10:31.818 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/656 2023-07-07T03:10:31.818 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:10:31.824 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:31.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:10:31.873 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2023-07-07T03:10:32.240 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:10:32.248 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:10:32.249 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:10:32.250 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:10:32.250 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:33.527 INFO:teuthology.orchestra.run.smithi006.stdout:generic/657 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T03:10:33.571 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/657 2023-07-07T03:10:33.571 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/657 2023-07-07T03:10:33.571 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:10:33.579 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:33.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:10:33.674 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2023-07-07T03:10:34.085 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:10:34.093 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:10:34.094 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:10:34.095 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:10:34.095 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:35.301 INFO:teuthology.orchestra.run.smithi006.stdout:generic/658 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T03:10:35.307 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/658 2023-07-07T03:10:35.307 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/658 2023-07-07T03:10:35.307 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:10:35.326 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:35.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:10:35.490 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2023-07-07T03:10:35.944 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:10:35.949 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:10:35.950 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:10:35.951 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:10:35.951 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:36.975 INFO:teuthology.orchestra.run.smithi006.stdout:generic/659 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T03:10:36.982 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/659 2023-07-07T03:10:36.982 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/659 2023-07-07T03:10:36.982 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:10:36.985 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:37.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:10:37.342 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2023-07-07T03:10:37.713 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:10:37.719 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:10:37.719 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:10:37.720 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:10:37.721 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:38.978 INFO:teuthology.orchestra.run.smithi006.stdout:generic/660 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T03:10:39.035 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/660 2023-07-07T03:10:39.036 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/660 2023-07-07T03:10:39.036 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:10:39.129 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:39.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:10:39.201 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2023-07-07T03:10:39.570 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:10:39.578 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:10:39.579 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:10:39.581 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:10:39.581 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:40.585 INFO:teuthology.orchestra.run.smithi006.stdout:generic/661 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T03:10:40.591 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/661 2023-07-07T03:10:40.591 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/661 2023-07-07T03:10:40.591 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:10:40.597 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:40.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:10:40.951 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2023-07-07T03:10:41.390 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:10:41.395 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:10:41.396 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:10:41.398 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:10:41.398 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:42.716 INFO:teuthology.orchestra.run.smithi006.stdout:generic/662 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T03:10:42.800 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/662 2023-07-07T03:10:42.801 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/662 2023-07-07T03:10:42.801 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:10:42.804 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:42.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:10:42.871 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2023-07-07T03:10:43.259 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:10:43.276 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:10:43.277 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:10:43.284 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:10:43.284 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:44.499 INFO:teuthology.orchestra.run.smithi006.stdout:generic/663 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T03:10:44.523 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/663 2023-07-07T03:10:44.524 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/663 2023-07-07T03:10:44.524 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:10:44.569 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:44.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:10:44.768 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2023-07-07T03:10:45.172 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:10:45.177 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:10:45.178 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:10:45.179 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:10:45.179 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:46.689 INFO:teuthology.orchestra.run.smithi006.stdout:generic/664 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T03:10:46.694 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/664 2023-07-07T03:10:46.694 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/664 2023-07-07T03:10:46.695 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:10:46.831 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:46.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:10:46.996 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2023-07-07T03:10:47.472 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:10:47.478 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:10:47.478 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:10:47.479 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:10:47.480 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:48.899 INFO:teuthology.orchestra.run.smithi006.stdout:generic/665 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T03:10:48.979 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/665 2023-07-07T03:10:48.979 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/665 2023-07-07T03:10:48.979 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:10:48.981 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:49.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:10:49.033 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2023-07-07T03:10:49.407 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:10:49.419 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:10:49.420 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:10:49.422 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:10:49.422 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:50.593 INFO:teuthology.orchestra.run.smithi006.stdout:generic/666 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T03:10:50.680 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/666 2023-07-07T03:10:50.680 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/666 2023-07-07T03:10:50.680 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:10:50.808 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:50.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:10:50.865 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2023-07-07T03:10:51.253 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:10:51.258 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:10:51.261 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:10:51.266 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:10:51.266 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:52.397 INFO:teuthology.orchestra.run.smithi006.stdout:generic/667 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T03:10:52.403 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/667 2023-07-07T03:10:52.404 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/667 2023-07-07T03:10:52.404 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:10:52.407 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:52.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:10:52.592 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2023-07-07T03:10:53.010 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:10:53.019 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:10:53.020 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:10:53.021 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:10:53.021 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:54.264 INFO:teuthology.orchestra.run.smithi006.stdout:generic/668 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T03:10:54.272 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/668 2023-07-07T03:10:54.272 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/668 2023-07-07T03:10:54.272 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:10:54.275 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:54.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:10:54.450 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2023-07-07T03:10:54.886 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:10:54.891 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:10:54.891 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:10:54.892 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:10:54.892 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:56.090 INFO:teuthology.orchestra.run.smithi006.stdout:generic/669 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T03:10:56.097 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/669 2023-07-07T03:10:56.097 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/669 2023-07-07T03:10:56.097 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:10:56.100 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:56.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:10:56.334 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2023-07-07T03:10:56.753 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:10:56.765 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:10:56.765 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:10:56.766 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:10:56.767 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:57.776 INFO:teuthology.orchestra.run.smithi006.stdout:generic/670 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T03:10:57.782 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/670 2023-07-07T03:10:57.782 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/670 2023-07-07T03:10:57.783 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:10:57.786 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:58.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:10:58.077 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2023-07-07T03:10:58.527 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:10:58.532 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:10:58.533 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:10:58.534 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:10:58.534 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:10:59.719 INFO:teuthology.orchestra.run.smithi006.stdout:generic/671 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T03:10:59.741 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/671 2023-07-07T03:10:59.741 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/671 2023-07-07T03:10:59.742 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:10:59.747 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:11:00.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:11:00.014 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2023-07-07T03:11:00.427 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:11:00.432 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:11:00.432 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:11:00.433 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:11:00.433 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:11:01.679 INFO:teuthology.orchestra.run.smithi006.stdout:generic/672 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T03:11:01.685 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/672 2023-07-07T03:11:01.685 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/672 2023-07-07T03:11:01.686 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:11:01.688 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:11:01.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:11:01.838 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2023-07-07T03:11:02.211 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:11:02.217 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:11:02.217 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:11:02.225 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:11:02.226 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:11:03.669 INFO:teuthology.orchestra.run.smithi006.stdout:generic/673 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T03:11:03.682 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/673 2023-07-07T03:11:03.683 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/673 2023-07-07T03:11:03.683 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:11:03.692 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:11:03.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:11:03.883 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2023-07-07T03:11:04.291 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:11:04.297 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:11:04.297 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:11:04.298 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:11:04.299 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:11:05.215 INFO:teuthology.orchestra.run.smithi006.stdout:generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-07-07T03:11:05.422 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/674 2023-07-07T03:11:05.422 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/674 2023-07-07T03:11:05.423 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:11:05.608 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:11:05.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:11:05.725 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2023-07-07T03:11:06.098 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:11:06.104 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:11:06.104 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:11:06.105 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:11:06.105 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:11:07.267 INFO:teuthology.orchestra.run.smithi006.stdout:generic/675 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T03:11:07.514 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/675 2023-07-07T03:11:07.514 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/675 2023-07-07T03:11:07.514 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:11:07.531 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:11:07.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:11:07.626 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2023-07-07T03:11:08.010 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:11:08.015 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:11:08.016 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:11:08.021 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:11:08.021 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:12:34.891 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:12:34.894 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:12:34.956 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-07T03:12:34.954+0000 7fec49f76700 -1 Fail to open '/proc/810285/cmdline' error = (2) No such file or directory 2023-07-07T03:12:34.956 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-07T03:12:34.954+0000 7fec49f76700 -1 received signal: Hangup from (PID: 810285) UID: 0 2023-07-07T03:12:34.958 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-07T03:12:34.957+0000 7fad36019700 -1 Fail to open '/proc/810285/cmdline' error = (2) No such file or directory 2023-07-07T03:12:34.958 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-07T03:12:34.957+0000 7fad36019700 -1 received signal: Hangup from (PID: 810285) UID: 0 2023-07-07T03:12:34.959 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-07T03:12:34.957+0000 7fb5a42e0700 -1 Fail to open '/proc/810285/cmdline' error = (2) No such file or directory 2023-07-07T03:12:34.959 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-07T03:12:34.957+0000 7fb5a42e0700 -1 received signal: Hangup from (PID: 810285) UID: 0 2023-07-07T03:12:34.959 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-07T03:12:34.957+0000 7fab95f25700 -1 Fail to open '/proc/810285/cmdline' error = (2) No such file or directory 2023-07-07T03:12:34.959 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-07T03:12:34.957+0000 7fab95f25700 -1 received signal: Hangup from (PID: 810285) UID: 0 2023-07-07T03:12:34.971 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-07-07T03:12:34.970+0000 7f3a28953700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 128648) UID: 0 2023-07-07T03:12:34.972 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-07-07T03:12:34.970+0000 7f627fdc9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 128648) UID: 0 2023-07-07T03:15:36.980 INFO:teuthology.orchestra.run.smithi040.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.b.log.1: 2023-07-07T03:15:36.981 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: stdin: file size changed while zipping 2023-07-07T03:15:38.633 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-07T03:15:38.631+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128676) UID: 0 2023-07-07T03:15:38.634 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-07T03:15:38.632+0000 7fc177dad700 -1 Fail to open '/proc/128676/cmdline' error = (2) No such file or directory 2023-07-07T03:15:38.635 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-07T03:15:38.632+0000 7fc177dad700 -1 received signal: Hangup from (PID: 128676) UID: 0 2023-07-07T03:15:38.636 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T03:15:38.634+0000 7ff734335700 -1 Fail to open '/proc/128676/cmdline' error = (2) No such file or directory 2023-07-07T03:15:38.636 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T03:15:38.634+0000 7ff734335700 -1 received signal: Hangup from (PID: 128676) UID: 0 2023-07-07T03:15:38.638 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-07T03:15:38.637+0000 7fec6f39a700 -1 Fail to open '/proc/128676/cmdline' error = (2) No such file or directory 2023-07-07T03:15:38.639 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-07T03:15:38.637+0000 7fec6f39a700 -1 received signal: Hangup from (PID: 128676) UID: 0 2023-07-07T03:19:48.351 INFO:teuthology.orchestra.run.smithi040.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.7.log.1: 2023-07-07T03:19:48.351 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: stdin: file size changed while zipping 2023-07-07T03:20:19.971 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:20:19.974 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:20:20.193 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-07-07T03:20:20.193+0000 7f3a28953700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 128735) UID: 0 2023-07-07T03:20:20.194 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-07-07T03:20:20.193+0000 7f627fdc9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 128735) UID: 0 2023-07-07T03:23:37.750 INFO:teuthology.orchestra.run.smithi006.stdout:generic/676 749s 2023-07-07T03:23:37.757 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/676 2023-07-07T03:23:37.757 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:23:37.760 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:38.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:23:38.328 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2023-07-07T03:23:38.775 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:23:38.780 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:23:38.780 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:23:38.782 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:23:38.782 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:39.414 INFO:teuthology.orchestra.run.smithi006.stdout:generic/677 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-07T03:23:39.420 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/677 2023-07-07T03:23:39.421 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/677 2023-07-07T03:23:39.421 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:23:39.424 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:39.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:23:39.464 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2023-07-07T03:23:39.931 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:23:39.936 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:23:39.942 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:23:39.943 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:23:39.943 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:40.576 INFO:teuthology.orchestra.run.smithi006.stdout:generic/678 [not run] kernel does not support IO_URING 2023-07-07T03:23:40.582 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/678 2023-07-07T03:23:40.582 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/678 2023-07-07T03:23:40.582 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:23:40.593 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:40.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:23:40.650 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2023-07-07T03:23:41.058 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:23:41.069 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:23:41.070 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:23:41.071 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:23:41.071 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:41.717 INFO:teuthology.orchestra.run.smithi006.stdout:generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T03:23:41.723 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/679 2023-07-07T03:23:41.723 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/679 2023-07-07T03:23:41.723 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:23:41.726 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:41.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:23:41.791 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2023-07-07T03:23:42.207 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:23:42.211 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:23:42.212 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:23:42.213 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:23:42.213 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:43.219 INFO:teuthology.orchestra.run.smithi006.stdout:generic/680 1s 2023-07-07T03:23:43.228 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/680 2023-07-07T03:23:43.229 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:23:43.231 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:43.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:23:43.356 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2023-07-07T03:23:44.128 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:23:44.136 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:23:44.137 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:23:44.138 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:23:44.138 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:44.728 INFO:teuthology.orchestra.run.smithi006.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T03:23:44.737 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/681 2023-07-07T03:23:44.737 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/681 2023-07-07T03:23:44.738 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:23:44.740 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:44.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:23:44.797 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2023-07-07T03:23:45.190 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:23:45.199 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:23:45.199 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:23:45.201 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:23:45.201 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:45.744 INFO:teuthology.orchestra.run.smithi006.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T03:23:45.749 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/682 2023-07-07T03:23:45.749 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/682 2023-07-07T03:23:45.750 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:23:45.753 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:45.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:23:45.791 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2023-07-07T03:23:46.224 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:23:46.229 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:23:46.229 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:23:46.231 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:23:46.231 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:46.949 INFO:teuthology.orchestra.run.smithi006.stdout:generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T03:23:46.957 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/683 2023-07-07T03:23:46.958 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/683 2023-07-07T03:23:46.958 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:23:46.960 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:47.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:23:47.008 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2023-07-07T03:23:47.417 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:23:47.424 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:23:47.425 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:23:47.426 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:23:47.426 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:52.762 INFO:teuthology.orchestra.run.smithi006.stdout:generic/684 - output mismatch (see /tmp/tmp.LybHGoQKZdxfstests-dev/results//generic/684.out.bad) 2023-07-07T03:23:52.765 INFO:teuthology.orchestra.run.smithi006.stdout: --- tests/generic/684.out 2023-07-06 20:00:31.464358082 +0000 2023-07-07T03:23:52.766 INFO:teuthology.orchestra.run.smithi006.stdout: +++ /tmp/tmp.LybHGoQKZdxfstests-dev/results//generic/684.out.bad 2023-07-07 03:23:52.750237883 +0000 2023-07-07T03:23:52.766 INFO:teuthology.orchestra.run.smithi006.stdout: @@ -1,19 +1,19 @@ 2023-07-07T03:23:52.766 INFO:teuthology.orchestra.run.smithi006.stdout: QA output created by 684 2023-07-07T03:23:52.766 INFO:teuthology.orchestra.run.smithi006.stdout: Test 1 - qa_user, non-exec file fpunch 2023-07-07T03:23:52.766 INFO:teuthology.orchestra.run.smithi006.stdout: 6666 -rwSrwSrw- TEST_DIR/684/a 2023-07-07T03:23:52.766 INFO:teuthology.orchestra.run.smithi006.stdout: -666 -rw-rw-rw- TEST_DIR/684/a 2023-07-07T03:23:52.766 INFO:teuthology.orchestra.run.smithi006.stdout: +6666 -rwSrwSrw- TEST_DIR/684/a 2023-07-07T03:23:52.767 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:52.767 INFO:teuthology.orchestra.run.smithi006.stdout: Test 2 - qa_user, group-exec file fpunch 2023-07-07T03:23:52.767 INFO:teuthology.orchestra.run.smithi006.stdout: 6676 -rwSrwsrw- TEST_DIR/684/a 2023-07-07T03:23:52.767 INFO:teuthology.orchestra.run.smithi006.stdout: -676 -rw-rwxrw- TEST_DIR/684/a 2023-07-07T03:23:52.767 INFO:teuthology.orchestra.run.smithi006.stdout: +6676 -rwSrwsrw- TEST_DIR/684/a 2023-07-07T03:23:52.767 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:52.767 INFO:teuthology.orchestra.run.smithi006.stdout: Test 3 - qa_user, user-exec file fpunch 2023-07-07T03:23:52.768 INFO:teuthology.orchestra.run.smithi006.stdout: 6766 -rwsrwSrw- TEST_DIR/684/a 2023-07-07T03:23:52.768 INFO:teuthology.orchestra.run.smithi006.stdout: -766 -rwxrw-rw- TEST_DIR/684/a 2023-07-07T03:23:52.768 INFO:teuthology.orchestra.run.smithi006.stdout: +6766 -rwsrwSrw- TEST_DIR/684/a 2023-07-07T03:23:52.768 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:52.768 INFO:teuthology.orchestra.run.smithi006.stdout: Test 4 - qa_user, all-exec file fpunch 2023-07-07T03:23:52.768 INFO:teuthology.orchestra.run.smithi006.stdout: 6777 -rwsrwsrwx TEST_DIR/684/a 2023-07-07T03:23:52.768 INFO:teuthology.orchestra.run.smithi006.stdout: -777 -rwxrwxrwx TEST_DIR/684/a 2023-07-07T03:23:52.769 INFO:teuthology.orchestra.run.smithi006.stdout: +6777 -rwsrwsrwx TEST_DIR/684/a 2023-07-07T03:23:52.769 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:52.769 INFO:teuthology.orchestra.run.smithi006.stdout: Test 5 - root, non-exec file fpunch 2023-07-07T03:23:52.769 INFO:teuthology.orchestra.run.smithi006.stdout: 6666 -rwSrwSrw- TEST_DIR/684/a 2023-07-07T03:23:52.769 INFO:teuthology.orchestra.run.smithi006.stdout: @@ -33,9 +33,9 @@ 2023-07-07T03:23:52.769 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:52.769 INFO:teuthology.orchestra.run.smithi006.stdout: Test 9 - qa_user, group-exec file fpunch, only sgid 2023-07-07T03:23:52.770 INFO:teuthology.orchestra.run.smithi006.stdout: 2676 -rw-rwsrw- TEST_DIR/684/a 2023-07-07T03:23:52.770 INFO:teuthology.orchestra.run.smithi006.stdout: -676 -rw-rwxrw- TEST_DIR/684/a 2023-07-07T03:23:52.770 INFO:teuthology.orchestra.run.smithi006.stdout: +2676 -rw-rwsrw- TEST_DIR/684/a 2023-07-07T03:23:52.770 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:52.770 INFO:teuthology.orchestra.run.smithi006.stdout: Test 10 - qa_user, all-exec file fpunch, only sgid 2023-07-07T03:23:52.770 INFO:teuthology.orchestra.run.smithi006.stdout: 2777 -rwxrwsrwx TEST_DIR/684/a 2023-07-07T03:23:52.770 INFO:teuthology.orchestra.run.smithi006.stdout: -777 -rwxrwxrwx TEST_DIR/684/a 2023-07-07T03:23:52.771 INFO:teuthology.orchestra.run.smithi006.stdout: +2777 -rwxrwsrwx TEST_DIR/684/a 2023-07-07T03:23:52.771 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:52.771 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/684 2023-07-07T03:23:52.771 INFO:teuthology.orchestra.run.smithi006.stdout:Failures: generic/684 2023-07-07T03:23:52.772 INFO:teuthology.orchestra.run.smithi006.stdout:Failed 1 of 1 tests 2023-07-07T03:23:52.772 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:53.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-07T03:23:53.134 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-07-07T03:23:53.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-07-07T03:23:53.135 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2023-07-07T03:23:53.678 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:23:53.686 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:23:53.686 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:23:53.688 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:23:53.688 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:54.441 INFO:teuthology.orchestra.run.smithi006.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-07T03:23:54.446 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/685 2023-07-07T03:23:54.446 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/685 2023-07-07T03:23:54.446 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:23:54.449 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:54.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:23:54.505 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2023-07-07T03:23:54.899 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:23:54.904 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:23:54.904 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:23:54.906 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:23:54.906 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:55.689 INFO:teuthology.orchestra.run.smithi006.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-07-07T03:23:55.694 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/686 2023-07-07T03:23:55.694 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/686 2023-07-07T03:23:55.694 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:23:55.699 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:55.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:23:55.776 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2023-07-07T03:23:56.219 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:23:56.227 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:23:56.227 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:23:56.228 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:23:56.228 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:56.996 INFO:teuthology.orchestra.run.smithi006.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-07-07T03:23:57.007 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/687 2023-07-07T03:23:57.007 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/687 2023-07-07T03:23:57.007 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:23:57.010 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:57.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:23:57.088 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2023-07-07T03:23:57.508 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:23:57.513 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:23:57.514 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:23:57.515 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:23:57.515 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:58.086 INFO:teuthology.orchestra.run.smithi006.stdout:generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-07-07T03:23:58.092 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/688 2023-07-07T03:23:58.092 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/688 2023-07-07T03:23:58.092 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:23:58.094 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:58.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:23:58.143 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2023-07-07T03:23:58.514 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:23:58.521 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:23:58.521 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:23:58.523 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:23:58.523 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:59.074 INFO:teuthology.orchestra.run.smithi006.stdout:generic/689 [not run] kernel does not support mount_setattr syscall 2023-07-07T03:23:59.080 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/689 2023-07-07T03:23:59.080 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/689 2023-07-07T03:23:59.080 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:23:59.084 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:23:59.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:23:59.116 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2023-07-07T03:23:59.486 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:23:59.493 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:23:59.494 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:23:59.495 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:23:59.495 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:00.137 INFO:teuthology.orchestra.run.smithi006.stdout:generic/690 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-07T03:24:00.142 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/690 2023-07-07T03:24:00.142 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/690 2023-07-07T03:24:00.143 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:24:00.145 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:00.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:24:00.209 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2023-07-07T03:24:00.594 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:24:00.599 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:24:00.599 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:24:00.601 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:24:00.601 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:01.175 INFO:teuthology.orchestra.run.smithi006.stdout:generic/691 [not run] disk quotas not supported by this filesystem type: ceph 2023-07-07T03:24:01.180 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/691 2023-07-07T03:24:01.180 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/691 2023-07-07T03:24:01.180 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:24:01.183 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:01.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:24:01.219 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2023-07-07T03:24:01.579 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:24:01.587 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:24:01.587 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:24:01.595 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:24:01.595 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:02.174 INFO:teuthology.orchestra.run.smithi006.stdout:generic/692 [not run] fsverity utility required, skipped this test 2023-07-07T03:24:02.179 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/692 2023-07-07T03:24:02.179 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/692 2023-07-07T03:24:02.180 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:24:02.182 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:02.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:24:02.213 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2023-07-07T03:24:02.605 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:24:02.610 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:24:02.611 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:24:02.612 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:24:02.612 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:03.495 INFO:teuthology.orchestra.run.smithi006.stdout:generic/693 [not run] kernel does not support ceph encryption 2023-07-07T03:24:03.512 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/693 2023-07-07T03:24:03.512 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/693 2023-07-07T03:24:03.512 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:24:03.514 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:03.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:24:03.550 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2023-07-07T03:24:03.972 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:24:03.977 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:24:03.978 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:24:03.980 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:24:03.980 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:12.404 INFO:teuthology.orchestra.run.smithi006.stdout:generic/694 8s 2023-07-07T03:24:12.410 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/694 2023-07-07T03:24:12.411 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:24:12.413 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:12.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:24:12.443 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2023-07-07T03:24:12.882 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:24:12.890 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:24:12.891 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:24:12.892 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:24:12.892 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:13.505 INFO:teuthology.orchestra.run.smithi006.stdout:generic/695 [not run] require 172.21.15.6:6789:/scratch to be valid block disk 2023-07-07T03:24:13.505 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/695 2023-07-07T03:24:13.505 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/695 2023-07-07T03:24:13.505 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:24:13.509 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:13.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:24:13.552 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2023-07-07T03:24:13.922 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:24:13.927 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:24:13.927 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:24:13.929 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:24:13.929 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:14.925 INFO:teuthology.orchestra.run.smithi006.stdout:generic/696 0s 2023-07-07T03:24:14.935 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/696 2023-07-07T03:24:14.935 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:24:14.938 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:14.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:24:14.979 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2023-07-07T03:24:15.353 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:24:15.358 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:24:15.358 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:24:15.360 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:24:15.360 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:16.137 INFO:teuthology.orchestra.run.smithi006.stdout:generic/697 1s 2023-07-07T03:24:16.150 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/697 2023-07-07T03:24:16.150 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:24:16.153 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:16.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:24:16.247 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2023-07-07T03:24:16.647 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:24:16.652 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:24:16.652 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:24:16.654 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:24:16.654 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:17.268 INFO:teuthology.orchestra.run.smithi006.stdout:generic/698 [not run] kernel does not support mount_setattr syscall 2023-07-07T03:24:17.273 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/698 2023-07-07T03:24:17.273 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/698 2023-07-07T03:24:17.273 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:24:17.276 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:17.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:24:17.347 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2023-07-07T03:24:17.747 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:24:17.771 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:24:17.771 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:24:17.773 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:24:17.773 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:18.354 INFO:teuthology.orchestra.run.smithi006.stdout:generic/699 [not run] kernel does not support mount_setattr syscall 2023-07-07T03:24:18.360 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/699 2023-07-07T03:24:18.360 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/699 2023-07-07T03:24:18.360 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:24:18.363 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:18.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:24:18.412 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2023-07-07T03:24:18.790 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:24:18.796 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:24:18.797 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:24:18.798 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:24:18.798 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:19.623 INFO:teuthology.orchestra.run.smithi006.stdout:generic/700 [not run] kernel doesn't support renameat2 syscall 2023-07-07T03:24:19.628 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/700 2023-07-07T03:24:19.628 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/700 2023-07-07T03:24:19.628 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:24:19.630 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:19.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:24:19.766 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2023-07-07T03:24:20.377 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:24:20.381 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:24:20.382 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:24:20.383 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:24:20.383 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:27.412 INFO:teuthology.orchestra.run.smithi006.stdout:generic/701 7s 2023-07-07T03:24:27.421 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/701 2023-07-07T03:24:27.421 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:24:27.424 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:30.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:24:30.480 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2023-07-07T03:24:30.954 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:24:30.959 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:24:30.959 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:24:30.961 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:24:30.961 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:32.031 INFO:teuthology.orchestra.run.smithi006.stdout:generic/702 [not run] Reflink not supported by scratch filesystem type: ceph 2023-07-07T03:24:32.038 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/702 2023-07-07T03:24:32.038 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/702 2023-07-07T03:24:32.038 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:24:32.042 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:32.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:24:32.409 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2023-07-07T03:24:32.863 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:24:32.868 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:24:32.870 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:24:32.870 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:24:32.871 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:33.890 INFO:teuthology.orchestra.run.smithi006.stdout:generic/703 [not run] kernel does not support IO_URING 2023-07-07T03:24:33.895 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/703 2023-07-07T03:24:33.895 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/703 2023-07-07T03:24:33.895 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:24:33.897 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:33.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:24:33.953 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2023-07-07T03:24:34.372 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:24:34.378 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:24:34.378 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:24:34.379 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:24:34.379 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:34.999 INFO:teuthology.orchestra.run.smithi006.stdout:generic/704 [not run] require 172.21.15.6:6789:/test to be valid block disk 2023-07-07T03:24:35.008 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/704 2023-07-07T03:24:35.008 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/704 2023-07-07T03:24:35.008 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:24:35.012 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:35.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:24:35.066 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2023-07-07T03:24:35.478 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:24:35.484 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:24:35.484 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:24:35.486 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:24:35.486 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:36.275 INFO:teuthology.orchestra.run.smithi006.stdout:generic/705 [not run] ceph does not support shutdown 2023-07-07T03:24:36.304 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/705 2023-07-07T03:24:36.305 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/705 2023-07-07T03:24:36.305 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:24:36.307 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:36.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:24:36.350 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2023-07-07T03:24:36.745 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:24:36.762 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:24:36.763 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:24:36.765 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:24:36.765 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:39.578 INFO:teuthology.orchestra.run.smithi006.stdout:generic/706 2s 2023-07-07T03:24:39.585 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/706 2023-07-07T03:24:39.585 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T03:24:39.587 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:24:39.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T03:24:39.921 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2023-07-07T03:24:40.484 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T03:24:40.489 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T03:24:40.490 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T03:24:40.491 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T03:24:40.491 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T03:28:02.864 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:28:02.867 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:28:02.946 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-07-07T03:28:02.944+0000 7f627fdc9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 130436) UID: 0 2023-07-07T03:28:02.946 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-07-07T03:28:02.944+0000 7f3a28953700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 130436) UID: 0 2023-07-07T03:28:02.961 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-07T03:28:02.960+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 837793) UID: 0 2023-07-07T03:28:02.962 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-07T03:28:02.960+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 837793) UID: 0 2023-07-07T03:28:02.962 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-07T03:28:02.960+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 837793) UID: 0 2023-07-07T03:28:02.963 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-07T03:28:02.962+0000 7fec49f76700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 837793) UID: 0 2023-07-07T03:35:20.219 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:35:20.222 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:35:20.297 INFO:tasks.ceph.osd.1.smithi006.stderr:2023-07-07T03:35:20.296+0000 7fb5a42e0700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 857315) UID: 0 2023-07-07T03:35:20.298 INFO:tasks.ceph.osd.3.smithi006.stderr:2023-07-07T03:35:20.296+0000 7fec49f76700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 857315) UID: 0 2023-07-07T03:35:20.298 INFO:tasks.ceph.osd.2.smithi006.stderr:2023-07-07T03:35:20.297+0000 7fab95f25700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 857315) UID: 0 2023-07-07T03:35:20.303 INFO:tasks.ceph.osd.0.smithi006.stderr:2023-07-07T03:35:20.297+0000 7fad36019700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 857315) UID: 0 2023-07-07T03:35:20.310 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-07T03:35:20.309+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130523) UID: 0 2023-07-07T03:35:20.311 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-07T03:35:20.309+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130523) UID: 0 2023-07-07T03:35:20.312 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-07T03:35:20.310+0000 7fc177dad700 -1 Fail to open '/proc/130523/cmdline' error = (2) No such file or directory 2023-07-07T03:35:20.312 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-07T03:35:20.310+0000 7fc177dad700 -1 received signal: Hangup from (PID: 130523) UID: 0 2023-07-07T03:35:20.312 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T03:35:20.310+0000 7ff734335700 -1 Fail to open '/proc/130523/cmdline' error = (2) No such file or directory 2023-07-07T03:35:20.312 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T03:35:20.310+0000 7ff734335700 -1 received signal: Hangup from (PID: 130523) UID: 0 2023-07-07T03:39:23.316 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:39:23.328 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:39:23.744 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-07T03:39:23.742+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130582) UID: 0 2023-07-07T03:39:23.744 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-07T03:39:23.742+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130582) UID: 0 2023-07-07T03:39:23.745 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-07T03:39:23.743+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130582) UID: 0 2023-07-07T03:39:23.745 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T03:39:23.743+0000 7ff734335700 -1 Fail to open '/proc/130582/cmdline' error = (2) No such file or directory 2023-07-07T03:39:23.745 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T03:39:23.743+0000 7ff734335700 -1 received signal: Hangup from (PID: 130582) UID: 0 2023-07-07T03:43:02.065 INFO:tasks.ceph.osd.4.smithi040.stderr:2023-07-07T03:43:02.064+0000 7fb9bd783700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130630) UID: 0 2023-07-07T03:43:02.066 INFO:tasks.ceph.osd.5.smithi040.stderr:2023-07-07T03:43:02.064+0000 7fc177dad700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130630) UID: 0 2023-07-07T03:43:02.066 INFO:tasks.ceph.osd.6.smithi040.stderr:2023-07-07T03:43:02.064+0000 7fec6f39a700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 130630) UID: 0 2023-07-07T03:43:02.067 INFO:tasks.ceph.osd.7.smithi040.stderr:2023-07-07T03:43:02.065+0000 7ff734335700 -1 received signal: Hangup from (PID: 130630) UID: 0 2023-07-07T03:43:02.280 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:43:02.283 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:43:33.294 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:43:33.296 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:44:03.390 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:44:03.393 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:44:33.547 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:44:33.549 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:45:03.666 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:45:03.669 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:45:33.761 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:45:33.765 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:46:03.854 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:46:03.857 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:46:33.940 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:46:33.944 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:46:34.010 INFO:tasks.ceph.mds.d.smithi040.stderr:2023-07-07T03:46:34.008+0000 7f627fdc9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 130837) UID: 0 2023-07-07T03:46:34.013 INFO:tasks.ceph.mds.b.smithi040.stderr:2023-07-07T03:46:34.008+0000 7f3a28953700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 130837) UID: 0 2023-07-07T03:49:46.906 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:49:46.909 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:50:17.011 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:50:17.013 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:50:47.093 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:50:47.095 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:51:17.470 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:51:17.472 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:51:47.583 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:51:47.586 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:52:17.646 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:52:17.650 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:52:47.729 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:52:47.732 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:53:18.037 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:53:18.039 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:53:48.147 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:53:48.150 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:54:18.480 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:54:18.484 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:54:48.593 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:54:48.596 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:55:18.722 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:55:18.725 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:55:48.807 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:55:48.810 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:56:18.894 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:56:18.899 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:56:49.392 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:56:49.401 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:57:19.482 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:57:19.490 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:57:49.599 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:57:49.602 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:58:19.679 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:58:19.682 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:58:49.761 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:58:49.763 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:59:19.854 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:59:19.856 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:59:49.950 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T03:59:49.953 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T04:00:06.212 INFO:teuthology.orchestra.run.smithi006.stdout:generic/707 2126s 2023-07-07T04:00:06.233 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/707 2023-07-07T04:00:06.234 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T04:00:06.237 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:06.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T04:00:06.256 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2023-07-07T04:00:06.927 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T04:00:06.936 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T04:00:06.937 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T04:00:06.938 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T04:00:06.938 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:12.439 INFO:teuthology.orchestra.run.smithi006.stdout:generic/708 1s 2023-07-07T04:00:12.452 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/708 2023-07-07T04:00:12.452 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T04:00:12.455 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:12.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T04:00:12.782 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2023-07-07T04:00:13.430 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T04:00:13.437 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T04:00:13.439 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T04:00:13.441 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T04:00:13.441 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:14.036 INFO:teuthology.orchestra.run.smithi006.stdout:generic/709 [not run] xfs_io swapext -v vfs not supported on ceph 2023-07-07T04:00:14.042 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/709 2023-07-07T04:00:14.042 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/709 2023-07-07T04:00:14.042 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T04:00:14.045 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:14.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T04:00:14.373 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2023-07-07T04:00:14.978 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T04:00:14.983 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T04:00:14.984 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T04:00:14.985 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T04:00:14.985 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:15.598 INFO:teuthology.orchestra.run.smithi006.stdout:generic/710 [not run] xfs_io swapext -v vfs not supported on ceph 2023-07-07T04:00:15.603 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/710 2023-07-07T04:00:15.603 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/710 2023-07-07T04:00:15.603 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T04:00:15.605 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:16.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T04:00:16.078 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2023-07-07T04:00:16.614 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T04:00:16.626 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T04:00:16.626 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T04:00:16.627 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T04:00:16.627 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:17.229 INFO:teuthology.orchestra.run.smithi006.stdout:generic/711 [not run] xfs_io swapext -v vfs not supported on ceph 2023-07-07T04:00:17.235 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/711 2023-07-07T04:00:17.235 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/711 2023-07-07T04:00:17.236 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T04:00:17.238 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:17.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T04:00:17.755 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2023-07-07T04:00:18.158 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T04:00:18.164 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T04:00:18.165 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T04:00:18.166 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T04:00:18.166 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:18.785 INFO:teuthology.orchestra.run.smithi006.stdout:generic/712 [not run] xfs_io swapext -v vfs not supported on ceph 2023-07-07T04:00:18.790 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/712 2023-07-07T04:00:18.790 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/712 2023-07-07T04:00:18.790 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T04:00:18.796 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:19.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T04:00:19.333 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2023-07-07T04:00:19.738 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T04:00:19.749 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T04:00:19.750 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T04:00:19.751 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T04:00:19.751 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:20.371 INFO:teuthology.orchestra.run.smithi006.stdout:generic/713 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph 2023-07-07T04:00:20.379 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/713 2023-07-07T04:00:20.379 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/713 2023-07-07T04:00:20.379 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T04:00:20.382 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:20.444 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T04:00:20.535 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T04:00:20.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T04:00:20.781 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2023-07-07T04:00:21.512 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T04:00:21.517 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T04:00:21.517 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T04:00:21.518 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T04:00:21.519 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:22.188 INFO:teuthology.orchestra.run.smithi006.stdout:generic/714 [not run] xfs_io swapext -v vfs not supported on ceph 2023-07-07T04:00:22.201 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/714 2023-07-07T04:00:22.201 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/714 2023-07-07T04:00:22.201 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T04:00:22.205 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:22.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T04:00:22.739 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2023-07-07T04:00:23.145 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T04:00:23.150 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T04:00:23.151 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T04:00:23.152 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T04:00:23.152 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:23.831 INFO:teuthology.orchestra.run.smithi006.stdout:generic/715 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph 2023-07-07T04:00:23.837 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/715 2023-07-07T04:00:23.837 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/715 2023-07-07T04:00:23.837 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T04:00:23.846 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:24.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T04:00:24.390 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2023-07-07T04:00:24.816 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T04:00:24.822 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T04:00:24.823 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T04:00:24.824 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T04:00:24.824 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:25.450 INFO:teuthology.orchestra.run.smithi006.stdout:generic/716 [not run] xfs_io swapext -v vfs not supported on ceph 2023-07-07T04:00:25.456 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/716 2023-07-07T04:00:25.456 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/716 2023-07-07T04:00:25.456 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T04:00:25.459 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:25.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T04:00:25.969 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2023-07-07T04:00:26.452 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T04:00:26.457 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T04:00:26.457 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T04:00:26.458 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T04:00:26.458 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:27.124 INFO:teuthology.orchestra.run.smithi006.stdout:generic/717 [not run] xfs_io swapext -v vfs not supported on ceph 2023-07-07T04:00:27.129 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/717 2023-07-07T04:00:27.130 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/717 2023-07-07T04:00:27.130 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T04:00:27.132 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:27.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T04:00:27.638 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2023-07-07T04:00:28.079 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T04:00:28.089 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T04:00:28.089 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T04:00:28.090 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T04:00:28.090 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:28.663 INFO:teuthology.orchestra.run.smithi006.stdout:generic/718 [not run] xfs_io swapext -v vfs not supported on ceph 2023-07-07T04:00:28.667 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/718 2023-07-07T04:00:28.668 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/718 2023-07-07T04:00:28.668 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T04:00:28.670 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:29.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T04:00:29.190 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2023-07-07T04:00:29.571 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T04:00:29.578 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T04:00:29.578 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T04:00:29.580 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T04:00:29.580 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:30.173 INFO:teuthology.orchestra.run.smithi006.stdout:generic/719 [not run] xfs_io swapext -v vfs not supported on ceph 2023-07-07T04:00:30.180 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/719 2023-07-07T04:00:30.180 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/719 2023-07-07T04:00:30.180 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T04:00:30.183 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:30.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T04:00:30.668 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2023-07-07T04:00:31.119 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T04:00:31.124 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T04:00:31.124 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T04:00:31.125 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T04:00:31.126 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:31.683 INFO:teuthology.orchestra.run.smithi006.stdout:generic/720 [not run] xfs_io swapext -v vfs not supported on ceph 2023-07-07T04:00:31.687 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/720 2023-07-07T04:00:31.688 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/720 2023-07-07T04:00:31.688 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T04:00:31.690 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:32.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T04:00:32.021 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2023-07-07T04:00:32.636 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T04:00:32.647 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T04:00:32.648 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T04:00:32.649 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T04:00:32.649 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:33.231 INFO:teuthology.orchestra.run.smithi006.stdout:generic/721 [not run] xfs_io startupdate support is missing 2023-07-07T04:00:33.236 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/721 2023-07-07T04:00:33.236 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/721 2023-07-07T04:00:33.236 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T04:00:33.242 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:33.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T04:00:33.311 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2023-07-07T04:00:33.718 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T04:00:33.723 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T04:00:33.724 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T04:00:33.725 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T04:00:33.725 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:34.403 INFO:teuthology.orchestra.run.smithi006.stdout:generic/722 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-07-07T04:00:34.416 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/722 2023-07-07T04:00:34.416 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/722 2023-07-07T04:00:34.416 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T04:00:34.419 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:34.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T04:00:34.670 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2023-07-07T04:00:35.354 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T04:00:35.363 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T04:00:35.364 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T04:00:35.365 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T04:00:35.366 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:36.048 INFO:teuthology.orchestra.run.smithi006.stdout:generic/723 [not run] xfs_io swapext -v vfs not supported on ceph 2023-07-07T04:00:36.061 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/723 2023-07-07T04:00:36.061 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/723 2023-07-07T04:00:36.062 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T04:00:36.064 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:36.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T04:00:36.575 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2023-07-07T04:00:37.024 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T04:00:37.040 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T04:00:37.043 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T04:00:37.047 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T04:00:37.048 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:37.646 INFO:teuthology.orchestra.run.smithi006.stdout:generic/724 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-07-07T04:00:37.651 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/724 2023-07-07T04:00:37.651 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/724 2023-07-07T04:00:37.651 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T04:00:37.655 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:38.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T04:00:38.150 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2023-07-07T04:00:38.615 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T04:00:38.624 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T04:00:38.626 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T04:00:38.627 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T04:00:38.627 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:39.269 INFO:teuthology.orchestra.run.smithi006.stdout:generic/725 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-07-07T04:00:39.279 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/725 2023-07-07T04:00:39.279 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/725 2023-07-07T04:00:39.279 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T04:00:39.282 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:39.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T04:00:39.769 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2023-07-07T04:00:40.302 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T04:00:40.307 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T04:00:40.324 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T04:00:40.324 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T04:00:40.325 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:41.247 INFO:teuthology.orchestra.run.smithi006.stdout:generic/726 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-07-07T04:00:41.253 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/726 2023-07-07T04:00:41.253 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/726 2023-07-07T04:00:41.254 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T04:00:41.256 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:41.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T04:00:41.528 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2023-07-07T04:00:42.230 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T04:00:42.234 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T04:00:42.234 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T04:00:42.236 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T04:00:42.236 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:42.954 INFO:teuthology.orchestra.run.smithi006.stdout:generic/727 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-07-07T04:00:42.958 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/727 2023-07-07T04:00:42.958 INFO:teuthology.orchestra.run.smithi006.stdout:Not run: generic/727 2023-07-07T04:00:42.958 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T04:00:42.961 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:43.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T04:00:43.459 DEBUG:teuthology.orchestra.run.smithi006:> (cd /tmp/tmp.LybHGoQKZdxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2023-07-07T04:00:43.894 INFO:teuthology.orchestra.run.smithi006.stdout:FSTYP -- ceph 2023-07-07T04:00:43.900 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM -- Linux/x86_64 smithi006 4.18.0-372.9.1.el8.x86_64 #1 SMP Fri Apr 15 22:12:19 EDT 2022 2023-07-07T04:00:43.900 INFO:teuthology.orchestra.run.smithi006.stdout:MKFS_OPTIONS -- 172.21.15.6:6789:/scratch 2023-07-07T04:00:43.901 INFO:teuthology.orchestra.run.smithi006.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC/HKdkF6DuOhAAEcfZmBWDrxTXJqu2wvg2/g== -o context=system_u:object_r:root_t:s0 172.21.15.6:6789:/scratch /tmp/tmp.EQx4TaXM2Pscratch 2023-07-07T04:00:43.901 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:48.676 INFO:teuthology.orchestra.run.smithi006.stdout:generic/728 4s 2023-07-07T04:00:48.691 INFO:teuthology.orchestra.run.smithi006.stdout:Ran: generic/728 2023-07-07T04:00:48.691 INFO:teuthology.orchestra.run.smithi006.stdout:Passed all 1 tests 2023-07-07T04:00:48.695 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:49.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-07T04:00:49.007 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 2========================================================= 2023-07-07T04:00:49.008 DEBUG:teuthology.orchestra.run.smithi006:> sudo userdel --force --remove fsgqa 2023-07-07T04:00:49.308 INFO:teuthology.orchestra.run.smithi006.stderr:userdel: user fsgqa is currently used by process 938802 2023-07-07T04:00:51.351 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T04:00:51.354 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T04:00:51.749 DEBUG:teuthology.orchestra.run.smithi006:> sudo userdel --force --remove 123456-fsgqa 2023-07-07T04:00:52.732 DEBUG:teuthology.orchestra.run.smithi006:> sudo groupdel fsgqa 2023-07-07T04:00:52.828 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-07-07T04:00:52.829 INFO:teuthology.orchestra.run.smithi006.stderr:groupdel: group 'fsgqa' does not exist 2023-07-07T04:00:52.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T04:00:52.830 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.LybHGoQKZdxfstests-dev/results) 2023-07-07T04:00:52.894 INFO:teuthology.orchestra.run.smithi006.stdout: File: /tmp/tmp.LybHGoQKZdxfstests-dev/results 2023-07-07T04:00:52.894 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 4096 Blocks: 8 IO Block: 4096 directory 2023-07-07T04:00:52.894 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 801h/2049d Inode: 794362 Links: 3 2023-07-07T04:00:52.895 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-07T04:00:52.895 INFO:teuthology.orchestra.run.smithi006.stdout:Context: unconfined_u:object_r:user_tmp_t:s0 2023-07-07T04:00:52.895 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-07-06 20:01:54.139518150 +0000 2023-07-07T04:00:52.895 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-07-07 04:00:48.688381569 +0000 2023-07-07T04:00:52.895 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-07-07 04:00:48.688381569 +0000 2023-07-07T04:00:52.895 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2023-07-06 20:01:54.139518150 +0000 2023-07-07T04:00:52.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T04:00:52.897 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p /var/log/ceph/xfstests-dev-results) 2023-07-07T04:00:53.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T04:00:53.006 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -r /tmp/tmp.LybHGoQKZdxfstests-dev/results /var/log/ceph/xfstests-dev-results) 2023-07-07T04:00:53.575 INFO:tasks.cephfs.xfstests_dev:results dir from xfstests-dev has been saved; it was copied from /tmp/tmp.LybHGoQKZdxfstests-dev to /var/log/ceph. 2023-07-07T04:00:53.576 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf /tmp/tmp.LybHGoQKZdxfstests-dev 2023-07-07T04:00:54.091 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-07T04:00:54.091 DEBUG:teuthology.orchestra.run.smithi006:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-07T04:00:54.200 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-07T04:00:54.313 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-07T04:00:54.313 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-07T04:00:54.314 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T04:00:54.363 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-07T04:00:54.363 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T04:00:54.425 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T04:00:58.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.685+0000 7f823aa1d700 1 Processor -- start 2023-07-07T04:00:58.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.691+0000 7f823aa1d700 1 -- start start 2023-07-07T04:00:58.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.692+0000 7f823aa1d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8234070d60 0x7f82340adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:00:58.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.692+0000 7f823aa1d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f823406abe0 0x7f82340cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:00:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.692+0000 7f823aa1d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f823406a750 con 0x7f8234158410 2023-07-07T04:00:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.692+0000 7f823aa1d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82341587e0 con 0x7f823406abe0 2023-07-07T04:00:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.692+0000 7f823aa1d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82340ce530 con 0x7f8234070d60 2023-07-07T04:00:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.692+0000 7f8233fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f8234158410 0x7f8234070650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49090/0 (socket says 172.21.15.6:49090) 2023-07-07T04:00:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.692+0000 7f8233fff700 1 -- 172.21.15.6:0/3452522019 learned_addr learned my addr 172.21.15.6:0/3452522019 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:00:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.692+0000 7f82337fe700 1 --2- 172.21.15.6:0/3452522019 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8234070d60 0x7f82340adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:00:58.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.693+0000 7f8232ffd700 1 -- 172.21.15.6:0/3452522019 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861670820 0 0) 0x7f823406a750 con 0x7f8234158410 2023-07-07T04:00:58.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.693+0000 7f8232ffd700 1 -- 172.21.15.6:0/3452522019 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f821c0034d0 con 0x7f8234158410 2023-07-07T04:00:58.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.693+0000 7f82337fe700 1 -- 172.21.15.6:0/3452522019 >> v2:172.21.15.6:3300/0 conn(0x7f823406abe0 msgr2=0x7f82340cdff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-07T04:00:58.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.693+0000 7f82337fe700 1 --2- 172.21.15.6:0/3452522019 >> v2:172.21.15.6:3300/0 conn(0x7f823406abe0 0x7f82340cdff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:00:58.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.693+0000 7f82337fe700 1 -- 172.21.15.6:0/3452522019 >> v1:172.21.15.6:6789/0 conn(0x7f8234158410 legacy=0x7f8234070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:00:58.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.693+0000 7f82337fe700 1 -- 172.21.15.6:0/3452522019 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82340b1a50 con 0x7f8234070d60 2023-07-07T04:00:58.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.693+0000 7f82337fe700 1 --2- 172.21.15.6:0/3452522019 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8234070d60 0x7f82340adfc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f82280091e0 tx=0x7f82280094f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b83c33760fbf0c47 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:00:58.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.693+0000 7f8232ffd700 1 -- 172.21.15.6:0/3452522019 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8228011830 con 0x7f8234070d60 2023-07-07T04:00:58.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.693+0000 7f8232ffd700 1 -- 172.21.15.6:0/3452522019 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8228011990 con 0x7f8234070d60 2023-07-07T04:00:58.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.693+0000 7f8232ffd700 1 -- 172.21.15.6:0/3452522019 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8228011d20 con 0x7f8234070d60 2023-07-07T04:00:58.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.694+0000 7f823aa1d700 1 -- 172.21.15.6:0/3452522019 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8234070d60 msgr2=0x7f82340adfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:00:58.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.694+0000 7f823aa1d700 1 --2- 172.21.15.6:0/3452522019 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8234070d60 0x7f82340adfc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f82280091e0 tx=0x7f82280094f0 comp rx=0 tx=0).stop 2023-07-07T04:00:58.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.695+0000 7f823aa1d700 1 -- 172.21.15.6:0/3452522019 shutdown_connections 2023-07-07T04:00:58.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.695+0000 7f823aa1d700 1 --2- 172.21.15.6:0/3452522019 >> v2:172.21.15.6:3300/0 conn(0x7f823406abe0 0x7f82340cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:00:58.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.695+0000 7f823aa1d700 1 --2- 172.21.15.6:0/3452522019 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8234070d60 0x7f82340adfc0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:00:58.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.695+0000 7f823aa1d700 1 -- 172.21.15.6:0/3452522019 >> 172.21.15.6:0/3452522019 conn(0x7f82340b05b0 msgr2=0x7f82340b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:00:58.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.695+0000 7f823aa1d700 1 -- 172.21.15.6:0/3452522019 shutdown_connections 2023-07-07T04:00:58.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.695+0000 7f823aa1d700 1 -- 172.21.15.6:0/3452522019 wait complete. 2023-07-07T04:00:58.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.697+0000 7f823aa1d700 1 Processor -- start 2023-07-07T04:00:58.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.697+0000 7f823aa1d700 1 -- start start 2023-07-07T04:00:58.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.698+0000 7f823aa1d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f823406abe0 0x7f82341f2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:00:58.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.698+0000 7f823aa1d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8234070d60 0x7f82341f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:00:58.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.698+0000 7f823aa1d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8234158410 0x7f82341f47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:00:58.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.698+0000 7f823aa1d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82340ad6e0 con 0x7f823406abe0 2023-07-07T04:00:58.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.698+0000 7f823aa1d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82341f29b0 con 0x7f8234070d60 2023-07-07T04:00:58.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.698+0000 7f823aa1d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82340acad0 con 0x7f8234158410 2023-07-07T04:00:58.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.698+0000 7f8238fba700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8234158410 0x7f82341f47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:00:58.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.698+0000 7f8238fba700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8234158410 0x7f82341f47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:40530/0 (socket says 172.21.15.6:40530) 2023-07-07T04:00:58.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.698+0000 7f8238fba700 1 -- 172.21.15.6:0/2663487651 learned_addr learned my addr 172.21.15.6:0/2663487651 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:00:58.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.699+0000 7f82337fe700 1 --2- 172.21.15.6:0/2663487651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8234070d60 0x7f82341f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:00:58.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.699+0000 7f8238fba700 1 -- 172.21.15.6:0/2663487651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8234070d60 msgr2=0x7f82341f2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:00:58.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.699+0000 7f8238fba700 1 --2- 172.21.15.6:0/2663487651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8234070d60 0x7f82341f2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:00:58.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.699+0000 7f8238fba700 1 -- 172.21.15.6:0/2663487651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f823406abe0 msgr2=0x7f82341f2c00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-07T04:00:58.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.699+0000 7f8238fba700 1 --2- 172.21.15.6:0/2663487651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f823406abe0 0x7f82341f2c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:00:58.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.699+0000 7f8238fba700 1 -- 172.21.15.6:0/2663487651 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8228009d30 con 0x7f8234158410 2023-07-07T04:00:58.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.699+0000 7f8238fba700 1 --2- 172.21.15.6:0/2663487651 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8234158410 0x7f82341f47c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f822400b970 tx=0x7f822400bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:00:58.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.699+0000 7f8230ff9700 1 -- 172.21.15.6:0/2663487651 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822400c930 con 0x7f8234158410 2023-07-07T04:00:58.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.699+0000 7f8230ff9700 1 -- 172.21.15.6:0/2663487651 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822400cab0 con 0x7f8234158410 2023-07-07T04:00:58.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.699+0000 7f823aa1d700 1 -- 172.21.15.6:0/2663487651 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82340acdb0 con 0x7f8234158410 2023-07-07T04:00:58.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.699+0000 7f8230ff9700 1 -- 172.21.15.6:0/2663487651 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822400cea0 con 0x7f8234158410 2023-07-07T04:00:58.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.700+0000 7f823aa1d700 1 -- 172.21.15.6:0/2663487651 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82340ad370 con 0x7f8234158410 2023-07-07T04:00:58.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.701+0000 7f823aa1d700 1 -- 172.21.15.6:0/2663487651 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f823406c780 con 0x7f8234158410 2023-07-07T04:00:58.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.701+0000 7f8230ff9700 1 -- 172.21.15.6:0/2663487651 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8224014440 con 0x7f8234158410 2023-07-07T04:00:58.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.702+0000 7f8230ff9700 1 --2- 172.21.15.6:0/2663487651 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f822006ace0 0x7f822006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:00:58.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.702+0000 7f8230ff9700 1 -- 172.21.15.6:0/2663487651 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f8224089140 con 0x7f8234158410 2023-07-07T04:00:58.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.704+0000 7f8233fff700 1 --2- 172.21.15.6:0/2663487651 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f822006ace0 0x7f822006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:00:58.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.704+0000 7f8233fff700 1 --2- 172.21.15.6:0/2663487651 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f822006ace0 0x7f822006d190 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f822c007fd0 tx=0x7f822c007980 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:00:58.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:58.708+0000 7f8230ff9700 1 -- 172.21.15.6:0/2663487651 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8224057c40 con 0x7f8234158410 2023-07-07T04:00:59.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.039+0000 7f823aa1d700 1 -- 172.21.15.6:0/2663487651 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82340aec70 con 0x7f8234158410 2023-07-07T04:00:59.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.041+0000 7f8230ff9700 1 -- 172.21.15.6:0/2663487651 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18496 (secure 0 0 0) 0x7f82240577d0 con 0x7f8234158410 2023-07-07T04:00:59.044 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:00:59.044 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":43,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T20:00:34.816976+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-06T20:00:16.527659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-06T20:00:17.129118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T04:00:59.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.045+0000 7f823aa1d700 1 -- 172.21.15.6:0/2663487651 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f822006ace0 msgr2=0x7f822006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:00:59.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.045+0000 7f823aa1d700 1 --2- 172.21.15.6:0/2663487651 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f822006ace0 0x7f822006d190 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f822c007fd0 tx=0x7f822c007980 comp rx=0 tx=0).stop 2023-07-07T04:00:59.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.045+0000 7f823aa1d700 1 -- 172.21.15.6:0/2663487651 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8234158410 msgr2=0x7f82341f47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:00:59.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.045+0000 7f823aa1d700 1 --2- 172.21.15.6:0/2663487651 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8234158410 0x7f82341f47c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f822400b970 tx=0x7f822400bc80 comp rx=0 tx=0).stop 2023-07-07T04:00:59.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.049+0000 7f823aa1d700 1 -- 172.21.15.6:0/2663487651 shutdown_connections 2023-07-07T04:00:59.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.049+0000 7f823aa1d700 1 --2- 172.21.15.6:0/2663487651 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f822006ace0 0x7f822006d190 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:00:59.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.049+0000 7f823aa1d700 1 --2- 172.21.15.6:0/2663487651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f823406abe0 0x7f82341f2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:00:59.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.049+0000 7f823aa1d700 1 --2- 172.21.15.6:0/2663487651 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f8234158410 0x7f82341f47c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:00:59.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.049+0000 7f823aa1d700 1 --2- 172.21.15.6:0/2663487651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8234070d60 0x7f82341f2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:00:59.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.049+0000 7f823aa1d700 1 -- 172.21.15.6:0/2663487651 >> 172.21.15.6:0/2663487651 conn(0x7f82340b05b0 msgr2=0x7f82340aef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:00:59.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.050+0000 7f823aa1d700 1 -- 172.21.15.6:0/2663487651 shutdown_connections 2023-07-07T04:00:59.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.050+0000 7f823aa1d700 1 -- 172.21.15.6:0/2663487651 wait complete. 2023-07-07T04:00:59.072 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T19:58:38.767727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T19:58:45.759808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T20:00:16.527659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T20:00:17.129118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-07T04:00:59.073 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-07T04:00:59.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.303+0000 7f0614442700 1 Processor -- start 2023-07-07T04:00:59.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.303+0000 7f0614442700 1 -- start start 2023-07-07T04:00:59.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.304+0000 7f0614442700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f060c071900 0x7f060c0ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:00:59.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.304+0000 7f0614442700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f060c0cb310 con 0x7f060c15c660 2023-07-07T04:00:59.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.304+0000 7f0614442700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f060c0af070 con 0x7f060c071cd0 2023-07-07T04:00:59.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.304+0000 7f0614442700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060c0cdbf0 con 0x7f060c071900 2023-07-07T04:00:59.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.304+0000 7f06129df700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f060c15c660 0x7f060c0ce010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49102/0 (socket says 172.21.15.6:49102) 2023-07-07T04:00:59.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.304+0000 7f06129df700 1 -- 172.21.15.6:0/3172318774 learned_addr learned my addr 172.21.15.6:0/3172318774 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:00:59.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.308+0000 7f06121de700 1 --2- 172.21.15.6:0/3172318774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f060c071900 0x7f060c0ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:00:59.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.308+0000 7f06121de700 1 -- 172.21.15.6:0/3172318774 >> v1:172.21.15.40:6789/0 conn(0x7f060c071cd0 legacy=0x7f060c15bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:00:59.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.308+0000 7f06121de700 1 -- 172.21.15.6:0/3172318774 >> v1:172.21.15.6:6789/0 conn(0x7f060c15c660 legacy=0x7f060c0ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:00:59.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.308+0000 7f06121de700 1 -- 172.21.15.6:0/3172318774 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060c0cad50 con 0x7f060c071900 2023-07-07T04:00:59.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.309+0000 7f06121de700 1 --2- 172.21.15.6:0/3172318774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f060c071900 0x7f060c0ca140 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009870 tx=0x7f05fc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d39e0a150ae5549 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:00:59.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.328+0000 7f06111dc700 1 -- 172.21.15.6:0/3172318774 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc011830 con 0x7f060c071900 2023-07-07T04:00:59.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.328+0000 7f06111dc700 1 -- 172.21.15.6:0/3172318774 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05fc011990 con 0x7f060c071900 2023-07-07T04:00:59.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.328+0000 7f06111dc700 1 -- 172.21.15.6:0/3172318774 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc011d20 con 0x7f060c071900 2023-07-07T04:00:59.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.329+0000 7f0614442700 1 -- 172.21.15.6:0/3172318774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f060c071900 msgr2=0x7f060c0ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:00:59.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.329+0000 7f0614442700 1 --2- 172.21.15.6:0/3172318774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f060c071900 0x7f060c0ca140 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009870 tx=0x7f05fc009b80 comp rx=0 tx=0).stop 2023-07-07T04:00:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.330+0000 7f0614442700 1 -- 172.21.15.6:0/3172318774 shutdown_connections 2023-07-07T04:00:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.330+0000 7f0614442700 1 --2- 172.21.15.6:0/3172318774 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f060c071900 0x7f060c0ca140 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:00:59.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.330+0000 7f0614442700 1 -- 172.21.15.6:0/3172318774 >> 172.21.15.6:0/3172318774 conn(0x7f060c0cf960 msgr2=0x7f060c0cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:00:59.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.334+0000 7f0614442700 1 -- 172.21.15.6:0/3172318774 shutdown_connections 2023-07-07T04:00:59.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.334+0000 7f0614442700 1 -- 172.21.15.6:0/3172318774 wait complete. 2023-07-07T04:00:59.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.335+0000 7f0614442700 1 Processor -- start 2023-07-07T04:00:59.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.335+0000 7f0614442700 1 -- start start 2023-07-07T04:00:59.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.336+0000 7f0614442700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f060c071900 0x7f060c151780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:00:59.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.336+0000 7f0614442700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f060c071cd0 0x7f060c0b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:00:59.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.336+0000 7f0614442700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f060c15c660 0x7f060c0b4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:00:59.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.336+0000 7f0614442700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c0b2b20 con 0x7f060c071900 2023-07-07T04:00:59.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.336+0000 7f0614442700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060c0b5630 con 0x7f060c15c660 2023-07-07T04:00:59.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.336+0000 7f0614442700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060c0b4c90 con 0x7f060c071cd0 2023-07-07T04:00:59.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.336+0000 7f06119dd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f060c071cd0 0x7f060c0b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:00:59.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.336+0000 7f06129df700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f060c15c660 0x7f060c0b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:00:59.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.336+0000 7f06119dd700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f060c071cd0 0x7f060c0b3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:40544/0 (socket says 172.21.15.6:40544) 2023-07-07T04:00:59.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.336+0000 7f06119dd700 1 -- 172.21.15.6:0/3900770651 learned_addr learned my addr 172.21.15.6:0/3900770651 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:00:59.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.337+0000 7f06119dd700 1 -- 172.21.15.6:0/3900770651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f060c15c660 msgr2=0x7f060c0b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:00:59.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.337+0000 7f06119dd700 1 --2- 172.21.15.6:0/3900770651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f060c15c660 0x7f060c0b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:00:59.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.337+0000 7f06119dd700 1 -- 172.21.15.6:0/3900770651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f060c071900 msgr2=0x7f060c151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:00:59.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.337+0000 7f06119dd700 1 --2- 172.21.15.6:0/3900770651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f060c071900 0x7f060c151780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:00:59.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.337+0000 7f06119dd700 1 -- 172.21.15.6:0/3900770651 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05fc0094a0 con 0x7f060c071cd0 2023-07-07T04:00:59.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.337+0000 7f06119dd700 1 --2- 172.21.15.6:0/3900770651 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f060c071cd0 0x7f060c0b3ee0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f060800c450 tx=0x7f060800c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:00:59.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.338+0000 7f0602ffd700 1 -- 172.21.15.6:0/3900770651 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06080052d0 con 0x7f060c071cd0 2023-07-07T04:00:59.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.338+0000 7f0602ffd700 1 -- 172.21.15.6:0/3900770651 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0608005430 con 0x7f060c071cd0 2023-07-07T04:00:59.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.338+0000 7f0614442700 1 -- 172.21.15.6:0/3900770651 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060c0b4f70 con 0x7f060c071cd0 2023-07-07T04:00:59.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.338+0000 7f0614442700 1 -- 172.21.15.6:0/3900770651 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f060c0b4960 con 0x7f060c071cd0 2023-07-07T04:00:59.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.338+0000 7f0602ffd700 1 -- 172.21.15.6:0/3900770651 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06080038c0 con 0x7f060c071cd0 2023-07-07T04:00:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.339+0000 7f0614442700 1 -- 172.21.15.6:0/3900770651 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f40052f0 con 0x7f060c071cd0 2023-07-07T04:00:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.341+0000 7f0602ffd700 1 -- 172.21.15.6:0/3900770651 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0608003a20 con 0x7f060c071cd0 2023-07-07T04:00:59.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.342+0000 7f0602ffd700 1 --2- 172.21.15.6:0/3900770651 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f05f006ad30 0x7f05f006d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:00:59.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.342+0000 7f0602ffd700 1 -- 172.21.15.6:0/3900770651 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f0608088a20 con 0x7f060c071cd0 2023-07-07T04:00:59.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.345+0000 7f06121de700 1 --2- 172.21.15.6:0/3900770651 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f05f006ad30 0x7f05f006d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:00:59.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.346+0000 7f06121de700 1 --2- 172.21.15.6:0/3900770651 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f05f006ad30 0x7f05f006d1e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009bc0 tx=0x7f05fc010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:00:59.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.348+0000 7f0602ffd700 1 -- 172.21.15.6:0/3900770651 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0608053a40 con 0x7f060c071cd0 2023-07-07T04:00:59.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.686+0000 7f0614442700 1 -- 172.21.15.6:0/3900770651 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f05f4005b20 con 0x7f060c071cd0 2023-07-07T04:00:59.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.686+0000 7f0602ffd700 1 -- 172.21.15.6:0/3900770651 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0608057060 con 0x7f060c071cd0 2023-07-07T04:00:59.689 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-07T04:00:59.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.692+0000 7f0614442700 1 -- 172.21.15.6:0/3900770651 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f05f006ad30 msgr2=0x7f05f006d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:00:59.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.692+0000 7f0614442700 1 --2- 172.21.15.6:0/3900770651 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f05f006ad30 0x7f05f006d1e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009bc0 tx=0x7f05fc010000 comp rx=0 tx=0).stop 2023-07-07T04:00:59.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.692+0000 7f0614442700 1 -- 172.21.15.6:0/3900770651 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f060c071cd0 msgr2=0x7f060c0b3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:00:59.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.692+0000 7f0614442700 1 --2- 172.21.15.6:0/3900770651 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f060c071cd0 0x7f060c0b3ee0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f060800c450 tx=0x7f060800c810 comp rx=0 tx=0).stop 2023-07-07T04:00:59.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.699+0000 7f0614442700 1 -- 172.21.15.6:0/3900770651 shutdown_connections 2023-07-07T04:00:59.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.699+0000 7f0614442700 1 --2- 172.21.15.6:0/3900770651 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f05f006ad30 0x7f05f006d1e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:00:59.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.699+0000 7f0614442700 1 --2- 172.21.15.6:0/3900770651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f060c071900 0x7f060c151780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:00:59.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.699+0000 7f0614442700 1 --2- 172.21.15.6:0/3900770651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f060c15c660 0x7f060c0b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:00:59.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.699+0000 7f0614442700 1 --2- 172.21.15.6:0/3900770651 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f060c071cd0 0x7f060c0b3ee0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:00:59.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.699+0000 7f0614442700 1 -- 172.21.15.6:0/3900770651 >> 172.21.15.6:0/3900770651 conn(0x7f060c0cf960 msgr2=0x7f060c06c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:00:59.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.703+0000 7f0614442700 1 -- 172.21.15.6:0/3900770651 shutdown_connections 2023-07-07T04:00:59.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.703+0000 7f0614442700 1 -- 172.21.15.6:0/3900770651 wait complete. 2023-07-07T04:00:59.735 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-07T04:00:59.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.939+0000 7fdbd1495700 1 Processor -- start 2023-07-07T04:00:59.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.939+0000 7fdbd1495700 1 -- start start 2023-07-07T04:00:59.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.940+0000 7fdbd1495700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdbcc0cd630 0x7fdbcc0ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:00:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.940+0000 7fdbd1495700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fdbcc06c040 0x7fdbcc0ca740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:00:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.940+0000 7fdbd1495700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbcc0c9d70 con 0x7fdbcc0cefe0 2023-07-07T04:00:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.940+0000 7fdbd1495700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbcc0c9810 con 0x7fdbcc06c040 2023-07-07T04:00:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.940+0000 7fdbd1495700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc06bdf0 con 0x7fdbcc0cd630 2023-07-07T04:00:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.940+0000 7fdbcaffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fdbcc0cefe0 0x7fdbcc0cf3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49114/0 (socket says 172.21.15.6:49114) 2023-07-07T04:00:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.941+0000 7fdbcaffd700 1 -- 172.21.15.6:0/2219148738 learned_addr learned my addr 172.21.15.6:0/2219148738 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:00:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.941+0000 7fdbcb7fe700 1 --2- 172.21.15.6:0/2219148738 >> v2:172.21.15.6:3300/0 conn(0x7fdbcc06c040 0x7fdbcc0ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:00:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.941+0000 7fdbca7fc700 1 --2- 172.21.15.6:0/2219148738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdbcc0cd630 0x7fdbcc0ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:00:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.941+0000 7fdbca7fc700 1 -- 172.21.15.6:0/2219148738 >> v2:172.21.15.6:3300/0 conn(0x7fdbcc06c040 msgr2=0x7fdbcc0ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:00:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.941+0000 7fdbca7fc700 1 --2- 172.21.15.6:0/2219148738 >> v2:172.21.15.6:3300/0 conn(0x7fdbcc06c040 0x7fdbcc0ca740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:00:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.941+0000 7fdbca7fc700 1 -- 172.21.15.6:0/2219148738 >> v1:172.21.15.6:6789/0 conn(0x7fdbcc0cefe0 legacy=0x7fdbcc0cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:00:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.941+0000 7fdbca7fc700 1 -- 172.21.15.6:0/2219148738 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbcc06b830 con 0x7fdbcc0cd630 2023-07-07T04:00:59.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.941+0000 7fdbc9ffb700 1 -- 172.21.15.6:0/2219148738 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083912756 0 0) 0x7fdbcc0c9d70 con 0x7fdbcc0cefe0 2023-07-07T04:00:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.941+0000 7fdbcb7fe700 1 --2- 172.21.15.6:0/2219148738 >> v2:172.21.15.6:3300/0 conn(0x7fdbcc06c040 0x7fdbcc0ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T04:00:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.941+0000 7fdbca7fc700 1 --2- 172.21.15.6:0/2219148738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdbcc0cd630 0x7fdbcc0ca200 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009840 tx=0x7fdbc0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b71d5c9f74e52da0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:00:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.941+0000 7fdbc9ffb700 1 -- 172.21.15.6:0/2219148738 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0011830 con 0x7fdbcc0cd630 2023-07-07T04:00:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.942+0000 7fdbc9ffb700 1 -- 172.21.15.6:0/2219148738 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc0011990 con 0x7fdbcc0cd630 2023-07-07T04:00:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.942+0000 7fdbc9ffb700 1 -- 172.21.15.6:0/2219148738 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0011d20 con 0x7fdbcc0cd630 2023-07-07T04:00:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.942+0000 7fdbd1495700 1 -- 172.21.15.6:0/2219148738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdbcc0cd630 msgr2=0x7fdbcc0ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:00:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.942+0000 7fdbd1495700 1 --2- 172.21.15.6:0/2219148738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdbcc0cd630 0x7fdbcc0ca200 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009840 tx=0x7fdbc0009b50 comp rx=0 tx=0).stop 2023-07-07T04:00:59.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.942+0000 7fdbd1495700 1 -- 172.21.15.6:0/2219148738 shutdown_connections 2023-07-07T04:00:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.942+0000 7fdbd1495700 1 --2- 172.21.15.6:0/2219148738 >> v2:172.21.15.6:3300/0 conn(0x7fdbcc06c040 0x7fdbcc0ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:00:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.942+0000 7fdbd1495700 1 --2- 172.21.15.6:0/2219148738 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdbcc0cd630 0x7fdbcc0ca200 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:00:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.942+0000 7fdbd1495700 1 -- 172.21.15.6:0/2219148738 >> 172.21.15.6:0/2219148738 conn(0x7fdbcc0b0b60 msgr2=0x7fdbcc0b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:00:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.942+0000 7fdbd1495700 1 -- 172.21.15.6:0/2219148738 shutdown_connections 2023-07-07T04:00:59.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.942+0000 7fdbd1495700 1 -- 172.21.15.6:0/2219148738 wait complete. 2023-07-07T04:00:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.944+0000 7fdbd1495700 1 Processor -- start 2023-07-07T04:00:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.944+0000 7fdbd1495700 1 -- start start 2023-07-07T04:00:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.945+0000 7fdbd1495700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbcc06c040 0x7fdbcc15aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:00:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.945+0000 7fdbd1495700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdbcc0cd630 0x7fdbcc158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:00:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.945+0000 7fdbd1495700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbcc0cefe0 0x7fdbcc1591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:00:59.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.945+0000 7fdbd1495700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc15b8d0 con 0x7fdbcc06c040 2023-07-07T04:00:59.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.945+0000 7fdbd1495700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc15bbb0 con 0x7fdbcc0cefe0 2023-07-07T04:00:59.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.945+0000 7fdbd1495700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc15be90 con 0x7fdbcc0cd630 2023-07-07T04:00:59.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.946+0000 7fdbcb7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbcc0cefe0 0x7fdbcc1591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:00:59.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.946+0000 7fdbcb7fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbcc0cefe0 0x7fdbcc1591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:55184/0 (socket says 172.21.15.6:55184) 2023-07-07T04:00:59.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.946+0000 7fdbcb7fe700 1 -- 172.21.15.6:0/4001906290 learned_addr learned my addr 172.21.15.6:0/4001906290 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:00:59.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.946+0000 7fdbcb7fe700 1 -- 172.21.15.6:0/4001906290 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdbcc0cd630 msgr2=0x7fdbcc158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:00:59.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.946+0000 7fdbcb7fe700 1 --2- 172.21.15.6:0/4001906290 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdbcc0cd630 0x7fdbcc158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:00:59.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.946+0000 7fdbcb7fe700 1 -- 172.21.15.6:0/4001906290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbcc06c040 msgr2=0x7fdbcc15aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:00:59.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.946+0000 7fdbcb7fe700 1 --2- 172.21.15.6:0/4001906290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbcc06c040 0x7fdbcc15aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:00:59.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.946+0000 7fdbcb7fe700 1 -- 172.21.15.6:0/4001906290 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc4009a70 con 0x7fdbcc0cefe0 2023-07-07T04:00:59.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.946+0000 7fdbcb7fe700 1 --2- 172.21.15.6:0/4001906290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbcc0cefe0 0x7fdbcc1591a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400efc0 tx=0x7fdbc400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:00:59.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.946+0000 7fdbb37fe700 1 -- 172.21.15.6:0/4001906290 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4009cd0 con 0x7fdbcc0cefe0 2023-07-07T04:00:59.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.947+0000 7fdbb37fe700 1 -- 172.21.15.6:0/4001906290 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc400f040 con 0x7fdbcc0cefe0 2023-07-07T04:00:59.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.947+0000 7fdbb37fe700 1 -- 172.21.15.6:0/4001906290 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc400cd60 con 0x7fdbcc0cefe0 2023-07-07T04:00:59.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.947+0000 7fdbd1495700 1 -- 172.21.15.6:0/4001906290 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc00094a0 con 0x7fdbcc0cefe0 2023-07-07T04:00:59.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.947+0000 7fdbd1495700 1 -- 172.21.15.6:0/4001906290 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbcc15b430 con 0x7fdbcc0cefe0 2023-07-07T04:00:59.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.952+0000 7fdbd1495700 1 -- 172.21.15.6:0/4001906290 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbcc0b2ed0 con 0x7fdbcc0cefe0 2023-07-07T04:00:59.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.955+0000 7fdbb37fe700 1 -- 172.21.15.6:0/4001906290 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdbc4014480 con 0x7fdbcc0cefe0 2023-07-07T04:00:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.956+0000 7fdbb37fe700 1 --2- 172.21.15.6:0/4001906290 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fdbb806ace0 0x7fdbb806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:00:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.956+0000 7fdbb37fe700 1 -- 172.21.15.6:0/4001906290 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fdbc4089d70 con 0x7fdbcc0cefe0 2023-07-07T04:00:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.956+0000 7fdbcaffd700 1 --2- 172.21.15.6:0/4001906290 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fdbb806ace0 0x7fdbb806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:00:59.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.956+0000 7fdbcaffd700 1 --2- 172.21.15.6:0/4001906290 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fdbb806ace0 0x7fdbb806d190 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0011e0 tx=0x7fdbbc0079b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:00:59.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:00:59.959+0000 7fdbb37fe700 1 -- 172.21.15.6:0/4001906290 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdbcc0b2ed0 con 0x7fdbcc0cefe0 2023-07-07T04:01:00.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.293+0000 7fdbd1495700 1 -- 172.21.15.6:0/4001906290 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdbcc0b32b0 con 0x7fdbcc0cefe0 2023-07-07T04:01:00.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.296+0000 7fdbb37fe700 1 -- 172.21.15.6:0/4001906290 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdbcc0b32b0 con 0x7fdbcc0cefe0 2023-07-07T04:01:00.301 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-07T04:01:00.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.300+0000 7fdbd1495700 1 -- 172.21.15.6:0/4001906290 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fdbb806ace0 msgr2=0x7fdbb806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:00.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.300+0000 7fdbd1495700 1 --2- 172.21.15.6:0/4001906290 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fdbb806ace0 0x7fdbb806d190 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0011e0 tx=0x7fdbbc0079b0 comp rx=0 tx=0).stop 2023-07-07T04:01:00.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.300+0000 7fdbd1495700 1 -- 172.21.15.6:0/4001906290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbcc0cefe0 msgr2=0x7fdbcc1591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:00.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.300+0000 7fdbd1495700 1 --2- 172.21.15.6:0/4001906290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbcc0cefe0 0x7fdbcc1591a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400efc0 tx=0x7fdbc400c3a0 comp rx=0 tx=0).stop 2023-07-07T04:01:00.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.303+0000 7fdbd1495700 1 -- 172.21.15.6:0/4001906290 shutdown_connections 2023-07-07T04:01:00.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.303+0000 7fdbd1495700 1 --2- 172.21.15.6:0/4001906290 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fdbb806ace0 0x7fdbb806d190 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:00.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.303+0000 7fdbd1495700 1 --2- 172.21.15.6:0/4001906290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdbcc06c040 0x7fdbcc15aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:00.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.303+0000 7fdbd1495700 1 --2- 172.21.15.6:0/4001906290 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdbcc0cefe0 0x7fdbcc1591a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:00.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.303+0000 7fdbd1495700 1 --2- 172.21.15.6:0/4001906290 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fdbcc0cd630 0x7fdbcc158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:00.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.303+0000 7fdbd1495700 1 -- 172.21.15.6:0/4001906290 >> 172.21.15.6:0/4001906290 conn(0x7fdbcc0b0b60 msgr2=0x7fdbcc0ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:00.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.312+0000 7fdbd1495700 1 -- 172.21.15.6:0/4001906290 shutdown_connections 2023-07-07T04:01:00.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.312+0000 7fdbd1495700 1 -- 172.21.15.6:0/4001906290 wait complete. 2023-07-07T04:01:00.334 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-07T04:01:00.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.542+0000 7f10f279f700 1 Processor -- start 2023-07-07T04:01:00.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.542+0000 7f10f279f700 1 -- start start 2023-07-07T04:01:00.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.544+0000 7f10f279f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f10ec160900 0x7f10ec0c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:00.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.544+0000 7f10f279f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ec0ca440 0x7f10ec06d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:00.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.544+0000 7f10f279f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f10ec06c650 0x7f10ec06cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:00.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.544+0000 7f10f279f700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10ec0ca8b0 con 0x7f10ec06c650 2023-07-07T04:01:00.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.544+0000 7f10f279f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10ec06cff0 con 0x7f10ec160900 2023-07-07T04:01:00.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.544+0000 7f10f279f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec06d880 con 0x7f10ec0ca440 2023-07-07T04:01:00.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.544+0000 7f10ebfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f10ec160900 0x7f10ec0c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:00.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.544+0000 7f10ebfff700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f10ec160900 0x7f10ec0c58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:55188/0 (socket says 172.21.15.6:55188) 2023-07-07T04:01:00.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.544+0000 7f10ebfff700 1 -- 172.21.15.6:0/4112660817 learned_addr learned my addr 172.21.15.6:0/4112660817 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:00.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.544+0000 7f10eb7fe700 1 --2- 172.21.15.6:0/4112660817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ec0ca440 0x7f10ec06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:00.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.545+0000 7f10eb7fe700 1 -- 172.21.15.6:0/4112660817 >> v2:172.21.15.40:3300/0 conn(0x7f10ec160900 msgr2=0x7f10ec0c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:00.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.545+0000 7f10eb7fe700 1 --2- 172.21.15.6:0/4112660817 >> v2:172.21.15.40:3300/0 conn(0x7f10ec160900 0x7f10ec0c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:00.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.545+0000 7f10eb7fe700 1 -- 172.21.15.6:0/4112660817 >> v2:172.21.15.6:3300/0 conn(0x7f10ec06c650 msgr2=0x7f10ec06cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:00.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.545+0000 7f10eb7fe700 1 --2- 172.21.15.6:0/4112660817 >> v2:172.21.15.6:3300/0 conn(0x7f10ec06c650 0x7f10ec06cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:00.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.545+0000 7f10eb7fe700 1 -- 172.21.15.6:0/4112660817 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec06a850 con 0x7f10ec0ca440 2023-07-07T04:01:00.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.546+0000 7f10eb7fe700 1 --2- 172.21.15.6:0/4112660817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ec0ca440 0x7f10ec06d340 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f10ec0b1500 tx=0x7f10e0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18fdc25d13d0212b server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:00.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.546+0000 7f10eaffd700 1 -- 172.21.15.6:0/4112660817 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e0011830 con 0x7f10ec0ca440 2023-07-07T04:01:00.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.548+0000 7f10eaffd700 1 -- 172.21.15.6:0/4112660817 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e0011990 con 0x7f10ec0ca440 2023-07-07T04:01:00.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.548+0000 7f10eaffd700 1 -- 172.21.15.6:0/4112660817 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e0011d20 con 0x7f10ec0ca440 2023-07-07T04:01:00.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.549+0000 7f10f279f700 1 -- 172.21.15.6:0/4112660817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ec0ca440 msgr2=0x7f10ec06d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:00.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.549+0000 7f10f279f700 1 --2- 172.21.15.6:0/4112660817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ec0ca440 0x7f10ec06d340 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f10ec0b1500 tx=0x7f10e0009b50 comp rx=0 tx=0).stop 2023-07-07T04:01:00.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.549+0000 7f10f279f700 1 -- 172.21.15.6:0/4112660817 shutdown_connections 2023-07-07T04:01:00.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.549+0000 7f10f279f700 1 --2- 172.21.15.6:0/4112660817 >> v2:172.21.15.6:3300/0 conn(0x7f10ec06c650 0x7f10ec06cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:00.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.549+0000 7f10f279f700 1 --2- 172.21.15.6:0/4112660817 >> v2:172.21.15.40:3300/0 conn(0x7f10ec160900 0x7f10ec0c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:00.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.549+0000 7f10f279f700 1 --2- 172.21.15.6:0/4112660817 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ec0ca440 0x7f10ec06d340 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:00.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.549+0000 7f10f279f700 1 -- 172.21.15.6:0/4112660817 >> 172.21.15.6:0/4112660817 conn(0x7f10ec0cf420 msgr2=0x7f10ec0cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:00.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.559+0000 7f10f279f700 1 -- 172.21.15.6:0/4112660817 shutdown_connections 2023-07-07T04:01:00.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.560+0000 7f10f279f700 1 -- 172.21.15.6:0/4112660817 wait complete. 2023-07-07T04:01:00.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.561+0000 7f10f279f700 1 Processor -- start 2023-07-07T04:01:00.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.562+0000 7f10f279f700 1 -- start start 2023-07-07T04:01:00.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.563+0000 7f10f279f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10ec06c650 0x7f10ec0b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:00.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.563+0000 7f10f279f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ec0ca440 0x7f10ec15a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:00.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.563+0000 7f10f279f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10ec160900 0x7f10ec0b1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:00.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.563+0000 7f10f279f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec0b4490 con 0x7f10ec06c650 2023-07-07T04:01:00.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.563+0000 7f10f279f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec0b3510 con 0x7f10ec160900 2023-07-07T04:01:00.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.563+0000 7f10f279f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec0b37f0 con 0x7f10ec0ca440 2023-07-07T04:01:00.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.563+0000 7f10ebfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10ec06c650 0x7f10ec0b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:00.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.563+0000 7f10ebfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10ec06c650 0x7f10ec0b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47926/0 (socket says 172.21.15.6:47926) 2023-07-07T04:01:00.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.563+0000 7f10ebfff700 1 -- 172.21.15.6:0/108342086 learned_addr learned my addr 172.21.15.6:0/108342086 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:00.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.563+0000 7f10eb7fe700 1 --2- 172.21.15.6:0/108342086 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ec0ca440 0x7f10ec15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:00.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.564+0000 7f10ebfff700 1 -- 172.21.15.6:0/108342086 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ec0ca440 msgr2=0x7f10ec15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:00.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.564+0000 7f10ebfff700 1 --2- 172.21.15.6:0/108342086 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ec0ca440 0x7f10ec15a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:00.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.564+0000 7f10ebfff700 1 -- 172.21.15.6:0/108342086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10ec160900 msgr2=0x7f10ec0b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:00.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.564+0000 7f10ebfff700 1 --2- 172.21.15.6:0/108342086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10ec160900 0x7f10ec0b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:00.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.564+0000 7f10ebfff700 1 -- 172.21.15.6:0/108342086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e00094a0 con 0x7f10ec06c650 2023-07-07T04:01:00.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.564+0000 7f10eb7fe700 1 --2- 172.21.15.6:0/108342086 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ec0ca440 0x7f10ec15a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T04:01:00.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.564+0000 7f10ebfff700 1 --2- 172.21.15.6:0/108342086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10ec06c650 0x7f10ec0b3f50 secure :-1 s=READY pgs=3318 cs=0 l=1 rev1=1 crypto rx=0x7f10dc00e7e0 tx=0x7f10dc00eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:00.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.565+0000 7f10e8ff9700 1 -- 172.21.15.6:0/108342086 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc013610 con 0x7f10ec06c650 2023-07-07T04:01:00.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.565+0000 7f10f279f700 1 -- 172.21.15.6:0/108342086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10ec0b3ad0 con 0x7f10ec06c650 2023-07-07T04:01:00.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.565+0000 7f10f279f700 1 -- 172.21.15.6:0/108342086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10ec15a980 con 0x7f10ec06c650 2023-07-07T04:01:00.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.566+0000 7f10f279f700 1 -- 172.21.15.6:0/108342086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10ec04eb90 con 0x7f10ec06c650 2023-07-07T04:01:00.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.597+0000 7f10e8ff9700 1 -- 172.21.15.6:0/108342086 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10dc00c490 con 0x7f10ec06c650 2023-07-07T04:01:00.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.597+0000 7f10e8ff9700 1 -- 172.21.15.6:0/108342086 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc005c20 con 0x7f10ec06c650 2023-07-07T04:01:00.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.598+0000 7f10e8ff9700 1 -- 172.21.15.6:0/108342086 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f10dc013770 con 0x7f10ec06c650 2023-07-07T04:01:00.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.598+0000 7f10e8ff9700 1 --2- 172.21.15.6:0/108342086 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f10d806ace0 0x7f10d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:00.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.598+0000 7f10e8ff9700 1 -- 172.21.15.6:0/108342086 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f10dc0895b0 con 0x7f10ec06c650 2023-07-07T04:01:00.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.599+0000 7f10eb7fe700 1 --2- 172.21.15.6:0/108342086 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f10d806ace0 0x7f10d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:00.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.599+0000 7f10eb7fe700 1 --2- 172.21.15.6:0/108342086 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f10d806ace0 0x7f10d806d190 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f10e00090b0 tx=0x7f10e0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:00.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.602+0000 7f10e8ff9700 1 -- 172.21.15.6:0/108342086 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f10dc054530 con 0x7f10ec06c650 2023-07-07T04:01:00.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.926+0000 7f10f279f700 1 -- 172.21.15.6:0/108342086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10ec0c3be0 con 0x7f10ec06c650 2023-07-07T04:01:00.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.926+0000 7f10e8ff9700 1 -- 172.21.15.6:0/108342086 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f10dc057b50 con 0x7f10ec06c650 2023-07-07T04:01:00.928 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-07T04:01:00.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.933+0000 7f10f279f700 1 -- 172.21.15.6:0/108342086 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f10d806ace0 msgr2=0x7f10d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:00.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.933+0000 7f10f279f700 1 --2- 172.21.15.6:0/108342086 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f10d806ace0 0x7f10d806d190 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f10e00090b0 tx=0x7f10e0008030 comp rx=0 tx=0).stop 2023-07-07T04:01:00.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.933+0000 7f10f279f700 1 -- 172.21.15.6:0/108342086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10ec06c650 msgr2=0x7f10ec0b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:00.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.933+0000 7f10f279f700 1 --2- 172.21.15.6:0/108342086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10ec06c650 0x7f10ec0b3f50 secure :-1 s=READY pgs=3318 cs=0 l=1 rev1=1 crypto rx=0x7f10dc00e7e0 tx=0x7f10dc00eaf0 comp rx=0 tx=0).stop 2023-07-07T04:01:00.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.933+0000 7f10f279f700 1 -- 172.21.15.6:0/108342086 shutdown_connections 2023-07-07T04:01:00.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.933+0000 7f10f279f700 1 --2- 172.21.15.6:0/108342086 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f10d806ace0 0x7f10d806d190 secure :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f10e00090b0 tx=0x7f10e0008030 comp rx=0 tx=0).stop 2023-07-07T04:01:00.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.933+0000 7f10f279f700 1 --2- 172.21.15.6:0/108342086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10ec06c650 0x7f10ec0b3f50 unknown :-1 s=CLOSED pgs=3318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:00.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.933+0000 7f10f279f700 1 --2- 172.21.15.6:0/108342086 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f10ec160900 0x7f10ec0b1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:00.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.933+0000 7f10f279f700 1 --2- 172.21.15.6:0/108342086 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f10ec0ca440 0x7f10ec15a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:00.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.933+0000 7f10f279f700 1 -- 172.21.15.6:0/108342086 >> 172.21.15.6:0/108342086 conn(0x7f10ec0cf420 msgr2=0x7f10ec0c4180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:00.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.943+0000 7f10f279f700 1 -- 172.21.15.6:0/108342086 shutdown_connections 2023-07-07T04:01:00.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:00.944+0000 7f10f279f700 1 -- 172.21.15.6:0/108342086 wait complete. 2023-07-07T04:01:00.965 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-07T04:01:01.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.180+0000 7efe0bdc3700 1 Processor -- start 2023-07-07T04:01:01.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.180+0000 7efe0bdc3700 1 -- start start 2023-07-07T04:01:01.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.181+0000 7efe0bdc3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe04071770 0x7efe040ae730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:01.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.181+0000 7efe0bdc3700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe041654b0 con 0x7efe04160890 2023-07-07T04:01:01.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.181+0000 7efe0bdc3700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe040af090 con 0x7efe040aec70 2023-07-07T04:01:01.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.181+0000 7efe0bdc3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe04164980 con 0x7efe04071770 2023-07-07T04:01:01.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.182+0000 7efe09b5f700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7efe04160890 0x7efe04164da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49142/0 (socket says 172.21.15.6:49142) 2023-07-07T04:01:01.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.182+0000 7efe09b5f700 1 -- 172.21.15.6:0/384468291 learned_addr learned my addr 172.21.15.6:0/384468291 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:01:01.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.182+0000 7efe08b5d700 1 -- 172.21.15.6:0/384468291 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2963358903 0 0) 0x7efe00001110 con 0x7efe04160890 2023-07-07T04:01:01.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.182+0000 7efe08b5d700 1 -- 172.21.15.6:0/384468291 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdf00035b0 con 0x7efe04160890 2023-07-07T04:01:01.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.182+0000 7efe08b5d700 1 -- 172.21.15.6:0/384468291 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013089923 0 0) 0x7efe040af090 con 0x7efe040aec70 2023-07-07T04:01:01.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.182+0000 7efe08b5d700 1 -- 172.21.15.6:0/384468291 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe00001110 con 0x7efe040aec70 2023-07-07T04:01:01.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.182+0000 7efe08b5d700 1 -- 172.21.15.6:0/384468291 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3061564181 0 0) 0x7efdf00035b0 con 0x7efe04160890 2023-07-07T04:01:01.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.182+0000 7efe08b5d700 1 -- 172.21.15.6:0/384468291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe04071770 msgr2=0x7efe040ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:01.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.182+0000 7efe08b5d700 1 --2- 172.21.15.6:0/384468291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe04071770 0x7efe040ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:01.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.182+0000 7efe08b5d700 1 -- 172.21.15.6:0/384468291 >> v1:172.21.15.40:6789/0 conn(0x7efe040aec70 legacy=0x7efe04160c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:01.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.182+0000 7efe08b5d700 1 -- 172.21.15.6:0/384468291 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe04161e80 con 0x7efe04160890 2023-07-07T04:01:01.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.182+0000 7efe08b5d700 1 -- 172.21.15.6:0/384468291 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7efe00001800 con 0x7efe04160890 2023-07-07T04:01:01.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.182+0000 7efe08b5d700 1 -- 172.21.15.6:0/384468291 >> v1:172.21.15.6:6789/0 conn(0x7efe04160890 legacy=0x7efe04164da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:01.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.182+0000 7efe08b5d700 1 --2- 172.21.15.6:0/384468291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf0004c50 0x7efdf0005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:01.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.182+0000 7efe08b5d700 1 --2- 172.21.15.6:0/384468291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdf00037f0 0x7efdf0003c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:01.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.182+0000 7efe08b5d700 1 --2- 172.21.15.6:0/384468291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdf00042c0 0x7efdf000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:01.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.182+0000 7efe08b5d700 1 -- 172.21.15.6:0/384468291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc0015b0 con 0x7efdf0004c50 2023-07-07T04:01:01.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.182+0000 7efe08b5d700 1 -- 172.21.15.6:0/384468291 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe04164980 con 0x7efdf00042c0 2023-07-07T04:01:01.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.182+0000 7efe08b5d700 1 -- 172.21.15.6:0/384468291 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf000c230 con 0x7efdf00037f0 2023-07-07T04:01:01.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.183+0000 7efe09b5f700 1 --2- 172.21.15.6:0/384468291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf0004c50 0x7efdf0005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:01.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.183+0000 7efe0a360700 1 --2- 172.21.15.6:0/384468291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdf00042c0 0x7efdf000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:01.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.183+0000 7efe09b5f700 1 -- 172.21.15.6:0/384468291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdf00037f0 msgr2=0x7efdf0003c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:01.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.183+0000 7efe09b5f700 1 --2- 172.21.15.6:0/384468291 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efdf00037f0 0x7efdf0003c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:01.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.183+0000 7efe09b5f700 1 -- 172.21.15.6:0/384468291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdf00042c0 msgr2=0x7efdf000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:01.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.183+0000 7efe09b5f700 1 --2- 172.21.15.6:0/384468291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdf00042c0 0x7efdf000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:01.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.183+0000 7efe09b5f700 1 -- 172.21.15.6:0/384468291 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf00035b0 con 0x7efdf0004c50 2023-07-07T04:01:01.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.183+0000 7efe09b5f700 1 --2- 172.21.15.6:0/384468291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf0004c50 0x7efdf0005020 secure :-1 s=READY pgs=3320 cs=0 l=1 rev1=1 crypto rx=0x7efe0000c210 tx=0x7efdf0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7ae98957093c16 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:01.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.184+0000 7efe08b5d700 1 -- 172.21.15.6:0/384468291 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0000cd50 con 0x7efdf0004c50 2023-07-07T04:01:01.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.184+0000 7efe08b5d700 1 -- 172.21.15.6:0/384468291 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe00005960 con 0x7efdf0004c50 2023-07-07T04:01:01.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.184+0000 7efe08b5d700 1 -- 172.21.15.6:0/384468291 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe00005cf0 con 0x7efdf0004c50 2023-07-07T04:01:01.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.184+0000 7efe0bdc3700 1 -- 172.21.15.6:0/384468291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf0004c50 msgr2=0x7efdf0005020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:01.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.184+0000 7efe0bdc3700 1 --2- 172.21.15.6:0/384468291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efdf0004c50 0x7efdf0005020 secure :-1 s=READY pgs=3320 cs=0 l=1 rev1=1 crypto rx=0x7efe0000c210 tx=0x7efdf0005880 comp rx=0 tx=0).stop 2023-07-07T04:01:01.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.184+0000 7efe0a360700 1 -- 172.21.15.6:0/384468291 reap_dead start 2023-07-07T04:01:01.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.184+0000 7efe0bdc3700 1 -- 172.21.15.6:0/384468291 shutdown_connections 2023-07-07T04:01:01.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.184+0000 7efe0bdc3700 1 -- 172.21.15.6:0/384468291 >> 172.21.15.6:0/384468291 conn(0x7efe040cf960 msgr2=0x7efe040cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:01.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.185+0000 7efe0bdc3700 1 -- 172.21.15.6:0/384468291 shutdown_connections 2023-07-07T04:01:01.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.185+0000 7efe0bdc3700 1 -- 172.21.15.6:0/384468291 wait complete. 2023-07-07T04:01:01.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.186+0000 7efe0bdc3700 1 Processor -- start 2023-07-07T04:01:01.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.186+0000 7efe0bdc3700 1 -- start start 2023-07-07T04:01:01.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.187+0000 7efe0bdc3700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe04154ec0 0x7efe040c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:01.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.187+0000 7efe0bdc3700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe040c6a30 0x7efe040c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:01.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.187+0000 7efe0bdc3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe04162b80 0x7efe04162ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:01.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.187+0000 7efe0bdc3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe04163530 con 0x7efe04162b80 2023-07-07T04:01:01.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.187+0000 7efe0bdc3700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe040c7480 con 0x7efe040c6a30 2023-07-07T04:01:01.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.187+0000 7efe0bdc3700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe040c7760 con 0x7efe04154ec0 2023-07-07T04:01:01.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.187+0000 7efe0935e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe040c6a30 0x7efe040c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:01.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.187+0000 7efe09b5f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe04154ec0 0x7efe040c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:01.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.187+0000 7efe0a360700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe04162b80 0x7efe04162ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:01.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.187+0000 7efe0935e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe040c6a30 0x7efe040c6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:55214/0 (socket says 172.21.15.6:55214) 2023-07-07T04:01:01.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.187+0000 7efe09b5f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe04154ec0 0x7efe040c8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:40592/0 (socket says 172.21.15.6:40592) 2023-07-07T04:01:01.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.187+0000 7efe0935e700 1 -- 172.21.15.6:0/1298823407 learned_addr learned my addr 172.21.15.6:0/1298823407 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:01.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.188+0000 7efe09b5f700 1 -- 172.21.15.6:0/1298823407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe040c6a30 msgr2=0x7efe040c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:01.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.188+0000 7efe09b5f700 1 --2- 172.21.15.6:0/1298823407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe040c6a30 0x7efe040c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:01.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.188+0000 7efe09b5f700 1 -- 172.21.15.6:0/1298823407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe04162b80 msgr2=0x7efe04162ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:01.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.188+0000 7efe09b5f700 1 --2- 172.21.15.6:0/1298823407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe04162b80 0x7efe04162ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:01.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.188+0000 7efe09b5f700 1 -- 172.21.15.6:0/1298823407 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe040c7a40 con 0x7efe04154ec0 2023-07-07T04:01:01.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.188+0000 7efe0a360700 1 --2- 172.21.15.6:0/1298823407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe04162b80 0x7efe04162ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T04:01:01.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.188+0000 7efe09b5f700 1 --2- 172.21.15.6:0/1298823407 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe04154ec0 0x7efe040c8520 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efe00001eb0 tx=0x7efe00001b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:01.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.188+0000 7efdfa7fc700 1 -- 172.21.15.6:0/1298823407 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe00007d60 con 0x7efe04154ec0 2023-07-07T04:01:01.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.188+0000 7efdfa7fc700 1 -- 172.21.15.6:0/1298823407 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe000070d0 con 0x7efe04154ec0 2023-07-07T04:01:01.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.188+0000 7efe0bdc3700 1 -- 172.21.15.6:0/1298823407 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe040c7d20 con 0x7efe04154ec0 2023-07-07T04:01:01.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.188+0000 7efdfa7fc700 1 -- 172.21.15.6:0/1298823407 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe00007460 con 0x7efe04154ec0 2023-07-07T04:01:01.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.189+0000 7efe0bdc3700 1 -- 172.21.15.6:0/1298823407 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe040b0470 con 0x7efe04154ec0 2023-07-07T04:01:01.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.190+0000 7efe0bdc3700 1 -- 172.21.15.6:0/1298823407 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe040b0600 con 0x7efe04154ec0 2023-07-07T04:01:01.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.190+0000 7efdfa7fc700 1 -- 172.21.15.6:0/1298823407 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efe00019070 con 0x7efe04154ec0 2023-07-07T04:01:01.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.191+0000 7efdfa7fc700 1 --2- 172.21.15.6:0/1298823407 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efde806ad10 0x7efde806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:01.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.191+0000 7efdfa7fc700 1 -- 172.21.15.6:0/1298823407 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7efe00089710 con 0x7efe04154ec0 2023-07-07T04:01:01.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.191+0000 7efe0935e700 1 --2- 172.21.15.6:0/1298823407 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efde806ad10 0x7efde806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:01.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.192+0000 7efe0935e700 1 --2- 172.21.15.6:0/1298823407 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efde806ad10 0x7efde806d1c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7efe040cef80 tx=0x7efdf40091c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:01.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.199+0000 7efdfa7fc700 1 -- 172.21.15.6:0/1298823407 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efe00054790 con 0x7efe04154ec0 2023-07-07T04:01:01.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.514+0000 7efe0bdc3700 1 -- 172.21.15.6:0/1298823407 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efe040c8240 con 0x7efe04154ec0 2023-07-07T04:01:01.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.519+0000 7efdfa7fc700 1 -- 172.21.15.6:0/1298823407 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7efe040c8240 con 0x7efe04154ec0 2023-07-07T04:01:01.522 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-07T04:01:01.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.526+0000 7efe0bdc3700 1 -- 172.21.15.6:0/1298823407 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efde806ad10 msgr2=0x7efde806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:01.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.526+0000 7efe0bdc3700 1 --2- 172.21.15.6:0/1298823407 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efde806ad10 0x7efde806d1c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7efe040cef80 tx=0x7efdf40091c0 comp rx=0 tx=0).stop 2023-07-07T04:01:01.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.526+0000 7efe0bdc3700 1 -- 172.21.15.6:0/1298823407 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe04154ec0 msgr2=0x7efe040c8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:01.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.526+0000 7efe0bdc3700 1 --2- 172.21.15.6:0/1298823407 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe04154ec0 0x7efe040c8520 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efe00001eb0 tx=0x7efe00001b10 comp rx=0 tx=0).stop 2023-07-07T04:01:01.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.533+0000 7efe0bdc3700 1 -- 172.21.15.6:0/1298823407 shutdown_connections 2023-07-07T04:01:01.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.533+0000 7efe0bdc3700 1 --2- 172.21.15.6:0/1298823407 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7efde806ad10 0x7efde806d1c0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:01.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.533+0000 7efe0bdc3700 1 --2- 172.21.15.6:0/1298823407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe04162b80 0x7efe04162ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:01.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.533+0000 7efe0bdc3700 1 --2- 172.21.15.6:0/1298823407 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7efe04154ec0 0x7efe040c8520 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:01.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.533+0000 7efe0bdc3700 1 --2- 172.21.15.6:0/1298823407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efe040c6a30 0x7efe040c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:01.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.533+0000 7efe0bdc3700 1 -- 172.21.15.6:0/1298823407 >> 172.21.15.6:0/1298823407 conn(0x7efe040cf960 msgr2=0x7efe0415edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:01.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.535+0000 7efe0bdc3700 1 -- 172.21.15.6:0/1298823407 shutdown_connections 2023-07-07T04:01:01.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.535+0000 7efe0bdc3700 1 -- 172.21.15.6:0/1298823407 wait complete. 2023-07-07T04:01:01.557 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-07T04:01:01.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.762+0000 7f2bf76e7700 1 Processor -- start 2023-07-07T04:01:01.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.762+0000 7f2bf76e7700 1 -- start start 2023-07-07T04:01:01.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.763+0000 7f2bf76e7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f2bf00aee40 0x7f2bf0160c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:01.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.763+0000 7f2bf76e7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf01654b0 con 0x7f2bf0071770 2023-07-07T04:01:01.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.763+0000 7f2bf76e7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf0161e80 con 0x7f2bf0160890 2023-07-07T04:01:01.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.763+0000 7f2bf76e7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf0164980 con 0x7f2bf00aee40 2023-07-07T04:01:01.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.764+0000 7f2bf5483700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2bf0160890 0x7f2bf0164da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:39034/0 (socket says 172.21.15.6:39034) 2023-07-07T04:01:01.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.764+0000 7f2bf5483700 1 -- 172.21.15.6:0/1083250543 learned_addr learned my addr 172.21.15.6:0/1083250543 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:01:01.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.766+0000 7f2be7fff700 1 -- 172.21.15.6:0/1083250543 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826029479 0 0) 0x7f2bf0161e80 con 0x7f2bf0160890 2023-07-07T04:01:01.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.766+0000 7f2be7fff700 1 -- 172.21.15.6:0/1083250543 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bdc0035b0 con 0x7f2bf0160890 2023-07-07T04:01:01.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.766+0000 7f2be7fff700 1 -- 172.21.15.6:0/1083250543 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1140341499 0 0) 0x7f2be0001040 con 0x7f2bf0071770 2023-07-07T04:01:01.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.766+0000 7f2be7fff700 1 -- 172.21.15.6:0/1083250543 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bf0161e80 con 0x7f2bf0071770 2023-07-07T04:01:01.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.766+0000 7f2be7fff700 1 -- 172.21.15.6:0/1083250543 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1888474867 0 0) 0x7f2bf0161e80 con 0x7f2bf0071770 2023-07-07T04:01:01.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.766+0000 7f2be7fff700 1 -- 172.21.15.6:0/1083250543 >> v2:172.21.15.6:3300/0 conn(0x7f2bf00aee40 msgr2=0x7f2bf0160c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:01.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.766+0000 7f2be7fff700 1 --2- 172.21.15.6:0/1083250543 >> v2:172.21.15.6:3300/0 conn(0x7f2bf00aee40 0x7f2bf0160c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:01.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.766+0000 7f2be7fff700 1 -- 172.21.15.6:0/1083250543 >> v1:172.21.15.40:6789/0 conn(0x7f2bf0160890 legacy=0x7f2bf0164da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:01.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.766+0000 7f2be7fff700 1 -- 172.21.15.6:0/1083250543 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf01618c0 con 0x7f2bf0071770 2023-07-07T04:01:01.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.766+0000 7f2be7fff700 1 -- 172.21.15.6:0/1083250543 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f2be00016b0 con 0x7f2bf0071770 2023-07-07T04:01:01.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.766+0000 7f2be7fff700 1 -- 172.21.15.6:0/1083250543 >> v1:172.21.15.6:6789/0 conn(0x7f2bf0071770 legacy=0x7f2bf00ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:01.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.766+0000 7f2be7fff700 1 --2- 172.21.15.6:0/1083250543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bdc004c40 0x7f2bdc005030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:01.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.766+0000 7f2be7fff700 1 --2- 172.21.15.6:0/1083250543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bdc0037f0 0x7f2bdc003c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:01.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.766+0000 7f2be7fff700 1 --2- 172.21.15.6:0/1083250543 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2bdc0043a0 0x7f2bdc01caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:01.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.766+0000 7f2be7fff700 1 -- 172.21.15.6:0/1083250543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf0164980 con 0x7f2bdc0037f0 2023-07-07T04:01:01.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.766+0000 7f2be7fff700 1 -- 172.21.15.6:0/1083250543 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc01d360 con 0x7f2bdc004c40 2023-07-07T04:01:01.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.766+0000 7f2be7fff700 1 -- 172.21.15.6:0/1083250543 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bdc01d520 con 0x7f2bdc0043a0 2023-07-07T04:01:01.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.766+0000 7f2bf4c82700 1 --2- 172.21.15.6:0/1083250543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bdc0037f0 0x7f2bdc003c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:01.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.767+0000 7f2bf4c82700 1 -- 172.21.15.6:0/1083250543 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2bdc0043a0 msgr2=0x7f2bdc01caa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-07T04:01:01.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.767+0000 7f2bf4c82700 1 --2- 172.21.15.6:0/1083250543 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2bdc0043a0 0x7f2bdc01caa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:01.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.767+0000 7f2bf4c82700 1 -- 172.21.15.6:0/1083250543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bdc004c40 msgr2=0x7f2bdc005030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:01.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.767+0000 7f2bf4c82700 1 --2- 172.21.15.6:0/1083250543 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bdc004c40 0x7f2bdc005030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:01.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.767+0000 7f2bf4c82700 1 -- 172.21.15.6:0/1083250543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf01618c0 con 0x7f2bdc0037f0 2023-07-07T04:01:01.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.767+0000 7f2bf4c82700 1 --2- 172.21.15.6:0/1083250543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bdc0037f0 0x7f2bdc003c60 secure :-1 s=READY pgs=3322 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00b58b0 tx=0x7f2bdc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ec9ad75da424b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:01.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.767+0000 7f2be7fff700 1 -- 172.21.15.6:0/1083250543 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be000cb40 con 0x7f2bdc0037f0 2023-07-07T04:01:01.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.767+0000 7f2be7fff700 1 -- 172.21.15.6:0/1083250543 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be000cca0 con 0x7f2bdc0037f0 2023-07-07T04:01:01.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.767+0000 7f2be7fff700 1 -- 172.21.15.6:0/1083250543 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be0006a80 con 0x7f2bdc0037f0 2023-07-07T04:01:01.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.770+0000 7f2bf5c84700 1 -- 172.21.15.6:0/1083250543 reap_dead start 2023-07-07T04:01:01.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.772+0000 7f2bf76e7700 1 -- 172.21.15.6:0/1083250543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bdc0037f0 msgr2=0x7f2bdc003c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:01.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.772+0000 7f2bf76e7700 1 --2- 172.21.15.6:0/1083250543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bdc0037f0 0x7f2bdc003c60 secure :-1 s=READY pgs=3322 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00b58b0 tx=0x7f2bdc005880 comp rx=0 tx=0).stop 2023-07-07T04:01:01.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.772+0000 7f2bf76e7700 1 -- 172.21.15.6:0/1083250543 shutdown_connections 2023-07-07T04:01:01.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.772+0000 7f2bf76e7700 1 --2- 172.21.15.6:0/1083250543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bdc0037f0 0x7f2bdc003c60 unknown :-1 s=CLOSED pgs=3322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:01.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.772+0000 7f2bf76e7700 1 -- 172.21.15.6:0/1083250543 >> 172.21.15.6:0/1083250543 conn(0x7f2bf00cf960 msgr2=0x7f2bf00cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:01.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.775+0000 7f2bf76e7700 1 -- 172.21.15.6:0/1083250543 shutdown_connections 2023-07-07T04:01:01.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.775+0000 7f2bf76e7700 1 -- 172.21.15.6:0/1083250543 wait complete. 2023-07-07T04:01:01.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.776+0000 7f2bf76e7700 1 Processor -- start 2023-07-07T04:01:01.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.780+0000 7f2bf76e7700 1 -- start start 2023-07-07T04:01:01.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.781+0000 7f2bf76e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bdc0037f0 0x7f2bf0159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:01.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.781+0000 7f2bf76e7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2bf00b38d0 0x7f2bf014c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:01.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.781+0000 7f2bf76e7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bf014c600 0x7f2bf014ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:01.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.781+0000 7f2bf76e7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf014ca80 con 0x7f2bdc0037f0 2023-07-07T04:01:01.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.781+0000 7f2bf76e7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf00b5410 con 0x7f2bf014c600 2023-07-07T04:01:01.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.781+0000 7f2bf76e7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf00b2830 con 0x7f2bf00b38d0 2023-07-07T04:01:01.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.781+0000 7f2bf5c84700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bf014c600 0x7f2bf014ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:01.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.781+0000 7f2bf5c84700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bf014c600 0x7f2bf014ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:55234/0 (socket says 172.21.15.6:55234) 2023-07-07T04:01:01.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.781+0000 7f2bf5c84700 1 -- 172.21.15.6:0/3733594686 learned_addr learned my addr 172.21.15.6:0/3733594686 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:01.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.782+0000 7f2bf5c84700 1 -- 172.21.15.6:0/3733594686 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2bf00b38d0 msgr2=0x7f2bf014c0c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-07T04:01:01.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.782+0000 7f2bf5c84700 1 --2- 172.21.15.6:0/3733594686 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2bf00b38d0 0x7f2bf014c0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:01.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.782+0000 7f2bf5c84700 1 -- 172.21.15.6:0/3733594686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bdc0037f0 msgr2=0x7f2bf0159850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-07T04:01:01.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.782+0000 7f2bf5c84700 1 --2- 172.21.15.6:0/3733594686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bdc0037f0 0x7f2bf0159850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:01.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.782+0000 7f2bf5c84700 1 -- 172.21.15.6:0/3733594686 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf00b2b10 con 0x7f2bf014c600 2023-07-07T04:01:01.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.782+0000 7f2bf5c84700 1 --2- 172.21.15.6:0/3733594686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bf014c600 0x7f2bf014ab40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2bf006e980 tx=0x7f2be800cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:01.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.782+0000 7f2be5ffb700 1 -- 172.21.15.6:0/3733594686 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be800a770 con 0x7f2bf014c600 2023-07-07T04:01:01.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.782+0000 7f2bf76e7700 1 -- 172.21.15.6:0/3733594686 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf00b2df0 con 0x7f2bf014c600 2023-07-07T04:01:01.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.782+0000 7f2be5ffb700 1 -- 172.21.15.6:0/3733594686 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be800a8f0 con 0x7f2bf014c600 2023-07-07T04:01:01.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.782+0000 7f2be5ffb700 1 -- 172.21.15.6:0/3733594686 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be800aca0 con 0x7f2bf014c600 2023-07-07T04:01:01.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.783+0000 7f2bf76e7700 1 -- 172.21.15.6:0/3733594686 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf00b33b0 con 0x7f2bf014c600 2023-07-07T04:01:01.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.784+0000 7f2bf76e7700 1 -- 172.21.15.6:0/3733594686 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf0164580 con 0x7f2bf014c600 2023-07-07T04:01:01.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.784+0000 7f2be5ffb700 1 -- 172.21.15.6:0/3733594686 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2be801b3b0 con 0x7f2bf014c600 2023-07-07T04:01:01.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.784+0000 7f2be5ffb700 1 --2- 172.21.15.6:0/3733594686 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2bd406ace0 0x7f2bd406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:01.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.785+0000 7f2be5ffb700 1 -- 172.21.15.6:0/3733594686 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f2be8088ee0 con 0x7f2bf014c600 2023-07-07T04:01:01.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.785+0000 7f2bf5483700 1 --2- 172.21.15.6:0/3733594686 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2bd406ace0 0x7f2bd406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:01.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.786+0000 7f2bf5483700 1 --2- 172.21.15.6:0/3733594686 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2bd406ace0 0x7f2bd406d190 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2bec007fd0 tx=0x7f2bec0079e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:01.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:01.792+0000 7f2be5ffb700 1 -- 172.21.15.6:0/3733594686 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2bf0164580 con 0x7f2bf014c600 2023-07-07T04:01:02.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.124+0000 7f2bf76e7700 1 -- 172.21.15.6:0/3733594686 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2bf0164580 con 0x7f2bf014c600 2023-07-07T04:01:02.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.127+0000 7f2be5ffb700 1 -- 172.21.15.6:0/3733594686 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v43) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2bf0164580 con 0x7f2bf014c600 2023-07-07T04:01:02.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.133+0000 7f2bf76e7700 1 -- 172.21.15.6:0/3733594686 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2bd406ace0 msgr2=0x7f2bd406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:02.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.133+0000 7f2bf76e7700 1 --2- 172.21.15.6:0/3733594686 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2bd406ace0 0x7f2bd406d190 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2bec007fd0 tx=0x7f2bec0079e0 comp rx=0 tx=0).stop 2023-07-07T04:01:02.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.133+0000 7f2bf76e7700 1 -- 172.21.15.6:0/3733594686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bf014c600 msgr2=0x7f2bf014ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:02.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.133+0000 7f2bf76e7700 1 --2- 172.21.15.6:0/3733594686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bf014c600 0x7f2bf014ab40 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2bf006e980 tx=0x7f2be800cbd0 comp rx=0 tx=0).stop 2023-07-07T04:01:02.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.133+0000 7f2bf76e7700 1 -- 172.21.15.6:0/3733594686 shutdown_connections 2023-07-07T04:01:02.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.133+0000 7f2bf76e7700 1 --2- 172.21.15.6:0/3733594686 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f2bd406ace0 0x7f2bd406d190 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:02.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.133+0000 7f2bf76e7700 1 --2- 172.21.15.6:0/3733594686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2bdc0037f0 0x7f2bf0159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:02.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.133+0000 7f2bf76e7700 1 --2- 172.21.15.6:0/3733594686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2bf014c600 0x7f2bf014ab40 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:02.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.133+0000 7f2bf76e7700 1 --2- 172.21.15.6:0/3733594686 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f2bf00b38d0 0x7f2bf014c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:02.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.133+0000 7f2bf76e7700 1 -- 172.21.15.6:0/3733594686 >> 172.21.15.6:0/3733594686 conn(0x7f2bf00cf960 msgr2=0x7f2bf00ca300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:02.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.133+0000 7f2bf76e7700 1 -- 172.21.15.6:0/3733594686 shutdown_connections 2023-07-07T04:01:02.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.134+0000 7f2bf76e7700 1 -- 172.21.15.6:0/3733594686 wait complete. 2023-07-07T04:01:02.137 INFO:teuthology.orchestra.run.smithi006.stderr:listed 0 entries 2023-07-07T04:01:02.153 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-07T04:01:02.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T04:01:02.154 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-07T04:01:02.221 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-07-07T04:01:02.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T04:01:02.221 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-07T04:01:02.273 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-07T04:01:02.273 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T04:01:02.293 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=44,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13568 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-07T04:01:02.294 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-07T04:01:02.294 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T04:01:02.320 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16755 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 tmpfs /run/user/10101 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=10101,gid=10101 0 0 2023-07-07T04:01:02.320 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-07T04:01:02.320 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T04:01:02.359 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=44,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13568 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-07T04:01:02.360 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-07T04:01:02.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.575+0000 7fddd24aa700 1 Processor -- start 2023-07-07T04:01:02.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.575+0000 7fddd24aa700 1 -- start start 2023-07-07T04:01:02.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.577+0000 7fddd24aa700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fddcc13f3f0 0x7fddcc0cab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:02.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.577+0000 7fddd24aa700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddcc143c90 con 0x7fddcc0cb9a0 2023-07-07T04:01:02.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.577+0000 7fddd24aa700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddcc13fc80 con 0x7fddcc13f7c0 2023-07-07T04:01:02.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.577+0000 7fddd24aa700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddcc13ff60 con 0x7fddcc13f3f0 2023-07-07T04:01:02.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.577+0000 7fddd0a47700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fddcc0cb9a0 0x7fddcc0cd170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49180/0 (socket says 172.21.15.6:49180) 2023-07-07T04:01:02.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.577+0000 7fddd0a47700 1 -- 172.21.15.6:0/2347913564 learned_addr learned my addr 172.21.15.6:0/2347913564 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:01:02.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.577+0000 7fddcbfff700 1 --2- 172.21.15.6:0/2347913564 >> v2:172.21.15.40:3300/0 conn(0x7fddcc13f3f0 0x7fddcc0cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:02.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.577+0000 7fddcaffd700 1 -- 172.21.15.6:0/2347913564 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161965469 0 0) 0x7fddcc13fc80 con 0x7fddcc13f7c0 2023-07-07T04:01:02.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.577+0000 7fddcaffd700 1 -- 172.21.15.6:0/2347913564 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddb40035b0 con 0x7fddcc13f7c0 2023-07-07T04:01:02.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.577+0000 7fddcaffd700 1 -- 172.21.15.6:0/2347913564 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297431364 0 0) 0x7fddcc143c90 con 0x7fddcc0cb9a0 2023-07-07T04:01:02.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.577+0000 7fddcbfff700 1 -- 172.21.15.6:0/2347913564 >> v1:172.21.15.40:6789/0 conn(0x7fddcc13f7c0 legacy=0x7fddcc0cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:02.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.577+0000 7fddcbfff700 1 -- 172.21.15.6:0/2347913564 >> v1:172.21.15.6:6789/0 conn(0x7fddcc0cb9a0 legacy=0x7fddcc0cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:02.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.577+0000 7fddcbfff700 1 -- 172.21.15.6:0/2347913564 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc140240 con 0x7fddcc13f3f0 2023-07-07T04:01:02.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.578+0000 7fddcbfff700 1 --2- 172.21.15.6:0/2347913564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddcc13f3f0 0x7fddcc0cab30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fddbc009840 tx=0x7fddbc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d4d454e62cf90ad server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:02.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.578+0000 7fddcaffd700 1 -- 172.21.15.6:0/2347913564 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc011830 con 0x7fddcc13f3f0 2023-07-07T04:01:02.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.578+0000 7fddcaffd700 1 -- 172.21.15.6:0/2347913564 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc011990 con 0x7fddcc13f3f0 2023-07-07T04:01:02.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.578+0000 7fddcaffd700 1 -- 172.21.15.6:0/2347913564 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc011d20 con 0x7fddcc13f3f0 2023-07-07T04:01:02.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.579+0000 7fddd24aa700 1 -- 172.21.15.6:0/2347913564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddcc13f3f0 msgr2=0x7fddcc0cab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:02.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.579+0000 7fddd24aa700 1 --2- 172.21.15.6:0/2347913564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddcc13f3f0 0x7fddcc0cab30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fddbc009840 tx=0x7fddbc009b50 comp rx=0 tx=0).stop 2023-07-07T04:01:02.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.579+0000 7fddd24aa700 1 -- 172.21.15.6:0/2347913564 shutdown_connections 2023-07-07T04:01:02.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.579+0000 7fddd24aa700 1 --2- 172.21.15.6:0/2347913564 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddcc13f3f0 0x7fddcc0cab30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:02.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.579+0000 7fddd24aa700 1 -- 172.21.15.6:0/2347913564 >> 172.21.15.6:0/2347913564 conn(0x7fddcc0b05b0 msgr2=0x7fddcc0b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:02.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.579+0000 7fddd24aa700 1 -- 172.21.15.6:0/2347913564 shutdown_connections 2023-07-07T04:01:02.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.579+0000 7fddd24aa700 1 -- 172.21.15.6:0/2347913564 wait complete. 2023-07-07T04:01:02.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.580+0000 7fddd24aa700 1 Processor -- start 2023-07-07T04:01:02.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.581+0000 7fddd24aa700 1 -- start start 2023-07-07T04:01:02.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.582+0000 7fddd24aa700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fddcc0cb9a0 0x7fddcc1f8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:02.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.582+0000 7fddd24aa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddcc13f3f0 0x7fddcc15a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:02.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.582+0000 7fddd24aa700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddcc13f7c0 0x7fddcc15aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:02.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.582+0000 7fddd24aa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc140a40 con 0x7fddcc13f3f0 2023-07-07T04:01:02.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.582+0000 7fddd24aa700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc1418a0 con 0x7fddcc13f7c0 2023-07-07T04:01:02.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.582+0000 7fddd24aa700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc140c90 con 0x7fddcc0cb9a0 2023-07-07T04:01:02.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.582+0000 7fddcb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddcc13f3f0 0x7fddcc15a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:02.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.582+0000 7fddcbfff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fddcc0cb9a0 0x7fddcc1f8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:02.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.582+0000 7fddcb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddcc13f3f0 0x7fddcc15a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47978/0 (socket says 172.21.15.6:47978) 2023-07-07T04:01:02.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.582+0000 7fddcb7fe700 1 -- 172.21.15.6:0/1504634899 learned_addr learned my addr 172.21.15.6:0/1504634899 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:02.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.583+0000 7fddcb7fe700 1 -- 172.21.15.6:0/1504634899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fddcc0cb9a0 msgr2=0x7fddcc1f8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:02.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.583+0000 7fddcb7fe700 1 --2- 172.21.15.6:0/1504634899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fddcc0cb9a0 0x7fddcc1f8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:02.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.583+0000 7fddcb7fe700 1 -- 172.21.15.6:0/1504634899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddcc13f7c0 msgr2=0x7fddcc15aee0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-07T04:01:02.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.583+0000 7fddcb7fe700 1 --2- 172.21.15.6:0/1504634899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddcc13f7c0 0x7fddcc15aee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:02.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.583+0000 7fddcb7fe700 1 -- 172.21.15.6:0/1504634899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddbc0094a0 con 0x7fddcc13f3f0 2023-07-07T04:01:02.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.583+0000 7fddcb7fe700 1 --2- 172.21.15.6:0/1504634899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddcc13f3f0 0x7fddcc15a9a0 secure :-1 s=READY pgs=3324 cs=0 l=1 rev1=1 crypto rx=0x7fddc000c4d0 tx=0x7fddc000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:02.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.583+0000 7fddc8ff9700 1 -- 172.21.15.6:0/1504634899 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc00052d0 con 0x7fddcc13f3f0 2023-07-07T04:01:02.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.583+0000 7fddd24aa700 1 -- 172.21.15.6:0/1504634899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddcc140f70 con 0x7fddcc13f3f0 2023-07-07T04:01:02.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.584+0000 7fddd24aa700 1 -- 172.21.15.6:0/1504634899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddcc141530 con 0x7fddcc13f3f0 2023-07-07T04:01:02.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.585+0000 7fddc8ff9700 1 -- 172.21.15.6:0/1504634899 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc0005430 con 0x7fddcc13f3f0 2023-07-07T04:01:02.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.585+0000 7fddc8ff9700 1 -- 172.21.15.6:0/1504634899 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc0003880 con 0x7fddcc13f3f0 2023-07-07T04:01:02.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.586+0000 7fddc8ff9700 1 -- 172.21.15.6:0/1504634899 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fddc00039e0 con 0x7fddcc13f3f0 2023-07-07T04:01:02.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.586+0000 7fddc8ff9700 1 --2- 172.21.15.6:0/1504634899 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fddb806ace0 0x7fddb806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:02.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.586+0000 7fddc8ff9700 1 -- 172.21.15.6:0/1504634899 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fddc0088990 con 0x7fddcc13f3f0 2023-07-07T04:01:02.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.587+0000 7fddcbfff700 1 --2- 172.21.15.6:0/1504634899 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fddb806ace0 0x7fddb806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:02.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.587+0000 7fddcbfff700 1 --2- 172.21.15.6:0/1504634899 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fddb806ace0 0x7fddb806d190 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fddbc009fd0 tx=0x7fddbc01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:02.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.587+0000 7fddd24aa700 1 -- 172.21.15.6:0/1504634899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddac0052f0 con 0x7fddcc13f3f0 2023-07-07T04:01:02.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:02.596+0000 7fddc8ff9700 1 -- 172.21.15.6:0/1504634899 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fddc00539b0 con 0x7fddcc13f3f0 2023-07-07T04:01:03.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.008+0000 7fddd24aa700 1 -- 172.21.15.6:0/1504634899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fddac0055a0 con 0x7fddcc13f3f0 2023-07-07T04:01:03.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.009+0000 7fddc8ff9700 1 -- 172.21.15.6:0/1504634899 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4662 (secure 0 0 0) 0x7fddc0017070 con 0x7fddcc13f3f0 2023-07-07T04:01:03.011 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:01:03.011 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/554562026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":554562026},{"type":"v1","addr":"172.21.15.40:6834","nonce":554562026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5379,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1231939681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1231939681},{"type":"v1","addr":"172.21.15.6:6835","nonce":1231939681}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5382,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2836488850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":2836488850},{"type":"v1","addr":"172.21.15.6:6837","nonce":2836488850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T20:00:18.163079+0000","modified":"2023-07-06T20:00:21.782010+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5397},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5397":{"gid":5397,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.40:6835/2106779005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":2106779005},{"type":"v1","addr":"172.21.15.40:6835","nonce":2106779005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-07T04:01:03.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.014+0000 7fddd24aa700 1 -- 172.21.15.6:0/1504634899 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fddb806ace0 msgr2=0x7fddb806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:03.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.014+0000 7fddd24aa700 1 --2- 172.21.15.6:0/1504634899 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fddb806ace0 0x7fddb806d190 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fddbc009fd0 tx=0x7fddbc01c040 comp rx=0 tx=0).stop 2023-07-07T04:01:03.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.014+0000 7fddd24aa700 1 -- 172.21.15.6:0/1504634899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddcc13f3f0 msgr2=0x7fddcc15a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:03.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.014+0000 7fddd24aa700 1 --2- 172.21.15.6:0/1504634899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddcc13f3f0 0x7fddcc15a9a0 secure :-1 s=READY pgs=3324 cs=0 l=1 rev1=1 crypto rx=0x7fddc000c4d0 tx=0x7fddc000c7e0 comp rx=0 tx=0).stop 2023-07-07T04:01:03.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.017+0000 7fddd24aa700 1 -- 172.21.15.6:0/1504634899 shutdown_connections 2023-07-07T04:01:03.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.017+0000 7fddd24aa700 1 --2- 172.21.15.6:0/1504634899 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fddb806ace0 0x7fddb806d190 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:03.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.017+0000 7fddd24aa700 1 --2- 172.21.15.6:0/1504634899 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddcc13f7c0 0x7fddcc15aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:03.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.017+0000 7fddd24aa700 1 --2- 172.21.15.6:0/1504634899 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fddcc0cb9a0 0x7fddcc1f8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:03.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.017+0000 7fddd24aa700 1 --2- 172.21.15.6:0/1504634899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fddcc13f3f0 0x7fddcc15a9a0 unknown :-1 s=CLOSED pgs=3324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:03.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.017+0000 7fddd24aa700 1 -- 172.21.15.6:0/1504634899 >> 172.21.15.6:0/1504634899 conn(0x7fddcc0b05b0 msgr2=0x7fddcc13c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:03.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.024+0000 7fddd24aa700 1 -- 172.21.15.6:0/1504634899 shutdown_connections 2023-07-07T04:01:03.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.027+0000 7fddd24aa700 1 -- 172.21.15.6:0/1504634899 wait complete. 2023-07-07T04:01:03.031 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 18 2023-07-07T04:01:03.052 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T04:01:03.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.249+0000 7fca5d809700 1 Processor -- start 2023-07-07T04:01:03.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.249+0000 7fca5d809700 1 -- start start 2023-07-07T04:01:03.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.250+0000 7fca5d809700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fca58159040 0x7fca580cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:03.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.250+0000 7fca5d809700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fca58071dd0 0x7fca5806c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:03.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.250+0000 7fca5d809700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca580cac20 con 0x7fca58159410 2023-07-07T04:01:03.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.250+0000 7fca5d809700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca5806d490 con 0x7fca58159040 2023-07-07T04:01:03.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.250+0000 7fca5d809700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5806ced0 con 0x7fca58071dd0 2023-07-07T04:01:03.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.250+0000 7fca567fc700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fca58159410 0x7fca580716c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49192/0 (socket says 172.21.15.6:49192) 2023-07-07T04:01:03.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.250+0000 7fca567fc700 1 -- 172.21.15.6:0/3394762302 learned_addr learned my addr 172.21.15.6:0/3394762302 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:01:03.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.250+0000 7fca56ffd700 1 --2- 172.21.15.6:0/3394762302 >> v2:172.21.15.40:3300/0 conn(0x7fca58159040 0x7fca580cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:03.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.250+0000 7fca577fe700 1 --2- 172.21.15.6:0/3394762302 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fca58071dd0 0x7fca5806c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:03.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.250+0000 7fca56ffd700 1 -- 172.21.15.6:0/3394762302 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fca58071dd0 msgr2=0x7fca5806c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:03.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.250+0000 7fca56ffd700 1 --2- 172.21.15.6:0/3394762302 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fca58071dd0 0x7fca5806c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:03.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.250+0000 7fca56ffd700 1 -- 172.21.15.6:0/3394762302 >> v1:172.21.15.6:6789/0 conn(0x7fca58159410 legacy=0x7fca580716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:03.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.250+0000 7fca55ffb700 1 -- 172.21.15.6:0/3394762302 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1514453446 0 0) 0x7fca580cac20 con 0x7fca58159410 2023-07-07T04:01:03.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.250+0000 7fca56ffd700 1 -- 172.21.15.6:0/3394762302 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5806d1b0 con 0x7fca58159040 2023-07-07T04:01:03.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.251+0000 7fca56ffd700 1 --2- 172.21.15.6:0/3394762302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca58159040 0x7fca580cd570 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fca4c009840 tx=0x7fca4c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d423ccf9a44c643 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:03.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.251+0000 7fca55ffb700 1 -- 172.21.15.6:0/3394762302 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c011830 con 0x7fca58159040 2023-07-07T04:01:03.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.251+0000 7fca55ffb700 1 -- 172.21.15.6:0/3394762302 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4c011990 con 0x7fca58159040 2023-07-07T04:01:03.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.251+0000 7fca55ffb700 1 -- 172.21.15.6:0/3394762302 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c011d20 con 0x7fca58159040 2023-07-07T04:01:03.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.252+0000 7fca5d809700 1 -- 172.21.15.6:0/3394762302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca58159040 msgr2=0x7fca580cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:03.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.252+0000 7fca5d809700 1 --2- 172.21.15.6:0/3394762302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca58159040 0x7fca580cd570 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fca4c009840 tx=0x7fca4c009b50 comp rx=0 tx=0).stop 2023-07-07T04:01:03.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.263+0000 7fca5d809700 1 -- 172.21.15.6:0/3394762302 shutdown_connections 2023-07-07T04:01:03.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.263+0000 7fca5d809700 1 --2- 172.21.15.6:0/3394762302 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fca58071dd0 0x7fca5806c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:03.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.263+0000 7fca5d809700 1 --2- 172.21.15.6:0/3394762302 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca58159040 0x7fca580cd570 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:03.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.263+0000 7fca5d809700 1 -- 172.21.15.6:0/3394762302 >> 172.21.15.6:0/3394762302 conn(0x7fca580cc420 msgr2=0x7fca580cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:03.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.269+0000 7fca5d809700 1 -- 172.21.15.6:0/3394762302 shutdown_connections 2023-07-07T04:01:03.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.271+0000 7fca5d809700 1 -- 172.21.15.6:0/3394762302 wait complete. 2023-07-07T04:01:03.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.273+0000 7fca5d809700 1 Processor -- start 2023-07-07T04:01:03.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.273+0000 7fca5d809700 1 -- start start 2023-07-07T04:01:03.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.274+0000 7fca5d809700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca58071dd0 0x7fca580cca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:03.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.274+0000 7fca5d809700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca58159040 0x7fca581449d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:03.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.274+0000 7fca5d809700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fca58159410 0x7fca58144f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:03.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.274+0000 7fca5d809700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca580c2a40 con 0x7fca58071dd0 2023-07-07T04:01:03.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.274+0000 7fca5d809700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca580c2c90 con 0x7fca58159040 2023-07-07T04:01:03.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.274+0000 7fca5d809700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca580c4470 con 0x7fca58159410 2023-07-07T04:01:03.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.274+0000 7fca56ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca58071dd0 0x7fca580cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:03.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.274+0000 7fca56ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca58071dd0 0x7fca580cca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47988/0 (socket says 172.21.15.6:47988) 2023-07-07T04:01:03.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.274+0000 7fca56ffd700 1 -- 172.21.15.6:0/3006022231 learned_addr learned my addr 172.21.15.6:0/3006022231 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:03.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.275+0000 7fca577fe700 1 --2- 172.21.15.6:0/3006022231 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fca58159410 0x7fca58144f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:03.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.275+0000 7fca567fc700 1 --2- 172.21.15.6:0/3006022231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca58159040 0x7fca581449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:03.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.275+0000 7fca56ffd700 1 -- 172.21.15.6:0/3006022231 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fca58159410 msgr2=0x7fca58144f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:03.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.275+0000 7fca56ffd700 1 --2- 172.21.15.6:0/3006022231 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fca58159410 0x7fca58144f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:03.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.275+0000 7fca56ffd700 1 -- 172.21.15.6:0/3006022231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca58159040 msgr2=0x7fca581449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:03.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.275+0000 7fca56ffd700 1 --2- 172.21.15.6:0/3006022231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca58159040 0x7fca581449d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:03.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.275+0000 7fca56ffd700 1 -- 172.21.15.6:0/3006022231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4c0094a0 con 0x7fca58071dd0 2023-07-07T04:01:03.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.275+0000 7fca56ffd700 1 --2- 172.21.15.6:0/3006022231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca58071dd0 0x7fca580cca60 secure :-1 s=READY pgs=3326 cs=0 l=1 rev1=1 crypto rx=0x7fca4c009fd0 tx=0x7fca4c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:03.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.275+0000 7fca3ffff700 1 -- 172.21.15.6:0/3006022231 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c0036a0 con 0x7fca58071dd0 2023-07-07T04:01:03.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.275+0000 7fca3ffff700 1 -- 172.21.15.6:0/3006022231 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4c01f070 con 0x7fca58071dd0 2023-07-07T04:01:03.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.275+0000 7fca3ffff700 1 -- 172.21.15.6:0/3006022231 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c003a20 con 0x7fca58071dd0 2023-07-07T04:01:03.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.276+0000 7fca5d809700 1 -- 172.21.15.6:0/3006022231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca580c4750 con 0x7fca58071dd0 2023-07-07T04:01:03.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.276+0000 7fca5d809700 1 -- 172.21.15.6:0/3006022231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca5816afd0 con 0x7fca58071dd0 2023-07-07T04:01:03.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.278+0000 7fca3ffff700 1 -- 172.21.15.6:0/3006022231 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fca4c003b80 con 0x7fca58071dd0 2023-07-07T04:01:03.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.278+0000 7fca5d809700 1 -- 172.21.15.6:0/3006022231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca5806bd80 con 0x7fca58071dd0 2023-07-07T04:01:03.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.278+0000 7fca3ffff700 1 --2- 172.21.15.6:0/3006022231 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fca4406ace0 0x7fca4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:03.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.278+0000 7fca3ffff700 1 -- 172.21.15.6:0/3006022231 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fca4c021070 con 0x7fca58071dd0 2023-07-07T04:01:03.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.278+0000 7fca567fc700 1 --2- 172.21.15.6:0/3006022231 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fca4406ace0 0x7fca4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:03.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.279+0000 7fca567fc700 1 --2- 172.21.15.6:0/3006022231 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fca4406ace0 0x7fca4406d190 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fca580ce690 tx=0x7fca48007e70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:03.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.286+0000 7fca3ffff700 1 -- 172.21.15.6:0/3006022231 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fca4c055ee0 con 0x7fca58071dd0 2023-07-07T04:01:03.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.620+0000 7fca5d809700 1 -- 172.21.15.6:0/3006022231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca5806ae20 con 0x7fca58071dd0 2023-07-07T04:01:03.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.622+0000 7fca3ffff700 1 -- 172.21.15.6:0/3006022231 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18496 (secure 0 0 0) 0x7fca4c059500 con 0x7fca58071dd0 2023-07-07T04:01:03.624 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:01:03.625 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":43,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T20:00:34.816976+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-06T20:00:16.527659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-06T20:00:17.129118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T04:01:03.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.625+0000 7fca5d809700 1 -- 172.21.15.6:0/3006022231 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fca4406ace0 msgr2=0x7fca4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:03.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.625+0000 7fca5d809700 1 --2- 172.21.15.6:0/3006022231 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fca4406ace0 0x7fca4406d190 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fca580ce690 tx=0x7fca48007e70 comp rx=0 tx=0).stop 2023-07-07T04:01:03.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.625+0000 7fca5d809700 1 -- 172.21.15.6:0/3006022231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca58071dd0 msgr2=0x7fca580cca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:03.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.625+0000 7fca5d809700 1 --2- 172.21.15.6:0/3006022231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca58071dd0 0x7fca580cca60 secure :-1 s=READY pgs=3326 cs=0 l=1 rev1=1 crypto rx=0x7fca4c009fd0 tx=0x7fca4c004750 comp rx=0 tx=0).stop 2023-07-07T04:01:03.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.625+0000 7fca5d809700 1 -- 172.21.15.6:0/3006022231 shutdown_connections 2023-07-07T04:01:03.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.625+0000 7fca5d809700 1 --2- 172.21.15.6:0/3006022231 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fca4406ace0 0x7fca4406d190 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:03.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.625+0000 7fca5d809700 1 --2- 172.21.15.6:0/3006022231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca58071dd0 0x7fca580cca60 unknown :-1 s=CLOSED pgs=3326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:03.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.625+0000 7fca5d809700 1 --2- 172.21.15.6:0/3006022231 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fca58159410 0x7fca58144f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:03.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.625+0000 7fca5d809700 1 --2- 172.21.15.6:0/3006022231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca58159040 0x7fca581449d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:03.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.625+0000 7fca5d809700 1 -- 172.21.15.6:0/3006022231 >> 172.21.15.6:0/3006022231 conn(0x7fca580cc420 msgr2=0x7fca580ce810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:03.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.625+0000 7fca5d809700 1 -- 172.21.15.6:0/3006022231 shutdown_connections 2023-07-07T04:01:03.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.625+0000 7fca5d809700 1 -- 172.21.15.6:0/3006022231 wait complete. 2023-07-07T04:01:03.650 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-06T19:58:38.767727+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-06T19:58:45.759808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-06T20:00:16.527659+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-06T20:00:17.129118+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-07T04:01:03.650 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-07T04:01:03.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.853+0000 7fcbeb813700 1 Processor -- start 2023-07-07T04:01:03.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.853+0000 7fcbeb813700 1 -- start start 2023-07-07T04:01:03.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.854+0000 7fcbeb813700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcbe40ca850 0x7fcbe415bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:03.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.854+0000 7fcbeb813700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcbe4071cd0 0x7fcbe415c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:03.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.854+0000 7fcbeb813700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe40cb310 con 0x7fcbe4071900 2023-07-07T04:01:03.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.854+0000 7fcbeb813700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe40cdbf0 con 0x7fcbe4071cd0 2023-07-07T04:01:03.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.854+0000 7fcbeb813700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe415c9d0 con 0x7fcbe40ca850 2023-07-07T04:01:03.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.854+0000 7fcbe9db0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcbe4071cd0 0x7fcbe415c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:03.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.854+0000 7fcbe95af700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcbe4071900 0x7fcbe40ca140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:39076/0 (socket says 172.21.15.6:39076) 2023-07-07T04:01:03.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.854+0000 7fcbe95af700 1 -- 172.21.15.6:0/3260938975 learned_addr learned my addr 172.21.15.6:0/3260938975 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:01:03.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.855+0000 7fcbe9db0700 1 -- 172.21.15.6:0/3260938975 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcbe40ca850 msgr2=0x7fcbe415bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:03.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.855+0000 7fcbe9db0700 1 --2- 172.21.15.6:0/3260938975 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcbe40ca850 0x7fcbe415bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:03.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.855+0000 7fcbe9db0700 1 -- 172.21.15.6:0/3260938975 >> v1:172.21.15.40:6789/0 conn(0x7fcbe4071900 legacy=0x7fcbe40ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:03.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.855+0000 7fcbdbfff700 1 -- 172.21.15.6:0/3260938975 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933524573 0 0) 0x7fcbe40cb310 con 0x7fcbe4071900 2023-07-07T04:01:03.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.855+0000 7fcbe9db0700 1 -- 172.21.15.6:0/3260938975 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe40af070 con 0x7fcbe4071cd0 2023-07-07T04:01:03.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.855+0000 7fcbe9db0700 1 --2- 172.21.15.6:0/3260938975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe4071cd0 0x7fcbe415c490 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009d90 tx=0x7fcbdc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abb3a1868d9741b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:03.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.855+0000 7fcbdbfff700 1 -- 172.21.15.6:0/3260938975 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc00e070 con 0x7fcbe4071cd0 2023-07-07T04:01:03.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.855+0000 7fcbdbfff700 1 -- 172.21.15.6:0/3260938975 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc00bbd0 con 0x7fcbe4071cd0 2023-07-07T04:01:03.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.856+0000 7fcbeb813700 1 -- 172.21.15.6:0/3260938975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe4071cd0 msgr2=0x7fcbe415c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:03.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.856+0000 7fcbeb813700 1 --2- 172.21.15.6:0/3260938975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe4071cd0 0x7fcbe415c490 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009d90 tx=0x7fcbdc00b330 comp rx=0 tx=0).stop 2023-07-07T04:01:03.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.860+0000 7fcbeb813700 1 -- 172.21.15.6:0/3260938975 shutdown_connections 2023-07-07T04:01:03.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.860+0000 7fcbeb813700 1 --2- 172.21.15.6:0/3260938975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe4071cd0 0x7fcbe415c490 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:03.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.860+0000 7fcbeb813700 1 --2- 172.21.15.6:0/3260938975 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcbe40ca850 0x7fcbe415bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:03.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.860+0000 7fcbeb813700 1 -- 172.21.15.6:0/3260938975 >> 172.21.15.6:0/3260938975 conn(0x7fcbe40cf960 msgr2=0x7fcbe40cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:03.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.863+0000 7fcbeb813700 1 -- 172.21.15.6:0/3260938975 shutdown_connections 2023-07-07T04:01:03.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.867+0000 7fcbeb813700 1 -- 172.21.15.6:0/3260938975 wait complete. 2023-07-07T04:01:03.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.868+0000 7fcbeb813700 1 Processor -- start 2023-07-07T04:01:03.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.868+0000 7fcbeb813700 1 -- start start 2023-07-07T04:01:03.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.869+0000 7fcbeb813700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbe4071900 0x7fcbe40b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:03.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.869+0000 7fcbeb813700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcbe4071cd0 0x7fcbe40b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:03.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.869+0000 7fcbeb813700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe40ca850 0x7fcbe4154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:03.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.869+0000 7fcbeb813700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe4150090 con 0x7fcbe4071900 2023-07-07T04:01:03.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.869+0000 7fcbeb813700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe414f730 con 0x7fcbe40ca850 2023-07-07T04:01:03.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.869+0000 7fcbeb813700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe40b11e0 con 0x7fcbe4071cd0 2023-07-07T04:01:03.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.869+0000 7fcbe95af700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbe4071900 0x7fcbe40b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:03.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.869+0000 7fcbe8dae700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcbe4071cd0 0x7fcbe40b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:03.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.870+0000 7fcbe8dae700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcbe4071cd0 0x7fcbe40b0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:40646/0 (socket says 172.21.15.6:40646) 2023-07-07T04:01:03.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.870+0000 7fcbe95af700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbe4071900 0x7fcbe40b0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48004/0 (socket says 172.21.15.6:48004) 2023-07-07T04:01:03.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.870+0000 7fcbe8dae700 1 -- 172.21.15.6:0/753874328 learned_addr learned my addr 172.21.15.6:0/753874328 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:03.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.870+0000 7fcbe9db0700 1 --2- 172.21.15.6:0/753874328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe40ca850 0x7fcbe4154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:03.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.870+0000 7fcbe95af700 1 -- 172.21.15.6:0/753874328 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcbe4071cd0 msgr2=0x7fcbe40b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:03.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.870+0000 7fcbe95af700 1 --2- 172.21.15.6:0/753874328 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcbe4071cd0 0x7fcbe40b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:03.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.870+0000 7fcbe95af700 1 -- 172.21.15.6:0/753874328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe40ca850 msgr2=0x7fcbe4154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:03.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.870+0000 7fcbe95af700 1 --2- 172.21.15.6:0/753874328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe40ca850 0x7fcbe4154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:03.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.870+0000 7fcbe95af700 1 -- 172.21.15.6:0/753874328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc009a70 con 0x7fcbe4071900 2023-07-07T04:01:03.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.870+0000 7fcbe8dae700 1 --2- 172.21.15.6:0/753874328 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcbe4071cd0 0x7fcbe40b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T04:01:03.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.870+0000 7fcbe95af700 1 --2- 172.21.15.6:0/753874328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbe4071900 0x7fcbe40b0670 secure :-1 s=READY pgs=3327 cs=0 l=1 rev1=1 crypto rx=0x7fcbe000c3c0 tx=0x7fcbe000c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:03.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.871+0000 7fcbd9ffb700 1 -- 172.21.15.6:0/753874328 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0004a70 con 0x7fcbe4071900 2023-07-07T04:01:03.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.871+0000 7fcbd9ffb700 1 -- 172.21.15.6:0/753874328 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe0004bf0 con 0x7fcbe4071900 2023-07-07T04:01:03.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.871+0000 7fcbeb813700 1 -- 172.21.15.6:0/753874328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe414f9d0 con 0x7fcbe4071900 2023-07-07T04:01:03.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.871+0000 7fcbd9ffb700 1 -- 172.21.15.6:0/753874328 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe00070d0 con 0x7fcbe4071900 2023-07-07T04:01:03.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.871+0000 7fcbeb813700 1 -- 172.21.15.6:0/753874328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe414f160 con 0x7fcbe4071900 2023-07-07T04:01:03.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.872+0000 7fcbeb813700 1 -- 172.21.15.6:0/753874328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe404eb90 con 0x7fcbe4071900 2023-07-07T04:01:03.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.873+0000 7fcbd9ffb700 1 -- 172.21.15.6:0/753874328 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcbe0007230 con 0x7fcbe4071900 2023-07-07T04:01:03.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.873+0000 7fcbd9ffb700 1 --2- 172.21.15.6:0/753874328 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcbc806ace0 0x7fcbc806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:03.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.873+0000 7fcbd9ffb700 1 -- 172.21.15.6:0/753874328 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fcbe00891c0 con 0x7fcbe4071900 2023-07-07T04:01:03.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.873+0000 7fcbe8dae700 1 --2- 172.21.15.6:0/753874328 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcbc806ace0 0x7fcbc806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:03.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.874+0000 7fcbe8dae700 1 --2- 172.21.15.6:0/753874328 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcbc806ace0 0x7fcbc806d190 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4151b40 tx=0x7fcbd4009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:03.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:03.881+0000 7fcbd9ffb700 1 -- 172.21.15.6:0/753874328 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcbe0054070 con 0x7fcbe4071900 2023-07-07T04:01:04.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.216+0000 7fcbeb813700 1 -- 172.21.15.6:0/753874328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcbe40b58e0 con 0x7fcbe4071900 2023-07-07T04:01:04.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.217+0000 7fcbd9ffb700 1 -- 172.21.15.6:0/753874328 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcbe0057690 con 0x7fcbe4071900 2023-07-07T04:01:04.219 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-07-07T04:01:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.219+0000 7fcbeb813700 1 -- 172.21.15.6:0/753874328 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcbc806ace0 msgr2=0x7fcbc806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.219+0000 7fcbeb813700 1 --2- 172.21.15.6:0/753874328 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcbc806ace0 0x7fcbc806d190 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fcbe4151b40 tx=0x7fcbd4009240 comp rx=0 tx=0).stop 2023-07-07T04:01:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.219+0000 7fcbeb813700 1 -- 172.21.15.6:0/753874328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbe4071900 msgr2=0x7fcbe40b0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.219+0000 7fcbeb813700 1 --2- 172.21.15.6:0/753874328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbe4071900 0x7fcbe40b0670 secure :-1 s=READY pgs=3327 cs=0 l=1 rev1=1 crypto rx=0x7fcbe000c3c0 tx=0x7fcbe000c6d0 comp rx=0 tx=0).stop 2023-07-07T04:01:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.222+0000 7fcbeb813700 1 -- 172.21.15.6:0/753874328 shutdown_connections 2023-07-07T04:01:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.222+0000 7fcbeb813700 1 --2- 172.21.15.6:0/753874328 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcbc806ace0 0x7fcbc806d190 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.222+0000 7fcbeb813700 1 --2- 172.21.15.6:0/753874328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcbe4071900 0x7fcbe40b0670 unknown :-1 s=CLOSED pgs=3327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.222+0000 7fcbeb813700 1 --2- 172.21.15.6:0/753874328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbe40ca850 0x7fcbe4154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.222+0000 7fcbeb813700 1 --2- 172.21.15.6:0/753874328 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcbe4071cd0 0x7fcbe40b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.222+0000 7fcbeb813700 1 -- 172.21.15.6:0/753874328 >> 172.21.15.6:0/753874328 conn(0x7fcbe40cf960 msgr2=0x7fcbe41597b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.222+0000 7fcbeb813700 1 -- 172.21.15.6:0/753874328 shutdown_connections 2023-07-07T04:01:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.222+0000 7fcbeb813700 1 -- 172.21.15.6:0/753874328 wait complete. 2023-07-07T04:01:04.245 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-07T04:01:04.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.445+0000 7fe187415700 1 Processor -- start 2023-07-07T04:01:04.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.445+0000 7fe187415700 1 -- start start 2023-07-07T04:01:04.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.446+0000 7fe187415700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe18015cd40 0x7fe1800cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:04.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.446+0000 7fe187415700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18015d2b0 con 0x7fe180071da0 2023-07-07T04:01:04.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.447+0000 7fe187415700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18015d590 con 0x7fe1801592b0 2023-07-07T04:01:04.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.447+0000 7fe187415700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe180159680 con 0x7fe18015cd40 2023-07-07T04:01:04.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.447+0000 7fe1859b2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe18015cd40 0x7fe1800cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:04.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.447+0000 7fe1859b2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe18015cd40 0x7fe1800cb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48014/0 (socket says 172.21.15.6:48014) 2023-07-07T04:01:04.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.447+0000 7fe1859b2700 1 -- 172.21.15.6:0/572604460 learned_addr learned my addr 172.21.15.6:0/572604460 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:04.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.447+0000 7fe1859b2700 1 -- 172.21.15.6:0/572604460 >> v1:172.21.15.40:6789/0 conn(0x7fe1801592b0 legacy=0x7fe180071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:04.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.447+0000 7fe1859b2700 1 -- 172.21.15.6:0/572604460 >> v1:172.21.15.6:6789/0 conn(0x7fe180071da0 legacy=0x7fe1800cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:04.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.447+0000 7fe1859b2700 1 -- 172.21.15.6:0/572604460 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18015d870 con 0x7fe18015cd40 2023-07-07T04:01:04.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.447+0000 7fe1859b2700 1 --2- 172.21.15.6:0/572604460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe18015cd40 0x7fe1800cb860 secure :-1 s=READY pgs=3328 cs=0 l=1 rev1=1 crypto rx=0x7fe17800d150 tx=0x7fe17800d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80e18a38ab22775 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:04.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.448+0000 7fe177fff700 1 -- 172.21.15.6:0/572604460 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe178010070 con 0x7fe18015cd40 2023-07-07T04:01:04.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.448+0000 7fe177fff700 1 -- 172.21.15.6:0/572604460 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17800dd40 con 0x7fe18015cd40 2023-07-07T04:01:04.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.448+0000 7fe177fff700 1 -- 172.21.15.6:0/572604460 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17800b310 con 0x7fe18015cd40 2023-07-07T04:01:04.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.449+0000 7fe187415700 1 -- 172.21.15.6:0/572604460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe18015cd40 msgr2=0x7fe1800cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:04.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.449+0000 7fe187415700 1 --2- 172.21.15.6:0/572604460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe18015cd40 0x7fe1800cb860 secure :-1 s=READY pgs=3328 cs=0 l=1 rev1=1 crypto rx=0x7fe17800d150 tx=0x7fe17800d460 comp rx=0 tx=0).stop 2023-07-07T04:01:04.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.455+0000 7fe187415700 1 -- 172.21.15.6:0/572604460 shutdown_connections 2023-07-07T04:01:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.455+0000 7fe187415700 1 --2- 172.21.15.6:0/572604460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe18015cd40 0x7fe1800cb860 unknown :-1 s=CLOSED pgs=3328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.455+0000 7fe187415700 1 -- 172.21.15.6:0/572604460 >> 172.21.15.6:0/572604460 conn(0x7fe1800cf960 msgr2=0x7fe1800cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:04.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.457+0000 7fe187415700 1 -- 172.21.15.6:0/572604460 shutdown_connections 2023-07-07T04:01:04.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.457+0000 7fe187415700 1 -- 172.21.15.6:0/572604460 wait complete. 2023-07-07T04:01:04.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.459+0000 7fe187415700 1 Processor -- start 2023-07-07T04:01:04.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.459+0000 7fe187415700 1 -- start start 2023-07-07T04:01:04.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.460+0000 7fe187415700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe180071da0 0x7fe1800af830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:04.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.460+0000 7fe187415700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1801592b0 0x7fe1801525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:04.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.460+0000 7fe187415700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe18015cd40 0x7fe180152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:04.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.460+0000 7fe187415700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1801f20e0 con 0x7fe1801592b0 2023-07-07T04:01:04.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.460+0000 7fe187415700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1800afd70 con 0x7fe180071da0 2023-07-07T04:01:04.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.460+0000 7fe187415700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe180147b50 con 0x7fe18015cd40 2023-07-07T04:01:04.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.460+0000 7fe1851b1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe180071da0 0x7fe1800af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:04.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.460+0000 7fe1859b2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe18015cd40 0x7fe180152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:04.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.460+0000 7fe1851b1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe180071da0 0x7fe1800af830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:55284/0 (socket says 172.21.15.6:55284) 2023-07-07T04:01:04.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.460+0000 7fe1851b1700 1 -- 172.21.15.6:0/3721605685 learned_addr learned my addr 172.21.15.6:0/3721605685 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:04.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.461+0000 7fe1859b2700 1 -- 172.21.15.6:0/3721605685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe180071da0 msgr2=0x7fe1800af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:04.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.461+0000 7fe1859b2700 1 --2- 172.21.15.6:0/3721605685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe180071da0 0x7fe1800af830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:04.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.461+0000 7fe1859b2700 1 -- 172.21.15.6:0/3721605685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1801592b0 msgr2=0x7fe1801525b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-07T04:01:04.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.461+0000 7fe1859b2700 1 --2- 172.21.15.6:0/3721605685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1801592b0 0x7fe1801525b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:04.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.461+0000 7fe1859b2700 1 -- 172.21.15.6:0/3721605685 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17800bd40 con 0x7fe18015cd40 2023-07-07T04:01:04.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.461+0000 7fe1851b1700 1 --2- 172.21.15.6:0/3721605685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe180071da0 0x7fe1800af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T04:01:04.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.461+0000 7fe1859b2700 1 --2- 172.21.15.6:0/3721605685 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe18015cd40 0x7fe180152af0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe178016000 tx=0x7fe178004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:04.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.461+0000 7fe175ffb700 1 -- 172.21.15.6:0/3721605685 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe178009a10 con 0x7fe18015cd40 2023-07-07T04:01:04.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.461+0000 7fe175ffb700 1 -- 172.21.15.6:0/3721605685 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe178009b70 con 0x7fe18015cd40 2023-07-07T04:01:04.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.461+0000 7fe175ffb700 1 -- 172.21.15.6:0/3721605685 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe178004030 con 0x7fe18015cd40 2023-07-07T04:01:04.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.461+0000 7fe187415700 1 -- 172.21.15.6:0/3721605685 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1800b1320 con 0x7fe18015cd40 2023-07-07T04:01:04.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.462+0000 7fe187415700 1 -- 172.21.15.6:0/3721605685 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1800b18e0 con 0x7fe18015cd40 2023-07-07T04:01:04.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.464+0000 7fe175ffb700 1 -- 172.21.15.6:0/3721605685 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe178004190 con 0x7fe18015cd40 2023-07-07T04:01:04.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.464+0000 7fe187415700 1 -- 172.21.15.6:0/3721605685 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1800c66f0 con 0x7fe18015cd40 2023-07-07T04:01:04.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.464+0000 7fe175ffb700 1 --2- 172.21.15.6:0/3721605685 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe16406ace0 0x7fe16406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:04.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.464+0000 7fe175ffb700 1 -- 172.21.15.6:0/3721605685 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fe17808afa0 con 0x7fe18015cd40 2023-07-07T04:01:04.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.465+0000 7fe1851b1700 1 --2- 172.21.15.6:0/3721605685 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe16406ace0 0x7fe16406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:04.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.465+0000 7fe1851b1700 1 --2- 172.21.15.6:0/3721605685 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe16406ace0 0x7fe16406d190 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fe17c007fd0 tx=0x7fe17c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:04.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.471+0000 7fe175ffb700 1 -- 172.21.15.6:0/3721605685 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe178055f60 con 0x7fe18015cd40 2023-07-07T04:01:04.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.799+0000 7fe187415700 1 -- 172.21.15.6:0/3721605685 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe18004eb90 con 0x7fe18015cd40 2023-07-07T04:01:04.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.803+0000 7fe175ffb700 1 -- 172.21.15.6:0/3721605685 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe178059580 con 0x7fe18015cd40 2023-07-07T04:01:04.805 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2023-07-07T04:01:04.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.813+0000 7fe187415700 1 -- 172.21.15.6:0/3721605685 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe16406ace0 msgr2=0x7fe16406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:04.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.813+0000 7fe187415700 1 --2- 172.21.15.6:0/3721605685 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe16406ace0 0x7fe16406d190 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fe17c007fd0 tx=0x7fe17c009040 comp rx=0 tx=0).stop 2023-07-07T04:01:04.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.813+0000 7fe187415700 1 -- 172.21.15.6:0/3721605685 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe18015cd40 msgr2=0x7fe180152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:04.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.813+0000 7fe187415700 1 --2- 172.21.15.6:0/3721605685 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe18015cd40 0x7fe180152af0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe178016000 tx=0x7fe178004ad0 comp rx=0 tx=0).stop 2023-07-07T04:01:04.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.818+0000 7fe187415700 1 -- 172.21.15.6:0/3721605685 shutdown_connections 2023-07-07T04:01:04.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.818+0000 7fe187415700 1 --2- 172.21.15.6:0/3721605685 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe16406ace0 0x7fe16406d190 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:04.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.818+0000 7fe187415700 1 --2- 172.21.15.6:0/3721605685 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe18015cd40 0x7fe180152af0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:04.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.818+0000 7fe187415700 1 --2- 172.21.15.6:0/3721605685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe180071da0 0x7fe1800af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:04.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.818+0000 7fe187415700 1 --2- 172.21.15.6:0/3721605685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1801592b0 0x7fe1801525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:04.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.818+0000 7fe187415700 1 -- 172.21.15.6:0/3721605685 >> 172.21.15.6:0/3721605685 conn(0x7fe1800cf960 msgr2=0x7fe1800cff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:04.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.822+0000 7fe187415700 1 -- 172.21.15.6:0/3721605685 shutdown_connections 2023-07-07T04:01:04.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:04.822+0000 7fe187415700 1 -- 172.21.15.6:0/3721605685 wait complete. 2023-07-07T04:01:04.846 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-07T04:01:05.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.055+0000 7fc7f1a83700 1 Processor -- start 2023-07-07T04:01:05.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.056+0000 7fc7f1a83700 1 -- start start 2023-07-07T04:01:05.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.057+0000 7fc7f1a83700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc7ec0cefe0 0x7fc7ec0cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:05.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.057+0000 7fc7f1a83700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc7ec0cb210 0x7fc7ec15cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:05.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.057+0000 7fc7f1a83700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7ec0c9d70 con 0x7fc7ec0cd630 2023-07-07T04:01:05.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.057+0000 7fc7f1a83700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7ec0c9810 con 0x7fc7ec0cefe0 2023-07-07T04:01:05.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.057+0000 7fc7f1a83700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7ec06bdf0 con 0x7fc7ec0cb210 2023-07-07T04:01:05.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.057+0000 7fc7eaffd700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc7ec0cd630 0x7fc7ec15c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:39104/0 (socket says 172.21.15.6:39104) 2023-07-07T04:01:05.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.057+0000 7fc7eaffd700 1 -- 172.21.15.6:0/4193893898 learned_addr learned my addr 172.21.15.6:0/4193893898 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:01:05.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.057+0000 7fc7ebfff700 1 --2- 172.21.15.6:0/4193893898 >> v2:172.21.15.40:3300/0 conn(0x7fc7ec0cb210 0x7fc7ec15cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:05.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.057+0000 7fc7ea7fc700 1 -- 172.21.15.6:0/4193893898 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1115086727 0 0) 0x7fc7ec0c9d70 con 0x7fc7ec0cd630 2023-07-07T04:01:05.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.057+0000 7fc7ea7fc700 1 -- 172.21.15.6:0/4193893898 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7d40035b0 con 0x7fc7ec0cd630 2023-07-07T04:01:05.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.057+0000 7fc7ebfff700 1 -- 172.21.15.6:0/4193893898 >> v2:172.21.15.6:3300/0 conn(0x7fc7ec0cefe0 msgr2=0x7fc7ec0cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:05.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.057+0000 7fc7ebfff700 1 --2- 172.21.15.6:0/4193893898 >> v2:172.21.15.6:3300/0 conn(0x7fc7ec0cefe0 0x7fc7ec0cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:05.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.057+0000 7fc7ebfff700 1 -- 172.21.15.6:0/4193893898 >> v1:172.21.15.40:6789/0 conn(0x7fc7ec0cd630 legacy=0x7fc7ec15c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:05.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.057+0000 7fc7ebfff700 1 -- 172.21.15.6:0/4193893898 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ec06b830 con 0x7fc7ec0cb210 2023-07-07T04:01:05.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.058+0000 7fc7ebfff700 1 --2- 172.21.15.6:0/4193893898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7ec0cb210 0x7fc7ec15cbe0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec0d0130 tx=0x7fc7e400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e378815a6b1ff9a server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:05.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.058+0000 7fc7ea7fc700 1 -- 172.21.15.6:0/4193893898 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e400e070 con 0x7fc7ec0cb210 2023-07-07T04:01:05.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.058+0000 7fc7ea7fc700 1 -- 172.21.15.6:0/4193893898 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e400bb20 con 0x7fc7ec0cb210 2023-07-07T04:01:05.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.058+0000 7fc7ea7fc700 1 -- 172.21.15.6:0/4193893898 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4012430 con 0x7fc7ec0cb210 2023-07-07T04:01:05.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.059+0000 7fc7f1a83700 1 -- 172.21.15.6:0/4193893898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7ec0cb210 msgr2=0x7fc7ec15cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:05.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.059+0000 7fc7f1a83700 1 --2- 172.21.15.6:0/4193893898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7ec0cb210 0x7fc7ec15cbe0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec0d0130 tx=0x7fc7e400b330 comp rx=0 tx=0).stop 2023-07-07T04:01:05.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.059+0000 7fc7f1a83700 1 -- 172.21.15.6:0/4193893898 shutdown_connections 2023-07-07T04:01:05.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.059+0000 7fc7f1a83700 1 --2- 172.21.15.6:0/4193893898 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7ec0cb210 0x7fc7ec15cbe0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:05.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.059+0000 7fc7f1a83700 1 --2- 172.21.15.6:0/4193893898 >> v2:172.21.15.6:3300/0 conn(0x7fc7ec0cefe0 0x7fc7ec0cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:05.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.059+0000 7fc7f1a83700 1 -- 172.21.15.6:0/4193893898 >> 172.21.15.6:0/4193893898 conn(0x7fc7ec0b0b60 msgr2=0x7fc7ec0b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:05.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.059+0000 7fc7f1a83700 1 -- 172.21.15.6:0/4193893898 shutdown_connections 2023-07-07T04:01:05.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.059+0000 7fc7f1a83700 1 -- 172.21.15.6:0/4193893898 wait complete. 2023-07-07T04:01:05.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.061+0000 7fc7f1a83700 1 Processor -- start 2023-07-07T04:01:05.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.061+0000 7fc7f1a83700 1 -- start start 2023-07-07T04:01:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.062+0000 7fc7f1a83700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7ec0cb210 0x7fc7ec153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.062+0000 7fc7f1a83700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7ec0cd630 0x7fc7ec1f1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.062+0000 7fc7f1a83700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7ec0cefe0 0x7fc7ec0ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.062+0000 7fc7f1a83700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec1f21a0 con 0x7fc7ec0cd630 2023-07-07T04:01:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.062+0000 7fc7f1a83700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec1f1be0 con 0x7fc7ec0cefe0 2023-07-07T04:01:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.062+0000 7fc7f1a83700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec1f1ec0 con 0x7fc7ec0cb210 2023-07-07T04:01:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.062+0000 7fc7eaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7ec0cd630 0x7fc7ec1f1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.062+0000 7fc7eb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7ec0cb210 0x7fc7ec153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.062+0000 7fc7eaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7ec0cd630 0x7fc7ec1f1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48030/0 (socket says 172.21.15.6:48030) 2023-07-07T04:01:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.062+0000 7fc7eaffd700 1 -- 172.21.15.6:0/1585734739 learned_addr learned my addr 172.21.15.6:0/1585734739 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.062+0000 7fc7eb7fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7ec0cb210 0x7fc7ec153270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:40672/0 (socket says 172.21.15.6:40672) 2023-07-07T04:01:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.062+0000 7fc7ebfff700 1 --2- 172.21.15.6:0/1585734739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7ec0cefe0 0x7fc7ec0ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.063+0000 7fc7ebfff700 1 -- 172.21.15.6:0/1585734739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7ec0cb210 msgr2=0x7fc7ec153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:05.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.063+0000 7fc7ebfff700 1 --2- 172.21.15.6:0/1585734739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7ec0cb210 0x7fc7ec153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:05.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.063+0000 7fc7ebfff700 1 -- 172.21.15.6:0/1585734739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7ec0cd630 msgr2=0x7fc7ec1f1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:05.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.063+0000 7fc7ebfff700 1 --2- 172.21.15.6:0/1585734739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7ec0cd630 0x7fc7ec1f1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:05.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.063+0000 7fc7ebfff700 1 -- 172.21.15.6:0/1585734739 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e4009a70 con 0x7fc7ec0cefe0 2023-07-07T04:01:05.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.063+0000 7fc7eb7fe700 1 --2- 172.21.15.6:0/1585734739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7ec0cb210 0x7fc7ec153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T04:01:05.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.063+0000 7fc7ebfff700 1 --2- 172.21.15.6:0/1585734739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7ec0cefe0 0x7fc7ec0ca200 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4016000 tx=0x7fc7e4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:05.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.064+0000 7fc7d3fff700 1 -- 172.21.15.6:0/1585734739 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4012430 con 0x7fc7ec0cefe0 2023-07-07T04:01:05.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.064+0000 7fc7d3fff700 1 -- 172.21.15.6:0/1585734739 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e401fd50 con 0x7fc7ec0cefe0 2023-07-07T04:01:05.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.064+0000 7fc7d3fff700 1 -- 172.21.15.6:0/1585734739 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4012820 con 0x7fc7ec0cefe0 2023-07-07T04:01:05.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.065+0000 7fc7f1a83700 1 -- 172.21.15.6:0/1585734739 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7ec0c7bb0 con 0x7fc7ec0cefe0 2023-07-07T04:01:05.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.065+0000 7fc7f1a83700 1 -- 172.21.15.6:0/1585734739 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7ec155240 con 0x7fc7ec0cefe0 2023-07-07T04:01:05.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.066+0000 7fc7f1a83700 1 -- 172.21.15.6:0/1585734739 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7ec0c7a10 con 0x7fc7ec0cefe0 2023-07-07T04:01:05.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.067+0000 7fc7d3fff700 1 -- 172.21.15.6:0/1585734739 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc7e4027070 con 0x7fc7ec0cefe0 2023-07-07T04:01:05.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.067+0000 7fc7d3fff700 1 --2- 172.21.15.6:0/1585734739 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc7d806ace0 0x7fc7d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:05.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.068+0000 7fc7d3fff700 1 -- 172.21.15.6:0/1585734739 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fc7e408a280 con 0x7fc7ec0cefe0 2023-07-07T04:01:05.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.068+0000 7fc7eb7fe700 1 --2- 172.21.15.6:0/1585734739 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc7d806ace0 0x7fc7d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:05.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.068+0000 7fc7eb7fe700 1 --2- 172.21.15.6:0/1585734739 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc7d806ace0 0x7fc7d806d190 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009d40 tx=0x7fc7dc009110 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:05.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.074+0000 7fc7d3fff700 1 -- 172.21.15.6:0/1585734739 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc7ec0c7a10 con 0x7fc7ec0cefe0 2023-07-07T04:01:05.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.414+0000 7fc7f1a83700 1 -- 172.21.15.6:0/1585734739 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc7ec0c7a10 con 0x7fc7ec0cefe0 2023-07-07T04:01:05.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.415+0000 7fc7d3fff700 1 -- 172.21.15.6:0/1585734739 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc7ec0c7a10 con 0x7fc7ec0cefe0 2023-07-07T04:01:05.418 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-07-07T04:01:05.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.420+0000 7fc7f1a83700 1 -- 172.21.15.6:0/1585734739 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc7d806ace0 msgr2=0x7fc7d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:05.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.420+0000 7fc7f1a83700 1 --2- 172.21.15.6:0/1585734739 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc7d806ace0 0x7fc7d806d190 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009d40 tx=0x7fc7dc009110 comp rx=0 tx=0).stop 2023-07-07T04:01:05.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.420+0000 7fc7f1a83700 1 -- 172.21.15.6:0/1585734739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7ec0cefe0 msgr2=0x7fc7ec0ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:05.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.420+0000 7fc7f1a83700 1 --2- 172.21.15.6:0/1585734739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7ec0cefe0 0x7fc7ec0ca200 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4016000 tx=0x7fc7e4004ad0 comp rx=0 tx=0).stop 2023-07-07T04:01:05.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.420+0000 7fc7f1a83700 1 -- 172.21.15.6:0/1585734739 shutdown_connections 2023-07-07T04:01:05.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.420+0000 7fc7f1a83700 1 --2- 172.21.15.6:0/1585734739 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc7d806ace0 0x7fc7d806d190 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:05.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.420+0000 7fc7f1a83700 1 --2- 172.21.15.6:0/1585734739 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7ec0cefe0 0x7fc7ec0ca200 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:05.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.421+0000 7fc7f1a83700 1 --2- 172.21.15.6:0/1585734739 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7ec0cb210 0x7fc7ec153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:05.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.421+0000 7fc7f1a83700 1 --2- 172.21.15.6:0/1585734739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7ec0cd630 0x7fc7ec1f1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:05.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.421+0000 7fc7f1a83700 1 -- 172.21.15.6:0/1585734739 >> 172.21.15.6:0/1585734739 conn(0x7fc7ec0b0b60 msgr2=0x7fc7ec0ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:05.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.425+0000 7fc7f1a83700 1 -- 172.21.15.6:0/1585734739 shutdown_connections 2023-07-07T04:01:05.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.428+0000 7fc7f1a83700 1 -- 172.21.15.6:0/1585734739 wait complete. 2023-07-07T04:01:05.451 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-07T04:01:05.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.640+0000 7f492325f700 1 Processor -- start 2023-07-07T04:01:05.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.640+0000 7f492325f700 1 -- start start 2023-07-07T04:01:05.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.642+0000 7f492325f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f491c0b21c0 0x7f491c15cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:05.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.642+0000 7f492325f700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f491c0d11c0 con 0x7f491c0d0c00 2023-07-07T04:01:05.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.642+0000 7f492325f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f491c0d14a0 con 0x7f491c0cd9d0 2023-07-07T04:01:05.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.642+0000 7f492325f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f491c0d1780 con 0x7f491c0b21c0 2023-07-07T04:01:05.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.643+0000 7f491bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f491c0d0c00 0x7f491c0cd2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49244/0 (socket says 172.21.15.6:49244) 2023-07-07T04:01:05.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.643+0000 7f491bfff700 1 -- 172.21.15.6:0/2696579754 learned_addr learned my addr 172.21.15.6:0/2696579754 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:01:05.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.643+0000 7f491b7fe700 1 -- 172.21.15.6:0/2696579754 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2119113419 0 0) 0x7f491c0d11c0 con 0x7f491c0d0c00 2023-07-07T04:01:05.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.643+0000 7f491b7fe700 1 -- 172.21.15.6:0/2696579754 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f490c0035b0 con 0x7f491c0d0c00 2023-07-07T04:01:05.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.644+0000 7f491b7fe700 1 -- 172.21.15.6:0/2696579754 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2368038095 0 0) 0x7f490c0035b0 con 0x7f491c0d0c00 2023-07-07T04:01:05.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.644+0000 7f491b7fe700 1 -- 172.21.15.6:0/2696579754 >> v2:172.21.15.40:3300/0 conn(0x7f491c0b21c0 msgr2=0x7f491c15cc60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-07T04:01:05.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.644+0000 7f491b7fe700 1 --2- 172.21.15.6:0/2696579754 >> v2:172.21.15.40:3300/0 conn(0x7f491c0b21c0 0x7f491c15cc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:05.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.644+0000 7f491b7fe700 1 -- 172.21.15.6:0/2696579754 >> v1:172.21.15.40:6789/0 conn(0x7f491c0cd9d0 legacy=0x7f491c06a0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-07T04:01:05.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.644+0000 7f491b7fe700 1 -- 172.21.15.6:0/2696579754 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c0d1a60 con 0x7f491c0d0c00 2023-07-07T04:01:05.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.644+0000 7f491b7fe700 1 -- 172.21.15.6:0/2696579754 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f4910001670 con 0x7f491c0d0c00 2023-07-07T04:01:05.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.644+0000 7f491b7fe700 1 -- 172.21.15.6:0/2696579754 >> v1:172.21.15.6:6789/0 conn(0x7f491c0d0c00 legacy=0x7f491c0cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:05.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.644+0000 7f491b7fe700 1 --2- 172.21.15.6:0/2696579754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f490c003a00 0x7f490c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:05.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.644+0000 7f491b7fe700 1 --2- 172.21.15.6:0/2696579754 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f490c004850 0x7f490c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:05.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.644+0000 7f491b7fe700 1 --2- 172.21.15.6:0/2696579754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f490c005320 0x7f490c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:05.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.644+0000 7f491b7fe700 1 -- 172.21.15.6:0/2696579754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c0d1780 con 0x7f490c003a00 2023-07-07T04:01:05.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.644+0000 7f491b7fe700 1 -- 172.21.15.6:0/2696579754 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490c00c1e0 con 0x7f490c005320 2023-07-07T04:01:05.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.644+0000 7f491b7fe700 1 -- 172.21.15.6:0/2696579754 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490c00c3a0 con 0x7f490c004850 2023-07-07T04:01:05.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.647+0000 7f491bfff700 1 --2- 172.21.15.6:0/2696579754 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f490c004850 0x7f490c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:05.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.647+0000 7f4920ffb700 1 --2- 172.21.15.6:0/2696579754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f490c003a00 0x7f490c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:05.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.647+0000 7f491bfff700 1 -- 172.21.15.6:0/2696579754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f490c005320 msgr2=0x7f490c00ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-07T04:01:05.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.647+0000 7f491bfff700 1 --2- 172.21.15.6:0/2696579754 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f490c005320 0x7f490c00ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:05.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.647+0000 7f491bfff700 1 -- 172.21.15.6:0/2696579754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f490c003a00 msgr2=0x7f490c003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:05.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.647+0000 7f491bfff700 1 --2- 172.21.15.6:0/2696579754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f490c003a00 0x7f490c003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:05.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.647+0000 7f491bfff700 1 -- 172.21.15.6:0/2696579754 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c0d1a60 con 0x7f490c004850 2023-07-07T04:01:05.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.647+0000 7f4920ffb700 1 --2- 172.21.15.6:0/2696579754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f490c003a00 0x7f490c003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T04:01:05.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.647+0000 7f491bfff700 1 --2- 172.21.15.6:0/2696579754 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f490c004850 0x7f490c004cc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f491000c370 tx=0x7f490c005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eca51f7ce6dbd602 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:05.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.648+0000 7f491b7fe700 1 -- 172.21.15.6:0/2696579754 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4910005960 con 0x7f490c004850 2023-07-07T04:01:05.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.648+0000 7f491b7fe700 1 -- 172.21.15.6:0/2696579754 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4910005ae0 con 0x7f490c004850 2023-07-07T04:01:05.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.648+0000 7f491b7fe700 1 -- 172.21.15.6:0/2696579754 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4910005e90 con 0x7f490c004850 2023-07-07T04:01:05.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.648+0000 7f49217fc700 1 -- 172.21.15.6:0/2696579754 reap_dead start 2023-07-07T04:01:05.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.649+0000 7f492325f700 1 -- 172.21.15.6:0/2696579754 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f490c004850 msgr2=0x7f490c004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:05.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.649+0000 7f492325f700 1 --2- 172.21.15.6:0/2696579754 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f490c004850 0x7f490c004cc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f491000c370 tx=0x7f490c005880 comp rx=0 tx=0).stop 2023-07-07T04:01:05.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.649+0000 7f492325f700 1 -- 172.21.15.6:0/2696579754 shutdown_connections 2023-07-07T04:01:05.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.649+0000 7f492325f700 1 --2- 172.21.15.6:0/2696579754 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f490c004850 0x7f490c004cc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:05.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.649+0000 7f492325f700 1 -- 172.21.15.6:0/2696579754 >> 172.21.15.6:0/2696579754 conn(0x7f491c0d3900 msgr2=0x7f491c0b4760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:05.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.653+0000 7f492325f700 1 -- 172.21.15.6:0/2696579754 shutdown_connections 2023-07-07T04:01:05.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.656+0000 7f492325f700 1 -- 172.21.15.6:0/2696579754 wait complete. 2023-07-07T04:01:05.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.657+0000 7f492325f700 1 Processor -- start 2023-07-07T04:01:05.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.658+0000 7f492325f700 1 -- start start 2023-07-07T04:01:05.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.659+0000 7f492325f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f490c004850 0x7f491c151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:05.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.659+0000 7f492325f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f491c0b6840 0x7f491c0cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:05.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.659+0000 7f492325f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f491c0cc000 0x7f491c157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:05.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.659+0000 7f492325f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c1521f0 con 0x7f491c0b6840 2023-07-07T04:01:05.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.659+0000 7f492325f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c15f4b0 con 0x7f491c0cc000 2023-07-07T04:01:05.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.659+0000 7f492325f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491c15f790 con 0x7f490c004850 2023-07-07T04:01:05.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.659+0000 7f491bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f491c0b6840 0x7f491c0cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:05.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.659+0000 7f491bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f491c0b6840 0x7f491c0cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48042/0 (socket says 172.21.15.6:48042) 2023-07-07T04:01:05.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.659+0000 7f491bfff700 1 -- 172.21.15.6:0/18593585 learned_addr learned my addr 172.21.15.6:0/18593585 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:05.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.659+0000 7f491bfff700 1 -- 172.21.15.6:0/18593585 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f490c004850 msgr2=0x7f491c151cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-07T04:01:05.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.659+0000 7f491bfff700 1 --2- 172.21.15.6:0/18593585 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f490c004850 0x7f491c151cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:05.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.659+0000 7f491bfff700 1 -- 172.21.15.6:0/18593585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f491c0cc000 msgr2=0x7f491c157770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-07T04:01:05.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.659+0000 7f491bfff700 1 --2- 172.21.15.6:0/18593585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f491c0cc000 0x7f491c157770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:05.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.659+0000 7f491bfff700 1 -- 172.21.15.6:0/18593585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c15fa70 con 0x7f491c0b6840 2023-07-07T04:01:05.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.660+0000 7f491bfff700 1 --2- 172.21.15.6:0/18593585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f491c0b6840 0x7f491c0cbac0 secure :-1 s=READY pgs=3330 cs=0 l=1 rev1=1 crypto rx=0x7f490c00c530 tx=0x7f4910001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:05.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.660+0000 7f49197fa700 1 -- 172.21.15.6:0/18593585 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4910004a80 con 0x7f491c0b6840 2023-07-07T04:01:05.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.660+0000 7f49197fa700 1 -- 172.21.15.6:0/18593585 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4910004c00 con 0x7f491c0b6840 2023-07-07T04:01:05.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.660+0000 7f492325f700 1 -- 172.21.15.6:0/18593585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491c0c9d40 con 0x7f491c0b6840 2023-07-07T04:01:05.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.660+0000 7f49197fa700 1 -- 172.21.15.6:0/18593585 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49100070d0 con 0x7f491c0b6840 2023-07-07T04:01:05.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.660+0000 7f492325f700 1 -- 172.21.15.6:0/18593585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491c0b6cb0 con 0x7f491c0b6840 2023-07-07T04:01:05.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.662+0000 7f492325f700 1 -- 172.21.15.6:0/18593585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48fc0052f0 con 0x7f491c0b6840 2023-07-07T04:01:05.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.663+0000 7f49197fa700 1 -- 172.21.15.6:0/18593585 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4910007230 con 0x7f491c0b6840 2023-07-07T04:01:05.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.663+0000 7f49197fa700 1 --2- 172.21.15.6:0/18593585 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f490006ace0 0x7f490006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:05.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.663+0000 7f49197fa700 1 -- 172.21.15.6:0/18593585 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f491008b1d0 con 0x7f491c0b6840 2023-07-07T04:01:05.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.667+0000 7f4920ffb700 1 --2- 172.21.15.6:0/18593585 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f490006ace0 0x7f490006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:05.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.668+0000 7f4920ffb700 1 --2- 172.21.15.6:0/18593585 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f490006ace0 0x7f490006d190 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f490800a870 tx=0x7f4908008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:05.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.669+0000 7f49197fa700 1 -- 172.21.15.6:0/18593585 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4910056270 con 0x7f491c0b6840 2023-07-07T04:01:05.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.980+0000 7f492325f700 1 -- 172.21.15.6:0/18593585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f48fc005b20 con 0x7f491c0b6840 2023-07-07T04:01:05.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.980+0000 7f49197fa700 1 -- 172.21.15.6:0/18593585 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4910007dc0 con 0x7f491c0b6840 2023-07-07T04:01:05.982 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-07-07T04:01:05.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.982+0000 7f492325f700 1 -- 172.21.15.6:0/18593585 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f490006ace0 msgr2=0x7f490006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:05.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.982+0000 7f492325f700 1 --2- 172.21.15.6:0/18593585 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f490006ace0 0x7f490006d190 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f490800a870 tx=0x7f4908008040 comp rx=0 tx=0).stop 2023-07-07T04:01:05.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.982+0000 7f492325f700 1 -- 172.21.15.6:0/18593585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f491c0b6840 msgr2=0x7f491c0cbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:05.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.982+0000 7f492325f700 1 --2- 172.21.15.6:0/18593585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f491c0b6840 0x7f491c0cbac0 secure :-1 s=READY pgs=3330 cs=0 l=1 rev1=1 crypto rx=0x7f490c00c530 tx=0x7f4910001930 comp rx=0 tx=0).stop 2023-07-07T04:01:05.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.983+0000 7f492325f700 1 -- 172.21.15.6:0/18593585 shutdown_connections 2023-07-07T04:01:05.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.983+0000 7f492325f700 1 --2- 172.21.15.6:0/18593585 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f490006ace0 0x7f490006d190 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:05.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.983+0000 7f492325f700 1 --2- 172.21.15.6:0/18593585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f491c0cc000 0x7f491c157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:05.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.983+0000 7f492325f700 1 --2- 172.21.15.6:0/18593585 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f490c004850 0x7f491c151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:05.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.983+0000 7f492325f700 1 --2- 172.21.15.6:0/18593585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f491c0b6840 0x7f491c0cbac0 unknown :-1 s=CLOSED pgs=3330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:05.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.983+0000 7f492325f700 1 -- 172.21.15.6:0/18593585 >> 172.21.15.6:0/18593585 conn(0x7f491c0d3900 msgr2=0x7f491c0d2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:05.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.983+0000 7f492325f700 1 -- 172.21.15.6:0/18593585 shutdown_connections 2023-07-07T04:01:05.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:05.983+0000 7f492325f700 1 -- 172.21.15.6:0/18593585 wait complete. 2023-07-07T04:01:06.008 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-07T04:01:06.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.222+0000 7f7d66a9c700 1 Processor -- start 2023-07-07T04:01:06.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.222+0000 7f7d66a9c700 1 -- start start 2023-07-07T04:01:06.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.223+0000 7f7d66a9c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7d6006a060 0x7f7d6015ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:06.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.223+0000 7f7d66a9c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d60070650 0x7f7d60070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:06.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.223+0000 7f7d66a9c700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d600b19e0 con 0x7f7d6015a200 2023-07-07T04:01:06.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.223+0000 7f7d66a9c700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d60071010 con 0x7f7d6006a060 2023-07-07T04:01:06.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.223+0000 7f7d66a9c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d60160e40 con 0x7f7d60070650 2023-07-07T04:01:06.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.224+0000 7f7d64838700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f7d6015a200 0x7f7d6015c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49254/0 (socket says 172.21.15.6:49254) 2023-07-07T04:01:06.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.224+0000 7f7d64838700 1 -- 172.21.15.6:0/632252377 learned_addr learned my addr 172.21.15.6:0/632252377 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:01:06.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.224+0000 7f7d5f7fe700 1 -- 172.21.15.6:0/632252377 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681300770 0 0) 0x7f7d600b19e0 con 0x7f7d6015a200 2023-07-07T04:01:06.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.224+0000 7f7d5f7fe700 1 -- 172.21.15.6:0/632252377 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d480035b0 con 0x7f7d6015a200 2023-07-07T04:01:06.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.224+0000 7f7d5f7fe700 1 -- 172.21.15.6:0/632252377 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2879988954 0 0) 0x7f7d480035b0 con 0x7f7d6015a200 2023-07-07T04:01:06.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.224+0000 7f7d5f7fe700 1 -- 172.21.15.6:0/632252377 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d60070650 msgr2=0x7f7d60070ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-07T04:01:06.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.224+0000 7f7d5f7fe700 1 --2- 172.21.15.6:0/632252377 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d60070650 0x7f7d60070ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:06.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.225+0000 7f7d5f7fe700 1 -- 172.21.15.6:0/632252377 >> v2:172.21.15.40:3300/0 conn(0x7f7d6006a060 msgr2=0x7f7d6015ffc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-07T04:01:06.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.225+0000 7f7d5f7fe700 1 --2- 172.21.15.6:0/632252377 >> v2:172.21.15.40:3300/0 conn(0x7f7d6006a060 0x7f7d6015ffc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:06.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.225+0000 7f7d5f7fe700 1 -- 172.21.15.6:0/632252377 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d601605a0 con 0x7f7d6015a200 2023-07-07T04:01:06.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.225+0000 7f7d5f7fe700 1 -- 172.21.15.6:0/632252377 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f7d580019f0 con 0x7f7d6015a200 2023-07-07T04:01:06.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.225+0000 7f7d5f7fe700 1 -- 172.21.15.6:0/632252377 >> v1:172.21.15.6:6789/0 conn(0x7f7d6015a200 legacy=0x7f7d6015c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:06.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.225+0000 7f7d5f7fe700 1 --2- 172.21.15.6:0/632252377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d48003a70 0x7f7d48003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:06.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.225+0000 7f7d5f7fe700 1 --2- 172.21.15.6:0/632252377 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d48004850 0x7f7d48004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.225+0000 7f7d5f7fe700 1 --2- 172.21.15.6:0/632252377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d48005320 0x7f7d4800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.225+0000 7f7d5f7fe700 1 -- 172.21.15.6:0/632252377 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d60071010 con 0x7f7d48003a70 2023-07-07T04:01:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.225+0000 7f7d5f7fe700 1 -- 172.21.15.6:0/632252377 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d60160e40 con 0x7f7d48005320 2023-07-07T04:01:06.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.225+0000 7f7d5f7fe700 1 -- 172.21.15.6:0/632252377 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4800c280 con 0x7f7d48004850 2023-07-07T04:01:06.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.225+0000 7f7d64838700 1 --2- 172.21.15.6:0/632252377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d48003a70 0x7f7d48003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.225+0000 7f7d64838700 1 -- 172.21.15.6:0/632252377 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d48004850 msgr2=0x7f7d48004cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-07T04:01:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.225+0000 7f7d64838700 1 --2- 172.21.15.6:0/632252377 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d48004850 0x7f7d48004cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.225+0000 7f7d64838700 1 -- 172.21.15.6:0/632252377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d48005320 msgr2=0x7f7d4800ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-07T04:01:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.225+0000 7f7d64838700 1 --2- 172.21.15.6:0/632252377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d48005320 0x7f7d4800ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.225+0000 7f7d64838700 1 -- 172.21.15.6:0/632252377 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d601605a0 con 0x7f7d48003a70 2023-07-07T04:01:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.226+0000 7f7d64838700 1 --2- 172.21.15.6:0/632252377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d48003a70 0x7f7d48003e80 secure :-1 s=READY pgs=3332 cs=0 l=1 rev1=1 crypto rx=0x7f7d5800a9d0 tx=0x7f7d48005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd99528d8393b932 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:06.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.226+0000 7f7d5f7fe700 1 -- 172.21.15.6:0/632252377 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5800c650 con 0x7f7d48003a70 2023-07-07T04:01:06.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.226+0000 7f7d5f7fe700 1 -- 172.21.15.6:0/632252377 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5800c7b0 con 0x7f7d48003a70 2023-07-07T04:01:06.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.226+0000 7f7d5f7fe700 1 -- 172.21.15.6:0/632252377 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5800cb40 con 0x7f7d48003a70 2023-07-07T04:01:06.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.231+0000 7f7d66a9c700 1 -- 172.21.15.6:0/632252377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d48003a70 msgr2=0x7f7d48003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:06.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.231+0000 7f7d66a9c700 1 --2- 172.21.15.6:0/632252377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d48003a70 0x7f7d48003e80 secure :-1 s=READY pgs=3332 cs=0 l=1 rev1=1 crypto rx=0x7f7d5800a9d0 tx=0x7f7d48005880 comp rx=0 tx=0).stop 2023-07-07T04:01:06.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.231+0000 7f7d65039700 1 -- 172.21.15.6:0/632252377 reap_dead start 2023-07-07T04:01:06.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.232+0000 7f7d66a9c700 1 -- 172.21.15.6:0/632252377 shutdown_connections 2023-07-07T04:01:06.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.232+0000 7f7d66a9c700 1 -- 172.21.15.6:0/632252377 >> 172.21.15.6:0/632252377 conn(0x7f7d600b05b0 msgr2=0x7f7d600b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:06.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.232+0000 7f7d66a9c700 1 -- 172.21.15.6:0/632252377 shutdown_connections 2023-07-07T04:01:06.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.232+0000 7f7d66a9c700 1 -- 172.21.15.6:0/632252377 wait complete. 2023-07-07T04:01:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.233+0000 7f7d66a9c700 1 Processor -- start 2023-07-07T04:01:06.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.233+0000 7f7d66a9c700 1 -- start start 2023-07-07T04:01:06.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.234+0000 7f7d66a9c700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d48003a70 0x7f7d600cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:06.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.234+0000 7f7d66a9c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d6014fb80 0x7f7d60158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:06.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.234+0000 7f7d66a9c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6014fff0 0x7f7d60158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:06.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.234+0000 7f7d66a9c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6015db80 con 0x7f7d6014fff0 2023-07-07T04:01:06.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.234+0000 7f7d66a9c700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6015cae0 con 0x7f7d48003a70 2023-07-07T04:01:06.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.234+0000 7f7d66a9c700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6015cdc0 con 0x7f7d6014fb80 2023-07-07T04:01:06.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.235+0000 7f7d65039700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6014fff0 0x7f7d60158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:06.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.235+0000 7f7d65039700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6014fff0 0x7f7d60158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48056/0 (socket says 172.21.15.6:48056) 2023-07-07T04:01:06.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.235+0000 7f7d65039700 1 -- 172.21.15.6:0/2740307882 learned_addr learned my addr 172.21.15.6:0/2740307882 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:06.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.235+0000 7f7d5ffff700 1 --2- 172.21.15.6:0/2740307882 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d6014fb80 0x7f7d60158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:06.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.235+0000 7f7d64838700 1 --2- 172.21.15.6:0/2740307882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d48003a70 0x7f7d600cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:06.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.235+0000 7f7d65039700 1 -- 172.21.15.6:0/2740307882 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d6014fb80 msgr2=0x7f7d60158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:06.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.235+0000 7f7d65039700 1 --2- 172.21.15.6:0/2740307882 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d6014fb80 0x7f7d60158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:06.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.235+0000 7f7d65039700 1 -- 172.21.15.6:0/2740307882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d48003a70 msgr2=0x7f7d600cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:06.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.235+0000 7f7d65039700 1 --2- 172.21.15.6:0/2740307882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d48003a70 0x7f7d600cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:06.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.235+0000 7f7d65039700 1 -- 172.21.15.6:0/2740307882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6015d0a0 con 0x7f7d6014fff0 2023-07-07T04:01:06.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.242+0000 7f7d65039700 1 --2- 172.21.15.6:0/2740307882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6014fff0 0x7f7d60158580 secure :-1 s=READY pgs=3333 cs=0 l=1 rev1=1 crypto rx=0x7f7d480047d0 tx=0x7f7d5400b5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:06.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.242+0000 7f7d5d7fa700 1 -- 172.21.15.6:0/2740307882 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d540038e0 con 0x7f7d6014fff0 2023-07-07T04:01:06.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.243+0000 7f7d5d7fa700 1 -- 172.21.15.6:0/2740307882 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d54003a40 con 0x7f7d6014fff0 2023-07-07T04:01:06.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.243+0000 7f7d66a9c700 1 -- 172.21.15.6:0/2740307882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d6015d380 con 0x7f7d6014fff0 2023-07-07T04:01:06.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.243+0000 7f7d5d7fa700 1 -- 172.21.15.6:0/2740307882 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d54003df0 con 0x7f7d6014fff0 2023-07-07T04:01:06.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.243+0000 7f7d66a9c700 1 -- 172.21.15.6:0/2740307882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d600cd080 con 0x7f7d6014fff0 2023-07-07T04:01:06.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.246+0000 7f7d66a9c700 1 -- 172.21.15.6:0/2740307882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d400052f0 con 0x7f7d6014fff0 2023-07-07T04:01:06.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.250+0000 7f7d5d7fa700 1 -- 172.21.15.6:0/2740307882 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7d54005070 con 0x7f7d6014fff0 2023-07-07T04:01:06.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.251+0000 7f7d5d7fa700 1 --2- 172.21.15.6:0/2740307882 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7d4c06ace0 0x7f7d4c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:06.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.251+0000 7f7d5d7fa700 1 -- 172.21.15.6:0/2740307882 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f7d540884b0 con 0x7f7d6014fff0 2023-07-07T04:01:06.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.251+0000 7f7d64838700 1 --2- 172.21.15.6:0/2740307882 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7d4c06ace0 0x7f7d4c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:06.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.252+0000 7f7d64838700 1 --2- 172.21.15.6:0/2740307882 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7d4c06ace0 0x7f7d4c06d190 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f7d58001cb0 tx=0x7f7d58009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:06.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.259+0000 7f7d5d7fa700 1 -- 172.21.15.6:0/2740307882 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7d54053350 con 0x7f7d6014fff0 2023-07-07T04:01:06.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.674+0000 7f7d66a9c700 1 -- 172.21.15.6:0/2740307882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d40005160 con 0x7f7d6014fff0 2023-07-07T04:01:06.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.677+0000 7f7d5d7fa700 1 -- 172.21.15.6:0/2740307882 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4662 (secure 0 0 0) 0x7f7d54016090 con 0x7f7d6014fff0 2023-07-07T04:01:06.679 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:01:06.679 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/554562026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":554562026},{"type":"v1","addr":"172.21.15.40:6834","nonce":554562026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5379,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1231939681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1231939681},{"type":"v1","addr":"172.21.15.6:6835","nonce":1231939681}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5382,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2836488850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":2836488850},{"type":"v1","addr":"172.21.15.6:6837","nonce":2836488850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T20:00:18.163079+0000","modified":"2023-07-06T20:00:21.782010+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5397},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5397":{"gid":5397,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.40:6835/2106779005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":2106779005},{"type":"v1","addr":"172.21.15.40:6835","nonce":2106779005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-07T04:01:06.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.679+0000 7f7d66a9c700 1 -- 172.21.15.6:0/2740307882 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7d4c06ace0 msgr2=0x7f7d4c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:06.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.679+0000 7f7d66a9c700 1 --2- 172.21.15.6:0/2740307882 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7d4c06ace0 0x7f7d4c06d190 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f7d58001cb0 tx=0x7f7d58009030 comp rx=0 tx=0).stop 2023-07-07T04:01:06.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.679+0000 7f7d66a9c700 1 -- 172.21.15.6:0/2740307882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6014fff0 msgr2=0x7f7d60158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:06.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.679+0000 7f7d66a9c700 1 --2- 172.21.15.6:0/2740307882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6014fff0 0x7f7d60158580 secure :-1 s=READY pgs=3333 cs=0 l=1 rev1=1 crypto rx=0x7f7d480047d0 tx=0x7f7d5400b5f0 comp rx=0 tx=0).stop 2023-07-07T04:01:06.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.679+0000 7f7d66a9c700 1 -- 172.21.15.6:0/2740307882 shutdown_connections 2023-07-07T04:01:06.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.679+0000 7f7d66a9c700 1 --2- 172.21.15.6:0/2740307882 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f7d4c06ace0 0x7f7d4c06d190 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:06.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.679+0000 7f7d66a9c700 1 --2- 172.21.15.6:0/2740307882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d6014fff0 0x7f7d60158580 unknown :-1 s=CLOSED pgs=3333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:06.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.679+0000 7f7d66a9c700 1 --2- 172.21.15.6:0/2740307882 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7d48003a70 0x7f7d600cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:06.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.679+0000 7f7d66a9c700 1 --2- 172.21.15.6:0/2740307882 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7d6014fb80 0x7f7d60158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:06.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.679+0000 7f7d66a9c700 1 -- 172.21.15.6:0/2740307882 >> 172.21.15.6:0/2740307882 conn(0x7f7d600b05b0 msgr2=0x7f7d6015bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:06.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.683+0000 7f7d66a9c700 1 -- 172.21.15.6:0/2740307882 shutdown_connections 2023-07-07T04:01:06.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.687+0000 7f7d66a9c700 1 -- 172.21.15.6:0/2740307882 wait complete. 2023-07-07T04:01:06.690 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 18 2023-07-07T04:01:06.707 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T04:01:06.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.897+0000 7f33d01a5700 1 Processor -- start 2023-07-07T04:01:06.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.897+0000 7f33d01a5700 1 -- start start 2023-07-07T04:01:06.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.899+0000 7f33d01a5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33c8158a40 0x7f33c80c9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:06.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.899+0000 7f33d01a5700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f33c80cb5b0 0x7f33c8070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:06.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.899+0000 7f33d01a5700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f33c8071a90 0x7f33c8071380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:06.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.899+0000 7f33d01a5700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c8158e10 con 0x7f33c80cb5b0 2023-07-07T04:01:06.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.899+0000 7f33d01a5700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c806b110 con 0x7f33c8071a90 2023-07-07T04:01:06.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.899+0000 7f33d01a5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c806b3f0 con 0x7f33c8158a40 2023-07-07T04:01:06.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.899+0000 7f33cd740700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f33c80cb5b0 0x7f33c8070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:06.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.899+0000 7f33cdf41700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33c8158a40 0x7f33c80c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:06.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.899+0000 7f33cd740700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f33c80cb5b0 0x7f33c8070e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48060/0 (socket says 172.21.15.6:48060) 2023-07-07T04:01:06.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.899+0000 7f33cd740700 1 -- 172.21.15.6:0/2448390874 learned_addr learned my addr 172.21.15.6:0/2448390874 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:06.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.899+0000 7f33cd740700 1 -- 172.21.15.6:0/2448390874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33c8158a40 msgr2=0x7f33c80c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:06.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.899+0000 7f33cd740700 1 --2- 172.21.15.6:0/2448390874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33c8158a40 0x7f33c80c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:06.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.899+0000 7f33cd740700 1 -- 172.21.15.6:0/2448390874 >> v2:172.21.15.40:3300/0 conn(0x7f33c8071a90 msgr2=0x7f33c8071380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-07T04:01:06.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.899+0000 7f33cd740700 1 --2- 172.21.15.6:0/2448390874 >> v2:172.21.15.40:3300/0 conn(0x7f33c8071a90 0x7f33c8071380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:06.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.899+0000 7f33cd740700 1 -- 172.21.15.6:0/2448390874 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c806b6d0 con 0x7f33c80cb5b0 2023-07-07T04:01:06.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.900+0000 7f33cd740700 1 --2- 172.21.15.6:0/2448390874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33c80cb5b0 0x7f33c8070e40 secure :-1 s=READY pgs=3334 cs=0 l=1 rev1=1 crypto rx=0x7f33c8071a00 tx=0x7f33c4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e0ff8e29d34908 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:06.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.900+0000 7f33ccf3f700 1 -- 172.21.15.6:0/2448390874 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c4011830 con 0x7f33c80cb5b0 2023-07-07T04:01:06.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.901+0000 7f33ccf3f700 1 -- 172.21.15.6:0/2448390874 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c4011990 con 0x7f33c80cb5b0 2023-07-07T04:01:06.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.901+0000 7f33ccf3f700 1 -- 172.21.15.6:0/2448390874 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c4011d20 con 0x7f33c80cb5b0 2023-07-07T04:01:06.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.901+0000 7f33d01a5700 1 -- 172.21.15.6:0/2448390874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33c80cb5b0 msgr2=0x7f33c8070e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:06.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.901+0000 7f33d01a5700 1 --2- 172.21.15.6:0/2448390874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33c80cb5b0 0x7f33c8070e40 secure :-1 s=READY pgs=3334 cs=0 l=1 rev1=1 crypto rx=0x7f33c8071a00 tx=0x7f33c4009bd0 comp rx=0 tx=0).stop 2023-07-07T04:01:06.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.902+0000 7f33d01a5700 1 -- 172.21.15.6:0/2448390874 shutdown_connections 2023-07-07T04:01:06.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.902+0000 7f33d01a5700 1 --2- 172.21.15.6:0/2448390874 >> v2:172.21.15.40:3300/0 conn(0x7f33c8071a90 0x7f33c8071380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:06.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.902+0000 7f33d01a5700 1 --2- 172.21.15.6:0/2448390874 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33c8158a40 0x7f33c80c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:06.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.902+0000 7f33d01a5700 1 --2- 172.21.15.6:0/2448390874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33c80cb5b0 0x7f33c8070e40 unknown :-1 s=CLOSED pgs=3334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:06.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.902+0000 7f33d01a5700 1 -- 172.21.15.6:0/2448390874 >> 172.21.15.6:0/2448390874 conn(0x7f33c80cf0f0 msgr2=0x7f33c80cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:06.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.902+0000 7f33d01a5700 1 -- 172.21.15.6:0/2448390874 shutdown_connections 2023-07-07T04:01:06.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.902+0000 7f33d01a5700 1 -- 172.21.15.6:0/2448390874 wait complete. 2023-07-07T04:01:06.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.903+0000 7f33d01a5700 1 Processor -- start 2023-07-07T04:01:06.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.903+0000 7f33d01a5700 1 -- start start 2023-07-07T04:01:06.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.904+0000 7f33d01a5700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33c8071a90 0x7f33c8157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:06.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.904+0000 7f33d01a5700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33c80cb5b0 0x7f33c8070d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:06.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.904+0000 7f33d01a5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33c8158a40 0x7f33c8071280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:06.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.904+0000 7f33d01a5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c80c5db0 con 0x7f33c8158a40 2023-07-07T04:01:06.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.904+0000 7f33d01a5700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c80b4740 con 0x7f33c8071a90 2023-07-07T04:01:06.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.904+0000 7f33d01a5700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c8144060 con 0x7f33c80cb5b0 2023-07-07T04:01:06.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.905+0000 7f33cd740700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33c80cb5b0 0x7f33c8070d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:06.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.905+0000 7f33ce742700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33c8158a40 0x7f33c8071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:06.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.905+0000 7f33cd740700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33c80cb5b0 0x7f33c8070d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:40708/0 (socket says 172.21.15.6:40708) 2023-07-07T04:01:06.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.905+0000 7f33cd740700 1 -- 172.21.15.6:0/3644147374 learned_addr learned my addr 172.21.15.6:0/3644147374 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:06.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.905+0000 7f33cd740700 1 -- 172.21.15.6:0/3644147374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33c8071a90 msgr2=0x7f33c8157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:06.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.905+0000 7f33cd740700 1 --2- 172.21.15.6:0/3644147374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33c8071a90 0x7f33c8157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:06.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.905+0000 7f33cd740700 1 -- 172.21.15.6:0/3644147374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33c8158a40 msgr2=0x7f33c8071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:06.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.905+0000 7f33cd740700 1 --2- 172.21.15.6:0/3644147374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33c8158a40 0x7f33c8071280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:06.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.905+0000 7f33cd740700 1 -- 172.21.15.6:0/3644147374 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c4009550 con 0x7f33c80cb5b0 2023-07-07T04:01:06.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.905+0000 7f33cd740700 1 --2- 172.21.15.6:0/3644147374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33c80cb5b0 0x7f33c8070d40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f33c4000c00 tx=0x7f33c4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:06.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.906+0000 7f33be7fc700 1 -- 172.21.15.6:0/3644147374 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c4037070 con 0x7f33c80cb5b0 2023-07-07T04:01:06.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.906+0000 7f33be7fc700 1 -- 172.21.15.6:0/3644147374 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c4011d10 con 0x7f33c80cb5b0 2023-07-07T04:01:06.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.906+0000 7f33d01a5700 1 -- 172.21.15.6:0/3644147374 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c8144e30 con 0x7f33c80cb5b0 2023-07-07T04:01:06.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.906+0000 7f33d01a5700 1 -- 172.21.15.6:0/3644147374 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c80b4c70 con 0x7f33c80cb5b0 2023-07-07T04:01:06.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.907+0000 7f33be7fc700 1 -- 172.21.15.6:0/3644147374 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c40042a0 con 0x7f33c80cb5b0 2023-07-07T04:01:06.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.908+0000 7f33be7fc700 1 -- 172.21.15.6:0/3644147374 <== mon.2 v2:172.21.15.40:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f33c4004480 con 0x7f33c80cb5b0 2023-07-07T04:01:06.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.908+0000 7f33be7fc700 1 --2- 172.21.15.6:0/3644147374 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f33ac06ace0 0x7f33ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:06.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.909+0000 7f33be7fc700 1 -- 172.21.15.6:0/3644147374 <== mon.2 v2:172.21.15.40:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f33c409b4a0 con 0x7f33c80cb5b0 2023-07-07T04:01:06.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.909+0000 7f33cdf41700 1 --2- 172.21.15.6:0/3644147374 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f33ac06ace0 0x7f33ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:06.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.910+0000 7f33cdf41700 1 --2- 172.21.15.6:0/3644147374 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f33ac06ace0 0x7f33ac06d190 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f33b8006b20 tx=0x7f33b8006ab0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:06.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.911+0000 7f33d01a5700 1 -- 172.21.15.6:0/3644147374 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b00052f0 con 0x7f33c80cb5b0 2023-07-07T04:01:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:06.919+0000 7f33be7fc700 1 -- 172.21.15.6:0/3644147374 <== mon.2 v2:172.21.15.40:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f33c40665a0 con 0x7f33c80cb5b0 2023-07-07T04:01:07.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.255+0000 7f33d01a5700 1 -- 172.21.15.6:0/3644147374 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33b0005870 con 0x7f33c80cb5b0 2023-07-07T04:01:07.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.257+0000 7f33be7fc700 1 -- 172.21.15.6:0/3644147374 <== mon.2 v2:172.21.15.40:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18496 (secure 0 0 0) 0x7f33c4015020 con 0x7f33c80cb5b0 2023-07-07T04:01:07.264 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:01:07.264 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":43,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T20:00:34.816976+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-06T20:00:16.527659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-06T20:00:17.129118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T04:01:07.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.265+0000 7f33d01a5700 1 -- 172.21.15.6:0/3644147374 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f33ac06ace0 msgr2=0x7f33ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:07.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.265+0000 7f33d01a5700 1 --2- 172.21.15.6:0/3644147374 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f33ac06ace0 0x7f33ac06d190 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f33b8006b20 tx=0x7f33b8006ab0 comp rx=0 tx=0).stop 2023-07-07T04:01:07.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.265+0000 7f33d01a5700 1 -- 172.21.15.6:0/3644147374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33c80cb5b0 msgr2=0x7f33c8070d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:07.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.265+0000 7f33d01a5700 1 --2- 172.21.15.6:0/3644147374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33c80cb5b0 0x7f33c8070d40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f33c4000c00 tx=0x7f33c4004750 comp rx=0 tx=0).stop 2023-07-07T04:01:07.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.265+0000 7f33d01a5700 1 -- 172.21.15.6:0/3644147374 shutdown_connections 2023-07-07T04:01:07.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.265+0000 7f33d01a5700 1 --2- 172.21.15.6:0/3644147374 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f33ac06ace0 0x7f33ac06d190 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:07.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.265+0000 7f33d01a5700 1 --2- 172.21.15.6:0/3644147374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33c8158a40 0x7f33c8071280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:07.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.265+0000 7f33d01a5700 1 --2- 172.21.15.6:0/3644147374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f33c8071a90 0x7f33c8157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:07.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.265+0000 7f33d01a5700 1 --2- 172.21.15.6:0/3644147374 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f33c80cb5b0 0x7f33c8070d40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:07.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.265+0000 7f33d01a5700 1 -- 172.21.15.6:0/3644147374 >> 172.21.15.6:0/3644147374 conn(0x7f33c80cf0f0 msgr2=0x7f33c80c9990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:07.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.265+0000 7f33d01a5700 1 -- 172.21.15.6:0/3644147374 shutdown_connections 2023-07-07T04:01:07.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.266+0000 7f33d01a5700 1 -- 172.21.15.6:0/3644147374 wait complete. 2023-07-07T04:01:07.299 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-07T04:01:07.300 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-07T04:01:07.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.492+0000 7f50765c2700 1 Processor -- start 2023-07-07T04:01:07.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.492+0000 7f50765c2700 1 -- start start 2023-07-07T04:01:07.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.493+0000 7f50765c2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50701642f0 0x7f50700adbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:07.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.493+0000 7f50765c2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50700ae100 0x7f5070070650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:07.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.493+0000 7f50765c2700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5070157c30 con 0x7f5070157860 2023-07-07T04:01:07.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.493+0000 7f50765c2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5070160d00 con 0x7f50701642f0 2023-07-07T04:01:07.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.493+0000 7f50765c2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5070164780 con 0x7f50700ae100 2023-07-07T04:01:07.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.493+0000 7f506f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50701642f0 0x7f50700adbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:07.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.493+0000 7f506ffff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f5070157860 0x7f507006cbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49280/0 (socket says 172.21.15.6:49280) 2023-07-07T04:01:07.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.493+0000 7f506ffff700 1 -- 172.21.15.6:0/4232637670 learned_addr learned my addr 172.21.15.6:0/4232637670 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:01:07.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.493+0000 7f506f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f50701642f0 0x7f50700adbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48074/0 (socket says 172.21.15.6:48074) 2023-07-07T04:01:07.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.493+0000 7f5074b5f700 1 --2- 172.21.15.6:0/4232637670 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50700ae100 0x7f5070070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:07.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.494+0000 7f506f7fe700 1 -- 172.21.15.6:0/4232637670 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50700ae100 msgr2=0x7f5070070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:07.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.494+0000 7f506f7fe700 1 --2- 172.21.15.6:0/4232637670 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50700ae100 0x7f5070070650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:07.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.494+0000 7f506f7fe700 1 -- 172.21.15.6:0/4232637670 >> v1:172.21.15.6:6789/0 conn(0x7f5070157860 legacy=0x7f507006cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:07.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.494+0000 7f506f7fe700 1 -- 172.21.15.6:0/4232637670 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5070164a60 con 0x7f50701642f0 2023-07-07T04:01:07.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.494+0000 7f506effd700 1 -- 172.21.15.6:0/4232637670 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957261252 0 0) 0x7f5070157c30 con 0x7f5070157860 2023-07-07T04:01:07.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.494+0000 7f506f7fe700 1 --2- 172.21.15.6:0/4232637670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50701642f0 0x7f50700adbc0 secure :-1 s=READY pgs=3336 cs=0 l=1 rev1=1 crypto rx=0x7f5064009840 tx=0x7f5064009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f1a70ece58b36f server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:07.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.494+0000 7f506effd700 1 -- 172.21.15.6:0/4232637670 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064011830 con 0x7f50701642f0 2023-07-07T04:01:07.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.494+0000 7f506effd700 1 -- 172.21.15.6:0/4232637670 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5064011990 con 0x7f50701642f0 2023-07-07T04:01:07.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.494+0000 7f506effd700 1 -- 172.21.15.6:0/4232637670 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064011d20 con 0x7f50701642f0 2023-07-07T04:01:07.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.495+0000 7f50765c2700 1 -- 172.21.15.6:0/4232637670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50701642f0 msgr2=0x7f50700adbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:07.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.495+0000 7f50765c2700 1 --2- 172.21.15.6:0/4232637670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50701642f0 0x7f50700adbc0 secure :-1 s=READY pgs=3336 cs=0 l=1 rev1=1 crypto rx=0x7f5064009840 tx=0x7f5064009b50 comp rx=0 tx=0).stop 2023-07-07T04:01:07.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.495+0000 7f50765c2700 1 -- 172.21.15.6:0/4232637670 shutdown_connections 2023-07-07T04:01:07.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.495+0000 7f50765c2700 1 --2- 172.21.15.6:0/4232637670 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50700ae100 0x7f5070070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.495+0000 7f50765c2700 1 --2- 172.21.15.6:0/4232637670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50701642f0 0x7f50700adbc0 unknown :-1 s=CLOSED pgs=3336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.495+0000 7f50765c2700 1 -- 172.21.15.6:0/4232637670 >> 172.21.15.6:0/4232637670 conn(0x7f50700b05b0 msgr2=0x7f50700b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.495+0000 7f50765c2700 1 -- 172.21.15.6:0/4232637670 shutdown_connections 2023-07-07T04:01:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.495+0000 7f50765c2700 1 -- 172.21.15.6:0/4232637670 wait complete. 2023-07-07T04:01:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.496+0000 7f50765c2700 1 Processor -- start 2023-07-07T04:01:07.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.497+0000 7f50765c2700 1 -- start start 2023-07-07T04:01:07.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.498+0000 7f50765c2700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50700ae100 0x7f50701ecbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:07.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.498+0000 7f50765c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5070157860 0x7f50701560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:07.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.498+0000 7f50765c2700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50701642f0 0x7f507006a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:07.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.498+0000 7f50765c2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50701ea630 con 0x7f5070157860 2023-07-07T04:01:07.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.498+0000 7f50765c2700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50701ea910 con 0x7f50701642f0 2023-07-07T04:01:07.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.498+0000 7f50765c2700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50701eabf0 con 0x7f50700ae100 2023-07-07T04:01:07.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.498+0000 7f506f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5070157860 0x7f50701560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:07.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.498+0000 7f506ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50700ae100 0x7f50701ecbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:07.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.498+0000 7f506ffff700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50700ae100 0x7f50701ecbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:40722/0 (socket says 172.21.15.6:40722) 2023-07-07T04:01:07.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.498+0000 7f506f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5070157860 0x7f50701560c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48080/0 (socket says 172.21.15.6:48080) 2023-07-07T04:01:07.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.498+0000 7f506ffff700 1 -- 172.21.15.6:0/3896134589 learned_addr learned my addr 172.21.15.6:0/3896134589 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:07.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.498+0000 7f506f7fe700 1 -- 172.21.15.6:0/3896134589 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50700ae100 msgr2=0x7f50701ecbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:07.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.498+0000 7f506f7fe700 1 --2- 172.21.15.6:0/3896134589 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50700ae100 0x7f50701ecbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:07.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.498+0000 7f506f7fe700 1 -- 172.21.15.6:0/3896134589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50701642f0 msgr2=0x7f507006a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:07.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.498+0000 7f506f7fe700 1 --2- 172.21.15.6:0/3896134589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50701642f0 0x7f507006a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:07.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.498+0000 7f506f7fe700 1 -- 172.21.15.6:0/3896134589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50640094a0 con 0x7f5070157860 2023-07-07T04:01:07.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.499+0000 7f506f7fe700 1 --2- 172.21.15.6:0/3896134589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5070157860 0x7f50701560c0 secure :-1 s=READY pgs=3337 cs=0 l=1 rev1=1 crypto rx=0x7f5064016000 tx=0x7f5064004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:07.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.499+0000 7f506cff9700 1 -- 172.21.15.6:0/3896134589 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50640045c0 con 0x7f5070157860 2023-07-07T04:01:07.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.499+0000 7f506cff9700 1 -- 172.21.15.6:0/3896134589 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506401e070 con 0x7f5070157860 2023-07-07T04:01:07.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.499+0000 7f506cff9700 1 -- 172.21.15.6:0/3896134589 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50640038e0 con 0x7f5070157860 2023-07-07T04:01:07.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.499+0000 7f50765c2700 1 -- 172.21.15.6:0/3896134589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50701eaed0 con 0x7f5070157860 2023-07-07T04:01:07.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.499+0000 7f50765c2700 1 -- 172.21.15.6:0/3896134589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5070156ac0 con 0x7f5070157860 2023-07-07T04:01:07.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.501+0000 7f506cff9700 1 -- 172.21.15.6:0/3896134589 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5064003a40 con 0x7f5070157860 2023-07-07T04:01:07.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.501+0000 7f506cff9700 1 --2- 172.21.15.6:0/3896134589 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f505c06ace0 0x7f505c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:07.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.501+0000 7f506cff9700 1 -- 172.21.15.6:0/3896134589 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f506408a520 con 0x7f5070157860 2023-07-07T04:01:07.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.501+0000 7f506ffff700 1 --2- 172.21.15.6:0/3896134589 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f505c06ace0 0x7f505c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:07.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.502+0000 7f506ffff700 1 --2- 172.21.15.6:0/3896134589 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f505c06ace0 0x7f505c06d190 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5060000f60 tx=0x7f5060007ea0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:07.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.505+0000 7f50765c2700 1 -- 172.21.15.6:0/3896134589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50701eb3f0 con 0x7f5070157860 2023-07-07T04:01:07.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.515+0000 7f506cff9700 1 -- 172.21.15.6:0/3896134589 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f50701eb3f0 con 0x7f5070157860 2023-07-07T04:01:07.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.933+0000 7f50765c2700 1 -- 172.21.15.6:0/3896134589 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50701eb3f0 con 0x7f5070157860 2023-07-07T04:01:07.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.935+0000 7f506cff9700 1 -- 172.21.15.6:0/3896134589 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4662 (secure 0 0 0) 0x7f50701eb3f0 con 0x7f5070157860 2023-07-07T04:01:07.941 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:01:07.941 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/554562026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":554562026},{"type":"v1","addr":"172.21.15.40:6834","nonce":554562026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5379,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1231939681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1231939681},{"type":"v1","addr":"172.21.15.6:6835","nonce":1231939681}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5382,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2836488850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":2836488850},{"type":"v1","addr":"172.21.15.6:6837","nonce":2836488850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T20:00:18.163079+0000","modified":"2023-07-06T20:00:21.782010+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5397},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5397":{"gid":5397,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.40:6835/2106779005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":2106779005},{"type":"v1","addr":"172.21.15.40:6835","nonce":2106779005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-07T04:01:07.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.943+0000 7f50765c2700 1 -- 172.21.15.6:0/3896134589 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f505c06ace0 msgr2=0x7f505c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:07.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.943+0000 7f50765c2700 1 --2- 172.21.15.6:0/3896134589 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f505c06ace0 0x7f505c06d190 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5060000f60 tx=0x7f5060007ea0 comp rx=0 tx=0).stop 2023-07-07T04:01:07.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.943+0000 7f50765c2700 1 -- 172.21.15.6:0/3896134589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5070157860 msgr2=0x7f50701560c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:07.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.943+0000 7f50765c2700 1 --2- 172.21.15.6:0/3896134589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5070157860 0x7f50701560c0 secure :-1 s=READY pgs=3337 cs=0 l=1 rev1=1 crypto rx=0x7f5064016000 tx=0x7f5064004750 comp rx=0 tx=0).stop 2023-07-07T04:01:07.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.947+0000 7f50765c2700 1 -- 172.21.15.6:0/3896134589 shutdown_connections 2023-07-07T04:01:07.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.947+0000 7f50765c2700 1 --2- 172.21.15.6:0/3896134589 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f505c06ace0 0x7f505c06d190 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:07.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.947+0000 7f50765c2700 1 --2- 172.21.15.6:0/3896134589 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50701642f0 0x7f507006a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:07.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.947+0000 7f50765c2700 1 --2- 172.21.15.6:0/3896134589 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f50700ae100 0x7f50701ecbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:07.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.947+0000 7f50765c2700 1 --2- 172.21.15.6:0/3896134589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5070157860 0x7f50701560c0 unknown :-1 s=CLOSED pgs=3337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:07.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.947+0000 7f50765c2700 1 -- 172.21.15.6:0/3896134589 >> 172.21.15.6:0/3896134589 conn(0x7f50700b05b0 msgr2=0x7f50700b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:07.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.958+0000 7f50765c2700 1 -- 172.21.15.6:0/3896134589 shutdown_connections 2023-07-07T04:01:07.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:07.958+0000 7f50765c2700 1 -- 172.21.15.6:0/3896134589 wait complete. 2023-07-07T04:01:07.963 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 18 2023-07-07T04:01:07.982 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-07T04:01:08.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.187+0000 7fbd284fe700 1 Processor -- start 2023-07-07T04:01:08.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.187+0000 7fbd284fe700 1 -- start start 2023-07-07T04:01:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.188+0000 7fbd284fe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbd20070e40 0x7fbd200712e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.188+0000 7fbd284fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbd200cd840 0x7fbd200cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.188+0000 7fbd284fe700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd200c2a40 con 0x7fbd200c2670 2023-07-07T04:01:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.188+0000 7fbd284fe700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd20071820 con 0x7fbd200cd840 2023-07-07T04:01:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.188+0000 7fbd284fe700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2006a770 con 0x7fbd20070e40 2023-07-07T04:01:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.189+0000 7fbd26a9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbd200cd840 0x7fbd200cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:08.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.189+0000 7fbd26a9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbd200cd840 0x7fbd200cdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48090/0 (socket says 172.21.15.6:48090) 2023-07-07T04:01:08.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.189+0000 7fbd26a9b700 1 -- 172.21.15.6:0/2340464458 learned_addr learned my addr 172.21.15.6:0/2340464458 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:08.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.189+0000 7fbd25a99700 1 --2- 172.21.15.6:0/2340464458 >> v2:172.21.15.40:3300/0 conn(0x7fbd20070e40 0x7fbd200712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:08.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.189+0000 7fbd26a9b700 1 -- 172.21.15.6:0/2340464458 >> v2:172.21.15.40:3300/0 conn(0x7fbd20070e40 msgr2=0x7fbd200712e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:08.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.189+0000 7fbd26a9b700 1 --2- 172.21.15.6:0/2340464458 >> v2:172.21.15.40:3300/0 conn(0x7fbd20070e40 0x7fbd200712e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:08.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.189+0000 7fbd26a9b700 1 -- 172.21.15.6:0/2340464458 >> v1:172.21.15.6:6789/0 conn(0x7fbd200c2670 legacy=0x7fbd2006a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:08.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.189+0000 7fbd26a9b700 1 -- 172.21.15.6:0/2340464458 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2006ee60 con 0x7fbd200cd840 2023-07-07T04:01:08.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.189+0000 7fbd26a9b700 1 --2- 172.21.15.6:0/2340464458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd200cd840 0x7fbd200cdc60 secure :-1 s=READY pgs=3339 cs=0 l=1 rev1=1 crypto rx=0x7fbd200732b0 tx=0x7fbd1800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aeb3af3c72b5acd server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:08.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.190+0000 7fbd25298700 1 -- 172.21.15.6:0/2340464458 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1800e070 con 0x7fbd200cd840 2023-07-07T04:01:08.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.190+0000 7fbd25298700 1 -- 172.21.15.6:0/2340464458 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1800b910 con 0x7fbd200cd840 2023-07-07T04:01:08.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.190+0000 7fbd25298700 1 -- 172.21.15.6:0/2340464458 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1800bcc0 con 0x7fbd200cd840 2023-07-07T04:01:08.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.191+0000 7fbd284fe700 1 -- 172.21.15.6:0/2340464458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd200cd840 msgr2=0x7fbd200cdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:08.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.191+0000 7fbd284fe700 1 --2- 172.21.15.6:0/2340464458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd200cd840 0x7fbd200cdc60 secure :-1 s=READY pgs=3339 cs=0 l=1 rev1=1 crypto rx=0x7fbd200732b0 tx=0x7fbd1800b330 comp rx=0 tx=0).stop 2023-07-07T04:01:08.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.198+0000 7fbd284fe700 1 -- 172.21.15.6:0/2340464458 shutdown_connections 2023-07-07T04:01:08.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.198+0000 7fbd284fe700 1 --2- 172.21.15.6:0/2340464458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd200cd840 0x7fbd200cdc60 unknown :-1 s=CLOSED pgs=3339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:08.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.198+0000 7fbd284fe700 1 --2- 172.21.15.6:0/2340464458 >> v2:172.21.15.40:3300/0 conn(0x7fbd20070e40 0x7fbd200712e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:08.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.198+0000 7fbd284fe700 1 -- 172.21.15.6:0/2340464458 >> 172.21.15.6:0/2340464458 conn(0x7fbd200cf0f0 msgr2=0x7fbd200cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:08.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.211+0000 7fbd284fe700 1 -- 172.21.15.6:0/2340464458 shutdown_connections 2023-07-07T04:01:08.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.211+0000 7fbd284fe700 1 -- 172.21.15.6:0/2340464458 wait complete. 2023-07-07T04:01:08.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.212+0000 7fbd284fe700 1 Processor -- start 2023-07-07T04:01:08.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.212+0000 7fbd284fe700 1 -- start start 2023-07-07T04:01:08.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.213+0000 7fbd284fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd20070e40 0x7fbd20147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:08.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.213+0000 7fbd284fe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd200c2670 0x7fbd200c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:08.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.213+0000 7fbd284fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd200cd840 0x7fbd200c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:08.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.213+0000 7fbd284fe700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd200c67b0 con 0x7fbd20070e40 2023-07-07T04:01:08.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.213+0000 7fbd284fe700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd200c9450 con 0x7fbd200cd840 2023-07-07T04:01:08.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.213+0000 7fbd284fe700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd200c8bb0 con 0x7fbd200c2670 2023-07-07T04:01:08.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.213+0000 7fbd2629a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd20070e40 0x7fbd20147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:08.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.213+0000 7fbd2629a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd20070e40 0x7fbd20147630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48092/0 (socket says 172.21.15.6:48092) 2023-07-07T04:01:08.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.213+0000 7fbd2629a700 1 -- 172.21.15.6:0/1253865367 learned_addr learned my addr 172.21.15.6:0/1253865367 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:08.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.214+0000 7fbd26a9b700 1 --2- 172.21.15.6:0/1253865367 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd200cd840 0x7fbd200c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:08.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.214+0000 7fbd2629a700 1 -- 172.21.15.6:0/1253865367 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd200c2670 msgr2=0x7fbd200c6c40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-07T04:01:08.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.214+0000 7fbd2629a700 1 --2- 172.21.15.6:0/1253865367 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd200c2670 0x7fbd200c6c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:08.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.214+0000 7fbd2629a700 1 -- 172.21.15.6:0/1253865367 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd200cd840 msgr2=0x7fbd200c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:08.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.214+0000 7fbd2629a700 1 --2- 172.21.15.6:0/1253865367 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd200cd840 0x7fbd200c4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:08.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.214+0000 7fbd2629a700 1 -- 172.21.15.6:0/1253865367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd18009b30 con 0x7fbd20070e40 2023-07-07T04:01:08.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.214+0000 7fbd2629a700 1 --2- 172.21.15.6:0/1253865367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd20070e40 0x7fbd20147630 secure :-1 s=READY pgs=3340 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400c490 tx=0x7fbd1400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:08.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.214+0000 7fbd12ffd700 1 -- 172.21.15.6:0/1253865367 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd140052d0 con 0x7fbd20070e40 2023-07-07T04:01:08.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.214+0000 7fbd12ffd700 1 -- 172.21.15.6:0/1253865367 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd14005430 con 0x7fbd20070e40 2023-07-07T04:01:08.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.214+0000 7fbd284fe700 1 -- 172.21.15.6:0/1253865367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd200c8e90 con 0x7fbd20070e40 2023-07-07T04:01:08.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.214+0000 7fbd12ffd700 1 -- 172.21.15.6:0/1253865367 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd14006aa0 con 0x7fbd20070e40 2023-07-07T04:01:08.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.214+0000 7fbd284fe700 1 -- 172.21.15.6:0/1253865367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd200c87d0 con 0x7fbd20070e40 2023-07-07T04:01:08.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.216+0000 7fbd284fe700 1 -- 172.21.15.6:0/1253865367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd20067720 con 0x7fbd20070e40 2023-07-07T04:01:08.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.218+0000 7fbd12ffd700 1 -- 172.21.15.6:0/1253865367 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbd14003680 con 0x7fbd20070e40 2023-07-07T04:01:08.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.219+0000 7fbd12ffd700 1 --2- 172.21.15.6:0/1253865367 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbd0406acb0 0x7fbd0406d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:08.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.219+0000 7fbd12ffd700 1 -- 172.21.15.6:0/1253865367 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fbd14088d10 con 0x7fbd20070e40 2023-07-07T04:01:08.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.223+0000 7fbd12ffd700 1 -- 172.21.15.6:0/1253865367 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbd14053d30 con 0x7fbd20070e40 2023-07-07T04:01:08.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.226+0000 7fbd25a99700 1 --2- 172.21.15.6:0/1253865367 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbd0406acb0 0x7fbd0406d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:08.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.226+0000 7fbd25a99700 1 --2- 172.21.15.6:0/1253865367 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbd0406acb0 0x7fbd0406d160 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fbd2014a150 tx=0x7fbd1c009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:08.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.621+0000 7fbd284fe700 1 -- 172.21.15.6:0/1253865367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd200c6a90 con 0x7fbd20070e40 2023-07-07T04:01:08.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.622+0000 7fbd12ffd700 1 -- 172.21.15.6:0/1253865367 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4662 (secure 0 0 0) 0x7fbd14057350 con 0x7fbd20070e40 2023-07-07T04:01:08.624 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:01:08.625 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/554562026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":554562026},{"type":"v1","addr":"172.21.15.40:6834","nonce":554562026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5379,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1231939681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1231939681},{"type":"v1","addr":"172.21.15.6:6835","nonce":1231939681}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5382,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2836488850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":2836488850},{"type":"v1","addr":"172.21.15.6:6837","nonce":2836488850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-06T20:00:18.163079+0000","modified":"2023-07-06T20:00:21.782010+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5397},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5397":{"gid":5397,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.40:6835/2106779005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":2106779005},{"type":"v1","addr":"172.21.15.40:6835","nonce":2106779005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-07T04:01:08.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.626+0000 7fbd284fe700 1 -- 172.21.15.6:0/1253865367 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbd0406acb0 msgr2=0x7fbd0406d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:08.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.626+0000 7fbd284fe700 1 --2- 172.21.15.6:0/1253865367 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbd0406acb0 0x7fbd0406d160 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fbd2014a150 tx=0x7fbd1c009210 comp rx=0 tx=0).stop 2023-07-07T04:01:08.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.626+0000 7fbd284fe700 1 -- 172.21.15.6:0/1253865367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd20070e40 msgr2=0x7fbd20147630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:08.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.626+0000 7fbd284fe700 1 --2- 172.21.15.6:0/1253865367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd20070e40 0x7fbd20147630 secure :-1 s=READY pgs=3340 cs=0 l=1 rev1=1 crypto rx=0x7fbd1400c490 tx=0x7fbd1400c7a0 comp rx=0 tx=0).stop 2023-07-07T04:01:08.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.629+0000 7fbd284fe700 1 -- 172.21.15.6:0/1253865367 shutdown_connections 2023-07-07T04:01:08.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.629+0000 7fbd284fe700 1 --2- 172.21.15.6:0/1253865367 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbd0406acb0 0x7fbd0406d160 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:08.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.629+0000 7fbd284fe700 1 --2- 172.21.15.6:0/1253865367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd20070e40 0x7fbd20147630 unknown :-1 s=CLOSED pgs=3340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:08.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.629+0000 7fbd284fe700 1 --2- 172.21.15.6:0/1253865367 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbd200cd840 0x7fbd200c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:08.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.629+0000 7fbd284fe700 1 --2- 172.21.15.6:0/1253865367 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbd200c2670 0x7fbd200c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:08.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.629+0000 7fbd284fe700 1 -- 172.21.15.6:0/1253865367 >> 172.21.15.6:0/1253865367 conn(0x7fbd200cf0f0 msgr2=0x7fbd200c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:08.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.635+0000 7fbd284fe700 1 -- 172.21.15.6:0/1253865367 shutdown_connections 2023-07-07T04:01:08.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.639+0000 7fbd284fe700 1 -- 172.21.15.6:0/1253865367 wait complete. 2023-07-07T04:01:08.641 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 18 2023-07-07T04:01:08.658 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T04:01:08.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.858+0000 7fb252ff7700 1 Processor -- start 2023-07-07T04:01:08.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.858+0000 7fb252ff7700 1 -- start start 2023-07-07T04:01:08.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.859+0000 7fb252ff7700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb24c15c430 0x7fb24c070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:08.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.859+0000 7fb252ff7700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb24c15c800 con 0x7fb24c06ef30 2023-07-07T04:01:08.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.859+0000 7fb252ff7700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb24c15d820 con 0x7fb24c15d1c0 2023-07-07T04:01:08.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.860+0000 7fb252ff7700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb24c06e170 con 0x7fb24c15c430 2023-07-07T04:01:08.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.860+0000 7fb24bfff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb24c06ef30 0x7fb24c15cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49308/0 (socket says 172.21.15.6:49308) 2023-07-07T04:01:08.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.860+0000 7fb24bfff700 1 -- 172.21.15.6:0/551426863 learned_addr learned my addr 172.21.15.6:0/551426863 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:01:08.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.860+0000 7fb250d93700 1 --2- 172.21.15.6:0/551426863 >> v2:172.21.15.6:3300/0 conn(0x7fb24c15c430 0x7fb24c070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:08.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.860+0000 7fb24b7fe700 1 -- 172.21.15.6:0/551426863 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468319252 0 0) 0x7fb24c15c800 con 0x7fb24c06ef30 2023-07-07T04:01:08.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.860+0000 7fb24b7fe700 1 -- 172.21.15.6:0/551426863 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb23c0035b0 con 0x7fb24c06ef30 2023-07-07T04:01:08.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.861+0000 7fb24b7fe700 1 -- 172.21.15.6:0/551426863 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2386403524 0 0) 0x7fb23c0035b0 con 0x7fb24c06ef30 2023-07-07T04:01:08.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.861+0000 7fb250d93700 1 -- 172.21.15.6:0/551426863 >> v1:172.21.15.40:6789/0 conn(0x7fb24c15d1c0 legacy=0x7fb24c0cccc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-07T04:01:08.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.861+0000 7fb250d93700 1 -- 172.21.15.6:0/551426863 >> v1:172.21.15.6:6789/0 conn(0x7fb24c06ef30 legacy=0x7fb24c15cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:08.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.861+0000 7fb250d93700 1 -- 172.21.15.6:0/551426863 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c06e450 con 0x7fb24c15c430 2023-07-07T04:01:08.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.861+0000 7fb250d93700 1 --2- 172.21.15.6:0/551426863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb24c15c430 0x7fb24c070e40 secure :-1 s=READY pgs=3342 cs=0 l=1 rev1=1 crypto rx=0x7fb240009840 tx=0x7fb240009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c54a7a5425978a server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:08.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.863+0000 7fb24b7fe700 1 -- 172.21.15.6:0/551426863 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb238001670 con 0x7fb24c15c430 2023-07-07T04:01:08.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.863+0000 7fb24b7fe700 1 -- 172.21.15.6:0/551426863 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb240004030 con 0x7fb24c15c430 2023-07-07T04:01:08.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.863+0000 7fb24b7fe700 1 -- 172.21.15.6:0/551426863 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2400043c0 con 0x7fb24c15c430 2023-07-07T04:01:08.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.864+0000 7fb252ff7700 1 -- 172.21.15.6:0/551426863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb24c15c430 msgr2=0x7fb24c070e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:08.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.864+0000 7fb252ff7700 1 --2- 172.21.15.6:0/551426863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb24c15c430 0x7fb24c070e40 secure :-1 s=READY pgs=3342 cs=0 l=1 rev1=1 crypto rx=0x7fb240009840 tx=0x7fb240009b50 comp rx=0 tx=0).stop 2023-07-07T04:01:08.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.868+0000 7fb252ff7700 1 -- 172.21.15.6:0/551426863 shutdown_connections 2023-07-07T04:01:08.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.868+0000 7fb252ff7700 1 --2- 172.21.15.6:0/551426863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb24c15c430 0x7fb24c070e40 unknown :-1 s=CLOSED pgs=3342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:08.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.868+0000 7fb252ff7700 1 -- 172.21.15.6:0/551426863 >> 172.21.15.6:0/551426863 conn(0x7fb24c0cf0f0 msgr2=0x7fb24c0cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:08.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.868+0000 7fb252ff7700 1 -- 172.21.15.6:0/551426863 shutdown_connections 2023-07-07T04:01:08.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.868+0000 7fb252ff7700 1 -- 172.21.15.6:0/551426863 wait complete. 2023-07-07T04:01:08.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.870+0000 7fb252ff7700 1 Processor -- start 2023-07-07T04:01:08.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.870+0000 7fb252ff7700 1 -- start start 2023-07-07T04:01:08.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.872+0000 7fb252ff7700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb24c06ef30 0x7fb24c1513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:08.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.872+0000 7fb252ff7700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb24c15c430 0x7fb24c0ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:08.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.872+0000 7fb252ff7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb24c15d1c0 0x7fb24c0b4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:08.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.872+0000 7fb252ff7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c0ad680 con 0x7fb24c15d1c0 2023-07-07T04:01:08.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.872+0000 7fb252ff7700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c0ac810 con 0x7fb24c06ef30 2023-07-07T04:01:08.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.872+0000 7fb252ff7700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c0b4540 con 0x7fb24c15c430 2023-07-07T04:01:08.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.872+0000 7fb251594700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb24c15d1c0 0x7fb24c0b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:08.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.872+0000 7fb251594700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb24c15d1c0 0x7fb24c0b4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48108/0 (socket says 172.21.15.6:48108) 2023-07-07T04:01:08.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.872+0000 7fb251594700 1 -- 172.21.15.6:0/3663789295 learned_addr learned my addr 172.21.15.6:0/3663789295 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:08.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.872+0000 7fb250d93700 1 --2- 172.21.15.6:0/3663789295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb24c06ef30 0x7fb24c1513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:08.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.873+0000 7fb251594700 1 -- 172.21.15.6:0/3663789295 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb24c15c430 msgr2=0x7fb24c0ac2d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-07T04:01:08.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.873+0000 7fb251594700 1 --2- 172.21.15.6:0/3663789295 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb24c15c430 0x7fb24c0ac2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:08.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.873+0000 7fb251594700 1 -- 172.21.15.6:0/3663789295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb24c06ef30 msgr2=0x7fb24c1513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:08.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.873+0000 7fb251594700 1 --2- 172.21.15.6:0/3663789295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb24c06ef30 0x7fb24c1513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:08.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.873+0000 7fb251594700 1 -- 172.21.15.6:0/3663789295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2400094a0 con 0x7fb24c15d1c0 2023-07-07T04:01:08.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.873+0000 7fb250d93700 1 --2- 172.21.15.6:0/3663789295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb24c06ef30 0x7fb24c1513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T04:01:08.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.873+0000 7fb251594700 1 --2- 172.21.15.6:0/3663789295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb24c15d1c0 0x7fb24c0b4000 secure :-1 s=READY pgs=3343 cs=0 l=1 rev1=1 crypto rx=0x7fb24400b990 tx=0x7fb24400bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:08.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.873+0000 7fb2497fa700 1 -- 172.21.15.6:0/3663789295 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24400c930 con 0x7fb24c15d1c0 2023-07-07T04:01:08.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.873+0000 7fb2497fa700 1 -- 172.21.15.6:0/3663789295 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24400ca90 con 0x7fb24c15d1c0 2023-07-07T04:01:08.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.873+0000 7fb2497fa700 1 -- 172.21.15.6:0/3663789295 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24400ce40 con 0x7fb24c15d1c0 2023-07-07T04:01:08.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.873+0000 7fb252ff7700 1 -- 172.21.15.6:0/3663789295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb24c0aca00 con 0x7fb24c15d1c0 2023-07-07T04:01:08.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.874+0000 7fb252ff7700 1 -- 172.21.15.6:0/3663789295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb24c0acfc0 con 0x7fb24c15d1c0 2023-07-07T04:01:08.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.875+0000 7fb252ff7700 1 -- 172.21.15.6:0/3663789295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb24c0ad7c0 con 0x7fb24c15d1c0 2023-07-07T04:01:08.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.876+0000 7fb2497fa700 1 -- 172.21.15.6:0/3663789295 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb244006d50 con 0x7fb24c15d1c0 2023-07-07T04:01:08.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.877+0000 7fb2497fa700 1 --2- 172.21.15.6:0/3663789295 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb23006ace0 0x7fb23006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:08.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.877+0000 7fb2497fa700 1 -- 172.21.15.6:0/3663789295 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fb2440890d0 con 0x7fb24c15d1c0 2023-07-07T04:01:08.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.882+0000 7fb250d93700 1 --2- 172.21.15.6:0/3663789295 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb23006ace0 0x7fb23006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:08.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.882+0000 7fb250d93700 1 --2- 172.21.15.6:0/3663789295 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb23006ace0 0x7fb23006d190 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb24000a010 tx=0x7fb24001c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:08.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:08.889+0000 7fb2497fa700 1 -- 172.21.15.6:0/3663789295 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb24c0ad7c0 con 0x7fb24c15d1c0 2023-07-07T04:01:09.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.220+0000 7fb252ff7700 1 -- 172.21.15.6:0/3663789295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb24c0ad7c0 con 0x7fb24c15d1c0 2023-07-07T04:01:09.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.222+0000 7fb2497fa700 1 -- 172.21.15.6:0/3663789295 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18496 (secure 0 0 0) 0x7fb24c0ad7c0 con 0x7fb24c15d1c0 2023-07-07T04:01:09.224 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:01:09.225 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":43,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-06T20:00:34.816976+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-06T20:00:16.527659+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-06T20:00:17.129118+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.13","mappings":[{"from":0,"to":4}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T04:01:09.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.227+0000 7fb252ff7700 1 -- 172.21.15.6:0/3663789295 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb23006ace0 msgr2=0x7fb23006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:09.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.227+0000 7fb252ff7700 1 --2- 172.21.15.6:0/3663789295 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb23006ace0 0x7fb23006d190 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb24000a010 tx=0x7fb24001c040 comp rx=0 tx=0).stop 2023-07-07T04:01:09.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.227+0000 7fb252ff7700 1 -- 172.21.15.6:0/3663789295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb24c15d1c0 msgr2=0x7fb24c0b4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:09.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.227+0000 7fb252ff7700 1 --2- 172.21.15.6:0/3663789295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb24c15d1c0 0x7fb24c0b4000 secure :-1 s=READY pgs=3343 cs=0 l=1 rev1=1 crypto rx=0x7fb24400b990 tx=0x7fb24400bca0 comp rx=0 tx=0).stop 2023-07-07T04:01:09.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.231+0000 7fb252ff7700 1 -- 172.21.15.6:0/3663789295 shutdown_connections 2023-07-07T04:01:09.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.231+0000 7fb252ff7700 1 --2- 172.21.15.6:0/3663789295 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb23006ace0 0x7fb23006d190 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:09.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.231+0000 7fb252ff7700 1 --2- 172.21.15.6:0/3663789295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb24c15d1c0 0x7fb24c0b4000 unknown :-1 s=CLOSED pgs=3343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:09.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.231+0000 7fb252ff7700 1 --2- 172.21.15.6:0/3663789295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb24c06ef30 0x7fb24c1513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:09.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.231+0000 7fb252ff7700 1 --2- 172.21.15.6:0/3663789295 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb24c15c430 0x7fb24c0ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:09.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.231+0000 7fb252ff7700 1 -- 172.21.15.6:0/3663789295 >> 172.21.15.6:0/3663789295 conn(0x7fb24c0cf0f0 msgr2=0x7fb24c0c9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:09.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.231+0000 7fb252ff7700 1 -- 172.21.15.6:0/3663789295 shutdown_connections 2023-07-07T04:01:09.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.231+0000 7fb252ff7700 1 -- 172.21.15.6:0/3663789295 wait complete. 2023-07-07T04:01:09.253 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-07T04:01:09.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.441+0000 7f7430787700 1 Processor -- start 2023-07-07T04:01:09.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.441+0000 7f7430787700 1 -- start start 2023-07-07T04:01:09.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.442+0000 7f7430787700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f742815c660 0x7f742806c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:09.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.442+0000 7f7430787700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f74280b1060 0x7f742806cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:09.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.442+0000 7f7430787700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f742815ca30 con 0x7f742806d0d0 2023-07-07T04:01:09.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.442+0000 7f7430787700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74280ccdb0 con 0x7f742815c660 2023-07-07T04:01:09.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.442+0000 7f7430787700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74280cd000 con 0x7f74280b1060 2023-07-07T04:01:09.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.442+0000 7f742e523700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f742815c660 0x7f742806c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:09.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.442+0000 7f742dd22700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f74280b1060 0x7f742806cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:09.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.442+0000 7f742e523700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f742815c660 0x7f742806c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48114/0 (socket says 172.21.15.6:48114) 2023-07-07T04:01:09.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.442+0000 7f742e523700 1 -- 172.21.15.6:0/2386964352 learned_addr learned my addr 172.21.15.6:0/2386964352 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:09.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.442+0000 7f742dd22700 1 -- 172.21.15.6:0/2386964352 >> v2:172.21.15.6:3300/0 conn(0x7f742815c660 msgr2=0x7f742806c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:09.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.443+0000 7f742dd22700 1 --2- 172.21.15.6:0/2386964352 >> v2:172.21.15.6:3300/0 conn(0x7f742815c660 0x7f742806c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:09.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.443+0000 7f742dd22700 1 -- 172.21.15.6:0/2386964352 >> v1:172.21.15.40:6789/0 conn(0x7f742806d0d0 legacy=0x7f74280c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:09.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.443+0000 7f742dd22700 1 -- 172.21.15.6:0/2386964352 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74280cd2e0 con 0x7f74280b1060 2023-07-07T04:01:09.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.443+0000 7f742e523700 1 --2- 172.21.15.6:0/2386964352 >> v2:172.21.15.6:3300/0 conn(0x7f742815c660 0x7f742806c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T04:01:09.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.443+0000 7f742dd22700 1 --2- 172.21.15.6:0/2386964352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74280b1060 0x7f742806cb90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7428070270 tx=0x7f7418009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f1219215e181bc4 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:09.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.443+0000 7f742d521700 1 -- 172.21.15.6:0/2386964352 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7418011830 con 0x7f74280b1060 2023-07-07T04:01:09.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.443+0000 7f742d521700 1 -- 172.21.15.6:0/2386964352 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7418011990 con 0x7f74280b1060 2023-07-07T04:01:09.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.443+0000 7f742d521700 1 -- 172.21.15.6:0/2386964352 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7418011d20 con 0x7f74280b1060 2023-07-07T04:01:09.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.444+0000 7f7430787700 1 -- 172.21.15.6:0/2386964352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74280b1060 msgr2=0x7f742806cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:09.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.444+0000 7f7430787700 1 --2- 172.21.15.6:0/2386964352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74280b1060 0x7f742806cb90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7428070270 tx=0x7f7418009b20 comp rx=0 tx=0).stop 2023-07-07T04:01:09.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.449+0000 7f7430787700 1 -- 172.21.15.6:0/2386964352 shutdown_connections 2023-07-07T04:01:09.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.449+0000 7f7430787700 1 --2- 172.21.15.6:0/2386964352 >> v2:172.21.15.6:3300/0 conn(0x7f742815c660 0x7f742806c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:09.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.449+0000 7f7430787700 1 --2- 172.21.15.6:0/2386964352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f74280b1060 0x7f742806cb90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:09.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.449+0000 7f7430787700 1 -- 172.21.15.6:0/2386964352 >> 172.21.15.6:0/2386964352 conn(0x7f74280cf420 msgr2=0x7f74280cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:09.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.449+0000 7f7430787700 1 -- 172.21.15.6:0/2386964352 shutdown_connections 2023-07-07T04:01:09.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.450+0000 7f7430787700 1 -- 172.21.15.6:0/2386964352 wait complete. 2023-07-07T04:01:09.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.451+0000 7f7430787700 1 Processor -- start 2023-07-07T04:01:09.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.451+0000 7f7430787700 1 -- start start 2023-07-07T04:01:09.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.453+0000 7f7430787700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f742806d0d0 0x7f742814b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:09.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.453+0000 7f7430787700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74280b1060 0x7f7428152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:09.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.453+0000 7f7430787700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f742815c660 0x7f74280c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:09.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.453+0000 7f7430787700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74281539d0 con 0x7f742806d0d0 2023-07-07T04:01:09.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.453+0000 7f7430787700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7428159a80 con 0x7f742815c660 2023-07-07T04:01:09.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.453+0000 7f7430787700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7428159d60 con 0x7f74280b1060 2023-07-07T04:01:09.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.453+0000 7f742e523700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f742806d0d0 0x7f742814b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:09.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.453+0000 7f742e523700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f742806d0d0 0x7f742814b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48120/0 (socket says 172.21.15.6:48120) 2023-07-07T04:01:09.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.453+0000 7f742e523700 1 -- 172.21.15.6:0/3661385508 learned_addr learned my addr 172.21.15.6:0/3661385508 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:09.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.453+0000 7f742dd22700 1 --2- 172.21.15.6:0/3661385508 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74280b1060 0x7f7428152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:09.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.453+0000 7f742e523700 1 -- 172.21.15.6:0/3661385508 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74280b1060 msgr2=0x7f7428152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:09.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.453+0000 7f742e523700 1 --2- 172.21.15.6:0/3661385508 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74280b1060 0x7f7428152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:09.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.453+0000 7f742e523700 1 -- 172.21.15.6:0/3661385508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f742815c660 msgr2=0x7f74280c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:09.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.453+0000 7f742e523700 1 --2- 172.21.15.6:0/3661385508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f742815c660 0x7f74280c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:09.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.453+0000 7f742e523700 1 -- 172.21.15.6:0/3661385508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7424009550 con 0x7f742806d0d0 2023-07-07T04:01:09.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.453+0000 7f742e523700 1 --2- 172.21.15.6:0/3661385508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f742806d0d0 0x7f742814b650 secure :-1 s=READY pgs=3344 cs=0 l=1 rev1=1 crypto rx=0x7f742400e9b0 tx=0x7f742400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:09.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.455+0000 7f741effd700 1 -- 172.21.15.6:0/3661385508 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742400c850 con 0x7f742806d0d0 2023-07-07T04:01:09.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.455+0000 7f741effd700 1 -- 172.21.15.6:0/3661385508 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f742400c9b0 con 0x7f742806d0d0 2023-07-07T04:01:09.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.455+0000 7f7430787700 1 -- 172.21.15.6:0/3661385508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74180094a0 con 0x7f742806d0d0 2023-07-07T04:01:09.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.455+0000 7f741effd700 1 -- 172.21.15.6:0/3661385508 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742400cd20 con 0x7f742806d0d0 2023-07-07T04:01:09.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.455+0000 7f7430787700 1 -- 172.21.15.6:0/3661385508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742815a320 con 0x7f742806d0d0 2023-07-07T04:01:09.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.457+0000 7f7430787700 1 -- 172.21.15.6:0/3661385508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74100052f0 con 0x7f742806d0d0 2023-07-07T04:01:09.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.461+0000 7f741effd700 1 -- 172.21.15.6:0/3661385508 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7424013470 con 0x7f742806d0d0 2023-07-07T04:01:09.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.461+0000 7f741effd700 1 --2- 172.21.15.6:0/3661385508 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f740c06ace0 0x7f740c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:09.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.461+0000 7f741effd700 1 -- 172.21.15.6:0/3661385508 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f7424089dd0 con 0x7f742806d0d0 2023-07-07T04:01:09.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.466+0000 7f742dd22700 1 --2- 172.21.15.6:0/3661385508 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f740c06ace0 0x7f740c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:09.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.468+0000 7f741effd700 1 -- 172.21.15.6:0/3661385508 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7424054de0 con 0x7f742806d0d0 2023-07-07T04:01:09.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.473+0000 7f742dd22700 1 --2- 172.21.15.6:0/3661385508 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f740c06ace0 0x7f740c06d190 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7418000c00 tx=0x7f741801c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:09.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.863+0000 7f7430787700 1 -- 172.21.15.6:0/3661385508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7410005870 con 0x7f742806d0d0 2023-07-07T04:01:09.889 INFO:tasks.ceph.mon.a.smithi006.stderr:2023-07-07T04:01:09.887+0000 7f6748688700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-07T04:01:09.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.892+0000 7f741effd700 1 -- 172.21.15.6:0/3661385508 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7424058400 con 0x7f742806d0d0 2023-07-07T04:01:09.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.894+0000 7f7430787700 1 -- 172.21.15.6:0/3661385508 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f740c06ace0 msgr2=0x7f740c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:09.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.894+0000 7f7430787700 1 --2- 172.21.15.6:0/3661385508 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f740c06ace0 0x7f740c06d190 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7418000c00 tx=0x7f741801c040 comp rx=0 tx=0).stop 2023-07-07T04:01:09.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.894+0000 7f7430787700 1 -- 172.21.15.6:0/3661385508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f742806d0d0 msgr2=0x7f742814b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:09.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.894+0000 7f7430787700 1 --2- 172.21.15.6:0/3661385508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f742806d0d0 0x7f742814b650 secure :-1 s=READY pgs=3344 cs=0 l=1 rev1=1 crypto rx=0x7f742400e9b0 tx=0x7f742400ecc0 comp rx=0 tx=0).stop 2023-07-07T04:01:09.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.894+0000 7f7430787700 1 -- 172.21.15.6:0/3661385508 shutdown_connections 2023-07-07T04:01:09.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.894+0000 7f7430787700 1 --2- 172.21.15.6:0/3661385508 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f740c06ace0 0x7f740c06d190 secure :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7418000c00 tx=0x7f741801c040 comp rx=0 tx=0).stop 2023-07-07T04:01:09.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.894+0000 7f7430787700 1 --2- 172.21.15.6:0/3661385508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f742806d0d0 0x7f742814b650 unknown :-1 s=CLOSED pgs=3344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:09.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.894+0000 7f7430787700 1 --2- 172.21.15.6:0/3661385508 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f742815c660 0x7f74280c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:09.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.894+0000 7f7430787700 1 --2- 172.21.15.6:0/3661385508 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f74280b1060 0x7f7428152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:09.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.894+0000 7f7430787700 1 -- 172.21.15.6:0/3661385508 >> 172.21.15.6:0/3661385508 conn(0x7f74280cf420 msgr2=0x7f74280c36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:09.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.898+0000 7f7430787700 1 -- 172.21.15.6:0/3661385508 shutdown_connections 2023-07-07T04:01:09.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:09.898+0000 7f7430787700 1 -- 172.21.15.6:0/3661385508 wait complete. 2023-07-07T04:01:09.910 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-07T04:01:09.929 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-07T04:01:10.054 INFO:tasks.ceph.mds.b.smithi040.stdout:starting mds.b at 2023-07-07T04:01:10.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.069+0000 7fcfc9d5b700 1 Processor -- start 2023-07-07T04:01:10.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.069+0000 7fcfc9d5b700 1 -- start start 2023-07-07T04:01:10.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.070+0000 7fcfc9d5b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcfc40b1f10 0x7fcfc40cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:10.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.070+0000 7fcfc9d5b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc415d480 con 0x7fcfc4160e00 2023-07-07T04:01:10.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.070+0000 7fcfc9d5b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc415ce70 con 0x7fcfc406c4c0 2023-07-07T04:01:10.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.070+0000 7fcfc9d5b700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc415cc60 con 0x7fcfc40b1f10 2023-07-07T04:01:10.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.070+0000 7fcfc37fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcfc40b1f10 0x7fcfc40cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:10.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.070+0000 7fcfc2ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fcfc4160e00 0x7fcfc406bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49338/0 (socket says 172.21.15.6:49338) 2023-07-07T04:01:10.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.070+0000 7fcfc2ffd700 1 -- 172.21.15.6:0/3206849433 learned_addr learned my addr 172.21.15.6:0/3206849433 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:01:10.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.071+0000 7fcfc37fe700 1 -- 172.21.15.6:0/3206849433 >> v1:172.21.15.40:6789/0 conn(0x7fcfc406c4c0 legacy=0x7fcfc40d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:10.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.071+0000 7fcfc37fe700 1 -- 172.21.15.6:0/3206849433 >> v1:172.21.15.6:6789/0 conn(0x7fcfc4160e00 legacy=0x7fcfc406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:10.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.071+0000 7fcfc37fe700 1 -- 172.21.15.6:0/3206849433 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc40cddd0 con 0x7fcfc40b1f10 2023-07-07T04:01:10.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.071+0000 7fcfc27fc700 1 -- 172.21.15.6:0/3206849433 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807640880 0 0) 0x7fcfc415d480 con 0x7fcfc4160e00 2023-07-07T04:01:10.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.071+0000 7fcfc37fe700 1 --2- 172.21.15.6:0/3206849433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfc40b1f10 0x7fcfc40cd2c0 secure :-1 s=READY pgs=3347 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009840 tx=0x7fcfb4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4de10f8cae2c7a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:10.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.071+0000 7fcfc27fc700 1 -- 172.21.15.6:0/3206849433 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4011830 con 0x7fcfc40b1f10 2023-07-07T04:01:10.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.071+0000 7fcfc27fc700 1 -- 172.21.15.6:0/3206849433 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb4011990 con 0x7fcfc40b1f10 2023-07-07T04:01:10.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.071+0000 7fcfc27fc700 1 -- 172.21.15.6:0/3206849433 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4011d20 con 0x7fcfc40b1f10 2023-07-07T04:01:10.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.072+0000 7fcfc9d5b700 1 -- 172.21.15.6:0/3206849433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfc40b1f10 msgr2=0x7fcfc40cd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:10.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.072+0000 7fcfc9d5b700 1 --2- 172.21.15.6:0/3206849433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfc40b1f10 0x7fcfc40cd2c0 secure :-1 s=READY pgs=3347 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009840 tx=0x7fcfb4009b50 comp rx=0 tx=0).stop 2023-07-07T04:01:10.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.072+0000 7fcfc9d5b700 1 -- 172.21.15.6:0/3206849433 shutdown_connections 2023-07-07T04:01:10.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.072+0000 7fcfc9d5b700 1 --2- 172.21.15.6:0/3206849433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfc40b1f10 0x7fcfc40cd2c0 unknown :-1 s=CLOSED pgs=3347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:10.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.072+0000 7fcfc9d5b700 1 -- 172.21.15.6:0/3206849433 >> 172.21.15.6:0/3206849433 conn(0x7fcfc40d2c70 msgr2=0x7fcfc40d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:10.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.072+0000 7fcfc9d5b700 1 -- 172.21.15.6:0/3206849433 shutdown_connections 2023-07-07T04:01:10.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.072+0000 7fcfc9d5b700 1 -- 172.21.15.6:0/3206849433 wait complete. 2023-07-07T04:01:10.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.073+0000 7fcfc9d5b700 1 Processor -- start 2023-07-07T04:01:10.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.073+0000 7fcfc9d5b700 1 -- start start 2023-07-07T04:01:10.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.074+0000 7fcfc9d5b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfc406c4c0 0x7fcfc415a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:10.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.074+0000 7fcfc9d5b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfc40b1f10 0x7fcfc40c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.074+0000 7fcfc9d5b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfc4160e00 0x7fcfc41f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.074+0000 7fcfc9d5b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc41f3100 con 0x7fcfc40b1f10 2023-07-07T04:01:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.074+0000 7fcfc9d5b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc40c9490 con 0x7fcfc406c4c0 2023-07-07T04:01:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.074+0000 7fcfc9d5b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc40c9770 con 0x7fcfc4160e00 2023-07-07T04:01:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.074+0000 7fcfc2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfc40b1f10 0x7fcfc40c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.074+0000 7fcfc2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfc40b1f10 0x7fcfc40c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48136/0 (socket says 172.21.15.6:48136) 2023-07-07T04:01:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.074+0000 7fcfc2ffd700 1 -- 172.21.15.6:0/4264174001 learned_addr learned my addr 172.21.15.6:0/4264174001 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.074+0000 7fcfc37fe700 1 --2- 172.21.15.6:0/4264174001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfc406c4c0 0x7fcfc415a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.074+0000 7fcfc3fff700 1 --2- 172.21.15.6:0/4264174001 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfc4160e00 0x7fcfc41f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.075+0000 7fcfc2ffd700 1 -- 172.21.15.6:0/4264174001 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfc4160e00 msgr2=0x7fcfc41f2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.075+0000 7fcfc2ffd700 1 --2- 172.21.15.6:0/4264174001 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfc4160e00 0x7fcfc41f2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.075+0000 7fcfc2ffd700 1 -- 172.21.15.6:0/4264174001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfc406c4c0 msgr2=0x7fcfc415a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.075+0000 7fcfc2ffd700 1 --2- 172.21.15.6:0/4264174001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfc406c4c0 0x7fcfc415a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.075+0000 7fcfc2ffd700 1 -- 172.21.15.6:0/4264174001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb40094a0 con 0x7fcfc40b1f10 2023-07-07T04:01:10.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.075+0000 7fcfc3fff700 1 --2- 172.21.15.6:0/4264174001 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfc4160e00 0x7fcfc41f2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T04:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.075+0000 7fcfc37fe700 1 --2- 172.21.15.6:0/4264174001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfc406c4c0 0x7fcfc415a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T04:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.075+0000 7fcfc2ffd700 1 --2- 172.21.15.6:0/4264174001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfc40b1f10 0x7fcfc40c8d90 secure :-1 s=READY pgs=3348 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8001eb0 tx=0x7fcfb800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.075+0000 7fcfabfff700 1 -- 172.21.15.6:0/4264174001 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8004c80 con 0x7fcfc40b1f10 2023-07-07T04:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.075+0000 7fcfabfff700 1 -- 172.21.15.6:0/4264174001 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb8004de0 con 0x7fcfc40b1f10 2023-07-07T04:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.075+0000 7fcfc9d5b700 1 -- 172.21.15.6:0/4264174001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc40c6840 con 0x7fcfc40b1f10 2023-07-07T04:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.075+0000 7fcfabfff700 1 -- 172.21.15.6:0/4264174001 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8007310 con 0x7fcfc40b1f10 2023-07-07T04:01:10.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.075+0000 7fcfc9d5b700 1 -- 172.21.15.6:0/4264174001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc40c9a50 con 0x7fcfc40b1f10 2023-07-07T04:01:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.076+0000 7fcfc9d5b700 1 -- 172.21.15.6:0/4264174001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc415d0f0 con 0x7fcfc40b1f10 2023-07-07T04:01:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.077+0000 7fcfabfff700 1 -- 172.21.15.6:0/4264174001 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcfb8007470 con 0x7fcfc40b1f10 2023-07-07T04:01:10.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.077+0000 7fcfabfff700 1 --2- 172.21.15.6:0/4264174001 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcfb006ace0 0x7fcfb006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:10.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.077+0000 7fcfabfff700 1 -- 172.21.15.6:0/4264174001 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6526+0+0 (secure 0 0 0) 0x7fcfb80892c0 con 0x7fcfc40b1f10 2023-07-07T04:01:10.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.077+0000 7fcfc37fe700 1 --2- 172.21.15.6:0/4264174001 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcfb006ace0 0x7fcfb006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:10.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.078+0000 7fcfc37fe700 1 --2- 172.21.15.6:0/4264174001 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcfb006ace0 0x7fcfb006d190 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40090b0 tx=0x7fcfb401c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:10.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.082+0000 7fcfabfff700 1 -- 172.21.15.6:0/4264174001 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcfc415d0f0 con 0x7fcfc40b1f10 2023-07-07T04:01:10.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.338+0000 7fcfc9d5b700 1 -- 172.21.15.6:0/4264174001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcfc40c6d60 con 0x7fcfc40b1f10 2023-07-07T04:01:10.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.895+0000 7fcfabfff700 1 -- 172.21.15.6:0/4264174001 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcfc40c6d60 con 0x7fcfc40b1f10 2023-07-07T04:01:10.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.898+0000 7fcfc9d5b700 1 -- 172.21.15.6:0/4264174001 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcfb006ace0 msgr2=0x7fcfb006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:10.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.898+0000 7fcfc9d5b700 1 --2- 172.21.15.6:0/4264174001 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcfb006ace0 0x7fcfb006d190 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40090b0 tx=0x7fcfb401c040 comp rx=0 tx=0).stop 2023-07-07T04:01:10.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.899+0000 7fcfc9d5b700 1 -- 172.21.15.6:0/4264174001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfc40b1f10 msgr2=0x7fcfc40c8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:10.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.899+0000 7fcfc9d5b700 1 --2- 172.21.15.6:0/4264174001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfc40b1f10 0x7fcfc40c8d90 secure :-1 s=READY pgs=3348 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8001eb0 tx=0x7fcfb800c800 comp rx=0 tx=0).stop 2023-07-07T04:01:10.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.899+0000 7fcfc9d5b700 1 -- 172.21.15.6:0/4264174001 shutdown_connections 2023-07-07T04:01:10.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.899+0000 7fcfc9d5b700 1 --2- 172.21.15.6:0/4264174001 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcfb006ace0 0x7fcfb006d190 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:10.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.899+0000 7fcfc9d5b700 1 --2- 172.21.15.6:0/4264174001 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcfc4160e00 0x7fcfc41f2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:10.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.899+0000 7fcfc9d5b700 1 --2- 172.21.15.6:0/4264174001 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfc406c4c0 0x7fcfc415a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:10.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.899+0000 7fcfc9d5b700 1 --2- 172.21.15.6:0/4264174001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcfc40b1f10 0x7fcfc40c8d90 unknown :-1 s=CLOSED pgs=3348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:10.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.899+0000 7fcfc9d5b700 1 -- 172.21.15.6:0/4264174001 >> 172.21.15.6:0/4264174001 conn(0x7fcfc40d2c70 msgr2=0x7fcfc40b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:10.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.899+0000 7fcfc9d5b700 1 -- 172.21.15.6:0/4264174001 shutdown_connections 2023-07-07T04:01:10.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:10.899+0000 7fcfc9d5b700 1 -- 172.21.15.6:0/4264174001 wait complete. 2023-07-07T04:01:10.917 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-07T04:01:11.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.058+0000 7f0df4bbe700 1 Processor -- start 2023-07-07T04:01:11.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.058+0000 7f0df4bbe700 1 -- start start 2023-07-07T04:01:11.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.059+0000 7f0df4bbe700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0df00d0580 0x7f0df00ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:11.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.059+0000 7f0df4bbe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0df015e910 0x7f0df00cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:11.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.059+0000 7f0df4bbe700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df00cb800 con 0x7f0df015de30 2023-07-07T04:01:11.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.059+0000 7f0df4bbe700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df00cd0f0 con 0x7f0df00d0580 2023-07-07T04:01:11.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.059+0000 7f0df4bbe700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df00cb240 con 0x7f0df015e910 2023-07-07T04:01:11.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.060+0000 7f0dedd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0df00d0580 0x7f0df00ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:11.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.060+0000 7f0deed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0df015e910 0x7f0df00cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:11.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.060+0000 7f0dedd9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0df00d0580 0x7f0df00ce9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:55412/0 (socket says 172.21.15.6:55412) 2023-07-07T04:01:11.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.060+0000 7f0dedd9b700 1 -- 172.21.15.6:0/373995317 learned_addr learned my addr 172.21.15.6:0/373995317 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:11.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.060+0000 7f0deed9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0df015e910 0x7f0df00cef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:40790/0 (socket says 172.21.15.6:40790) 2023-07-07T04:01:11.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.060+0000 7f0dee59c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0df015de30 0x7f0df015e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:39222/0 (socket says 172.21.15.6:39222) 2023-07-07T04:01:11.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.060+0000 7f0dedd9b700 1 -- 172.21.15.6:0/373995317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0df015e910 msgr2=0x7f0df00cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:11.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.060+0000 7f0dedd9b700 1 --2- 172.21.15.6:0/373995317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0df015e910 0x7f0df00cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:11.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.060+0000 7f0dedd9b700 1 -- 172.21.15.6:0/373995317 >> v1:172.21.15.40:6789/0 conn(0x7f0df015de30 legacy=0x7f0df015e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:11.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.060+0000 7f0dedd9b700 1 -- 172.21.15.6:0/373995317 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df00cb520 con 0x7f0df00d0580 2023-07-07T04:01:11.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.060+0000 7f0deed9d700 1 --2- 172.21.15.6:0/373995317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0df015e910 0x7f0df00cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T04:01:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.060+0000 7f0dedd9b700 1 --2- 172.21.15.6:0/373995317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0df00d0580 0x7f0df00ce9c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0de40098f0 tx=0x7f0de4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51c2320b01bf72a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.060+0000 7f0ded59a700 1 -- 172.21.15.6:0/373995317 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de4011830 con 0x7f0df00d0580 2023-07-07T04:01:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.061+0000 7f0ded59a700 1 -- 172.21.15.6:0/373995317 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de4011990 con 0x7f0df00d0580 2023-07-07T04:01:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.061+0000 7f0ded59a700 1 -- 172.21.15.6:0/373995317 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de4011d20 con 0x7f0df00d0580 2023-07-07T04:01:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.061+0000 7f0df4bbe700 1 -- 172.21.15.6:0/373995317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0df00d0580 msgr2=0x7f0df00ce9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.061+0000 7f0df4bbe700 1 --2- 172.21.15.6:0/373995317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0df00d0580 0x7f0df00ce9c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0de40098f0 tx=0x7f0de4009c00 comp rx=0 tx=0).stop 2023-07-07T04:01:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.061+0000 7f0df4bbe700 1 -- 172.21.15.6:0/373995317 shutdown_connections 2023-07-07T04:01:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.061+0000 7f0df4bbe700 1 --2- 172.21.15.6:0/373995317 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0df015e910 0x7f0df00cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.061+0000 7f0df4bbe700 1 --2- 172.21.15.6:0/373995317 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0df00d0580 0x7f0df00ce9c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.061+0000 7f0df4bbe700 1 -- 172.21.15.6:0/373995317 >> 172.21.15.6:0/373995317 conn(0x7f0df00ce160 msgr2=0x7f0df00d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.061+0000 7f0df4bbe700 1 -- 172.21.15.6:0/373995317 shutdown_connections 2023-07-07T04:01:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.061+0000 7f0df4bbe700 1 -- 172.21.15.6:0/373995317 wait complete. 2023-07-07T04:01:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.063+0000 7f0df4bbe700 1 Processor -- start 2023-07-07T04:01:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.063+0000 7f0df4bbe700 1 -- start start 2023-07-07T04:01:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.063+0000 7f0df4bbe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0df00d0580 0x7f0df00b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.063+0000 7f0df4bbe700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0df015de30 0x7f0df00b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.063+0000 7f0df4bbe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df015e910 0x7f0df00cfb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.063+0000 7f0df4bbe700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df01580f0 con 0x7f0df015e910 2023-07-07T04:01:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.063+0000 7f0df4bbe700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df00b1ee0 con 0x7f0df00d0580 2023-07-07T04:01:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.063+0000 7f0df4bbe700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df00b12d0 con 0x7f0df015de30 2023-07-07T04:01:11.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.064+0000 7f0deed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df015e910 0x7f0df00cfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:11.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.064+0000 7f0deed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df015e910 0x7f0df00cfb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48152/0 (socket says 172.21.15.6:48152) 2023-07-07T04:01:11.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.064+0000 7f0deed9d700 1 -- 172.21.15.6:0/383002429 learned_addr learned my addr 172.21.15.6:0/383002429 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:11.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.064+0000 7f0dee59c700 1 --2- 172.21.15.6:0/383002429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0df00d0580 0x7f0df00b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:11.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.064+0000 7f0dedd9b700 1 --2- 172.21.15.6:0/383002429 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0df015de30 0x7f0df00b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:11.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.064+0000 7f0deed9d700 1 -- 172.21.15.6:0/383002429 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0df015de30 msgr2=0x7f0df00b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:11.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.064+0000 7f0deed9d700 1 --2- 172.21.15.6:0/383002429 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0df015de30 0x7f0df00b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.064+0000 7f0deed9d700 1 -- 172.21.15.6:0/383002429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0df00d0580 msgr2=0x7f0df00b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.064+0000 7f0deed9d700 1 --2- 172.21.15.6:0/383002429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0df00d0580 0x7f0df00b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.064+0000 7f0deed9d700 1 -- 172.21.15.6:0/383002429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de8009a70 con 0x7f0df015e910 2023-07-07T04:01:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.064+0000 7f0deed9d700 1 --2- 172.21.15.6:0/383002429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df015e910 0x7f0df00cfb90 secure :-1 s=READY pgs=3349 cs=0 l=1 rev1=1 crypto rx=0x7f0de800efc0 tx=0x7f0de800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.064+0000 7f0ddeffd700 1 -- 172.21.15.6:0/383002429 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de800ca90 con 0x7f0df015e910 2023-07-07T04:01:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.064+0000 7f0ddeffd700 1 -- 172.21.15.6:0/383002429 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de800f040 con 0x7f0df015e910 2023-07-07T04:01:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.064+0000 7f0df4bbe700 1 -- 172.21.15.6:0/383002429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de4009550 con 0x7f0df015e910 2023-07-07T04:01:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.064+0000 7f0ddeffd700 1 -- 172.21.15.6:0/383002429 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de800ce10 con 0x7f0df015e910 2023-07-07T04:01:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.064+0000 7f0df4bbe700 1 -- 172.21.15.6:0/383002429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df00b1890 con 0x7f0df015e910 2023-07-07T04:01:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.065+0000 7f0df4bbe700 1 -- 172.21.15.6:0/383002429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df00b58e0 con 0x7f0df015e910 2023-07-07T04:01:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.066+0000 7f0ddeffd700 1 -- 172.21.15.6:0/383002429 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0de8014480 con 0x7f0df015e910 2023-07-07T04:01:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.066+0000 7f0ddeffd700 1 --2- 172.21.15.6:0/383002429 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0dd006ace0 0x7f0dd006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.066+0000 7f0ddeffd700 1 -- 172.21.15.6:0/383002429 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6526+0+0 (secure 0 0 0) 0x7f0de8089d10 con 0x7f0df015e910 2023-07-07T04:01:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.067+0000 7f0dee59c700 1 --2- 172.21.15.6:0/383002429 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0dd006ace0 0x7f0dd006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.067+0000 7f0dee59c700 1 --2- 172.21.15.6:0/383002429 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0dd006ace0 0x7f0dd006d190 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f0de0000f60 tx=0x7f0de0007ed0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:11.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.071+0000 7f0ddeffd700 1 -- 172.21.15.6:0/383002429 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0de8058690 con 0x7f0df015e910 2023-07-07T04:01:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.278+0000 7f0df4bbe700 1 -- 172.21.15.6:0/383002429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0df0074200 con 0x7f0df015e910 2023-07-07T04:01:11.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.904+0000 7f0ddeffd700 1 -- 172.21.15.6:0/383002429 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v45) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0de8058220 con 0x7f0df015e910 2023-07-07T04:01:11.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.909+0000 7f0df4bbe700 1 -- 172.21.15.6:0/383002429 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0dd006ace0 msgr2=0x7f0dd006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:11.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.909+0000 7f0df4bbe700 1 --2- 172.21.15.6:0/383002429 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0dd006ace0 0x7f0dd006d190 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f0de0000f60 tx=0x7f0de0007ed0 comp rx=0 tx=0).stop 2023-07-07T04:01:11.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.909+0000 7f0df4bbe700 1 -- 172.21.15.6:0/383002429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df015e910 msgr2=0x7f0df00cfb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:11.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.909+0000 7f0df4bbe700 1 --2- 172.21.15.6:0/383002429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df015e910 0x7f0df00cfb90 secure :-1 s=READY pgs=3349 cs=0 l=1 rev1=1 crypto rx=0x7f0de800efc0 tx=0x7f0de800c3a0 comp rx=0 tx=0).stop 2023-07-07T04:01:11.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.909+0000 7f0df4bbe700 1 -- 172.21.15.6:0/383002429 shutdown_connections 2023-07-07T04:01:11.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.909+0000 7f0df4bbe700 1 --2- 172.21.15.6:0/383002429 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0dd006ace0 0x7f0dd006d190 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:11.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.909+0000 7f0df4bbe700 1 --2- 172.21.15.6:0/383002429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0df015e910 0x7f0df00cfb90 unknown :-1 s=CLOSED pgs=3349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:11.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.909+0000 7f0df4bbe700 1 --2- 172.21.15.6:0/383002429 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0df00d0580 0x7f0df00b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:11.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.909+0000 7f0df4bbe700 1 --2- 172.21.15.6:0/383002429 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0df015de30 0x7f0df00b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:11.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.909+0000 7f0df4bbe700 1 -- 172.21.15.6:0/383002429 >> 172.21.15.6:0/383002429 conn(0x7f0df00ce160 msgr2=0x7f0df015a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:11.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.909+0000 7f0df4bbe700 1 -- 172.21.15.6:0/383002429 shutdown_connections 2023-07-07T04:01:11.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:11.909+0000 7f0df4bbe700 1 -- 172.21.15.6:0/383002429 wait complete. 2023-07-07T04:01:11.913 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-07-07T04:01:11.934 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-07T04:01:12.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.165+0000 7f3b5de5b700 1 Processor -- start 2023-07-07T04:01:12.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.165+0000 7f3b5de5b700 1 -- start start 2023-07-07T04:01:12.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.166+0000 7f3b5de5b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3b5815c670 0x7f3b5806bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:12.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.166+0000 7f3b5de5b700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5806aa30 con 0x7f3b5806c410 2023-07-07T04:01:12.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.166+0000 7f3b5de5b700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5815ca40 con 0x7f3b580cd950 2023-07-07T04:01:12.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.166+0000 7f3b5de5b700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b5806c950 con 0x7f3b5815c670 2023-07-07T04:01:12.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.166+0000 7f3b56ffd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3b5806c410 0x7f3b580cd240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49364/0 (socket says 172.21.15.6:49364) 2023-07-07T04:01:12.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.166+0000 7f3b56ffd700 1 -- 172.21.15.6:0/650472288 learned_addr learned my addr 172.21.15.6:0/650472288 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:01:12.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.167+0000 7f3b577fe700 1 --2- 172.21.15.6:0/650472288 >> v2:172.21.15.40:3300/0 conn(0x7f3b5815c670 0x7f3b5806bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:12.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.167+0000 7f3b567fc700 1 -- 172.21.15.6:0/650472288 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 766625224 0 0) 0x7f3b5806aa30 con 0x7f3b5806c410 2023-07-07T04:01:12.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.167+0000 7f3b567fc700 1 -- 172.21.15.6:0/650472288 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b400035b0 con 0x7f3b5806c410 2023-07-07T04:01:12.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.167+0000 7f3b577fe700 1 -- 172.21.15.6:0/650472288 >> v1:172.21.15.40:6789/0 conn(0x7f3b580cd950 legacy=0x7f3b580d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:12.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.167+0000 7f3b577fe700 1 -- 172.21.15.6:0/650472288 >> v1:172.21.15.6:6789/0 conn(0x7f3b5806c410 legacy=0x7f3b580cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:12.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.167+0000 7f3b577fe700 1 -- 172.21.15.6:0/650472288 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b5806a100 con 0x7f3b5815c670 2023-07-07T04:01:12.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.167+0000 7f3b577fe700 1 --2- 172.21.15.6:0/650472288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b5815c670 0x7f3b5806bed0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c009840 tx=0x7f3b4c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=599e71217bb23ab5 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:12.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.167+0000 7f3b567fc700 1 -- 172.21.15.6:0/650472288 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c011830 con 0x7f3b5815c670 2023-07-07T04:01:12.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.167+0000 7f3b567fc700 1 -- 172.21.15.6:0/650472288 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c011990 con 0x7f3b5815c670 2023-07-07T04:01:12.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.167+0000 7f3b567fc700 1 -- 172.21.15.6:0/650472288 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c011d20 con 0x7f3b5815c670 2023-07-07T04:01:12.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.168+0000 7f3b5de5b700 1 -- 172.21.15.6:0/650472288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b5815c670 msgr2=0x7f3b5806bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:12.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.168+0000 7f3b5de5b700 1 --2- 172.21.15.6:0/650472288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b5815c670 0x7f3b5806bed0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c009840 tx=0x7f3b4c009b50 comp rx=0 tx=0).stop 2023-07-07T04:01:12.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.169+0000 7f3b5de5b700 1 -- 172.21.15.6:0/650472288 shutdown_connections 2023-07-07T04:01:12.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.169+0000 7f3b5de5b700 1 --2- 172.21.15.6:0/650472288 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b5815c670 0x7f3b5806bed0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:12.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.169+0000 7f3b5de5b700 1 -- 172.21.15.6:0/650472288 >> 172.21.15.6:0/650472288 conn(0x7f3b580d2bf0 msgr2=0x7f3b580d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:12.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.169+0000 7f3b5de5b700 1 -- 172.21.15.6:0/650472288 shutdown_connections 2023-07-07T04:01:12.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.169+0000 7f3b5de5b700 1 -- 172.21.15.6:0/650472288 wait complete. 2023-07-07T04:01:12.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.171+0000 7f3b5de5b700 1 Processor -- start 2023-07-07T04:01:12.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.172+0000 7f3b5de5b700 1 -- start start 2023-07-07T04:01:12.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.173+0000 7f3b5de5b700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b5806c410 0x7f3b580c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:12.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.173+0000 7f3b5de5b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b580cd950 0x7f3b581585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:12.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.173+0000 7f3b5de5b700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b5815c670 0x7f3b58158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:12.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.173+0000 7f3b5de5b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580b60b0 con 0x7f3b580cd950 2023-07-07T04:01:12.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.173+0000 7f3b5de5b700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580b6390 con 0x7f3b5806c410 2023-07-07T04:01:12.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.173+0000 7f3b5de5b700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580b6670 con 0x7f3b5815c670 2023-07-07T04:01:12.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.173+0000 7f3b577fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b5806c410 0x7f3b580c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:12.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.173+0000 7f3b577fe700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b5806c410 0x7f3b580c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:55430/0 (socket says 172.21.15.6:55430) 2023-07-07T04:01:12.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.173+0000 7f3b577fe700 1 -- 172.21.15.6:0/2142276271 learned_addr learned my addr 172.21.15.6:0/2142276271 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:12.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.173+0000 7f3b57fff700 1 --2- 172.21.15.6:0/2142276271 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b5815c670 0x7f3b58158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:12.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.173+0000 7f3b56ffd700 1 --2- 172.21.15.6:0/2142276271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b580cd950 0x7f3b581585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:12.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.173+0000 7f3b577fe700 1 -- 172.21.15.6:0/2142276271 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b5815c670 msgr2=0x7f3b58158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:12.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.173+0000 7f3b577fe700 1 --2- 172.21.15.6:0/2142276271 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b5815c670 0x7f3b58158af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:12.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.173+0000 7f3b577fe700 1 -- 172.21.15.6:0/2142276271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b580cd950 msgr2=0x7f3b581585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:12.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.173+0000 7f3b577fe700 1 --2- 172.21.15.6:0/2142276271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b580cd950 0x7f3b581585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:12.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.173+0000 7f3b577fe700 1 -- 172.21.15.6:0/2142276271 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c0094a0 con 0x7f3b5806c410 2023-07-07T04:01:12.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.174+0000 7f3b577fe700 1 --2- 172.21.15.6:0/2142276271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b5806c410 0x7f3b580c8f40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c009fd0 tx=0x7f3b4c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:12.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.174+0000 7f3b3ffff700 1 -- 172.21.15.6:0/2142276271 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0036a0 con 0x7f3b5806c410 2023-07-07T04:01:12.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.174+0000 7f3b3ffff700 1 -- 172.21.15.6:0/2142276271 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c01f070 con 0x7f3b5806c410 2023-07-07T04:01:12.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.174+0000 7f3b5de5b700 1 -- 172.21.15.6:0/2142276271 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b580b6950 con 0x7f3b5806c410 2023-07-07T04:01:12.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.174+0000 7f3b3ffff700 1 -- 172.21.15.6:0/2142276271 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c003a60 con 0x7f3b5806c410 2023-07-07T04:01:12.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.174+0000 7f3b5de5b700 1 -- 172.21.15.6:0/2142276271 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b580c9480 con 0x7f3b5806c410 2023-07-07T04:01:12.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.176+0000 7f3b5de5b700 1 -- 172.21.15.6:0/2142276271 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b580c9610 con 0x7f3b5806c410 2023-07-07T04:01:12.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.176+0000 7f3b3ffff700 1 -- 172.21.15.6:0/2142276271 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3b4c003bc0 con 0x7f3b5806c410 2023-07-07T04:01:12.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.177+0000 7f3b3ffff700 1 --2- 172.21.15.6:0/2142276271 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3b4406ace0 0x7f3b4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:12.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.177+0000 7f3b3ffff700 1 -- 172.21.15.6:0/2142276271 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6088+0+0 (secure 0 0 0) 0x7f3b4c021070 con 0x7f3b5806c410 2023-07-07T04:01:12.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.177+0000 7f3b56ffd700 1 --2- 172.21.15.6:0/2142276271 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3b4406ace0 0x7f3b4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:12.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.177+0000 7f3b56ffd700 1 --2- 172.21.15.6:0/2142276271 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3b4406ace0 0x7f3b4406d190 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f3b580b8a20 tx=0x7f3b48007dc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:12.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.181+0000 7f3b3ffff700 1 -- 172.21.15.6:0/2142276271 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3b580c9610 con 0x7f3b5806c410 2023-07-07T04:01:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.509+0000 7f3b5de5b700 1 -- 172.21.15.6:0/2142276271 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3b580c9610 con 0x7f3b5806c410 2023-07-07T04:01:12.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.929+0000 7f3b3ffff700 1 -- 172.21.15.6:0/2142276271 <== mon.1 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v46) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3b580c9610 con 0x7f3b5806c410 2023-07-07T04:01:12.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.937+0000 7f3b5de5b700 1 -- 172.21.15.6:0/2142276271 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3b4406ace0 msgr2=0x7f3b4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:12.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.937+0000 7f3b5de5b700 1 --2- 172.21.15.6:0/2142276271 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3b4406ace0 0x7f3b4406d190 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f3b580b8a20 tx=0x7f3b48007dc0 comp rx=0 tx=0).stop 2023-07-07T04:01:12.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.937+0000 7f3b5de5b700 1 -- 172.21.15.6:0/2142276271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b5806c410 msgr2=0x7f3b580c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.937+0000 7f3b5de5b700 1 --2- 172.21.15.6:0/2142276271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b5806c410 0x7f3b580c8f40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c009fd0 tx=0x7f3b4c004750 comp rx=0 tx=0).stop 2023-07-07T04:01:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.938+0000 7f3b5de5b700 1 -- 172.21.15.6:0/2142276271 shutdown_connections 2023-07-07T04:01:12.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.938+0000 7f3b5de5b700 1 --2- 172.21.15.6:0/2142276271 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3b4406ace0 0x7f3b4406d190 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.938+0000 7f3b5de5b700 1 --2- 172.21.15.6:0/2142276271 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b5815c670 0x7f3b58158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.938+0000 7f3b5de5b700 1 --2- 172.21.15.6:0/2142276271 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b5806c410 0x7f3b580c8f40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.938+0000 7f3b5de5b700 1 --2- 172.21.15.6:0/2142276271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b580cd950 0x7f3b581585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.938+0000 7f3b5de5b700 1 -- 172.21.15.6:0/2142276271 >> 172.21.15.6:0/2142276271 conn(0x7f3b580d2bf0 msgr2=0x7f3b580cd220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.938+0000 7f3b5de5b700 1 -- 172.21.15.6:0/2142276271 shutdown_connections 2023-07-07T04:01:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:12.938+0000 7f3b5de5b700 1 -- 172.21.15.6:0/2142276271 wait complete. 2023-07-07T04:01:12.941 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-07-07T04:01:12.958 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-07T04:01:13.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.144+0000 7fd7f7284700 1 Processor -- start 2023-07-07T04:01:13.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.145+0000 7fd7f7284700 1 -- start start 2023-07-07T04:01:13.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.146+0000 7fd7f7284700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd7f01592b0 0x7fd7f0071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:13.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.146+0000 7fd7f7284700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f00cd950 0x7fd7f0071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:13.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.146+0000 7fd7f7284700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f015d2b0 con 0x7fd7f015cd40 2023-07-07T04:01:13.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.146+0000 7fd7f7284700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f0159680 con 0x7fd7f01592b0 2023-07-07T04:01:13.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.146+0000 7fd7f7284700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f00cc160 con 0x7fd7f00cd950 2023-07-07T04:01:13.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.146+0000 7fd7f5821700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f00cd950 0x7fd7f0071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:13.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.146+0000 7fd7f5821700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f00cd950 0x7fd7f0071bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:40816/0 (socket says 172.21.15.6:40816) 2023-07-07T04:01:13.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.146+0000 7fd7f5821700 1 -- 172.21.15.6:0/1099732252 learned_addr learned my addr 172.21.15.6:0/1099732252 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:13.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.147+0000 7fd7f5821700 1 -- 172.21.15.6:0/1099732252 >> v2:172.21.15.40:3300/0 conn(0x7fd7f01592b0 msgr2=0x7fd7f0071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:13.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.147+0000 7fd7f5821700 1 --2- 172.21.15.6:0/1099732252 >> v2:172.21.15.40:3300/0 conn(0x7fd7f01592b0 0x7fd7f0071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:13.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.147+0000 7fd7f5821700 1 -- 172.21.15.6:0/1099732252 >> v1:172.21.15.40:6789/0 conn(0x7fd7f015cd40 legacy=0x7fd7f006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:13.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.147+0000 7fd7f5821700 1 -- 172.21.15.6:0/1099732252 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f015d590 con 0x7fd7f00cd950 2023-07-07T04:01:13.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.148+0000 7fd7f5821700 1 --2- 172.21.15.6:0/1099732252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f00cd950 0x7fd7f0071bd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd7e00098f0 tx=0x7fd7e0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=279a7655fd34e2c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:13.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.148+0000 7fd7e7fff700 1 -- 172.21.15.6:0/1099732252 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0004230 con 0x7fd7f00cd950 2023-07-07T04:01:13.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.149+0000 7fd7e7fff700 1 -- 172.21.15.6:0/1099732252 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e0004390 con 0x7fd7f00cd950 2023-07-07T04:01:13.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.149+0000 7fd7e7fff700 1 -- 172.21.15.6:0/1099732252 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00036a0 con 0x7fd7f00cd950 2023-07-07T04:01:13.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.149+0000 7fd7f7284700 1 -- 172.21.15.6:0/1099732252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f00cd950 msgr2=0x7fd7f0071bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:13.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.149+0000 7fd7f7284700 1 --2- 172.21.15.6:0/1099732252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f00cd950 0x7fd7f0071bd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd7e00098f0 tx=0x7fd7e0009c00 comp rx=0 tx=0).stop 2023-07-07T04:01:13.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.150+0000 7fd7f7284700 1 -- 172.21.15.6:0/1099732252 shutdown_connections 2023-07-07T04:01:13.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.150+0000 7fd7f7284700 1 --2- 172.21.15.6:0/1099732252 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f00cd950 0x7fd7f0071bd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:13.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.150+0000 7fd7f7284700 1 --2- 172.21.15.6:0/1099732252 >> v2:172.21.15.40:3300/0 conn(0x7fd7f01592b0 0x7fd7f0071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:13.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.150+0000 7fd7f7284700 1 -- 172.21.15.6:0/1099732252 >> 172.21.15.6:0/1099732252 conn(0x7fd7f00cf960 msgr2=0x7fd7f00cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:13.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.150+0000 7fd7f7284700 1 -- 172.21.15.6:0/1099732252 shutdown_connections 2023-07-07T04:01:13.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.150+0000 7fd7f7284700 1 -- 172.21.15.6:0/1099732252 wait complete. 2023-07-07T04:01:13.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.152+0000 7fd7f7284700 1 Processor -- start 2023-07-07T04:01:13.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.152+0000 7fd7f7284700 1 -- start start 2023-07-07T04:01:13.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.153+0000 7fd7f7284700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f00cd950 0x7fd7f014c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:13.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.153+0000 7fd7f7284700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7f01592b0 0x7fd7f00b3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:13.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.153+0000 7fd7f7284700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f015cd40 0x7fd7f00b1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:13.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.153+0000 7fd7f7284700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f00b2790 con 0x7fd7f00cd950 2023-07-07T04:01:13.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.153+0000 7fd7f7284700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f00b29a0 con 0x7fd7f01592b0 2023-07-07T04:01:13.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.153+0000 7fd7f7284700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f00b2c80 con 0x7fd7f015cd40 2023-07-07T04:01:13.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.154+0000 7fd7f5821700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f015cd40 0x7fd7f00b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:13.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.154+0000 7fd7f5821700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f015cd40 0x7fd7f00b1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:40820/0 (socket says 172.21.15.6:40820) 2023-07-07T04:01:13.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.154+0000 7fd7f5821700 1 -- 172.21.15.6:0/2816408095 learned_addr learned my addr 172.21.15.6:0/2816408095 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:13.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.154+0000 7fd7f5020700 1 --2- 172.21.15.6:0/2816408095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f00cd950 0x7fd7f014c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:13.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.154+0000 7fd7f481f700 1 --2- 172.21.15.6:0/2816408095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7f01592b0 0x7fd7f00b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:13.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.154+0000 7fd7f5020700 1 -- 172.21.15.6:0/2816408095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f015cd40 msgr2=0x7fd7f00b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:13.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.154+0000 7fd7f5020700 1 --2- 172.21.15.6:0/2816408095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f015cd40 0x7fd7f00b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:13.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.154+0000 7fd7f5020700 1 -- 172.21.15.6:0/2816408095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7f01592b0 msgr2=0x7fd7f00b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:13.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.154+0000 7fd7f5020700 1 --2- 172.21.15.6:0/2816408095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7f01592b0 0x7fd7f00b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:13.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.154+0000 7fd7f5020700 1 -- 172.21.15.6:0/2816408095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e0009550 con 0x7fd7f00cd950 2023-07-07T04:01:13.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.156+0000 7fd7f5020700 1 --2- 172.21.15.6:0/2816408095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f00cd950 0x7fd7f014c980 secure :-1 s=READY pgs=3351 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800bd70 tx=0x7fd7e800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:13.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.156+0000 7fd7e5ffb700 1 -- 172.21.15.6:0/2816408095 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e800cc90 con 0x7fd7f00cd950 2023-07-07T04:01:13.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.156+0000 7fd7e5ffb700 1 -- 172.21.15.6:0/2816408095 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e800ce10 con 0x7fd7f00cd950 2023-07-07T04:01:13.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.156+0000 7fd7e5ffb700 1 -- 172.21.15.6:0/2816408095 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8014680 con 0x7fd7f00cd950 2023-07-07T04:01:13.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.156+0000 7fd7f7284700 1 -- 172.21.15.6:0/2816408095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f00b2f60 con 0x7fd7f00cd950 2023-07-07T04:01:13.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.156+0000 7fd7f7284700 1 -- 172.21.15.6:0/2816408095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f00b17c0 con 0x7fd7f00cd950 2023-07-07T04:01:13.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.158+0000 7fd7f7284700 1 -- 172.21.15.6:0/2816408095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f00b3480 con 0x7fd7f00cd950 2023-07-07T04:01:13.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.158+0000 7fd7e5ffb700 1 -- 172.21.15.6:0/2816408095 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd7e801d3b0 con 0x7fd7f00cd950 2023-07-07T04:01:13.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.158+0000 7fd7e5ffb700 1 --2- 172.21.15.6:0/2816408095 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd7d406ad10 0x7fd7d406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:13.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.159+0000 7fd7e5ffb700 1 -- 172.21.15.6:0/2816408095 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fd7e8089280 con 0x7fd7f00cd950 2023-07-07T04:01:13.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.162+0000 7fd7f481f700 1 --2- 172.21.15.6:0/2816408095 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd7d406ad10 0x7fd7d406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:13.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.163+0000 7fd7f481f700 1 --2- 172.21.15.6:0/2816408095 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd7d406ad10 0x7fd7d406d1c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd7f014cec0 tx=0x7fd7ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:13.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.165+0000 7fd7e5ffb700 1 -- 172.21.15.6:0/2816408095 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd7f00b3480 con 0x7fd7f00cd950 2023-07-07T04:01:13.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.552+0000 7fd7f7284700 1 -- 172.21.15.6:0/2816408095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd7f00b3480 con 0x7fd7f00cd950 2023-07-07T04:01:13.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.560+0000 7fd7e5ffb700 1 -- 172.21.15.6:0/2816408095 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd7f00b3480 con 0x7fd7f00cd950 2023-07-07T04:01:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.566+0000 7fd7f7284700 1 -- 172.21.15.6:0/2816408095 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd7d406ad10 msgr2=0x7fd7d406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.566+0000 7fd7f7284700 1 --2- 172.21.15.6:0/2816408095 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd7d406ad10 0x7fd7d406d1c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fd7f014cec0 tx=0x7fd7ec009040 comp rx=0 tx=0).stop 2023-07-07T04:01:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.566+0000 7fd7f7284700 1 -- 172.21.15.6:0/2816408095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f00cd950 msgr2=0x7fd7f014c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.566+0000 7fd7f7284700 1 --2- 172.21.15.6:0/2816408095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f00cd950 0x7fd7f014c980 secure :-1 s=READY pgs=3351 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800bd70 tx=0x7fd7e800bda0 comp rx=0 tx=0).stop 2023-07-07T04:01:13.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.569+0000 7fd7f7284700 1 -- 172.21.15.6:0/2816408095 shutdown_connections 2023-07-07T04:01:13.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.569+0000 7fd7f7284700 1 --2- 172.21.15.6:0/2816408095 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fd7d406ad10 0x7fd7d406d1c0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:13.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.569+0000 7fd7f7284700 1 --2- 172.21.15.6:0/2816408095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7f00cd950 0x7fd7f014c980 unknown :-1 s=CLOSED pgs=3351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:13.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.569+0000 7fd7f7284700 1 --2- 172.21.15.6:0/2816408095 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fd7f015cd40 0x7fd7f00b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:13.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.569+0000 7fd7f7284700 1 --2- 172.21.15.6:0/2816408095 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7f01592b0 0x7fd7f00b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:13.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.569+0000 7fd7f7284700 1 -- 172.21.15.6:0/2816408095 >> 172.21.15.6:0/2816408095 conn(0x7fd7f00cf960 msgr2=0x7fd7f006c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:13.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.569+0000 7fd7f7284700 1 -- 172.21.15.6:0/2816408095 shutdown_connections 2023-07-07T04:01:13.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.569+0000 7fd7f7284700 1 -- 172.21.15.6:0/2816408095 wait complete. 2023-07-07T04:01:13.598 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-07-07T04:01:13.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.875+0000 7f7454711700 1 Processor -- start 2023-07-07T04:01:13.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.876+0000 7f7454711700 1 -- start start 2023-07-07T04:01:13.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.878+0000 7f7454711700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f744c1590d0 0x7f744c070650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:13.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.878+0000 7f7454711700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f744c070b90 0x7f744c0b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:13.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.878+0000 7f7454711700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f744c0b33d0 0x7f744c0b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:13.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.878+0000 7f7454711700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f744c071000 con 0x7f744c0b33d0 2023-07-07T04:01:13.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.878+0000 7f7454711700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f744c15d8f0 con 0x7f744c070b90 2023-07-07T04:01:13.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.878+0000 7f7454711700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744c15ffb0 con 0x7f744c1590d0 2023-07-07T04:01:13.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.880+0000 7f7451cac700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f744c070b90 0x7f744c0b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:13.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.880+0000 7f7451cac700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f744c070b90 0x7f744c0b2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:55452/0 (socket says 172.21.15.6:55452) 2023-07-07T04:01:13.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.880+0000 7f7451cac700 1 -- 172.21.15.6:0/2508243175 learned_addr learned my addr 172.21.15.6:0/2508243175 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:13.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.880+0000 7f7452cae700 1 --2- 172.21.15.6:0/2508243175 >> v2:172.21.15.6:3300/0 conn(0x7f744c0b33d0 0x7f744c0b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:13.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.880+0000 7f74524ad700 1 --2- 172.21.15.6:0/2508243175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f744c1590d0 0x7f744c070650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:13.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.881+0000 7f7452cae700 1 -- 172.21.15.6:0/2508243175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f744c1590d0 msgr2=0x7f744c070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:13.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.881+0000 7f7452cae700 1 --2- 172.21.15.6:0/2508243175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f744c1590d0 0x7f744c070650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:13.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.881+0000 7f7452cae700 1 -- 172.21.15.6:0/2508243175 >> v2:172.21.15.40:3300/0 conn(0x7f744c070b90 msgr2=0x7f744c0b2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:13.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.881+0000 7f7452cae700 1 --2- 172.21.15.6:0/2508243175 >> v2:172.21.15.40:3300/0 conn(0x7f744c070b90 0x7f744c0b2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:13.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.881+0000 7f7452cae700 1 -- 172.21.15.6:0/2508243175 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c1594a0 con 0x7f744c0b33d0 2023-07-07T04:01:13.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.881+0000 7f7451cac700 1 --2- 172.21.15.6:0/2508243175 >> v2:172.21.15.40:3300/0 conn(0x7f744c070b90 0x7f744c0b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T04:01:13.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.881+0000 7f7452cae700 1 --2- 172.21.15.6:0/2508243175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744c0b33d0 0x7f744c0b18b0 secure :-1 s=READY pgs=3352 cs=0 l=1 rev1=1 crypto rx=0x7f744c0b1590 tx=0x7f7448009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcbdee9940035a42 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:13.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.882+0000 7f74514ab700 1 -- 172.21.15.6:0/2508243175 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7448011830 con 0x7f744c0b33d0 2023-07-07T04:01:13.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.882+0000 7f74514ab700 1 -- 172.21.15.6:0/2508243175 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7448011990 con 0x7f744c0b33d0 2023-07-07T04:01:13.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.882+0000 7f74514ab700 1 -- 172.21.15.6:0/2508243175 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7448011d20 con 0x7f744c0b33d0 2023-07-07T04:01:13.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.883+0000 7f7454711700 1 -- 172.21.15.6:0/2508243175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744c0b33d0 msgr2=0x7f744c0b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:13.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.883+0000 7f7454711700 1 --2- 172.21.15.6:0/2508243175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744c0b33d0 0x7f744c0b18b0 secure :-1 s=READY pgs=3352 cs=0 l=1 rev1=1 crypto rx=0x7f744c0b1590 tx=0x7f7448009b50 comp rx=0 tx=0).stop 2023-07-07T04:01:13.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.888+0000 7f7454711700 1 -- 172.21.15.6:0/2508243175 shutdown_connections 2023-07-07T04:01:13.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.888+0000 7f7454711700 1 --2- 172.21.15.6:0/2508243175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744c0b33d0 0x7f744c0b18b0 unknown :-1 s=CLOSED pgs=3352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:13.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.888+0000 7f7454711700 1 --2- 172.21.15.6:0/2508243175 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f744c1590d0 0x7f744c070650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:13.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.888+0000 7f7454711700 1 --2- 172.21.15.6:0/2508243175 >> v2:172.21.15.40:3300/0 conn(0x7f744c070b90 0x7f744c0b2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:13.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.888+0000 7f7454711700 1 -- 172.21.15.6:0/2508243175 >> 172.21.15.6:0/2508243175 conn(0x7f744c0b05b0 msgr2=0x7f744c0b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:13.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.893+0000 7f7454711700 1 -- 172.21.15.6:0/2508243175 shutdown_connections 2023-07-07T04:01:13.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.893+0000 7f7454711700 1 -- 172.21.15.6:0/2508243175 wait complete. 2023-07-07T04:01:13.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.895+0000 7f7454711700 1 Processor -- start 2023-07-07T04:01:13.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.896+0000 7f7454711700 1 -- start start 2023-07-07T04:01:13.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.897+0000 7f7454711700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f744c070b90 0x7f744c16e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:13.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.897+0000 7f7454711700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f744c0b33d0 0x7f744c1fed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:13.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.897+0000 7f7454711700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744c1590d0 0x7f744c15def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:13.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.897+0000 7f7454711700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744c16eb70 con 0x7f744c1590d0 2023-07-07T04:01:13.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.897+0000 7f7454711700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744c16ee50 con 0x7f744c0b33d0 2023-07-07T04:01:13.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.897+0000 7f7454711700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744c16f130 con 0x7f744c070b90 2023-07-07T04:01:13.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.898+0000 7f7452cae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744c1590d0 0x7f744c15def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:13.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.898+0000 7f7452cae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744c1590d0 0x7f744c15def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48194/0 (socket says 172.21.15.6:48194) 2023-07-07T04:01:13.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.898+0000 7f7452cae700 1 -- 172.21.15.6:0/1885828801 learned_addr learned my addr 172.21.15.6:0/1885828801 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:13.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.899+0000 7f7452cae700 1 -- 172.21.15.6:0/1885828801 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f744c070b90 msgr2=0x7f744c16e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:13.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.899+0000 7f7452cae700 1 --2- 172.21.15.6:0/1885828801 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f744c070b90 0x7f744c16e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:13.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.899+0000 7f7452cae700 1 -- 172.21.15.6:0/1885828801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f744c0b33d0 msgr2=0x7f744c1fed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:13.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.899+0000 7f7452cae700 1 --2- 172.21.15.6:0/1885828801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f744c0b33d0 0x7f744c1fed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:13.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.899+0000 7f7452cae700 1 -- 172.21.15.6:0/1885828801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c009550 con 0x7f744c1590d0 2023-07-07T04:01:13.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.899+0000 7f7452cae700 1 --2- 172.21.15.6:0/1885828801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744c1590d0 0x7f744c15def0 secure :-1 s=READY pgs=3353 cs=0 l=1 rev1=1 crypto rx=0x7f74480090b0 tx=0x7f7448004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:13.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.899+0000 7f7442ffd700 1 -- 172.21.15.6:0/1885828801 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74480044d0 con 0x7f744c1590d0 2023-07-07T04:01:13.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.899+0000 7f7442ffd700 1 -- 172.21.15.6:0/1885828801 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744801e070 con 0x7f744c1590d0 2023-07-07T04:01:13.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.899+0000 7f7454711700 1 -- 172.21.15.6:0/1885828801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74480094a0 con 0x7f744c1590d0 2023-07-07T04:01:13.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.899+0000 7f7442ffd700 1 -- 172.21.15.6:0/1885828801 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74480038c0 con 0x7f744c1590d0 2023-07-07T04:01:13.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.899+0000 7f7454711700 1 -- 172.21.15.6:0/1885828801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f744c16f6f0 con 0x7f744c1590d0 2023-07-07T04:01:13.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.902+0000 7f7442ffd700 1 -- 172.21.15.6:0/1885828801 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7448003a20 con 0x7f744c1590d0 2023-07-07T04:01:13.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.902+0000 7f7442ffd700 1 --2- 172.21.15.6:0/1885828801 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f743006ace0 0x7f743006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:13.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.903+0000 7f7442ffd700 1 -- 172.21.15.6:0/1885828801 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f744808a220 con 0x7f744c1590d0 2023-07-07T04:01:13.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.903+0000 7f7454711700 1 -- 172.21.15.6:0/1885828801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f744c0b2b70 con 0x7f744c1590d0 2023-07-07T04:01:13.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.910+0000 7f74524ad700 1 --2- 172.21.15.6:0/1885828801 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f743006ace0 0x7f743006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:13.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.911+0000 7f74524ad700 1 --2- 172.21.15.6:0/1885828801 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f743006ace0 0x7f743006d190 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f74440070b0 tx=0x7f7444007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:13.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:13.913+0000 7f7442ffd700 1 -- 172.21.15.6:0/1885828801 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f74480554a0 con 0x7f744c1590d0 2023-07-07T04:01:14.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:14.512+0000 7f7454711700 1 -- 172.21.15.6:0/1885828801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f744c16f8e0 con 0x7f744c1590d0 2023-07-07T04:01:14.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:14.955+0000 7f7442ffd700 1 -- 172.21.15.6:0/1885828801 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v14560) v1 ==== 144+0+0 (secure 0 0 0) 0x7f7448020030 con 0x7f744c1590d0 2023-07-07T04:01:14.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:14.968+0000 7f7454711700 1 -- 172.21.15.6:0/1885828801 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f743006ace0 msgr2=0x7f743006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:14.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:14.968+0000 7f7454711700 1 --2- 172.21.15.6:0/1885828801 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f743006ace0 0x7f743006d190 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f74440070b0 tx=0x7f7444007040 comp rx=0 tx=0).stop 2023-07-07T04:01:14.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:14.968+0000 7f7454711700 1 -- 172.21.15.6:0/1885828801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744c1590d0 msgr2=0x7f744c15def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:14.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:14.968+0000 7f7454711700 1 --2- 172.21.15.6:0/1885828801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744c1590d0 0x7f744c15def0 secure :-1 s=READY pgs=3353 cs=0 l=1 rev1=1 crypto rx=0x7f74480090b0 tx=0x7f7448004750 comp rx=0 tx=0).stop 2023-07-07T04:01:14.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:14.969+0000 7f7454711700 1 -- 172.21.15.6:0/1885828801 shutdown_connections 2023-07-07T04:01:14.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:14.969+0000 7f7454711700 1 --2- 172.21.15.6:0/1885828801 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f743006ace0 0x7f743006d190 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:14.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:14.969+0000 7f7454711700 1 --2- 172.21.15.6:0/1885828801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f744c1590d0 0x7f744c15def0 unknown :-1 s=CLOSED pgs=3353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:14.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:14.969+0000 7f7454711700 1 --2- 172.21.15.6:0/1885828801 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f744c070b90 0x7f744c16e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:14.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:14.969+0000 7f7454711700 1 --2- 172.21.15.6:0/1885828801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f744c0b33d0 0x7f744c1fed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:14.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:14.969+0000 7f7454711700 1 -- 172.21.15.6:0/1885828801 >> 172.21.15.6:0/1885828801 conn(0x7f744c0b05b0 msgr2=0x7f744c0cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:14.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:14.971+0000 7f7454711700 1 -- 172.21.15.6:0/1885828801 shutdown_connections 2023-07-07T04:01:14.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:14.972+0000 7f7454711700 1 -- 172.21.15.6:0/1885828801 wait complete. 2023-07-07T04:01:14.998 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2023-07-07T04:01:14.998 INFO:tasks.cephfs_test_runner: 2023-07-07T04:01:14.998 INFO:tasks.cephfs_test_runner:====================================================================== 2023-07-07T04:01:14.999 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-07-07T04:01:14.999 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-07T04:01:14.999 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-07-07T04:01:14.999 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_79365bb3b803780276d69efb2cc4afe5b160de9e/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-07-07T04:01:14.999 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-07-07T04:01:15.000 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_79365bb3b803780276d69efb2cc4afe5b160de9e/qa/tasks/cephfs/xfstests_dev.py", line 387, in run_generic_tests 2023-07-07T04:01:15.000 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-07-07T04:01:15.000 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_79365bb3b803780276d69efb2cc4afe5b160de9e/qa/tasks/cephfs/xfstests_dev.py", line 379, in run_testdir 2023-07-07T04:01:15.000 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2023-07-07T04:01:15.000 INFO:tasks.cephfs_test_runner:AssertionError: 2 != 0 2023-07-07T04:01:15.001 INFO:tasks.cephfs_test_runner: 2023-07-07T04:01:15.001 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-07T04:01:15.001 INFO:tasks.cephfs_test_runner:Ran 1 test in 28885.981s 2023-07-07T04:01:15.001 INFO:tasks.cephfs_test_runner: 2023-07-07T04:01:15.001 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2023-07-07T04:01:15.002 INFO:tasks.cephfs_test_runner: 2023-07-07T04:01:15.002 INFO:tasks.cephfs_test_runner:====================================================================== 2023-07-07T04:01:15.002 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-07-07T04:01:15.002 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-07T04:01:15.002 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-07-07T04:01:15.003 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_79365bb3b803780276d69efb2cc4afe5b160de9e/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-07-07T04:01:15.003 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-07-07T04:01:15.003 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_79365bb3b803780276d69efb2cc4afe5b160de9e/qa/tasks/cephfs/xfstests_dev.py", line 387, in run_generic_tests 2023-07-07T04:01:15.003 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-07-07T04:01:15.003 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_79365bb3b803780276d69efb2cc4afe5b160de9e/qa/tasks/cephfs/xfstests_dev.py", line 379, in run_testdir 2023-07-07T04:01:15.003 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2023-07-07T04:01:15.004 INFO:tasks.cephfs_test_runner:AssertionError: 2 != 0 2023-07-07T04:01:15.004 INFO:tasks.cephfs_test_runner: 2023-07-07T04:01:15.004 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_79365bb3b803780276d69efb2cc4afe5b160de9e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-07-07T04:01:15.067 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=dcf48721361549959f52956ab70b7641 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b53f236c1077f1d295baafb9e0ca9a4b447019d7/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_79365bb3b803780276d69efb2cc4afe5b160de9e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-07-07T04:01:15.068 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-07-07T04:01:15.079 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-07-07T04:01:15.195 INFO:tasks.kclient:Unmounting kernel clients... 2023-07-07T04:01:15.195 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-07T04:01:15.196 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T04:01:15.266 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16755 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 tmpfs /run/user/10101 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=10101,gid=10101 0 0 2023-07-07T04:01:15.266 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-07-07T04:01:15.266 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T04:01:15.348 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=31,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16755 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 tmpfs /run/user/10101 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=10101,gid=10101 0 0 2023-07-07T04:01:15.349 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-07T04:01:15.349 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T04:01:15.411 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=44,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13568 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-07T04:01:15.411 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2023-07-07T04:01:15.412 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-07T04:01:15.491 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=44,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=13568 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-07-07T04:01:15.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T04:01:15.491 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-07T04:01:15.584 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-07T04:01:15.585 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-07T04:01:15.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T04:01:15.585 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-07T04:01:15.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T04:01:15.707 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-07T04:01:15.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T04:01:15.824 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2023-07-07T04:01:16.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T04:01:16.018 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-07-07T04:01:16.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T04:01:16.083 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2023-07-07T04:01:16.200 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-07T04:01:16.201 INFO:teuthology.orchestra.run.smithi006.stderr:Cannot find device "ceph-brx" 2023-07-07T04:01:16.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T04:01:16.202 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-07-07T04:01:16.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-07T04:01:16.289 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-07T04:01:16.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T04:01:16.290 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-07T04:01:16.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T04:01:16.395 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-07T04:01:16.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T04:01:16.564 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2023-07-07T04:01:16.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T04:01:16.752 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2023-07-07T04:01:16.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-07T04:01:16.798 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2023-07-07T04:01:17.014 INFO:teuthology.orchestra.run.smithi040.stderr:Cannot find device "ceph-brx" 2023-07-07T04:01:17.015 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-07T04:01:17.016 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-07-07T04:01:17.025 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-07T04:01:17.025 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-07T04:01:17.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.295+0000 7f8878502700 1 Processor -- start 2023-07-07T04:01:17.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.296+0000 7f8878502700 1 -- start start 2023-07-07T04:01:17.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.297+0000 7f8878502700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f88700b2330 0x7f88700b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:17.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.297+0000 7f8878502700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f887015c3c0 0x7f887015c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:17.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.297+0000 7f8878502700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88700b2d80 con 0x7f8870159ae0 2023-07-07T04:01:17.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.297+0000 7f8878502700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8870159000 con 0x7f887015c3c0 2023-07-07T04:01:17.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.297+0000 7f8878502700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88701592e0 con 0x7f88700b2330 2023-07-07T04:01:17.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.297+0000 7f8876a9f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f887015c3c0 0x7f887015c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:17.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.298+0000 7f8876a9f700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f887015c3c0 0x7f887015c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48198/0 (socket says 172.21.15.6:48198) 2023-07-07T04:01:17.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.298+0000 7f8876a9f700 1 -- 172.21.15.6:0/37193795 learned_addr learned my addr 172.21.15.6:0/37193795 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:17.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.298+0000 7f8876a9f700 1 -- 172.21.15.6:0/37193795 >> v2:172.21.15.40:3300/0 conn(0x7f88700b2330 msgr2=0x7f88700b2780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-07T04:01:17.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.298+0000 7f8876a9f700 1 --2- 172.21.15.6:0/37193795 >> v2:172.21.15.40:3300/0 conn(0x7f88700b2330 0x7f88700b2780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:17.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.298+0000 7f8876a9f700 1 -- 172.21.15.6:0/37193795 >> v1:172.21.15.40:6789/0 conn(0x7f8870159ae0 legacy=0x7f88701587d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-07T04:01:17.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.298+0000 7f8876a9f700 1 -- 172.21.15.6:0/37193795 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88701595c0 con 0x7f887015c3c0 2023-07-07T04:01:17.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.298+0000 7f8876a9f700 1 --2- 172.21.15.6:0/37193795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f887015c3c0 0x7f887015c860 secure :-1 s=READY pgs=3354 cs=0 l=1 rev1=1 crypto rx=0x7f88700b1540 tx=0x7f886800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7357e19b5003893 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:17.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.299+0000 7f887529c700 1 -- 172.21.15.6:0/37193795 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886800e070 con 0x7f887015c3c0 2023-07-07T04:01:17.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.299+0000 7f887529c700 1 -- 172.21.15.6:0/37193795 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8868003a20 con 0x7f887015c3c0 2023-07-07T04:01:17.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.299+0000 7f887529c700 1 -- 172.21.15.6:0/37193795 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8868003dd0 con 0x7f887015c3c0 2023-07-07T04:01:17.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.300+0000 7f8878502700 1 -- 172.21.15.6:0/37193795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f887015c3c0 msgr2=0x7f887015c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:17.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.300+0000 7f8878502700 1 --2- 172.21.15.6:0/37193795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f887015c3c0 0x7f887015c860 secure :-1 s=READY pgs=3354 cs=0 l=1 rev1=1 crypto rx=0x7f88700b1540 tx=0x7f886800b330 comp rx=0 tx=0).stop 2023-07-07T04:01:17.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.306+0000 7f8878502700 1 -- 172.21.15.6:0/37193795 shutdown_connections 2023-07-07T04:01:17.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.306+0000 7f8878502700 1 --2- 172.21.15.6:0/37193795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f887015c3c0 0x7f887015c860 unknown :-1 s=CLOSED pgs=3354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:17.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.306+0000 7f8878502700 1 --2- 172.21.15.6:0/37193795 >> v2:172.21.15.40:3300/0 conn(0x7f88700b2330 0x7f88700b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:17.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.306+0000 7f8878502700 1 -- 172.21.15.6:0/37193795 >> 172.21.15.6:0/37193795 conn(0x7f88700b05b0 msgr2=0x7f88700b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:17.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.307+0000 7f8878502700 1 -- 172.21.15.6:0/37193795 shutdown_connections 2023-07-07T04:01:17.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.308+0000 7f8878502700 1 -- 172.21.15.6:0/37193795 wait complete. 2023-07-07T04:01:17.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.310+0000 7f8878502700 1 Processor -- start 2023-07-07T04:01:17.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.313+0000 7f8878502700 1 -- start start 2023-07-07T04:01:17.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.314+0000 7f8878502700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88700b2330 0x7f88701461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:17.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.315+0000 7f8878502700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8870159ae0 0x7f8870133a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:17.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.315+0000 7f8878502700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f887015c3c0 0x7f8870141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:17.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.315+0000 7f8878502700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887016acd0 con 0x7f887015c3c0 2023-07-07T04:01:17.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.315+0000 7f8878502700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887016ae40 con 0x7f8870159ae0 2023-07-07T04:01:17.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.315+0000 7f8878502700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887016b000 con 0x7f88700b2330 2023-07-07T04:01:17.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.316+0000 7f8876a9f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f887015c3c0 0x7f8870141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:17.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.316+0000 7f8876a9f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f887015c3c0 0x7f8870141fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48202/0 (socket says 172.21.15.6:48202) 2023-07-07T04:01:17.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.316+0000 7f8876a9f700 1 -- 172.21.15.6:0/4125314128 learned_addr learned my addr 172.21.15.6:0/4125314128 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:17.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.316+0000 7f8875a9d700 1 --2- 172.21.15.6:0/4125314128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8870159ae0 0x7f8870133a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:17.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.317+0000 7f8875a9d700 1 -- 172.21.15.6:0/4125314128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88700b2330 msgr2=0x7f88701461e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-07T04:01:17.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.317+0000 7f8875a9d700 1 --2- 172.21.15.6:0/4125314128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88700b2330 0x7f88701461e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:17.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.317+0000 7f8875a9d700 1 -- 172.21.15.6:0/4125314128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f887015c3c0 msgr2=0x7f8870141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:17.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.317+0000 7f8875a9d700 1 --2- 172.21.15.6:0/4125314128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f887015c3c0 0x7f8870141fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:17.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.317+0000 7f8875a9d700 1 -- 172.21.15.6:0/4125314128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8868009b30 con 0x7f8870159ae0 2023-07-07T04:01:17.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.318+0000 7f8875a9d700 1 --2- 172.21.15.6:0/4125314128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8870159ae0 0x7f8870133a20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f886c006fd0 tx=0x7f886c00b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:17.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.323+0000 7f8866ffd700 1 -- 172.21.15.6:0/4125314128 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c011830 con 0x7f8870159ae0 2023-07-07T04:01:17.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.323+0000 7f8866ffd700 1 -- 172.21.15.6:0/4125314128 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886c0119b0 con 0x7f8870159ae0 2023-07-07T04:01:17.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.323+0000 7f8866ffd700 1 -- 172.21.15.6:0/4125314128 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c011d60 con 0x7f8870159ae0 2023-07-07T04:01:17.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.324+0000 7f8878502700 1 -- 172.21.15.6:0/4125314128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f887016b2e0 con 0x7f8870159ae0 2023-07-07T04:01:17.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.324+0000 7f8878502700 1 -- 172.21.15.6:0/4125314128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887016b5c0 con 0x7f8870159ae0 2023-07-07T04:01:17.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.326+0000 7f8878502700 1 -- 172.21.15.6:0/4125314128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8870137820 con 0x7f8870159ae0 2023-07-07T04:01:17.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.326+0000 7f8866ffd700 1 -- 172.21.15.6:0/4125314128 <== mon.1 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f886c01a410 con 0x7f8870159ae0 2023-07-07T04:01:17.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.327+0000 7f8866ffd700 1 --2- 172.21.15.6:0/4125314128 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f885c06aef0 0x7f885c06d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:17.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.327+0000 7f8866ffd700 1 -- 172.21.15.6:0/4125314128 <== mon.1 v2:172.21.15.40:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f886c088b00 con 0x7f8870159ae0 2023-07-07T04:01:17.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.335+0000 7f8866ffd700 1 -- 172.21.15.6:0/4125314128 <== mon.1 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f886c053f00 con 0x7f8870159ae0 2023-07-07T04:01:17.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.340+0000 7f887629e700 1 --2- 172.21.15.6:0/4125314128 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f885c06aef0 0x7f885c06d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:17.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.341+0000 7f887629e700 1 --2- 172.21.15.6:0/4125314128 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f885c06aef0 0x7f885c06d3a0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f8860009710 tx=0x7f8860006c60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:17.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.688+0000 7f8878502700 1 -- 172.21.15.6:0/4125314128 --> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f887015cda0 con 0x7f885c06aef0 2023-07-07T04:01:17.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.694+0000 7f8866ffd700 1 -- 172.21.15.6:0/4125314128 <== mgr.4110 v2:172.21.15.6:6832/201543369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71422 (secure 0 0 0) 0x7f8860013400 con 0x7f885c06aef0 2023-07-07T04:01:17.697 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:01:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.698+0000 7f8878502700 1 -- 172.21.15.6:0/4125314128 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f885c06aef0 msgr2=0x7f885c06d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.698+0000 7f8878502700 1 --2- 172.21.15.6:0/4125314128 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f885c06aef0 0x7f885c06d3a0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f8860009710 tx=0x7f8860006c60 comp rx=0 tx=0).stop 2023-07-07T04:01:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.698+0000 7f8878502700 1 -- 172.21.15.6:0/4125314128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8870159ae0 msgr2=0x7f8870133a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.698+0000 7f8878502700 1 --2- 172.21.15.6:0/4125314128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8870159ae0 0x7f8870133a20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f886c006fd0 tx=0x7f886c00b730 comp rx=0 tx=0).stop 2023-07-07T04:01:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.699+0000 7f8878502700 1 -- 172.21.15.6:0/4125314128 shutdown_connections 2023-07-07T04:01:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.699+0000 7f8878502700 1 --2- 172.21.15.6:0/4125314128 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f885c06aef0 0x7f885c06d3a0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.699+0000 7f8878502700 1 --2- 172.21.15.6:0/4125314128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f887015c3c0 0x7f8870141fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.699+0000 7f8878502700 1 --2- 172.21.15.6:0/4125314128 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f88700b2330 0x7f88701461e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.699+0000 7f8878502700 1 --2- 172.21.15.6:0/4125314128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8870159ae0 0x7f8870133a20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:17.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.699+0000 7f8878502700 1 -- 172.21.15.6:0/4125314128 >> 172.21.15.6:0/4125314128 conn(0x7f88700b05b0 msgr2=0x7f887006a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:17.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.699+0000 7f8878502700 1 -- 172.21.15.6:0/4125314128 shutdown_connections 2023-07-07T04:01:17.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.699+0000 7f8878502700 1 -- 172.21.15.6:0/4125314128 wait complete. 2023-07-07T04:01:17.702 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-07T04:01:17.717 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":14509,"stamp":"2023-07-07T04:01:15.945002+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":63447840,"kb_used_data":51480260,"kb_used_omap":151204,"kb_used_meta":11703899,"kb_avail":691526880,"statfs":{"total":773094113280,"available":708123525120,"internally_reserved":0,"allocated":52715786240,"data_stored":52692286697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":154833875,"internal_metadata":11984792621},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":291,"apply_latency_ms":291,"commit_latency_ns":291000000,"apply_latency_ns":291000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-63863244667,"num_objects":-45149,"num_object_clones":0,"num_object_copies":-90298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-45149,"num_whiteouts":0,"num_read":-1564873,"num_read_kb":-372837003,"num_write":-3149060,"num_write_kb":-618200878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-3621,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.023959"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":295,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.917698+0000","last_change":"2023-07-06T19:58:47.723855+0000","last_active":"2023-07-07T04:01:12.917698+0000","last_peered":"2023-07-07T04:01:12.917698+0000","last_clean":"2023-07-07T04:01:12.917698+0000","last_became_active":"2023-07-06T19:58:47.723553+0000","last_became_peered":"2023-07-06T19:58:47.723553+0000","last_unstale":"2023-07-07T04:01:12.917698+0000","last_undegraded":"2023-07-07T04:01:12.917698+0000","last_fullsized":"2023-07-07T04:01:12.917698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:11:58.031720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":290,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.961276+0000","last_change":"2023-07-06T19:58:47.705294+0000","last_active":"2023-07-07T04:01:12.961276+0000","last_peered":"2023-07-07T04:01:12.961276+0000","last_clean":"2023-07-07T04:01:12.961276+0000","last_became_active":"2023-07-06T19:58:47.704921+0000","last_became_peered":"2023-07-06T19:58:47.704921+0000","last_unstale":"2023-07-07T04:01:12.961276+0000","last_undegraded":"2023-07-07T04:01:12.961276+0000","last_fullsized":"2023-07-07T04:01:12.961276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:13:52.238597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":291,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:13.296600+0000","last_change":"2023-07-06T19:58:47.766992+0000","last_active":"2023-07-07T04:01:13.296600+0000","last_peered":"2023-07-07T04:01:13.296600+0000","last_clean":"2023-07-07T04:01:13.296600+0000","last_became_active":"2023-07-06T19:58:47.766697+0000","last_became_peered":"2023-07-06T19:58:47.766697+0000","last_unstale":"2023-07-07T04:01:13.296600+0000","last_undegraded":"2023-07-07T04:01:13.296600+0000","last_fullsized":"2023-07-07T04:01:13.296600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:23:14.562370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":290,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.934144+0000","last_change":"2023-07-06T19:58:47.704498+0000","last_active":"2023-07-07T04:01:12.934144+0000","last_peered":"2023-07-07T04:01:12.934144+0000","last_clean":"2023-07-07T04:01:12.934144+0000","last_became_active":"2023-07-06T19:58:47.704172+0000","last_became_peered":"2023-07-06T19:58:47.704172+0000","last_unstale":"2023-07-07T04:01:12.934144+0000","last_undegraded":"2023-07-07T04:01:12.934144+0000","last_fullsized":"2023-07-07T04:01:12.934144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:02:36.844807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"43'161","reported_seq":510,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.946359+0000","last_change":"2023-07-06T19:58:40.972763+0000","last_active":"2023-07-07T04:01:12.946359+0000","last_peered":"2023-07-07T04:01:12.946359+0000","last_clean":"2023-07-07T04:01:12.946359+0000","last_became_active":"2023-07-06T19:58:40.971570+0000","last_became_peered":"2023-07-06T19:58:40.971570+0000","last_unstale":"2023-07-07T04:01:12.946359+0000","last_undegraded":"2023-07-07T04:01:12.946359+0000","last_fullsized":"2023-07-07T04:01:12.946359+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_clean_scrub_stamp":"2023-07-06T19:58:39.653546+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:31:36.048493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":301,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.946495+0000","last_change":"2023-07-06T19:58:47.708545+0000","last_active":"2023-07-07T04:01:12.946495+0000","last_peered":"2023-07-07T04:01:12.946495+0000","last_clean":"2023-07-07T04:01:12.946495+0000","last_became_active":"2023-07-06T19:58:47.708230+0000","last_became_peered":"2023-07-06T19:58:47.708230+0000","last_unstale":"2023-07-07T04:01:12.946495+0000","last_undegraded":"2023-07-07T04:01:12.946495+0000","last_fullsized":"2023-07-07T04:01:12.946495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:31:37.154591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":289,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.947328+0000","last_change":"2023-07-06T19:58:47.723926+0000","last_active":"2023-07-07T04:01:12.947328+0000","last_peered":"2023-07-07T04:01:12.947328+0000","last_clean":"2023-07-07T04:01:12.947328+0000","last_became_active":"2023-07-06T19:58:47.723646+0000","last_became_peered":"2023-07-06T19:58:47.723646+0000","last_unstale":"2023-07-07T04:01:12.947328+0000","last_undegraded":"2023-07-07T04:01:12.947328+0000","last_fullsized":"2023-07-07T04:01:12.947328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:37:22.324090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":288,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.920569+0000","last_change":"2023-07-06T19:58:47.711918+0000","last_active":"2023-07-07T04:01:12.920569+0000","last_peered":"2023-07-07T04:01:12.920569+0000","last_clean":"2023-07-07T04:01:12.920569+0000","last_became_active":"2023-07-06T19:58:47.711591+0000","last_became_peered":"2023-07-06T19:58:47.711591+0000","last_unstale":"2023-07-07T04:01:12.920569+0000","last_undegraded":"2023-07-07T04:01:12.920569+0000","last_fullsized":"2023-07-07T04:01:12.920569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:31:20.169556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":285,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.925775+0000","last_change":"2023-07-06T19:58:47.712143+0000","last_active":"2023-07-07T04:01:12.925775+0000","last_peered":"2023-07-07T04:01:12.925775+0000","last_clean":"2023-07-07T04:01:12.925775+0000","last_became_active":"2023-07-06T19:58:47.711788+0000","last_became_peered":"2023-07-06T19:58:47.711788+0000","last_unstale":"2023-07-07T04:01:12.925775+0000","last_undegraded":"2023-07-07T04:01:12.925775+0000","last_fullsized":"2023-07-07T04:01:12.925775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:48:00.551095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580636,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6657892,"kb_used_data":5039644,"kb_used_omap":28457,"kb_used_meta":1589782,"kb_avail":87713948,"statfs":{"total":96636764160,"available":89819082752,"internally_reserved":0,"allocated":5160595456,"data_stored":5158230903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29140457,"internal_metadata":1627937303},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":2.7480000000000002,"5min":1.383,"15min":1.196},"min":{"1min":0.25900000000000001,"5min":0.24299999999999999,"15min":0.24199999999999999},"max":{"1min":32.406999999999996,"5min":32.406999999999996,"15min":32.406999999999996},"last":2.5960000000000001},{"interface":"front","average":{"1min":3.1840000000000002,"5min":1.9730000000000001,"15min":1.625},"min":{"1min":0.30099999999999999,"5min":0.29399999999999998,"15min":0.26900000000000002},"max":{"1min":24.928999999999998,"5min":24.928999999999998,"15min":24.928999999999998},"last":8.3360000000000003}]},{"osd":1,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":3.4169999999999998,"5min":1.7869999999999999,"15min":1.524},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":32.445,"5min":32.445,"15min":32.445},"last":12.093999999999999},{"interface":"front","average":{"1min":2.4830000000000001,"5min":1.8180000000000001,"15min":1.8839999999999999},"min":{"1min":0.315,"5min":0.29999999999999999,"15min":0.29299999999999998},"max":{"1min":24.966000000000001,"5min":24.966000000000001,"15min":24.966000000000001},"last":12}]},{"osd":2,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":4.1609999999999996,"5min":2.2440000000000002,"15min":1.887},"min":{"1min":0.376,"5min":0.35199999999999998,"15min":0.32200000000000001},"max":{"1min":36.658999999999999,"5min":36.658999999999999,"15min":36.658999999999999},"last":2.4860000000000002},{"interface":"front","average":{"1min":3.3159999999999998,"5min":2.4249999999999998,"15min":2},"min":{"1min":0.41299999999999998,"5min":0.38400000000000001,"15min":0.32900000000000001},"max":{"1min":32.369,"5min":32.369,"15min":32.369},"last":2.3860000000000001}]},{"osd":3,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":5.9930000000000003,"5min":2.9969999999999999,"15min":2.2930000000000001},"min":{"1min":0.39500000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":74.998000000000005,"5min":74.998000000000005,"15min":74.998000000000005},"last":4.484},{"interface":"front","average":{"1min":3.0670000000000002,"5min":2.085,"15min":1.99},"min":{"1min":0.39300000000000002,"5min":0.35799999999999998,"15min":0.33500000000000002},"max":{"1min":16.452999999999999,"5min":16.452999999999999,"15min":16.452999999999999},"last":2.4449999999999998}]},{"osd":4,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":3.7010000000000001,"5min":1.6870000000000001,"15min":1.5049999999999999},"min":{"1min":0.30399999999999999,"5min":0.29299999999999998,"15min":0.28599999999999998},"max":{"1min":59.920999999999999,"5min":59.920999999999999,"15min":59.920999999999999},"last":2.4249999999999998},{"interface":"front","average":{"1min":2.9910000000000001,"5min":1.696,"15min":1.49},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":36.616999999999997,"5min":36.616999999999997,"15min":36.616999999999997},"last":2.536}]},{"osd":5,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":2.508,"5min":1.3720000000000001,"15min":1.282},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":16.904,"5min":16.904,"15min":16.904},"last":7.9089999999999998},{"interface":"front","average":{"1min":2.6110000000000002,"5min":1.6379999999999999,"15min":1.639},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":24.811,"5min":24.811,"15min":24.811},"last":2.4750000000000001}]},{"osd":6,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":3.6749999999999998,"5min":1.9830000000000001,"15min":1.8160000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":60.188000000000002,"5min":60.188000000000002,"15min":60.188000000000002},"last":2.5219999999999998},{"interface":"front","average":{"1min":2.8679999999999999,"5min":1.6719999999999999,"15min":1.5149999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":24.065999999999999,"5min":24.065999999999999,"15min":24.065999999999999},"last":2.5760000000000001}]}]},{"osd":6,"up_from":13,"seq":55834580632,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9669504,"kb_used_data":7709716,"kb_used_omap":17122,"kb_used_meta":1909405,"kb_avail":84702336,"statfs":{"total":96636764160,"available":86735192064,"internally_reserved":0,"allocated":7894749184,"data_stored":7891441954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17533718,"internal_metadata":1955230954},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":51,"apply_latency_ms":51,"commit_latency_ns":51000000,"apply_latency_ns":51000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.5629999999999999,"15min":1.411},"min":{"1min":0.28299999999999997,"5min":0.249,"15min":0.24099999999999999},"max":{"1min":5.9420000000000002,"5min":13.332000000000001,"15min":21.984999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":5.4770000000000003,"5min":2.4609999999999999,"15min":1.9179999999999999},"min":{"1min":0.28699999999999998,"5min":0.27800000000000002,"15min":0.246},"max":{"1min":65.186000000000007,"5min":65.186000000000007,"15min":65.186000000000007},"last":0.83299999999999996}]},{"osd":1,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":3.6629999999999998,"5min":2.524,"15min":2.0920000000000001},"min":{"1min":0.316,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":15.278,"5min":17.091999999999999,"15min":22.117000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":4.4720000000000004,"5min":2.1349999999999998,"15min":1.821},"min":{"1min":0.33500000000000002,"5min":0.29999999999999999,"15min":0.28899999999999998},"max":{"1min":40.649000000000001,"5min":40.649000000000001,"15min":40.649000000000001},"last":1.0029999999999999}]},{"osd":2,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":2.4279999999999999,"5min":2.0710000000000002,"15min":1.9770000000000001},"min":{"1min":0.32900000000000001,"5min":0.32400000000000001,"15min":0.30599999999999999},"max":{"1min":9.3309999999999995,"5min":13.196999999999999,"15min":22.210000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":2.7490000000000001,"5min":2.0750000000000002,"15min":1.877},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.30499999999999999},"max":{"1min":15.545999999999999,"5min":15.545999999999999,"15min":22.280000000000001},"last":0.93200000000000005}]},{"osd":3,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":8.5969999999999995,"5min":3.4540000000000002,"15min":2.5979999999999999},"min":{"1min":0.41499999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":111.95399999999999,"5min":111.95399999999999,"15min":111.95399999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":6.9690000000000003,"5min":3.032,"15min":2.3740000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.33700000000000002},"max":{"1min":112.504,"5min":112.504,"15min":112.504},"last":0.96399999999999997}]},{"osd":4,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":2.1739999999999999,"5min":1.2589999999999999,"15min":1.2929999999999999},"min":{"1min":0.34200000000000003,"5min":0.308,"15min":0.27700000000000002},"max":{"1min":15.587999999999999,"5min":15.587999999999999,"15min":22.225000000000001},"last":0.623},{"interface":"front","average":{"1min":2.1890000000000001,"5min":1.716,"15min":1.6020000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":15.205,"5min":15.205,"15min":22.265999999999998},"last":0.86899999999999999}]},{"osd":5,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":3.956,"5min":2.1339999999999999,"15min":1.885},"min":{"1min":0.39300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":38.103000000000002,"5min":38.103000000000002,"15min":38.103000000000002},"last":0.90500000000000003},{"interface":"front","average":{"1min":3.77,"5min":2.0179999999999998,"15min":1.6579999999999999},"min":{"1min":0.41199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":37.863,"5min":37.863,"15min":37.863},"last":0.78000000000000003}]},{"osd":7,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":1.8129999999999999,"5min":1.4279999999999999,"15min":1.359},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.32300000000000001},"max":{"1min":15.507,"5min":15.507,"15min":22.395},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.7569999999999999,"5min":1.597,"15min":1.4910000000000001},"min":{"1min":0.39500000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":15.471,"5min":15.471,"15min":22.43},"last":0.81000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834580612,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5177288,"kb_used_data":4175360,"kb_used_omap":18390,"kb_used_meta":946281,"kb_avail":89194552,"statfs":{"total":96636764160,"available":91335221248,"internally_reserved":0,"allocated":4275568640,"data_stored":4273643280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18831879,"internal_metadata":968992249},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":3.1869999999999998,"5min":1.788,"15min":1.4410000000000001},"min":{"1min":0.26200000000000001,"5min":0.254,"15min":0.23300000000000001},"max":{"1min":23.021000000000001,"5min":23.021000000000001,"15min":23.021000000000001},"last":2.895},{"interface":"front","average":{"1min":2.855,"5min":2.2010000000000001,"15min":1.829},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.248},"max":{"1min":16.084,"5min":16.084,"15min":16.084},"last":2.835}]},{"osd":2,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":4.2939999999999996,"5min":2.23,"15min":1.8200000000000001},"min":{"1min":0.27800000000000002,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":28.513999999999999,"5min":28.513999999999999,"15min":28.513999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":4.1740000000000004,"5min":2.4169999999999998,"15min":2.1360000000000001},"min":{"1min":0.30599999999999999,"5min":0.28699999999999998,"15min":0.26200000000000001},"max":{"1min":28.352,"5min":28.352,"15min":28.352},"last":0.89300000000000002}]},{"osd":3,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":4.9790000000000001,"5min":2.976,"15min":2.3900000000000001},"min":{"1min":0.32700000000000001,"5min":0.32100000000000001,"15min":0.28100000000000003},"max":{"1min":21.620999999999999,"5min":21.620999999999999,"15min":21.620999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":3.129,"5min":2.2559999999999998,"15min":1.8029999999999999},"min":{"1min":0.38200000000000001,"5min":0.34699999999999998,"15min":0.29999999999999999},"max":{"1min":15.952,"5min":15.952,"15min":15.952},"last":0.66300000000000003}]},{"osd":4,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":3.7829999999999999,"5min":2.085,"15min":1.6659999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":23.071999999999999,"5min":23.071999999999999,"15min":23.071999999999999},"last":2.8540000000000001},{"interface":"front","average":{"1min":2.9729999999999999,"5min":2.3849999999999998,"15min":1.9850000000000001},"min":{"1min":0.40400000000000003,"5min":0.379,"15min":0.35899999999999999},"max":{"1min":11.039,"5min":11.039,"15min":11.039},"last":2.7919999999999998}]},{"osd":5,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":2.7589999999999999,"5min":2.3050000000000002,"15min":2.1160000000000001},"min":{"1min":0.45100000000000001,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":11.085000000000001,"5min":11.085000000000001,"15min":17.998000000000001},"last":1.506},{"interface":"front","average":{"1min":3.4790000000000001,"5min":2.3980000000000001,"15min":2.2519999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":21.696000000000002,"5min":21.696000000000002,"15min":21.696000000000002},"last":2.7000000000000002}]},{"osd":6,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":8.3789999999999996,"5min":3.2909999999999999,"15min":2.2250000000000001},"min":{"1min":0.48799999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":83.441999999999993,"5min":83.441999999999993,"15min":83.441999999999993},"last":3.7269999999999999},{"interface":"front","average":{"1min":7.742,"5min":3.524,"15min":2.669},"min":{"1min":0.51900000000000002,"5min":0.48699999999999999,"15min":0.45900000000000002},"max":{"1min":60.134,"5min":60.134,"15min":60.134},"last":1.5509999999999999}]},{"osd":7,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":3.5329999999999999,"5min":2.2530000000000001,"15min":2.2669999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":21.495000000000001,"5min":21.495000000000001,"15min":21.495000000000001},"last":11.798},{"interface":"front","average":{"1min":4.7720000000000002,"5min":2.7719999999999998,"15min":2.5339999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45700000000000002},"max":{"1min":21.449000000000002,"5min":21.449000000000002,"15min":21.449000000000002},"last":2.7599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834580568,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12907076,"kb_used_data":11959164,"kb_used_omap":23947,"kb_used_meta":923956,"kb_avail":81464764,"statfs":{"total":96636764160,"available":83419918336,"internally_reserved":0,"allocated":12246183936,"data_stored":12241026959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24521912,"internal_metadata":946131784},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,5],"upper_bound":64},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 7 04:01:04 2023","interfaces":[{"interface":"back","average":{"1min":4.4340000000000002,"5min":2.1320000000000001,"15min":1.4199999999999999},"min":{"1min":0.28100000000000003,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":26.895,"5min":26.895,"15min":26.895},"last":4.4409999999999998},{"interface":"front","average":{"1min":3.5739999999999998,"5min":1.8380000000000001,"15min":1.909},"min":{"1min":0.27900000000000003,"5min":0.27600000000000002,"15min":0.26000000000000001},"max":{"1min":17.221,"5min":17.221,"15min":32.700000000000003},"last":4.3559999999999999}]},{"osd":2,"last update":"Fri Jul 7 04:00:26 2023","interfaces":[{"interface":"back","average":{"1min":3.0470000000000002,"5min":1.6399999999999999,"15min":1.534},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.25600000000000001},"max":{"1min":14.9,"5min":14.9,"15min":19.475999999999999},"last":4.1180000000000003},{"interface":"front","average":{"1min":2.3809999999999998,"5min":1.742,"15min":1.784},"min":{"1min":0.29399999999999998,"5min":0.26900000000000002,"15min":0.26600000000000001},"max":{"1min":17.254999999999999,"5min":17.254999999999999,"15min":17.254999999999999},"last":2.601}]},{"osd":3,"last update":"Fri Jul 7 04:00:26 2023","interfaces":[{"interface":"back","average":{"1min":5.2400000000000002,"5min":2.2519999999999998,"15min":1.774},"min":{"1min":0.35799999999999998,"5min":0.29299999999999998,"15min":0.26200000000000001},"max":{"1min":44.267000000000003,"5min":44.267000000000003,"15min":44.267000000000003},"last":1.9910000000000001},{"interface":"front","average":{"1min":2.464,"5min":1.724,"15min":1.6160000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":14.843999999999999,"5min":14.843999999999999,"15min":32.759999999999998},"last":4.7629999999999999}]},{"osd":4,"last update":"Fri Jul 7 04:00:26 2023","interfaces":[{"interface":"back","average":{"1min":2.5270000000000001,"5min":1.732,"15min":1.7410000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.32500000000000001},"max":{"1min":17.125,"5min":17.125,"15min":17.125},"last":0.84999999999999998},{"interface":"front","average":{"1min":6.6980000000000004,"5min":2.7509999999999999,"15min":2.02},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":46.898000000000003,"5min":46.898000000000003,"15min":46.898000000000003},"last":1.8859999999999999}]},{"osd":5,"last update":"Fri Jul 7 04:00:26 2023","interfaces":[{"interface":"back","average":{"1min":4.9720000000000004,"5min":2.516,"15min":2.0590000000000002},"min":{"1min":0.434,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":44.174999999999997,"5min":44.174999999999997,"15min":44.174999999999997},"last":1.931},{"interface":"front","average":{"1min":2.5249999999999999,"5min":1.607,"15min":1.4770000000000001},"min":{"1min":0.45500000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":22.643999999999998,"5min":22.643999999999998,"15min":22.643999999999998},"last":4.0110000000000001}]},{"osd":6,"last update":"Fri Jul 7 04:01:04 2023","interfaces":[{"interface":"back","average":{"1min":7.1109999999999998,"5min":2.512,"15min":1.867},"min":{"1min":0.49299999999999999,"5min":0.41699999999999998,"15min":0.41199999999999998},"max":{"1min":48.225999999999999,"5min":48.225999999999999,"15min":48.225999999999999},"last":4.069},{"interface":"front","average":{"1min":6.2880000000000003,"5min":2.4649999999999999,"15min":2.1629999999999998},"min":{"1min":0.42099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":44.990000000000002,"5min":44.990000000000002,"15min":44.990000000000002},"last":0.89200000000000002}]},{"osd":7,"last update":"Fri Jul 7 04:00:26 2023","interfaces":[{"interface":"back","average":{"1min":3.0459999999999998,"5min":2.0609999999999999,"15min":2.2999999999999998},"min":{"1min":0.53000000000000003,"5min":0.45700000000000002,"15min":0.39600000000000002},"max":{"1min":17.155999999999999,"5min":17.155999999999999,"15min":17.155999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":5.8760000000000003,"5min":2.8260000000000001,"15min":2.2469999999999999},"min":{"1min":0.503,"5min":0.49299999999999999,"15min":0.42699999999999999},"max":{"1min":44.228999999999999,"5min":44.228999999999999,"15min":44.228999999999999},"last":1.96}]}]},{"osd":2,"up_from":13,"seq":55834580602,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8150288,"kb_used_data":6309412,"kb_used_omap":11342,"kb_used_meta":1812977,"kb_avail":86221552,"statfs":{"total":96636764160,"available":88290869248,"internally_reserved":0,"allocated":6460837888,"data_stored":6457667617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11614252,"internal_metadata":1856489428},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":51,"apply_latency_ms":51,"commit_latency_ns":51000000,"apply_latency_ns":51000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:23 2023","interfaces":[{"interface":"back","average":{"1min":1.843,"5min":1.3440000000000001,"15min":1.2270000000000001},"min":{"1min":0.253,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":11.614000000000001,"5min":11.614000000000001,"15min":11.898999999999999},"last":5.6669999999999998},{"interface":"front","average":{"1min":2.3580000000000001,"5min":1.6020000000000001,"15min":1.389},"min":{"1min":0.28299999999999997,"5min":0.26700000000000002,"15min":0.25},"max":{"1min":24.515000000000001,"5min":24.515000000000001,"15min":24.515000000000001},"last":8.6720000000000006}]},{"osd":1,"last update":"Fri Jul 7 04:00:32 2023","interfaces":[{"interface":"back","average":{"1min":2.016,"5min":1.526,"15min":1.3340000000000001},"min":{"1min":0.28899999999999998,"5min":0.26600000000000001,"15min":0.248},"max":{"1min":10.263999999999999,"5min":10.263999999999999,"15min":10.263999999999999},"last":5.2729999999999997},{"interface":"front","average":{"1min":2.8999999999999999,"5min":1.7669999999999999,"15min":1.5009999999999999},"min":{"1min":0.36799999999999999,"5min":0.28799999999999998,"15min":0.26400000000000001},"max":{"1min":16.858000000000001,"5min":16.858000000000001,"15min":16.858000000000001},"last":4.718}]},{"osd":3,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":7.9550000000000001,"5min":3.1200000000000001,"15min":1.9930000000000001},"min":{"1min":0.28799999999999998,"5min":0.28599999999999998,"15min":0.252},"max":{"1min":96.594999999999999,"5min":96.594999999999999,"15min":96.594999999999999},"last":4.8280000000000003},{"interface":"front","average":{"1min":3.4649999999999999,"5min":1.752,"15min":1.472},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.29599999999999999},"max":{"1min":22.445,"5min":22.445,"15min":22.445},"last":5.2370000000000001}]},{"osd":4,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.333,"15min":1.2430000000000001},"min":{"1min":0.36599999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":7.9710000000000001,"5min":7.9710000000000001,"15min":8.6340000000000003},"last":5.1230000000000002},{"interface":"front","average":{"1min":1.99,"5min":1.6299999999999999,"15min":1.5980000000000001},"min":{"1min":0.38700000000000001,"5min":0.38300000000000001,"15min":0.34999999999999998},"max":{"1min":10.791,"5min":10.791,"15min":10.791},"last":4.6790000000000003}]},{"osd":5,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":2.3100000000000001,"5min":1.994,"15min":1.861},"min":{"1min":0.41899999999999998,"5min":0.39000000000000001,"15min":0.38500000000000001},"max":{"1min":12.581,"5min":12.581,"15min":12.581},"last":4.7910000000000004},{"interface":"front","average":{"1min":2.0819999999999999,"5min":1.8340000000000001,"15min":1.6279999999999999},"min":{"1min":0.41599999999999998,"5min":0.39500000000000002,"15min":0.39300000000000002},"max":{"1min":12.428000000000001,"5min":12.428000000000001,"15min":12.428000000000001},"last":5.1929999999999996}]},{"osd":6,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":1.931,"5min":1.956,"15min":1.794},"min":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.39100000000000001},"max":{"1min":10.855,"5min":10.855,"15min":11.019},"last":8.6020000000000003},{"interface":"front","average":{"1min":2.714,"5min":2.1859999999999999,"15min":2.0600000000000001},"min":{"1min":0.46200000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":12.481,"5min":12.481,"15min":12.481},"last":4.8730000000000002}]},{"osd":7,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":2.6019999999999999,"5min":2.0099999999999998,"15min":1.869},"min":{"1min":0.48599999999999999,"5min":0.45800000000000002,"15min":0.42599999999999999},"max":{"1min":10.890000000000001,"5min":10.890000000000001,"15min":10.890000000000001},"last":4.6079999999999997},{"interface":"front","average":{"1min":2.4020000000000001,"5min":2.2810000000000001,"15min":2.1869999999999998},"min":{"1min":0.51400000000000001,"5min":0.48299999999999998,"15min":0.45300000000000001},"max":{"1min":12.617000000000001,"5min":12.617000000000001,"15min":12.617000000000001},"last":4.7389999999999999}]}]},{"osd":3,"up_from":13,"seq":55834580589,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6842044,"kb_used_data":5161588,"kb_used_omap":20609,"kb_used_meta":1659838,"kb_avail":87529796,"statfs":{"total":96636764160,"available":89630511104,"internally_reserved":0,"allocated":5285466112,"data_stored":5282830452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21104547,"internal_metadata":1699674205},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:37 2023","interfaces":[{"interface":"back","average":{"1min":2.6600000000000001,"5min":1.411,"15min":1.2130000000000001},"min":{"1min":0.24399999999999999,"5min":0.23699999999999999,"15min":0.22800000000000001},"max":{"1min":18.285,"5min":18.285,"15min":18.285},"last":0.41499999999999998},{"interface":"front","average":{"1min":2.9199999999999999,"5min":1.7210000000000001,"15min":1.716},"min":{"1min":0.247,"5min":0.247,"15min":0.23799999999999999},"max":{"1min":19.972000000000001,"5min":19.972000000000001,"15min":19.972000000000001},"last":0.72299999999999998}]},{"osd":1,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":2.258,"5min":2.3860000000000001,"15min":1.758},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.23699999999999999},"max":{"1min":15.093,"5min":61.411000000000001,"15min":61.411000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":2.9620000000000002,"5min":1.706,"15min":1.575},"min":{"1min":0.314,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":18.222000000000001,"5min":18.222000000000001,"15min":18.222000000000001},"last":0.64300000000000002}]},{"osd":2,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":2.9500000000000002,"5min":2.4900000000000002,"15min":1.978},"min":{"1min":0.317,"5min":0.312,"15min":0.28299999999999997},"max":{"1min":14.986000000000001,"5min":61.511000000000003,"15min":61.511000000000003},"last":0.61299999999999999},{"interface":"front","average":{"1min":4.6500000000000004,"5min":2.4660000000000002,"15min":1.9339999999999999},"min":{"1min":0.45600000000000002,"5min":0.314,"15min":0.314},"max":{"1min":20.542000000000002,"5min":61.707000000000001,"15min":61.707000000000001},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":4.5419999999999998,"5min":2.8090000000000002,"15min":2.2120000000000002},"min":{"1min":0.38,"5min":0.33000000000000002,"15min":0.32300000000000001},"max":{"1min":21.120000000000001,"5min":61.453000000000003,"15min":61.453000000000003},"last":0.79800000000000004},{"interface":"front","average":{"1min":2.5750000000000002,"5min":2.3010000000000002,"15min":1.843},"min":{"1min":0.377,"5min":0.377,"15min":0.35699999999999998},"max":{"1min":15.122,"5min":61.558,"15min":61.558},"last":0.74299999999999999}]},{"osd":5,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":3.8490000000000002,"5min":1.921,"15min":1.659},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":21.388999999999999,"5min":21.388999999999999,"15min":21.388999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":5.0069999999999997,"5min":2.4740000000000002,"15min":2.2080000000000002},"min":{"1min":0.46000000000000002,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":32.100999999999999,"5min":32.100999999999999,"15min":32.100999999999999},"last":0.66400000000000003}]},{"osd":6,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":4.2039999999999997,"5min":2.5790000000000002,"15min":2.1389999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":27.613,"5min":61.667000000000002,"15min":61.667000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":7.2060000000000004,"5min":2.7999999999999998,"15min":2.0680000000000001},"min":{"1min":0.45800000000000002,"5min":0.44400000000000001,"15min":0.442},"max":{"1min":83.242000000000004,"5min":83.242000000000004,"15min":83.242000000000004},"last":0.68799999999999994}]},{"osd":7,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":4.516,"5min":2.5310000000000001,"15min":2.3620000000000001},"min":{"1min":0.49299999999999999,"5min":0.42299999999999999,"15min":0.40100000000000002},"max":{"1min":19.928000000000001,"5min":19.928000000000001,"15min":19.928000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":3.0960000000000001,"5min":2.7189999999999999,"15min":2.3130000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":15.063000000000001,"5min":61.621000000000002,"15min":61.621000000000002},"last":0.78000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834580632,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7410600,"kb_used_data":6118112,"kb_used_omap":11728,"kb_used_meta":1280751,"kb_avail":86961240,"statfs":{"total":96636764160,"available":89048309760,"internally_reserved":0,"allocated":6264946688,"data_stored":6262290568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12010156,"internal_metadata":1311489364},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":7.8529999999999998,"5min":2.2999999999999998,"15min":1.486},"min":{"1min":0.252,"5min":0.252,"15min":0.251},"max":{"1min":97.753,"5min":97.753,"15min":97.753},"last":3.169},{"interface":"front","average":{"1min":3.6150000000000002,"5min":1.7450000000000001,"15min":1.6279999999999999},"min":{"1min":0.30299999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":30.262,"5min":30.262,"15min":30.262},"last":17.577000000000002}]},{"osd":1,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":3.843,"5min":1.8,"15min":1.772},"min":{"1min":0.28999999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":25.344999999999999,"5min":25.344999999999999,"15min":25.344999999999999},"last":3.2599999999999998},{"interface":"front","average":{"1min":4.6109999999999998,"5min":2.1850000000000001,"15min":1.77},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":66.322000000000003,"5min":66.322000000000003,"15min":66.322000000000003},"last":3.2069999999999999}]},{"osd":2,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":2.8170000000000002,"5min":1.8200000000000001,"15min":1.831},"min":{"1min":0.36199999999999999,"5min":0.308,"15min":0.308},"max":{"1min":7.9800000000000004,"5min":7.9800000000000004,"15min":13.151999999999999},"last":3.3029999999999999},{"interface":"front","average":{"1min":3.1960000000000002,"5min":1.899,"15min":1.97},"min":{"1min":0.42299999999999999,"5min":0.34300000000000003,"15min":0.33300000000000002},"max":{"1min":10.395,"5min":10.395,"15min":10.395},"last":10.051}]},{"osd":3,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":3.4689999999999999,"5min":2.3130000000000002,"15min":2.0899999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":21.390999999999998,"5min":21.390999999999998,"15min":21.390999999999998},"last":8.0440000000000005},{"interface":"front","average":{"1min":3.5609999999999999,"5min":2.1299999999999999,"15min":2.1499999999999999},"min":{"1min":0.45600000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":11.641999999999999,"5min":11.641999999999999,"15min":11.641999999999999},"last":0.55000000000000004}]},{"osd":5,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":4.1959999999999997,"5min":1.694,"15min":1.3100000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.30499999999999999},"max":{"1min":51.551000000000002,"5min":51.551000000000002,"15min":51.551000000000002},"last":3.2389999999999999},{"interface":"front","average":{"1min":2.3439999999999999,"5min":1.242,"15min":1.427},"min":{"1min":0.371,"5min":0.33100000000000002,"15min":0.317},"max":{"1min":22.038,"5min":22.038,"15min":22.038},"last":7.0389999999999997}]},{"osd":6,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.0760000000000001,"15min":1.4590000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.29699999999999999},"max":{"1min":4.1959999999999997,"5min":7.9189999999999996,"15min":8.0760000000000005},"last":3.335},{"interface":"front","average":{"1min":4.2670000000000003,"5min":1.7390000000000001,"15min":1.5580000000000001},"min":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.371},"max":{"1min":66.373999999999995,"5min":66.373999999999995,"15min":66.373999999999995},"last":7.3780000000000001}]},{"osd":7,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":1.962,"5min":1.3180000000000001,"15min":1.5349999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.36599999999999999},"max":{"1min":8.0399999999999991,"5min":8.0399999999999991,"15min":11.585000000000001},"last":4.1980000000000004},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.1180000000000001,"15min":1.52},"min":{"1min":0.375,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":3.7970000000000002,"5min":7.1449999999999996,"15min":12.414},"last":0.496}]}]},{"osd":5,"up_from":13,"seq":55834580638,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6633148,"kb_used_data":5007264,"kb_used_omap":19606,"kb_used_meta":1580905,"kb_avail":87738692,"statfs":{"total":96636764160,"available":89844420608,"internally_reserved":0,"allocated":5127438336,"data_stored":5125154964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20076954,"internal_metadata":1618847334},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":4.0099999999999998,"5min":1.6100000000000001,"15min":1.4730000000000001},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":46.174999999999997,"5min":46.174999999999997,"15min":46.174999999999997},"last":2.6539999999999999},{"interface":"front","average":{"1min":2.0579999999999998,"5min":1.675,"15min":1.804},"min":{"1min":0.28799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":11.06,"5min":13.792999999999999,"15min":38.530999999999999},"last":7.524}]},{"osd":1,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":2.8319999999999999,"5min":1.6539999999999999,"15min":1.6439999999999999},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.28299999999999997},"max":{"1min":15.209,"5min":15.209,"15min":15.343},"last":7.202},{"interface":"front","average":{"1min":4.2779999999999996,"5min":2.0379999999999998,"15min":1.746},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.29599999999999999},"max":{"1min":33.927999999999997,"5min":33.927999999999997,"15min":33.927999999999997},"last":2.621}]},{"osd":2,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":2.319,"5min":1.7070000000000001,"15min":2.097},"min":{"1min":0.39200000000000002,"5min":0.29799999999999999,"15min":0.28699999999999998},"max":{"1min":9.5609999999999999,"5min":9.5609999999999999,"15min":10.222},"last":7.4749999999999996},{"interface":"front","average":{"1min":2.4300000000000002,"5min":1.893,"15min":1.6639999999999999},"min":{"1min":0.41299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":13.628,"5min":13.628,"15min":15.398},"last":7.5449999999999999}]},{"osd":3,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":3.8929999999999998,"5min":2.141,"15min":1.9930000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":33.828000000000003,"5min":33.828000000000003,"15min":33.828000000000003},"last":7.3979999999999997},{"interface":"front","average":{"1min":2.476,"5min":2.069,"15min":2.1070000000000002},"min":{"1min":0.443,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":13.595000000000001,"5min":13.595000000000001,"15min":15.43},"last":7.625}]},{"osd":4,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":3.306,"5min":1.752,"15min":1.373},"min":{"1min":0.32400000000000001,"5min":0.308,"15min":0.27800000000000002},"max":{"1min":28.396999999999998,"5min":28.396999999999998,"15min":28.396999999999998},"last":7.3310000000000004},{"interface":"front","average":{"1min":2.7639999999999998,"5min":2.012,"15min":1.696},"min":{"1min":0.33000000000000002,"5min":0.32600000000000001,"15min":0.29199999999999998},"max":{"1min":23.481999999999999,"5min":23.481999999999999,"15min":23.481999999999999},"last":7.423}]},{"osd":6,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":3.8210000000000002,"5min":1.913,"15min":1.667},"min":{"1min":0.36499999999999999,"5min":0.311,"15min":0.29599999999999999},"max":{"1min":55.161000000000001,"5min":55.161000000000001,"15min":55.161000000000001},"last":7.2830000000000004},{"interface":"front","average":{"1min":4.1879999999999997,"5min":1.8899999999999999,"15min":1.669},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.32900000000000001},"max":{"1min":62.456000000000003,"5min":62.456000000000003,"15min":62.456000000000003},"last":2.569}]},{"osd":7,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":1.839,"5min":1.629,"15min":1.78},"min":{"1min":0.41099999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":7.1710000000000003,"5min":24.16,"15min":24.16},"last":3.1080000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":1.327,"15min":1.468},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.37},"max":{"1min":3.3980000000000001,"5min":17.751000000000001,"15min":17.751000000000001},"last":7.5860000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-07T04:01:17.720 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-07T04:01:17.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.901+0000 7f342dce9700 1 Processor -- start 2023-07-07T04:01:17.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.901+0000 7f342dce9700 1 -- start start 2023-07-07T04:01:17.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.903+0000 7f342dce9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3428157ed0 0x7f342806f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:17.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.903+0000 7f342dce9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f34280ccbe0 0x7f342815ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:17.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.903+0000 7f342dce9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f342806e6c0 con 0x7f34280cd030 2023-07-07T04:01:17.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.903+0000 7f342dce9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f342806f6a0 con 0x7f3428157ed0 2023-07-07T04:01:17.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.903+0000 7f342dce9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34280cb080 con 0x7f34280ccbe0 2023-07-07T04:01:17.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.903+0000 7f34277fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3428157ed0 0x7f342806f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:17.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.903+0000 7f34277fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f3428157ed0 0x7f342806f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48208/0 (socket says 172.21.15.6:48208) 2023-07-07T04:01:17.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.903+0000 7f34277fe700 1 -- 172.21.15.6:0/1296607378 learned_addr learned my addr 172.21.15.6:0/1296607378 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:17.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.903+0000 7f341ffff700 1 --2- 172.21.15.6:0/1296607378 >> v2:172.21.15.40:3300/0 conn(0x7f34280ccbe0 0x7f342815ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:17.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.903+0000 7f34277fe700 1 -- 172.21.15.6:0/1296607378 >> v2:172.21.15.40:3300/0 conn(0x7f34280ccbe0 msgr2=0x7f342815ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:17.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.903+0000 7f34277fe700 1 --2- 172.21.15.6:0/1296607378 >> v2:172.21.15.40:3300/0 conn(0x7f34280ccbe0 0x7f342815ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:17.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.903+0000 7f34277fe700 1 -- 172.21.15.6:0/1296607378 >> v1:172.21.15.40:6789/0 conn(0x7f34280cd030 legacy=0x7f34280ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:17.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.903+0000 7f34277fe700 1 -- 172.21.15.6:0/1296607378 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34280cb360 con 0x7f3428157ed0 2023-07-07T04:01:17.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.904+0000 7f34277fe700 1 --2- 172.21.15.6:0/1296607378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3428157ed0 0x7f342806f160 secure :-1 s=READY pgs=3355 cs=0 l=1 rev1=1 crypto rx=0x7f34280cbdd0 tx=0x7f3418009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be252e627d7ea034 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:17.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.904+0000 7f3426ffd700 1 -- 172.21.15.6:0/1296607378 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3418004230 con 0x7f3428157ed0 2023-07-07T04:01:17.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.904+0000 7f3426ffd700 1 -- 172.21.15.6:0/1296607378 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3418004390 con 0x7f3428157ed0 2023-07-07T04:01:17.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.904+0000 7f3426ffd700 1 -- 172.21.15.6:0/1296607378 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34180036a0 con 0x7f3428157ed0 2023-07-07T04:01:17.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.905+0000 7f342dce9700 1 -- 172.21.15.6:0/1296607378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3428157ed0 msgr2=0x7f342806f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:17.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.905+0000 7f342dce9700 1 --2- 172.21.15.6:0/1296607378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3428157ed0 0x7f342806f160 secure :-1 s=READY pgs=3355 cs=0 l=1 rev1=1 crypto rx=0x7f34280cbdd0 tx=0x7f3418009bd0 comp rx=0 tx=0).stop 2023-07-07T04:01:17.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.905+0000 7f342dce9700 1 -- 172.21.15.6:0/1296607378 shutdown_connections 2023-07-07T04:01:17.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.905+0000 7f342dce9700 1 --2- 172.21.15.6:0/1296607378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3428157ed0 0x7f342806f160 unknown :-1 s=CLOSED pgs=3355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:17.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.905+0000 7f342dce9700 1 --2- 172.21.15.6:0/1296607378 >> v2:172.21.15.40:3300/0 conn(0x7f34280ccbe0 0x7f342815ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:17.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.905+0000 7f342dce9700 1 -- 172.21.15.6:0/1296607378 >> 172.21.15.6:0/1296607378 conn(0x7f34280d0a30 msgr2=0x7f34280d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:17.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.905+0000 7f342dce9700 1 -- 172.21.15.6:0/1296607378 shutdown_connections 2023-07-07T04:01:17.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.905+0000 7f342dce9700 1 -- 172.21.15.6:0/1296607378 wait complete. 2023-07-07T04:01:17.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.907+0000 7f342dce9700 1 Processor -- start 2023-07-07T04:01:17.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.907+0000 7f342dce9700 1 -- start start 2023-07-07T04:01:17.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.908+0000 7f342dce9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34280ccbe0 0x7f34280c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:17.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.908+0000 7f342dce9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34280cd030 0x7f34280afd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:17.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.908+0000 7f342dce9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3428157ed0 0x7f34280b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:17.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.908+0000 7f342dce9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34280c69a0 con 0x7f3428157ed0 2023-07-07T04:01:17.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.908+0000 7f342dce9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34280c5af0 con 0x7f34280ccbe0 2023-07-07T04:01:17.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.908+0000 7f342dce9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34280c5d20 con 0x7f34280cd030 2023-07-07T04:01:17.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.909+0000 7f3427fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3428157ed0 0x7f34280b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:17.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.909+0000 7f3427fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3428157ed0 0x7f34280b02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48216/0 (socket says 172.21.15.6:48216) 2023-07-07T04:01:17.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.909+0000 7f3427fff700 1 -- 172.21.15.6:0/2368538299 learned_addr learned my addr 172.21.15.6:0/2368538299 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:17.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.909+0000 7f34277fe700 1 --2- 172.21.15.6:0/2368538299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34280ccbe0 0x7f34280c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:17.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.909+0000 7f341ffff700 1 --2- 172.21.15.6:0/2368538299 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34280cd030 0x7f34280afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:17.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.909+0000 7f3427fff700 1 -- 172.21.15.6:0/2368538299 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34280cd030 msgr2=0x7f34280afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:17.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.909+0000 7f3427fff700 1 --2- 172.21.15.6:0/2368538299 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34280cd030 0x7f34280afd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:17.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.909+0000 7f3427fff700 1 -- 172.21.15.6:0/2368538299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34280ccbe0 msgr2=0x7f34280c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:17.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.909+0000 7f3427fff700 1 --2- 172.21.15.6:0/2368538299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34280ccbe0 0x7f34280c55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:17.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.909+0000 7f3427fff700 1 -- 172.21.15.6:0/2368538299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3418009550 con 0x7f3428157ed0 2023-07-07T04:01:17.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.909+0000 7f34277fe700 1 --2- 172.21.15.6:0/2368538299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34280ccbe0 0x7f34280c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T04:01:17.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.909+0000 7f3427fff700 1 --2- 172.21.15.6:0/2368538299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3428157ed0 0x7f34280b02a0 secure :-1 s=READY pgs=3356 cs=0 l=1 rev1=1 crypto rx=0x7f342000c780 tx=0x7f342000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:17.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.910+0000 7f3424ff9700 1 -- 172.21.15.6:0/2368538299 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420003e10 con 0x7f3428157ed0 2023-07-07T04:01:17.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.911+0000 7f3424ff9700 1 -- 172.21.15.6:0/2368538299 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3420005070 con 0x7f3428157ed0 2023-07-07T04:01:17.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.911+0000 7f342dce9700 1 -- 172.21.15.6:0/2368538299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34280c6000 con 0x7f3428157ed0 2023-07-07T04:01:17.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.911+0000 7f3424ff9700 1 -- 172.21.15.6:0/2368538299 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420005420 con 0x7f3428157ed0 2023-07-07T04:01:17.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.911+0000 7f342dce9700 1 -- 172.21.15.6:0/2368538299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34280c65c0 con 0x7f3428157ed0 2023-07-07T04:01:17.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.913+0000 7f342dce9700 1 -- 172.21.15.6:0/2368538299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34280b3400 con 0x7f3428157ed0 2023-07-07T04:01:17.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.913+0000 7f3424ff9700 1 -- 172.21.15.6:0/2368538299 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3420005580 con 0x7f3428157ed0 2023-07-07T04:01:17.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.913+0000 7f3424ff9700 1 --2- 172.21.15.6:0/2368538299 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f340806ace0 0x7f340806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:17.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.914+0000 7f3424ff9700 1 -- 172.21.15.6:0/2368538299 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f34200883b0 con 0x7f3428157ed0 2023-07-07T04:01:17.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.914+0000 7f34277fe700 1 --2- 172.21.15.6:0/2368538299 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f340806ace0 0x7f340806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:17.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.914+0000 7f34277fe700 1 --2- 172.21.15.6:0/2368538299 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f340806ace0 0x7f340806d190 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f3418009130 tx=0x7f3418008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:17.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:17.921+0000 7f3424ff9700 1 -- 172.21.15.6:0/2368538299 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f34200536b0 con 0x7f3428157ed0 2023-07-07T04:01:18.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.210+0000 7f342dce9700 1 -- 172.21.15.6:0/2368538299 --> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f342806ec40 con 0x7f340806ace0 2023-07-07T04:01:18.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.213+0000 7f3424ff9700 1 -- 172.21.15.6:0/2368538299 <== mgr.4110 v2:172.21.15.6:6832/201543369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71426 (secure 0 0 0) 0x7f34180041b0 con 0x7f340806ace0 2023-07-07T04:01:18.215 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:01:18.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.216+0000 7f342dce9700 1 -- 172.21.15.6:0/2368538299 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f340806ace0 msgr2=0x7f340806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:18.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.216+0000 7f342dce9700 1 --2- 172.21.15.6:0/2368538299 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f340806ace0 0x7f340806d190 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f3418009130 tx=0x7f3418008030 comp rx=0 tx=0).stop 2023-07-07T04:01:18.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.216+0000 7f342dce9700 1 -- 172.21.15.6:0/2368538299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3428157ed0 msgr2=0x7f34280b02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:18.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.216+0000 7f342dce9700 1 --2- 172.21.15.6:0/2368538299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3428157ed0 0x7f34280b02a0 secure :-1 s=READY pgs=3356 cs=0 l=1 rev1=1 crypto rx=0x7f342000c780 tx=0x7f342000ca90 comp rx=0 tx=0).stop 2023-07-07T04:01:18.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.216+0000 7f342dce9700 1 -- 172.21.15.6:0/2368538299 shutdown_connections 2023-07-07T04:01:18.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.216+0000 7f342dce9700 1 --2- 172.21.15.6:0/2368538299 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f340806ace0 0x7f340806d190 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:18.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.216+0000 7f342dce9700 1 --2- 172.21.15.6:0/2368538299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3428157ed0 0x7f34280b02a0 unknown :-1 s=CLOSED pgs=3356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:18.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.216+0000 7f342dce9700 1 --2- 172.21.15.6:0/2368538299 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34280ccbe0 0x7f34280c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:18.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.216+0000 7f342dce9700 1 --2- 172.21.15.6:0/2368538299 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f34280cd030 0x7f34280afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:18.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.216+0000 7f342dce9700 1 -- 172.21.15.6:0/2368538299 >> 172.21.15.6:0/2368538299 conn(0x7f34280d0a30 msgr2=0x7f34280d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:18.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.216+0000 7f342dce9700 1 -- 172.21.15.6:0/2368538299 shutdown_connections 2023-07-07T04:01:18.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.216+0000 7f342dce9700 1 -- 172.21.15.6:0/2368538299 wait complete. 2023-07-07T04:01:18.220 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-07T04:01:18.232 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":14510,"stamp":"2023-07-07T04:01:17.945403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":58804444,"kb_used_data":46832768,"kb_used_omap":151204,"kb_used_meta":11707995,"kb_avail":696170276,"statfs":{"total":773094113280,"available":712878362624,"internally_reserved":0,"allocated":47956754432,"data_stored":47935144640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":154833875,"internal_metadata":11988986925},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":370,"apply_latency_ms":370,"commit_latency_ns":370000000,"apply_latency_ns":370000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-63863244667,"num_objects":-45149,"num_object_clones":0,"num_object_copies":-90298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-45149,"num_whiteouts":0,"num_read":-1564873,"num_read_kb":-372837003,"num_write":-3149060,"num_write_kb":-618200878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-3621,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.004192"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":295,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.917698+0000","last_change":"2023-07-06T19:58:47.723855+0000","last_active":"2023-07-07T04:01:12.917698+0000","last_peered":"2023-07-07T04:01:12.917698+0000","last_clean":"2023-07-07T04:01:12.917698+0000","last_became_active":"2023-07-06T19:58:47.723553+0000","last_became_peered":"2023-07-06T19:58:47.723553+0000","last_unstale":"2023-07-07T04:01:12.917698+0000","last_undegraded":"2023-07-07T04:01:12.917698+0000","last_fullsized":"2023-07-07T04:01:12.917698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:11:58.031720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":290,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.961276+0000","last_change":"2023-07-06T19:58:47.705294+0000","last_active":"2023-07-07T04:01:12.961276+0000","last_peered":"2023-07-07T04:01:12.961276+0000","last_clean":"2023-07-07T04:01:12.961276+0000","last_became_active":"2023-07-06T19:58:47.704921+0000","last_became_peered":"2023-07-06T19:58:47.704921+0000","last_unstale":"2023-07-07T04:01:12.961276+0000","last_undegraded":"2023-07-07T04:01:12.961276+0000","last_fullsized":"2023-07-07T04:01:12.961276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:13:52.238597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":291,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:13.296600+0000","last_change":"2023-07-06T19:58:47.766992+0000","last_active":"2023-07-07T04:01:13.296600+0000","last_peered":"2023-07-07T04:01:13.296600+0000","last_clean":"2023-07-07T04:01:13.296600+0000","last_became_active":"2023-07-06T19:58:47.766697+0000","last_became_peered":"2023-07-06T19:58:47.766697+0000","last_unstale":"2023-07-07T04:01:13.296600+0000","last_undegraded":"2023-07-07T04:01:13.296600+0000","last_fullsized":"2023-07-07T04:01:13.296600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:23:14.562370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":290,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.934144+0000","last_change":"2023-07-06T19:58:47.704498+0000","last_active":"2023-07-07T04:01:12.934144+0000","last_peered":"2023-07-07T04:01:12.934144+0000","last_clean":"2023-07-07T04:01:12.934144+0000","last_became_active":"2023-07-06T19:58:47.704172+0000","last_became_peered":"2023-07-06T19:58:47.704172+0000","last_unstale":"2023-07-07T04:01:12.934144+0000","last_undegraded":"2023-07-07T04:01:12.934144+0000","last_fullsized":"2023-07-07T04:01:12.934144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:02:36.844807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"43'161","reported_seq":510,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.946359+0000","last_change":"2023-07-06T19:58:40.972763+0000","last_active":"2023-07-07T04:01:12.946359+0000","last_peered":"2023-07-07T04:01:12.946359+0000","last_clean":"2023-07-07T04:01:12.946359+0000","last_became_active":"2023-07-06T19:58:40.971570+0000","last_became_peered":"2023-07-06T19:58:40.971570+0000","last_unstale":"2023-07-07T04:01:12.946359+0000","last_undegraded":"2023-07-07T04:01:12.946359+0000","last_fullsized":"2023-07-07T04:01:12.946359+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_clean_scrub_stamp":"2023-07-06T19:58:39.653546+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:31:36.048493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":301,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.946495+0000","last_change":"2023-07-06T19:58:47.708545+0000","last_active":"2023-07-07T04:01:12.946495+0000","last_peered":"2023-07-07T04:01:12.946495+0000","last_clean":"2023-07-07T04:01:12.946495+0000","last_became_active":"2023-07-06T19:58:47.708230+0000","last_became_peered":"2023-07-06T19:58:47.708230+0000","last_unstale":"2023-07-07T04:01:12.946495+0000","last_undegraded":"2023-07-07T04:01:12.946495+0000","last_fullsized":"2023-07-07T04:01:12.946495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:31:37.154591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":289,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.947328+0000","last_change":"2023-07-06T19:58:47.723926+0000","last_active":"2023-07-07T04:01:12.947328+0000","last_peered":"2023-07-07T04:01:12.947328+0000","last_clean":"2023-07-07T04:01:12.947328+0000","last_became_active":"2023-07-06T19:58:47.723646+0000","last_became_peered":"2023-07-06T19:58:47.723646+0000","last_unstale":"2023-07-07T04:01:12.947328+0000","last_undegraded":"2023-07-07T04:01:12.947328+0000","last_fullsized":"2023-07-07T04:01:12.947328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:37:22.324090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":288,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.920569+0000","last_change":"2023-07-06T19:58:47.711918+0000","last_active":"2023-07-07T04:01:12.920569+0000","last_peered":"2023-07-07T04:01:12.920569+0000","last_clean":"2023-07-07T04:01:12.920569+0000","last_became_active":"2023-07-06T19:58:47.711591+0000","last_became_peered":"2023-07-06T19:58:47.711591+0000","last_unstale":"2023-07-07T04:01:12.920569+0000","last_undegraded":"2023-07-07T04:01:12.920569+0000","last_fullsized":"2023-07-07T04:01:12.920569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:31:20.169556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":285,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.925775+0000","last_change":"2023-07-06T19:58:47.712143+0000","last_active":"2023-07-07T04:01:12.925775+0000","last_peered":"2023-07-07T04:01:12.925775+0000","last_clean":"2023-07-07T04:01:12.925775+0000","last_became_active":"2023-07-06T19:58:47.711788+0000","last_became_peered":"2023-07-06T19:58:47.711788+0000","last_unstale":"2023-07-07T04:01:12.925775+0000","last_undegraded":"2023-07-07T04:01:12.925775+0000","last_fullsized":"2023-07-07T04:01:12.925775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:48:00.551095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580636,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6657892,"kb_used_data":5039644,"kb_used_omap":28457,"kb_used_meta":1589782,"kb_avail":87713948,"statfs":{"total":96636764160,"available":89819082752,"internally_reserved":0,"allocated":5160595456,"data_stored":5158230903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29140457,"internal_metadata":1627937303},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":2.7480000000000002,"5min":1.383,"15min":1.196},"min":{"1min":0.25900000000000001,"5min":0.24299999999999999,"15min":0.24199999999999999},"max":{"1min":32.406999999999996,"5min":32.406999999999996,"15min":32.406999999999996},"last":2.5960000000000001},{"interface":"front","average":{"1min":3.1840000000000002,"5min":1.9730000000000001,"15min":1.625},"min":{"1min":0.30099999999999999,"5min":0.29399999999999998,"15min":0.26900000000000002},"max":{"1min":24.928999999999998,"5min":24.928999999999998,"15min":24.928999999999998},"last":8.3360000000000003}]},{"osd":1,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":3.4169999999999998,"5min":1.7869999999999999,"15min":1.524},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":32.445,"5min":32.445,"15min":32.445},"last":12.093999999999999},{"interface":"front","average":{"1min":2.4830000000000001,"5min":1.8180000000000001,"15min":1.8839999999999999},"min":{"1min":0.315,"5min":0.29999999999999999,"15min":0.29299999999999998},"max":{"1min":24.966000000000001,"5min":24.966000000000001,"15min":24.966000000000001},"last":12}]},{"osd":2,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":4.1609999999999996,"5min":2.2440000000000002,"15min":1.887},"min":{"1min":0.376,"5min":0.35199999999999998,"15min":0.32200000000000001},"max":{"1min":36.658999999999999,"5min":36.658999999999999,"15min":36.658999999999999},"last":2.4860000000000002},{"interface":"front","average":{"1min":3.3159999999999998,"5min":2.4249999999999998,"15min":2},"min":{"1min":0.41299999999999998,"5min":0.38400000000000001,"15min":0.32900000000000001},"max":{"1min":32.369,"5min":32.369,"15min":32.369},"last":2.3860000000000001}]},{"osd":3,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":5.9930000000000003,"5min":2.9969999999999999,"15min":2.2930000000000001},"min":{"1min":0.39500000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":74.998000000000005,"5min":74.998000000000005,"15min":74.998000000000005},"last":4.484},{"interface":"front","average":{"1min":3.0670000000000002,"5min":2.085,"15min":1.99},"min":{"1min":0.39300000000000002,"5min":0.35799999999999998,"15min":0.33500000000000002},"max":{"1min":16.452999999999999,"5min":16.452999999999999,"15min":16.452999999999999},"last":2.4449999999999998}]},{"osd":4,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":3.7010000000000001,"5min":1.6870000000000001,"15min":1.5049999999999999},"min":{"1min":0.30399999999999999,"5min":0.29299999999999998,"15min":0.28599999999999998},"max":{"1min":59.920999999999999,"5min":59.920999999999999,"15min":59.920999999999999},"last":2.4249999999999998},{"interface":"front","average":{"1min":2.9910000000000001,"5min":1.696,"15min":1.49},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":36.616999999999997,"5min":36.616999999999997,"15min":36.616999999999997},"last":2.536}]},{"osd":5,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":2.508,"5min":1.3720000000000001,"15min":1.282},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":16.904,"5min":16.904,"15min":16.904},"last":7.9089999999999998},{"interface":"front","average":{"1min":2.6110000000000002,"5min":1.6379999999999999,"15min":1.639},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":24.811,"5min":24.811,"15min":24.811},"last":2.4750000000000001}]},{"osd":6,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":3.6749999999999998,"5min":1.9830000000000001,"15min":1.8160000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":60.188000000000002,"5min":60.188000000000002,"15min":60.188000000000002},"last":2.5219999999999998},{"interface":"front","average":{"1min":2.8679999999999999,"5min":1.6719999999999999,"15min":1.5149999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":24.065999999999999,"5min":24.065999999999999,"15min":24.065999999999999},"last":2.5760000000000001}]}]},{"osd":6,"up_from":13,"seq":55834580632,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9669504,"kb_used_data":7709716,"kb_used_omap":17122,"kb_used_meta":1909405,"kb_avail":84702336,"statfs":{"total":96636764160,"available":86735192064,"internally_reserved":0,"allocated":7894749184,"data_stored":7891441954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17533718,"internal_metadata":1955230954},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":51,"apply_latency_ms":51,"commit_latency_ns":51000000,"apply_latency_ns":51000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.5629999999999999,"15min":1.411},"min":{"1min":0.28299999999999997,"5min":0.249,"15min":0.24099999999999999},"max":{"1min":5.9420000000000002,"5min":13.332000000000001,"15min":21.984999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":5.4770000000000003,"5min":2.4609999999999999,"15min":1.9179999999999999},"min":{"1min":0.28699999999999998,"5min":0.27800000000000002,"15min":0.246},"max":{"1min":65.186000000000007,"5min":65.186000000000007,"15min":65.186000000000007},"last":0.83299999999999996}]},{"osd":1,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":3.6629999999999998,"5min":2.524,"15min":2.0920000000000001},"min":{"1min":0.316,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":15.278,"5min":17.091999999999999,"15min":22.117000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":4.4720000000000004,"5min":2.1349999999999998,"15min":1.821},"min":{"1min":0.33500000000000002,"5min":0.29999999999999999,"15min":0.28899999999999998},"max":{"1min":40.649000000000001,"5min":40.649000000000001,"15min":40.649000000000001},"last":1.0029999999999999}]},{"osd":2,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":2.4279999999999999,"5min":2.0710000000000002,"15min":1.9770000000000001},"min":{"1min":0.32900000000000001,"5min":0.32400000000000001,"15min":0.30599999999999999},"max":{"1min":9.3309999999999995,"5min":13.196999999999999,"15min":22.210000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":2.7490000000000001,"5min":2.0750000000000002,"15min":1.877},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.30499999999999999},"max":{"1min":15.545999999999999,"5min":15.545999999999999,"15min":22.280000000000001},"last":0.93200000000000005}]},{"osd":3,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":8.5969999999999995,"5min":3.4540000000000002,"15min":2.5979999999999999},"min":{"1min":0.41499999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":111.95399999999999,"5min":111.95399999999999,"15min":111.95399999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":6.9690000000000003,"5min":3.032,"15min":2.3740000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.33700000000000002},"max":{"1min":112.504,"5min":112.504,"15min":112.504},"last":0.96399999999999997}]},{"osd":4,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":2.1739999999999999,"5min":1.2589999999999999,"15min":1.2929999999999999},"min":{"1min":0.34200000000000003,"5min":0.308,"15min":0.27700000000000002},"max":{"1min":15.587999999999999,"5min":15.587999999999999,"15min":22.225000000000001},"last":0.623},{"interface":"front","average":{"1min":2.1890000000000001,"5min":1.716,"15min":1.6020000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":15.205,"5min":15.205,"15min":22.265999999999998},"last":0.86899999999999999}]},{"osd":5,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":3.956,"5min":2.1339999999999999,"15min":1.885},"min":{"1min":0.39300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":38.103000000000002,"5min":38.103000000000002,"15min":38.103000000000002},"last":0.90500000000000003},{"interface":"front","average":{"1min":3.77,"5min":2.0179999999999998,"15min":1.6579999999999999},"min":{"1min":0.41199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":37.863,"5min":37.863,"15min":37.863},"last":0.78000000000000003}]},{"osd":7,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":1.8129999999999999,"5min":1.4279999999999999,"15min":1.359},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.32300000000000001},"max":{"1min":15.507,"5min":15.507,"15min":22.395},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.7569999999999999,"5min":1.597,"15min":1.4910000000000001},"min":{"1min":0.39500000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":15.471,"5min":15.471,"15min":22.43},"last":0.81000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834580612,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5177288,"kb_used_data":4175360,"kb_used_omap":18390,"kb_used_meta":946281,"kb_avail":89194552,"statfs":{"total":96636764160,"available":91335221248,"internally_reserved":0,"allocated":4275568640,"data_stored":4273643280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18831879,"internal_metadata":968992249},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":3.1869999999999998,"5min":1.788,"15min":1.4410000000000001},"min":{"1min":0.26200000000000001,"5min":0.254,"15min":0.23300000000000001},"max":{"1min":23.021000000000001,"5min":23.021000000000001,"15min":23.021000000000001},"last":2.895},{"interface":"front","average":{"1min":2.855,"5min":2.2010000000000001,"15min":1.829},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.248},"max":{"1min":16.084,"5min":16.084,"15min":16.084},"last":2.835}]},{"osd":2,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":4.2939999999999996,"5min":2.23,"15min":1.8200000000000001},"min":{"1min":0.27800000000000002,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":28.513999999999999,"5min":28.513999999999999,"15min":28.513999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":4.1740000000000004,"5min":2.4169999999999998,"15min":2.1360000000000001},"min":{"1min":0.30599999999999999,"5min":0.28699999999999998,"15min":0.26200000000000001},"max":{"1min":28.352,"5min":28.352,"15min":28.352},"last":0.89300000000000002}]},{"osd":3,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":4.9790000000000001,"5min":2.976,"15min":2.3900000000000001},"min":{"1min":0.32700000000000001,"5min":0.32100000000000001,"15min":0.28100000000000003},"max":{"1min":21.620999999999999,"5min":21.620999999999999,"15min":21.620999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":3.129,"5min":2.2559999999999998,"15min":1.8029999999999999},"min":{"1min":0.38200000000000001,"5min":0.34699999999999998,"15min":0.29999999999999999},"max":{"1min":15.952,"5min":15.952,"15min":15.952},"last":0.66300000000000003}]},{"osd":4,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":3.7829999999999999,"5min":2.085,"15min":1.6659999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":23.071999999999999,"5min":23.071999999999999,"15min":23.071999999999999},"last":2.8540000000000001},{"interface":"front","average":{"1min":2.9729999999999999,"5min":2.3849999999999998,"15min":1.9850000000000001},"min":{"1min":0.40400000000000003,"5min":0.379,"15min":0.35899999999999999},"max":{"1min":11.039,"5min":11.039,"15min":11.039},"last":2.7919999999999998}]},{"osd":5,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":2.7589999999999999,"5min":2.3050000000000002,"15min":2.1160000000000001},"min":{"1min":0.45100000000000001,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":11.085000000000001,"5min":11.085000000000001,"15min":17.998000000000001},"last":1.506},{"interface":"front","average":{"1min":3.4790000000000001,"5min":2.3980000000000001,"15min":2.2519999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":21.696000000000002,"5min":21.696000000000002,"15min":21.696000000000002},"last":2.7000000000000002}]},{"osd":6,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":8.3789999999999996,"5min":3.2909999999999999,"15min":2.2250000000000001},"min":{"1min":0.48799999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":83.441999999999993,"5min":83.441999999999993,"15min":83.441999999999993},"last":3.7269999999999999},{"interface":"front","average":{"1min":7.742,"5min":3.524,"15min":2.669},"min":{"1min":0.51900000000000002,"5min":0.48699999999999999,"15min":0.45900000000000002},"max":{"1min":60.134,"5min":60.134,"15min":60.134},"last":1.5509999999999999}]},{"osd":7,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":3.5329999999999999,"5min":2.2530000000000001,"15min":2.2669999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":21.495000000000001,"5min":21.495000000000001,"15min":21.495000000000001},"last":11.798},{"interface":"front","average":{"1min":4.7720000000000002,"5min":2.7719999999999998,"15min":2.5339999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45700000000000002},"max":{"1min":21.449000000000002,"5min":21.449000000000002,"15min":21.449000000000002},"last":2.7599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834580569,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8263680,"kb_used_data":7311672,"kb_used_omap":23947,"kb_used_meta":928052,"kb_avail":86108160,"statfs":{"total":96636764160,"available":88174755840,"internally_reserved":0,"allocated":7487152128,"data_stored":7483884902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24521912,"internal_metadata":950326088},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":80,"apply_latency_ms":80,"commit_latency_ns":80000000,"apply_latency_ns":80000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 7 04:01:04 2023","interfaces":[{"interface":"back","average":{"1min":4.4340000000000002,"5min":2.1320000000000001,"15min":1.4199999999999999},"min":{"1min":0.28100000000000003,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":26.895,"5min":26.895,"15min":26.895},"last":2.4329999999999998},{"interface":"front","average":{"1min":3.5739999999999998,"5min":1.8380000000000001,"15min":1.909},"min":{"1min":0.27900000000000003,"5min":0.27600000000000002,"15min":0.26000000000000001},"max":{"1min":17.221,"5min":17.221,"15min":32.700000000000003},"last":2.5910000000000002}]},{"osd":2,"last update":"Fri Jul 7 04:00:26 2023","interfaces":[{"interface":"back","average":{"1min":3.0470000000000002,"5min":1.6399999999999999,"15min":1.534},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.25600000000000001},"max":{"1min":14.9,"5min":14.9,"15min":19.475999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":2.3809999999999998,"5min":1.742,"15min":1.784},"min":{"1min":0.29399999999999998,"5min":0.26900000000000002,"15min":0.26600000000000001},"max":{"1min":17.254999999999999,"5min":17.254999999999999,"15min":17.254999999999999},"last":2.5529999999999999}]},{"osd":3,"last update":"Fri Jul 7 04:00:26 2023","interfaces":[{"interface":"back","average":{"1min":5.2400000000000002,"5min":2.2519999999999998,"15min":1.774},"min":{"1min":0.35799999999999998,"5min":0.29299999999999998,"15min":0.26200000000000001},"max":{"1min":44.267000000000003,"5min":44.267000000000003,"15min":44.267000000000003},"last":6.8239999999999998},{"interface":"front","average":{"1min":2.464,"5min":1.724,"15min":1.6160000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":14.843999999999999,"5min":14.843999999999999,"15min":32.759999999999998},"last":2.4700000000000002}]},{"osd":4,"last update":"Fri Jul 7 04:00:26 2023","interfaces":[{"interface":"back","average":{"1min":2.5270000000000001,"5min":1.732,"15min":1.7410000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.32500000000000001},"max":{"1min":17.125,"5min":17.125,"15min":17.125},"last":0.72599999999999998},{"interface":"front","average":{"1min":6.6980000000000004,"5min":2.7509999999999999,"15min":2.02},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":46.898000000000003,"5min":46.898000000000003,"15min":46.898000000000003},"last":0.876}]},{"osd":5,"last update":"Fri Jul 7 04:00:26 2023","interfaces":[{"interface":"back","average":{"1min":4.9720000000000004,"5min":2.516,"15min":2.0590000000000002},"min":{"1min":0.434,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":44.174999999999997,"5min":44.174999999999997,"15min":44.174999999999997},"last":15.645},{"interface":"front","average":{"1min":2.5249999999999999,"5min":1.607,"15min":1.4770000000000001},"min":{"1min":0.45500000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":22.643999999999998,"5min":22.643999999999998,"15min":22.643999999999998},"last":8.9030000000000005}]},{"osd":6,"last update":"Fri Jul 7 04:01:04 2023","interfaces":[{"interface":"back","average":{"1min":7.1109999999999998,"5min":2.512,"15min":1.867},"min":{"1min":0.49299999999999999,"5min":0.41699999999999998,"15min":0.41199999999999998},"max":{"1min":48.225999999999999,"5min":48.225999999999999,"15min":48.225999999999999},"last":4.5019999999999998},{"interface":"front","average":{"1min":6.2880000000000003,"5min":2.4649999999999999,"15min":2.1629999999999998},"min":{"1min":0.42099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":44.990000000000002,"5min":44.990000000000002,"15min":44.990000000000002},"last":0.77800000000000002}]},{"osd":7,"last update":"Fri Jul 7 04:00:26 2023","interfaces":[{"interface":"back","average":{"1min":3.0459999999999998,"5min":2.0609999999999999,"15min":2.2999999999999998},"min":{"1min":0.53000000000000003,"5min":0.45700000000000002,"15min":0.39600000000000002},"max":{"1min":17.155999999999999,"5min":17.155999999999999,"15min":17.155999999999999},"last":2.6299999999999999},{"interface":"front","average":{"1min":5.8760000000000003,"5min":2.8260000000000001,"15min":2.2469999999999999},"min":{"1min":0.503,"5min":0.49299999999999999,"15min":0.42699999999999999},"max":{"1min":44.228999999999999,"5min":44.228999999999999,"15min":44.228999999999999},"last":2.5129999999999999}]}]},{"osd":2,"up_from":13,"seq":55834580602,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8150288,"kb_used_data":6309412,"kb_used_omap":11342,"kb_used_meta":1812977,"kb_avail":86221552,"statfs":{"total":96636764160,"available":88290869248,"internally_reserved":0,"allocated":6460837888,"data_stored":6457667617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11614252,"internal_metadata":1856489428},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":51,"apply_latency_ms":51,"commit_latency_ns":51000000,"apply_latency_ns":51000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:23 2023","interfaces":[{"interface":"back","average":{"1min":1.843,"5min":1.3440000000000001,"15min":1.2270000000000001},"min":{"1min":0.253,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":11.614000000000001,"5min":11.614000000000001,"15min":11.898999999999999},"last":5.6669999999999998},{"interface":"front","average":{"1min":2.3580000000000001,"5min":1.6020000000000001,"15min":1.389},"min":{"1min":0.28299999999999997,"5min":0.26700000000000002,"15min":0.25},"max":{"1min":24.515000000000001,"5min":24.515000000000001,"15min":24.515000000000001},"last":8.6720000000000006}]},{"osd":1,"last update":"Fri Jul 7 04:00:32 2023","interfaces":[{"interface":"back","average":{"1min":2.016,"5min":1.526,"15min":1.3340000000000001},"min":{"1min":0.28899999999999998,"5min":0.26600000000000001,"15min":0.248},"max":{"1min":10.263999999999999,"5min":10.263999999999999,"15min":10.263999999999999},"last":5.2729999999999997},{"interface":"front","average":{"1min":2.8999999999999999,"5min":1.7669999999999999,"15min":1.5009999999999999},"min":{"1min":0.36799999999999999,"5min":0.28799999999999998,"15min":0.26400000000000001},"max":{"1min":16.858000000000001,"5min":16.858000000000001,"15min":16.858000000000001},"last":4.718}]},{"osd":3,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":7.9550000000000001,"5min":3.1200000000000001,"15min":1.9930000000000001},"min":{"1min":0.28799999999999998,"5min":0.28599999999999998,"15min":0.252},"max":{"1min":96.594999999999999,"5min":96.594999999999999,"15min":96.594999999999999},"last":4.8280000000000003},{"interface":"front","average":{"1min":3.4649999999999999,"5min":1.752,"15min":1.472},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.29599999999999999},"max":{"1min":22.445,"5min":22.445,"15min":22.445},"last":5.2370000000000001}]},{"osd":4,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.333,"15min":1.2430000000000001},"min":{"1min":0.36599999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":7.9710000000000001,"5min":7.9710000000000001,"15min":8.6340000000000003},"last":5.1230000000000002},{"interface":"front","average":{"1min":1.99,"5min":1.6299999999999999,"15min":1.5980000000000001},"min":{"1min":0.38700000000000001,"5min":0.38300000000000001,"15min":0.34999999999999998},"max":{"1min":10.791,"5min":10.791,"15min":10.791},"last":4.6790000000000003}]},{"osd":5,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":2.3100000000000001,"5min":1.994,"15min":1.861},"min":{"1min":0.41899999999999998,"5min":0.39000000000000001,"15min":0.38500000000000001},"max":{"1min":12.581,"5min":12.581,"15min":12.581},"last":4.7910000000000004},{"interface":"front","average":{"1min":2.0819999999999999,"5min":1.8340000000000001,"15min":1.6279999999999999},"min":{"1min":0.41599999999999998,"5min":0.39500000000000002,"15min":0.39300000000000002},"max":{"1min":12.428000000000001,"5min":12.428000000000001,"15min":12.428000000000001},"last":5.1929999999999996}]},{"osd":6,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":1.931,"5min":1.956,"15min":1.794},"min":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.39100000000000001},"max":{"1min":10.855,"5min":10.855,"15min":11.019},"last":8.6020000000000003},{"interface":"front","average":{"1min":2.714,"5min":2.1859999999999999,"15min":2.0600000000000001},"min":{"1min":0.46200000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":12.481,"5min":12.481,"15min":12.481},"last":4.8730000000000002}]},{"osd":7,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":2.6019999999999999,"5min":2.0099999999999998,"15min":1.869},"min":{"1min":0.48599999999999999,"5min":0.45800000000000002,"15min":0.42599999999999999},"max":{"1min":10.890000000000001,"5min":10.890000000000001,"15min":10.890000000000001},"last":4.6079999999999997},{"interface":"front","average":{"1min":2.4020000000000001,"5min":2.2810000000000001,"15min":2.1869999999999998},"min":{"1min":0.51400000000000001,"5min":0.48299999999999998,"15min":0.45300000000000001},"max":{"1min":12.617000000000001,"5min":12.617000000000001,"15min":12.617000000000001},"last":4.7389999999999999}]}]},{"osd":3,"up_from":13,"seq":55834580589,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6842044,"kb_used_data":5161588,"kb_used_omap":20609,"kb_used_meta":1659838,"kb_avail":87529796,"statfs":{"total":96636764160,"available":89630511104,"internally_reserved":0,"allocated":5285466112,"data_stored":5282830452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21104547,"internal_metadata":1699674205},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:37 2023","interfaces":[{"interface":"back","average":{"1min":2.6600000000000001,"5min":1.411,"15min":1.2130000000000001},"min":{"1min":0.24399999999999999,"5min":0.23699999999999999,"15min":0.22800000000000001},"max":{"1min":18.285,"5min":18.285,"15min":18.285},"last":0.41499999999999998},{"interface":"front","average":{"1min":2.9199999999999999,"5min":1.7210000000000001,"15min":1.716},"min":{"1min":0.247,"5min":0.247,"15min":0.23799999999999999},"max":{"1min":19.972000000000001,"5min":19.972000000000001,"15min":19.972000000000001},"last":0.72299999999999998}]},{"osd":1,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":2.258,"5min":2.3860000000000001,"15min":1.758},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.23699999999999999},"max":{"1min":15.093,"5min":61.411000000000001,"15min":61.411000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":2.9620000000000002,"5min":1.706,"15min":1.575},"min":{"1min":0.314,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":18.222000000000001,"5min":18.222000000000001,"15min":18.222000000000001},"last":0.64300000000000002}]},{"osd":2,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":2.9500000000000002,"5min":2.4900000000000002,"15min":1.978},"min":{"1min":0.317,"5min":0.312,"15min":0.28299999999999997},"max":{"1min":14.986000000000001,"5min":61.511000000000003,"15min":61.511000000000003},"last":0.61299999999999999},{"interface":"front","average":{"1min":4.6500000000000004,"5min":2.4660000000000002,"15min":1.9339999999999999},"min":{"1min":0.45600000000000002,"5min":0.314,"15min":0.314},"max":{"1min":20.542000000000002,"5min":61.707000000000001,"15min":61.707000000000001},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":4.5419999999999998,"5min":2.8090000000000002,"15min":2.2120000000000002},"min":{"1min":0.38,"5min":0.33000000000000002,"15min":0.32300000000000001},"max":{"1min":21.120000000000001,"5min":61.453000000000003,"15min":61.453000000000003},"last":0.79800000000000004},{"interface":"front","average":{"1min":2.5750000000000002,"5min":2.3010000000000002,"15min":1.843},"min":{"1min":0.377,"5min":0.377,"15min":0.35699999999999998},"max":{"1min":15.122,"5min":61.558,"15min":61.558},"last":0.74299999999999999}]},{"osd":5,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":3.8490000000000002,"5min":1.921,"15min":1.659},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":21.388999999999999,"5min":21.388999999999999,"15min":21.388999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":5.0069999999999997,"5min":2.4740000000000002,"15min":2.2080000000000002},"min":{"1min":0.46000000000000002,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":32.100999999999999,"5min":32.100999999999999,"15min":32.100999999999999},"last":0.66400000000000003}]},{"osd":6,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":4.2039999999999997,"5min":2.5790000000000002,"15min":2.1389999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":27.613,"5min":61.667000000000002,"15min":61.667000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":7.2060000000000004,"5min":2.7999999999999998,"15min":2.0680000000000001},"min":{"1min":0.45800000000000002,"5min":0.44400000000000001,"15min":0.442},"max":{"1min":83.242000000000004,"5min":83.242000000000004,"15min":83.242000000000004},"last":0.68799999999999994}]},{"osd":7,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":4.516,"5min":2.5310000000000001,"15min":2.3620000000000001},"min":{"1min":0.49299999999999999,"5min":0.42299999999999999,"15min":0.40100000000000002},"max":{"1min":19.928000000000001,"5min":19.928000000000001,"15min":19.928000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":3.0960000000000001,"5min":2.7189999999999999,"15min":2.3130000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":15.063000000000001,"5min":61.621000000000002,"15min":61.621000000000002},"last":0.78000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834580632,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7410600,"kb_used_data":6118112,"kb_used_omap":11728,"kb_used_meta":1280751,"kb_avail":86961240,"statfs":{"total":96636764160,"available":89048309760,"internally_reserved":0,"allocated":6264946688,"data_stored":6262290568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12010156,"internal_metadata":1311489364},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":7.8529999999999998,"5min":2.2999999999999998,"15min":1.486},"min":{"1min":0.252,"5min":0.252,"15min":0.251},"max":{"1min":97.753,"5min":97.753,"15min":97.753},"last":3.169},{"interface":"front","average":{"1min":3.6150000000000002,"5min":1.7450000000000001,"15min":1.6279999999999999},"min":{"1min":0.30299999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":30.262,"5min":30.262,"15min":30.262},"last":17.577000000000002}]},{"osd":1,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":3.843,"5min":1.8,"15min":1.772},"min":{"1min":0.28999999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":25.344999999999999,"5min":25.344999999999999,"15min":25.344999999999999},"last":3.2599999999999998},{"interface":"front","average":{"1min":4.6109999999999998,"5min":2.1850000000000001,"15min":1.77},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":66.322000000000003,"5min":66.322000000000003,"15min":66.322000000000003},"last":3.2069999999999999}]},{"osd":2,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":2.8170000000000002,"5min":1.8200000000000001,"15min":1.831},"min":{"1min":0.36199999999999999,"5min":0.308,"15min":0.308},"max":{"1min":7.9800000000000004,"5min":7.9800000000000004,"15min":13.151999999999999},"last":3.3029999999999999},{"interface":"front","average":{"1min":3.1960000000000002,"5min":1.899,"15min":1.97},"min":{"1min":0.42299999999999999,"5min":0.34300000000000003,"15min":0.33300000000000002},"max":{"1min":10.395,"5min":10.395,"15min":10.395},"last":10.051}]},{"osd":3,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":3.4689999999999999,"5min":2.3130000000000002,"15min":2.0899999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":21.390999999999998,"5min":21.390999999999998,"15min":21.390999999999998},"last":8.0440000000000005},{"interface":"front","average":{"1min":3.5609999999999999,"5min":2.1299999999999999,"15min":2.1499999999999999},"min":{"1min":0.45600000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":11.641999999999999,"5min":11.641999999999999,"15min":11.641999999999999},"last":0.55000000000000004}]},{"osd":5,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":4.1959999999999997,"5min":1.694,"15min":1.3100000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.30499999999999999},"max":{"1min":51.551000000000002,"5min":51.551000000000002,"15min":51.551000000000002},"last":3.2389999999999999},{"interface":"front","average":{"1min":2.3439999999999999,"5min":1.242,"15min":1.427},"min":{"1min":0.371,"5min":0.33100000000000002,"15min":0.317},"max":{"1min":22.038,"5min":22.038,"15min":22.038},"last":7.0389999999999997}]},{"osd":6,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.0760000000000001,"15min":1.4590000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.29699999999999999},"max":{"1min":4.1959999999999997,"5min":7.9189999999999996,"15min":8.0760000000000005},"last":3.335},{"interface":"front","average":{"1min":4.2670000000000003,"5min":1.7390000000000001,"15min":1.5580000000000001},"min":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.371},"max":{"1min":66.373999999999995,"5min":66.373999999999995,"15min":66.373999999999995},"last":7.3780000000000001}]},{"osd":7,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":1.962,"5min":1.3180000000000001,"15min":1.5349999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.36599999999999999},"max":{"1min":8.0399999999999991,"5min":8.0399999999999991,"15min":11.585000000000001},"last":4.1980000000000004},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.1180000000000001,"15min":1.52},"min":{"1min":0.375,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":3.7970000000000002,"5min":7.1449999999999996,"15min":12.414},"last":0.496}]}]},{"osd":5,"up_from":13,"seq":55834580638,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6633148,"kb_used_data":5007264,"kb_used_omap":19606,"kb_used_meta":1580905,"kb_avail":87738692,"statfs":{"total":96636764160,"available":89844420608,"internally_reserved":0,"allocated":5127438336,"data_stored":5125154964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20076954,"internal_metadata":1618847334},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":4.0099999999999998,"5min":1.6100000000000001,"15min":1.4730000000000001},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":46.174999999999997,"5min":46.174999999999997,"15min":46.174999999999997},"last":2.6539999999999999},{"interface":"front","average":{"1min":2.0579999999999998,"5min":1.675,"15min":1.804},"min":{"1min":0.28799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":11.06,"5min":13.792999999999999,"15min":38.530999999999999},"last":7.524}]},{"osd":1,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":2.8319999999999999,"5min":1.6539999999999999,"15min":1.6439999999999999},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.28299999999999997},"max":{"1min":15.209,"5min":15.209,"15min":15.343},"last":7.202},{"interface":"front","average":{"1min":4.2779999999999996,"5min":2.0379999999999998,"15min":1.746},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.29599999999999999},"max":{"1min":33.927999999999997,"5min":33.927999999999997,"15min":33.927999999999997},"last":2.621}]},{"osd":2,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":2.319,"5min":1.7070000000000001,"15min":2.097},"min":{"1min":0.39200000000000002,"5min":0.29799999999999999,"15min":0.28699999999999998},"max":{"1min":9.5609999999999999,"5min":9.5609999999999999,"15min":10.222},"last":7.4749999999999996},{"interface":"front","average":{"1min":2.4300000000000002,"5min":1.893,"15min":1.6639999999999999},"min":{"1min":0.41299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":13.628,"5min":13.628,"15min":15.398},"last":7.5449999999999999}]},{"osd":3,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":3.8929999999999998,"5min":2.141,"15min":1.9930000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":33.828000000000003,"5min":33.828000000000003,"15min":33.828000000000003},"last":7.3979999999999997},{"interface":"front","average":{"1min":2.476,"5min":2.069,"15min":2.1070000000000002},"min":{"1min":0.443,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":13.595000000000001,"5min":13.595000000000001,"15min":15.43},"last":7.625}]},{"osd":4,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":3.306,"5min":1.752,"15min":1.373},"min":{"1min":0.32400000000000001,"5min":0.308,"15min":0.27800000000000002},"max":{"1min":28.396999999999998,"5min":28.396999999999998,"15min":28.396999999999998},"last":7.3310000000000004},{"interface":"front","average":{"1min":2.7639999999999998,"5min":2.012,"15min":1.696},"min":{"1min":0.33000000000000002,"5min":0.32600000000000001,"15min":0.29199999999999998},"max":{"1min":23.481999999999999,"5min":23.481999999999999,"15min":23.481999999999999},"last":7.423}]},{"osd":6,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":3.8210000000000002,"5min":1.913,"15min":1.667},"min":{"1min":0.36499999999999999,"5min":0.311,"15min":0.29599999999999999},"max":{"1min":55.161000000000001,"5min":55.161000000000001,"15min":55.161000000000001},"last":7.2830000000000004},{"interface":"front","average":{"1min":4.1879999999999997,"5min":1.8899999999999999,"15min":1.669},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.32900000000000001},"max":{"1min":62.456000000000003,"5min":62.456000000000003,"15min":62.456000000000003},"last":2.569}]},{"osd":7,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":1.839,"5min":1.629,"15min":1.78},"min":{"1min":0.41099999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":7.1710000000000003,"5min":24.16,"15min":24.16},"last":3.1080000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":1.327,"15min":1.468},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.37},"max":{"1min":3.3980000000000001,"5min":17.751000000000001,"15min":17.751000000000001},"last":7.5860000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-07T04:01:18.234 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-07T04:01:18.235 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-07T04:01:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.377+0000 7fedd65af700 1 Processor -- start 2023-07-07T04:01:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.377+0000 7fedd65af700 1 -- start start 2023-07-07T04:01:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.378+0000 7fedd65af700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fedd00cd1b0 0x7fedd006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.378+0000 7fedd65af700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd0160060 con 0x7fedd006c2f0 2023-07-07T04:01:18.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.378+0000 7fedd65af700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd006c6f0 con 0x7fedd015ce50 2023-07-07T04:01:18.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.378+0000 7fedd65af700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd00cd800 con 0x7fedd00cd1b0 2023-07-07T04:01:18.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.378+0000 7fedcf7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fedd00cd1b0 0x7fedd006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:18.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.378+0000 7fedd4b4c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fedd006c2f0 0x7fedd00d0730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49434/0 (socket says 172.21.15.6:49434) 2023-07-07T04:01:18.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.378+0000 7fedd4b4c700 1 -- 172.21.15.6:0/1405762591 learned_addr learned my addr 172.21.15.6:0/1405762591 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:01:18.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.378+0000 7fedceffd700 1 -- 172.21.15.6:0/1405762591 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1826929645 0 0) 0x7fedd0160060 con 0x7fedd006c2f0 2023-07-07T04:01:18.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.378+0000 7fedceffd700 1 -- 172.21.15.6:0/1405762591 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedb80035b0 con 0x7fedd006c2f0 2023-07-07T04:01:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.378+0000 7fedcf7fe700 1 -- 172.21.15.6:0/1405762591 >> v1:172.21.15.40:6789/0 conn(0x7fedd015ce50 legacy=0x7fedd015d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.378+0000 7fedcf7fe700 1 -- 172.21.15.6:0/1405762591 >> v1:172.21.15.6:6789/0 conn(0x7fedd006c2f0 legacy=0x7fedd00d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.378+0000 7fedcf7fe700 1 -- 172.21.15.6:0/1405762591 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd01602b0 con 0x7fedd00cd1b0 2023-07-07T04:01:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.379+0000 7fedcf7fe700 1 --2- 172.21.15.6:0/1405762591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedd00cd1b0 0x7fedd006bdb0 secure :-1 s=READY pgs=3358 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009840 tx=0x7fedc4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350bb2d051e31b7b server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:18.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.379+0000 7fedceffd700 1 -- 172.21.15.6:0/1405762591 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4011830 con 0x7fedd00cd1b0 2023-07-07T04:01:18.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.379+0000 7fedceffd700 1 -- 172.21.15.6:0/1405762591 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc4011990 con 0x7fedd00cd1b0 2023-07-07T04:01:18.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.379+0000 7fedceffd700 1 -- 172.21.15.6:0/1405762591 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc4011d20 con 0x7fedd00cd1b0 2023-07-07T04:01:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.379+0000 7fedd65af700 1 -- 172.21.15.6:0/1405762591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedd00cd1b0 msgr2=0x7fedd006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.379+0000 7fedd65af700 1 --2- 172.21.15.6:0/1405762591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedd00cd1b0 0x7fedd006bdb0 secure :-1 s=READY pgs=3358 cs=0 l=1 rev1=1 crypto rx=0x7fedc4009840 tx=0x7fedc4009b50 comp rx=0 tx=0).stop 2023-07-07T04:01:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.379+0000 7fedd65af700 1 -- 172.21.15.6:0/1405762591 shutdown_connections 2023-07-07T04:01:18.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.379+0000 7fedd65af700 1 --2- 172.21.15.6:0/1405762591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedd00cd1b0 0x7fedd006bdb0 unknown :-1 s=CLOSED pgs=3358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.379+0000 7fedd65af700 1 -- 172.21.15.6:0/1405762591 >> 172.21.15.6:0/1405762591 conn(0x7fedd00d3880 msgr2=0x7fedd00cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.379+0000 7fedd65af700 1 -- 172.21.15.6:0/1405762591 shutdown_connections 2023-07-07T04:01:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.379+0000 7fedd65af700 1 -- 172.21.15.6:0/1405762591 wait complete. 2023-07-07T04:01:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.381+0000 7fedd65af700 1 Processor -- start 2023-07-07T04:01:18.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.381+0000 7fedd65af700 1 -- start start 2023-07-07T04:01:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.382+0000 7fedd65af700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fedd006c2f0 0x7fedd01f1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.382+0000 7fedd65af700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fedd00cd1b0 0x7fedd015f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.382+0000 7fedd65af700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedd015ce50 0x7fedd013f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.382+0000 7fedd65af700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd00b8970 con 0x7fedd015ce50 2023-07-07T04:01:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.382+0000 7fedd65af700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd015f700 con 0x7fedd006c2f0 2023-07-07T04:01:18.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.382+0000 7fedd65af700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd015e410 con 0x7fedd00cd1b0 2023-07-07T04:01:18.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.382+0000 7fedd4b4c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedd015ce50 0x7fedd013f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:18.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.382+0000 7fedd4b4c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedd015ce50 0x7fedd013f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48232/0 (socket says 172.21.15.6:48232) 2023-07-07T04:01:18.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.382+0000 7fedd4b4c700 1 -- 172.21.15.6:0/1983856587 learned_addr learned my addr 172.21.15.6:0/1983856587 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:18.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.382+0000 7fedcf7fe700 1 --2- 172.21.15.6:0/1983856587 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fedd00cd1b0 0x7fedd015f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.382+0000 7fedcffff700 1 --2- 172.21.15.6:0/1983856587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fedd006c2f0 0x7fedd01f1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.382+0000 7fedd4b4c700 1 -- 172.21.15.6:0/1983856587 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fedd00cd1b0 msgr2=0x7fedd015f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.382+0000 7fedd4b4c700 1 --2- 172.21.15.6:0/1983856587 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fedd00cd1b0 0x7fedd015f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.382+0000 7fedd4b4c700 1 -- 172.21.15.6:0/1983856587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fedd006c2f0 msgr2=0x7fedd01f1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.382+0000 7fedd4b4c700 1 --2- 172.21.15.6:0/1983856587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fedd006c2f0 0x7fedd01f1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.382+0000 7fedd4b4c700 1 -- 172.21.15.6:0/1983856587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc40094a0 con 0x7fedd015ce50 2023-07-07T04:01:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.382+0000 7fedd4b4c700 1 --2- 172.21.15.6:0/1983856587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedd015ce50 0x7fedd013f9a0 secure :-1 s=READY pgs=3359 cs=0 l=1 rev1=1 crypto rx=0x7fedc800cb40 tx=0x7fedc800ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.383+0000 7fedccff9700 1 -- 172.21.15.6:0/1983856587 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc800a9e0 con 0x7fedd015ce50 2023-07-07T04:01:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.383+0000 7fedccff9700 1 -- 172.21.15.6:0/1983856587 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc800ab40 con 0x7fedd015ce50 2023-07-07T04:01:18.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.383+0000 7fedccff9700 1 -- 172.21.15.6:0/1983856587 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc8012400 con 0x7fedd015ce50 2023-07-07T04:01:18.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.383+0000 7fedd65af700 1 -- 172.21.15.6:0/1983856587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd00b8690 con 0x7fedd015ce50 2023-07-07T04:01:18.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.383+0000 7fedd65af700 1 -- 172.21.15.6:0/1983856587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd015e9c0 con 0x7fedd015ce50 2023-07-07T04:01:18.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.384+0000 7fedd65af700 1 -- 172.21.15.6:0/1983856587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd00b1f30 con 0x7fedd015ce50 2023-07-07T04:01:18.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.384+0000 7fedccff9700 1 -- 172.21.15.6:0/1983856587 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fedc801b3b0 con 0x7fedd015ce50 2023-07-07T04:01:18.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.385+0000 7fedccff9700 1 --2- 172.21.15.6:0/1983856587 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fedbc06ace0 0x7fedbc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:18.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.385+0000 7fedccff9700 1 -- 172.21.15.6:0/1983856587 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fedc8088e10 con 0x7fedd015ce50 2023-07-07T04:01:18.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.385+0000 7fedcffff700 1 --2- 172.21.15.6:0/1983856587 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fedbc06ace0 0x7fedbc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:18.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.385+0000 7fedcffff700 1 --2- 172.21.15.6:0/1983856587 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fedbc06ace0 0x7fedbc06d190 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fedc0007fd0 tx=0x7fedc0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:18.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.389+0000 7fedccff9700 1 -- 172.21.15.6:0/1983856587 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fedc8054130 con 0x7fedd015ce50 2023-07-07T04:01:18.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.595+0000 7fedd65af700 1 -- 172.21.15.6:0/1983856587 --> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fedd0160870 con 0x7fedbc06ace0 2023-07-07T04:01:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.598+0000 7fedccff9700 1 -- 172.21.15.6:0/1983856587 <== mgr.4110 v2:172.21.15.6:6832/201543369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71426 (secure 0 0 0) 0x7fedc0001cc0 con 0x7fedbc06ace0 2023-07-07T04:01:18.600 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:01:18.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.600+0000 7fedd65af700 1 -- 172.21.15.6:0/1983856587 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fedbc06ace0 msgr2=0x7fedbc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:18.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.600+0000 7fedd65af700 1 --2- 172.21.15.6:0/1983856587 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fedbc06ace0 0x7fedbc06d190 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fedc0007fd0 tx=0x7fedc0009040 comp rx=0 tx=0).stop 2023-07-07T04:01:18.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.600+0000 7fedd65af700 1 -- 172.21.15.6:0/1983856587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedd015ce50 msgr2=0x7fedd013f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:18.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.600+0000 7fedd65af700 1 --2- 172.21.15.6:0/1983856587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedd015ce50 0x7fedd013f9a0 secure :-1 s=READY pgs=3359 cs=0 l=1 rev1=1 crypto rx=0x7fedc800cb40 tx=0x7fedc800ce50 comp rx=0 tx=0).stop 2023-07-07T04:01:18.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.600+0000 7fedd65af700 1 -- 172.21.15.6:0/1983856587 shutdown_connections 2023-07-07T04:01:18.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.600+0000 7fedd65af700 1 --2- 172.21.15.6:0/1983856587 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fedbc06ace0 0x7fedbc06d190 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:18.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.600+0000 7fedd65af700 1 --2- 172.21.15.6:0/1983856587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedd015ce50 0x7fedd013f9a0 unknown :-1 s=CLOSED pgs=3359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:18.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.600+0000 7fedd65af700 1 --2- 172.21.15.6:0/1983856587 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fedd006c2f0 0x7fedd01f1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:18.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.600+0000 7fedd65af700 1 --2- 172.21.15.6:0/1983856587 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fedd00cd1b0 0x7fedd015f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:18.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.600+0000 7fedd65af700 1 -- 172.21.15.6:0/1983856587 >> 172.21.15.6:0/1983856587 conn(0x7fedd00d3880 msgr2=0x7fedd00d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:18.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.600+0000 7fedd65af700 1 -- 172.21.15.6:0/1983856587 shutdown_connections 2023-07-07T04:01:18.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.600+0000 7fedd65af700 1 -- 172.21.15.6:0/1983856587 wait complete. 2023-07-07T04:01:18.604 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-07T04:01:18.615 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":14510,"stamp":"2023-07-07T04:01:17.945403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":58804444,"kb_used_data":46832768,"kb_used_omap":151204,"kb_used_meta":11707995,"kb_avail":696170276,"statfs":{"total":773094113280,"available":712878362624,"internally_reserved":0,"allocated":47956754432,"data_stored":47935144640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":154833875,"internal_metadata":11988986925},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":370,"apply_latency_ms":370,"commit_latency_ns":370000000,"apply_latency_ns":370000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-63863244667,"num_objects":-45149,"num_object_clones":0,"num_object_copies":-90298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-45149,"num_whiteouts":0,"num_read":-1564873,"num_read_kb":-372837003,"num_write":-3149060,"num_write_kb":-618200878,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-3621,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.004192"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":295,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.917698+0000","last_change":"2023-07-06T19:58:47.723855+0000","last_active":"2023-07-07T04:01:12.917698+0000","last_peered":"2023-07-07T04:01:12.917698+0000","last_clean":"2023-07-07T04:01:12.917698+0000","last_became_active":"2023-07-06T19:58:47.723553+0000","last_became_peered":"2023-07-06T19:58:47.723553+0000","last_unstale":"2023-07-07T04:01:12.917698+0000","last_undegraded":"2023-07-07T04:01:12.917698+0000","last_fullsized":"2023-07-07T04:01:12.917698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:11:58.031720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":290,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.961276+0000","last_change":"2023-07-06T19:58:47.705294+0000","last_active":"2023-07-07T04:01:12.961276+0000","last_peered":"2023-07-07T04:01:12.961276+0000","last_clean":"2023-07-07T04:01:12.961276+0000","last_became_active":"2023-07-06T19:58:47.704921+0000","last_became_peered":"2023-07-06T19:58:47.704921+0000","last_unstale":"2023-07-07T04:01:12.961276+0000","last_undegraded":"2023-07-07T04:01:12.961276+0000","last_fullsized":"2023-07-07T04:01:12.961276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:13:52.238597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":291,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:13.296600+0000","last_change":"2023-07-06T19:58:47.766992+0000","last_active":"2023-07-07T04:01:13.296600+0000","last_peered":"2023-07-07T04:01:13.296600+0000","last_clean":"2023-07-07T04:01:13.296600+0000","last_became_active":"2023-07-06T19:58:47.766697+0000","last_became_peered":"2023-07-06T19:58:47.766697+0000","last_unstale":"2023-07-07T04:01:13.296600+0000","last_undegraded":"2023-07-07T04:01:13.296600+0000","last_fullsized":"2023-07-07T04:01:13.296600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:23:14.562370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":290,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.934144+0000","last_change":"2023-07-06T19:58:47.704498+0000","last_active":"2023-07-07T04:01:12.934144+0000","last_peered":"2023-07-07T04:01:12.934144+0000","last_clean":"2023-07-07T04:01:12.934144+0000","last_became_active":"2023-07-06T19:58:47.704172+0000","last_became_peered":"2023-07-06T19:58:47.704172+0000","last_unstale":"2023-07-07T04:01:12.934144+0000","last_undegraded":"2023-07-07T04:01:12.934144+0000","last_fullsized":"2023-07-07T04:01:12.934144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:02:36.844807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"43'161","reported_seq":510,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.946359+0000","last_change":"2023-07-06T19:58:40.972763+0000","last_active":"2023-07-07T04:01:12.946359+0000","last_peered":"2023-07-07T04:01:12.946359+0000","last_clean":"2023-07-07T04:01:12.946359+0000","last_became_active":"2023-07-06T19:58:40.971570+0000","last_became_peered":"2023-07-06T19:58:40.971570+0000","last_unstale":"2023-07-07T04:01:12.946359+0000","last_undegraded":"2023-07-07T04:01:12.946359+0000","last_fullsized":"2023-07-07T04:01:12.946359+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_clean_scrub_stamp":"2023-07-06T19:58:39.653546+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:31:36.048493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":301,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.946495+0000","last_change":"2023-07-06T19:58:47.708545+0000","last_active":"2023-07-07T04:01:12.946495+0000","last_peered":"2023-07-07T04:01:12.946495+0000","last_clean":"2023-07-07T04:01:12.946495+0000","last_became_active":"2023-07-06T19:58:47.708230+0000","last_became_peered":"2023-07-06T19:58:47.708230+0000","last_unstale":"2023-07-07T04:01:12.946495+0000","last_undegraded":"2023-07-07T04:01:12.946495+0000","last_fullsized":"2023-07-07T04:01:12.946495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:31:37.154591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":289,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.947328+0000","last_change":"2023-07-06T19:58:47.723926+0000","last_active":"2023-07-07T04:01:12.947328+0000","last_peered":"2023-07-07T04:01:12.947328+0000","last_clean":"2023-07-07T04:01:12.947328+0000","last_became_active":"2023-07-06T19:58:47.723646+0000","last_became_peered":"2023-07-06T19:58:47.723646+0000","last_unstale":"2023-07-07T04:01:12.947328+0000","last_undegraded":"2023-07-07T04:01:12.947328+0000","last_fullsized":"2023-07-07T04:01:12.947328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:37:22.324090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":288,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.920569+0000","last_change":"2023-07-06T19:58:47.711918+0000","last_active":"2023-07-07T04:01:12.920569+0000","last_peered":"2023-07-07T04:01:12.920569+0000","last_clean":"2023-07-07T04:01:12.920569+0000","last_became_active":"2023-07-06T19:58:47.711591+0000","last_became_peered":"2023-07-06T19:58:47.711591+0000","last_unstale":"2023-07-07T04:01:12.920569+0000","last_undegraded":"2023-07-07T04:01:12.920569+0000","last_fullsized":"2023-07-07T04:01:12.920569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:31:20.169556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":285,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.925775+0000","last_change":"2023-07-06T19:58:47.712143+0000","last_active":"2023-07-07T04:01:12.925775+0000","last_peered":"2023-07-07T04:01:12.925775+0000","last_clean":"2023-07-07T04:01:12.925775+0000","last_became_active":"2023-07-06T19:58:47.711788+0000","last_became_peered":"2023-07-06T19:58:47.711788+0000","last_unstale":"2023-07-07T04:01:12.925775+0000","last_undegraded":"2023-07-07T04:01:12.925775+0000","last_fullsized":"2023-07-07T04:01:12.925775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:48:00.551095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580636,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6657892,"kb_used_data":5039644,"kb_used_omap":28457,"kb_used_meta":1589782,"kb_avail":87713948,"statfs":{"total":96636764160,"available":89819082752,"internally_reserved":0,"allocated":5160595456,"data_stored":5158230903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29140457,"internal_metadata":1627937303},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":2.7480000000000002,"5min":1.383,"15min":1.196},"min":{"1min":0.25900000000000001,"5min":0.24299999999999999,"15min":0.24199999999999999},"max":{"1min":32.406999999999996,"5min":32.406999999999996,"15min":32.406999999999996},"last":2.5960000000000001},{"interface":"front","average":{"1min":3.1840000000000002,"5min":1.9730000000000001,"15min":1.625},"min":{"1min":0.30099999999999999,"5min":0.29399999999999998,"15min":0.26900000000000002},"max":{"1min":24.928999999999998,"5min":24.928999999999998,"15min":24.928999999999998},"last":8.3360000000000003}]},{"osd":1,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":3.4169999999999998,"5min":1.7869999999999999,"15min":1.524},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":32.445,"5min":32.445,"15min":32.445},"last":12.093999999999999},{"interface":"front","average":{"1min":2.4830000000000001,"5min":1.8180000000000001,"15min":1.8839999999999999},"min":{"1min":0.315,"5min":0.29999999999999999,"15min":0.29299999999999998},"max":{"1min":24.966000000000001,"5min":24.966000000000001,"15min":24.966000000000001},"last":12}]},{"osd":2,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":4.1609999999999996,"5min":2.2440000000000002,"15min":1.887},"min":{"1min":0.376,"5min":0.35199999999999998,"15min":0.32200000000000001},"max":{"1min":36.658999999999999,"5min":36.658999999999999,"15min":36.658999999999999},"last":2.4860000000000002},{"interface":"front","average":{"1min":3.3159999999999998,"5min":2.4249999999999998,"15min":2},"min":{"1min":0.41299999999999998,"5min":0.38400000000000001,"15min":0.32900000000000001},"max":{"1min":32.369,"5min":32.369,"15min":32.369},"last":2.3860000000000001}]},{"osd":3,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":5.9930000000000003,"5min":2.9969999999999999,"15min":2.2930000000000001},"min":{"1min":0.39500000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":74.998000000000005,"5min":74.998000000000005,"15min":74.998000000000005},"last":4.484},{"interface":"front","average":{"1min":3.0670000000000002,"5min":2.085,"15min":1.99},"min":{"1min":0.39300000000000002,"5min":0.35799999999999998,"15min":0.33500000000000002},"max":{"1min":16.452999999999999,"5min":16.452999999999999,"15min":16.452999999999999},"last":2.4449999999999998}]},{"osd":4,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":3.7010000000000001,"5min":1.6870000000000001,"15min":1.5049999999999999},"min":{"1min":0.30399999999999999,"5min":0.29299999999999998,"15min":0.28599999999999998},"max":{"1min":59.920999999999999,"5min":59.920999999999999,"15min":59.920999999999999},"last":2.4249999999999998},{"interface":"front","average":{"1min":2.9910000000000001,"5min":1.696,"15min":1.49},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":36.616999999999997,"5min":36.616999999999997,"15min":36.616999999999997},"last":2.536}]},{"osd":5,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":2.508,"5min":1.3720000000000001,"15min":1.282},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":16.904,"5min":16.904,"15min":16.904},"last":7.9089999999999998},{"interface":"front","average":{"1min":2.6110000000000002,"5min":1.6379999999999999,"15min":1.639},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":24.811,"5min":24.811,"15min":24.811},"last":2.4750000000000001}]},{"osd":6,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":3.6749999999999998,"5min":1.9830000000000001,"15min":1.8160000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":60.188000000000002,"5min":60.188000000000002,"15min":60.188000000000002},"last":2.5219999999999998},{"interface":"front","average":{"1min":2.8679999999999999,"5min":1.6719999999999999,"15min":1.5149999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":24.065999999999999,"5min":24.065999999999999,"15min":24.065999999999999},"last":2.5760000000000001}]}]},{"osd":6,"up_from":13,"seq":55834580632,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9669504,"kb_used_data":7709716,"kb_used_omap":17122,"kb_used_meta":1909405,"kb_avail":84702336,"statfs":{"total":96636764160,"available":86735192064,"internally_reserved":0,"allocated":7894749184,"data_stored":7891441954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17533718,"internal_metadata":1955230954},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":51,"apply_latency_ms":51,"commit_latency_ns":51000000,"apply_latency_ns":51000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.5629999999999999,"15min":1.411},"min":{"1min":0.28299999999999997,"5min":0.249,"15min":0.24099999999999999},"max":{"1min":5.9420000000000002,"5min":13.332000000000001,"15min":21.984999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":5.4770000000000003,"5min":2.4609999999999999,"15min":1.9179999999999999},"min":{"1min":0.28699999999999998,"5min":0.27800000000000002,"15min":0.246},"max":{"1min":65.186000000000007,"5min":65.186000000000007,"15min":65.186000000000007},"last":0.83299999999999996}]},{"osd":1,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":3.6629999999999998,"5min":2.524,"15min":2.0920000000000001},"min":{"1min":0.316,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":15.278,"5min":17.091999999999999,"15min":22.117000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":4.4720000000000004,"5min":2.1349999999999998,"15min":1.821},"min":{"1min":0.33500000000000002,"5min":0.29999999999999999,"15min":0.28899999999999998},"max":{"1min":40.649000000000001,"5min":40.649000000000001,"15min":40.649000000000001},"last":1.0029999999999999}]},{"osd":2,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":2.4279999999999999,"5min":2.0710000000000002,"15min":1.9770000000000001},"min":{"1min":0.32900000000000001,"5min":0.32400000000000001,"15min":0.30599999999999999},"max":{"1min":9.3309999999999995,"5min":13.196999999999999,"15min":22.210000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":2.7490000000000001,"5min":2.0750000000000002,"15min":1.877},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.30499999999999999},"max":{"1min":15.545999999999999,"5min":15.545999999999999,"15min":22.280000000000001},"last":0.93200000000000005}]},{"osd":3,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":8.5969999999999995,"5min":3.4540000000000002,"15min":2.5979999999999999},"min":{"1min":0.41499999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":111.95399999999999,"5min":111.95399999999999,"15min":111.95399999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":6.9690000000000003,"5min":3.032,"15min":2.3740000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.33700000000000002},"max":{"1min":112.504,"5min":112.504,"15min":112.504},"last":0.96399999999999997}]},{"osd":4,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":2.1739999999999999,"5min":1.2589999999999999,"15min":1.2929999999999999},"min":{"1min":0.34200000000000003,"5min":0.308,"15min":0.27700000000000002},"max":{"1min":15.587999999999999,"5min":15.587999999999999,"15min":22.225000000000001},"last":0.623},{"interface":"front","average":{"1min":2.1890000000000001,"5min":1.716,"15min":1.6020000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":15.205,"5min":15.205,"15min":22.265999999999998},"last":0.86899999999999999}]},{"osd":5,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":3.956,"5min":2.1339999999999999,"15min":1.885},"min":{"1min":0.39300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":38.103000000000002,"5min":38.103000000000002,"15min":38.103000000000002},"last":0.90500000000000003},{"interface":"front","average":{"1min":3.77,"5min":2.0179999999999998,"15min":1.6579999999999999},"min":{"1min":0.41199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":37.863,"5min":37.863,"15min":37.863},"last":0.78000000000000003}]},{"osd":7,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":1.8129999999999999,"5min":1.4279999999999999,"15min":1.359},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.32300000000000001},"max":{"1min":15.507,"5min":15.507,"15min":22.395},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.7569999999999999,"5min":1.597,"15min":1.4910000000000001},"min":{"1min":0.39500000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":15.471,"5min":15.471,"15min":22.43},"last":0.81000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834580612,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5177288,"kb_used_data":4175360,"kb_used_omap":18390,"kb_used_meta":946281,"kb_avail":89194552,"statfs":{"total":96636764160,"available":91335221248,"internally_reserved":0,"allocated":4275568640,"data_stored":4273643280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18831879,"internal_metadata":968992249},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":3.1869999999999998,"5min":1.788,"15min":1.4410000000000001},"min":{"1min":0.26200000000000001,"5min":0.254,"15min":0.23300000000000001},"max":{"1min":23.021000000000001,"5min":23.021000000000001,"15min":23.021000000000001},"last":2.895},{"interface":"front","average":{"1min":2.855,"5min":2.2010000000000001,"15min":1.829},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.248},"max":{"1min":16.084,"5min":16.084,"15min":16.084},"last":2.835}]},{"osd":2,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":4.2939999999999996,"5min":2.23,"15min":1.8200000000000001},"min":{"1min":0.27800000000000002,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":28.513999999999999,"5min":28.513999999999999,"15min":28.513999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":4.1740000000000004,"5min":2.4169999999999998,"15min":2.1360000000000001},"min":{"1min":0.30599999999999999,"5min":0.28699999999999998,"15min":0.26200000000000001},"max":{"1min":28.352,"5min":28.352,"15min":28.352},"last":0.89300000000000002}]},{"osd":3,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":4.9790000000000001,"5min":2.976,"15min":2.3900000000000001},"min":{"1min":0.32700000000000001,"5min":0.32100000000000001,"15min":0.28100000000000003},"max":{"1min":21.620999999999999,"5min":21.620999999999999,"15min":21.620999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":3.129,"5min":2.2559999999999998,"15min":1.8029999999999999},"min":{"1min":0.38200000000000001,"5min":0.34699999999999998,"15min":0.29999999999999999},"max":{"1min":15.952,"5min":15.952,"15min":15.952},"last":0.66300000000000003}]},{"osd":4,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":3.7829999999999999,"5min":2.085,"15min":1.6659999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":23.071999999999999,"5min":23.071999999999999,"15min":23.071999999999999},"last":2.8540000000000001},{"interface":"front","average":{"1min":2.9729999999999999,"5min":2.3849999999999998,"15min":1.9850000000000001},"min":{"1min":0.40400000000000003,"5min":0.379,"15min":0.35899999999999999},"max":{"1min":11.039,"5min":11.039,"15min":11.039},"last":2.7919999999999998}]},{"osd":5,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":2.7589999999999999,"5min":2.3050000000000002,"15min":2.1160000000000001},"min":{"1min":0.45100000000000001,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":11.085000000000001,"5min":11.085000000000001,"15min":17.998000000000001},"last":1.506},{"interface":"front","average":{"1min":3.4790000000000001,"5min":2.3980000000000001,"15min":2.2519999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":21.696000000000002,"5min":21.696000000000002,"15min":21.696000000000002},"last":2.7000000000000002}]},{"osd":6,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":8.3789999999999996,"5min":3.2909999999999999,"15min":2.2250000000000001},"min":{"1min":0.48799999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":83.441999999999993,"5min":83.441999999999993,"15min":83.441999999999993},"last":3.7269999999999999},{"interface":"front","average":{"1min":7.742,"5min":3.524,"15min":2.669},"min":{"1min":0.51900000000000002,"5min":0.48699999999999999,"15min":0.45900000000000002},"max":{"1min":60.134,"5min":60.134,"15min":60.134},"last":1.5509999999999999}]},{"osd":7,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":3.5329999999999999,"5min":2.2530000000000001,"15min":2.2669999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":21.495000000000001,"5min":21.495000000000001,"15min":21.495000000000001},"last":11.798},{"interface":"front","average":{"1min":4.7720000000000002,"5min":2.7719999999999998,"15min":2.5339999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45700000000000002},"max":{"1min":21.449000000000002,"5min":21.449000000000002,"15min":21.449000000000002},"last":2.7599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834580569,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8263680,"kb_used_data":7311672,"kb_used_omap":23947,"kb_used_meta":928052,"kb_avail":86108160,"statfs":{"total":96636764160,"available":88174755840,"internally_reserved":0,"allocated":7487152128,"data_stored":7483884902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24521912,"internal_metadata":950326088},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":80,"apply_latency_ms":80,"commit_latency_ns":80000000,"apply_latency_ns":80000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 7 04:01:04 2023","interfaces":[{"interface":"back","average":{"1min":4.4340000000000002,"5min":2.1320000000000001,"15min":1.4199999999999999},"min":{"1min":0.28100000000000003,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":26.895,"5min":26.895,"15min":26.895},"last":2.4329999999999998},{"interface":"front","average":{"1min":3.5739999999999998,"5min":1.8380000000000001,"15min":1.909},"min":{"1min":0.27900000000000003,"5min":0.27600000000000002,"15min":0.26000000000000001},"max":{"1min":17.221,"5min":17.221,"15min":32.700000000000003},"last":2.5910000000000002}]},{"osd":2,"last update":"Fri Jul 7 04:00:26 2023","interfaces":[{"interface":"back","average":{"1min":3.0470000000000002,"5min":1.6399999999999999,"15min":1.534},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.25600000000000001},"max":{"1min":14.9,"5min":14.9,"15min":19.475999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":2.3809999999999998,"5min":1.742,"15min":1.784},"min":{"1min":0.29399999999999998,"5min":0.26900000000000002,"15min":0.26600000000000001},"max":{"1min":17.254999999999999,"5min":17.254999999999999,"15min":17.254999999999999},"last":2.5529999999999999}]},{"osd":3,"last update":"Fri Jul 7 04:00:26 2023","interfaces":[{"interface":"back","average":{"1min":5.2400000000000002,"5min":2.2519999999999998,"15min":1.774},"min":{"1min":0.35799999999999998,"5min":0.29299999999999998,"15min":0.26200000000000001},"max":{"1min":44.267000000000003,"5min":44.267000000000003,"15min":44.267000000000003},"last":6.8239999999999998},{"interface":"front","average":{"1min":2.464,"5min":1.724,"15min":1.6160000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":14.843999999999999,"5min":14.843999999999999,"15min":32.759999999999998},"last":2.4700000000000002}]},{"osd":4,"last update":"Fri Jul 7 04:00:26 2023","interfaces":[{"interface":"back","average":{"1min":2.5270000000000001,"5min":1.732,"15min":1.7410000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.32500000000000001},"max":{"1min":17.125,"5min":17.125,"15min":17.125},"last":0.72599999999999998},{"interface":"front","average":{"1min":6.6980000000000004,"5min":2.7509999999999999,"15min":2.02},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":46.898000000000003,"5min":46.898000000000003,"15min":46.898000000000003},"last":0.876}]},{"osd":5,"last update":"Fri Jul 7 04:00:26 2023","interfaces":[{"interface":"back","average":{"1min":4.9720000000000004,"5min":2.516,"15min":2.0590000000000002},"min":{"1min":0.434,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":44.174999999999997,"5min":44.174999999999997,"15min":44.174999999999997},"last":15.645},{"interface":"front","average":{"1min":2.5249999999999999,"5min":1.607,"15min":1.4770000000000001},"min":{"1min":0.45500000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":22.643999999999998,"5min":22.643999999999998,"15min":22.643999999999998},"last":8.9030000000000005}]},{"osd":6,"last update":"Fri Jul 7 04:01:04 2023","interfaces":[{"interface":"back","average":{"1min":7.1109999999999998,"5min":2.512,"15min":1.867},"min":{"1min":0.49299999999999999,"5min":0.41699999999999998,"15min":0.41199999999999998},"max":{"1min":48.225999999999999,"5min":48.225999999999999,"15min":48.225999999999999},"last":4.5019999999999998},{"interface":"front","average":{"1min":6.2880000000000003,"5min":2.4649999999999999,"15min":2.1629999999999998},"min":{"1min":0.42099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":44.990000000000002,"5min":44.990000000000002,"15min":44.990000000000002},"last":0.77800000000000002}]},{"osd":7,"last update":"Fri Jul 7 04:00:26 2023","interfaces":[{"interface":"back","average":{"1min":3.0459999999999998,"5min":2.0609999999999999,"15min":2.2999999999999998},"min":{"1min":0.53000000000000003,"5min":0.45700000000000002,"15min":0.39600000000000002},"max":{"1min":17.155999999999999,"5min":17.155999999999999,"15min":17.155999999999999},"last":2.6299999999999999},{"interface":"front","average":{"1min":5.8760000000000003,"5min":2.8260000000000001,"15min":2.2469999999999999},"min":{"1min":0.503,"5min":0.49299999999999999,"15min":0.42699999999999999},"max":{"1min":44.228999999999999,"5min":44.228999999999999,"15min":44.228999999999999},"last":2.5129999999999999}]}]},{"osd":2,"up_from":13,"seq":55834580602,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8150288,"kb_used_data":6309412,"kb_used_omap":11342,"kb_used_meta":1812977,"kb_avail":86221552,"statfs":{"total":96636764160,"available":88290869248,"internally_reserved":0,"allocated":6460837888,"data_stored":6457667617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11614252,"internal_metadata":1856489428},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":51,"apply_latency_ms":51,"commit_latency_ns":51000000,"apply_latency_ns":51000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:23 2023","interfaces":[{"interface":"back","average":{"1min":1.843,"5min":1.3440000000000001,"15min":1.2270000000000001},"min":{"1min":0.253,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":11.614000000000001,"5min":11.614000000000001,"15min":11.898999999999999},"last":5.6669999999999998},{"interface":"front","average":{"1min":2.3580000000000001,"5min":1.6020000000000001,"15min":1.389},"min":{"1min":0.28299999999999997,"5min":0.26700000000000002,"15min":0.25},"max":{"1min":24.515000000000001,"5min":24.515000000000001,"15min":24.515000000000001},"last":8.6720000000000006}]},{"osd":1,"last update":"Fri Jul 7 04:00:32 2023","interfaces":[{"interface":"back","average":{"1min":2.016,"5min":1.526,"15min":1.3340000000000001},"min":{"1min":0.28899999999999998,"5min":0.26600000000000001,"15min":0.248},"max":{"1min":10.263999999999999,"5min":10.263999999999999,"15min":10.263999999999999},"last":5.2729999999999997},{"interface":"front","average":{"1min":2.8999999999999999,"5min":1.7669999999999999,"15min":1.5009999999999999},"min":{"1min":0.36799999999999999,"5min":0.28799999999999998,"15min":0.26400000000000001},"max":{"1min":16.858000000000001,"5min":16.858000000000001,"15min":16.858000000000001},"last":4.718}]},{"osd":3,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":7.9550000000000001,"5min":3.1200000000000001,"15min":1.9930000000000001},"min":{"1min":0.28799999999999998,"5min":0.28599999999999998,"15min":0.252},"max":{"1min":96.594999999999999,"5min":96.594999999999999,"15min":96.594999999999999},"last":4.8280000000000003},{"interface":"front","average":{"1min":3.4649999999999999,"5min":1.752,"15min":1.472},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.29599999999999999},"max":{"1min":22.445,"5min":22.445,"15min":22.445},"last":5.2370000000000001}]},{"osd":4,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.333,"15min":1.2430000000000001},"min":{"1min":0.36599999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":7.9710000000000001,"5min":7.9710000000000001,"15min":8.6340000000000003},"last":5.1230000000000002},{"interface":"front","average":{"1min":1.99,"5min":1.6299999999999999,"15min":1.5980000000000001},"min":{"1min":0.38700000000000001,"5min":0.38300000000000001,"15min":0.34999999999999998},"max":{"1min":10.791,"5min":10.791,"15min":10.791},"last":4.6790000000000003}]},{"osd":5,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":2.3100000000000001,"5min":1.994,"15min":1.861},"min":{"1min":0.41899999999999998,"5min":0.39000000000000001,"15min":0.38500000000000001},"max":{"1min":12.581,"5min":12.581,"15min":12.581},"last":4.7910000000000004},{"interface":"front","average":{"1min":2.0819999999999999,"5min":1.8340000000000001,"15min":1.6279999999999999},"min":{"1min":0.41599999999999998,"5min":0.39500000000000002,"15min":0.39300000000000002},"max":{"1min":12.428000000000001,"5min":12.428000000000001,"15min":12.428000000000001},"last":5.1929999999999996}]},{"osd":6,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":1.931,"5min":1.956,"15min":1.794},"min":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.39100000000000001},"max":{"1min":10.855,"5min":10.855,"15min":11.019},"last":8.6020000000000003},{"interface":"front","average":{"1min":2.714,"5min":2.1859999999999999,"15min":2.0600000000000001},"min":{"1min":0.46200000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":12.481,"5min":12.481,"15min":12.481},"last":4.8730000000000002}]},{"osd":7,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":2.6019999999999999,"5min":2.0099999999999998,"15min":1.869},"min":{"1min":0.48599999999999999,"5min":0.45800000000000002,"15min":0.42599999999999999},"max":{"1min":10.890000000000001,"5min":10.890000000000001,"15min":10.890000000000001},"last":4.6079999999999997},{"interface":"front","average":{"1min":2.4020000000000001,"5min":2.2810000000000001,"15min":2.1869999999999998},"min":{"1min":0.51400000000000001,"5min":0.48299999999999998,"15min":0.45300000000000001},"max":{"1min":12.617000000000001,"5min":12.617000000000001,"15min":12.617000000000001},"last":4.7389999999999999}]}]},{"osd":3,"up_from":13,"seq":55834580589,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6842044,"kb_used_data":5161588,"kb_used_omap":20609,"kb_used_meta":1659838,"kb_avail":87529796,"statfs":{"total":96636764160,"available":89630511104,"internally_reserved":0,"allocated":5285466112,"data_stored":5282830452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21104547,"internal_metadata":1699674205},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:37 2023","interfaces":[{"interface":"back","average":{"1min":2.6600000000000001,"5min":1.411,"15min":1.2130000000000001},"min":{"1min":0.24399999999999999,"5min":0.23699999999999999,"15min":0.22800000000000001},"max":{"1min":18.285,"5min":18.285,"15min":18.285},"last":0.41499999999999998},{"interface":"front","average":{"1min":2.9199999999999999,"5min":1.7210000000000001,"15min":1.716},"min":{"1min":0.247,"5min":0.247,"15min":0.23799999999999999},"max":{"1min":19.972000000000001,"5min":19.972000000000001,"15min":19.972000000000001},"last":0.72299999999999998}]},{"osd":1,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":2.258,"5min":2.3860000000000001,"15min":1.758},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.23699999999999999},"max":{"1min":15.093,"5min":61.411000000000001,"15min":61.411000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":2.9620000000000002,"5min":1.706,"15min":1.575},"min":{"1min":0.314,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":18.222000000000001,"5min":18.222000000000001,"15min":18.222000000000001},"last":0.64300000000000002}]},{"osd":2,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":2.9500000000000002,"5min":2.4900000000000002,"15min":1.978},"min":{"1min":0.317,"5min":0.312,"15min":0.28299999999999997},"max":{"1min":14.986000000000001,"5min":61.511000000000003,"15min":61.511000000000003},"last":0.61299999999999999},{"interface":"front","average":{"1min":4.6500000000000004,"5min":2.4660000000000002,"15min":1.9339999999999999},"min":{"1min":0.45600000000000002,"5min":0.314,"15min":0.314},"max":{"1min":20.542000000000002,"5min":61.707000000000001,"15min":61.707000000000001},"last":0.48699999999999999}]},{"osd":4,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":4.5419999999999998,"5min":2.8090000000000002,"15min":2.2120000000000002},"min":{"1min":0.38,"5min":0.33000000000000002,"15min":0.32300000000000001},"max":{"1min":21.120000000000001,"5min":61.453000000000003,"15min":61.453000000000003},"last":0.79800000000000004},{"interface":"front","average":{"1min":2.5750000000000002,"5min":2.3010000000000002,"15min":1.843},"min":{"1min":0.377,"5min":0.377,"15min":0.35699999999999998},"max":{"1min":15.122,"5min":61.558,"15min":61.558},"last":0.74299999999999999}]},{"osd":5,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":3.8490000000000002,"5min":1.921,"15min":1.659},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":21.388999999999999,"5min":21.388999999999999,"15min":21.388999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":5.0069999999999997,"5min":2.4740000000000002,"15min":2.2080000000000002},"min":{"1min":0.46000000000000002,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":32.100999999999999,"5min":32.100999999999999,"15min":32.100999999999999},"last":0.66400000000000003}]},{"osd":6,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":4.2039999999999997,"5min":2.5790000000000002,"15min":2.1389999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":27.613,"5min":61.667000000000002,"15min":61.667000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":7.2060000000000004,"5min":2.7999999999999998,"15min":2.0680000000000001},"min":{"1min":0.45800000000000002,"5min":0.44400000000000001,"15min":0.442},"max":{"1min":83.242000000000004,"5min":83.242000000000004,"15min":83.242000000000004},"last":0.68799999999999994}]},{"osd":7,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":4.516,"5min":2.5310000000000001,"15min":2.3620000000000001},"min":{"1min":0.49299999999999999,"5min":0.42299999999999999,"15min":0.40100000000000002},"max":{"1min":19.928000000000001,"5min":19.928000000000001,"15min":19.928000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":3.0960000000000001,"5min":2.7189999999999999,"15min":2.3130000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":15.063000000000001,"5min":61.621000000000002,"15min":61.621000000000002},"last":0.78000000000000003}]}]},{"osd":4,"up_from":13,"seq":55834580632,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7410600,"kb_used_data":6118112,"kb_used_omap":11728,"kb_used_meta":1280751,"kb_avail":86961240,"statfs":{"total":96636764160,"available":89048309760,"internally_reserved":0,"allocated":6264946688,"data_stored":6262290568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12010156,"internal_metadata":1311489364},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":7.8529999999999998,"5min":2.2999999999999998,"15min":1.486},"min":{"1min":0.252,"5min":0.252,"15min":0.251},"max":{"1min":97.753,"5min":97.753,"15min":97.753},"last":3.169},{"interface":"front","average":{"1min":3.6150000000000002,"5min":1.7450000000000001,"15min":1.6279999999999999},"min":{"1min":0.30299999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":30.262,"5min":30.262,"15min":30.262},"last":17.577000000000002}]},{"osd":1,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":3.843,"5min":1.8,"15min":1.772},"min":{"1min":0.28999999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":25.344999999999999,"5min":25.344999999999999,"15min":25.344999999999999},"last":3.2599999999999998},{"interface":"front","average":{"1min":4.6109999999999998,"5min":2.1850000000000001,"15min":1.77},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":66.322000000000003,"5min":66.322000000000003,"15min":66.322000000000003},"last":3.2069999999999999}]},{"osd":2,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":2.8170000000000002,"5min":1.8200000000000001,"15min":1.831},"min":{"1min":0.36199999999999999,"5min":0.308,"15min":0.308},"max":{"1min":7.9800000000000004,"5min":7.9800000000000004,"15min":13.151999999999999},"last":3.3029999999999999},{"interface":"front","average":{"1min":3.1960000000000002,"5min":1.899,"15min":1.97},"min":{"1min":0.42299999999999999,"5min":0.34300000000000003,"15min":0.33300000000000002},"max":{"1min":10.395,"5min":10.395,"15min":10.395},"last":10.051}]},{"osd":3,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":3.4689999999999999,"5min":2.3130000000000002,"15min":2.0899999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":21.390999999999998,"5min":21.390999999999998,"15min":21.390999999999998},"last":8.0440000000000005},{"interface":"front","average":{"1min":3.5609999999999999,"5min":2.1299999999999999,"15min":2.1499999999999999},"min":{"1min":0.45600000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":11.641999999999999,"5min":11.641999999999999,"15min":11.641999999999999},"last":0.55000000000000004}]},{"osd":5,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":4.1959999999999997,"5min":1.694,"15min":1.3100000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.30499999999999999},"max":{"1min":51.551000000000002,"5min":51.551000000000002,"15min":51.551000000000002},"last":3.2389999999999999},{"interface":"front","average":{"1min":2.3439999999999999,"5min":1.242,"15min":1.427},"min":{"1min":0.371,"5min":0.33100000000000002,"15min":0.317},"max":{"1min":22.038,"5min":22.038,"15min":22.038},"last":7.0389999999999997}]},{"osd":6,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.0760000000000001,"15min":1.4590000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.29699999999999999},"max":{"1min":4.1959999999999997,"5min":7.9189999999999996,"15min":8.0760000000000005},"last":3.335},{"interface":"front","average":{"1min":4.2670000000000003,"5min":1.7390000000000001,"15min":1.5580000000000001},"min":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.371},"max":{"1min":66.373999999999995,"5min":66.373999999999995,"15min":66.373999999999995},"last":7.3780000000000001}]},{"osd":7,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":1.962,"5min":1.3180000000000001,"15min":1.5349999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.36599999999999999},"max":{"1min":8.0399999999999991,"5min":8.0399999999999991,"15min":11.585000000000001},"last":4.1980000000000004},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.1180000000000001,"15min":1.52},"min":{"1min":0.375,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":3.7970000000000002,"5min":7.1449999999999996,"15min":12.414},"last":0.496}]}]},{"osd":5,"up_from":13,"seq":55834580638,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6633148,"kb_used_data":5007264,"kb_used_omap":19606,"kb_used_meta":1580905,"kb_avail":87738692,"statfs":{"total":96636764160,"available":89844420608,"internally_reserved":0,"allocated":5127438336,"data_stored":5125154964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20076954,"internal_metadata":1618847334},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":4.0099999999999998,"5min":1.6100000000000001,"15min":1.4730000000000001},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":46.174999999999997,"5min":46.174999999999997,"15min":46.174999999999997},"last":2.6539999999999999},{"interface":"front","average":{"1min":2.0579999999999998,"5min":1.675,"15min":1.804},"min":{"1min":0.28799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":11.06,"5min":13.792999999999999,"15min":38.530999999999999},"last":7.524}]},{"osd":1,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":2.8319999999999999,"5min":1.6539999999999999,"15min":1.6439999999999999},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.28299999999999997},"max":{"1min":15.209,"5min":15.209,"15min":15.343},"last":7.202},{"interface":"front","average":{"1min":4.2779999999999996,"5min":2.0379999999999998,"15min":1.746},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.29599999999999999},"max":{"1min":33.927999999999997,"5min":33.927999999999997,"15min":33.927999999999997},"last":2.621}]},{"osd":2,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":2.319,"5min":1.7070000000000001,"15min":2.097},"min":{"1min":0.39200000000000002,"5min":0.29799999999999999,"15min":0.28699999999999998},"max":{"1min":9.5609999999999999,"5min":9.5609999999999999,"15min":10.222},"last":7.4749999999999996},{"interface":"front","average":{"1min":2.4300000000000002,"5min":1.893,"15min":1.6639999999999999},"min":{"1min":0.41299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":13.628,"5min":13.628,"15min":15.398},"last":7.5449999999999999}]},{"osd":3,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":3.8929999999999998,"5min":2.141,"15min":1.9930000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":33.828000000000003,"5min":33.828000000000003,"15min":33.828000000000003},"last":7.3979999999999997},{"interface":"front","average":{"1min":2.476,"5min":2.069,"15min":2.1070000000000002},"min":{"1min":0.443,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":13.595000000000001,"5min":13.595000000000001,"15min":15.43},"last":7.625}]},{"osd":4,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":3.306,"5min":1.752,"15min":1.373},"min":{"1min":0.32400000000000001,"5min":0.308,"15min":0.27800000000000002},"max":{"1min":28.396999999999998,"5min":28.396999999999998,"15min":28.396999999999998},"last":7.3310000000000004},{"interface":"front","average":{"1min":2.7639999999999998,"5min":2.012,"15min":1.696},"min":{"1min":0.33000000000000002,"5min":0.32600000000000001,"15min":0.29199999999999998},"max":{"1min":23.481999999999999,"5min":23.481999999999999,"15min":23.481999999999999},"last":7.423}]},{"osd":6,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":3.8210000000000002,"5min":1.913,"15min":1.667},"min":{"1min":0.36499999999999999,"5min":0.311,"15min":0.29599999999999999},"max":{"1min":55.161000000000001,"5min":55.161000000000001,"15min":55.161000000000001},"last":7.2830000000000004},{"interface":"front","average":{"1min":4.1879999999999997,"5min":1.8899999999999999,"15min":1.669},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.32900000000000001},"max":{"1min":62.456000000000003,"5min":62.456000000000003,"15min":62.456000000000003},"last":2.569}]},{"osd":7,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":1.839,"5min":1.629,"15min":1.78},"min":{"1min":0.41099999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":7.1710000000000003,"5min":24.16,"15min":24.16},"last":3.1080000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":1.327,"15min":1.468},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.37},"max":{"1min":3.3980000000000001,"5min":17.751000000000001,"15min":17.751000000000001},"last":7.5860000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-07T04:01:18.618 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-07T04:01:18.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.753+0000 7f8451220700 1 Processor -- start 2023-07-07T04:01:18.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.753+0000 7f8451220700 1 -- start start 2023-07-07T04:01:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.753+0000 7f8451220700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f844c15c430 0x7f844c070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.753+0000 7f8451220700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f844c15c800 con 0x7f844c06ef30 2023-07-07T04:01:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.753+0000 7f8451220700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f844c15d820 con 0x7f844c15d1c0 2023-07-07T04:01:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.753+0000 7f8451220700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f844c06e170 con 0x7f844c15c430 2023-07-07T04:01:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.754+0000 7f844ad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f844c15c430 0x7f844c070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.754+0000 7f844a59c700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f844c06ef30 0x7f844c15cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49444/0 (socket says 172.21.15.6:49444) 2023-07-07T04:01:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.754+0000 7f844a59c700 1 -- 172.21.15.6:0/2442394471 learned_addr learned my addr 172.21.15.6:0/2442394471 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:01:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.754+0000 7f844ad9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f844c15c430 0x7f844c070e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48238/0 (socket says 172.21.15.6:48238) 2023-07-07T04:01:18.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.754+0000 7f844ad9d700 1 -- 172.21.15.6:0/2442394471 >> v1:172.21.15.40:6789/0 conn(0x7f844c15d1c0 legacy=0x7f844c0cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:18.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.754+0000 7f844ad9d700 1 -- 172.21.15.6:0/2442394471 >> v1:172.21.15.6:6789/0 conn(0x7f844c06ef30 legacy=0x7f844c15cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:18.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.754+0000 7f844ad9d700 1 -- 172.21.15.6:0/2442394471 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c06e450 con 0x7f844c15c430 2023-07-07T04:01:18.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.754+0000 7f844ad9d700 1 --2- 172.21.15.6:0/2442394471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f844c15c430 0x7f844c070e40 secure :-1 s=READY pgs=3361 cs=0 l=1 rev1=1 crypto rx=0x7f843c009840 tx=0x7f843c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8daf297f9836b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:18.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.754+0000 7f8449d9b700 1 -- 172.21.15.6:0/2442394471 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c011830 con 0x7f844c15c430 2023-07-07T04:01:18.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.754+0000 7f8449d9b700 1 -- 172.21.15.6:0/2442394471 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843c011990 con 0x7f844c15c430 2023-07-07T04:01:18.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.754+0000 7f8449d9b700 1 -- 172.21.15.6:0/2442394471 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c011d20 con 0x7f844c15c430 2023-07-07T04:01:18.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.755+0000 7f8451220700 1 -- 172.21.15.6:0/2442394471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f844c15c430 msgr2=0x7f844c070e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:18.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.755+0000 7f8451220700 1 --2- 172.21.15.6:0/2442394471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f844c15c430 0x7f844c070e40 secure :-1 s=READY pgs=3361 cs=0 l=1 rev1=1 crypto rx=0x7f843c009840 tx=0x7f843c009b50 comp rx=0 tx=0).stop 2023-07-07T04:01:18.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.755+0000 7f8451220700 1 -- 172.21.15.6:0/2442394471 shutdown_connections 2023-07-07T04:01:18.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.755+0000 7f8451220700 1 --2- 172.21.15.6:0/2442394471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f844c15c430 0x7f844c070e40 unknown :-1 s=CLOSED pgs=3361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:18.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.755+0000 7f8451220700 1 -- 172.21.15.6:0/2442394471 >> 172.21.15.6:0/2442394471 conn(0x7f844c0cf0f0 msgr2=0x7f844c0cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.755+0000 7f8451220700 1 -- 172.21.15.6:0/2442394471 shutdown_connections 2023-07-07T04:01:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.755+0000 7f8451220700 1 -- 172.21.15.6:0/2442394471 wait complete. 2023-07-07T04:01:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.757+0000 7f8451220700 1 Processor -- start 2023-07-07T04:01:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.757+0000 7f8451220700 1 -- start start 2023-07-07T04:01:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.757+0000 7f8451220700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f844c06ef30 0x7f844c15a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.757+0000 7f8451220700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f844c15c430 0x7f844c0b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.757+0000 7f8451220700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f844c15d1c0 0x7f844c0aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.757+0000 7f8451220700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c1f2d70 con 0x7f844c06ef30 2023-07-07T04:01:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.757+0000 7f8451220700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c1f1e30 con 0x7f844c15d1c0 2023-07-07T04:01:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.757+0000 7f8451220700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844c0b2480 con 0x7f844c15c430 2023-07-07T04:01:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.758+0000 7f844ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f844c06ef30 0x7f844c15a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.758+0000 7f844ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f844c06ef30 0x7f844c15a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48240/0 (socket says 172.21.15.6:48240) 2023-07-07T04:01:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.758+0000 7f844ad9d700 1 -- 172.21.15.6:0/1451939671 learned_addr learned my addr 172.21.15.6:0/1451939671 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.758+0000 7f844b59e700 1 --2- 172.21.15.6:0/1451939671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f844c15d1c0 0x7f844c0aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.758+0000 7f844a59c700 1 --2- 172.21.15.6:0/1451939671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f844c15c430 0x7f844c0b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.758+0000 7f844ad9d700 1 -- 172.21.15.6:0/1451939671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f844c15c430 msgr2=0x7f844c0b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.758+0000 7f844ad9d700 1 --2- 172.21.15.6:0/1451939671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f844c15c430 0x7f844c0b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:18.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.758+0000 7f844ad9d700 1 -- 172.21.15.6:0/1451939671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f844c15d1c0 msgr2=0x7f844c0aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:18.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.758+0000 7f844ad9d700 1 --2- 172.21.15.6:0/1451939671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f844c15d1c0 0x7f844c0aceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:18.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.758+0000 7f844ad9d700 1 -- 172.21.15.6:0/1451939671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c0094a0 con 0x7f844c06ef30 2023-07-07T04:01:18.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.758+0000 7f844ad9d700 1 --2- 172.21.15.6:0/1451939671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f844c06ef30 0x7f844c15a8b0 secure :-1 s=READY pgs=3362 cs=0 l=1 rev1=1 crypto rx=0x7f843c0090b0 tx=0x7f843c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.758+0000 7f84337fe700 1 -- 172.21.15.6:0/1451939671 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c0038a0 con 0x7f844c06ef30 2023-07-07T04:01:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.758+0000 7f84337fe700 1 -- 172.21.15.6:0/1451939671 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843c01f070 con 0x7f844c06ef30 2023-07-07T04:01:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.758+0000 7f8451220700 1 -- 172.21.15.6:0/1451939671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f844c1f20f0 con 0x7f844c06ef30 2023-07-07T04:01:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.758+0000 7f84337fe700 1 -- 172.21.15.6:0/1451939671 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c003c40 con 0x7f844c06ef30 2023-07-07T04:01:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.758+0000 7f8451220700 1 -- 172.21.15.6:0/1451939671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f844c1f26b0 con 0x7f844c06ef30 2023-07-07T04:01:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.759+0000 7f8451220700 1 -- 172.21.15.6:0/1451939671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f844c071cf0 con 0x7f844c06ef30 2023-07-07T04:01:18.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.760+0000 7f84337fe700 1 -- 172.21.15.6:0/1451939671 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f843c026480 con 0x7f844c06ef30 2023-07-07T04:01:18.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.760+0000 7f84337fe700 1 --2- 172.21.15.6:0/1451939671 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f843806ace0 0x7f843806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:18.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.760+0000 7f84337fe700 1 -- 172.21.15.6:0/1451939671 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f843c021070 con 0x7f844c06ef30 2023-07-07T04:01:18.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.760+0000 7f844a59c700 1 --2- 172.21.15.6:0/1451939671 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f843806ace0 0x7f843806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:18.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.761+0000 7f844a59c700 1 --2- 172.21.15.6:0/1451939671 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f843806ace0 0x7f843806d190 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f844c0b5040 tx=0x7f8440009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:18.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.765+0000 7f84337fe700 1 -- 172.21.15.6:0/1451939671 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f843c0560f0 con 0x7f844c06ef30 2023-07-07T04:01:18.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.975+0000 7f8451220700 1 -- 172.21.15.6:0/1451939671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f844c0cfd60 con 0x7f844c06ef30 2023-07-07T04:01:18.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.976+0000 7f84337fe700 1 -- 172.21.15.6:0/1451939671 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+14817 (secure 0 0 0) 0x7f843c059710 con 0x7f844c06ef30 2023-07-07T04:01:18.978 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:01:18.978 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":46,"fsid":"59b158c6-5d9d-4877-b4e7-a584e294fb2e","created":"2023-07-06T19:58:26.937189+0000","modified":"2023-07-07T04:01:12.898922+0000","last_up_change":"2023-07-06T19:58:38.651678+0000","last_in_change":"2023-07-06T19:58:29.664297+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-06T19:58:38.767727+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-06T19:58:45.759808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"67717d32-4b3a-4503-a994-31e663c1c7cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6809","nonce":43500803}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6811","nonce":43500803}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6815","nonce":43500803}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":43500803},{"type":"v1","addr":"172.21.15.6:6813","nonce":43500803}]},"public_addr":"172.21.15.6:6809/43500803","cluster_addr":"172.21.15.6:6811/43500803","heartbeat_back_addr":"172.21.15.6:6815/43500803","heartbeat_front_addr":"172.21.15.6:6813/43500803","state":["exists","up"]},{"osd":1,"uuid":"8044cb19-a7d5-4fd6-9a90-17d7522d13d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6801","nonce":3393411907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6803","nonce":3393411907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6807","nonce":3393411907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":3393411907},{"type":"v1","addr":"172.21.15.6:6805","nonce":3393411907}]},"public_addr":"172.21.15.6:6801/3393411907","cluster_addr":"172.21.15.6:6803/3393411907","heartbeat_back_addr":"172.21.15.6:6807/3393411907","heartbeat_front_addr":"172.21.15.6:6805/3393411907","state":["exists","up"]},{"osd":2,"uuid":"47578e23-99c3-42d1-b7a7-f04670ee7e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6817","nonce":2050035126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6819","nonce":2050035126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6823","nonce":2050035126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2050035126},{"type":"v1","addr":"172.21.15.6:6821","nonce":2050035126}]},"public_addr":"172.21.15.6:6817/2050035126","cluster_addr":"172.21.15.6:6819/2050035126","heartbeat_back_addr":"172.21.15.6:6823/2050035126","heartbeat_front_addr":"172.21.15.6:6821/2050035126","state":["exists","up"]},{"osd":3,"uuid":"029a1b80-b306-47fe-9a7d-39935854bf7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6825","nonce":49626386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6827","nonce":49626386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6831","nonce":49626386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":49626386},{"type":"v1","addr":"172.21.15.6:6829","nonce":49626386}]},"public_addr":"172.21.15.6:6825/49626386","cluster_addr":"172.21.15.6:6827/49626386","heartbeat_back_addr":"172.21.15.6:6831/49626386","heartbeat_front_addr":"172.21.15.6:6829/49626386","state":["exists","up"]},{"osd":4,"uuid":"07ca1701-14b7-4e9a-979f-81da9da5d661","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6801","nonce":2298149583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6803","nonce":2298149583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6807","nonce":2298149583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":2298149583},{"type":"v1","addr":"172.21.15.40:6805","nonce":2298149583}]},"public_addr":"172.21.15.40:6801/2298149583","cluster_addr":"172.21.15.40:6803/2298149583","heartbeat_back_addr":"172.21.15.40:6807/2298149583","heartbeat_front_addr":"172.21.15.40:6805/2298149583","state":["exists","up"]},{"osd":5,"uuid":"93eea16b-8153-4f84-9b3c-b4f6c7a592e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6809","nonce":23442053}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6811","nonce":23442053}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6815","nonce":23442053}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":23442053},{"type":"v1","addr":"172.21.15.40:6813","nonce":23442053}]},"public_addr":"172.21.15.40:6809/23442053","cluster_addr":"172.21.15.40:6811/23442053","heartbeat_back_addr":"172.21.15.40:6815/23442053","heartbeat_front_addr":"172.21.15.40:6813/23442053","state":["exists","up"]},{"osd":6,"uuid":"a299a0dc-d67d-4d1e-9e3b-fa3cfb242573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6817","nonce":4092969902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6818","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6819","nonce":4092969902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6822","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6823","nonce":4092969902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":4092969902},{"type":"v1","addr":"172.21.15.40:6821","nonce":4092969902}]},"public_addr":"172.21.15.40:6817/4092969902","cluster_addr":"172.21.15.40:6819/4092969902","heartbeat_back_addr":"172.21.15.40:6823/4092969902","heartbeat_front_addr":"172.21.15.40:6821/4092969902","state":["exists","up"]},{"osd":7,"uuid":"29025007-fca2-41ed-91f2-2f6dfe833897","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6825","nonce":4054264969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6826","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6827","nonce":4054264969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6830","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6831","nonce":4054264969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":4054264969},{"type":"v1","addr":"172.21.15.40:6829","nonce":4054264969}]},"public_addr":"172.21.15.40:6825/4054264969","cluster_addr":"172.21.15.40:6827/4054264969","heartbeat_back_addr":"172.21.15.40:6831/4054264969","heartbeat_front_addr":"172.21.15.40:6829/4054264969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.862654+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.851766+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.820967+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.900462+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.895910+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.897680+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.826188+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-06T19:58:34.864599+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.40:6835/2106779005":"2023-07-08T04:01:09.865166+0000","172.21.15.40:6833/2106779005":"2023-07-08T04:01:09.865166+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-07T04:01:18.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.978+0000 7f8451220700 1 -- 172.21.15.6:0/1451939671 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f843806ace0 msgr2=0x7f843806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:18.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.978+0000 7f8451220700 1 --2- 172.21.15.6:0/1451939671 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f843806ace0 0x7f843806d190 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f844c0b5040 tx=0x7f8440009040 comp rx=0 tx=0).stop 2023-07-07T04:01:18.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.979+0000 7f8451220700 1 -- 172.21.15.6:0/1451939671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f844c06ef30 msgr2=0x7f844c15a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:18.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.979+0000 7f8451220700 1 --2- 172.21.15.6:0/1451939671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f844c06ef30 0x7f844c15a8b0 secure :-1 s=READY pgs=3362 cs=0 l=1 rev1=1 crypto rx=0x7f843c0090b0 tx=0x7f843c004750 comp rx=0 tx=0).stop 2023-07-07T04:01:18.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.979+0000 7f8451220700 1 -- 172.21.15.6:0/1451939671 shutdown_connections 2023-07-07T04:01:18.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.979+0000 7f8451220700 1 --2- 172.21.15.6:0/1451939671 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f843806ace0 0x7f843806d190 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:18.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.979+0000 7f8451220700 1 --2- 172.21.15.6:0/1451939671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f844c06ef30 0x7f844c15a8b0 unknown :-1 s=CLOSED pgs=3362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:18.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.979+0000 7f8451220700 1 --2- 172.21.15.6:0/1451939671 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f844c15d1c0 0x7f844c0aceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:18.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.979+0000 7f8451220700 1 --2- 172.21.15.6:0/1451939671 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f844c15c430 0x7f844c0b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:18.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.979+0000 7f8451220700 1 -- 172.21.15.6:0/1451939671 >> 172.21.15.6:0/1451939671 conn(0x7f844c0cf0f0 msgr2=0x7f844c0ccc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:18.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.979+0000 7f8451220700 1 -- 172.21.15.6:0/1451939671 shutdown_connections 2023-07-07T04:01:18.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:18.979+0000 7f8451220700 1 -- 172.21.15.6:0/1451939671 wait complete. 2023-07-07T04:01:19.995 INFO:tasks.ceph:Scrubbing osd.0 2023-07-07T04:01:19.996 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-07-07T04:01:20.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.144+0000 7f753a49e700 1 Processor -- start 2023-07-07T04:01:20.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.144+0000 7f753a49e700 1 -- start start 2023-07-07T04:01:20.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.145+0000 7f753a49e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f75340cd690 0x7f75340d1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.145+0000 7f753a49e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f753406aa30 con 0x7f753415c670 2023-07-07T04:01:20.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.145+0000 7f753a49e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f753415ca40 con 0x7f75340cd240 2023-07-07T04:01:20.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.145+0000 7f753a49e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f753406c950 con 0x7f75340cd690 2023-07-07T04:01:20.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.145+0000 7f7533fff700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f753415c670 0x7f753406bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49456/0 (socket says 172.21.15.6:49456) 2023-07-07T04:01:20.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.145+0000 7f7533fff700 1 -- 172.21.15.6:0/3113455087 learned_addr learned my addr 172.21.15.6:0/3113455087 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:01:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.145+0000 7f7538a3b700 1 --2- 172.21.15.6:0/3113455087 >> v2:172.21.15.40:3300/0 conn(0x7f75340cd690 0x7f75340d1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.145+0000 7f7532ffd700 1 -- 172.21.15.6:0/3113455087 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513534605 0 0) 0x7f753406aa30 con 0x7f753415c670 2023-07-07T04:01:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.145+0000 7f7532ffd700 1 -- 172.21.15.6:0/3113455087 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75200035b0 con 0x7f753415c670 2023-07-07T04:01:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.146+0000 7f7532ffd700 1 -- 172.21.15.6:0/3113455087 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 8548098 0 0) 0x7f75200035b0 con 0x7f753415c670 2023-07-07T04:01:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.146+0000 7f7532ffd700 1 -- 172.21.15.6:0/3113455087 >> v2:172.21.15.40:3300/0 conn(0x7f75340cd690 msgr2=0x7f75340d1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.146+0000 7f7532ffd700 1 --2- 172.21.15.6:0/3113455087 >> v2:172.21.15.40:3300/0 conn(0x7f75340cd690 0x7f75340d1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.146+0000 7f7532ffd700 1 -- 172.21.15.6:0/3113455087 >> v1:172.21.15.40:6789/0 conn(0x7f75340cd240 legacy=0x7f75340d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.146+0000 7f7532ffd700 1 -- 172.21.15.6:0/3113455087 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753406a100 con 0x7f753415c670 2023-07-07T04:01:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.146+0000 7f7532ffd700 1 -- 172.21.15.6:0/3113455087 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f751c001670 con 0x7f753415c670 2023-07-07T04:01:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.146+0000 7f7532ffd700 1 -- 172.21.15.6:0/3113455087 >> v1:172.21.15.6:6789/0 conn(0x7f753415c670 legacy=0x7f753406bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.146+0000 7f7532ffd700 1 --2- 172.21.15.6:0/3113455087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7520003a00 0x7f7520003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.146+0000 7f7532ffd700 1 --2- 172.21.15.6:0/3113455087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7520004850 0x7f7520004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.146+0000 7f7532ffd700 1 --2- 172.21.15.6:0/3113455087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7520005200 0x7f752000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.146+0000 7f7532ffd700 1 -- 172.21.15.6:0/3113455087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753406c950 con 0x7f7520004850 2023-07-07T04:01:20.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.146+0000 7f7532ffd700 1 -- 172.21.15.6:0/3113455087 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752000c080 con 0x7f7520005200 2023-07-07T04:01:20.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.146+0000 7f7532ffd700 1 -- 172.21.15.6:0/3113455087 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752000c240 con 0x7f7520003a00 2023-07-07T04:01:20.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.146+0000 7f75337fe700 1 --2- 172.21.15.6:0/3113455087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7520004850 0x7f7520004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.146+0000 7f7533fff700 1 --2- 172.21.15.6:0/3113455087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7520003a00 0x7f7520003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.146+0000 7f7538a3b700 1 --2- 172.21.15.6:0/3113455087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7520005200 0x7f752000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.146+0000 7f75337fe700 1 -- 172.21.15.6:0/3113455087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7520003a00 msgr2=0x7f7520003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:20.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.146+0000 7f75337fe700 1 --2- 172.21.15.6:0/3113455087 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7520003a00 0x7f7520003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.146+0000 7f75337fe700 1 -- 172.21.15.6:0/3113455087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7520005200 msgr2=0x7f752000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:20.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.146+0000 7f75337fe700 1 --2- 172.21.15.6:0/3113455087 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7520005200 0x7f752000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.146+0000 7f7538a3b700 1 -- 172.21.15.6:0/3113455087 reap_dead start 2023-07-07T04:01:20.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.146+0000 7f75337fe700 1 -- 172.21.15.6:0/3113455087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75200035b0 con 0x7f7520004850 2023-07-07T04:01:20.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.146+0000 7f75337fe700 1 --2- 172.21.15.6:0/3113455087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7520004850 0x7f7520004cc0 secure :-1 s=READY pgs=3364 cs=0 l=1 rev1=1 crypto rx=0x7f75240017c0 tx=0x7f7520005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ddfb7ba1db27c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:20.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.147+0000 7f7532ffd700 1 -- 172.21.15.6:0/3113455087 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75240052d0 con 0x7f7520004850 2023-07-07T04:01:20.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.147+0000 7f7532ffd700 1 -- 172.21.15.6:0/3113455087 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7524005450 con 0x7f7520004850 2023-07-07T04:01:20.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.147+0000 7f7532ffd700 1 -- 172.21.15.6:0/3113455087 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75240038c0 con 0x7f7520004850 2023-07-07T04:01:20.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.147+0000 7f753a49e700 1 -- 172.21.15.6:0/3113455087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7520004850 msgr2=0x7f7520004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.147+0000 7f753a49e700 1 --2- 172.21.15.6:0/3113455087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7520004850 0x7f7520004cc0 secure :-1 s=READY pgs=3364 cs=0 l=1 rev1=1 crypto rx=0x7f75240017c0 tx=0x7f7520005880 comp rx=0 tx=0).stop 2023-07-07T04:01:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.147+0000 7f753a49e700 1 -- 172.21.15.6:0/3113455087 shutdown_connections 2023-07-07T04:01:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.147+0000 7f753a49e700 1 --2- 172.21.15.6:0/3113455087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7520004850 0x7f7520004cc0 unknown :-1 s=CLOSED pgs=3364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.147+0000 7f753a49e700 1 -- 172.21.15.6:0/3113455087 >> 172.21.15.6:0/3113455087 conn(0x7f75340d2bf0 msgr2=0x7f75340d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.147+0000 7f753a49e700 1 -- 172.21.15.6:0/3113455087 shutdown_connections 2023-07-07T04:01:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.147+0000 7f753a49e700 1 -- 172.21.15.6:0/3113455087 wait complete. 2023-07-07T04:01:20.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.148+0000 7f753a49e700 1 Processor -- start 2023-07-07T04:01:20.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.149+0000 7f753a49e700 1 -- start start 2023-07-07T04:01:20.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.149+0000 7f753a49e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7520004850 0x7f7534158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.149+0000 7f753a49e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f753415f370 0x7f75341f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.149+0000 7f753a49e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f753415ac20 0x7f753415b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.149+0000 7f753a49e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753415a350 con 0x7f753415ac20 2023-07-07T04:01:20.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.149+0000 7f753a49e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753415b5b0 con 0x7f753415f370 2023-07-07T04:01:20.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.149+0000 7f753a49e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75341596d0 con 0x7f7520004850 2023-07-07T04:01:20.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.150+0000 7f7538a3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f753415ac20 0x7f753415b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.150+0000 7f7538a3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f753415ac20 0x7f753415b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48264/0 (socket says 172.21.15.6:48264) 2023-07-07T04:01:20.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.150+0000 7f7538a3b700 1 -- 172.21.15.6:0/1805478975 learned_addr learned my addr 172.21.15.6:0/1805478975 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:20.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.150+0000 7f7533fff700 1 --2- 172.21.15.6:0/1805478975 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7520004850 0x7f7534158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.150+0000 7f75337fe700 1 --2- 172.21.15.6:0/1805478975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f753415f370 0x7f75341f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.150+0000 7f7538a3b700 1 -- 172.21.15.6:0/1805478975 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7520004850 msgr2=0x7f7534158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:20.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.150+0000 7f7538a3b700 1 --2- 172.21.15.6:0/1805478975 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f7520004850 0x7f7534158e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.150+0000 7f7538a3b700 1 -- 172.21.15.6:0/1805478975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f753415f370 msgr2=0x7f75341f5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:20.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.150+0000 7f7538a3b700 1 --2- 172.21.15.6:0/1805478975 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f753415f370 0x7f75341f5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.150+0000 7f7538a3b700 1 -- 172.21.15.6:0/1805478975 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75341599b0 con 0x7f753415ac20 2023-07-07T04:01:20.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.150+0000 7f7538a3b700 1 --2- 172.21.15.6:0/1805478975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f753415ac20 0x7f753415b070 secure :-1 s=READY pgs=3365 cs=0 l=1 rev1=1 crypto rx=0x7f75340cddf0 tx=0x7f752c011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:20.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.150+0000 7f7530ff9700 1 -- 172.21.15.6:0/1805478975 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c00e040 con 0x7f753415ac20 2023-07-07T04:01:20.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.150+0000 7f7530ff9700 1 -- 172.21.15.6:0/1805478975 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f752c00f040 con 0x7f753415ac20 2023-07-07T04:01:20.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.150+0000 7f753a49e700 1 -- 172.21.15.6:0/1805478975 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7534159c90 con 0x7f753415ac20 2023-07-07T04:01:20.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.150+0000 7f7530ff9700 1 -- 172.21.15.6:0/1805478975 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f752c00fbe0 con 0x7f753415ac20 2023-07-07T04:01:20.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.150+0000 7f753a49e700 1 -- 172.21.15.6:0/1805478975 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75341593b0 con 0x7f753415ac20 2023-07-07T04:01:20.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.151+0000 7f753a49e700 1 -- 172.21.15.6:0/1805478975 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f753406a6c0 con 0x7f753415ac20 2023-07-07T04:01:20.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.152+0000 7f7530ff9700 1 -- 172.21.15.6:0/1805478975 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f752c00fd40 con 0x7f753415ac20 2023-07-07T04:01:20.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.152+0000 7f7530ff9700 1 --2- 172.21.15.6:0/1805478975 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f751406ace0 0x7f751406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.152+0000 7f7530ff9700 1 -- 172.21.15.6:0/1805478975 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f752c0897d0 con 0x7f753415ac20 2023-07-07T04:01:20.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.152+0000 7f7533fff700 1 --2- 172.21.15.6:0/1805478975 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f751406ace0 0x7f751406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.153+0000 7f7530ff9700 1 --2- 172.21.15.6:0/1805478975 >> [v2:172.21.15.6:6808/43500803,v1:172.21.15.6:6809/43500803] conn(0x7f7514071580 0x7f75140739d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.153+0000 7f7530ff9700 1 -- 172.21.15.6:0/1805478975 --> [v2:172.21.15.6:6808/43500803,v1:172.21.15.6:6809/43500803] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f75140740a0 con 0x7f7514071580 2023-07-07T04:01:20.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.153+0000 7f7530ff9700 1 -- 172.21.15.6:0/1805478975 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f752c08e2a0 con 0x7f753415ac20 2023-07-07T04:01:20.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.153+0000 7f75337fe700 1 --2- 172.21.15.6:0/1805478975 >> [v2:172.21.15.6:6808/43500803,v1:172.21.15.6:6809/43500803] conn(0x7f7514071580 0x7f75140739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.153+0000 7f7533fff700 1 --2- 172.21.15.6:0/1805478975 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f751406ace0 0x7f751406d190 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f751c000f60 tx=0x7f751c000ef0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:20.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.153+0000 7f75337fe700 1 --2- 172.21.15.6:0/1805478975 >> [v2:172.21.15.6:6808/43500803,v1:172.21.15.6:6809/43500803] conn(0x7f7514071580 0x7f75140739d0 crc :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:20.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.154+0000 7f7530ff9700 1 -- 172.21.15.6:0/1805478975 <== osd.0 v2:172.21.15.6:6808/43500803 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f75140740a0 con 0x7f7514071580 2023-07-07T04:01:20.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.169+0000 7f753a49e700 1 -- 172.21.15.6:0/1805478975 --> [v2:172.21.15.6:6808/43500803,v1:172.21.15.6:6809/43500803] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f753406a3e0 con 0x7f7514071580 2023-07-07T04:01:20.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.169+0000 7f7530ff9700 1 -- 172.21.15.6:0/1805478975 <== osd.0 v2:172.21.15.6:6808/43500803 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f7524005250 con 0x7f7514071580 2023-07-07T04:01:20.171 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-07T04:01:20.171 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-07T04:01:20.171 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-07T04:01:20.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.170+0000 7f753a49e700 1 -- 172.21.15.6:0/1805478975 >> [v2:172.21.15.6:6808/43500803,v1:172.21.15.6:6809/43500803] conn(0x7f7514071580 msgr2=0x7f75140739d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:20.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.170+0000 7f753a49e700 1 --2- 172.21.15.6:0/1805478975 >> [v2:172.21.15.6:6808/43500803,v1:172.21.15.6:6809/43500803] conn(0x7f7514071580 0x7f75140739d0 crc :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.170+0000 7f753a49e700 1 -- 172.21.15.6:0/1805478975 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f751406ace0 msgr2=0x7f751406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:20.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.170+0000 7f753a49e700 1 --2- 172.21.15.6:0/1805478975 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f751406ace0 0x7f751406d190 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f751c000f60 tx=0x7f751c000ef0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.170+0000 7f753a49e700 1 -- 172.21.15.6:0/1805478975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f753415ac20 msgr2=0x7f753415b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:20.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.170+0000 7f753a49e700 1 --2- 172.21.15.6:0/1805478975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f753415ac20 0x7f753415b070 secure :-1 s=READY pgs=3365 cs=0 l=1 rev1=1 crypto rx=0x7f75340cddf0 tx=0x7f752c011ed0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.170+0000 7f7538a3b700 1 -- 172.21.15.6:0/1805478975 reap_dead start 2023-07-07T04:01:20.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.170+0000 7f753a49e700 1 -- 172.21.15.6:0/1805478975 shutdown_connections 2023-07-07T04:01:20.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.170+0000 7f753a49e700 1 -- 172.21.15.6:0/1805478975 >> 172.21.15.6:0/1805478975 conn(0x7f75340d2bf0 msgr2=0x7f7534157b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:20.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.170+0000 7f753a49e700 1 -- 172.21.15.6:0/1805478975 shutdown_connections 2023-07-07T04:01:20.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.170+0000 7f753a49e700 1 -- 172.21.15.6:0/1805478975 wait complete. 2023-07-07T04:01:20.184 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-07-07T04:01:20.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.321+0000 7fccf2ac0700 1 Processor -- start 2023-07-07T04:01:20.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.321+0000 7fccf2ac0700 1 -- start start 2023-07-07T04:01:20.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.322+0000 7fccf2ac0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fccec0b1f10 0x7fccec0cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.322+0000 7fccf2ac0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccec06c4c0 0x7fccec0d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.322+0000 7fccf2ac0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccec15d480 con 0x7fccec160e00 2023-07-07T04:01:20.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.322+0000 7fccf2ac0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccec15cc60 con 0x7fccec0b1f10 2023-07-07T04:01:20.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.322+0000 7fccf2ac0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccec15ce70 con 0x7fccec06c4c0 2023-07-07T04:01:20.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.323+0000 7fccf105d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccec06c4c0 0x7fccec0d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.323+0000 7fccf085c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fccec0b1f10 0x7fccec0cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.323+0000 7fccebfff700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fccec160e00 0x7fccec06bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:39350/0 (socket says 172.21.15.6:39350) 2023-07-07T04:01:20.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.323+0000 7fccebfff700 1 -- 172.21.15.6:0/3524835494 learned_addr learned my addr 172.21.15.6:0/3524835494 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:01:20.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.323+0000 7fccf085c700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fccec0b1f10 0x7fccec0cd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:55538/0 (socket says 172.21.15.6:55538) 2023-07-07T04:01:20.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.323+0000 7fccf105d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccec06c4c0 0x7fccec0d0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:40918/0 (socket says 172.21.15.6:40918) 2023-07-07T04:01:20.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.323+0000 7fccf085c700 1 -- 172.21.15.6:0/3524835494 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccec06c4c0 msgr2=0x7fccec0d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:20.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.323+0000 7fccf085c700 1 --2- 172.21.15.6:0/3524835494 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccec06c4c0 0x7fccec0d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.323+0000 7fccf085c700 1 -- 172.21.15.6:0/3524835494 >> v1:172.21.15.40:6789/0 conn(0x7fccec160e00 legacy=0x7fccec06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:20.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.323+0000 7fccf085c700 1 -- 172.21.15.6:0/3524835494 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccec0cddd0 con 0x7fccec0b1f10 2023-07-07T04:01:20.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.323+0000 7fcceb7fe700 1 -- 172.21.15.6:0/3524835494 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449545343 0 0) 0x7fccec15d480 con 0x7fccec160e00 2023-07-07T04:01:20.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.323+0000 7fccf085c700 1 --2- 172.21.15.6:0/3524835494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccec0b1f10 0x7fccec0cd2c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009840 tx=0x7fccdc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13d30a02b92312c server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:20.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.323+0000 7fcceb7fe700 1 -- 172.21.15.6:0/3524835494 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc011830 con 0x7fccec0b1f10 2023-07-07T04:01:20.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.323+0000 7fcceb7fe700 1 -- 172.21.15.6:0/3524835494 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccdc011990 con 0x7fccec0b1f10 2023-07-07T04:01:20.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.323+0000 7fcceb7fe700 1 -- 172.21.15.6:0/3524835494 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccdc011d20 con 0x7fccec0b1f10 2023-07-07T04:01:20.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.324+0000 7fccf2ac0700 1 -- 172.21.15.6:0/3524835494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccec0b1f10 msgr2=0x7fccec0cd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:20.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.324+0000 7fccf2ac0700 1 --2- 172.21.15.6:0/3524835494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccec0b1f10 0x7fccec0cd2c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009840 tx=0x7fccdc009b50 comp rx=0 tx=0).stop 2023-07-07T04:01:20.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.324+0000 7fccf2ac0700 1 -- 172.21.15.6:0/3524835494 shutdown_connections 2023-07-07T04:01:20.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.324+0000 7fccf2ac0700 1 --2- 172.21.15.6:0/3524835494 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccec06c4c0 0x7fccec0d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.324+0000 7fccf2ac0700 1 --2- 172.21.15.6:0/3524835494 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccec0b1f10 0x7fccec0cd2c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.324+0000 7fccf2ac0700 1 -- 172.21.15.6:0/3524835494 >> 172.21.15.6:0/3524835494 conn(0x7fccec0d2c70 msgr2=0x7fccec0d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:20.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.324+0000 7fccf2ac0700 1 -- 172.21.15.6:0/3524835494 shutdown_connections 2023-07-07T04:01:20.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.324+0000 7fccf2ac0700 1 -- 172.21.15.6:0/3524835494 wait complete. 2023-07-07T04:01:20.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.325+0000 7fccf2ac0700 1 Processor -- start 2023-07-07T04:01:20.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.325+0000 7fccf2ac0700 1 -- start start 2023-07-07T04:01:20.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.326+0000 7fccf2ac0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccec06c4c0 0x7fccec15a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.326+0000 7fccf2ac0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccec0b1f10 0x7fccec0b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.326+0000 7fccf2ac0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccec160e00 0x7fccec0b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.326+0000 7fccf2ac0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec15a7a0 con 0x7fccec160e00 2023-07-07T04:01:20.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.326+0000 7fccf2ac0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccec0b75e0 con 0x7fccec0b1f10 2023-07-07T04:01:20.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.326+0000 7fccf2ac0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccec0b6d20 con 0x7fccec06c4c0 2023-07-07T04:01:20.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.326+0000 7fccf105d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccec160e00 0x7fccec0b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.327+0000 7fccf105d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccec160e00 0x7fccec0b3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48280/0 (socket says 172.21.15.6:48280) 2023-07-07T04:01:20.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.327+0000 7fccf105d700 1 -- 172.21.15.6:0/83051694 learned_addr learned my addr 172.21.15.6:0/83051694 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:20.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.327+0000 7fccf085c700 1 --2- 172.21.15.6:0/83051694 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccec06c4c0 0x7fccec15a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.327+0000 7fccebfff700 1 --2- 172.21.15.6:0/83051694 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccec0b1f10 0x7fccec0b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.327+0000 7fccf105d700 1 -- 172.21.15.6:0/83051694 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccec06c4c0 msgr2=0x7fccec15a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:20.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.327+0000 7fccf105d700 1 --2- 172.21.15.6:0/83051694 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccec06c4c0 0x7fccec15a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.327+0000 7fccf105d700 1 -- 172.21.15.6:0/83051694 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccec0b1f10 msgr2=0x7fccec0b64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:20.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.327+0000 7fccf105d700 1 --2- 172.21.15.6:0/83051694 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccec0b1f10 0x7fccec0b64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.327+0000 7fccf105d700 1 -- 172.21.15.6:0/83051694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc0094a0 con 0x7fccec160e00 2023-07-07T04:01:20.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.327+0000 7fccf105d700 1 --2- 172.21.15.6:0/83051694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccec160e00 0x7fccec0b3a10 secure :-1 s=READY pgs=3366 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009e30 tx=0x7fcce400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:20.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.328+0000 7fcce97fa700 1 -- 172.21.15.6:0/83051694 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce4009ca0 con 0x7fccec160e00 2023-07-07T04:01:20.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.328+0000 7fccf2ac0700 1 -- 172.21.15.6:0/83051694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccec0b6f90 con 0x7fccec160e00 2023-07-07T04:01:20.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.328+0000 7fcce97fa700 1 -- 172.21.15.6:0/83051694 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce400f040 con 0x7fccec160e00 2023-07-07T04:01:20.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.328+0000 7fcce97fa700 1 -- 172.21.15.6:0/83051694 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce4014480 con 0x7fccec160e00 2023-07-07T04:01:20.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.328+0000 7fccf2ac0700 1 -- 172.21.15.6:0/83051694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccec0b69f0 con 0x7fccec160e00 2023-07-07T04:01:20.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.329+0000 7fccf2ac0700 1 -- 172.21.15.6:0/83051694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccec0b7790 con 0x7fccec160e00 2023-07-07T04:01:20.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.329+0000 7fcce97fa700 1 -- 172.21.15.6:0/83051694 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcce40145e0 con 0x7fccec160e00 2023-07-07T04:01:20.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.330+0000 7fcce97fa700 1 --2- 172.21.15.6:0/83051694 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fccd806ace0 0x7fccd806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.330+0000 7fcce97fa700 1 -- 172.21.15.6:0/83051694 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fcce4089df0 con 0x7fccec160e00 2023-07-07T04:01:20.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.330+0000 7fccf085c700 1 --2- 172.21.15.6:0/83051694 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fccd806ace0 0x7fccd806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.331+0000 7fccf085c700 1 --2- 172.21.15.6:0/83051694 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fccd806ace0 0x7fccd806d190 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0090b0 tx=0x7fccdc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:20.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.336+0000 7fcce97fa700 1 -- 172.21.15.6:0/83051694 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fccec0b7790 con 0x7fccec160e00 2023-07-07T04:01:20.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.542+0000 7fccf2ac0700 1 -- 172.21.15.6:0/83051694 --> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fccec15d110 con 0x7fccd806ace0 2023-07-07T04:01:20.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.542+0000 7fcce97fa700 1 -- 172.21.15.6:0/83051694 <== mgr.4110 v2:172.21.15.6:6832/201543369 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fccdc011c00 con 0x7fccd806ace0 2023-07-07T04:01:20.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.544+0000 7fccf2ac0700 1 -- 172.21.15.6:0/83051694 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fccd806ace0 msgr2=0x7fccd806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:20.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.544+0000 7fccf2ac0700 1 --2- 172.21.15.6:0/83051694 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fccd806ace0 0x7fccd806d190 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fccdc0090b0 tx=0x7fccdc008030 comp rx=0 tx=0).stop 2023-07-07T04:01:20.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.544+0000 7fccf2ac0700 1 -- 172.21.15.6:0/83051694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccec160e00 msgr2=0x7fccec0b3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:20.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.544+0000 7fccf2ac0700 1 --2- 172.21.15.6:0/83051694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccec160e00 0x7fccec0b3a10 secure :-1 s=READY pgs=3366 cs=0 l=1 rev1=1 crypto rx=0x7fcce4009e30 tx=0x7fcce400c3a0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.544+0000 7fccf2ac0700 1 -- 172.21.15.6:0/83051694 shutdown_connections 2023-07-07T04:01:20.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.544+0000 7fccf2ac0700 1 --2- 172.21.15.6:0/83051694 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fccd806ace0 0x7fccd806d190 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.544+0000 7fccf2ac0700 1 --2- 172.21.15.6:0/83051694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccec160e00 0x7fccec0b3a10 unknown :-1 s=CLOSED pgs=3366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.544+0000 7fccf2ac0700 1 --2- 172.21.15.6:0/83051694 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fccec06c4c0 0x7fccec15a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.544+0000 7fccf2ac0700 1 --2- 172.21.15.6:0/83051694 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fccec0b1f10 0x7fccec0b64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.544+0000 7fccf2ac0700 1 -- 172.21.15.6:0/83051694 >> 172.21.15.6:0/83051694 conn(0x7fccec0d2c70 msgr2=0x7fccec0b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:20.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.545+0000 7fccf2ac0700 1 -- 172.21.15.6:0/83051694 shutdown_connections 2023-07-07T04:01:20.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.545+0000 7fccf2ac0700 1 -- 172.21.15.6:0/83051694 wait complete. 2023-07-07T04:01:20.548 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 0 to deep-scrub 2023-07-07T04:01:20.559 INFO:tasks.ceph:Scrubbing osd.1 2023-07-07T04:01:20.560 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-07-07T04:01:20.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.699+0000 7f1827157700 1 Processor -- start 2023-07-07T04:01:20.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.699+0000 7f1827157700 1 -- start start 2023-07-07T04:01:20.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.699+0000 7f1827157700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1820071da0 0x7f18200aee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.699+0000 7f1827157700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f182006ad40 0x7f182015ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.700+0000 7f1827157700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1820160660 con 0x7f182015c2c0 2023-07-07T04:01:20.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.700+0000 7f1827157700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1820160940 con 0x7f182006ad40 2023-07-07T04:01:20.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.700+0000 7f1827157700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1820160c20 con 0x7f1820071da0 2023-07-07T04:01:20.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.700+0000 7f18256f4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f182006ad40 0x7f182015ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.700+0000 7f18256f4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f182006ad40 0x7f182015ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48288/0 (socket says 172.21.15.6:48288) 2023-07-07T04:01:20.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.700+0000 7f18256f4700 1 -- 172.21.15.6:0/3713151235 learned_addr learned my addr 172.21.15.6:0/3713151235 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:20.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.700+0000 7f181ffff700 1 --2- 172.21.15.6:0/3713151235 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1820071da0 0x7f18200aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.700+0000 7f18256f4700 1 -- 172.21.15.6:0/3713151235 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1820071da0 msgr2=0x7f18200aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:20.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.700+0000 7f18256f4700 1 --2- 172.21.15.6:0/3713151235 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1820071da0 0x7f18200aee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.700+0000 7f18256f4700 1 -- 172.21.15.6:0/3713151235 >> v1:172.21.15.40:6789/0 conn(0x7f182015c2c0 legacy=0x7f1820071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:20.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.700+0000 7f18256f4700 1 -- 172.21.15.6:0/3713151235 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18200cdca0 con 0x7f182006ad40 2023-07-07T04:01:20.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.700+0000 7f18256f4700 1 --2- 172.21.15.6:0/3713151235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f182006ad40 0x7f182015ff80 secure :-1 s=READY pgs=3367 cs=0 l=1 rev1=1 crypto rx=0x7f1818009e50 tx=0x7f181800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3a6082d4460d25 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:20.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.700+0000 7f181f7fe700 1 -- 172.21.15.6:0/3713151235 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181800e070 con 0x7f182006ad40 2023-07-07T04:01:20.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.700+0000 7f181f7fe700 1 -- 172.21.15.6:0/3713151235 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1818003a20 con 0x7f182006ad40 2023-07-07T04:01:20.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.700+0000 7f181f7fe700 1 -- 172.21.15.6:0/3713151235 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1818003dd0 con 0x7f182006ad40 2023-07-07T04:01:20.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.701+0000 7f1827157700 1 -- 172.21.15.6:0/3713151235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f182006ad40 msgr2=0x7f182015ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:20.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.701+0000 7f1827157700 1 --2- 172.21.15.6:0/3713151235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f182006ad40 0x7f182015ff80 secure :-1 s=READY pgs=3367 cs=0 l=1 rev1=1 crypto rx=0x7f1818009e50 tx=0x7f181800b330 comp rx=0 tx=0).stop 2023-07-07T04:01:20.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.701+0000 7f1827157700 1 -- 172.21.15.6:0/3713151235 shutdown_connections 2023-07-07T04:01:20.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.701+0000 7f1827157700 1 --2- 172.21.15.6:0/3713151235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f182006ad40 0x7f182015ff80 unknown :-1 s=CLOSED pgs=3367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.701+0000 7f1827157700 1 --2- 172.21.15.6:0/3713151235 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1820071da0 0x7f18200aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.701+0000 7f1827157700 1 -- 172.21.15.6:0/3713151235 >> 172.21.15.6:0/3713151235 conn(0x7f18200cf940 msgr2=0x7f18200cfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:20.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.701+0000 7f1827157700 1 -- 172.21.15.6:0/3713151235 shutdown_connections 2023-07-07T04:01:20.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.701+0000 7f1827157700 1 -- 172.21.15.6:0/3713151235 wait complete. 2023-07-07T04:01:20.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.702+0000 7f1827157700 1 Processor -- start 2023-07-07T04:01:20.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.702+0000 7f1827157700 1 -- start start 2023-07-07T04:01:20.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.703+0000 7f1827157700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f182006ad40 0x7f18200c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.703+0000 7f1827157700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1820071da0 0x7f182015e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.703+0000 7f1827157700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f182015c2c0 0x7f18201f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.703+0000 7f1827157700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18200aeec0 con 0x7f182006ad40 2023-07-07T04:01:20.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.703+0000 7f1827157700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18200c7bc0 con 0x7f182015c2c0 2023-07-07T04:01:20.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.703+0000 7f1827157700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18200c7ea0 con 0x7f1820071da0 2023-07-07T04:01:20.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.703+0000 7f1824ef3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f182006ad40 0x7f18200c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.703+0000 7f1824ef3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f182006ad40 0x7f18200c91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48290/0 (socket says 172.21.15.6:48290) 2023-07-07T04:01:20.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.703+0000 7f1824ef3700 1 -- 172.21.15.6:0/930859862 learned_addr learned my addr 172.21.15.6:0/930859862 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:20.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.704+0000 7f18256f4700 1 --2- 172.21.15.6:0/930859862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f182015c2c0 0x7f18201f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.704+0000 7f181ffff700 1 --2- 172.21.15.6:0/930859862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1820071da0 0x7f182015e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.704+0000 7f1824ef3700 1 -- 172.21.15.6:0/930859862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1820071da0 msgr2=0x7f182015e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:20.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.704+0000 7f1824ef3700 1 --2- 172.21.15.6:0/930859862 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1820071da0 0x7f182015e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.704+0000 7f1824ef3700 1 -- 172.21.15.6:0/930859862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f182015c2c0 msgr2=0x7f18201f5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:20.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.704+0000 7f1824ef3700 1 --2- 172.21.15.6:0/930859862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f182015c2c0 0x7f18201f5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.704+0000 7f1824ef3700 1 -- 172.21.15.6:0/930859862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1818009b30 con 0x7f182006ad40 2023-07-07T04:01:20.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.704+0000 7f1824ef3700 1 --2- 172.21.15.6:0/930859862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f182006ad40 0x7f18200c91c0 secure :-1 s=READY pgs=3368 cs=0 l=1 rev1=1 crypto rx=0x7f180800b4a0 tx=0x7f180800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:20.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.704+0000 7f181d7fa700 1 -- 172.21.15.6:0/930859862 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1808011830 con 0x7f182006ad40 2023-07-07T04:01:20.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.704+0000 7f181d7fa700 1 -- 172.21.15.6:0/930859862 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1808011990 con 0x7f182006ad40 2023-07-07T04:01:20.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.704+0000 7f1827157700 1 -- 172.21.15.6:0/930859862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18200c8180 con 0x7f182006ad40 2023-07-07T04:01:20.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.704+0000 7f181d7fa700 1 -- 172.21.15.6:0/930859862 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1808011d40 con 0x7f182006ad40 2023-07-07T04:01:20.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.704+0000 7f1827157700 1 -- 172.21.15.6:0/930859862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18201522f0 con 0x7f182006ad40 2023-07-07T04:01:20.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.705+0000 7f1827157700 1 -- 172.21.15.6:0/930859862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f18200ce1c0 con 0x7f182006ad40 2023-07-07T04:01:20.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.706+0000 7f181d7fa700 1 -- 172.21.15.6:0/930859862 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f180801a400 con 0x7f182006ad40 2023-07-07T04:01:20.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.706+0000 7f181d7fa700 1 --2- 172.21.15.6:0/930859862 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f180006ace0 0x7f180006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.706+0000 7f181d7fa700 1 -- 172.21.15.6:0/930859862 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f18080893b0 con 0x7f182006ad40 2023-07-07T04:01:20.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.706+0000 7f181ffff700 1 --2- 172.21.15.6:0/930859862 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f180006ace0 0x7f180006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.706+0000 7f181d7fa700 1 --2- 172.21.15.6:0/930859862 >> [v2:172.21.15.6:6800/3393411907,v1:172.21.15.6:6801/3393411907] conn(0x7f1800071580 0x7f18000739d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.706+0000 7f181d7fa700 1 -- 172.21.15.6:0/930859862 --> [v2:172.21.15.6:6800/3393411907,v1:172.21.15.6:6801/3393411907] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f18000740a0 con 0x7f1800071580 2023-07-07T04:01:20.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.706+0000 7f181d7fa700 1 -- 172.21.15.6:0/930859862 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1808089720 con 0x7f182006ad40 2023-07-07T04:01:20.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.707+0000 7f18256f4700 1 --2- 172.21.15.6:0/930859862 >> [v2:172.21.15.6:6800/3393411907,v1:172.21.15.6:6801/3393411907] conn(0x7f1800071580 0x7f18000739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.707+0000 7f181ffff700 1 --2- 172.21.15.6:0/930859862 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f180006ace0 0x7f180006d190 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f1820161060 tx=0x7f1810008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:20.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.707+0000 7f18256f4700 1 --2- 172.21.15.6:0/930859862 >> [v2:172.21.15.6:6800/3393411907,v1:172.21.15.6:6801/3393411907] conn(0x7f1800071580 0x7f18000739d0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:20.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.708+0000 7f181d7fa700 1 -- 172.21.15.6:0/930859862 <== osd.1 v2:172.21.15.6:6800/3393411907 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f18000740a0 con 0x7f1800071580 2023-07-07T04:01:20.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.723+0000 7f1827157700 1 -- 172.21.15.6:0/930859862 --> [v2:172.21.15.6:6800/3393411907,v1:172.21.15.6:6801/3393411907] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1820074200 con 0x7f1800071580 2023-07-07T04:01:20.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.723+0000 7f181d7fa700 1 -- 172.21.15.6:0/930859862 <== osd.1 v2:172.21.15.6:6800/3393411907 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f1820074200 con 0x7f1800071580 2023-07-07T04:01:20.725 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-07T04:01:20.725 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-07T04:01:20.725 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-07T04:01:20.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.723+0000 7f1827157700 1 -- 172.21.15.6:0/930859862 >> [v2:172.21.15.6:6800/3393411907,v1:172.21.15.6:6801/3393411907] conn(0x7f1800071580 msgr2=0x7f18000739d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:20.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.723+0000 7f1827157700 1 --2- 172.21.15.6:0/930859862 >> [v2:172.21.15.6:6800/3393411907,v1:172.21.15.6:6801/3393411907] conn(0x7f1800071580 0x7f18000739d0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.724+0000 7f1827157700 1 -- 172.21.15.6:0/930859862 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f180006ace0 msgr2=0x7f180006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:20.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.724+0000 7f1827157700 1 --2- 172.21.15.6:0/930859862 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f180006ace0 0x7f180006d190 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f1820161060 tx=0x7f1810008040 comp rx=0 tx=0).stop 2023-07-07T04:01:20.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.724+0000 7f1827157700 1 -- 172.21.15.6:0/930859862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f182006ad40 msgr2=0x7f18200c91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:20.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.724+0000 7f1827157700 1 --2- 172.21.15.6:0/930859862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f182006ad40 0x7f18200c91c0 secure :-1 s=READY pgs=3368 cs=0 l=1 rev1=1 crypto rx=0x7f180800b4a0 tx=0x7f180800b7b0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.724+0000 7f18256f4700 1 -- 172.21.15.6:0/930859862 reap_dead start 2023-07-07T04:01:20.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.724+0000 7f1827157700 1 -- 172.21.15.6:0/930859862 shutdown_connections 2023-07-07T04:01:20.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.724+0000 7f1827157700 1 -- 172.21.15.6:0/930859862 >> 172.21.15.6:0/930859862 conn(0x7f18200cf940 msgr2=0x7f182006c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:20.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.724+0000 7f1827157700 1 -- 172.21.15.6:0/930859862 shutdown_connections 2023-07-07T04:01:20.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.724+0000 7f1827157700 1 -- 172.21.15.6:0/930859862 wait complete. 2023-07-07T04:01:20.738 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-07-07T04:01:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.873+0000 7f1f36b0d700 1 Processor -- start 2023-07-07T04:01:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.873+0000 7f1f36b0d700 1 -- start start 2023-07-07T04:01:20.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.874+0000 7f1f36b0d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1f300b1f10 0x7f1f300cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.874+0000 7f1f36b0d700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1f3006c4c0 0x7f1f300d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.874+0000 7f1f36b0d700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3015d480 con 0x7f1f30160e00 2023-07-07T04:01:20.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.874+0000 7f1f36b0d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3015cc60 con 0x7f1f300b1f10 2023-07-07T04:01:20.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.874+0000 7f1f36b0d700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3015ce70 con 0x7f1f3006c4c0 2023-07-07T04:01:20.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.874+0000 7f1f348a9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1f300b1f10 0x7f1f300cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.874+0000 7f1f348a9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f1f300b1f10 0x7f1f300cd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48298/0 (socket says 172.21.15.6:48298) 2023-07-07T04:01:20.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.874+0000 7f1f348a9700 1 -- 172.21.15.6:0/40038741 learned_addr learned my addr 172.21.15.6:0/40038741 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:20.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.874+0000 7f1f350aa700 1 --2- 172.21.15.6:0/40038741 >> v2:172.21.15.40:3300/0 conn(0x7f1f3006c4c0 0x7f1f300d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.875+0000 7f1f348a9700 1 -- 172.21.15.6:0/40038741 >> v2:172.21.15.40:3300/0 conn(0x7f1f3006c4c0 msgr2=0x7f1f300d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:20.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.875+0000 7f1f348a9700 1 --2- 172.21.15.6:0/40038741 >> v2:172.21.15.40:3300/0 conn(0x7f1f3006c4c0 0x7f1f300d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.875+0000 7f1f348a9700 1 -- 172.21.15.6:0/40038741 >> v1:172.21.15.40:6789/0 conn(0x7f1f30160e00 legacy=0x7f1f3006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:20.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.875+0000 7f1f348a9700 1 -- 172.21.15.6:0/40038741 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f300cddd0 con 0x7f1f300b1f10 2023-07-07T04:01:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.875+0000 7f1f348a9700 1 --2- 172.21.15.6:0/40038741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f300b1f10 0x7f1f300cd2c0 secure :-1 s=READY pgs=3369 cs=0 l=1 rev1=1 crypto rx=0x7f1f3008be80 tx=0x7f1f20009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b415672b81fddafc server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.875+0000 7f1f2f7fe700 1 -- 172.21.15.6:0/40038741 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2000b870 con 0x7f1f300b1f10 2023-07-07T04:01:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.875+0000 7f1f2f7fe700 1 -- 172.21.15.6:0/40038741 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2000b9d0 con 0x7f1f300b1f10 2023-07-07T04:01:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.875+0000 7f1f2f7fe700 1 -- 172.21.15.6:0/40038741 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2000bd60 con 0x7f1f300b1f10 2023-07-07T04:01:20.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.875+0000 7f1f36b0d700 1 -- 172.21.15.6:0/40038741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f300b1f10 msgr2=0x7f1f300cd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:20.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.875+0000 7f1f36b0d700 1 --2- 172.21.15.6:0/40038741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f300b1f10 0x7f1f300cd2c0 secure :-1 s=READY pgs=3369 cs=0 l=1 rev1=1 crypto rx=0x7f1f3008be80 tx=0x7f1f20009bd0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.875+0000 7f1f36b0d700 1 -- 172.21.15.6:0/40038741 shutdown_connections 2023-07-07T04:01:20.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.875+0000 7f1f36b0d700 1 --2- 172.21.15.6:0/40038741 >> v2:172.21.15.40:3300/0 conn(0x7f1f3006c4c0 0x7f1f300d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.875+0000 7f1f36b0d700 1 --2- 172.21.15.6:0/40038741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f300b1f10 0x7f1f300cd2c0 unknown :-1 s=CLOSED pgs=3369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.876+0000 7f1f36b0d700 1 -- 172.21.15.6:0/40038741 >> 172.21.15.6:0/40038741 conn(0x7f1f300d2c70 msgr2=0x7f1f300d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:20.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.876+0000 7f1f36b0d700 1 -- 172.21.15.6:0/40038741 shutdown_connections 2023-07-07T04:01:20.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.876+0000 7f1f36b0d700 1 -- 172.21.15.6:0/40038741 wait complete. 2023-07-07T04:01:20.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.877+0000 7f1f36b0d700 1 Processor -- start 2023-07-07T04:01:20.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.877+0000 7f1f36b0d700 1 -- start start 2023-07-07T04:01:20.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.878+0000 7f1f36b0d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f3006c4c0 0x7f1f301e6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.878+0000 7f1f36b0d700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f300b1f10 0x7f1f30159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.878+0000 7f1f36b0d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f30160e00 0x7f1f301f13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.878+0000 7f1f36b0d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f301e70f0 con 0x7f1f3006c4c0 2023-07-07T04:01:20.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.878+0000 7f1f36b0d700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f301e65b0 con 0x7f1f300b1f10 2023-07-07T04:01:20.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.878+0000 7f1f36b0d700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f301e6850 con 0x7f1f30160e00 2023-07-07T04:01:20.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.878+0000 7f1f348a9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f3006c4c0 0x7f1f301e6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.878+0000 7f1f348a9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f3006c4c0 0x7f1f301e6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48302/0 (socket says 172.21.15.6:48302) 2023-07-07T04:01:20.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.878+0000 7f1f348a9700 1 -- 172.21.15.6:0/505577639 learned_addr learned my addr 172.21.15.6:0/505577639 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:20.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.878+0000 7f1f350aa700 1 --2- 172.21.15.6:0/505577639 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f30160e00 0x7f1f301f13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.878+0000 7f1f2ffff700 1 --2- 172.21.15.6:0/505577639 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f300b1f10 0x7f1f30159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.878+0000 7f1f348a9700 1 -- 172.21.15.6:0/505577639 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f30160e00 msgr2=0x7f1f301f13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:20.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.878+0000 7f1f348a9700 1 --2- 172.21.15.6:0/505577639 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f30160e00 0x7f1f301f13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.878+0000 7f1f348a9700 1 -- 172.21.15.6:0/505577639 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f300b1f10 msgr2=0x7f1f30159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:20.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.878+0000 7f1f348a9700 1 --2- 172.21.15.6:0/505577639 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f300b1f10 0x7f1f30159690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:20.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.878+0000 7f1f348a9700 1 -- 172.21.15.6:0/505577639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f20009550 con 0x7f1f3006c4c0 2023-07-07T04:01:20.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.879+0000 7f1f348a9700 1 --2- 172.21.15.6:0/505577639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f3006c4c0 0x7f1f301e6070 secure :-1 s=READY pgs=3370 cs=0 l=1 rev1=1 crypto rx=0x7f1f20000c00 tx=0x7f1f20004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:20.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.879+0000 7f1f2d7fa700 1 -- 172.21.15.6:0/505577639 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f20004540 con 0x7f1f3006c4c0 2023-07-07T04:01:20.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.879+0000 7f1f2d7fa700 1 -- 172.21.15.6:0/505577639 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f200036a0 con 0x7f1f3006c4c0 2023-07-07T04:01:20.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.879+0000 7f1f36b0d700 1 -- 172.21.15.6:0/505577639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f301e6b30 con 0x7f1f3006c4c0 2023-07-07T04:01:20.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.879+0000 7f1f2d7fa700 1 -- 172.21.15.6:0/505577639 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f20003a10 con 0x7f1f3006c4c0 2023-07-07T04:01:20.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.879+0000 7f1f36b0d700 1 -- 172.21.15.6:0/505577639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f300c9e70 con 0x7f1f3006c4c0 2023-07-07T04:01:20.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.880+0000 7f1f36b0d700 1 -- 172.21.15.6:0/505577639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3004eb90 con 0x7f1f3006c4c0 2023-07-07T04:01:20.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.880+0000 7f1f2d7fa700 1 -- 172.21.15.6:0/505577639 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1f20021070 con 0x7f1f3006c4c0 2023-07-07T04:01:20.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.881+0000 7f1f2d7fa700 1 --2- 172.21.15.6:0/505577639 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1f1006ace0 0x7f1f1006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:20.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.881+0000 7f1f2d7fa700 1 -- 172.21.15.6:0/505577639 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f1f2008a930 con 0x7f1f3006c4c0 2023-07-07T04:01:20.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.881+0000 7f1f2ffff700 1 --2- 172.21.15.6:0/505577639 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1f1006ace0 0x7f1f1006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:20.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.881+0000 7f1f2ffff700 1 --2- 172.21.15.6:0/505577639 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1f1006ace0 0x7f1f1006d190 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1f301e7b30 tx=0x7f1f18009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:20.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:20.886+0000 7f1f2d7fa700 1 -- 172.21.15.6:0/505577639 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1f20055c30 con 0x7f1f3006c4c0 2023-07-07T04:01:21.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.097+0000 7f1f36b0d700 1 -- 172.21.15.6:0/505577639 --> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f3015d110 con 0x7f1f1006ace0 2023-07-07T04:01:21.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.097+0000 7f1f2d7fa700 1 -- 172.21.15.6:0/505577639 <== mgr.4110 v2:172.21.15.6:6832/201543369 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1f18001cc0 con 0x7f1f1006ace0 2023-07-07T04:01:21.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.100+0000 7f1f36b0d700 1 -- 172.21.15.6:0/505577639 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1f1006ace0 msgr2=0x7f1f1006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:21.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.100+0000 7f1f36b0d700 1 --2- 172.21.15.6:0/505577639 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1f1006ace0 0x7f1f1006d190 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1f301e7b30 tx=0x7f1f18009040 comp rx=0 tx=0).stop 2023-07-07T04:01:21.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.100+0000 7f1f36b0d700 1 -- 172.21.15.6:0/505577639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f3006c4c0 msgr2=0x7f1f301e6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:21.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.100+0000 7f1f36b0d700 1 --2- 172.21.15.6:0/505577639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f3006c4c0 0x7f1f301e6070 secure :-1 s=READY pgs=3370 cs=0 l=1 rev1=1 crypto rx=0x7f1f20000c00 tx=0x7f1f20004750 comp rx=0 tx=0).stop 2023-07-07T04:01:21.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.100+0000 7f1f36b0d700 1 -- 172.21.15.6:0/505577639 shutdown_connections 2023-07-07T04:01:21.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.100+0000 7f1f36b0d700 1 --2- 172.21.15.6:0/505577639 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f1f1006ace0 0x7f1f1006d190 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.100+0000 7f1f36b0d700 1 --2- 172.21.15.6:0/505577639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f3006c4c0 0x7f1f301e6070 unknown :-1 s=CLOSED pgs=3370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.100+0000 7f1f36b0d700 1 --2- 172.21.15.6:0/505577639 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f1f30160e00 0x7f1f301f13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.100+0000 7f1f36b0d700 1 --2- 172.21.15.6:0/505577639 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1f300b1f10 0x7f1f30159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.100+0000 7f1f36b0d700 1 -- 172.21.15.6:0/505577639 >> 172.21.15.6:0/505577639 conn(0x7f1f300d2c70 msgr2=0x7f1f300d1630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:21.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.100+0000 7f1f36b0d700 1 -- 172.21.15.6:0/505577639 shutdown_connections 2023-07-07T04:01:21.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.100+0000 7f1f36b0d700 1 -- 172.21.15.6:0/505577639 wait complete. 2023-07-07T04:01:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 1 to deep-scrub 2023-07-07T04:01:21.115 INFO:tasks.ceph:Scrubbing osd.2 2023-07-07T04:01:21.115 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-07-07T04:01:21.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.254+0000 7f31b8eb9700 1 Processor -- start 2023-07-07T04:01:21.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.254+0000 7f31b8eb9700 1 -- start start 2023-07-07T04:01:21.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.255+0000 7f31b8eb9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31b415c670 0x7f31b406bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.255+0000 7f31b8eb9700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f31b40cd950 0x7f31b40d0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.255+0000 7f31b8eb9700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b406aa30 con 0x7f31b406c410 2023-07-07T04:01:21.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.255+0000 7f31b8eb9700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b415ca40 con 0x7f31b415c670 2023-07-07T04:01:21.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.255+0000 7f31b8eb9700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b406c950 con 0x7f31b40cd950 2023-07-07T04:01:21.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.255+0000 7f31b259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31b415c670 0x7f31b406bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:21.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.255+0000 7f31b259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f31b415c670 0x7f31b406bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48310/0 (socket says 172.21.15.6:48310) 2023-07-07T04:01:21.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.255+0000 7f31b259c700 1 -- 172.21.15.6:0/348882866 learned_addr learned my addr 172.21.15.6:0/348882866 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:21.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.255+0000 7f31b2d9d700 1 --2- 172.21.15.6:0/348882866 >> v2:172.21.15.40:3300/0 conn(0x7f31b40cd950 0x7f31b40d0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:21.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.255+0000 7f31b259c700 1 -- 172.21.15.6:0/348882866 >> v2:172.21.15.40:3300/0 conn(0x7f31b40cd950 msgr2=0x7f31b40d0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:21.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.255+0000 7f31b259c700 1 --2- 172.21.15.6:0/348882866 >> v2:172.21.15.40:3300/0 conn(0x7f31b40cd950 0x7f31b40d0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.255+0000 7f31b259c700 1 -- 172.21.15.6:0/348882866 >> v1:172.21.15.40:6789/0 conn(0x7f31b406c410 legacy=0x7f31b40cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:21.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.256+0000 7f31b259c700 1 -- 172.21.15.6:0/348882866 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b406a100 con 0x7f31b415c670 2023-07-07T04:01:21.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.256+0000 7f31b259c700 1 --2- 172.21.15.6:0/348882866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31b415c670 0x7f31b406bed0 secure :-1 s=READY pgs=3371 cs=0 l=1 rev1=1 crypto rx=0x7f31b406d8b0 tx=0x7f31a4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66cae262887f89a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:21.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.256+0000 7f31b159a700 1 -- 172.21.15.6:0/348882866 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a4011830 con 0x7f31b415c670 2023-07-07T04:01:21.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.256+0000 7f31b159a700 1 -- 172.21.15.6:0/348882866 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a4011990 con 0x7f31b415c670 2023-07-07T04:01:21.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.256+0000 7f31b159a700 1 -- 172.21.15.6:0/348882866 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a4011d20 con 0x7f31b415c670 2023-07-07T04:01:21.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.256+0000 7f31b8eb9700 1 -- 172.21.15.6:0/348882866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31b415c670 msgr2=0x7f31b406bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:21.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.256+0000 7f31b8eb9700 1 --2- 172.21.15.6:0/348882866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31b415c670 0x7f31b406bed0 secure :-1 s=READY pgs=3371 cs=0 l=1 rev1=1 crypto rx=0x7f31b406d8b0 tx=0x7f31a4009bd0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.257+0000 7f31b8eb9700 1 -- 172.21.15.6:0/348882866 shutdown_connections 2023-07-07T04:01:21.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.257+0000 7f31b8eb9700 1 --2- 172.21.15.6:0/348882866 >> v2:172.21.15.40:3300/0 conn(0x7f31b40cd950 0x7f31b40d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.257+0000 7f31b8eb9700 1 --2- 172.21.15.6:0/348882866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31b415c670 0x7f31b406bed0 unknown :-1 s=CLOSED pgs=3371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.257+0000 7f31b8eb9700 1 -- 172.21.15.6:0/348882866 >> 172.21.15.6:0/348882866 conn(0x7f31b40d2bf0 msgr2=0x7f31b40d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:21.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.257+0000 7f31b8eb9700 1 -- 172.21.15.6:0/348882866 shutdown_connections 2023-07-07T04:01:21.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.257+0000 7f31b8eb9700 1 -- 172.21.15.6:0/348882866 wait complete. 2023-07-07T04:01:21.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.258+0000 7f31b8eb9700 1 Processor -- start 2023-07-07T04:01:21.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.258+0000 7f31b8eb9700 1 -- start start 2023-07-07T04:01:21.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.259+0000 7f31b8eb9700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31b406c410 0x7f31b41e8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.259+0000 7f31b8eb9700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31b40cd950 0x7f31b40c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.259+0000 7f31b8eb9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31b415c670 0x7f31b40cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.259+0000 7f31b8eb9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40ccd80 con 0x7f31b415c670 2023-07-07T04:01:21.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.259+0000 7f31b8eb9700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40cc170 con 0x7f31b40cd950 2023-07-07T04:01:21.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.259+0000 7f31b8eb9700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40cc450 con 0x7f31b406c410 2023-07-07T04:01:21.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.259+0000 7f31b2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31b415c670 0x7f31b40cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:21.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.259+0000 7f31b2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31b415c670 0x7f31b40cb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48318/0 (socket says 172.21.15.6:48318) 2023-07-07T04:01:21.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.259+0000 7f31b2d9d700 1 -- 172.21.15.6:0/3471732192 learned_addr learned my addr 172.21.15.6:0/3471732192 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:21.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.259+0000 7f31b259c700 1 --2- 172.21.15.6:0/3471732192 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31b406c410 0x7f31b41e8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:21.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.259+0000 7f31b1d9b700 1 --2- 172.21.15.6:0/3471732192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31b40cd950 0x7f31b40c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:21.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.259+0000 7f31b2d9d700 1 -- 172.21.15.6:0/3471732192 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31b406c410 msgr2=0x7f31b41e8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:21.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.259+0000 7f31b2d9d700 1 --2- 172.21.15.6:0/3471732192 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f31b406c410 0x7f31b41e8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.259+0000 7f31b2d9d700 1 -- 172.21.15.6:0/3471732192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31b40cd950 msgr2=0x7f31b40c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:21.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.259+0000 7f31b2d9d700 1 --2- 172.21.15.6:0/3471732192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31b40cd950 0x7f31b40c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.259+0000 7f31b2d9d700 1 -- 172.21.15.6:0/3471732192 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a4009550 con 0x7f31b415c670 2023-07-07T04:01:21.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.259+0000 7f31b1d9b700 1 --2- 172.21.15.6:0/3471732192 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f31b40cd950 0x7f31b40c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T04:01:21.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.260+0000 7f31b2d9d700 1 --2- 172.21.15.6:0/3471732192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31b415c670 0x7f31b40cb4a0 secure :-1 s=READY pgs=3372 cs=0 l=1 rev1=1 crypto rx=0x7f31ac00efc0 tx=0x7f31ac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:21.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.260+0000 7f31a2ffd700 1 -- 172.21.15.6:0/3471732192 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac009ca0 con 0x7f31b415c670 2023-07-07T04:01:21.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.260+0000 7f31a2ffd700 1 -- 172.21.15.6:0/3471732192 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ac00f040 con 0x7f31b415c670 2023-07-07T04:01:21.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.260+0000 7f31b8eb9700 1 -- 172.21.15.6:0/3471732192 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b40cc730 con 0x7f31b415c670 2023-07-07T04:01:21.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.260+0000 7f31a2ffd700 1 -- 172.21.15.6:0/3471732192 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac014480 con 0x7f31b415c670 2023-07-07T04:01:21.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.260+0000 7f31b8eb9700 1 -- 172.21.15.6:0/3471732192 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b41e8e90 con 0x7f31b415c670 2023-07-07T04:01:21.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.261+0000 7f31b8eb9700 1 -- 172.21.15.6:0/3471732192 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f31b406a6c0 con 0x7f31b415c670 2023-07-07T04:01:21.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.261+0000 7f31a2ffd700 1 -- 172.21.15.6:0/3471732192 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f31ac0145e0 con 0x7f31b415c670 2023-07-07T04:01:21.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.262+0000 7f31a2ffd700 1 --2- 172.21.15.6:0/3471732192 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f319406ace0 0x7f319406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.262+0000 7f31a2ffd700 1 -- 172.21.15.6:0/3471732192 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f31ac08a930 con 0x7f31b415c670 2023-07-07T04:01:21.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.262+0000 7f31b259c700 1 --2- 172.21.15.6:0/3471732192 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f319406ace0 0x7f319406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:21.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.262+0000 7f31a2ffd700 1 --2- 172.21.15.6:0/3471732192 >> [v2:172.21.15.6:6816/2050035126,v1:172.21.15.6:6817/2050035126] conn(0x7f3194071580 0x7f31940739d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.262+0000 7f31a2ffd700 1 -- 172.21.15.6:0/3471732192 --> [v2:172.21.15.6:6816/2050035126,v1:172.21.15.6:6817/2050035126] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f31940740a0 con 0x7f3194071580 2023-07-07T04:01:21.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.262+0000 7f31a2ffd700 1 -- 172.21.15.6:0/3471732192 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31ac08ad60 con 0x7f31b415c670 2023-07-07T04:01:21.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.262+0000 7f31b1d9b700 1 --2- 172.21.15.6:0/3471732192 >> [v2:172.21.15.6:6816/2050035126,v1:172.21.15.6:6817/2050035126] conn(0x7f3194071580 0x7f31940739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:21.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.262+0000 7f31b259c700 1 --2- 172.21.15.6:0/3471732192 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f319406ace0 0x7f319406d190 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f31a4014040 tx=0x7f31a4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:21.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.263+0000 7f31b1d9b700 1 --2- 172.21.15.6:0/3471732192 >> [v2:172.21.15.6:6816/2050035126,v1:172.21.15.6:6817/2050035126] conn(0x7f3194071580 0x7f31940739d0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:21.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.263+0000 7f31a2ffd700 1 -- 172.21.15.6:0/3471732192 <== osd.2 v2:172.21.15.6:6816/2050035126 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f31940740a0 con 0x7f3194071580 2023-07-07T04:01:21.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.279+0000 7f31b8eb9700 1 -- 172.21.15.6:0/3471732192 --> [v2:172.21.15.6:6816/2050035126,v1:172.21.15.6:6817/2050035126] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f31b406a3e0 con 0x7f3194071580 2023-07-07T04:01:21.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.279+0000 7f31a2ffd700 1 -- 172.21.15.6:0/3471732192 <== osd.2 v2:172.21.15.6:6816/2050035126 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f31a80050f0 con 0x7f3194071580 2023-07-07T04:01:21.280 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-07T04:01:21.281 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-07T04:01:21.281 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-07T04:01:21.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.279+0000 7f31b8eb9700 1 -- 172.21.15.6:0/3471732192 >> [v2:172.21.15.6:6816/2050035126,v1:172.21.15.6:6817/2050035126] conn(0x7f3194071580 msgr2=0x7f31940739d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:21.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.279+0000 7f31b8eb9700 1 --2- 172.21.15.6:0/3471732192 >> [v2:172.21.15.6:6816/2050035126,v1:172.21.15.6:6817/2050035126] conn(0x7f3194071580 0x7f31940739d0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.279+0000 7f31b8eb9700 1 -- 172.21.15.6:0/3471732192 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f319406ace0 msgr2=0x7f319406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:21.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.279+0000 7f31b8eb9700 1 --2- 172.21.15.6:0/3471732192 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f319406ace0 0x7f319406d190 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f31a4014040 tx=0x7f31a4008030 comp rx=0 tx=0).stop 2023-07-07T04:01:21.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.279+0000 7f31b8eb9700 1 -- 172.21.15.6:0/3471732192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31b415c670 msgr2=0x7f31b40cb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:21.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.279+0000 7f31b8eb9700 1 --2- 172.21.15.6:0/3471732192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31b415c670 0x7f31b40cb4a0 secure :-1 s=READY pgs=3372 cs=0 l=1 rev1=1 crypto rx=0x7f31ac00efc0 tx=0x7f31ac00c3a0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.279+0000 7f31b2d9d700 1 -- 172.21.15.6:0/3471732192 reap_dead start 2023-07-07T04:01:21.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.279+0000 7f31b8eb9700 1 -- 172.21.15.6:0/3471732192 shutdown_connections 2023-07-07T04:01:21.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.279+0000 7f31b8eb9700 1 -- 172.21.15.6:0/3471732192 >> 172.21.15.6:0/3471732192 conn(0x7f31b40d2bf0 msgr2=0x7f31b415fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:21.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.279+0000 7f31b8eb9700 1 -- 172.21.15.6:0/3471732192 shutdown_connections 2023-07-07T04:01:21.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.279+0000 7f31b8eb9700 1 -- 172.21.15.6:0/3471732192 wait complete. 2023-07-07T04:01:21.294 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-07-07T04:01:21.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.430+0000 7f0bb2760700 1 Processor -- start 2023-07-07T04:01:21.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.430+0000 7f0bb2760700 1 -- start start 2023-07-07T04:01:21.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.431+0000 7f0bb2760700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0bac0b1f10 0x7f0bac0cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.431+0000 7f0bb2760700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0bac160e00 0x7f0bac06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.431+0000 7f0bb2760700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0bac15d910 0x7f0bac06c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.431+0000 7f0bb2760700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bac15cc60 con 0x7f0bac15d910 2023-07-07T04:01:21.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.431+0000 7f0bb2760700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bac15d480 con 0x7f0bac0b1f10 2023-07-07T04:01:21.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.431+0000 7f0bb2760700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac15ce70 con 0x7f0bac160e00 2023-07-07T04:01:21.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.431+0000 7f0bb0cfd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0bac15d910 0x7f0bac06c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:21.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.431+0000 7f0bb0cfd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f0bac15d910 0x7f0bac06c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48330/0 (socket says 172.21.15.6:48330) 2023-07-07T04:01:21.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.431+0000 7f0bb0cfd700 1 -- 172.21.15.6:0/3221146105 learned_addr learned my addr 172.21.15.6:0/3221146105 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:21.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.431+0000 7f0bab7fe700 1 --2- 172.21.15.6:0/3221146105 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0bac160e00 0x7f0bac06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:21.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.431+0000 7f0babfff700 1 --2- 172.21.15.6:0/3221146105 >> v2:172.21.15.40:3300/0 conn(0x7f0bac0b1f10 0x7f0bac0cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:21.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.432+0000 7f0bb0cfd700 1 -- 172.21.15.6:0/3221146105 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0bac160e00 msgr2=0x7f0bac06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:21.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.432+0000 7f0bb0cfd700 1 --2- 172.21.15.6:0/3221146105 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0bac160e00 0x7f0bac06bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.432+0000 7f0bb0cfd700 1 -- 172.21.15.6:0/3221146105 >> v2:172.21.15.40:3300/0 conn(0x7f0bac0b1f10 msgr2=0x7f0bac0cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:21.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.432+0000 7f0bb0cfd700 1 --2- 172.21.15.6:0/3221146105 >> v2:172.21.15.40:3300/0 conn(0x7f0bac0b1f10 0x7f0bac0cd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.432+0000 7f0bb0cfd700 1 -- 172.21.15.6:0/3221146105 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac0cddd0 con 0x7f0bac15d910 2023-07-07T04:01:21.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.432+0000 7f0bb0cfd700 1 --2- 172.21.15.6:0/3221146105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bac15d910 0x7f0bac06c2f0 secure :-1 s=READY pgs=3373 cs=0 l=1 rev1=1 crypto rx=0x7f0bac06d860 tx=0x7f0ba400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d9ba19092c523a server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:21.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.432+0000 7f0baaffd700 1 -- 172.21.15.6:0/3221146105 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba400e070 con 0x7f0bac15d910 2023-07-07T04:01:21.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.432+0000 7f0baaffd700 1 -- 172.21.15.6:0/3221146105 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba400b9c0 con 0x7f0bac15d910 2023-07-07T04:01:21.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.432+0000 7f0baaffd700 1 -- 172.21.15.6:0/3221146105 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba400bd70 con 0x7f0bac15d910 2023-07-07T04:01:21.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.432+0000 7f0bb2760700 1 -- 172.21.15.6:0/3221146105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bac15d910 msgr2=0x7f0bac06c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:21.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.432+0000 7f0bb2760700 1 --2- 172.21.15.6:0/3221146105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bac15d910 0x7f0bac06c2f0 secure :-1 s=READY pgs=3373 cs=0 l=1 rev1=1 crypto rx=0x7f0bac06d860 tx=0x7f0ba400b330 comp rx=0 tx=0).stop 2023-07-07T04:01:21.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.433+0000 7f0bb2760700 1 -- 172.21.15.6:0/3221146105 shutdown_connections 2023-07-07T04:01:21.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.433+0000 7f0bb2760700 1 --2- 172.21.15.6:0/3221146105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bac15d910 0x7f0bac06c2f0 unknown :-1 s=CLOSED pgs=3373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.433+0000 7f0bb2760700 1 --2- 172.21.15.6:0/3221146105 >> v2:172.21.15.40:3300/0 conn(0x7f0bac0b1f10 0x7f0bac0cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.433+0000 7f0bb2760700 1 --2- 172.21.15.6:0/3221146105 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0bac160e00 0x7f0bac06bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.433+0000 7f0bb2760700 1 -- 172.21.15.6:0/3221146105 >> 172.21.15.6:0/3221146105 conn(0x7f0bac0d2c70 msgr2=0x7f0bac0d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:21.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.433+0000 7f0bb2760700 1 -- 172.21.15.6:0/3221146105 shutdown_connections 2023-07-07T04:01:21.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.433+0000 7f0bb2760700 1 -- 172.21.15.6:0/3221146105 wait complete. 2023-07-07T04:01:21.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.434+0000 7f0bb2760700 1 Processor -- start 2023-07-07T04:01:21.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.434+0000 7f0bb2760700 1 -- start start 2023-07-07T04:01:21.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.435+0000 7f0bb2760700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0bac0b1f10 0x7f0bac14b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.435+0000 7f0bb2760700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bac15d910 0x7f0bac0c9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.435+0000 7f0bb2760700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bac160e00 0x7f0bac0c7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.435+0000 7f0bb2760700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac0c74e0 con 0x7f0bac160e00 2023-07-07T04:01:21.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.435+0000 7f0bb2760700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac0c68d0 con 0x7f0bac15d910 2023-07-07T04:01:21.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.435+0000 7f0bb2760700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bac0c6bb0 con 0x7f0bac0b1f10 2023-07-07T04:01:21.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.435+0000 7f0bb0cfd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bac160e00 0x7f0bac0c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:21.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.435+0000 7f0bb0cfd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bac160e00 0x7f0bac0c7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48336/0 (socket says 172.21.15.6:48336) 2023-07-07T04:01:21.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.435+0000 7f0bb0cfd700 1 -- 172.21.15.6:0/893602686 learned_addr learned my addr 172.21.15.6:0/893602686 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:21.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.435+0000 7f0babfff700 1 --2- 172.21.15.6:0/893602686 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0bac0b1f10 0x7f0bac14b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:21.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.435+0000 7f0bab7fe700 1 --2- 172.21.15.6:0/893602686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bac15d910 0x7f0bac0c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:21.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.435+0000 7f0bb0cfd700 1 -- 172.21.15.6:0/893602686 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0bac0b1f10 msgr2=0x7f0bac14b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:21.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.435+0000 7f0bb0cfd700 1 --2- 172.21.15.6:0/893602686 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0bac0b1f10 0x7f0bac14b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.435+0000 7f0bb0cfd700 1 -- 172.21.15.6:0/893602686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bac15d910 msgr2=0x7f0bac0c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:21.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.435+0000 7f0bb0cfd700 1 --2- 172.21.15.6:0/893602686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bac15d910 0x7f0bac0c9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.435+0000 7f0bb0cfd700 1 -- 172.21.15.6:0/893602686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba4009b30 con 0x7f0bac160e00 2023-07-07T04:01:21.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.435+0000 7f0bb0cfd700 1 --2- 172.21.15.6:0/893602686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bac160e00 0x7f0bac0c7970 secure :-1 s=READY pgs=3374 cs=0 l=1 rev1=1 crypto rx=0x7f0bac0d39d0 tx=0x7f0ba4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:21.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.436+0000 7f0ba8ff9700 1 -- 172.21.15.6:0/893602686 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba40099b0 con 0x7f0bac160e00 2023-07-07T04:01:21.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.436+0000 7f0ba8ff9700 1 -- 172.21.15.6:0/893602686 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba4004250 con 0x7f0bac160e00 2023-07-07T04:01:21.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.436+0000 7f0bb2760700 1 -- 172.21.15.6:0/893602686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bac0c6e90 con 0x7f0bac160e00 2023-07-07T04:01:21.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.436+0000 7f0ba8ff9700 1 -- 172.21.15.6:0/893602686 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4004600 con 0x7f0bac160e00 2023-07-07T04:01:21.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.436+0000 7f0bb2760700 1 -- 172.21.15.6:0/893602686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bac0c9590 con 0x7f0bac160e00 2023-07-07T04:01:21.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.437+0000 7f0bb2760700 1 -- 172.21.15.6:0/893602686 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bac0c9720 con 0x7f0bac160e00 2023-07-07T04:01:21.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.437+0000 7f0ba8ff9700 1 -- 172.21.15.6:0/893602686 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0ba4004760 con 0x7f0bac160e00 2023-07-07T04:01:21.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.438+0000 7f0ba8ff9700 1 --2- 172.21.15.6:0/893602686 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0b8c06ace0 0x7f0b8c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.438+0000 7f0ba8ff9700 1 -- 172.21.15.6:0/893602686 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f0ba408a6a0 con 0x7f0bac160e00 2023-07-07T04:01:21.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.438+0000 7f0babfff700 1 --2- 172.21.15.6:0/893602686 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0b8c06ace0 0x7f0b8c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:21.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.438+0000 7f0babfff700 1 --2- 172.21.15.6:0/893602686 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0b8c06ace0 0x7f0b8c06d190 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0b94006b20 tx=0x7f0b94008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:21.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.442+0000 7f0ba8ff9700 1 -- 172.21.15.6:0/893602686 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0ba4055a50 con 0x7f0bac160e00 2023-07-07T04:01:21.469 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T04:01:21.471 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T04:01:21.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.654+0000 7f0bb2760700 1 -- 172.21.15.6:0/893602686 --> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f0bac15d110 con 0x7f0b8c06ace0 2023-07-07T04:01:21.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.655+0000 7f0ba8ff9700 1 -- 172.21.15.6:0/893602686 <== mgr.4110 v2:172.21.15.6:6832/201543369 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0b940076b0 con 0x7f0b8c06ace0 2023-07-07T04:01:21.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.657+0000 7f0bb2760700 1 -- 172.21.15.6:0/893602686 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0b8c06ace0 msgr2=0x7f0b8c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:21.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.657+0000 7f0bb2760700 1 --2- 172.21.15.6:0/893602686 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0b8c06ace0 0x7f0b8c06d190 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0b94006b20 tx=0x7f0b94008040 comp rx=0 tx=0).stop 2023-07-07T04:01:21.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.657+0000 7f0bb2760700 1 -- 172.21.15.6:0/893602686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bac160e00 msgr2=0x7f0bac0c7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:21.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.657+0000 7f0bb2760700 1 --2- 172.21.15.6:0/893602686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bac160e00 0x7f0bac0c7970 secure :-1 s=READY pgs=3374 cs=0 l=1 rev1=1 crypto rx=0x7f0bac0d39d0 tx=0x7f0ba4004ad0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.657+0000 7f0bb2760700 1 -- 172.21.15.6:0/893602686 shutdown_connections 2023-07-07T04:01:21.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.657+0000 7f0bb2760700 1 --2- 172.21.15.6:0/893602686 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f0b8c06ace0 0x7f0b8c06d190 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.657+0000 7f0bb2760700 1 --2- 172.21.15.6:0/893602686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0bac160e00 0x7f0bac0c7970 unknown :-1 s=CLOSED pgs=3374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.657+0000 7f0bb2760700 1 --2- 172.21.15.6:0/893602686 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f0bac0b1f10 0x7f0bac14b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.657+0000 7f0bb2760700 1 --2- 172.21.15.6:0/893602686 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0bac15d910 0x7f0bac0c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.657+0000 7f0bb2760700 1 -- 172.21.15.6:0/893602686 >> 172.21.15.6:0/893602686 conn(0x7f0bac0d2c70 msgr2=0x7f0bac0d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:21.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.657+0000 7f0bb2760700 1 -- 172.21.15.6:0/893602686 shutdown_connections 2023-07-07T04:01:21.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.657+0000 7f0bb2760700 1 -- 172.21.15.6:0/893602686 wait complete. 2023-07-07T04:01:21.661 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 2 to deep-scrub 2023-07-07T04:01:21.672 INFO:tasks.ceph:Scrubbing osd.3 2023-07-07T04:01:21.672 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-07-07T04:01:21.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.812+0000 7fc78c231700 1 Processor -- start 2023-07-07T04:01:21.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.812+0000 7fc78c231700 1 -- start start 2023-07-07T04:01:21.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.813+0000 7fc78c231700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc7840cd240 0x7fc7840cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.813+0000 7fc78c231700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7840d0b70 0x7fc7840d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.813+0000 7fc78c231700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7840cdbd0 con 0x7fc78415c670 2023-07-07T04:01:21.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.813+0000 7fc78c231700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc78406aa30 con 0x7fc7840cd240 2023-07-07T04:01:21.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.813+0000 7fc78c231700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78415ca40 con 0x7fc7840d0b70 2023-07-07T04:01:21.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.813+0000 7fc789fcd700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc78415c670 0x7fc78406bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49548/0 (socket says 172.21.15.6:49548) 2023-07-07T04:01:21.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.813+0000 7fc789fcd700 1 -- 172.21.15.6:0/1513397231 learned_addr learned my addr 172.21.15.6:0/1513397231 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:01:21.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.813+0000 7fc78a7ce700 1 --2- 172.21.15.6:0/1513397231 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7840d0b70 0x7fc7840d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:21.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.813+0000 7fc7897cc700 1 --2- 172.21.15.6:0/1513397231 >> v2:172.21.15.40:3300/0 conn(0x7fc7840cd240 0x7fc7840cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:21.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.813+0000 7fc788fcb700 1 -- 172.21.15.6:0/1513397231 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424213516 0 0) 0x7fc774001110 con 0x7fc78415c670 2023-07-07T04:01:21.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.813+0000 7fc788fcb700 1 -- 172.21.15.6:0/1513397231 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc76c0035b0 con 0x7fc78415c670 2023-07-07T04:01:21.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.813+0000 7fc7897cc700 1 -- 172.21.15.6:0/1513397231 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7840d0b70 msgr2=0x7fc7840d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:21.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.813+0000 7fc7897cc700 1 --2- 172.21.15.6:0/1513397231 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7840d0b70 0x7fc7840d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.813+0000 7fc7897cc700 1 -- 172.21.15.6:0/1513397231 >> v1:172.21.15.6:6789/0 conn(0x7fc78415c670 legacy=0x7fc78406bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:21.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.813+0000 7fc7897cc700 1 -- 172.21.15.6:0/1513397231 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78406c950 con 0x7fc7840cd240 2023-07-07T04:01:21.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.813+0000 7fc78a7ce700 1 --2- 172.21.15.6:0/1513397231 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7840d0b70 0x7fc7840d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T04:01:21.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.814+0000 7fc7897cc700 1 --2- 172.21.15.6:0/1513397231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7840cd240 0x7fc7840cd690 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc778009840 tx=0x7fc778009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ee224ab2624ca98 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:21.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.814+0000 7fc788fcb700 1 -- 172.21.15.6:0/1513397231 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778011830 con 0x7fc7840cd240 2023-07-07T04:01:21.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.814+0000 7fc788fcb700 1 -- 172.21.15.6:0/1513397231 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc778011990 con 0x7fc7840cd240 2023-07-07T04:01:21.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.814+0000 7fc788fcb700 1 -- 172.21.15.6:0/1513397231 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc778011d20 con 0x7fc7840cd240 2023-07-07T04:01:21.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.814+0000 7fc78c231700 1 -- 172.21.15.6:0/1513397231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7840cd240 msgr2=0x7fc7840cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:21.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.814+0000 7fc78c231700 1 --2- 172.21.15.6:0/1513397231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7840cd240 0x7fc7840cd690 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc778009840 tx=0x7fc778009b50 comp rx=0 tx=0).stop 2023-07-07T04:01:21.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.814+0000 7fc78c231700 1 -- 172.21.15.6:0/1513397231 shutdown_connections 2023-07-07T04:01:21.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.814+0000 7fc78c231700 1 --2- 172.21.15.6:0/1513397231 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc7840d0b70 0x7fc7840d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.814+0000 7fc78c231700 1 --2- 172.21.15.6:0/1513397231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7840cd240 0x7fc7840cd690 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.815+0000 7fc78c231700 1 -- 172.21.15.6:0/1513397231 >> 172.21.15.6:0/1513397231 conn(0x7fc7840d2bf0 msgr2=0x7fc7840d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:21.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.815+0000 7fc78c231700 1 -- 172.21.15.6:0/1513397231 shutdown_connections 2023-07-07T04:01:21.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.815+0000 7fc78c231700 1 -- 172.21.15.6:0/1513397231 wait complete. 2023-07-07T04:01:21.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.816+0000 7fc78c231700 1 Processor -- start 2023-07-07T04:01:21.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.816+0000 7fc78c231700 1 -- start start 2023-07-07T04:01:21.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.817+0000 7fc78c231700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7840cd240 0x7fc784153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.817+0000 7fc78c231700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7840d0b70 0x7fc7840cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.817+0000 7fc78c231700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc78415c670 0x7fc7840cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.817+0000 7fc78c231700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc784153880 con 0x7fc7840cd240 2023-07-07T04:01:21.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.817+0000 7fc78c231700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7841e6fb0 con 0x7fc7840d0b70 2023-07-07T04:01:21.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.817+0000 7fc78c231700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7841e7290 con 0x7fc78415c670 2023-07-07T04:01:21.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.817+0000 7fc789fcd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7840cd240 0x7fc784153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:21.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.817+0000 7fc789fcd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7840cd240 0x7fc784153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48346/0 (socket says 172.21.15.6:48346) 2023-07-07T04:01:21.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.817+0000 7fc789fcd700 1 -- 172.21.15.6:0/1632842670 learned_addr learned my addr 172.21.15.6:0/1632842670 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:21.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.817+0000 7fc78a7ce700 1 --2- 172.21.15.6:0/1632842670 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc78415c670 0x7fc7840cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:21.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.817+0000 7fc7897cc700 1 --2- 172.21.15.6:0/1632842670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7840d0b70 0x7fc7840cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:21.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.817+0000 7fc789fcd700 1 -- 172.21.15.6:0/1632842670 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc78415c670 msgr2=0x7fc7840cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:21.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.817+0000 7fc789fcd700 1 --2- 172.21.15.6:0/1632842670 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fc78415c670 0x7fc7840cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.817+0000 7fc789fcd700 1 -- 172.21.15.6:0/1632842670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7840d0b70 msgr2=0x7fc7840cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:21.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.817+0000 7fc789fcd700 1 --2- 172.21.15.6:0/1632842670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc7840d0b70 0x7fc7840cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.817+0000 7fc789fcd700 1 -- 172.21.15.6:0/1632842670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c009a70 con 0x7fc7840cd240 2023-07-07T04:01:21.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.817+0000 7fc789fcd700 1 --2- 172.21.15.6:0/1632842670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7840cd240 0x7fc784153340 secure :-1 s=READY pgs=3376 cs=0 l=1 rev1=1 crypto rx=0x7fc774007fd0 tx=0x7fc77400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:21.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.818+0000 7fc7827fc700 1 -- 172.21.15.6:0/1632842670 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77400cea0 con 0x7fc7840cd240 2023-07-07T04:01:21.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.818+0000 7fc7827fc700 1 -- 172.21.15.6:0/1632842670 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc774005d70 con 0x7fc7840cd240 2023-07-07T04:01:21.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.818+0000 7fc78c231700 1 -- 172.21.15.6:0/1632842670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7780094a0 con 0x7fc7840cd240 2023-07-07T04:01:21.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.818+0000 7fc7827fc700 1 -- 172.21.15.6:0/1632842670 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7740072f0 con 0x7fc7840cd240 2023-07-07T04:01:21.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.818+0000 7fc78c231700 1 -- 172.21.15.6:0/1632842670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7841e7850 con 0x7fc7840cd240 2023-07-07T04:01:21.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.819+0000 7fc78c231700 1 -- 172.21.15.6:0/1632842670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc78406a3e0 con 0x7fc7840cd240 2023-07-07T04:01:21.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.819+0000 7fc7827fc700 1 -- 172.21.15.6:0/1632842670 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc774007450 con 0x7fc7840cd240 2023-07-07T04:01:21.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.820+0000 7fc7827fc700 1 --2- 172.21.15.6:0/1632842670 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc77006ace0 0x7fc77006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.820+0000 7fc7827fc700 1 -- 172.21.15.6:0/1632842670 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fc774088570 con 0x7fc7840cd240 2023-07-07T04:01:21.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.820+0000 7fc7897cc700 1 --2- 172.21.15.6:0/1632842670 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc77006ace0 0x7fc77006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:21.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.820+0000 7fc7827fc700 1 --2- 172.21.15.6:0/1632842670 >> [v2:172.21.15.6:6824/49626386,v1:172.21.15.6:6825/49626386] conn(0x7fc770071580 0x7fc7700739d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.820+0000 7fc7827fc700 1 -- 172.21.15.6:0/1632842670 --> [v2:172.21.15.6:6824/49626386,v1:172.21.15.6:6825/49626386] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc7700740a0 con 0x7fc770071580 2023-07-07T04:01:21.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.820+0000 7fc7827fc700 1 -- 172.21.15.6:0/1632842670 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc77408ac10 con 0x7fc7840cd240 2023-07-07T04:01:21.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.820+0000 7fc78a7ce700 1 --2- 172.21.15.6:0/1632842670 >> [v2:172.21.15.6:6824/49626386,v1:172.21.15.6:6825/49626386] conn(0x7fc770071580 0x7fc7700739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:21.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.820+0000 7fc7897cc700 1 --2- 172.21.15.6:0/1632842670 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc77006ace0 0x7fc77006d190 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fc778000c00 tx=0x7fc778008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:21.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.820+0000 7fc78a7ce700 1 --2- 172.21.15.6:0/1632842670 >> [v2:172.21.15.6:6824/49626386,v1:172.21.15.6:6825/49626386] conn(0x7fc770071580 0x7fc7700739d0 crc :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:21.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.821+0000 7fc7827fc700 1 -- 172.21.15.6:0/1632842670 <== osd.3 v2:172.21.15.6:6824/49626386 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc7700740a0 con 0x7fc770071580 2023-07-07T04:01:21.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.836+0000 7fc78c231700 1 -- 172.21.15.6:0/1632842670 --> [v2:172.21.15.6:6824/49626386,v1:172.21.15.6:6825/49626386] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc784158b40 con 0x7fc770071580 2023-07-07T04:01:21.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.837+0000 7fc7827fc700 1 -- 172.21.15.6:0/1632842670 <== osd.3 v2:172.21.15.6:6824/49626386 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc784158b40 con 0x7fc770071580 2023-07-07T04:01:21.838 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-07T04:01:21.838 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-07T04:01:21.838 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-07T04:01:21.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.837+0000 7fc78c231700 1 -- 172.21.15.6:0/1632842670 >> [v2:172.21.15.6:6824/49626386,v1:172.21.15.6:6825/49626386] conn(0x7fc770071580 msgr2=0x7fc7700739d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:21.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.837+0000 7fc78c231700 1 --2- 172.21.15.6:0/1632842670 >> [v2:172.21.15.6:6824/49626386,v1:172.21.15.6:6825/49626386] conn(0x7fc770071580 0x7fc7700739d0 crc :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.837+0000 7fc78c231700 1 -- 172.21.15.6:0/1632842670 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc77006ace0 msgr2=0x7fc77006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:21.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.837+0000 7fc78c231700 1 --2- 172.21.15.6:0/1632842670 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fc77006ace0 0x7fc77006d190 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fc778000c00 tx=0x7fc778008030 comp rx=0 tx=0).stop 2023-07-07T04:01:21.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.837+0000 7fc78c231700 1 -- 172.21.15.6:0/1632842670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7840cd240 msgr2=0x7fc784153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:21.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.837+0000 7fc78c231700 1 --2- 172.21.15.6:0/1632842670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7840cd240 0x7fc784153340 secure :-1 s=READY pgs=3376 cs=0 l=1 rev1=1 crypto rx=0x7fc774007fd0 tx=0x7fc77400c7b0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.837+0000 7fc78a7ce700 1 -- 172.21.15.6:0/1632842670 reap_dead start 2023-07-07T04:01:21.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.837+0000 7fc78c231700 1 -- 172.21.15.6:0/1632842670 shutdown_connections 2023-07-07T04:01:21.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.837+0000 7fc78c231700 1 -- 172.21.15.6:0/1632842670 >> 172.21.15.6:0/1632842670 conn(0x7fc7840d2bf0 msgr2=0x7fc7840c9580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:21.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.837+0000 7fc78c231700 1 -- 172.21.15.6:0/1632842670 shutdown_connections 2023-07-07T04:01:21.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.837+0000 7fc78c231700 1 -- 172.21.15.6:0/1632842670 wait complete. 2023-07-07T04:01:21.851 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-07-07T04:01:21.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.988+0000 7fb1bf945700 1 Processor -- start 2023-07-07T04:01:21.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.988+0000 7fb1bf945700 1 -- start start 2023-07-07T04:01:21.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.989+0000 7fb1bf945700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1b8160e00 0x7fb1b806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.989+0000 7fb1bf945700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b815d480 con 0x7fb1b815d910 2023-07-07T04:01:21.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.989+0000 7fb1bf945700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b815ce70 con 0x7fb1b80b1f10 2023-07-07T04:01:21.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.989+0000 7fb1bf945700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b815cc60 con 0x7fb1b8160e00 2023-07-07T04:01:21.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.989+0000 7fb1bdee2700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fb1b815d910 0x7fb1b80d0c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49568/0 (socket says 172.21.15.6:49568) 2023-07-07T04:01:21.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.989+0000 7fb1bdee2700 1 -- 172.21.15.6:0/4186678308 learned_addr learned my addr 172.21.15.6:0/4186678308 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:01:21.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.989+0000 7fb1bcee0700 1 --2- 172.21.15.6:0/4186678308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1b8160e00 0x7fb1b806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:21.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.989+0000 7fb1b7fff700 1 -- 172.21.15.6:0/4186678308 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323158734 0 0) 0x7fb1b815d480 con 0x7fb1b815d910 2023-07-07T04:01:21.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.989+0000 7fb1b7fff700 1 -- 172.21.15.6:0/4186678308 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1a00035b0 con 0x7fb1b815d910 2023-07-07T04:01:21.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.989+0000 7fb1bcee0700 1 -- 172.21.15.6:0/4186678308 >> v1:172.21.15.40:6789/0 conn(0x7fb1b80b1f10 legacy=0x7fb1b80cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.989+0000 7fb1bcee0700 1 -- 172.21.15.6:0/4186678308 >> v1:172.21.15.6:6789/0 conn(0x7fb1b815d910 legacy=0x7fb1b80d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.989+0000 7fb1bcee0700 1 -- 172.21.15.6:0/4186678308 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b80cddd0 con 0x7fb1b8160e00 2023-07-07T04:01:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.990+0000 7fb1bcee0700 1 --2- 172.21.15.6:0/4186678308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1b8160e00 0x7fb1b806bdb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009870 tx=0x7fb1ac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc2ab947c12d3b9c server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.990+0000 7fb1b7fff700 1 -- 172.21.15.6:0/4186678308 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac011830 con 0x7fb1b8160e00 2023-07-07T04:01:21.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.990+0000 7fb1b7fff700 1 -- 172.21.15.6:0/4186678308 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac011990 con 0x7fb1b8160e00 2023-07-07T04:01:21.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.990+0000 7fb1b7fff700 1 -- 172.21.15.6:0/4186678308 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac011d20 con 0x7fb1b8160e00 2023-07-07T04:01:21.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.990+0000 7fb1bf945700 1 -- 172.21.15.6:0/4186678308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1b8160e00 msgr2=0x7fb1b806bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:21.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.990+0000 7fb1bf945700 1 --2- 172.21.15.6:0/4186678308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1b8160e00 0x7fb1b806bdb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009870 tx=0x7fb1ac009b80 comp rx=0 tx=0).stop 2023-07-07T04:01:21.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.990+0000 7fb1bf945700 1 -- 172.21.15.6:0/4186678308 shutdown_connections 2023-07-07T04:01:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.990+0000 7fb1bf945700 1 --2- 172.21.15.6:0/4186678308 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1b8160e00 0x7fb1b806bdb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.990+0000 7fb1bf945700 1 -- 172.21.15.6:0/4186678308 >> 172.21.15.6:0/4186678308 conn(0x7fb1b80d2c70 msgr2=0x7fb1b80d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.990+0000 7fb1bf945700 1 -- 172.21.15.6:0/4186678308 shutdown_connections 2023-07-07T04:01:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.990+0000 7fb1bf945700 1 -- 172.21.15.6:0/4186678308 wait complete. 2023-07-07T04:01:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.992+0000 7fb1bf945700 1 Processor -- start 2023-07-07T04:01:21.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.992+0000 7fb1bf945700 1 -- start start 2023-07-07T04:01:21.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.993+0000 7fb1bf945700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1b80b1f10 0x7fb1b81553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.993+0000 7fb1bf945700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b815d910 0x7fb1b80cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.993+0000 7fb1bf945700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1b8160e00 0x7fb1b815ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:21.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.993+0000 7fb1bf945700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b80cbcb0 con 0x7fb1b815d910 2023-07-07T04:01:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.993+0000 7fb1bf945700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b80b5aa0 con 0x7fb1b80b1f10 2023-07-07T04:01:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.993+0000 7fb1bf945700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b80b5d80 con 0x7fb1b8160e00 2023-07-07T04:01:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.993+0000 7fb1bcee0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b815d910 0x7fb1b80cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.993+0000 7fb1bcee0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b815d910 0x7fb1b80cb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48366/0 (socket says 172.21.15.6:48366) 2023-07-07T04:01:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.993+0000 7fb1bcee0700 1 -- 172.21.15.6:0/3337316946 learned_addr learned my addr 172.21.15.6:0/3337316946 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.993+0000 7fb1bdee2700 1 --2- 172.21.15.6:0/3337316946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1b8160e00 0x7fb1b815ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.993+0000 7fb1bd6e1700 1 --2- 172.21.15.6:0/3337316946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1b80b1f10 0x7fb1b81553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.993+0000 7fb1bcee0700 1 -- 172.21.15.6:0/3337316946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1b8160e00 msgr2=0x7fb1b815ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.993+0000 7fb1bcee0700 1 --2- 172.21.15.6:0/3337316946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1b8160e00 0x7fb1b815ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.993+0000 7fb1bcee0700 1 -- 172.21.15.6:0/3337316946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1b80b1f10 msgr2=0x7fb1b81553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:22.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.993+0000 7fb1bcee0700 1 --2- 172.21.15.6:0/3337316946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1b80b1f10 0x7fb1b81553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.993+0000 7fb1bcee0700 1 -- 172.21.15.6:0/3337316946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac0094a0 con 0x7fb1b815d910 2023-07-07T04:01:22.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.993+0000 7fb1bcee0700 1 --2- 172.21.15.6:0/3337316946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b815d910 0x7fb1b80cb770 secure :-1 s=READY pgs=3378 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac014040 tx=0x7fb1ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:22.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.993+0000 7fb1b5ffb700 1 -- 172.21.15.6:0/3337316946 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac0036a0 con 0x7fb1b815d910 2023-07-07T04:01:22.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.994+0000 7fb1b5ffb700 1 -- 172.21.15.6:0/3337316946 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac01e070 con 0x7fb1b815d910 2023-07-07T04:01:22.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.994+0000 7fb1bf945700 1 -- 172.21.15.6:0/3337316946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b80b6060 con 0x7fb1b815d910 2023-07-07T04:01:22.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.994+0000 7fb1b5ffb700 1 -- 172.21.15.6:0/3337316946 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac003a40 con 0x7fb1b815d910 2023-07-07T04:01:22.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.994+0000 7fb1bf945700 1 -- 172.21.15.6:0/3337316946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b80b6620 con 0x7fb1b815d910 2023-07-07T04:01:22.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.995+0000 7fb1bf945700 1 -- 172.21.15.6:0/3337316946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b80c70d0 con 0x7fb1b815d910 2023-07-07T04:01:22.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.995+0000 7fb1b5ffb700 1 -- 172.21.15.6:0/3337316946 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb1ac003ba0 con 0x7fb1b815d910 2023-07-07T04:01:22.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.996+0000 7fb1b5ffb700 1 --2- 172.21.15.6:0/3337316946 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb1a406ace0 0x7fb1a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.996+0000 7fb1b5ffb700 1 -- 172.21.15.6:0/3337316946 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fb1ac08a290 con 0x7fb1b815d910 2023-07-07T04:01:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.996+0000 7fb1bd6e1700 1 --2- 172.21.15.6:0/3337316946 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb1a406ace0 0x7fb1a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:21.996+0000 7fb1bd6e1700 1 --2- 172.21.15.6:0/3337316946 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb1a406ace0 0x7fb1a406d190 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0007fd0 tx=0x7fb1b0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.001+0000 7fb1b5ffb700 1 -- 172.21.15.6:0/3337316946 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb1ac055510 con 0x7fb1b815d910 2023-07-07T04:01:22.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.208+0000 7fb1bf945700 1 -- 172.21.15.6:0/3337316946 --> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1b815d110 con 0x7fb1a406ace0 2023-07-07T04:01:22.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.208+0000 7fb1b5ffb700 1 -- 172.21.15.6:0/3337316946 <== mgr.4110 v2:172.21.15.6:6832/201543369 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb1b0001560 con 0x7fb1a406ace0 2023-07-07T04:01:22.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.211+0000 7fb1bf945700 1 -- 172.21.15.6:0/3337316946 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb1a406ace0 msgr2=0x7fb1a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:22.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.211+0000 7fb1bf945700 1 --2- 172.21.15.6:0/3337316946 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb1a406ace0 0x7fb1a406d190 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0007fd0 tx=0x7fb1b0009040 comp rx=0 tx=0).stop 2023-07-07T04:01:22.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.211+0000 7fb1bf945700 1 -- 172.21.15.6:0/3337316946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b815d910 msgr2=0x7fb1b80cb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:22.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.211+0000 7fb1bf945700 1 --2- 172.21.15.6:0/3337316946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b815d910 0x7fb1b80cb770 secure :-1 s=READY pgs=3378 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac014040 tx=0x7fb1ac004750 comp rx=0 tx=0).stop 2023-07-07T04:01:22.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.211+0000 7fb1bf945700 1 -- 172.21.15.6:0/3337316946 shutdown_connections 2023-07-07T04:01:22.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.211+0000 7fb1bf945700 1 --2- 172.21.15.6:0/3337316946 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb1a406ace0 0x7fb1a406d190 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.211+0000 7fb1bf945700 1 --2- 172.21.15.6:0/3337316946 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb1b8160e00 0x7fb1b815ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.211+0000 7fb1bf945700 1 --2- 172.21.15.6:0/3337316946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1b80b1f10 0x7fb1b81553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.211+0000 7fb1bf945700 1 --2- 172.21.15.6:0/3337316946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1b815d910 0x7fb1b80cb770 unknown :-1 s=CLOSED pgs=3378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.211+0000 7fb1bf945700 1 -- 172.21.15.6:0/3337316946 >> 172.21.15.6:0/3337316946 conn(0x7fb1b80d2c70 msgr2=0x7fb1b806c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:22.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.211+0000 7fb1bf945700 1 -- 172.21.15.6:0/3337316946 shutdown_connections 2023-07-07T04:01:22.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.211+0000 7fb1bf945700 1 -- 172.21.15.6:0/3337316946 wait complete. 2023-07-07T04:01:22.215 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 3 to deep-scrub 2023-07-07T04:01:22.226 INFO:tasks.ceph:Scrubbing osd.4 2023-07-07T04:01:22.227 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-07-07T04:01:22.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.367+0000 7fcd49141700 1 Processor -- start 2023-07-07T04:01:22.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.367+0000 7fcd49141700 1 -- start start 2023-07-07T04:01:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.368+0000 7fcd49141700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcd4415c670 0x7fcd4406bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.368+0000 7fcd49141700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcd4406c410 0x7fcd440cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.368+0000 7fcd49141700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd440cd780 0x7fcd441601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.368+0000 7fcd49141700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd440cdbe0 con 0x7fcd4406c410 2023-07-07T04:01:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.368+0000 7fcd49141700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd4406aa30 con 0x7fcd4415c670 2023-07-07T04:01:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.368+0000 7fcd49141700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4415ca40 con 0x7fcd440cd780 2023-07-07T04:01:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.368+0000 7fcd4259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcd4406c410 0x7fcd440cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.368+0000 7fcd4259c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fcd4406c410 0x7fcd440cd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48372/0 (socket says 172.21.15.6:48372) 2023-07-07T04:01:22.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.368+0000 7fcd4259c700 1 -- 172.21.15.6:0/2933386768 learned_addr learned my addr 172.21.15.6:0/2933386768 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.368+0000 7fcd42d9d700 1 --2- 172.21.15.6:0/2933386768 >> v2:172.21.15.40:3300/0 conn(0x7fcd4415c670 0x7fcd4406bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.368+0000 7fcd4359e700 1 --2- 172.21.15.6:0/2933386768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd440cd780 0x7fcd441601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.368+0000 7fcd4259c700 1 -- 172.21.15.6:0/2933386768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd440cd780 msgr2=0x7fcd441601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.368+0000 7fcd4259c700 1 --2- 172.21.15.6:0/2933386768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd440cd780 0x7fcd441601f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.368+0000 7fcd4259c700 1 -- 172.21.15.6:0/2933386768 >> v2:172.21.15.40:3300/0 conn(0x7fcd4415c670 msgr2=0x7fcd4406bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:22.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.368+0000 7fcd4259c700 1 --2- 172.21.15.6:0/2933386768 >> v2:172.21.15.40:3300/0 conn(0x7fcd4415c670 0x7fcd4406bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.368+0000 7fcd4259c700 1 -- 172.21.15.6:0/2933386768 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4406c950 con 0x7fcd4406c410 2023-07-07T04:01:22.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.368+0000 7fcd4359e700 1 --2- 172.21.15.6:0/2933386768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd440cd780 0x7fcd441601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T04:01:22.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.369+0000 7fcd4259c700 1 --2- 172.21.15.6:0/2933386768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd4406c410 0x7fcd440cd240 secure :-1 s=READY pgs=3379 cs=0 l=1 rev1=1 crypto rx=0x7fcd4406d7c0 tx=0x7fcd38009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31bafb2f8e96a08a server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:22.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.369+0000 7fcd41d9b700 1 -- 172.21.15.6:0/2933386768 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38011830 con 0x7fcd4406c410 2023-07-07T04:01:22.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.369+0000 7fcd41d9b700 1 -- 172.21.15.6:0/2933386768 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd38011990 con 0x7fcd4406c410 2023-07-07T04:01:22.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.369+0000 7fcd41d9b700 1 -- 172.21.15.6:0/2933386768 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38011d20 con 0x7fcd4406c410 2023-07-07T04:01:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.369+0000 7fcd49141700 1 -- 172.21.15.6:0/2933386768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd4406c410 msgr2=0x7fcd440cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.369+0000 7fcd49141700 1 --2- 172.21.15.6:0/2933386768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd4406c410 0x7fcd440cd240 secure :-1 s=READY pgs=3379 cs=0 l=1 rev1=1 crypto rx=0x7fcd4406d7c0 tx=0x7fcd38009bd0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.369+0000 7fcd49141700 1 -- 172.21.15.6:0/2933386768 shutdown_connections 2023-07-07T04:01:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.369+0000 7fcd49141700 1 --2- 172.21.15.6:0/2933386768 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd440cd780 0x7fcd441601f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.369+0000 7fcd49141700 1 --2- 172.21.15.6:0/2933386768 >> v2:172.21.15.40:3300/0 conn(0x7fcd4415c670 0x7fcd4406bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.369+0000 7fcd49141700 1 --2- 172.21.15.6:0/2933386768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd4406c410 0x7fcd440cd240 unknown :-1 s=CLOSED pgs=3379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.369+0000 7fcd49141700 1 -- 172.21.15.6:0/2933386768 >> 172.21.15.6:0/2933386768 conn(0x7fcd440d2bf0 msgr2=0x7fcd440d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:22.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.369+0000 7fcd49141700 1 -- 172.21.15.6:0/2933386768 shutdown_connections 2023-07-07T04:01:22.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.369+0000 7fcd49141700 1 -- 172.21.15.6:0/2933386768 wait complete. 2023-07-07T04:01:22.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.371+0000 7fcd49141700 1 Processor -- start 2023-07-07T04:01:22.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.371+0000 7fcd49141700 1 -- start start 2023-07-07T04:01:22.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.372+0000 7fcd49141700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd4406c410 0x7fcd44158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:22.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.372+0000 7fcd49141700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd440cd780 0x7fcd44156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:22.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.372+0000 7fcd49141700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd4415c670 0x7fcd441f2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:22.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.372+0000 7fcd49141700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd440cc160 con 0x7fcd440cd780 2023-07-07T04:01:22.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.372+0000 7fcd49141700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd440cb550 con 0x7fcd4406c410 2023-07-07T04:01:22.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.372+0000 7fcd49141700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd440cb830 con 0x7fcd4415c670 2023-07-07T04:01:22.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.372+0000 7fcd4259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd440cd780 0x7fcd44156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.372+0000 7fcd4259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd440cd780 0x7fcd44156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48376/0 (socket says 172.21.15.6:48376) 2023-07-07T04:01:22.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.372+0000 7fcd4259c700 1 -- 172.21.15.6:0/1434626307 learned_addr learned my addr 172.21.15.6:0/1434626307 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:22.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.372+0000 7fcd4359e700 1 --2- 172.21.15.6:0/1434626307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd4415c670 0x7fcd441f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.372+0000 7fcd42d9d700 1 --2- 172.21.15.6:0/1434626307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd4406c410 0x7fcd44158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.372+0000 7fcd4259c700 1 -- 172.21.15.6:0/1434626307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd4415c670 msgr2=0x7fcd441f2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:22.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.372+0000 7fcd4259c700 1 --2- 172.21.15.6:0/1434626307 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fcd4415c670 0x7fcd441f2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.372+0000 7fcd4259c700 1 -- 172.21.15.6:0/1434626307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd4406c410 msgr2=0x7fcd44158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:22.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.372+0000 7fcd4259c700 1 --2- 172.21.15.6:0/1434626307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd4406c410 0x7fcd44158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.372+0000 7fcd4259c700 1 -- 172.21.15.6:0/1434626307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd38009550 con 0x7fcd440cd780 2023-07-07T04:01:22.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.372+0000 7fcd42d9d700 1 --2- 172.21.15.6:0/1434626307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcd4406c410 0x7fcd44158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T04:01:22.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.373+0000 7fcd4259c700 1 --2- 172.21.15.6:0/1434626307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd440cd780 0x7fcd44156370 secure :-1 s=READY pgs=3380 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009c10 tx=0x7fcd38004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:22.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.373+0000 7fcd2b7fe700 1 -- 172.21.15.6:0/1434626307 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38004510 con 0x7fcd440cd780 2023-07-07T04:01:22.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.373+0000 7fcd2b7fe700 1 -- 172.21.15.6:0/1434626307 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3801e070 con 0x7fcd440cd780 2023-07-07T04:01:22.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.373+0000 7fcd49141700 1 -- 172.21.15.6:0/1434626307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd440cbb10 con 0x7fcd440cd780 2023-07-07T04:01:22.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.373+0000 7fcd2b7fe700 1 -- 172.21.15.6:0/1434626307 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd380038e0 con 0x7fcd440cd780 2023-07-07T04:01:22.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.373+0000 7fcd49141700 1 -- 172.21.15.6:0/1434626307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd440c9a60 con 0x7fcd440cd780 2023-07-07T04:01:22.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.374+0000 7fcd49141700 1 -- 172.21.15.6:0/1434626307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcd4406a3e0 con 0x7fcd440cd780 2023-07-07T04:01:22.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.374+0000 7fcd2b7fe700 1 -- 172.21.15.6:0/1434626307 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcd38003a40 con 0x7fcd440cd780 2023-07-07T04:01:22.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.375+0000 7fcd2b7fe700 1 --2- 172.21.15.6:0/1434626307 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcd3006ace0 0x7fcd3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:22.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.375+0000 7fcd2b7fe700 1 -- 172.21.15.6:0/1434626307 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fcd3808a130 con 0x7fcd440cd780 2023-07-07T04:01:22.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.375+0000 7fcd42d9d700 1 --2- 172.21.15.6:0/1434626307 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcd3006ace0 0x7fcd3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.375+0000 7fcd2b7fe700 1 --2- 172.21.15.6:0/1434626307 >> [v2:172.21.15.40:6800/2298149583,v1:172.21.15.40:6801/2298149583] conn(0x7fcd30071580 0x7fcd300739d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:22.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.375+0000 7fcd2b7fe700 1 -- 172.21.15.6:0/1434626307 --> [v2:172.21.15.40:6800/2298149583,v1:172.21.15.40:6801/2298149583] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcd300740a0 con 0x7fcd30071580 2023-07-07T04:01:22.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.375+0000 7fcd2b7fe700 1 -- 172.21.15.6:0/1434626307 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd3808c7d0 con 0x7fcd440cd780 2023-07-07T04:01:22.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.375+0000 7fcd4359e700 1 --2- 172.21.15.6:0/1434626307 >> [v2:172.21.15.40:6800/2298149583,v1:172.21.15.40:6801/2298149583] conn(0x7fcd30071580 0x7fcd300739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.375+0000 7fcd42d9d700 1 --2- 172.21.15.6:0/1434626307 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcd3006ace0 0x7fcd3006d190 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009c30 tx=0x7fcd34008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:22.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.376+0000 7fcd4359e700 1 --2- 172.21.15.6:0/1434626307 >> [v2:172.21.15.40:6800/2298149583,v1:172.21.15.40:6801/2298149583] conn(0x7fcd30071580 0x7fcd300739d0 crc :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:22.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.377+0000 7fcd2b7fe700 1 -- 172.21.15.6:0/1434626307 <== osd.4 v2:172.21.15.40:6800/2298149583 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fcd300740a0 con 0x7fcd30071580 2023-07-07T04:01:22.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.392+0000 7fcd49141700 1 -- 172.21.15.6:0/1434626307 --> [v2:172.21.15.40:6800/2298149583,v1:172.21.15.40:6801/2298149583] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcd4406a100 con 0x7fcd30071580 2023-07-07T04:01:22.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.392+0000 7fcd2b7fe700 1 -- 172.21.15.6:0/1434626307 <== osd.4 v2:172.21.15.40:6800/2298149583 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fcd3c00f040 con 0x7fcd30071580 2023-07-07T04:01:22.394 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-07T04:01:22.394 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-07T04:01:22.394 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-07T04:01:22.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.393+0000 7fcd49141700 1 -- 172.21.15.6:0/1434626307 >> [v2:172.21.15.40:6800/2298149583,v1:172.21.15.40:6801/2298149583] conn(0x7fcd30071580 msgr2=0x7fcd300739d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:22.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.393+0000 7fcd49141700 1 --2- 172.21.15.6:0/1434626307 >> [v2:172.21.15.40:6800/2298149583,v1:172.21.15.40:6801/2298149583] conn(0x7fcd30071580 0x7fcd300739d0 crc :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.393+0000 7fcd49141700 1 -- 172.21.15.6:0/1434626307 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcd3006ace0 msgr2=0x7fcd3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:22.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.393+0000 7fcd49141700 1 --2- 172.21.15.6:0/1434626307 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fcd3006ace0 0x7fcd3006d190 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fcd34009c30 tx=0x7fcd34008040 comp rx=0 tx=0).stop 2023-07-07T04:01:22.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.393+0000 7fcd49141700 1 -- 172.21.15.6:0/1434626307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd440cd780 msgr2=0x7fcd44156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:22.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.393+0000 7fcd49141700 1 --2- 172.21.15.6:0/1434626307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd440cd780 0x7fcd44156370 secure :-1 s=READY pgs=3380 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009c10 tx=0x7fcd38004750 comp rx=0 tx=0).stop 2023-07-07T04:01:22.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.393+0000 7fcd4359e700 1 -- 172.21.15.6:0/1434626307 reap_dead start 2023-07-07T04:01:22.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.393+0000 7fcd49141700 1 -- 172.21.15.6:0/1434626307 shutdown_connections 2023-07-07T04:01:22.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.393+0000 7fcd49141700 1 -- 172.21.15.6:0/1434626307 >> 172.21.15.6:0/1434626307 conn(0x7fcd440d2bf0 msgr2=0x7fcd44160380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:22.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.393+0000 7fcd49141700 1 -- 172.21.15.6:0/1434626307 shutdown_connections 2023-07-07T04:01:22.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.393+0000 7fcd49141700 1 -- 172.21.15.6:0/1434626307 wait complete. 2023-07-07T04:01:22.407 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-07-07T04:01:22.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.543+0000 7f18968f0700 1 Processor -- start 2023-07-07T04:01:22.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.543+0000 7f18968f0700 1 -- start start 2023-07-07T04:01:22.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.543+0000 7f18968f0700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f18901602c0 0x7f18900b5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:22.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.543+0000 7f18968f0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18900b3c60 0x7f18900cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:22.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.543+0000 7f18968f0700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18900b5e30 con 0x7f18900b58b0 2023-07-07T04:01:22.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.543+0000 7f18968f0700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18900b6110 con 0x7f18900b3c60 2023-07-07T04:01:22.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.543+0000 7f18968f0700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18900b63f0 con 0x7f18901602c0 2023-07-07T04:01:22.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.544+0000 7f188f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18900b3c60 0x7f18900cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.544+0000 7f188f7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f18900b3c60 0x7f18900cebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48388/0 (socket says 172.21.15.6:48388) 2023-07-07T04:01:22.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.544+0000 7f188f7fe700 1 -- 172.21.15.6:0/3906040098 learned_addr learned my addr 172.21.15.6:0/3906040098 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:22.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.544+0000 7f188ffff700 1 --2- 172.21.15.6:0/3906040098 >> v2:172.21.15.40:3300/0 conn(0x7f18901602c0 0x7f18900b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.544+0000 7f188f7fe700 1 -- 172.21.15.6:0/3906040098 >> v2:172.21.15.40:3300/0 conn(0x7f18901602c0 msgr2=0x7f18900b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:22.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.544+0000 7f188f7fe700 1 --2- 172.21.15.6:0/3906040098 >> v2:172.21.15.40:3300/0 conn(0x7f18901602c0 0x7f18900b5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.544+0000 7f188f7fe700 1 -- 172.21.15.6:0/3906040098 >> v1:172.21.15.40:6789/0 conn(0x7f18900b58b0 legacy=0x7f18900cf120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:22.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.544+0000 7f188f7fe700 1 -- 172.21.15.6:0/3906040098 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18900b66d0 con 0x7f18900b3c60 2023-07-07T04:01:22.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.544+0000 7f188ffff700 1 --2- 172.21.15.6:0/3906040098 >> v2:172.21.15.40:3300/0 conn(0x7f18901602c0 0x7f18900b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T04:01:22.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.544+0000 7f188f7fe700 1 --2- 172.21.15.6:0/3906040098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18900b3c60 0x7f18900cebe0 secure :-1 s=READY pgs=3381 cs=0 l=1 rev1=1 crypto rx=0x7f18900b35a0 tx=0x7f1884009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c6223976cb05dd server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:22.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.544+0000 7f188effd700 1 -- 172.21.15.6:0/3906040098 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188400b870 con 0x7f18900b3c60 2023-07-07T04:01:22.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.544+0000 7f188effd700 1 -- 172.21.15.6:0/3906040098 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188400b9d0 con 0x7f18900b3c60 2023-07-07T04:01:22.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.544+0000 7f188effd700 1 -- 172.21.15.6:0/3906040098 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188400bd60 con 0x7f18900b3c60 2023-07-07T04:01:22.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.545+0000 7f18968f0700 1 -- 172.21.15.6:0/3906040098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18900b3c60 msgr2=0x7f18900cebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:22.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.545+0000 7f18968f0700 1 --2- 172.21.15.6:0/3906040098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18900b3c60 0x7f18900cebe0 secure :-1 s=READY pgs=3381 cs=0 l=1 rev1=1 crypto rx=0x7f18900b35a0 tx=0x7f1884009bd0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.545+0000 7f18968f0700 1 -- 172.21.15.6:0/3906040098 shutdown_connections 2023-07-07T04:01:22.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.545+0000 7f18968f0700 1 --2- 172.21.15.6:0/3906040098 >> v2:172.21.15.40:3300/0 conn(0x7f18901602c0 0x7f18900b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.545+0000 7f18968f0700 1 --2- 172.21.15.6:0/3906040098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18900b3c60 0x7f18900cebe0 unknown :-1 s=CLOSED pgs=3381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.545+0000 7f18968f0700 1 -- 172.21.15.6:0/3906040098 >> 172.21.15.6:0/3906040098 conn(0x7f18900ce120 msgr2=0x7f18900d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:22.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.545+0000 7f18968f0700 1 -- 172.21.15.6:0/3906040098 shutdown_connections 2023-07-07T04:01:22.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.545+0000 7f18968f0700 1 -- 172.21.15.6:0/3906040098 wait complete. 2023-07-07T04:01:22.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.546+0000 7f18968f0700 1 Processor -- start 2023-07-07T04:01:22.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.547+0000 7f18968f0700 1 -- start start 2023-07-07T04:01:22.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.547+0000 7f18968f0700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18900b3c60 0x7f1890157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:22.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.547+0000 7f18968f0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18900b58b0 0x7f18900b1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:22.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.547+0000 7f18968f0700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18901602c0 0x7f1890150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:22.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.547+0000 7f18968f0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18900b1ca0 con 0x7f18900b58b0 2023-07-07T04:01:22.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.547+0000 7f18968f0700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18900c4740 con 0x7f18900b3c60 2023-07-07T04:01:22.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.547+0000 7f18968f0700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18901506b0 con 0x7f18901602c0 2023-07-07T04:01:22.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.547+0000 7f188f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18900b58b0 0x7f18900b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.547+0000 7f188f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18900b58b0 0x7f18900b1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48392/0 (socket says 172.21.15.6:48392) 2023-07-07T04:01:22.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.547+0000 7f188f7fe700 1 -- 172.21.15.6:0/3722851616 learned_addr learned my addr 172.21.15.6:0/3722851616 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:22.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.548+0000 7f188ffff700 1 --2- 172.21.15.6:0/3722851616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18900b3c60 0x7f1890157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.548+0000 7f1894e8d700 1 --2- 172.21.15.6:0/3722851616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18901602c0 0x7f1890150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.548+0000 7f188f7fe700 1 -- 172.21.15.6:0/3722851616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18901602c0 msgr2=0x7f1890150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.548+0000 7f188f7fe700 1 --2- 172.21.15.6:0/3722851616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18901602c0 0x7f1890150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.548+0000 7f188f7fe700 1 -- 172.21.15.6:0/3722851616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18900b3c60 msgr2=0x7f1890157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.548+0000 7f188f7fe700 1 --2- 172.21.15.6:0/3722851616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18900b3c60 0x7f1890157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.548+0000 7f188f7fe700 1 -- 172.21.15.6:0/3722851616 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1884009550 con 0x7f18900b58b0 2023-07-07T04:01:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.548+0000 7f188f7fe700 1 --2- 172.21.15.6:0/3722851616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18900b58b0 0x7f18900b1760 secure :-1 s=READY pgs=3382 cs=0 l=1 rev1=1 crypto rx=0x7f1890066bd0 tx=0x7f1884004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:22.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.548+0000 7f188cff9700 1 -- 172.21.15.6:0/3722851616 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1884004540 con 0x7f18900b58b0 2023-07-07T04:01:22.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.548+0000 7f188cff9700 1 -- 172.21.15.6:0/3722851616 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18840036a0 con 0x7f18900b58b0 2023-07-07T04:01:22.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.548+0000 7f18968f0700 1 -- 172.21.15.6:0/3722851616 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18900b1e90 con 0x7f18900b58b0 2023-07-07T04:01:22.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.548+0000 7f188cff9700 1 -- 172.21.15.6:0/3722851616 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1884003a30 con 0x7f18900b58b0 2023-07-07T04:01:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.548+0000 7f18968f0700 1 -- 172.21.15.6:0/3722851616 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18900b2450 con 0x7f18900b58b0 2023-07-07T04:01:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.549+0000 7f18968f0700 1 -- 172.21.15.6:0/3722851616 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f189004eb90 con 0x7f18900b58b0 2023-07-07T04:01:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.550+0000 7f188cff9700 1 -- 172.21.15.6:0/3722851616 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1884021070 con 0x7f18900b58b0 2023-07-07T04:01:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.550+0000 7f188cff9700 1 --2- 172.21.15.6:0/3722851616 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f187c06ace0 0x7f187c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.550+0000 7f188cff9700 1 -- 172.21.15.6:0/3722851616 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f188408aa20 con 0x7f18900b58b0 2023-07-07T04:01:22.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.550+0000 7f188ffff700 1 --2- 172.21.15.6:0/3722851616 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f187c06ace0 0x7f187c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.551+0000 7f188ffff700 1 --2- 172.21.15.6:0/3722851616 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f187c06ace0 0x7f187c06d190 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f188000c900 tx=0x7f1880008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:22.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.555+0000 7f188cff9700 1 -- 172.21.15.6:0/3722851616 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1884055d20 con 0x7f18900b58b0 2023-07-07T04:01:22.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.767+0000 7f18968f0700 1 -- 172.21.15.6:0/3722851616 --> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f18900ce6c0 con 0x7f187c06ace0 2023-07-07T04:01:22.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.768+0000 7f188cff9700 1 -- 172.21.15.6:0/3722851616 <== mgr.4110 v2:172.21.15.6:6832/201543369 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f188000cdd0 con 0x7f187c06ace0 2023-07-07T04:01:22.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.770+0000 7f18968f0700 1 -- 172.21.15.6:0/3722851616 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f187c06ace0 msgr2=0x7f187c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:22.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.770+0000 7f18968f0700 1 --2- 172.21.15.6:0/3722851616 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f187c06ace0 0x7f187c06d190 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f188000c900 tx=0x7f1880008040 comp rx=0 tx=0).stop 2023-07-07T04:01:22.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.770+0000 7f18968f0700 1 -- 172.21.15.6:0/3722851616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18900b58b0 msgr2=0x7f18900b1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:22.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.770+0000 7f18968f0700 1 --2- 172.21.15.6:0/3722851616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18900b58b0 0x7f18900b1760 secure :-1 s=READY pgs=3382 cs=0 l=1 rev1=1 crypto rx=0x7f1890066bd0 tx=0x7f1884004750 comp rx=0 tx=0).stop 2023-07-07T04:01:22.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.770+0000 7f18968f0700 1 -- 172.21.15.6:0/3722851616 shutdown_connections 2023-07-07T04:01:22.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.770+0000 7f18968f0700 1 --2- 172.21.15.6:0/3722851616 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f187c06ace0 0x7f187c06d190 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.770+0000 7f18968f0700 1 --2- 172.21.15.6:0/3722851616 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f18901602c0 0x7f1890150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.770+0000 7f18968f0700 1 --2- 172.21.15.6:0/3722851616 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18900b3c60 0x7f1890157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.770+0000 7f18968f0700 1 --2- 172.21.15.6:0/3722851616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18900b58b0 0x7f18900b1760 unknown :-1 s=CLOSED pgs=3382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.770+0000 7f18968f0700 1 -- 172.21.15.6:0/3722851616 >> 172.21.15.6:0/3722851616 conn(0x7f18900ce120 msgr2=0x7f18900cf370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:22.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.770+0000 7f18968f0700 1 -- 172.21.15.6:0/3722851616 shutdown_connections 2023-07-07T04:01:22.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.770+0000 7f18968f0700 1 -- 172.21.15.6:0/3722851616 wait complete. 2023-07-07T04:01:22.774 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 4 to deep-scrub 2023-07-07T04:01:22.785 INFO:tasks.ceph:Scrubbing osd.5 2023-07-07T04:01:22.786 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-07-07T04:01:22.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.924+0000 7fe9e86cb700 1 Processor -- start 2023-07-07T04:01:22.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.924+0000 7fe9e86cb700 1 -- start start 2023-07-07T04:01:22.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.925+0000 7fe9e86cb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9e015c670 0x7fe9e006bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:22.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.925+0000 7fe9e86cb700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe9e006c410 0x7fe9e00cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:22.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.925+0000 7fe9e86cb700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe9e00cd780 0x7fe9e01601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:22.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.925+0000 7fe9e86cb700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e00cdbe0 con 0x7fe9e00cd780 2023-07-07T04:01:22.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.925+0000 7fe9e86cb700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9e006aa30 con 0x7fe9e006c410 2023-07-07T04:01:22.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.925+0000 7fe9e86cb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e015ca40 con 0x7fe9e015c670 2023-07-07T04:01:22.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.925+0000 7fe9e6c68700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe9e00cd780 0x7fe9e01601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.925+0000 7fe9e6c68700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe9e00cd780 0x7fe9e01601f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48400/0 (socket says 172.21.15.6:48400) 2023-07-07T04:01:22.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.925+0000 7fe9e6c68700 1 -- 172.21.15.6:0/3844469185 learned_addr learned my addr 172.21.15.6:0/3844469185 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:22.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.926+0000 7fe9e5c66700 1 --2- 172.21.15.6:0/3844469185 >> v2:172.21.15.40:3300/0 conn(0x7fe9e006c410 0x7fe9e00cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.926+0000 7fe9e6467700 1 --2- 172.21.15.6:0/3844469185 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9e015c670 0x7fe9e006bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.926+0000 7fe9e6c68700 1 -- 172.21.15.6:0/3844469185 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9e015c670 msgr2=0x7fe9e006bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:22.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.926+0000 7fe9e6c68700 1 --2- 172.21.15.6:0/3844469185 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9e015c670 0x7fe9e006bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.926+0000 7fe9e6c68700 1 -- 172.21.15.6:0/3844469185 >> v2:172.21.15.40:3300/0 conn(0x7fe9e006c410 msgr2=0x7fe9e00cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:22.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.926+0000 7fe9e6c68700 1 --2- 172.21.15.6:0/3844469185 >> v2:172.21.15.40:3300/0 conn(0x7fe9e006c410 0x7fe9e00cd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.926+0000 7fe9e6c68700 1 -- 172.21.15.6:0/3844469185 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e006c950 con 0x7fe9e00cd780 2023-07-07T04:01:22.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.926+0000 7fe9e5c66700 1 --2- 172.21.15.6:0/3844469185 >> v2:172.21.15.40:3300/0 conn(0x7fe9e006c410 0x7fe9e00cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T04:01:22.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.926+0000 7fe9e6467700 1 --2- 172.21.15.6:0/3844469185 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9e015c670 0x7fe9e006bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-07T04:01:22.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.926+0000 7fe9e6c68700 1 --2- 172.21.15.6:0/3844469185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9e00cd780 0x7fe9e01601f0 secure :-1 s=READY pgs=3383 cs=0 l=1 rev1=1 crypto rx=0x7fe9e006d6d0 tx=0x7fe9d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533426dabcf6a840 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:22.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.926+0000 7fe9e5465700 1 -- 172.21.15.6:0/3844469185 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d800e070 con 0x7fe9e00cd780 2023-07-07T04:01:22.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.926+0000 7fe9e5465700 1 -- 172.21.15.6:0/3844469185 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d800b9c0 con 0x7fe9e00cd780 2023-07-07T04:01:22.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.926+0000 7fe9e5465700 1 -- 172.21.15.6:0/3844469185 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d800bd70 con 0x7fe9e00cd780 2023-07-07T04:01:22.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.927+0000 7fe9e86cb700 1 -- 172.21.15.6:0/3844469185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9e00cd780 msgr2=0x7fe9e01601f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:22.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.927+0000 7fe9e86cb700 1 --2- 172.21.15.6:0/3844469185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9e00cd780 0x7fe9e01601f0 secure :-1 s=READY pgs=3383 cs=0 l=1 rev1=1 crypto rx=0x7fe9e006d6d0 tx=0x7fe9d800b330 comp rx=0 tx=0).stop 2023-07-07T04:01:22.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.927+0000 7fe9e86cb700 1 -- 172.21.15.6:0/3844469185 shutdown_connections 2023-07-07T04:01:22.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.927+0000 7fe9e86cb700 1 --2- 172.21.15.6:0/3844469185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9e00cd780 0x7fe9e01601f0 unknown :-1 s=CLOSED pgs=3383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.927+0000 7fe9e86cb700 1 --2- 172.21.15.6:0/3844469185 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9e015c670 0x7fe9e006bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.927+0000 7fe9e86cb700 1 --2- 172.21.15.6:0/3844469185 >> v2:172.21.15.40:3300/0 conn(0x7fe9e006c410 0x7fe9e00cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.927+0000 7fe9e86cb700 1 -- 172.21.15.6:0/3844469185 >> 172.21.15.6:0/3844469185 conn(0x7fe9e00d2bf0 msgr2=0x7fe9e00d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:22.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.927+0000 7fe9e86cb700 1 -- 172.21.15.6:0/3844469185 shutdown_connections 2023-07-07T04:01:22.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.927+0000 7fe9e86cb700 1 -- 172.21.15.6:0/3844469185 wait complete. 2023-07-07T04:01:22.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.928+0000 7fe9e86cb700 1 Processor -- start 2023-07-07T04:01:22.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.928+0000 7fe9e86cb700 1 -- start start 2023-07-07T04:01:22.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.929+0000 7fe9e86cb700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9e006c410 0x7fe9e014cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:22.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.929+0000 7fe9e86cb700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9e00cd780 0x7fe9e00b7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:22.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.929+0000 7fe9e86cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9e015c670 0x7fe9e014f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:22.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.929+0000 7fe9e86cb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e01510c0 con 0x7fe9e015c670 2023-07-07T04:01:22.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.929+0000 7fe9e86cb700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e014e5b0 con 0x7fe9e006c410 2023-07-07T04:01:22.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.929+0000 7fe9e86cb700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e014e890 con 0x7fe9e00cd780 2023-07-07T04:01:22.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.929+0000 7fe9e6c68700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9e015c670 0x7fe9e014f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.929+0000 7fe9e6c68700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9e015c670 0x7fe9e014f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48410/0 (socket says 172.21.15.6:48410) 2023-07-07T04:01:22.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.929+0000 7fe9e6c68700 1 -- 172.21.15.6:0/334919885 learned_addr learned my addr 172.21.15.6:0/334919885 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:22.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.929+0000 7fe9e6467700 1 --2- 172.21.15.6:0/334919885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9e006c410 0x7fe9e014cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.929+0000 7fe9e5c66700 1 --2- 172.21.15.6:0/334919885 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9e00cd780 0x7fe9e00b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.929+0000 7fe9e6c68700 1 -- 172.21.15.6:0/334919885 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9e00cd780 msgr2=0x7fe9e00b7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:22.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.929+0000 7fe9e6c68700 1 --2- 172.21.15.6:0/334919885 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fe9e00cd780 0x7fe9e00b7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.929+0000 7fe9e6c68700 1 -- 172.21.15.6:0/334919885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9e006c410 msgr2=0x7fe9e014cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:22.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.929+0000 7fe9e6c68700 1 --2- 172.21.15.6:0/334919885 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe9e006c410 0x7fe9e014cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.929+0000 7fe9e6c68700 1 -- 172.21.15.6:0/334919885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d8009b30 con 0x7fe9e015c670 2023-07-07T04:01:22.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.930+0000 7fe9e6c68700 1 --2- 172.21.15.6:0/334919885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9e015c670 0x7fe9e014f650 secure :-1 s=READY pgs=3384 cs=0 l=1 rev1=1 crypto rx=0x7fe9e006d930 tx=0x7fe9d8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:22.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.930+0000 7fe9d6ffd700 1 -- 172.21.15.6:0/334919885 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80092e0 con 0x7fe9e015c670 2023-07-07T04:01:22.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.930+0000 7fe9d6ffd700 1 -- 172.21.15.6:0/334919885 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d8004250 con 0x7fe9e015c670 2023-07-07T04:01:22.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.930+0000 7fe9e86cb700 1 -- 172.21.15.6:0/334919885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e014eb70 con 0x7fe9e015c670 2023-07-07T04:01:22.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.930+0000 7fe9d6ffd700 1 -- 172.21.15.6:0/334919885 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8004620 con 0x7fe9e015c670 2023-07-07T04:01:22.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.930+0000 7fe9e86cb700 1 -- 172.21.15.6:0/334919885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e014f130 con 0x7fe9e015c670 2023-07-07T04:01:22.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.931+0000 7fe9e86cb700 1 -- 172.21.15.6:0/334919885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe9e006a3e0 con 0x7fe9e015c670 2023-07-07T04:01:22.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.931+0000 7fe9d6ffd700 1 -- 172.21.15.6:0/334919885 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe9d8004780 con 0x7fe9e015c670 2023-07-07T04:01:22.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.932+0000 7fe9d6ffd700 1 --2- 172.21.15.6:0/334919885 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe9c406ace0 0x7fe9c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:22.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.932+0000 7fe9d6ffd700 1 -- 172.21.15.6:0/334919885 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fe9d808a850 con 0x7fe9e015c670 2023-07-07T04:01:22.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.932+0000 7fe9e6467700 1 --2- 172.21.15.6:0/334919885 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe9c406ace0 0x7fe9c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.932+0000 7fe9d6ffd700 1 --2- 172.21.15.6:0/334919885 >> [v2:172.21.15.40:6808/23442053,v1:172.21.15.40:6809/23442053] conn(0x7fe9c4071580 0x7fe9c40739d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:22.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.932+0000 7fe9d6ffd700 1 -- 172.21.15.6:0/334919885 --> [v2:172.21.15.40:6808/23442053,v1:172.21.15.40:6809/23442053] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe9c40740a0 con 0x7fe9c4071580 2023-07-07T04:01:22.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.932+0000 7fe9d6ffd700 1 -- 172.21.15.6:0/334919885 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9d808ac80 con 0x7fe9e015c670 2023-07-07T04:01:22.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.932+0000 7fe9e5c66700 1 --2- 172.21.15.6:0/334919885 >> [v2:172.21.15.40:6808/23442053,v1:172.21.15.40:6809/23442053] conn(0x7fe9c4071580 0x7fe9c40739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:22.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.932+0000 7fe9e6467700 1 --2- 172.21.15.6:0/334919885 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe9c406ace0 0x7fe9c406d190 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0099d0 tx=0x7fe9dc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:22.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.933+0000 7fe9e5c66700 1 --2- 172.21.15.6:0/334919885 >> [v2:172.21.15.40:6808/23442053,v1:172.21.15.40:6809/23442053] conn(0x7fe9c4071580 0x7fe9c40739d0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:22.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.934+0000 7fe9d6ffd700 1 -- 172.21.15.6:0/334919885 <== osd.5 v2:172.21.15.40:6808/23442053 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe9c40740a0 con 0x7fe9c4071580 2023-07-07T04:01:22.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.949+0000 7fe9e86cb700 1 -- 172.21.15.6:0/334919885 --> [v2:172.21.15.40:6808/23442053,v1:172.21.15.40:6809/23442053] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe9e006a100 con 0x7fe9c4071580 2023-07-07T04:01:22.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.949+0000 7fe9d6ffd700 1 -- 172.21.15.6:0/334919885 <== osd.5 v2:172.21.15.40:6808/23442053 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe9d000baf0 con 0x7fe9c4071580 2023-07-07T04:01:22.950 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-07T04:01:22.951 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-07T04:01:22.951 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-07T04:01:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.950+0000 7fe9e86cb700 1 -- 172.21.15.6:0/334919885 >> [v2:172.21.15.40:6808/23442053,v1:172.21.15.40:6809/23442053] conn(0x7fe9c4071580 msgr2=0x7fe9c40739d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.950+0000 7fe9e86cb700 1 --2- 172.21.15.6:0/334919885 >> [v2:172.21.15.40:6808/23442053,v1:172.21.15.40:6809/23442053] conn(0x7fe9c4071580 0x7fe9c40739d0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.950+0000 7fe9e86cb700 1 -- 172.21.15.6:0/334919885 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe9c406ace0 msgr2=0x7fe9c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.950+0000 7fe9e86cb700 1 --2- 172.21.15.6:0/334919885 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fe9c406ace0 0x7fe9c406d190 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0099d0 tx=0x7fe9dc008040 comp rx=0 tx=0).stop 2023-07-07T04:01:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.950+0000 7fe9e86cb700 1 -- 172.21.15.6:0/334919885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9e015c670 msgr2=0x7fe9e014f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.950+0000 7fe9e86cb700 1 --2- 172.21.15.6:0/334919885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9e015c670 0x7fe9e014f650 secure :-1 s=READY pgs=3384 cs=0 l=1 rev1=1 crypto rx=0x7fe9e006d930 tx=0x7fe9d8004ad0 comp rx=0 tx=0).stop 2023-07-07T04:01:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.950+0000 7fe9e6c68700 1 -- 172.21.15.6:0/334919885 reap_dead start 2023-07-07T04:01:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.950+0000 7fe9e86cb700 1 -- 172.21.15.6:0/334919885 shutdown_connections 2023-07-07T04:01:22.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.950+0000 7fe9e86cb700 1 -- 172.21.15.6:0/334919885 >> 172.21.15.6:0/334919885 conn(0x7fe9e00d2bf0 msgr2=0x7fe9e00b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:22.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.950+0000 7fe9e86cb700 1 -- 172.21.15.6:0/334919885 shutdown_connections 2023-07-07T04:01:22.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:22.950+0000 7fe9e86cb700 1 -- 172.21.15.6:0/334919885 wait complete. 2023-07-07T04:01:22.964 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-07-07T04:01:23.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.099+0000 7fa234be1700 1 Processor -- start 2023-07-07T04:01:23.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.099+0000 7fa234be1700 1 -- start start 2023-07-07T04:01:23.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.100+0000 7fa234be1700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa2300b1f10 0x7fa2300cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:23.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.100+0000 7fa234be1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa230160e00 0x7fa23006bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:23.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.100+0000 7fa234be1700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23015d480 con 0x7fa23015d910 2023-07-07T04:01:23.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.100+0000 7fa234be1700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa23015cc60 con 0x7fa2300b1f10 2023-07-07T04:01:23.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.100+0000 7fa234be1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa23015ce70 con 0x7fa230160e00 2023-07-07T04:01:23.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.100+0000 7fa22ed9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fa23015d910 0x7fa23006a060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49624/0 (socket says 172.21.15.6:49624) 2023-07-07T04:01:23.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.100+0000 7fa22ed9d700 1 -- 172.21.15.6:0/639952690 learned_addr learned my addr 172.21.15.6:0/639952690 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:01:23.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.100+0000 7fa22dd9b700 1 --2- 172.21.15.6:0/639952690 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa230160e00 0x7fa23006bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:23.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.100+0000 7fa22e59c700 1 --2- 172.21.15.6:0/639952690 >> v2:172.21.15.40:3300/0 conn(0x7fa2300b1f10 0x7fa2300cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:23.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.100+0000 7fa22d59a700 1 -- 172.21.15.6:0/639952690 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4180305164 0 0) 0x7fa23015d480 con 0x7fa23015d910 2023-07-07T04:01:23.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.100+0000 7fa22d59a700 1 -- 172.21.15.6:0/639952690 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2180035b0 con 0x7fa23015d910 2023-07-07T04:01:23.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.101+0000 7fa22dd9b700 1 -- 172.21.15.6:0/639952690 >> v2:172.21.15.40:3300/0 conn(0x7fa2300b1f10 msgr2=0x7fa2300cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:23.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.101+0000 7fa22dd9b700 1 --2- 172.21.15.6:0/639952690 >> v2:172.21.15.40:3300/0 conn(0x7fa2300b1f10 0x7fa2300cd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:23.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.101+0000 7fa22dd9b700 1 -- 172.21.15.6:0/639952690 >> v1:172.21.15.6:6789/0 conn(0x7fa23015d910 legacy=0x7fa23006a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:23.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.101+0000 7fa22dd9b700 1 -- 172.21.15.6:0/639952690 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2300cddd0 con 0x7fa230160e00 2023-07-07T04:01:23.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.101+0000 7fa22dd9b700 1 --2- 172.21.15.6:0/639952690 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa230160e00 0x7fa23006bdb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa224009840 tx=0x7fa224009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffb53eaba979fa26 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:23.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.101+0000 7fa22d59a700 1 -- 172.21.15.6:0/639952690 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa224011830 con 0x7fa230160e00 2023-07-07T04:01:23.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.101+0000 7fa22d59a700 1 -- 172.21.15.6:0/639952690 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa224011990 con 0x7fa230160e00 2023-07-07T04:01:23.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.101+0000 7fa22d59a700 1 -- 172.21.15.6:0/639952690 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa224011d20 con 0x7fa230160e00 2023-07-07T04:01:23.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.102+0000 7fa234be1700 1 -- 172.21.15.6:0/639952690 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa230160e00 msgr2=0x7fa23006bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:23.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.102+0000 7fa234be1700 1 --2- 172.21.15.6:0/639952690 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa230160e00 0x7fa23006bdb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa224009840 tx=0x7fa224009b50 comp rx=0 tx=0).stop 2023-07-07T04:01:23.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.102+0000 7fa234be1700 1 -- 172.21.15.6:0/639952690 shutdown_connections 2023-07-07T04:01:23.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.102+0000 7fa234be1700 1 --2- 172.21.15.6:0/639952690 >> v2:172.21.15.40:3300/0 conn(0x7fa2300b1f10 0x7fa2300cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:23.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.102+0000 7fa234be1700 1 --2- 172.21.15.6:0/639952690 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa230160e00 0x7fa23006bdb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:23.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.102+0000 7fa234be1700 1 -- 172.21.15.6:0/639952690 >> 172.21.15.6:0/639952690 conn(0x7fa2300d2c70 msgr2=0x7fa2300d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:23.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.102+0000 7fa234be1700 1 -- 172.21.15.6:0/639952690 shutdown_connections 2023-07-07T04:01:23.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.102+0000 7fa234be1700 1 -- 172.21.15.6:0/639952690 wait complete. 2023-07-07T04:01:23.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.103+0000 7fa234be1700 1 Processor -- start 2023-07-07T04:01:23.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.103+0000 7fa234be1700 1 -- start start 2023-07-07T04:01:23.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.104+0000 7fa234be1700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2300b1f10 0x7fa2301f3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:23.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.104+0000 7fa234be1700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa23015d910 0x7fa2300c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:23.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.104+0000 7fa234be1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa230160e00 0x7fa2300ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:23.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.104+0000 7fa234be1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2301f35f0 con 0x7fa230160e00 2023-07-07T04:01:23.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.104+0000 7fa234be1700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2300c90b0 con 0x7fa2300b1f10 2023-07-07T04:01:23.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.104+0000 7fa234be1700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2300c9390 con 0x7fa23015d910 2023-07-07T04:01:23.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.104+0000 7fa22ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa230160e00 0x7fa2300ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:23.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.104+0000 7fa22ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa230160e00 0x7fa2300ca380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48426/0 (socket says 172.21.15.6:48426) 2023-07-07T04:01:23.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.104+0000 7fa22ed9d700 1 -- 172.21.15.6:0/2111827455 learned_addr learned my addr 172.21.15.6:0/2111827455 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:23.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.104+0000 7fa22dd9b700 1 --2- 172.21.15.6:0/2111827455 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa23015d910 0x7fa2300c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:23.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.104+0000 7fa22e59c700 1 --2- 172.21.15.6:0/2111827455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2300b1f10 0x7fa2301f3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:23.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.104+0000 7fa22ed9d700 1 -- 172.21.15.6:0/2111827455 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa23015d910 msgr2=0x7fa2300c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:23.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.104+0000 7fa22ed9d700 1 --2- 172.21.15.6:0/2111827455 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa23015d910 0x7fa2300c9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:23.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.105+0000 7fa22ed9d700 1 -- 172.21.15.6:0/2111827455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2300b1f10 msgr2=0x7fa2301f3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:23.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.105+0000 7fa22ed9d700 1 --2- 172.21.15.6:0/2111827455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2300b1f10 0x7fa2301f3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:23.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.105+0000 7fa22ed9d700 1 -- 172.21.15.6:0/2111827455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2240094a0 con 0x7fa230160e00 2023-07-07T04:01:23.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.105+0000 7fa22e59c700 1 --2- 172.21.15.6:0/2111827455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2300b1f10 0x7fa2301f3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-07T04:01:23.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.105+0000 7fa22ed9d700 1 --2- 172.21.15.6:0/2111827455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa230160e00 0x7fa2300ca380 secure :-1 s=READY pgs=3386 cs=0 l=1 rev1=1 crypto rx=0x7fa22800cb40 tx=0x7fa22800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:23.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.105+0000 7fa21effd700 1 -- 172.21.15.6:0/2111827455 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22800ab50 con 0x7fa230160e00 2023-07-07T04:01:23.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.105+0000 7fa21effd700 1 -- 172.21.15.6:0/2111827455 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22800acb0 con 0x7fa230160e00 2023-07-07T04:01:23.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.105+0000 7fa234be1700 1 -- 172.21.15.6:0/2111827455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2300c8db0 con 0x7fa230160e00 2023-07-07T04:01:23.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.105+0000 7fa21effd700 1 -- 172.21.15.6:0/2111827455 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228012620 con 0x7fa230160e00 2023-07-07T04:01:23.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.105+0000 7fa234be1700 1 -- 172.21.15.6:0/2111827455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2300c8400 con 0x7fa230160e00 2023-07-07T04:01:23.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.106+0000 7fa234be1700 1 -- 172.21.15.6:0/2111827455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa23004eb90 con 0x7fa230160e00 2023-07-07T04:01:23.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.106+0000 7fa21effd700 1 -- 172.21.15.6:0/2111827455 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa22801b3b0 con 0x7fa230160e00 2023-07-07T04:01:23.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.107+0000 7fa21effd700 1 --2- 172.21.15.6:0/2111827455 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa21006ace0 0x7fa21006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:23.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.107+0000 7fa21effd700 1 -- 172.21.15.6:0/2111827455 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fa228089190 con 0x7fa230160e00 2023-07-07T04:01:23.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.107+0000 7fa22e59c700 1 --2- 172.21.15.6:0/2111827455 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa21006ace0 0x7fa21006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:23.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.107+0000 7fa22e59c700 1 --2- 172.21.15.6:0/2111827455 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa21006ace0 0x7fa21006d190 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa230151300 tx=0x7fa220008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:23.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.111+0000 7fa21effd700 1 -- 172.21.15.6:0/2111827455 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa228054380 con 0x7fa230160e00 2023-07-07T04:01:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.318+0000 7fa234be1700 1 -- 172.21.15.6:0/2111827455 --> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fa23015d110 con 0x7fa21006ace0 2023-07-07T04:01:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.318+0000 7fa21effd700 1 -- 172.21.15.6:0/2111827455 <== mgr.4110 v2:172.21.15.6:6832/201543369 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa2200106e0 con 0x7fa21006ace0 2023-07-07T04:01:23.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.320+0000 7fa234be1700 1 -- 172.21.15.6:0/2111827455 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa21006ace0 msgr2=0x7fa21006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:23.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.320+0000 7fa234be1700 1 --2- 172.21.15.6:0/2111827455 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa21006ace0 0x7fa21006d190 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fa230151300 tx=0x7fa220008040 comp rx=0 tx=0).stop 2023-07-07T04:01:23.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.320+0000 7fa234be1700 1 -- 172.21.15.6:0/2111827455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa230160e00 msgr2=0x7fa2300ca380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:23.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.320+0000 7fa234be1700 1 --2- 172.21.15.6:0/2111827455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa230160e00 0x7fa2300ca380 secure :-1 s=READY pgs=3386 cs=0 l=1 rev1=1 crypto rx=0x7fa22800cb40 tx=0x7fa22800cf00 comp rx=0 tx=0).stop 2023-07-07T04:01:23.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.320+0000 7fa234be1700 1 -- 172.21.15.6:0/2111827455 shutdown_connections 2023-07-07T04:01:23.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.320+0000 7fa234be1700 1 --2- 172.21.15.6:0/2111827455 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fa21006ace0 0x7fa21006d190 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:23.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.320+0000 7fa234be1700 1 --2- 172.21.15.6:0/2111827455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa230160e00 0x7fa2300ca380 unknown :-1 s=CLOSED pgs=3386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:23.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.320+0000 7fa234be1700 1 --2- 172.21.15.6:0/2111827455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2300b1f10 0x7fa2301f3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:23.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.320+0000 7fa234be1700 1 --2- 172.21.15.6:0/2111827455 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fa23015d910 0x7fa2300c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:23.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.320+0000 7fa234be1700 1 -- 172.21.15.6:0/2111827455 >> 172.21.15.6:0/2111827455 conn(0x7fa2300d2c70 msgr2=0x7fa23015dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:23.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.320+0000 7fa234be1700 1 -- 172.21.15.6:0/2111827455 shutdown_connections 2023-07-07T04:01:23.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.321+0000 7fa234be1700 1 -- 172.21.15.6:0/2111827455 wait complete. 2023-07-07T04:01:23.324 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 5 to deep-scrub 2023-07-07T04:01:23.335 INFO:tasks.ceph:Scrubbing osd.6 2023-07-07T04:01:23.336 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-07-07T04:01:23.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.474+0000 7f526c99f700 1 Processor -- start 2023-07-07T04:01:23.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.474+0000 7f526c99f700 1 -- start start 2023-07-07T04:01:23.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.475+0000 7f526c99f700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f52680cd240 0x7f52680cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:23.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.475+0000 7f526c99f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52680d0b70 0x7f52680d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:23.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.475+0000 7f526c99f700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52680cdbd0 con 0x7f526815c670 2023-07-07T04:01:23.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.475+0000 7f526c99f700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526806aa30 con 0x7f52680cd240 2023-07-07T04:01:23.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.475+0000 7f526c99f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f526815ca40 con 0x7f52680d0b70 2023-07-07T04:01:23.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.476+0000 7f5265d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f52680cd240 0x7f52680cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:23.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.476+0000 7f5266d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52680d0b70 0x7f52680d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:23.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.476+0000 7f526659c700 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f526815c670 0x7f526806bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:39510/0 (socket says 172.21.15.6:39510) 2023-07-07T04:01:23.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.476+0000 7f5266d9d700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52680d0b70 0x7f52680d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:41078/0 (socket says 172.21.15.6:41078) 2023-07-07T04:01:23.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.476+0000 7f5265d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f52680cd240 0x7f52680cd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.6:55700/0 (socket says 172.21.15.6:55700) 2023-07-07T04:01:23.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.476+0000 7f526659c700 1 -- 172.21.15.6:0/1915025254 learned_addr learned my addr 172.21.15.6:0/1915025254 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:01:23.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.476+0000 7f5266d9d700 1 -- 172.21.15.6:0/1915025254 >> v2:172.21.15.40:3300/0 conn(0x7f52680cd240 msgr2=0x7f52680cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:23.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.476+0000 7f5266d9d700 1 --2- 172.21.15.6:0/1915025254 >> v2:172.21.15.40:3300/0 conn(0x7f52680cd240 0x7f52680cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:23.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.476+0000 7f5266d9d700 1 -- 172.21.15.6:0/1915025254 >> v1:172.21.15.40:6789/0 conn(0x7f526815c670 legacy=0x7f526806bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:23.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.476+0000 7f5266d9d700 1 -- 172.21.15.6:0/1915025254 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526806c950 con 0x7f52680d0b70 2023-07-07T04:01:23.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.476+0000 7f5265d9b700 1 --2- 172.21.15.6:0/1915025254 >> v2:172.21.15.40:3300/0 conn(0x7f52680cd240 0x7f52680cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T04:01:23.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.476+0000 7f5266d9d700 1 --2- 172.21.15.6:0/1915025254 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52680d0b70 0x7f52680d0fc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5260009d90 tx=0x7f526000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4152f8945758e19 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:23.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.476+0000 7f526559a700 1 -- 172.21.15.6:0/1915025254 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526000e070 con 0x7f52680d0b70 2023-07-07T04:01:23.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.476+0000 7f526559a700 1 -- 172.21.15.6:0/1915025254 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526000bb20 con 0x7f52680d0b70 2023-07-07T04:01:23.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.476+0000 7f526559a700 1 -- 172.21.15.6:0/1915025254 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260012430 con 0x7f52680d0b70 2023-07-07T04:01:23.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.477+0000 7f526c99f700 1 -- 172.21.15.6:0/1915025254 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52680d0b70 msgr2=0x7f52680d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:23.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.477+0000 7f526c99f700 1 --2- 172.21.15.6:0/1915025254 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52680d0b70 0x7f52680d0fc0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5260009d90 tx=0x7f526000b330 comp rx=0 tx=0).stop 2023-07-07T04:01:23.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.477+0000 7f526c99f700 1 -- 172.21.15.6:0/1915025254 shutdown_connections 2023-07-07T04:01:23.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.477+0000 7f526c99f700 1 --2- 172.21.15.6:0/1915025254 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52680d0b70 0x7f52680d0fc0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:23.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.477+0000 7f526c99f700 1 --2- 172.21.15.6:0/1915025254 >> v2:172.21.15.40:3300/0 conn(0x7f52680cd240 0x7f52680cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:23.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.477+0000 7f526c99f700 1 -- 172.21.15.6:0/1915025254 >> 172.21.15.6:0/1915025254 conn(0x7f52680d2bf0 msgr2=0x7f52680d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:23.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.477+0000 7f526c99f700 1 -- 172.21.15.6:0/1915025254 shutdown_connections 2023-07-07T04:01:23.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.477+0000 7f526c99f700 1 -- 172.21.15.6:0/1915025254 wait complete. 2023-07-07T04:01:23.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.478+0000 7f526c99f700 1 Processor -- start 2023-07-07T04:01:23.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.479+0000 7f526c99f700 1 -- start start 2023-07-07T04:01:23.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.479+0000 7f526c99f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52680cd240 0x7f5268153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:23.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.479+0000 7f526c99f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52680d0b70 0x7f52680b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:23.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.479+0000 7f526c99f700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f526815c670 0x7f52680b7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:23.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.479+0000 7f526c99f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5268153640 con 0x7f52680cd240 2023-07-07T04:01:23.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.479+0000 7f526c99f700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52680ccb50 con 0x7f526815c670 2023-07-07T04:01:23.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.479+0000 7f526c99f700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52680cce30 con 0x7f52680d0b70 2023-07-07T04:01:23.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.479+0000 7f526659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52680cd240 0x7f5268153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:23.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.479+0000 7f526659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52680cd240 0x7f5268153100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48436/0 (socket says 172.21.15.6:48436) 2023-07-07T04:01:23.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.480+0000 7f526659c700 1 -- 172.21.15.6:0/3182186014 learned_addr learned my addr 172.21.15.6:0/3182186014 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:23.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.480+0000 7f5265d9b700 1 --2- 172.21.15.6:0/3182186014 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52680d0b70 0x7f52680b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:23.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.480+0000 7f5266d9d700 1 --2- 172.21.15.6:0/3182186014 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f526815c670 0x7f52680b7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:23.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.480+0000 7f526659c700 1 -- 172.21.15.6:0/3182186014 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52680d0b70 msgr2=0x7f52680b7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:23.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.480+0000 7f526659c700 1 --2- 172.21.15.6:0/3182186014 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f52680d0b70 0x7f52680b7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:23.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.480+0000 7f526659c700 1 -- 172.21.15.6:0/3182186014 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f526815c670 msgr2=0x7f52680b7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:23.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.480+0000 7f526659c700 1 --2- 172.21.15.6:0/3182186014 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f526815c670 0x7f52680b7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:23.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.480+0000 7f526659c700 1 -- 172.21.15.6:0/3182186014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525c0094a0 con 0x7f52680cd240 2023-07-07T04:01:23.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.480+0000 7f526659c700 1 --2- 172.21.15.6:0/3182186014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52680cd240 0x7f5268153100 secure :-1 s=READY pgs=3387 cs=0 l=1 rev1=1 crypto rx=0x7f525800c480 tx=0x7f525800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:23.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.480+0000 7f5256ffd700 1 -- 172.21.15.6:0/3182186014 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5258005d70 con 0x7f52680cd240 2023-07-07T04:01:23.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.480+0000 7f5256ffd700 1 -- 172.21.15.6:0/3182186014 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52580070d0 con 0x7f52680cd240 2023-07-07T04:01:23.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.480+0000 7f526c99f700 1 -- 172.21.15.6:0/3182186014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5260009a70 con 0x7f52680cd240 2023-07-07T04:01:23.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.480+0000 7f5256ffd700 1 -- 172.21.15.6:0/3182186014 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5258007440 con 0x7f52680cd240 2023-07-07T04:01:23.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.480+0000 7f526c99f700 1 -- 172.21.15.6:0/3182186014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52681e86e0 con 0x7f52680cd240 2023-07-07T04:01:23.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.481+0000 7f526c99f700 1 -- 172.21.15.6:0/3182186014 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f526806a3e0 con 0x7f52680cd240 2023-07-07T04:01:23.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.482+0000 7f5256ffd700 1 -- 172.21.15.6:0/3182186014 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f52580075a0 con 0x7f52680cd240 2023-07-07T04:01:23.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.482+0000 7f5256ffd700 1 --2- 172.21.15.6:0/3182186014 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f524806ace0 0x7f524806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:23.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.482+0000 7f5256ffd700 1 -- 172.21.15.6:0/3182186014 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f52580884d0 con 0x7f52680cd240 2023-07-07T04:01:23.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.482+0000 7f5265d9b700 1 --2- 172.21.15.6:0/3182186014 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f524806ace0 0x7f524806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:23.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.482+0000 7f5256ffd700 1 --2- 172.21.15.6:0/3182186014 >> [v2:172.21.15.40:6816/4092969902,v1:172.21.15.40:6817/4092969902] conn(0x7f5248071580 0x7f52480739d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:23.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.482+0000 7f5256ffd700 1 -- 172.21.15.6:0/3182186014 --> [v2:172.21.15.40:6816/4092969902,v1:172.21.15.40:6817/4092969902] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f52480740a0 con 0x7f5248071580 2023-07-07T04:01:23.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.482+0000 7f5256ffd700 1 -- 172.21.15.6:0/3182186014 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f525808ab70 con 0x7f52680cd240 2023-07-07T04:01:23.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.483+0000 7f5266d9d700 1 --2- 172.21.15.6:0/3182186014 >> [v2:172.21.15.40:6816/4092969902,v1:172.21.15.40:6817/4092969902] conn(0x7f5248071580 0x7f52480739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:23.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.483+0000 7f5265d9b700 1 --2- 172.21.15.6:0/3182186014 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f524806ace0 0x7f524806d190 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f525c009d00 tx=0x7f525c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:23.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.483+0000 7f5266d9d700 1 --2- 172.21.15.6:0/3182186014 >> [v2:172.21.15.40:6816/4092969902,v1:172.21.15.40:6817/4092969902] conn(0x7f5248071580 0x7f52480739d0 crc :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:23.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.484+0000 7f5256ffd700 1 -- 172.21.15.6:0/3182186014 <== osd.6 v2:172.21.15.40:6816/4092969902 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f52480740a0 con 0x7f5248071580 2023-07-07T04:01:23.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.499+0000 7f526c99f700 1 -- 172.21.15.6:0/3182186014 --> [v2:172.21.15.40:6816/4092969902,v1:172.21.15.40:6817/4092969902] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f526806a100 con 0x7f5248071580 2023-07-07T04:01:23.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.500+0000 7f5256ffd700 1 -- 172.21.15.6:0/3182186014 <== osd.6 v2:172.21.15.40:6816/4092969902 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f5260003c20 con 0x7f5248071580 2023-07-07T04:01:23.501 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-07T04:01:23.501 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-07T04:01:23.502 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-07T04:01:23.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.500+0000 7f526c99f700 1 -- 172.21.15.6:0/3182186014 >> [v2:172.21.15.40:6816/4092969902,v1:172.21.15.40:6817/4092969902] conn(0x7f5248071580 msgr2=0x7f52480739d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:23.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.500+0000 7f526c99f700 1 --2- 172.21.15.6:0/3182186014 >> [v2:172.21.15.40:6816/4092969902,v1:172.21.15.40:6817/4092969902] conn(0x7f5248071580 0x7f52480739d0 crc :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:23.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.500+0000 7f526c99f700 1 -- 172.21.15.6:0/3182186014 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f524806ace0 msgr2=0x7f524806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:23.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.500+0000 7f526c99f700 1 --2- 172.21.15.6:0/3182186014 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f524806ace0 0x7f524806d190 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f525c009d00 tx=0x7f525c008040 comp rx=0 tx=0).stop 2023-07-07T04:01:23.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.500+0000 7f526c99f700 1 -- 172.21.15.6:0/3182186014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52680cd240 msgr2=0x7f5268153100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:23.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.500+0000 7f526c99f700 1 --2- 172.21.15.6:0/3182186014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52680cd240 0x7f5268153100 secure :-1 s=READY pgs=3387 cs=0 l=1 rev1=1 crypto rx=0x7f525800c480 tx=0x7f525800c840 comp rx=0 tx=0).stop 2023-07-07T04:01:23.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.500+0000 7f5266d9d700 1 -- 172.21.15.6:0/3182186014 reap_dead start 2023-07-07T04:01:23.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.500+0000 7f526c99f700 1 -- 172.21.15.6:0/3182186014 shutdown_connections 2023-07-07T04:01:23.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.500+0000 7f526c99f700 1 -- 172.21.15.6:0/3182186014 >> 172.21.15.6:0/3182186014 conn(0x7f52680d2bf0 msgr2=0x7f526815fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:23.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.500+0000 7f526c99f700 1 -- 172.21.15.6:0/3182186014 shutdown_connections 2023-07-07T04:01:23.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.500+0000 7f526c99f700 1 -- 172.21.15.6:0/3182186014 wait complete. 2023-07-07T04:01:23.515 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-07-07T04:01:23.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.650+0000 7f964bfed700 1 Processor -- start 2023-07-07T04:01:23.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.651+0000 7f964bfed700 1 -- start start 2023-07-07T04:01:23.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.651+0000 7f964bfed700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96440cfbf0 0x7f964415cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:23.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.652+0000 7f964bfed700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96440b5e30 con 0x7f96441602c0 2023-07-07T04:01:23.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.652+0000 7f964bfed700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96440b6110 con 0x7f96440b3c60 2023-07-07T04:01:23.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.652+0000 7f964bfed700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96440b63f0 con 0x7f96440cfbf0 2023-07-07T04:01:23.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.652+0000 7f9649d89700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f96441602c0 0x7f96440b5370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49654/0 (socket says 172.21.15.6:49654) 2023-07-07T04:01:23.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.652+0000 7f9649d89700 1 -- 172.21.15.6:0/3118898687 learned_addr learned my addr 172.21.15.6:0/3118898687 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:01:23.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.652+0000 7f964a58a700 1 --2- 172.21.15.6:0/3118898687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96440cfbf0 0x7f964415cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:23.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.652+0000 7f9648d87700 1 -- 172.21.15.6:0/3118898687 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194491319 0 0) 0x7f96440b5e30 con 0x7f96441602c0 2023-07-07T04:01:23.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.652+0000 7f9648d87700 1 -- 172.21.15.6:0/3118898687 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96300035b0 con 0x7f96441602c0 2023-07-07T04:01:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.652+0000 7f9648d87700 1 -- 172.21.15.6:0/3118898687 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 845416794 0 0) 0x7f96300035b0 con 0x7f96441602c0 2023-07-07T04:01:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.652+0000 7f9648d87700 1 -- 172.21.15.6:0/3118898687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96440cfbf0 msgr2=0x7f964415cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.652+0000 7f9648d87700 1 --2- 172.21.15.6:0/3118898687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96440cfbf0 0x7f964415cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:23.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.652+0000 7f9648d87700 1 -- 172.21.15.6:0/3118898687 >> v1:172.21.15.40:6789/0 conn(0x7f96440b3c60 legacy=0x7f964415c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:23.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.652+0000 7f9648d87700 1 -- 172.21.15.6:0/3118898687 --> v1:172.21.15.6:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96440b66d0 con 0x7f96441602c0 2023-07-07T04:01:23.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.652+0000 7f9648d87700 1 -- 172.21.15.6:0/3118898687 <== mon.0 v1:172.21.15.6:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2474607074 0 0) 0x7f9640001670 con 0x7f96441602c0 2023-07-07T04:01:23.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.652+0000 7f9648d87700 1 -- 172.21.15.6:0/3118898687 >> v1:172.21.15.6:6789/0 conn(0x7f96441602c0 legacy=0x7f96440b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:23.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.652+0000 7f9648d87700 1 --2- 172.21.15.6:0/3118898687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96440cfbf0 0x7f9630003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:23.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.652+0000 7f9648d87700 1 --2- 172.21.15.6:0/3118898687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9630003f70 0x7f9630004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:23.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.652+0000 7f9648d87700 1 --2- 172.21.15.6:0/3118898687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630004d90 0x7f9630005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:23.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.652+0000 7f9648d87700 1 -- 172.21.15.6:0/3118898687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96440b63f0 con 0x7f9630004d90 2023-07-07T04:01:23.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.652+0000 7f9648d87700 1 -- 172.21.15.6:0/3118898687 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963000ba40 con 0x7f9630003f70 2023-07-07T04:01:23.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.652+0000 7f9648d87700 1 -- 172.21.15.6:0/3118898687 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963000bc00 con 0x7f96440cfbf0 2023-07-07T04:01:23.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.653+0000 7f964a58a700 1 --2- 172.21.15.6:0/3118898687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630004d90 0x7f9630005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:23.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.653+0000 7f9649d89700 1 --2- 172.21.15.6:0/3118898687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96440cfbf0 0x7f9630003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:23.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.653+0000 7f9649588700 1 --2- 172.21.15.6:0/3118898687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9630003f70 0x7f9630004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:23.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.653+0000 7f964a58a700 1 -- 172.21.15.6:0/3118898687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96440cfbf0 msgr2=0x7f9630003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:23.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.653+0000 7f964a58a700 1 --2- 172.21.15.6:0/3118898687 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f96440cfbf0 0x7f9630003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:23.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.653+0000 7f964a58a700 1 -- 172.21.15.6:0/3118898687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9630003f70 msgr2=0x7f9630004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:23.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.653+0000 7f964a58a700 1 --2- 172.21.15.6:0/3118898687 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9630003f70 0x7f9630004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:23.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.653+0000 7f964a58a700 1 -- 172.21.15.6:0/3118898687 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96300035b0 con 0x7f9630004d90 2023-07-07T04:01:23.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.653+0000 7f964a58a700 1 --2- 172.21.15.6:0/3118898687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630004d90 0x7f9630005200 secure :-1 s=READY pgs=3389 cs=0 l=1 rev1=1 crypto rx=0x7f963c009fc0 tx=0x7f9630005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c9850adf572b5c server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:23.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.653+0000 7f9648d87700 1 -- 172.21.15.6:0/3118898687 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c00ec30 con 0x7f9630004d90 2023-07-07T04:01:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.653+0000 7f9648d87700 1 -- 172.21.15.6:0/3118898687 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963c00f040 con 0x7f9630004d90 2023-07-07T04:01:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.653+0000 7f9648d87700 1 -- 172.21.15.6:0/3118898687 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c014480 con 0x7f9630004d90 2023-07-07T04:01:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.654+0000 7f964bfed700 1 -- 172.21.15.6:0/3118898687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630004d90 msgr2=0x7f9630005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.654+0000 7f964bfed700 1 --2- 172.21.15.6:0/3118898687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630004d90 0x7f9630005200 secure :-1 s=READY pgs=3389 cs=0 l=1 rev1=1 crypto rx=0x7f963c009fc0 tx=0x7f9630005880 comp rx=0 tx=0).stop 2023-07-07T04:01:23.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.654+0000 7f964a58a700 1 -- 172.21.15.6:0/3118898687 reap_dead start 2023-07-07T04:01:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.654+0000 7f964bfed700 1 -- 172.21.15.6:0/3118898687 shutdown_connections 2023-07-07T04:01:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.654+0000 7f964bfed700 1 -- 172.21.15.6:0/3118898687 >> 172.21.15.6:0/3118898687 conn(0x7f96440ce120 msgr2=0x7f96440d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.654+0000 7f964bfed700 1 -- 172.21.15.6:0/3118898687 shutdown_connections 2023-07-07T04:01:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.654+0000 7f964bfed700 1 -- 172.21.15.6:0/3118898687 wait complete. 2023-07-07T04:01:23.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.655+0000 7f964bfed700 1 Processor -- start 2023-07-07T04:01:23.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.655+0000 7f964bfed700 1 -- start start 2023-07-07T04:01:23.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.656+0000 7f964bfed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630004d90 0x7f964414cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:23.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.656+0000 7f964bfed700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f964406e070 0x7f964406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:23.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.656+0000 7f964bfed700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f964406ba00 0x7f964406be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:23.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.656+0000 7f964bfed700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964406ea20 con 0x7f9630004d90 2023-07-07T04:01:23.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.656+0000 7f964bfed700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964414d250 con 0x7f964406ba00 2023-07-07T04:01:23.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.656+0000 7f964bfed700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964406c6f0 con 0x7f964406e070 2023-07-07T04:01:23.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.656+0000 7f9649d89700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630004d90 0x7f964414cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:23.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.656+0000 7f9649d89700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630004d90 0x7f964414cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48458/0 (socket says 172.21.15.6:48458) 2023-07-07T04:01:23.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.656+0000 7f9649d89700 1 -- 172.21.15.6:0/37549019 learned_addr learned my addr 172.21.15.6:0/37549019 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:23.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.656+0000 7f9649588700 1 --2- 172.21.15.6:0/37549019 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f964406e070 0x7f964406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:23.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.656+0000 7f964a58a700 1 --2- 172.21.15.6:0/37549019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f964406ba00 0x7f964406be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:23.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.656+0000 7f9649d89700 1 -- 172.21.15.6:0/37549019 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f964406e070 msgr2=0x7f964406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:23.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.656+0000 7f9649d89700 1 --2- 172.21.15.6:0/37549019 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f964406e070 0x7f964406e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:23.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.657+0000 7f9649d89700 1 -- 172.21.15.6:0/37549019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f964406ba00 msgr2=0x7f964406be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:23.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.657+0000 7f9649d89700 1 --2- 172.21.15.6:0/37549019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f964406ba00 0x7f964406be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:23.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.657+0000 7f9649d89700 1 -- 172.21.15.6:0/37549019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96440b5c00 con 0x7f9630004d90 2023-07-07T04:01:23.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.657+0000 7f9649d89700 1 --2- 172.21.15.6:0/37549019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630004d90 0x7f964414cd10 secure :-1 s=READY pgs=3390 cs=0 l=1 rev1=1 crypto rx=0x7f96400011e0 tx=0x7f9640007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:23.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.657+0000 7f963a7fc700 1 -- 172.21.15.6:0/37549019 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964000f5e0 con 0x7f9630004d90 2023-07-07T04:01:23.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.657+0000 7f963a7fc700 1 -- 172.21.15.6:0/37549019 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964000f760 con 0x7f9630004d90 2023-07-07T04:01:23.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.657+0000 7f964bfed700 1 -- 172.21.15.6:0/37549019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964406c9d0 con 0x7f9630004d90 2023-07-07T04:01:23.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.657+0000 7f963a7fc700 1 -- 172.21.15.6:0/37549019 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964000fb10 con 0x7f9630004d90 2023-07-07T04:01:23.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.657+0000 7f964bfed700 1 -- 172.21.15.6:0/37549019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f964406cf90 con 0x7f9630004d90 2023-07-07T04:01:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.658+0000 7f964bfed700 1 -- 172.21.15.6:0/37549019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f964404eb90 con 0x7f9630004d90 2023-07-07T04:01:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.658+0000 7f963a7fc700 1 -- 172.21.15.6:0/37549019 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f964000fc70 con 0x7f9630004d90 2023-07-07T04:01:23.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.659+0000 7f963a7fc700 1 --2- 172.21.15.6:0/37549019 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f962806ace0 0x7f962806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:23.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.659+0000 7f963a7fc700 1 -- 172.21.15.6:0/37549019 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f9640089270 con 0x7f9630004d90 2023-07-07T04:01:23.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.659+0000 7f9649588700 1 --2- 172.21.15.6:0/37549019 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f962806ace0 0x7f962806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:23.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.659+0000 7f9649588700 1 --2- 172.21.15.6:0/37549019 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f962806ace0 0x7f962806d190 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f964406fa10 tx=0x7f9634009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:23.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.663+0000 7f963a7fc700 1 -- 172.21.15.6:0/37549019 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9640054520 con 0x7f9630004d90 2023-07-07T04:01:23.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.891+0000 7f964bfed700 1 -- 172.21.15.6:0/37549019 --> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f96440ce6c0 con 0x7f962806ace0 2023-07-07T04:01:23.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.892+0000 7f963a7fc700 1 -- 172.21.15.6:0/37549019 <== mgr.4110 v2:172.21.15.6:6832/201543369 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9634006860 con 0x7f962806ace0 2023-07-07T04:01:23.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.894+0000 7f964bfed700 1 -- 172.21.15.6:0/37549019 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f962806ace0 msgr2=0x7f962806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:23.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.894+0000 7f964bfed700 1 --2- 172.21.15.6:0/37549019 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f962806ace0 0x7f962806d190 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f964406fa10 tx=0x7f9634009040 comp rx=0 tx=0).stop 2023-07-07T04:01:23.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.894+0000 7f964bfed700 1 -- 172.21.15.6:0/37549019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630004d90 msgr2=0x7f964414cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:23.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.894+0000 7f964bfed700 1 --2- 172.21.15.6:0/37549019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630004d90 0x7f964414cd10 secure :-1 s=READY pgs=3390 cs=0 l=1 rev1=1 crypto rx=0x7f96400011e0 tx=0x7f9640007570 comp rx=0 tx=0).stop 2023-07-07T04:01:23.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.894+0000 7f964bfed700 1 -- 172.21.15.6:0/37549019 shutdown_connections 2023-07-07T04:01:23.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.894+0000 7f964bfed700 1 --2- 172.21.15.6:0/37549019 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f962806ace0 0x7f962806d190 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:23.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.894+0000 7f964bfed700 1 --2- 172.21.15.6:0/37549019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9630004d90 0x7f964414cd10 unknown :-1 s=CLOSED pgs=3390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:23.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.894+0000 7f964bfed700 1 --2- 172.21.15.6:0/37549019 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f964406ba00 0x7f964406be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:23.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.894+0000 7f964bfed700 1 --2- 172.21.15.6:0/37549019 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f964406e070 0x7f964406e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:23.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.894+0000 7f964bfed700 1 -- 172.21.15.6:0/37549019 >> 172.21.15.6:0/37549019 conn(0x7f96440ce120 msgr2=0x7f9644158110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:23.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.894+0000 7f964bfed700 1 -- 172.21.15.6:0/37549019 shutdown_connections 2023-07-07T04:01:23.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:23.894+0000 7f964bfed700 1 -- 172.21.15.6:0/37549019 wait complete. 2023-07-07T04:01:23.898 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 6 to deep-scrub 2023-07-07T04:01:23.910 INFO:tasks.ceph:Scrubbing osd.7 2023-07-07T04:01:23.910 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-07-07T04:01:24.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.050+0000 7fb42d89e700 1 Processor -- start 2023-07-07T04:01:24.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.050+0000 7fb42d89e700 1 -- start start 2023-07-07T04:01:24.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.051+0000 7fb42d89e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb4280cd240 0x7fb4280cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:24.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.051+0000 7fb42d89e700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb4280d0b70 0x7fb4280d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:24.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.051+0000 7fb42d89e700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4280cdbd0 con 0x7fb42815c670 2023-07-07T04:01:24.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.051+0000 7fb42d89e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb42806aa30 con 0x7fb4280cd240 2023-07-07T04:01:24.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.051+0000 7fb42d89e700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb42815ca40 con 0x7fb4280d0b70 2023-07-07T04:01:24.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.051+0000 7fb4267fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb4280cd240 0x7fb4280cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:24.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.051+0000 7fb4267fc700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb4280cd240 0x7fb4280cd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48468/0 (socket says 172.21.15.6:48468) 2023-07-07T04:01:24.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.051+0000 7fb4267fc700 1 -- 172.21.15.6:0/879706301 learned_addr learned my addr 172.21.15.6:0/879706301 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:24.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.051+0000 7fb4277fe700 1 --2- 172.21.15.6:0/879706301 >> v2:172.21.15.40:3300/0 conn(0x7fb4280d0b70 0x7fb4280d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:24.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.051+0000 7fb4267fc700 1 -- 172.21.15.6:0/879706301 >> v2:172.21.15.40:3300/0 conn(0x7fb4280d0b70 msgr2=0x7fb4280d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:24.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.051+0000 7fb4267fc700 1 --2- 172.21.15.6:0/879706301 >> v2:172.21.15.40:3300/0 conn(0x7fb4280d0b70 0x7fb4280d0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.051+0000 7fb4267fc700 1 -- 172.21.15.6:0/879706301 >> v1:172.21.15.40:6789/0 conn(0x7fb42815c670 legacy=0x7fb42806bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:24.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.051+0000 7fb4267fc700 1 -- 172.21.15.6:0/879706301 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42806c950 con 0x7fb4280cd240 2023-07-07T04:01:24.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.051+0000 7fb4267fc700 1 --2- 172.21.15.6:0/879706301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4280cd240 0x7fb4280cd690 secure :-1 s=READY pgs=3391 cs=0 l=1 rev1=1 crypto rx=0x7fb42806a9a0 tx=0x7fb41c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d5146b5b0e0044 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:24.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.052+0000 7fb425ffb700 1 -- 172.21.15.6:0/879706301 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c011830 con 0x7fb4280cd240 2023-07-07T04:01:24.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.052+0000 7fb425ffb700 1 -- 172.21.15.6:0/879706301 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41c011990 con 0x7fb4280cd240 2023-07-07T04:01:24.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.052+0000 7fb425ffb700 1 -- 172.21.15.6:0/879706301 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c011d20 con 0x7fb4280cd240 2023-07-07T04:01:24.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.052+0000 7fb42d89e700 1 -- 172.21.15.6:0/879706301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4280cd240 msgr2=0x7fb4280cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:24.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.052+0000 7fb42d89e700 1 --2- 172.21.15.6:0/879706301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4280cd240 0x7fb4280cd690 secure :-1 s=READY pgs=3391 cs=0 l=1 rev1=1 crypto rx=0x7fb42806a9a0 tx=0x7fb41c009bd0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.052+0000 7fb42d89e700 1 -- 172.21.15.6:0/879706301 shutdown_connections 2023-07-07T04:01:24.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.052+0000 7fb42d89e700 1 --2- 172.21.15.6:0/879706301 >> v2:172.21.15.40:3300/0 conn(0x7fb4280d0b70 0x7fb4280d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.052+0000 7fb42d89e700 1 --2- 172.21.15.6:0/879706301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4280cd240 0x7fb4280cd690 unknown :-1 s=CLOSED pgs=3391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.052+0000 7fb42d89e700 1 -- 172.21.15.6:0/879706301 >> 172.21.15.6:0/879706301 conn(0x7fb4280d2bf0 msgr2=0x7fb4280d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:24.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.052+0000 7fb42d89e700 1 -- 172.21.15.6:0/879706301 shutdown_connections 2023-07-07T04:01:24.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.052+0000 7fb42d89e700 1 -- 172.21.15.6:0/879706301 wait complete. 2023-07-07T04:01:24.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.053+0000 7fb42d89e700 1 Processor -- start 2023-07-07T04:01:24.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.054+0000 7fb42d89e700 1 -- start start 2023-07-07T04:01:24.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.054+0000 7fb42d89e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4280cd240 0x7fb4280ca870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:24.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.054+0000 7fb42d89e700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4280d0b70 0x7fb428158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:24.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.054+0000 7fb42d89e700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb42815c670 0x7fb4281e6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:24.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.054+0000 7fb42d89e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4281586b0 con 0x7fb4280cd240 2023-07-07T04:01:24.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.054+0000 7fb42d89e700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4281f2550 con 0x7fb42815c670 2023-07-07T04:01:24.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.054+0000 7fb42d89e700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4281e7270 con 0x7fb4280d0b70 2023-07-07T04:01:24.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.055+0000 7fb426ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4280cd240 0x7fb4280ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:24.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.055+0000 7fb426ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4280cd240 0x7fb4280ca870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48472/0 (socket says 172.21.15.6:48472) 2023-07-07T04:01:24.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.055+0000 7fb426ffd700 1 -- 172.21.15.6:0/1438869995 learned_addr learned my addr 172.21.15.6:0/1438869995 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:24.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.055+0000 7fb4277fe700 1 --2- 172.21.15.6:0/1438869995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb42815c670 0x7fb4281e6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.055+0000 7fb4267fc700 1 --2- 172.21.15.6:0/1438869995 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4280d0b70 0x7fb428158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.055+0000 7fb426ffd700 1 -- 172.21.15.6:0/1438869995 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4280d0b70 msgr2=0x7fb428158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.055+0000 7fb426ffd700 1 --2- 172.21.15.6:0/1438869995 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fb4280d0b70 0x7fb428158170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.055+0000 7fb426ffd700 1 -- 172.21.15.6:0/1438869995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb42815c670 msgr2=0x7fb4281e6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:24.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.055+0000 7fb426ffd700 1 --2- 172.21.15.6:0/1438869995 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb42815c670 0x7fb4281e6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.055+0000 7fb426ffd700 1 -- 172.21.15.6:0/1438869995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41c009550 con 0x7fb4280cd240 2023-07-07T04:01:24.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.055+0000 7fb426ffd700 1 --2- 172.21.15.6:0/1438869995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4280cd240 0x7fb4280ca870 secure :-1 s=READY pgs=3392 cs=0 l=1 rev1=1 crypto rx=0x7fb41800c430 tx=0x7fb41800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:24.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.055+0000 7fb40ffff700 1 -- 172.21.15.6:0/1438869995 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4180052d0 con 0x7fb4280cd240 2023-07-07T04:01:24.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.055+0000 7fb40ffff700 1 -- 172.21.15.6:0/1438869995 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb418005450 con 0x7fb4280cd240 2023-07-07T04:01:24.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.055+0000 7fb42d89e700 1 -- 172.21.15.6:0/1438869995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4281e7550 con 0x7fb4280cd240 2023-07-07T04:01:24.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.055+0000 7fb40ffff700 1 -- 172.21.15.6:0/1438869995 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb418006aa0 con 0x7fb4280cd240 2023-07-07T04:01:24.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.055+0000 7fb42d89e700 1 -- 172.21.15.6:0/1438869995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4281e6f80 con 0x7fb4280cd240 2023-07-07T04:01:24.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.056+0000 7fb42d89e700 1 -- 172.21.15.6:0/1438869995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb42806a3e0 con 0x7fb4280cd240 2023-07-07T04:01:24.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.057+0000 7fb40ffff700 1 -- 172.21.15.6:0/1438869995 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb418003680 con 0x7fb4280cd240 2023-07-07T04:01:24.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.057+0000 7fb40ffff700 1 --2- 172.21.15.6:0/1438869995 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb41406ace0 0x7fb41406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:24.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.057+0000 7fb40ffff700 1 -- 172.21.15.6:0/1438869995 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fb418088390 con 0x7fb4280cd240 2023-07-07T04:01:24.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.057+0000 7fb4267fc700 1 --2- 172.21.15.6:0/1438869995 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb41406ace0 0x7fb41406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:24.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.057+0000 7fb40ffff700 1 --2- 172.21.15.6:0/1438869995 >> [v2:172.21.15.40:6824/4054264969,v1:172.21.15.40:6825/4054264969] conn(0x7fb414071580 0x7fb4140739d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:24.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.058+0000 7fb40ffff700 1 -- 172.21.15.6:0/1438869995 --> [v2:172.21.15.40:6824/4054264969,v1:172.21.15.40:6825/4054264969] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb4140740a0 con 0x7fb414071580 2023-07-07T04:01:24.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.058+0000 7fb40ffff700 1 -- 172.21.15.6:0/1438869995 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb41808aa30 con 0x7fb4280cd240 2023-07-07T04:01:24.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.058+0000 7fb4267fc700 1 --2- 172.21.15.6:0/1438869995 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb41406ace0 0x7fb41406d190 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fb42815afd0 tx=0x7fb41c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:24.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.058+0000 7fb4277fe700 1 --2- 172.21.15.6:0/1438869995 >> [v2:172.21.15.40:6824/4054264969,v1:172.21.15.40:6825/4054264969] conn(0x7fb414071580 0x7fb4140739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:24.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.058+0000 7fb4277fe700 1 --2- 172.21.15.6:0/1438869995 >> [v2:172.21.15.40:6824/4054264969,v1:172.21.15.40:6825/4054264969] conn(0x7fb414071580 0x7fb4140739d0 crc :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:24.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.060+0000 7fb40ffff700 1 -- 172.21.15.6:0/1438869995 <== osd.7 v2:172.21.15.40:6824/4054264969 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb4140740a0 con 0x7fb414071580 2023-07-07T04:01:24.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.075+0000 7fb42d89e700 1 -- 172.21.15.6:0/1438869995 --> [v2:172.21.15.40:6824/4054264969,v1:172.21.15.40:6825/4054264969] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb42806a100 con 0x7fb414071580 2023-07-07T04:01:24.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.075+0000 7fb40ffff700 1 -- 172.21.15.6:0/1438869995 <== osd.7 v2:172.21.15.40:6824/4054264969 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb420003a20 con 0x7fb414071580 2023-07-07T04:01:24.076 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-07-07T04:01:24.077 INFO:teuthology.orchestra.run.smithi006.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-07T04:01:24.077 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-07-07T04:01:24.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.075+0000 7fb42d89e700 1 -- 172.21.15.6:0/1438869995 >> [v2:172.21.15.40:6824/4054264969,v1:172.21.15.40:6825/4054264969] conn(0x7fb414071580 msgr2=0x7fb4140739d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:24.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.075+0000 7fb42d89e700 1 --2- 172.21.15.6:0/1438869995 >> [v2:172.21.15.40:6824/4054264969,v1:172.21.15.40:6825/4054264969] conn(0x7fb414071580 0x7fb4140739d0 crc :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.075+0000 7fb42d89e700 1 -- 172.21.15.6:0/1438869995 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb41406ace0 msgr2=0x7fb41406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:24.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.076+0000 7fb42d89e700 1 --2- 172.21.15.6:0/1438869995 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fb41406ace0 0x7fb41406d190 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fb42815afd0 tx=0x7fb41c008030 comp rx=0 tx=0).stop 2023-07-07T04:01:24.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.076+0000 7fb42d89e700 1 -- 172.21.15.6:0/1438869995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4280cd240 msgr2=0x7fb4280ca870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:24.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.076+0000 7fb42d89e700 1 --2- 172.21.15.6:0/1438869995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4280cd240 0x7fb4280ca870 secure :-1 s=READY pgs=3392 cs=0 l=1 rev1=1 crypto rx=0x7fb41800c430 tx=0x7fb41800c7f0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.076+0000 7fb4277fe700 1 -- 172.21.15.6:0/1438869995 reap_dead start 2023-07-07T04:01:24.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.076+0000 7fb42d89e700 1 -- 172.21.15.6:0/1438869995 shutdown_connections 2023-07-07T04:01:24.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.076+0000 7fb42d89e700 1 -- 172.21.15.6:0/1438869995 >> 172.21.15.6:0/1438869995 conn(0x7fb4280d2bf0 msgr2=0x7fb42815fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:24.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.076+0000 7fb42d89e700 1 -- 172.21.15.6:0/1438869995 shutdown_connections 2023-07-07T04:01:24.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.076+0000 7fb42d89e700 1 -- 172.21.15.6:0/1438869995 wait complete. 2023-07-07T04:01:24.090 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-07-07T04:01:24.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.225+0000 7f92c3e93700 1 Processor -- start 2023-07-07T04:01:24.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.225+0000 7f92c3e93700 1 -- start start 2023-07-07T04:01:24.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.226+0000 7f92c3e93700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92bc160e00 0x7f92bc06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:24.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.226+0000 7f92c3e93700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92bc15d480 con 0x7f92bc15d910 2023-07-07T04:01:24.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.226+0000 7f92c3e93700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92bc15ce70 con 0x7f92bc0b1f10 2023-07-07T04:01:24.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.226+0000 7f92c3e93700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc15cc60 con 0x7f92bc160e00 2023-07-07T04:01:24.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.226+0000 7f92c2430700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f92bc15d910 0x7f92bc0d0c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49694/0 (socket says 172.21.15.6:49694) 2023-07-07T04:01:24.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.226+0000 7f92c2430700 1 -- 172.21.15.6:0/3817946657 learned_addr learned my addr 172.21.15.6:0/3817946657 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:01:24.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.227+0000 7f92c142e700 1 --2- 172.21.15.6:0/3817946657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92bc160e00 0x7f92bc06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:24.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.227+0000 7f92c0c2d700 1 -- 172.21.15.6:0/3817946657 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257362119 0 0) 0x7f92bc15d480 con 0x7f92bc15d910 2023-07-07T04:01:24.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.227+0000 7f92c0c2d700 1 -- 172.21.15.6:0/3817946657 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92a80035b0 con 0x7f92bc15d910 2023-07-07T04:01:24.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.227+0000 7f92c0c2d700 1 -- 172.21.15.6:0/3817946657 <== mon.1 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859471232 0 0) 0x7f92bc15ce70 con 0x7f92bc0b1f10 2023-07-07T04:01:24.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.227+0000 7f92c0c2d700 1 -- 172.21.15.6:0/3817946657 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92bc15d480 con 0x7f92bc0b1f10 2023-07-07T04:01:24.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.227+0000 7f92c142e700 1 -- 172.21.15.6:0/3817946657 >> v1:172.21.15.40:6789/0 conn(0x7f92bc0b1f10 legacy=0x7f92bc0cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:24.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.227+0000 7f92c142e700 1 -- 172.21.15.6:0/3817946657 >> v1:172.21.15.6:6789/0 conn(0x7f92bc15d910 legacy=0x7f92bc0d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:24.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.227+0000 7f92c142e700 1 -- 172.21.15.6:0/3817946657 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc0cddd0 con 0x7f92bc160e00 2023-07-07T04:01:24.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.227+0000 7f92c142e700 1 --2- 172.21.15.6:0/3817946657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92bc160e00 0x7f92bc06bdb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f92ac009870 tx=0x7f92ac009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=940811226b1bfedc server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:24.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.227+0000 7f92c0c2d700 1 -- 172.21.15.6:0/3817946657 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac011830 con 0x7f92bc160e00 2023-07-07T04:01:24.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.228+0000 7f92c0c2d700 1 -- 172.21.15.6:0/3817946657 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ac011990 con 0x7f92bc160e00 2023-07-07T04:01:24.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.228+0000 7f92c0c2d700 1 -- 172.21.15.6:0/3817946657 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac011d20 con 0x7f92bc160e00 2023-07-07T04:01:24.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.228+0000 7f92c3e93700 1 -- 172.21.15.6:0/3817946657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92bc160e00 msgr2=0x7f92bc06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:24.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.228+0000 7f92c3e93700 1 --2- 172.21.15.6:0/3817946657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92bc160e00 0x7f92bc06bdb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f92ac009870 tx=0x7f92ac009b80 comp rx=0 tx=0).stop 2023-07-07T04:01:24.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.228+0000 7f92c3e93700 1 -- 172.21.15.6:0/3817946657 shutdown_connections 2023-07-07T04:01:24.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.228+0000 7f92c3e93700 1 --2- 172.21.15.6:0/3817946657 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92bc160e00 0x7f92bc06bdb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.228+0000 7f92c3e93700 1 -- 172.21.15.6:0/3817946657 >> 172.21.15.6:0/3817946657 conn(0x7f92bc0d2c70 msgr2=0x7f92bc0d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:24.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.228+0000 7f92c3e93700 1 -- 172.21.15.6:0/3817946657 shutdown_connections 2023-07-07T04:01:24.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.228+0000 7f92c3e93700 1 -- 172.21.15.6:0/3817946657 wait complete. 2023-07-07T04:01:24.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.229+0000 7f92c3e93700 1 Processor -- start 2023-07-07T04:01:24.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.230+0000 7f92c3e93700 1 -- start start 2023-07-07T04:01:24.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.230+0000 7f92c3e93700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92bc0b1f10 0x7f92bc150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:24.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.230+0000 7f92c3e93700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92bc15d910 0x7f92bc150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:24.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.230+0000 7f92c3e93700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92bc160e00 0x7f92bc0c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:24.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.230+0000 7f92c3e93700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc0c8940 con 0x7f92bc160e00 2023-07-07T04:01:24.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.230+0000 7f92c3e93700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc15a120 con 0x7f92bc15d910 2023-07-07T04:01:24.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.230+0000 7f92c3e93700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc0c7d70 con 0x7f92bc0b1f10 2023-07-07T04:01:24.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.230+0000 7f92c2430700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92bc160e00 0x7f92bc0c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:24.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.230+0000 7f92c1c2f700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92bc0b1f10 0x7f92bc150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:24.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.230+0000 7f92c2430700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92bc160e00 0x7f92bc0c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48492/0 (socket says 172.21.15.6:48492) 2023-07-07T04:01:24.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.230+0000 7f92c2430700 1 -- 172.21.15.6:0/3332583626 learned_addr learned my addr 172.21.15.6:0/3332583626 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:24.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.230+0000 7f92c142e700 1 --2- 172.21.15.6:0/3332583626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92bc15d910 0x7f92bc150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:24.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.231+0000 7f92c2430700 1 -- 172.21.15.6:0/3332583626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92bc0b1f10 msgr2=0x7f92bc150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:24.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.231+0000 7f92c2430700 1 --2- 172.21.15.6:0/3332583626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92bc0b1f10 0x7f92bc150390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.231+0000 7f92c2430700 1 -- 172.21.15.6:0/3332583626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92bc15d910 msgr2=0x7f92bc150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:24.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.231+0000 7f92c2430700 1 --2- 172.21.15.6:0/3332583626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92bc15d910 0x7f92bc150b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.231+0000 7f92c2430700 1 -- 172.21.15.6:0/3332583626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ac0094a0 con 0x7f92bc160e00 2023-07-07T04:01:24.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.231+0000 7f92c2430700 1 --2- 172.21.15.6:0/3332583626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92bc160e00 0x7f92bc0c8dd0 secure :-1 s=READY pgs=3394 cs=0 l=1 rev1=1 crypto rx=0x7f92b400cb40 tx=0x7f92b400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:24.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.231+0000 7f92b27fc700 1 -- 172.21.15.6:0/3332583626 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b400a9e0 con 0x7f92bc160e00 2023-07-07T04:01:24.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.231+0000 7f92b27fc700 1 -- 172.21.15.6:0/3332583626 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b400ab40 con 0x7f92bc160e00 2023-07-07T04:01:24.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.231+0000 7f92c3e93700 1 -- 172.21.15.6:0/3332583626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92bc0c8010 con 0x7f92bc160e00 2023-07-07T04:01:24.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.231+0000 7f92b27fc700 1 -- 172.21.15.6:0/3332583626 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b4012400 con 0x7f92bc160e00 2023-07-07T04:01:24.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.231+0000 7f92c3e93700 1 -- 172.21.15.6:0/3332583626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92bc0c85d0 con 0x7f92bc160e00 2023-07-07T04:01:24.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.232+0000 7f92c3e93700 1 -- 172.21.15.6:0/3332583626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92bc15d0f0 con 0x7f92bc160e00 2023-07-07T04:01:24.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.233+0000 7f92b27fc700 1 -- 172.21.15.6:0/3332583626 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f92b401b3b0 con 0x7f92bc160e00 2023-07-07T04:01:24.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.233+0000 7f92b27fc700 1 --2- 172.21.15.6:0/3332583626 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f92a006ace0 0x7f92a006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:24.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.233+0000 7f92b27fc700 1 -- 172.21.15.6:0/3332583626 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f92b4088fa0 con 0x7f92bc160e00 2023-07-07T04:01:24.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.233+0000 7f92c1c2f700 1 --2- 172.21.15.6:0/3332583626 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f92a006ace0 0x7f92a006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:24.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.234+0000 7f92c1c2f700 1 --2- 172.21.15.6:0/3332583626 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f92a006ace0 0x7f92a006d190 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f92b80011e0 tx=0x7f92b8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:24.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.238+0000 7f92b27fc700 1 -- 172.21.15.6:0/3332583626 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f92b40bb310 con 0x7f92bc160e00 2023-07-07T04:01:24.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.452+0000 7f92c3e93700 1 -- 172.21.15.6:0/3332583626 --> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f92bc0cdaf0 con 0x7f92a006ace0 2023-07-07T04:01:24.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.452+0000 7f92b27fc700 1 -- 172.21.15.6:0/3332583626 <== mgr.4110 v2:172.21.15.6:6832/201543369 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f92b8001570 con 0x7f92a006ace0 2023-07-07T04:01:24.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.455+0000 7f92c3e93700 1 -- 172.21.15.6:0/3332583626 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f92a006ace0 msgr2=0x7f92a006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:24.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.455+0000 7f92c3e93700 1 --2- 172.21.15.6:0/3332583626 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f92a006ace0 0x7f92a006d190 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f92b80011e0 tx=0x7f92b8009040 comp rx=0 tx=0).stop 2023-07-07T04:01:24.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.455+0000 7f92c3e93700 1 -- 172.21.15.6:0/3332583626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92bc160e00 msgr2=0x7f92bc0c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:24.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.455+0000 7f92c3e93700 1 --2- 172.21.15.6:0/3332583626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92bc160e00 0x7f92bc0c8dd0 secure :-1 s=READY pgs=3394 cs=0 l=1 rev1=1 crypto rx=0x7f92b400cb40 tx=0x7f92b400ce50 comp rx=0 tx=0).stop 2023-07-07T04:01:24.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.455+0000 7f92c3e93700 1 -- 172.21.15.6:0/3332583626 shutdown_connections 2023-07-07T04:01:24.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.455+0000 7f92c3e93700 1 --2- 172.21.15.6:0/3332583626 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f92a006ace0 0x7f92a006d190 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.455+0000 7f92c3e93700 1 --2- 172.21.15.6:0/3332583626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92bc160e00 0x7f92bc0c8dd0 unknown :-1 s=CLOSED pgs=3394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.455+0000 7f92c3e93700 1 --2- 172.21.15.6:0/3332583626 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f92bc0b1f10 0x7f92bc150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.455+0000 7f92c3e93700 1 --2- 172.21.15.6:0/3332583626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92bc15d910 0x7f92bc150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.455+0000 7f92c3e93700 1 -- 172.21.15.6:0/3332583626 >> 172.21.15.6:0/3332583626 conn(0x7f92bc0d2c70 msgr2=0x7f92bc15e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:24.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.455+0000 7f92c3e93700 1 -- 172.21.15.6:0/3332583626 shutdown_connections 2023-07-07T04:01:24.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.455+0000 7f92c3e93700 1 -- 172.21.15.6:0/3332583626 wait complete. 2023-07-07T04:01:24.459 INFO:teuthology.orchestra.run.smithi006.stderr:instructed osd(s) 7 to deep-scrub 2023-07-07T04:01:24.470 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-07T04:01:24.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.604+0000 7fbc6cf82700 1 Processor -- start 2023-07-07T04:01:24.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.604+0000 7fbc6cf82700 1 -- start start 2023-07-07T04:01:24.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.605+0000 7fbc6cf82700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc68158860 0x7fbc680b2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:24.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.605+0000 7fbc6cf82700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc680b2870 0x7fbc68070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:24.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.605+0000 7fbc6cf82700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbc68159ae0 0x7fbc68071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:24.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.605+0000 7fbc6cf82700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc680b2d80 con 0x7fbc68159ae0 2023-07-07T04:01:24.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.605+0000 7fbc6cf82700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc68159000 con 0x7fbc680b2870 2023-07-07T04:01:24.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.605+0000 7fbc6cf82700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc681592e0 con 0x7fbc68158860 2023-07-07T04:01:24.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.605+0000 7fbc66d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbc68159ae0 0x7fbc68071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:24.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.605+0000 7fbc66d9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbc68159ae0 0x7fbc68071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48498/0 (socket says 172.21.15.6:48498) 2023-07-07T04:01:24.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.605+0000 7fbc66d9d700 1 -- 172.21.15.6:0/1393161515 learned_addr learned my addr 172.21.15.6:0/1393161515 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:24.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.605+0000 7fbc6659c700 1 --2- 172.21.15.6:0/1393161515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc68158860 0x7fbc680b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:24.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.605+0000 7fbc65d9b700 1 --2- 172.21.15.6:0/1393161515 >> v2:172.21.15.40:3300/0 conn(0x7fbc680b2870 0x7fbc68070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:24.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.605+0000 7fbc66d9d700 1 -- 172.21.15.6:0/1393161515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc68158860 msgr2=0x7fbc680b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:24.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.605+0000 7fbc66d9d700 1 --2- 172.21.15.6:0/1393161515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc68158860 0x7fbc680b2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.605+0000 7fbc66d9d700 1 -- 172.21.15.6:0/1393161515 >> v2:172.21.15.40:3300/0 conn(0x7fbc680b2870 msgr2=0x7fbc68070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:24.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.605+0000 7fbc66d9d700 1 --2- 172.21.15.6:0/1393161515 >> v2:172.21.15.40:3300/0 conn(0x7fbc680b2870 0x7fbc68070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.606+0000 7fbc66d9d700 1 -- 172.21.15.6:0/1393161515 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc681595c0 con 0x7fbc68159ae0 2023-07-07T04:01:24.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.606+0000 7fbc66d9d700 1 --2- 172.21.15.6:0/1393161515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc68159ae0 0x7fbc68071420 secure :-1 s=READY pgs=3395 cs=0 l=1 rev1=1 crypto rx=0x7fbc6806eb60 tx=0x7fbc6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ce76b1c26d2169 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:24.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.606+0000 7fbc6559a700 1 -- 172.21.15.6:0/1393161515 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6000e070 con 0x7fbc68159ae0 2023-07-07T04:01:24.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.606+0000 7fbc6559a700 1 -- 172.21.15.6:0/1393161515 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6000b910 con 0x7fbc68159ae0 2023-07-07T04:01:24.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.606+0000 7fbc6559a700 1 -- 172.21.15.6:0/1393161515 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6000bcc0 con 0x7fbc68159ae0 2023-07-07T04:01:24.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.606+0000 7fbc6cf82700 1 -- 172.21.15.6:0/1393161515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc68159ae0 msgr2=0x7fbc68071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:24.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.606+0000 7fbc6cf82700 1 --2- 172.21.15.6:0/1393161515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc68159ae0 0x7fbc68071420 secure :-1 s=READY pgs=3395 cs=0 l=1 rev1=1 crypto rx=0x7fbc6806eb60 tx=0x7fbc6000b330 comp rx=0 tx=0).stop 2023-07-07T04:01:24.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.607+0000 7fbc6cf82700 1 -- 172.21.15.6:0/1393161515 shutdown_connections 2023-07-07T04:01:24.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.607+0000 7fbc6cf82700 1 --2- 172.21.15.6:0/1393161515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc68159ae0 0x7fbc68071420 unknown :-1 s=CLOSED pgs=3395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.607+0000 7fbc6cf82700 1 --2- 172.21.15.6:0/1393161515 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc68158860 0x7fbc680b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.607+0000 7fbc6cf82700 1 --2- 172.21.15.6:0/1393161515 >> v2:172.21.15.40:3300/0 conn(0x7fbc680b2870 0x7fbc68070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.607+0000 7fbc6cf82700 1 -- 172.21.15.6:0/1393161515 >> 172.21.15.6:0/1393161515 conn(0x7fbc680b05b0 msgr2=0x7fbc680b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:24.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.607+0000 7fbc6cf82700 1 -- 172.21.15.6:0/1393161515 shutdown_connections 2023-07-07T04:01:24.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.607+0000 7fbc6cf82700 1 -- 172.21.15.6:0/1393161515 wait complete. 2023-07-07T04:01:24.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.608+0000 7fbc6cf82700 1 Processor -- start 2023-07-07T04:01:24.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.608+0000 7fbc6cf82700 1 -- start start 2023-07-07T04:01:24.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.609+0000 7fbc6cf82700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc680b2870 0x7fbc68156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:24.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.609+0000 7fbc6cf82700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc68158860 0x7fbc68142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:24.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.609+0000 7fbc6cf82700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc68159ae0 0x7fbc6813da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:24.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.609+0000 7fbc6cf82700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc681493b0 con 0x7fbc68158860 2023-07-07T04:01:24.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.609+0000 7fbc6cf82700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc68157220 con 0x7fbc680b2870 2023-07-07T04:01:24.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.609+0000 7fbc6cf82700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc68157500 con 0x7fbc68159ae0 2023-07-07T04:01:24.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.609+0000 7fbc65d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc68158860 0x7fbc68142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:24.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.609+0000 7fbc65d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc68158860 0x7fbc68142b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48504/0 (socket says 172.21.15.6:48504) 2023-07-07T04:01:24.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.609+0000 7fbc65d9b700 1 -- 172.21.15.6:0/3935953355 learned_addr learned my addr 172.21.15.6:0/3935953355 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:24.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.609+0000 7fbc6659c700 1 --2- 172.21.15.6:0/3935953355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc680b2870 0x7fbc68156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:24.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.609+0000 7fbc66d9d700 1 --2- 172.21.15.6:0/3935953355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc68159ae0 0x7fbc6813da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:24.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.609+0000 7fbc65d9b700 1 -- 172.21.15.6:0/3935953355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc68159ae0 msgr2=0x7fbc6813da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:24.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.609+0000 7fbc65d9b700 1 --2- 172.21.15.6:0/3935953355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc68159ae0 0x7fbc6813da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.609+0000 7fbc65d9b700 1 -- 172.21.15.6:0/3935953355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc680b2870 msgr2=0x7fbc68156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:24.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.609+0000 7fbc65d9b700 1 --2- 172.21.15.6:0/3935953355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc680b2870 0x7fbc68156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.609+0000 7fbc65d9b700 1 -- 172.21.15.6:0/3935953355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc60009b30 con 0x7fbc68158860 2023-07-07T04:01:24.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.609+0000 7fbc65d9b700 1 --2- 172.21.15.6:0/3935953355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc68158860 0x7fbc68142b90 secure :-1 s=READY pgs=3396 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00e9b0 tx=0x7fbc5c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:24.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.610+0000 7fbc56ffd700 1 -- 172.21.15.6:0/3935953355 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c009710 con 0x7fbc68158860 2023-07-07T04:01:24.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.610+0000 7fbc56ffd700 1 -- 172.21.15.6:0/3935953355 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5c00ee50 con 0x7fbc68158860 2023-07-07T04:01:24.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.610+0000 7fbc6cf82700 1 -- 172.21.15.6:0/3935953355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc68148d60 con 0x7fbc68158860 2023-07-07T04:01:24.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.610+0000 7fbc56ffd700 1 -- 172.21.15.6:0/3935953355 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c00ca50 con 0x7fbc68158860 2023-07-07T04:01:24.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.610+0000 7fbc6cf82700 1 -- 172.21.15.6:0/3935953355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc681430d0 con 0x7fbc68158860 2023-07-07T04:01:24.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.611+0000 7fbc6cf82700 1 -- 172.21.15.6:0/3935953355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc6806a8f0 con 0x7fbc68158860 2023-07-07T04:01:24.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.611+0000 7fbc56ffd700 1 -- 172.21.15.6:0/3935953355 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbc5c00cbb0 con 0x7fbc68158860 2023-07-07T04:01:24.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.612+0000 7fbc56ffd700 1 --2- 172.21.15.6:0/3935953355 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbc4806ace0 0x7fbc4806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:24.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.612+0000 7fbc56ffd700 1 -- 172.21.15.6:0/3935953355 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fbc5c089280 con 0x7fbc68158860 2023-07-07T04:01:24.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.612+0000 7fbc6659c700 1 --2- 172.21.15.6:0/3935953355 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbc4806ace0 0x7fbc4806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:24.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.612+0000 7fbc6659c700 1 --2- 172.21.15.6:0/3935953355 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbc4806ace0 0x7fbc4806d190 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009b60 tx=0x7fbc58009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:24.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.616+0000 7fbc56ffd700 1 -- 172.21.15.6:0/3935953355 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbc5c057f90 con 0x7fbc68158860 2023-07-07T04:01:24.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.818+0000 7fbc6cf82700 1 -- 172.21.15.6:0/3935953355 --> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbc68158c30 con 0x7fbc4806ace0 2023-07-07T04:01:24.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.821+0000 7fbc56ffd700 1 -- 172.21.15.6:0/3935953355 <== mgr.4110 v2:172.21.15.6:6832/201543369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71378 (secure 0 0 0) 0x7fbc580117e0 con 0x7fbc4806ace0 2023-07-07T04:01:24.823 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:01:24.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.823+0000 7fbc6cf82700 1 -- 172.21.15.6:0/3935953355 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbc4806ace0 msgr2=0x7fbc4806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:24.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.823+0000 7fbc6cf82700 1 --2- 172.21.15.6:0/3935953355 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbc4806ace0 0x7fbc4806d190 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fbc58009b60 tx=0x7fbc58009210 comp rx=0 tx=0).stop 2023-07-07T04:01:24.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.823+0000 7fbc6cf82700 1 -- 172.21.15.6:0/3935953355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc68158860 msgr2=0x7fbc68142b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:24.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.823+0000 7fbc6cf82700 1 --2- 172.21.15.6:0/3935953355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc68158860 0x7fbc68142b90 secure :-1 s=READY pgs=3396 cs=0 l=1 rev1=1 crypto rx=0x7fbc5c00e9b0 tx=0x7fbc5c00ecc0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.823+0000 7fbc6cf82700 1 -- 172.21.15.6:0/3935953355 shutdown_connections 2023-07-07T04:01:24.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.823+0000 7fbc6cf82700 1 --2- 172.21.15.6:0/3935953355 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7fbc4806ace0 0x7fbc4806d190 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.823+0000 7fbc6cf82700 1 --2- 172.21.15.6:0/3935953355 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7fbc68159ae0 0x7fbc6813da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.823+0000 7fbc6cf82700 1 --2- 172.21.15.6:0/3935953355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc680b2870 0x7fbc68156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.823+0000 7fbc6cf82700 1 --2- 172.21.15.6:0/3935953355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc68158860 0x7fbc68142b90 unknown :-1 s=CLOSED pgs=3396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.823+0000 7fbc6cf82700 1 -- 172.21.15.6:0/3935953355 >> 172.21.15.6:0/3935953355 conn(0x7fbc680b05b0 msgr2=0x7fbc68071010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.823+0000 7fbc6cf82700 1 -- 172.21.15.6:0/3935953355 shutdown_connections 2023-07-07T04:01:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:24.823+0000 7fbc6cf82700 1 -- 172.21.15.6:0/3935953355 wait complete. 2023-07-07T04:01:24.827 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-07T04:01:24.838 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":14513,"stamp":"2023-07-07T04:01:23.946602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":11940968,"kb_used_data":5416,"kb_used_omap":151204,"kb_used_meta":11784283,"kb_avail":743033752,"statfs":{"total":773094113280,"available":760866562048,"internally_reserved":0,"allocated":5545984,"data_stored":3149744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":154833875,"internal_metadata":12067105837},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":521,"apply_latency_ms":521,"commit_latency_ns":521000000,"apply_latency_ns":521000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.037925"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":295,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.917698+0000","last_change":"2023-07-06T19:58:47.723855+0000","last_active":"2023-07-07T04:01:12.917698+0000","last_peered":"2023-07-07T04:01:12.917698+0000","last_clean":"2023-07-07T04:01:12.917698+0000","last_became_active":"2023-07-06T19:58:47.723553+0000","last_became_peered":"2023-07-06T19:58:47.723553+0000","last_unstale":"2023-07-07T04:01:12.917698+0000","last_undegraded":"2023-07-07T04:01:12.917698+0000","last_fullsized":"2023-07-07T04:01:12.917698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:11:58.031720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":290,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.961276+0000","last_change":"2023-07-06T19:58:47.705294+0000","last_active":"2023-07-07T04:01:12.961276+0000","last_peered":"2023-07-07T04:01:12.961276+0000","last_clean":"2023-07-07T04:01:12.961276+0000","last_became_active":"2023-07-06T19:58:47.704921+0000","last_became_peered":"2023-07-06T19:58:47.704921+0000","last_unstale":"2023-07-07T04:01:12.961276+0000","last_undegraded":"2023-07-07T04:01:12.961276+0000","last_fullsized":"2023-07-07T04:01:12.961276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:13:52.238597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":291,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:13.296600+0000","last_change":"2023-07-06T19:58:47.766992+0000","last_active":"2023-07-07T04:01:13.296600+0000","last_peered":"2023-07-07T04:01:13.296600+0000","last_clean":"2023-07-07T04:01:13.296600+0000","last_became_active":"2023-07-06T19:58:47.766697+0000","last_became_peered":"2023-07-06T19:58:47.766697+0000","last_unstale":"2023-07-07T04:01:13.296600+0000","last_undegraded":"2023-07-07T04:01:13.296600+0000","last_fullsized":"2023-07-07T04:01:13.296600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:23:14.562370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":290,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.934144+0000","last_change":"2023-07-06T19:58:47.704498+0000","last_active":"2023-07-07T04:01:12.934144+0000","last_peered":"2023-07-07T04:01:12.934144+0000","last_clean":"2023-07-07T04:01:12.934144+0000","last_became_active":"2023-07-06T19:58:47.704172+0000","last_became_peered":"2023-07-06T19:58:47.704172+0000","last_unstale":"2023-07-07T04:01:12.934144+0000","last_undegraded":"2023-07-07T04:01:12.934144+0000","last_fullsized":"2023-07-07T04:01:12.934144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T03:02:36.844807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"43'161","reported_seq":510,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.946359+0000","last_change":"2023-07-06T19:58:40.972763+0000","last_active":"2023-07-07T04:01:12.946359+0000","last_peered":"2023-07-07T04:01:12.946359+0000","last_clean":"2023-07-07T04:01:12.946359+0000","last_became_active":"2023-07-06T19:58:40.971570+0000","last_became_peered":"2023-07-06T19:58:40.971570+0000","last_unstale":"2023-07-07T04:01:12.946359+0000","last_undegraded":"2023-07-07T04:01:12.946359+0000","last_fullsized":"2023-07-07T04:01:12.946359+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:39.653546+0000","last_clean_scrub_stamp":"2023-07-06T19:58:39.653546+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T00:31:36.048493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":301,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.946495+0000","last_change":"2023-07-06T19:58:47.708545+0000","last_active":"2023-07-07T04:01:12.946495+0000","last_peered":"2023-07-07T04:01:12.946495+0000","last_clean":"2023-07-07T04:01:12.946495+0000","last_became_active":"2023-07-06T19:58:47.708230+0000","last_became_peered":"2023-07-06T19:58:47.708230+0000","last_unstale":"2023-07-07T04:01:12.946495+0000","last_undegraded":"2023-07-07T04:01:12.946495+0000","last_fullsized":"2023-07-07T04:01:12.946495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T02:31:37.154591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":289,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.947328+0000","last_change":"2023-07-06T19:58:47.723926+0000","last_active":"2023-07-07T04:01:12.947328+0000","last_peered":"2023-07-07T04:01:12.947328+0000","last_clean":"2023-07-07T04:01:12.947328+0000","last_became_active":"2023-07-06T19:58:47.723646+0000","last_became_peered":"2023-07-06T19:58:47.723646+0000","last_unstale":"2023-07-07T04:01:12.947328+0000","last_undegraded":"2023-07-07T04:01:12.947328+0000","last_fullsized":"2023-07-07T04:01:12.947328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:37:22.324090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":288,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.920569+0000","last_change":"2023-07-06T19:58:47.711918+0000","last_active":"2023-07-07T04:01:12.920569+0000","last_peered":"2023-07-07T04:01:12.920569+0000","last_clean":"2023-07-07T04:01:12.920569+0000","last_became_active":"2023-07-06T19:58:47.711591+0000","last_became_peered":"2023-07-06T19:58:47.711591+0000","last_unstale":"2023-07-07T04:01:12.920569+0000","last_undegraded":"2023-07-07T04:01:12.920569+0000","last_fullsized":"2023-07-07T04:01:12.920569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:31:20.169556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":285,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:12.925775+0000","last_change":"2023-07-06T19:58:47.712143+0000","last_active":"2023-07-07T04:01:12.925775+0000","last_peered":"2023-07-07T04:01:12.925775+0000","last_clean":"2023-07-07T04:01:12.925775+0000","last_became_active":"2023-07-06T19:58:47.711788+0000","last_became_peered":"2023-07-06T19:58:47.711788+0000","last_unstale":"2023-07-07T04:01:12.925775+0000","last_undegraded":"2023-07-07T04:01:12.925775+0000","last_fullsized":"2023-07-07T04:01:12.925775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-06T19:58:46.687678+0000","last_clean_scrub_stamp":"2023-07-06T19:58:46.687678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-07T22:48:00.551095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580637,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1619360,"kb_used_data":1112,"kb_used_omap":28457,"kb_used_meta":1589782,"kb_avail":92752480,"statfs":{"total":96636764160,"available":94978539520,"internally_reserved":0,"allocated":1138688,"data_stored":836494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29140457,"internal_metadata":1627937303},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":57,"apply_latency_ms":57,"commit_latency_ns":57000000,"apply_latency_ns":57000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":2.7480000000000002,"5min":1.383,"15min":1.196},"min":{"1min":0.25900000000000001,"5min":0.24299999999999999,"15min":0.24199999999999999},"max":{"1min":32.406999999999996,"5min":32.406999999999996,"15min":32.406999999999996},"last":0.73499999999999999},{"interface":"front","average":{"1min":3.1840000000000002,"5min":1.9730000000000001,"15min":1.625},"min":{"1min":0.30099999999999999,"5min":0.29399999999999998,"15min":0.26900000000000002},"max":{"1min":24.928999999999998,"5min":24.928999999999998,"15min":24.928999999999998},"last":0.56999999999999995}]},{"osd":1,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":3.4169999999999998,"5min":1.7869999999999999,"15min":1.524},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":32.445,"5min":32.445,"15min":32.445},"last":0.58999999999999997},{"interface":"front","average":{"1min":2.4830000000000001,"5min":1.8180000000000001,"15min":1.8839999999999999},"min":{"1min":0.315,"5min":0.29999999999999999,"15min":0.29299999999999998},"max":{"1min":24.966000000000001,"5min":24.966000000000001,"15min":24.966000000000001},"last":0.42599999999999999}]},{"osd":2,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":4.1609999999999996,"5min":2.2440000000000002,"15min":1.887},"min":{"1min":0.376,"5min":0.35199999999999998,"15min":0.32200000000000001},"max":{"1min":36.658999999999999,"5min":36.658999999999999,"15min":36.658999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":3.3159999999999998,"5min":2.4249999999999998,"15min":2},"min":{"1min":0.41299999999999998,"5min":0.38400000000000001,"15min":0.32900000000000001},"max":{"1min":32.369,"5min":32.369,"15min":32.369},"last":0.64500000000000002}]},{"osd":3,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":5.9930000000000003,"5min":2.9969999999999999,"15min":2.2930000000000001},"min":{"1min":0.39500000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":74.998000000000005,"5min":74.998000000000005,"15min":74.998000000000005},"last":0.60899999999999999},{"interface":"front","average":{"1min":3.0670000000000002,"5min":2.085,"15min":1.99},"min":{"1min":0.39300000000000002,"5min":0.35799999999999998,"15min":0.33500000000000002},"max":{"1min":16.452999999999999,"5min":16.452999999999999,"15min":16.452999999999999},"last":0.70299999999999996}]},{"osd":4,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":3.7010000000000001,"5min":1.6870000000000001,"15min":1.5049999999999999},"min":{"1min":0.30399999999999999,"5min":0.29299999999999998,"15min":0.28599999999999998},"max":{"1min":59.920999999999999,"5min":59.920999999999999,"15min":59.920999999999999},"last":0.622},{"interface":"front","average":{"1min":2.9910000000000001,"5min":1.696,"15min":1.49},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":36.616999999999997,"5min":36.616999999999997,"15min":36.616999999999997},"last":0.53900000000000003}]},{"osd":5,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":2.508,"5min":1.3720000000000001,"15min":1.282},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":16.904,"5min":16.904,"15min":16.904},"last":0.67800000000000005},{"interface":"front","average":{"1min":2.6110000000000002,"5min":1.6379999999999999,"15min":1.639},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":24.811,"5min":24.811,"15min":24.811},"last":0.747}]},{"osd":6,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":3.6749999999999998,"5min":1.9830000000000001,"15min":1.8160000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":60.188000000000002,"5min":60.188000000000002,"15min":60.188000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":2.8679999999999999,"5min":1.6719999999999999,"15min":1.5149999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":24.065999999999999,"5min":24.065999999999999,"15min":24.065999999999999},"last":0.71299999999999997}]}]},{"osd":6,"up_from":13,"seq":55834580633,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1927068,"kb_used_data":532,"kb_used_omap":17122,"kb_used_meta":1909405,"kb_avail":92444772,"statfs":{"total":96636764160,"available":94663446528,"internally_reserved":0,"allocated":544768,"data_stored":246126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17533718,"internal_metadata":1955230954},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":86,"apply_latency_ms":86,"commit_latency_ns":86000000,"apply_latency_ns":86000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.5629999999999999,"15min":1.411},"min":{"1min":0.28299999999999997,"5min":0.249,"15min":0.24099999999999999},"max":{"1min":5.9420000000000002,"5min":13.332000000000001,"15min":21.984999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":5.4770000000000003,"5min":2.4609999999999999,"15min":1.9179999999999999},"min":{"1min":0.28699999999999998,"5min":0.27800000000000002,"15min":0.246},"max":{"1min":65.186000000000007,"5min":65.186000000000007,"15min":65.186000000000007},"last":0.91000000000000003}]},{"osd":1,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":3.6629999999999998,"5min":2.524,"15min":2.0920000000000001},"min":{"1min":0.316,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":15.278,"5min":17.091999999999999,"15min":22.117000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":4.4720000000000004,"5min":2.1349999999999998,"15min":1.821},"min":{"1min":0.33500000000000002,"5min":0.29999999999999999,"15min":0.28899999999999998},"max":{"1min":40.649000000000001,"5min":40.649000000000001,"15min":40.649000000000001},"last":0.89100000000000001}]},{"osd":2,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":2.4279999999999999,"5min":2.0710000000000002,"15min":1.9770000000000001},"min":{"1min":0.32900000000000001,"5min":0.32400000000000001,"15min":0.30599999999999999},"max":{"1min":9.3309999999999995,"5min":13.196999999999999,"15min":22.210000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":2.7490000000000001,"5min":2.0750000000000002,"15min":1.877},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.30499999999999999},"max":{"1min":15.545999999999999,"5min":15.545999999999999,"15min":22.280000000000001},"last":0.83299999999999996}]},{"osd":3,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":8.5969999999999995,"5min":3.4540000000000002,"15min":2.5979999999999999},"min":{"1min":0.41499999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":111.95399999999999,"5min":111.95399999999999,"15min":111.95399999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":6.9690000000000003,"5min":3.032,"15min":2.3740000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.33700000000000002},"max":{"1min":112.504,"5min":112.504,"15min":112.504},"last":0.871}]},{"osd":4,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":2.1739999999999999,"5min":1.2589999999999999,"15min":1.2929999999999999},"min":{"1min":0.34200000000000003,"5min":0.308,"15min":0.27700000000000002},"max":{"1min":15.587999999999999,"5min":15.587999999999999,"15min":22.225000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":2.1890000000000001,"5min":1.716,"15min":1.6020000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":15.205,"5min":15.205,"15min":22.265999999999998},"last":0.58999999999999997}]},{"osd":5,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":3.956,"5min":2.1339999999999999,"15min":1.885},"min":{"1min":0.39300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":38.103000000000002,"5min":38.103000000000002,"15min":38.103000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":3.77,"5min":2.0179999999999998,"15min":1.6579999999999999},"min":{"1min":0.41199999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":37.863,"5min":37.863,"15min":37.863},"last":0.66100000000000003}]},{"osd":7,"last update":"Fri Jul 7 04:00:31 2023","interfaces":[{"interface":"back","average":{"1min":1.8129999999999999,"5min":1.4279999999999999,"15min":1.359},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.32300000000000001},"max":{"1min":15.507,"5min":15.507,"15min":22.395},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.7569999999999999,"5min":1.597,"15min":1.4910000000000001},"min":{"1min":0.39500000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":15.471,"5min":15.471,"15min":22.43},"last":0.74199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834580613,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":983260,"kb_used_data":532,"kb_used_omap":18390,"kb_used_meta":964329,"kb_avail":93388580,"statfs":{"total":96636764160,"available":95629905920,"internally_reserved":0,"allocated":544768,"data_stored":246126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18831879,"internal_metadata":987473401},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":53,"apply_latency_ms":53,"commit_latency_ns":53000000,"apply_latency_ns":53000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":3.1869999999999998,"5min":1.788,"15min":1.4410000000000001},"min":{"1min":0.26200000000000001,"5min":0.254,"15min":0.23300000000000001},"max":{"1min":23.021000000000001,"5min":23.021000000000001,"15min":23.021000000000001},"last":1.2110000000000001},{"interface":"front","average":{"1min":2.855,"5min":2.2010000000000001,"15min":1.829},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.248},"max":{"1min":16.084,"5min":16.084,"15min":16.084},"last":1.343}]},{"osd":2,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":4.2939999999999996,"5min":2.23,"15min":1.8200000000000001},"min":{"1min":0.27800000000000002,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":28.513999999999999,"5min":28.513999999999999,"15min":28.513999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":4.1740000000000004,"5min":2.4169999999999998,"15min":2.1360000000000001},"min":{"1min":0.30599999999999999,"5min":0.28699999999999998,"15min":0.26200000000000001},"max":{"1min":28.352,"5min":28.352,"15min":28.352},"last":0.54600000000000004}]},{"osd":3,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":4.9790000000000001,"5min":2.976,"15min":2.3900000000000001},"min":{"1min":0.32700000000000001,"5min":0.32100000000000001,"15min":0.28100000000000003},"max":{"1min":21.620999999999999,"5min":21.620999999999999,"15min":21.620999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":3.129,"5min":2.2559999999999998,"15min":1.8029999999999999},"min":{"1min":0.38200000000000001,"5min":0.34699999999999998,"15min":0.29999999999999999},"max":{"1min":15.952,"5min":15.952,"15min":15.952},"last":0.77500000000000002}]},{"osd":4,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":3.7829999999999999,"5min":2.085,"15min":1.6659999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":23.071999999999999,"5min":23.071999999999999,"15min":23.071999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":2.9729999999999999,"5min":2.3849999999999998,"15min":1.9850000000000001},"min":{"1min":0.40400000000000003,"5min":0.379,"15min":0.35899999999999999},"max":{"1min":11.039,"5min":11.039,"15min":11.039},"last":1.3180000000000001}]},{"osd":5,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":2.7589999999999999,"5min":2.3050000000000002,"15min":2.1160000000000001},"min":{"1min":0.45100000000000001,"5min":0.40000000000000002,"15min":0.38500000000000001},"max":{"1min":11.085000000000001,"5min":11.085000000000001,"15min":17.998000000000001},"last":1.2350000000000001},{"interface":"front","average":{"1min":3.4790000000000001,"5min":2.3980000000000001,"15min":2.2519999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":21.696000000000002,"5min":21.696000000000002,"15min":21.696000000000002},"last":0.64100000000000001}]},{"osd":6,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":8.3789999999999996,"5min":3.2909999999999999,"15min":2.2250000000000001},"min":{"1min":0.48799999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":83.441999999999993,"5min":83.441999999999993,"15min":83.441999999999993},"last":0.74299999999999999},{"interface":"front","average":{"1min":7.742,"5min":3.524,"15min":2.669},"min":{"1min":0.51900000000000002,"5min":0.48699999999999999,"15min":0.45900000000000002},"max":{"1min":60.134,"5min":60.134,"15min":60.134},"last":1.2889999999999999}]},{"osd":7,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":3.5329999999999999,"5min":2.2530000000000001,"15min":2.2669999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":21.495000000000001,"5min":21.495000000000001,"15min":21.495000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":4.7720000000000002,"5min":2.7719999999999998,"15min":2.5339999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45700000000000002},"max":{"1min":21.449000000000002,"5min":21.449000000000002,"15min":21.449000000000002},"last":0.59999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834580570,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":971168,"kb_used_data":1112,"kb_used_omap":23947,"kb_used_meta":946100,"kb_avail":93400672,"statfs":{"total":96636764160,"available":95642288128,"internally_reserved":0,"allocated":1138688,"data_stored":836494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24521912,"internal_metadata":968807240},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":86,"apply_latency_ms":86,"commit_latency_ns":86000000,"apply_latency_ns":86000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 7 04:01:04 2023","interfaces":[{"interface":"back","average":{"1min":4.4340000000000002,"5min":2.1320000000000001,"15min":1.4199999999999999},"min":{"1min":0.28100000000000003,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":26.895,"5min":26.895,"15min":26.895},"last":7.8769999999999998},{"interface":"front","average":{"1min":3.5739999999999998,"5min":1.8380000000000001,"15min":1.909},"min":{"1min":0.27900000000000003,"5min":0.27600000000000002,"15min":0.26000000000000001},"max":{"1min":17.221,"5min":17.221,"15min":32.700000000000003},"last":10.561999999999999}]},{"osd":2,"last update":"Fri Jul 7 04:00:26 2023","interfaces":[{"interface":"back","average":{"1min":3.0470000000000002,"5min":1.6399999999999999,"15min":1.534},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.25600000000000001},"max":{"1min":14.9,"5min":14.9,"15min":19.475999999999999},"last":7.8410000000000002},{"interface":"front","average":{"1min":2.3809999999999998,"5min":1.742,"15min":1.784},"min":{"1min":0.29399999999999998,"5min":0.26900000000000002,"15min":0.26600000000000001},"max":{"1min":17.254999999999999,"5min":17.254999999999999,"15min":17.254999999999999},"last":10.605}]},{"osd":3,"last update":"Fri Jul 7 04:00:26 2023","interfaces":[{"interface":"back","average":{"1min":5.2400000000000002,"5min":2.2519999999999998,"15min":1.774},"min":{"1min":0.35799999999999998,"5min":0.29299999999999998,"15min":0.26200000000000001},"max":{"1min":44.267000000000003,"5min":44.267000000000003,"15min":44.267000000000003},"last":7.7729999999999997},{"interface":"front","average":{"1min":2.464,"5min":1.724,"15min":1.6160000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":14.843999999999999,"5min":14.843999999999999,"15min":32.759999999999998},"last":7.9160000000000004}]},{"osd":4,"last update":"Fri Jul 7 04:00:26 2023","interfaces":[{"interface":"back","average":{"1min":2.5270000000000001,"5min":1.732,"15min":1.7410000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.32500000000000001},"max":{"1min":17.125,"5min":17.125,"15min":17.125},"last":10.372},{"interface":"front","average":{"1min":6.6980000000000004,"5min":2.7509999999999999,"15min":2.02},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":46.898000000000003,"5min":46.898000000000003,"15min":46.898000000000003},"last":7.6280000000000001}]},{"osd":5,"last update":"Fri Jul 7 04:00:26 2023","interfaces":[{"interface":"back","average":{"1min":4.9720000000000004,"5min":2.516,"15min":2.0590000000000002},"min":{"1min":0.434,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":44.174999999999997,"5min":44.174999999999997,"15min":44.174999999999997},"last":7.7409999999999997},{"interface":"front","average":{"1min":2.5249999999999999,"5min":1.607,"15min":1.4770000000000001},"min":{"1min":0.45500000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":22.643999999999998,"5min":22.643999999999998,"15min":22.643999999999998},"last":7.7930000000000001}]},{"osd":6,"last update":"Fri Jul 7 04:01:04 2023","interfaces":[{"interface":"back","average":{"1min":7.1109999999999998,"5min":2.512,"15min":1.867},"min":{"1min":0.49299999999999999,"5min":0.41699999999999998,"15min":0.41199999999999998},"max":{"1min":48.225999999999999,"5min":48.225999999999999,"15min":48.225999999999999},"last":7.5720000000000001},{"interface":"front","average":{"1min":6.2880000000000003,"5min":2.4649999999999999,"15min":2.1629999999999998},"min":{"1min":0.42099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":44.990000000000002,"5min":44.990000000000002,"15min":44.990000000000002},"last":10.470000000000001}]},{"osd":7,"last update":"Fri Jul 7 04:00:26 2023","interfaces":[{"interface":"back","average":{"1min":3.0459999999999998,"5min":2.0609999999999999,"15min":2.2999999999999998},"min":{"1min":0.53000000000000003,"5min":0.45700000000000002,"15min":0.39600000000000002},"max":{"1min":17.155999999999999,"5min":17.155999999999999,"15min":17.155999999999999},"last":10.516999999999999},{"interface":"front","average":{"1min":5.8760000000000003,"5min":2.8260000000000001,"15min":2.2469999999999999},"min":{"1min":0.503,"5min":0.49299999999999999,"15min":0.42699999999999999},"max":{"1min":44.228999999999999,"5min":44.228999999999999,"15min":44.228999999999999},"last":7.702}]}]},{"osd":2,"up_from":13,"seq":55834580603,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1847004,"kb_used_data":532,"kb_used_omap":11342,"kb_used_meta":1835121,"kb_avail":92524836,"statfs":{"total":96636764160,"available":94745432064,"internally_reserved":0,"allocated":544768,"data_stored":246126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11614252,"internal_metadata":1879164884},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":58,"apply_latency_ms":58,"commit_latency_ns":58000000,"apply_latency_ns":58000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:23 2023","interfaces":[{"interface":"back","average":{"1min":1.843,"5min":1.3440000000000001,"15min":1.2270000000000001},"min":{"1min":0.253,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":11.614000000000001,"5min":11.614000000000001,"15min":11.898999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":2.3580000000000001,"5min":1.6020000000000001,"15min":1.389},"min":{"1min":0.28299999999999997,"5min":0.26700000000000002,"15min":0.25},"max":{"1min":24.515000000000001,"5min":24.515000000000001,"15min":24.515000000000001},"last":0.50700000000000001}]},{"osd":1,"last update":"Fri Jul 7 04:00:32 2023","interfaces":[{"interface":"back","average":{"1min":2.016,"5min":1.526,"15min":1.3340000000000001},"min":{"1min":0.28899999999999998,"5min":0.26600000000000001,"15min":0.248},"max":{"1min":10.263999999999999,"5min":10.263999999999999,"15min":10.263999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":2.8999999999999999,"5min":1.7669999999999999,"15min":1.5009999999999999},"min":{"1min":0.36799999999999999,"5min":0.28799999999999998,"15min":0.26400000000000001},"max":{"1min":16.858000000000001,"5min":16.858000000000001,"15min":16.858000000000001},"last":0.61699999999999999}]},{"osd":3,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":7.9550000000000001,"5min":3.1200000000000001,"15min":1.9930000000000001},"min":{"1min":0.28799999999999998,"5min":0.28599999999999998,"15min":0.252},"max":{"1min":96.594999999999999,"5min":96.594999999999999,"15min":96.594999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":3.4649999999999999,"5min":1.752,"15min":1.472},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.29599999999999999},"max":{"1min":22.445,"5min":22.445,"15min":22.445},"last":0.48199999999999998}]},{"osd":4,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.333,"15min":1.2430000000000001},"min":{"1min":0.36599999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":7.9710000000000001,"5min":7.9710000000000001,"15min":8.6340000000000003},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.99,"5min":1.6299999999999999,"15min":1.5980000000000001},"min":{"1min":0.38700000000000001,"5min":0.38300000000000001,"15min":0.34999999999999998},"max":{"1min":10.791,"5min":10.791,"15min":10.791},"last":0.85299999999999998}]},{"osd":5,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":2.3100000000000001,"5min":1.994,"15min":1.861},"min":{"1min":0.41899999999999998,"5min":0.39000000000000001,"15min":0.38500000000000001},"max":{"1min":12.581,"5min":12.581,"15min":12.581},"last":0.872},{"interface":"front","average":{"1min":2.0819999999999999,"5min":1.8340000000000001,"15min":1.6279999999999999},"min":{"1min":0.41599999999999998,"5min":0.39500000000000002,"15min":0.39300000000000002},"max":{"1min":12.428000000000001,"5min":12.428000000000001,"15min":12.428000000000001},"last":0.64700000000000002}]},{"osd":6,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":1.931,"5min":1.956,"15min":1.794},"min":{"1min":0.42199999999999999,"5min":0.40999999999999998,"15min":0.39100000000000001},"max":{"1min":10.855,"5min":10.855,"15min":11.019},"last":0.92000000000000004},{"interface":"front","average":{"1min":2.714,"5min":2.1859999999999999,"15min":2.0600000000000001},"min":{"1min":0.46200000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":12.481,"5min":12.481,"15min":12.481},"last":0.77700000000000002}]},{"osd":7,"last update":"Fri Jul 7 04:00:24 2023","interfaces":[{"interface":"back","average":{"1min":2.6019999999999999,"5min":2.0099999999999998,"15min":1.869},"min":{"1min":0.48599999999999999,"5min":0.45800000000000002,"15min":0.42599999999999999},"max":{"1min":10.890000000000001,"5min":10.890000000000001,"15min":10.890000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":2.4020000000000001,"5min":2.2810000000000001,"15min":2.1869999999999998},"min":{"1min":0.51400000000000001,"5min":0.48299999999999998,"15min":0.45300000000000001},"max":{"1min":12.617000000000001,"5min":12.617000000000001,"15min":12.617000000000001},"last":0.93500000000000005}]}]},{"osd":3,"up_from":13,"seq":55834580590,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1699036,"kb_used_data":532,"kb_used_omap":20609,"kb_used_meta":1677886,"kb_avail":92672804,"statfs":{"total":96636764160,"available":94896951296,"internally_reserved":0,"allocated":544768,"data_stored":246126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21104547,"internal_metadata":1718155357},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":69,"apply_latency_ms":69,"commit_latency_ns":69000000,"apply_latency_ns":69000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:37 2023","interfaces":[{"interface":"back","average":{"1min":2.6600000000000001,"5min":1.411,"15min":1.2130000000000001},"min":{"1min":0.24399999999999999,"5min":0.23699999999999999,"15min":0.22800000000000001},"max":{"1min":18.285,"5min":18.285,"15min":18.285},"last":8.2029999999999994},{"interface":"front","average":{"1min":2.9199999999999999,"5min":1.7210000000000001,"15min":1.716},"min":{"1min":0.247,"5min":0.247,"15min":0.23799999999999999},"max":{"1min":19.972000000000001,"5min":19.972000000000001,"15min":19.972000000000001},"last":9.1739999999999995}]},{"osd":1,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":2.258,"5min":2.3860000000000001,"15min":1.758},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.23699999999999999},"max":{"1min":15.093,"5min":61.411000000000001,"15min":61.411000000000001},"last":5.1520000000000001},{"interface":"front","average":{"1min":2.9620000000000002,"5min":1.706,"15min":1.575},"min":{"1min":0.314,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":18.222000000000001,"5min":18.222000000000001,"15min":18.222000000000001},"last":0.67200000000000004}]},{"osd":2,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":2.9500000000000002,"5min":2.4900000000000002,"15min":1.978},"min":{"1min":0.317,"5min":0.312,"15min":0.28299999999999997},"max":{"1min":14.986000000000001,"5min":61.511000000000003,"15min":61.511000000000003},"last":5.1059999999999999},{"interface":"front","average":{"1min":4.6500000000000004,"5min":2.4660000000000002,"15min":1.9339999999999999},"min":{"1min":0.45600000000000002,"5min":0.314,"15min":0.314},"max":{"1min":20.542000000000002,"5min":61.707000000000001,"15min":61.707000000000001},"last":0.59099999999999997}]},{"osd":4,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":4.5419999999999998,"5min":2.8090000000000002,"15min":2.2120000000000002},"min":{"1min":0.38,"5min":0.33000000000000002,"15min":0.32300000000000001},"max":{"1min":21.120000000000001,"5min":61.453000000000003,"15min":61.453000000000003},"last":1.0429999999999999},{"interface":"front","average":{"1min":2.5750000000000002,"5min":2.3010000000000002,"15min":1.843},"min":{"1min":0.377,"5min":0.377,"15min":0.35699999999999998},"max":{"1min":15.122,"5min":61.558,"15min":61.558},"last":4.9969999999999999}]},{"osd":5,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":3.8490000000000002,"5min":1.921,"15min":1.659},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":21.388999999999999,"5min":21.388999999999999,"15min":21.388999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":5.0069999999999997,"5min":2.4740000000000002,"15min":2.2080000000000002},"min":{"1min":0.46000000000000002,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":32.100999999999999,"5min":32.100999999999999,"15min":32.100999999999999},"last":0.68300000000000005}]},{"osd":6,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":4.2039999999999997,"5min":2.5790000000000002,"15min":2.1389999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":27.613,"5min":61.667000000000002,"15min":61.667000000000002},"last":5.1959999999999997},{"interface":"front","average":{"1min":7.2060000000000004,"5min":2.7999999999999998,"15min":2.0680000000000001},"min":{"1min":0.45800000000000002,"5min":0.44400000000000001,"15min":0.442},"max":{"1min":83.242000000000004,"5min":83.242000000000004,"15min":83.242000000000004},"last":2.4020000000000001}]},{"osd":7,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":4.516,"5min":2.5310000000000001,"15min":2.3620000000000001},"min":{"1min":0.49299999999999999,"5min":0.42299999999999999,"15min":0.40100000000000002},"max":{"1min":19.928000000000001,"5min":19.928000000000001,"15min":19.928000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":3.0960000000000001,"5min":2.7189999999999999,"15min":2.3130000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":15.063000000000001,"5min":61.621000000000002,"15min":61.621000000000002},"last":5.0679999999999996}]}]},{"osd":4,"up_from":13,"seq":55834580633,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1293020,"kb_used_data":532,"kb_used_omap":11728,"kb_used_meta":1280751,"kb_avail":93078820,"statfs":{"total":96636764160,"available":95312711680,"internally_reserved":0,"allocated":544768,"data_stored":246126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12010156,"internal_metadata":1311489364},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":7.8529999999999998,"5min":2.2999999999999998,"15min":1.486},"min":{"1min":0.252,"5min":0.252,"15min":0.251},"max":{"1min":97.753,"5min":97.753,"15min":97.753},"last":3.169},{"interface":"front","average":{"1min":3.6150000000000002,"5min":1.7450000000000001,"15min":1.6279999999999999},"min":{"1min":0.30299999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":30.262,"5min":30.262,"15min":30.262},"last":17.577000000000002}]},{"osd":1,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":3.843,"5min":1.8,"15min":1.772},"min":{"1min":0.28999999999999998,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":25.344999999999999,"5min":25.344999999999999,"15min":25.344999999999999},"last":3.2599999999999998},{"interface":"front","average":{"1min":4.6109999999999998,"5min":2.1850000000000001,"15min":1.77},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":66.322000000000003,"5min":66.322000000000003,"15min":66.322000000000003},"last":3.2069999999999999}]},{"osd":2,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":2.8170000000000002,"5min":1.8200000000000001,"15min":1.831},"min":{"1min":0.36199999999999999,"5min":0.308,"15min":0.308},"max":{"1min":7.9800000000000004,"5min":7.9800000000000004,"15min":13.151999999999999},"last":3.3029999999999999},{"interface":"front","average":{"1min":3.1960000000000002,"5min":1.899,"15min":1.97},"min":{"1min":0.42299999999999999,"5min":0.34300000000000003,"15min":0.33300000000000002},"max":{"1min":10.395,"5min":10.395,"15min":10.395},"last":10.051}]},{"osd":3,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":3.4689999999999999,"5min":2.3130000000000002,"15min":2.0899999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":21.390999999999998,"5min":21.390999999999998,"15min":21.390999999999998},"last":8.0440000000000005},{"interface":"front","average":{"1min":3.5609999999999999,"5min":2.1299999999999999,"15min":2.1499999999999999},"min":{"1min":0.45600000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":11.641999999999999,"5min":11.641999999999999,"15min":11.641999999999999},"last":0.55000000000000004}]},{"osd":5,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":4.1959999999999997,"5min":1.694,"15min":1.3100000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.30499999999999999},"max":{"1min":51.551000000000002,"5min":51.551000000000002,"15min":51.551000000000002},"last":3.2389999999999999},{"interface":"front","average":{"1min":2.3439999999999999,"5min":1.242,"15min":1.427},"min":{"1min":0.371,"5min":0.33100000000000002,"15min":0.317},"max":{"1min":22.038,"5min":22.038,"15min":22.038},"last":7.0389999999999997}]},{"osd":6,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.0760000000000001,"15min":1.4590000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.29699999999999999},"max":{"1min":4.1959999999999997,"5min":7.9189999999999996,"15min":8.0760000000000005},"last":3.335},{"interface":"front","average":{"1min":4.2670000000000003,"5min":1.7390000000000001,"15min":1.5580000000000001},"min":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.371},"max":{"1min":66.373999999999995,"5min":66.373999999999995,"15min":66.373999999999995},"last":7.3780000000000001}]},{"osd":7,"last update":"Fri Jul 7 04:00:29 2023","interfaces":[{"interface":"back","average":{"1min":1.962,"5min":1.3180000000000001,"15min":1.5349999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.36599999999999999},"max":{"1min":8.0399999999999991,"5min":8.0399999999999991,"15min":11.585000000000001},"last":4.1980000000000004},{"interface":"front","average":{"1min":0.97499999999999998,"5min":1.1180000000000001,"15min":1.52},"min":{"1min":0.375,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":3.7970000000000002,"5min":7.1449999999999996,"15min":12.414},"last":0.496}]}]},{"osd":5,"up_from":13,"seq":55834580639,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1601052,"kb_used_data":532,"kb_used_omap":19606,"kb_used_meta":1580905,"kb_avail":92770788,"statfs":{"total":96636764160,"available":94997286912,"internally_reserved":0,"allocated":544768,"data_stored":246126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20076954,"internal_metadata":1618847334},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":65,"apply_latency_ms":65,"commit_latency_ns":65000000,"apply_latency_ns":65000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":4.0099999999999998,"5min":1.6100000000000001,"15min":1.4730000000000001},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":46.174999999999997,"5min":46.174999999999997,"15min":46.174999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":2.0579999999999998,"5min":1.675,"15min":1.804},"min":{"1min":0.28799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":11.06,"5min":13.792999999999999,"15min":38.530999999999999},"last":0.62}]},{"osd":1,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":2.8319999999999999,"5min":1.6539999999999999,"15min":1.6439999999999999},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.28299999999999997},"max":{"1min":15.209,"5min":15.209,"15min":15.343},"last":0.66700000000000004},{"interface":"front","average":{"1min":4.2779999999999996,"5min":2.0379999999999998,"15min":1.746},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.29599999999999999},"max":{"1min":33.927999999999997,"5min":33.927999999999997,"15min":33.927999999999997},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":2.319,"5min":1.7070000000000001,"15min":2.097},"min":{"1min":0.39200000000000002,"5min":0.29799999999999999,"15min":0.28699999999999998},"max":{"1min":9.5609999999999999,"5min":9.5609999999999999,"15min":10.222},"last":0.53200000000000003},{"interface":"front","average":{"1min":2.4300000000000002,"5min":1.893,"15min":1.6639999999999999},"min":{"1min":0.41299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":13.628,"5min":13.628,"15min":15.398},"last":0.58899999999999997}]},{"osd":3,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":3.8929999999999998,"5min":2.141,"15min":1.9930000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":33.828000000000003,"5min":33.828000000000003,"15min":33.828000000000003},"last":0.64000000000000001},{"interface":"front","average":{"1min":2.476,"5min":2.069,"15min":2.1070000000000002},"min":{"1min":0.443,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":13.595000000000001,"5min":13.595000000000001,"15min":15.43},"last":0.77300000000000002}]},{"osd":4,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":3.306,"5min":1.752,"15min":1.373},"min":{"1min":0.32400000000000001,"5min":0.308,"15min":0.27800000000000002},"max":{"1min":28.396999999999998,"5min":28.396999999999998,"15min":28.396999999999998},"last":0.495},{"interface":"front","average":{"1min":2.7639999999999998,"5min":2.012,"15min":1.696},"min":{"1min":0.33000000000000002,"5min":0.32600000000000001,"15min":0.29199999999999998},"max":{"1min":23.481999999999999,"5min":23.481999999999999,"15min":23.481999999999999},"last":0.68700000000000006}]},{"osd":6,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":3.8210000000000002,"5min":1.913,"15min":1.667},"min":{"1min":0.36499999999999999,"5min":0.311,"15min":0.29599999999999999},"max":{"1min":55.161000000000001,"5min":55.161000000000001,"15min":55.161000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":4.1879999999999997,"5min":1.8899999999999999,"15min":1.669},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.32900000000000001},"max":{"1min":62.456000000000003,"5min":62.456000000000003,"15min":62.456000000000003},"last":0.75800000000000001}]},{"osd":7,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":1.839,"5min":1.629,"15min":1.78},"min":{"1min":0.41099999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":7.1710000000000003,"5min":24.16,"15min":24.16},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.92800000000000005,"5min":1.327,"15min":1.468},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.37},"max":{"1min":3.3980000000000001,"5min":17.751000000000001,"15min":17.751000000000001},"last":0.81200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-07T04:01:24.842 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-07-06T19:58:46.687678+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=19, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=7, tm_hour=4, tm_min=1, tm_sec=18, tm_wday=4, tm_yday=188, tm_isdst=0) 2023-07-07T04:01:24.843 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-07-06T19:58:46.687678+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=19, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=7, tm_hour=4, tm_min=1, tm_sec=18, tm_wday=4, tm_yday=188, tm_isdst=0) 2023-07-07T04:01:24.843 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-07-06T19:58:46.687678+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=19, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=7, tm_hour=4, tm_min=1, tm_sec=18, tm_wday=4, tm_yday=188, tm_isdst=0) 2023-07-07T04:01:24.843 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-07-06T19:58:46.687678+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=19, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=7, tm_hour=4, tm_min=1, tm_sec=18, tm_wday=4, tm_yday=188, tm_isdst=0) 2023-07-07T04:01:24.844 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-07-06T19:58:39.653546+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=19, tm_min=58, tm_sec=39, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=7, tm_hour=4, tm_min=1, tm_sec=18, tm_wday=4, tm_yday=188, tm_isdst=0) 2023-07-07T04:01:24.844 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-07-06T19:58:46.687678+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=19, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=7, tm_hour=4, tm_min=1, tm_sec=18, tm_wday=4, tm_yday=188, tm_isdst=0) 2023-07-07T04:01:24.844 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-07-06T19:58:46.687678+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=19, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=7, tm_hour=4, tm_min=1, tm_sec=18, tm_wday=4, tm_yday=188, tm_isdst=0) 2023-07-07T04:01:24.845 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-07-06T19:58:46.687678+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=19, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=7, tm_hour=4, tm_min=1, tm_sec=18, tm_wday=4, tm_yday=188, tm_isdst=0) 2023-07-07T04:01:24.845 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-07-06T19:58:46.687678+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=6, tm_hour=19, tm_min=58, tm_sec=46, tm_wday=3, tm_yday=187, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=7, tm_hour=4, tm_min=1, tm_sec=18, tm_wday=4, tm_yday=188, tm_isdst=0) 2023-07-07T04:01:24.845 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-07T04:01:44.847 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-07T04:01:44.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.991+0000 7f3b318ea700 1 Processor -- start 2023-07-07T04:01:44.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.991+0000 7f3b318ea700 1 -- start start 2023-07-07T04:01:44.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.992+0000 7f3b318ea700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3b2c0cb280 0x7f3b2c0cf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:44.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.992+0000 7f3b318ea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b2c0ae1c0 0x7f3b2c0cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:44.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.992+0000 7f3b318ea700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2c160da0 con 0x7f3b2c0c92a0 2023-07-07T04:01:44.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.992+0000 7f3b318ea700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2c1601d0 con 0x7f3b2c0cb280 2023-07-07T04:01:44.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.992+0000 7f3b318ea700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c160470 con 0x7f3b2c0ae1c0 2023-07-07T04:01:44.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.992+0000 7f3b2b7fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f3b2c0c92a0 0x7f3b2c06a060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:49720/0 (socket says 172.21.15.6:49720) 2023-07-07T04:01:44.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.992+0000 7f3b2b7fe700 1 -- 172.21.15.6:0/1705931400 learned_addr learned my addr 172.21.15.6:0/1705931400 (peer_addr_for_me v1:172.21.15.6:0/0) 2023-07-07T04:01:44.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.992+0000 7f3b2affd700 1 --2- 172.21.15.6:0/1705931400 >> v2:172.21.15.40:3300/0 conn(0x7f3b2c0cb280 0x7f3b2c0cf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:44.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.992+0000 7f3b2a7fc700 1 --2- 172.21.15.6:0/1705931400 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b2c0ae1c0 0x7f3b2c0cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:44.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.992+0000 7f3b29ffb700 1 -- 172.21.15.6:0/1705931400 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1008075587 0 0) 0x7f3b2c160da0 con 0x7f3b2c0c92a0 2023-07-07T04:01:44.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.992+0000 7f3b29ffb700 1 -- 172.21.15.6:0/1705931400 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b140035b0 con 0x7f3b2c0c92a0 2023-07-07T04:01:44.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.992+0000 7f3b2affd700 1 -- 172.21.15.6:0/1705931400 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b2c0ae1c0 msgr2=0x7f3b2c0cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:44.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.992+0000 7f3b2affd700 1 --2- 172.21.15.6:0/1705931400 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b2c0ae1c0 0x7f3b2c0cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:44.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.992+0000 7f3b2affd700 1 -- 172.21.15.6:0/1705931400 >> v1:172.21.15.6:6789/0 conn(0x7f3b2c0c92a0 legacy=0x7f3b2c06a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:44.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.992+0000 7f3b2affd700 1 -- 172.21.15.6:0/1705931400 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c160750 con 0x7f3b2c0cb280 2023-07-07T04:01:44.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.992+0000 7f3b2a7fc700 1 --2- 172.21.15.6:0/1705931400 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b2c0ae1c0 0x7f3b2c0cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T04:01:44.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.993+0000 7f3b2affd700 1 --2- 172.21.15.6:0/1705931400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b2c0cb280 0x7f3b2c0cf570 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c009840 tx=0x7f3b1c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82c753f8cd98c105 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:44.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.993+0000 7f3b29ffb700 1 -- 172.21.15.6:0/1705931400 <== mon.1 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c011830 con 0x7f3b2c0cb280 2023-07-07T04:01:44.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.993+0000 7f3b29ffb700 1 -- 172.21.15.6:0/1705931400 <== mon.1 v2:172.21.15.40:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c011990 con 0x7f3b2c0cb280 2023-07-07T04:01:44.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.993+0000 7f3b29ffb700 1 -- 172.21.15.6:0/1705931400 <== mon.1 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c011d20 con 0x7f3b2c0cb280 2023-07-07T04:01:45.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.993+0000 7f3b318ea700 1 -- 172.21.15.6:0/1705931400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b2c0cb280 msgr2=0x7f3b2c0cf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:45.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.993+0000 7f3b318ea700 1 --2- 172.21.15.6:0/1705931400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b2c0cb280 0x7f3b2c0cf570 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c009840 tx=0x7f3b1c009b50 comp rx=0 tx=0).stop 2023-07-07T04:01:45.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.993+0000 7f3b318ea700 1 -- 172.21.15.6:0/1705931400 shutdown_connections 2023-07-07T04:01:45.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.993+0000 7f3b318ea700 1 --2- 172.21.15.6:0/1705931400 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b2c0cb280 0x7f3b2c0cf570 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:45.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.993+0000 7f3b318ea700 1 --2- 172.21.15.6:0/1705931400 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b2c0ae1c0 0x7f3b2c0cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:45.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.993+0000 7f3b318ea700 1 -- 172.21.15.6:0/1705931400 >> 172.21.15.6:0/1705931400 conn(0x7f3b2c0b1470 msgr2=0x7f3b2c0cec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:45.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.993+0000 7f3b318ea700 1 -- 172.21.15.6:0/1705931400 shutdown_connections 2023-07-07T04:01:45.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.993+0000 7f3b318ea700 1 -- 172.21.15.6:0/1705931400 wait complete. 2023-07-07T04:01:45.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.995+0000 7f3b318ea700 1 Processor -- start 2023-07-07T04:01:45.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.995+0000 7f3b318ea700 1 -- start start 2023-07-07T04:01:45.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.996+0000 7f3b318ea700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b2c0ae1c0 0x7f3b2c149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:45.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.996+0000 7f3b318ea700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b2c0c92a0 0x7f3b2c0ac910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:45.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.996+0000 7f3b318ea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b2c0cb280 0x7f3b2c15aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:45.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.996+0000 7f3b318ea700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0add90 con 0x7f3b2c0cb280 2023-07-07T04:01:45.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.996+0000 7f3b318ea700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0ad210 con 0x7f3b2c0ae1c0 2023-07-07T04:01:45.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.996+0000 7f3b318ea700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0ad4f0 con 0x7f3b2c0c92a0 2023-07-07T04:01:45.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.996+0000 7f3b2b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b2c0cb280 0x7f3b2c15aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:45.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.996+0000 7f3b2b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b2c0cb280 0x7f3b2c15aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48520/0 (socket says 172.21.15.6:48520) 2023-07-07T04:01:45.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.996+0000 7f3b2b7fe700 1 -- 172.21.15.6:0/1301358297 learned_addr learned my addr 172.21.15.6:0/1301358297 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:45.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.996+0000 7f3b2affd700 1 --2- 172.21.15.6:0/1301358297 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b2c0ae1c0 0x7f3b2c149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:45.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.996+0000 7f3b2a7fc700 1 --2- 172.21.15.6:0/1301358297 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b2c0c92a0 0x7f3b2c0ac910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:45.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.996+0000 7f3b2b7fe700 1 -- 172.21.15.6:0/1301358297 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b2c0c92a0 msgr2=0x7f3b2c0ac910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:45.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.996+0000 7f3b2b7fe700 1 --2- 172.21.15.6:0/1301358297 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b2c0c92a0 0x7f3b2c0ac910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:45.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.996+0000 7f3b2b7fe700 1 -- 172.21.15.6:0/1301358297 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b2c0ae1c0 msgr2=0x7f3b2c149f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:45.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.996+0000 7f3b2b7fe700 1 --2- 172.21.15.6:0/1301358297 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b2c0ae1c0 0x7f3b2c149f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:45.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.996+0000 7f3b2b7fe700 1 -- 172.21.15.6:0/1301358297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b200094a0 con 0x7f3b2c0cb280 2023-07-07T04:01:45.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.996+0000 7f3b2b7fe700 1 --2- 172.21.15.6:0/1301358297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b2c0cb280 0x7f3b2c15aa60 secure :-1 s=READY pgs=3398 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400cb40 tx=0x7f3b2400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:45.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.996+0000 7f3b13fff700 1 -- 172.21.15.6:0/1301358297 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2400a9e0 con 0x7f3b2c0cb280 2023-07-07T04:01:45.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.997+0000 7f3b13fff700 1 -- 172.21.15.6:0/1301358297 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2400ab40 con 0x7f3b2c0cb280 2023-07-07T04:01:45.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.997+0000 7f3b318ea700 1 -- 172.21.15.6:0/1301358297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b1c0094a0 con 0x7f3b2c0cb280 2023-07-07T04:01:45.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.997+0000 7f3b13fff700 1 -- 172.21.15.6:0/1301358297 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24012400 con 0x7f3b2c0cb280 2023-07-07T04:01:45.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.997+0000 7f3b318ea700 1 -- 172.21.15.6:0/1301358297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2c0adab0 con 0x7f3b2c0cb280 2023-07-07T04:01:45.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.998+0000 7f3b318ea700 1 -- 172.21.15.6:0/1301358297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b2c06da60 con 0x7f3b2c0cb280 2023-07-07T04:01:45.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.998+0000 7f3b13fff700 1 -- 172.21.15.6:0/1301358297 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3b2401b3b0 con 0x7f3b2c0cb280 2023-07-07T04:01:45.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.999+0000 7f3b13fff700 1 --2- 172.21.15.6:0/1301358297 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3b1806ace0 0x7f3b1806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:45.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.999+0000 7f3b13fff700 1 -- 172.21.15.6:0/1301358297 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f3b24088ee0 con 0x7f3b2c0cb280 2023-07-07T04:01:45.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.999+0000 7f3b2affd700 1 --2- 172.21.15.6:0/1301358297 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3b1806ace0 0x7f3b1806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:45.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:44.999+0000 7f3b2affd700 1 --2- 172.21.15.6:0/1301358297 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3b1806ace0 0x7f3b1806d190 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c000c00 tx=0x7f3b1c01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:45.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.004+0000 7f3b13fff700 1 -- 172.21.15.6:0/1301358297 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3b24054170 con 0x7f3b2c0cb280 2023-07-07T04:01:45.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.207+0000 7f3b318ea700 1 -- 172.21.15.6:0/1301358297 --> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3b2c0ad660 con 0x7f3b1806ace0 2023-07-07T04:01:45.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.210+0000 7f3b13fff700 1 -- 172.21.15.6:0/1301358297 <== mgr.4110 v2:172.21.15.6:6832/201543369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+71559 (secure 0 0 0) 0x7f3b2c0ad660 con 0x7f3b1806ace0 2023-07-07T04:01:45.214 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:01:45.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.212+0000 7f3b318ea700 1 -- 172.21.15.6:0/1301358297 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3b1806ace0 msgr2=0x7f3b1806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:45.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.212+0000 7f3b318ea700 1 --2- 172.21.15.6:0/1301358297 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3b1806ace0 0x7f3b1806d190 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c000c00 tx=0x7f3b1c01c040 comp rx=0 tx=0).stop 2023-07-07T04:01:45.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.212+0000 7f3b318ea700 1 -- 172.21.15.6:0/1301358297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b2c0cb280 msgr2=0x7f3b2c15aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:45.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.213+0000 7f3b318ea700 1 --2- 172.21.15.6:0/1301358297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b2c0cb280 0x7f3b2c15aa60 secure :-1 s=READY pgs=3398 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400cb40 tx=0x7f3b2400ce50 comp rx=0 tx=0).stop 2023-07-07T04:01:45.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.213+0000 7f3b318ea700 1 -- 172.21.15.6:0/1301358297 shutdown_connections 2023-07-07T04:01:45.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.213+0000 7f3b318ea700 1 --2- 172.21.15.6:0/1301358297 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f3b1806ace0 0x7f3b1806d190 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:45.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.213+0000 7f3b318ea700 1 --2- 172.21.15.6:0/1301358297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b2c0cb280 0x7f3b2c15aa60 unknown :-1 s=CLOSED pgs=3398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:45.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.213+0000 7f3b318ea700 1 --2- 172.21.15.6:0/1301358297 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b2c0ae1c0 0x7f3b2c149f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:45.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.213+0000 7f3b318ea700 1 --2- 172.21.15.6:0/1301358297 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f3b2c0c92a0 0x7f3b2c0ac910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:45.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.213+0000 7f3b318ea700 1 -- 172.21.15.6:0/1301358297 >> 172.21.15.6:0/1301358297 conn(0x7f3b2c0b1470 msgr2=0x7f3b2c15be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:45.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.213+0000 7f3b318ea700 1 -- 172.21.15.6:0/1301358297 shutdown_connections 2023-07-07T04:01:45.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.213+0000 7f3b318ea700 1 -- 172.21.15.6:0/1301358297 wait complete. 2023-07-07T04:01:45.220 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-07-07T04:01:45.229 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":14523,"stamp":"2023-07-07T04:01:43.951108+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":11940968,"kb_used_data":5416,"kb_used_omap":151204,"kb_used_meta":11784283,"kb_avail":743033752,"statfs":{"total":773094113280,"available":760866562048,"internally_reserved":0,"allocated":5545984,"data_stored":3149744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":154833875,"internal_metadata":12067105837},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002760"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":304,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:23.736513+0000","last_change":"2023-07-07T04:01:23.736558+0000","last_active":"2023-07-07T04:01:23.736513+0000","last_peered":"2023-07-07T04:01:23.736513+0000","last_clean":"2023-07-07T04:01:23.736513+0000","last_became_active":"2023-07-06T19:58:47.723553+0000","last_became_peered":"2023-07-06T19:58:47.723553+0000","last_unstale":"2023-07-07T04:01:23.736513+0000","last_undegraded":"2023-07-07T04:01:23.736513+0000","last_fullsized":"2023-07-07T04:01:23.736513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T04:01:23.736383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T04:01:23.736383+0000","last_clean_scrub_stamp":"2023-07-07T04:01:23.736383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T14:01:34.100462+0000","scrub_duration":0.054127794999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":299,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:27.922229+0000","last_change":"2023-07-07T04:01:27.922279+0000","last_active":"2023-07-07T04:01:27.922229+0000","last_peered":"2023-07-07T04:01:27.922229+0000","last_clean":"2023-07-07T04:01:27.922229+0000","last_became_active":"2023-07-06T19:58:47.704921+0000","last_became_peered":"2023-07-06T19:58:47.704921+0000","last_unstale":"2023-07-07T04:01:27.922229+0000","last_undegraded":"2023-07-07T04:01:27.922229+0000","last_fullsized":"2023-07-07T04:01:27.922229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T04:01:27.922120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T04:01:27.922120+0000","last_clean_scrub_stamp":"2023-07-07T04:01:27.922120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T10:34:18.389033+0000","scrub_duration":0.072915598999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":300,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:25.478975+0000","last_change":"2023-07-07T04:01:25.479028+0000","last_active":"2023-07-07T04:01:25.478975+0000","last_peered":"2023-07-07T04:01:25.478975+0000","last_clean":"2023-07-07T04:01:25.478975+0000","last_became_active":"2023-07-06T19:58:47.766697+0000","last_became_peered":"2023-07-06T19:58:47.766697+0000","last_unstale":"2023-07-07T04:01:25.478975+0000","last_undegraded":"2023-07-07T04:01:25.478975+0000","last_fullsized":"2023-07-07T04:01:25.478975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T04:01:25.478852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T04:01:25.478852+0000","last_clean_scrub_stamp":"2023-07-07T04:01:25.478852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T15:53:27.241956+0000","scrub_duration":0.065426633999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":299,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:23.932539+0000","last_change":"2023-07-07T04:01:23.932589+0000","last_active":"2023-07-07T04:01:23.932539+0000","last_peered":"2023-07-07T04:01:23.932539+0000","last_clean":"2023-07-07T04:01:23.932539+0000","last_became_active":"2023-07-06T19:58:47.704172+0000","last_became_peered":"2023-07-06T19:58:47.704172+0000","last_unstale":"2023-07-07T04:01:23.932539+0000","last_undegraded":"2023-07-07T04:01:23.932539+0000","last_fullsized":"2023-07-07T04:01:23.932539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T04:01:23.932080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T04:01:23.932080+0000","last_clean_scrub_stamp":"2023-07-07T04:01:23.932080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T14:23:29.757361+0000","scrub_duration":0.073311051000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"46'163","reported_seq":521,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:28.705205+0000","last_change":"2023-07-07T04:01:28.705268+0000","last_active":"2023-07-07T04:01:28.705205+0000","last_peered":"2023-07-07T04:01:28.705205+0000","last_clean":"2023-07-07T04:01:28.705205+0000","last_became_active":"2023-07-06T19:58:40.971570+0000","last_became_peered":"2023-07-06T19:58:40.971570+0000","last_unstale":"2023-07-07T04:01:28.705205+0000","last_undegraded":"2023-07-07T04:01:28.705205+0000","last_fullsized":"2023-07-07T04:01:28.705205+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'163","last_scrub_stamp":"2023-07-07T04:01:28.705106+0000","last_deep_scrub":"46'163","last_deep_scrub_stamp":"2023-07-07T04:01:28.705106+0000","last_clean_scrub_stamp":"2023-07-07T04:01:28.705106+0000","objects_scrubbed":2,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T10:14:29.869135+0000","scrub_duration":0.050228495999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":310,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:30.710485+0000","last_change":"2023-07-07T04:01:30.710537+0000","last_active":"2023-07-07T04:01:30.710485+0000","last_peered":"2023-07-07T04:01:30.710485+0000","last_clean":"2023-07-07T04:01:30.710485+0000","last_became_active":"2023-07-06T19:58:47.708230+0000","last_became_peered":"2023-07-06T19:58:47.708230+0000","last_unstale":"2023-07-07T04:01:30.710485+0000","last_undegraded":"2023-07-07T04:01:30.710485+0000","last_fullsized":"2023-07-07T04:01:30.710485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T04:01:30.710373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T04:01:30.710373+0000","last_clean_scrub_stamp":"2023-07-07T04:01:30.710373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T05:29:03.411577+0000","scrub_duration":0.051019479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":298,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:32.740221+0000","last_change":"2023-07-07T04:01:32.740272+0000","last_active":"2023-07-07T04:01:32.740221+0000","last_peered":"2023-07-07T04:01:32.740221+0000","last_clean":"2023-07-07T04:01:32.740221+0000","last_became_active":"2023-07-06T19:58:47.723646+0000","last_became_peered":"2023-07-06T19:58:47.723646+0000","last_unstale":"2023-07-07T04:01:32.740221+0000","last_undegraded":"2023-07-07T04:01:32.740221+0000","last_fullsized":"2023-07-07T04:01:32.740221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T04:01:32.740097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T04:01:32.740097+0000","last_clean_scrub_stamp":"2023-07-07T04:01:32.740097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T12:38:24.133421+0000","scrub_duration":0.073643942000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":297,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:22.793871+0000","last_change":"2023-07-07T04:01:22.793922+0000","last_active":"2023-07-07T04:01:22.793871+0000","last_peered":"2023-07-07T04:01:22.793871+0000","last_clean":"2023-07-07T04:01:22.793871+0000","last_became_active":"2023-07-06T19:58:47.711591+0000","last_became_peered":"2023-07-06T19:58:47.711591+0000","last_unstale":"2023-07-07T04:01:22.793871+0000","last_undegraded":"2023-07-07T04:01:22.793871+0000","last_fullsized":"2023-07-07T04:01:22.793871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T04:01:22.793732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T04:01:22.793732+0000","last_clean_scrub_stamp":"2023-07-07T04:01:22.793732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T04:45:22.045582+0000","scrub_duration":0.12187975700000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":294,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-07-07T04:01:29.233915+0000","last_change":"2023-07-07T04:01:29.233965+0000","last_active":"2023-07-07T04:01:29.233915+0000","last_peered":"2023-07-07T04:01:29.233915+0000","last_clean":"2023-07-07T04:01:29.233915+0000","last_became_active":"2023-07-06T19:58:47.711788+0000","last_became_peered":"2023-07-06T19:58:47.711788+0000","last_unstale":"2023-07-07T04:01:29.233915+0000","last_undegraded":"2023-07-07T04:01:29.233915+0000","last_fullsized":"2023-07-07T04:01:29.233915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-07T04:01:29.233792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-07T04:01:29.233792+0000","last_clean_scrub_stamp":"2023-07-07T04:01:29.233792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-08T14:36:07.094866+0000","scrub_duration":0.087367274999999994,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580641,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1619360,"kb_used_data":1112,"kb_used_omap":28457,"kb_used_meta":1589782,"kb_avail":92752480,"statfs":{"total":96636764160,"available":94978539520,"internally_reserved":0,"allocated":1138688,"data_stored":836494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29140457,"internal_metadata":1627937303},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":2.7480000000000002,"5min":1.383,"15min":1.196},"min":{"1min":0.25900000000000001,"5min":0.24299999999999999,"15min":0.24199999999999999},"max":{"1min":32.406999999999996,"5min":32.406999999999996,"15min":32.406999999999996},"last":0.89200000000000002},{"interface":"front","average":{"1min":3.1840000000000002,"5min":1.9730000000000001,"15min":1.625},"min":{"1min":0.30099999999999999,"5min":0.29399999999999998,"15min":0.26900000000000002},"max":{"1min":24.928999999999998,"5min":24.928999999999998,"15min":24.928999999999998},"last":0.68000000000000005}]},{"osd":1,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":3.4169999999999998,"5min":1.7869999999999999,"15min":1.524},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":32.445,"5min":32.445,"15min":32.445},"last":0.72599999999999998},{"interface":"front","average":{"1min":2.4830000000000001,"5min":1.8180000000000001,"15min":1.8839999999999999},"min":{"1min":0.315,"5min":0.29999999999999999,"15min":0.29299999999999998},"max":{"1min":24.966000000000001,"5min":24.966000000000001,"15min":24.966000000000001},"last":0.82899999999999996}]},{"osd":2,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":4.1609999999999996,"5min":2.2440000000000002,"15min":1.887},"min":{"1min":0.376,"5min":0.35199999999999998,"15min":0.32200000000000001},"max":{"1min":36.658999999999999,"5min":36.658999999999999,"15min":36.658999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":3.3159999999999998,"5min":2.4249999999999998,"15min":2},"min":{"1min":0.41299999999999998,"5min":0.38400000000000001,"15min":0.32900000000000001},"max":{"1min":32.369,"5min":32.369,"15min":32.369},"last":0.80900000000000005}]},{"osd":3,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":5.9930000000000003,"5min":2.9969999999999999,"15min":2.2930000000000001},"min":{"1min":0.39500000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":74.998000000000005,"5min":74.998000000000005,"15min":74.998000000000005},"last":0.79700000000000004},{"interface":"front","average":{"1min":3.0670000000000002,"5min":2.085,"15min":1.99},"min":{"1min":0.39300000000000002,"5min":0.35799999999999998,"15min":0.33500000000000002},"max":{"1min":16.452999999999999,"5min":16.452999999999999,"15min":16.452999999999999},"last":0.84499999999999997}]},{"osd":4,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":3.7010000000000001,"5min":1.6870000000000001,"15min":1.5049999999999999},"min":{"1min":0.30399999999999999,"5min":0.29299999999999998,"15min":0.28599999999999998},"max":{"1min":59.920999999999999,"5min":59.920999999999999,"15min":59.920999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":2.9910000000000001,"5min":1.696,"15min":1.49},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":36.616999999999997,"5min":36.616999999999997,"15min":36.616999999999997},"last":0.74199999999999999}]},{"osd":5,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":2.508,"5min":1.3720000000000001,"15min":1.282},"min":{"1min":0.33600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":16.904,"5min":16.904,"15min":16.904},"last":0.626},{"interface":"front","average":{"1min":2.6110000000000002,"5min":1.6379999999999999,"15min":1.639},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":24.811,"5min":24.811,"15min":24.811},"last":0.77000000000000002}]},{"osd":6,"last update":"Fri Jul 7 04:00:53 2023","interfaces":[{"interface":"back","average":{"1min":3.6749999999999998,"5min":1.9830000000000001,"15min":1.8160000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":60.188000000000002,"5min":60.188000000000002,"15min":60.188000000000002},"last":0.877},{"interface":"front","average":{"1min":2.8679999999999999,"5min":1.6719999999999999,"15min":1.5149999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":24.065999999999999,"5min":24.065999999999999,"15min":24.065999999999999},"last":0.90300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834580637,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1927068,"kb_used_data":532,"kb_used_omap":17122,"kb_used_meta":1909405,"kb_avail":92444772,"statfs":{"total":96636764160,"available":94663446528,"internally_reserved":0,"allocated":544768,"data_stored":246126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":17533718,"internal_metadata":1955230954},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:01:35 2023","interfaces":[{"interface":"back","average":{"1min":1.744,"5min":1.6140000000000001,"15min":1.415},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":10.619999999999999,"5min":13.332000000000001,"15min":13.332000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":4.3940000000000001,"5min":3.0579999999999998,"15min":2.0569999999999999},"min":{"1min":0.379,"5min":0.27800000000000002,"15min":0.246},"max":{"1min":23.876999999999999,"5min":65.186000000000007,"15min":65.186000000000007},"last":0.65200000000000002}]},{"osd":1,"last update":"Fri Jul 7 04:01:35 2023","interfaces":[{"interface":"back","average":{"1min":3.7000000000000002,"5min":2.9129999999999998,"15min":2.1680000000000001},"min":{"1min":0.30499999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":23.937000000000001,"5min":23.937000000000001,"15min":23.937000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":3.5379999999999998,"5min":2.4809999999999999,"15min":1.8440000000000001},"min":{"1min":0.34699999999999998,"5min":0.29999999999999999,"15min":0.28899999999999998},"max":{"1min":23.625,"5min":40.649000000000001,"15min":40.649000000000001},"last":0.55400000000000005}]},{"osd":2,"last update":"Fri Jul 7 04:01:35 2023","interfaces":[{"interface":"back","average":{"1min":2.9590000000000001,"5min":2.306,"15min":2.0009999999999999},"min":{"1min":0.38400000000000001,"5min":0.32400000000000001,"15min":0.30599999999999999},"max":{"1min":20.449000000000002,"5min":20.449000000000002,"15min":20.449000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":3.464,"5min":2.3199999999999998,"15min":1.8959999999999999},"min":{"1min":0.435,"5min":0.30599999999999999,"15min":0.30499999999999999},"max":{"1min":23.573,"5min":23.573,"15min":23.573},"last":0.72799999999999998}]},{"osd":3,"last update":"Fri Jul 7 04:01:35 2023","interfaces":[{"interface":"back","average":{"1min":5.258,"5min":4.0910000000000002,"15min":2.754},"min":{"1min":0.44700000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":31.843,"5min":111.95399999999999,"15min":111.95399999999999},"last":0.746},{"interface":"front","average":{"1min":4.0199999999999996,"5min":3.4769999999999999,"15min":2.4449999999999998},"min":{"1min":0.439,"5min":0.40000000000000002,"15min":0.33700000000000002},"max":{"1min":31.899999999999999,"5min":112.504,"15min":112.504},"last":0.57799999999999996}]},{"osd":4,"last update":"Fri Jul 7 04:01:35 2023","interfaces":[{"interface":"back","average":{"1min":3.8999999999999999,"5min":1.8839999999999999,"15min":1.4399999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.27700000000000002},"max":{"1min":54.738,"5min":54.738,"15min":54.738},"last":0.629},{"interface":"front","average":{"1min":4.1550000000000002,"5min":2.3239999999999998,"15min":1.7110000000000001},"min":{"1min":0.35199999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":65.135000000000005,"5min":65.135000000000005,"15min":65.135000000000005},"last":0.49099999999999999}]},{"osd":5,"last update":"Fri Jul 7 04:01:35 2023","interfaces":[{"interface":"back","average":{"1min":3.0190000000000001,"5min":2.4940000000000002,"15min":1.9199999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":23.907,"5min":38.103000000000002,"15min":38.103000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":7.008,"5min":3.2410000000000001,"15min":2.0059999999999998},"min":{"1min":0.39300000000000002,"5min":0.35499999999999998,"15min":0.32600000000000001},"max":{"1min":111.569,"5min":111.569,"15min":111.569},"last":0.60899999999999999}]},{"osd":7,"last update":"Fri Jul 7 04:01:35 2023","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.53,"15min":1.3140000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.32300000000000001},"max":{"1min":11.414,"5min":15.507,"15min":15.507},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.339,"5min":1.641,"15min":1.4330000000000001},"min":{"1min":0.40200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":10.329000000000001,"5min":15.471,"15min":15.471},"last":0.77500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834580617,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":983260,"kb_used_data":532,"kb_used_omap":18390,"kb_used_meta":964329,"kb_avail":93388580,"statfs":{"total":96636764160,"available":95629905920,"internally_reserved":0,"allocated":544768,"data_stored":246126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18831879,"internal_metadata":987473401},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.8440000000000001,"15min":1.444},"min":{"1min":0.255,"5min":0.254,"15min":0.23300000000000001},"max":{"1min":6.1109999999999998,"5min":23.021000000000001,"15min":23.021000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":2.919,"5min":2.3380000000000001,"15min":1.968},"min":{"1min":0.27400000000000002,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":25.864000000000001,"5min":25.864000000000001,"15min":25.864000000000001},"last":0.51200000000000001}]},{"osd":2,"last update":"Fri Jul 7 04:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.891,"5min":2.3279999999999998,"15min":1.8420000000000001},"min":{"1min":0.317,"5min":0.26800000000000002,"15min":0.25800000000000001},"max":{"1min":8.9689999999999994,"5min":28.513999999999999,"15min":28.513999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":1.528,"5min":2.3399999999999999,"15min":2.1230000000000002},"min":{"1min":0.33500000000000002,"5min":0.28699999999999998,"15min":0.26200000000000001},"max":{"1min":11.253,"5min":28.352,"15min":28.352},"last":0.59499999999999997}]},{"osd":3,"last update":"Fri Jul 7 04:01:26 2023","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":2.7829999999999999,"15min":2.3849999999999998},"min":{"1min":0.35599999999999998,"5min":0.32100000000000001,"15min":0.29699999999999999},"max":{"1min":5.9219999999999997,"5min":21.620999999999999,"15min":21.620999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":1.798,"5min":2.1669999999999998,"15min":1.8280000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.29999999999999999},"max":{"1min":15.029,"5min":15.952,"15min":15.952},"last":0.48999999999999999}]},{"osd":4,"last update":"Fri Jul 7 04:01:26 2023","interfaces":[{"interface":"back","average":{"1min":2.4119999999999999,"5min":2.218,"15min":1.7250000000000001},"min":{"1min":0.373,"5min":0.371,"15min":0.34699999999999998},"max":{"1min":25.649999999999999,"5min":25.649999999999999,"15min":25.649999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":2.4060000000000001,"5min":2.4689999999999999,"15min":2.069},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":16.306000000000001,"5min":16.306000000000001,"15min":16.306000000000001},"last":0.65800000000000003}]},{"osd":5,"last update":"Fri Jul 7 04:01:26 2023","interfaces":[{"interface":"back","average":{"1min":3.5680000000000001,"5min":2.508,"15min":2.2090000000000001},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":24.565999999999999,"5min":24.565999999999999,"15min":24.565999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":2.9590000000000001,"5min":2.581,"15min":2.2959999999999998},"min":{"1min":0.46200000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":24.582000000000001,"5min":24.582000000000001,"15min":24.582000000000001},"last":0.63800000000000001}]},{"osd":6,"last update":"Fri Jul 7 04:01:26 2023","interfaces":[{"interface":"back","average":{"1min":2.5779999999999998,"5min":3.4489999999999998,"15min":2.2530000000000001},"min":{"1min":0.438,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":25.763999999999999,"5min":83.441999999999993,"15min":83.441999999999993},"last":0.65000000000000002},{"interface":"front","average":{"1min":2.9430000000000001,"5min":3.5190000000000001,"15min":2.7370000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":25.908000000000001,"5min":60.134,"15min":60.134},"last":0.79500000000000004}]},{"osd":7,"last update":"Fri Jul 7 04:01:26 2023","interfaces":[{"interface":"back","average":{"1min":4.5330000000000004,"5min":2.798,"15min":2.4380000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":60.305999999999997,"5min":60.305999999999997,"15min":60.305999999999997},"last":0.68400000000000005},{"interface":"front","average":{"1min":2.577,"5min":2.8420000000000001,"15min":2.593},"min":{"1min":0.49299999999999999,"5min":0.45900000000000002,"15min":0.45700000000000002},"max":{"1min":21.309000000000001,"5min":21.449000000000002,"15min":21.449000000000002},"last":0.73599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834580574,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":971168,"kb_used_data":1112,"kb_used_omap":23947,"kb_used_meta":946100,"kb_avail":93400672,"statfs":{"total":96636764160,"available":95642288128,"internally_reserved":0,"allocated":1138688,"data_stored":836494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24521912,"internal_metadata":968807240},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 7 04:01:04 2023","interfaces":[{"interface":"back","average":{"1min":4.4340000000000002,"5min":2.1320000000000001,"15min":1.4199999999999999},"min":{"1min":0.28100000000000003,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":26.895,"5min":26.895,"15min":26.895},"last":0.60099999999999998},{"interface":"front","average":{"1min":3.5739999999999998,"5min":1.8380000000000001,"15min":1.909},"min":{"1min":0.27900000000000003,"5min":0.27600000000000002,"15min":0.26000000000000001},"max":{"1min":17.221,"5min":17.221,"15min":32.700000000000003},"last":0.63900000000000001}]},{"osd":2,"last update":"Fri Jul 7 04:01:27 2023","interfaces":[{"interface":"back","average":{"1min":1.8460000000000001,"5min":1.6539999999999999,"15min":1.5469999999999999},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.25600000000000001},"max":{"1min":7.8410000000000002,"5min":14.9,"15min":19.475999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":3.4849999999999999,"5min":2.048,"15min":1.875},"min":{"1min":0.28499999999999998,"5min":0.26900000000000002,"15min":0.26600000000000001},"max":{"1min":24.016999999999999,"5min":24.016999999999999,"15min":24.016999999999999},"last":0.53700000000000003}]},{"osd":3,"last update":"Fri Jul 7 04:01:27 2023","interfaces":[{"interface":"back","average":{"1min":3.1549999999999998,"5min":2.323,"15min":1.8779999999999999},"min":{"1min":0.313,"5min":0.29299999999999998,"15min":0.26200000000000001},"max":{"1min":16.196000000000002,"5min":44.267000000000003,"15min":44.267000000000003},"last":0.66100000000000003},{"interface":"front","average":{"1min":3.1560000000000001,"5min":2.077,"15min":1.7070000000000001},"min":{"1min":0.40500000000000003,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":16.292999999999999,"5min":16.292999999999999,"15min":32.759999999999998},"last":0.81899999999999995}]},{"osd":4,"last update":"Fri Jul 7 04:01:27 2023","interfaces":[{"interface":"back","average":{"1min":3.4380000000000002,"5min":2.085,"15min":1.835},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32500000000000001},"max":{"1min":21.379999999999999,"5min":21.379999999999999,"15min":21.379999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":2.9790000000000001,"5min":2.8879999999999999,"15min":2.1309999999999998},"min":{"1min":0.46200000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":27.077000000000002,"5min":46.898000000000003,"15min":46.898000000000003},"last":1.02}]},{"osd":5,"last update":"Fri Jul 7 04:01:27 2023","interfaces":[{"interface":"back","average":{"1min":4.2249999999999996,"5min":2.7930000000000001,"15min":2.25},"min":{"1min":0.43099999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":21.649999999999999,"5min":44.174999999999997,"15min":44.174999999999997},"last":0.91400000000000003},{"interface":"front","average":{"1min":2.597,"5min":1.857,"15min":1.496},"min":{"1min":0.56599999999999995,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":9.0790000000000006,"5min":22.643999999999998,"15min":22.643999999999998},"last":1.056}]},{"osd":6,"last update":"Fri Jul 7 04:01:04 2023","interfaces":[{"interface":"back","average":{"1min":7.1109999999999998,"5min":2.512,"15min":1.867},"min":{"1min":0.49299999999999999,"5min":0.41699999999999998,"15min":0.41199999999999998},"max":{"1min":48.225999999999999,"5min":48.225999999999999,"15min":48.225999999999999},"last":0.999},{"interface":"front","average":{"1min":6.2880000000000003,"5min":2.4649999999999999,"15min":2.1629999999999998},"min":{"1min":0.42099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":44.990000000000002,"5min":44.990000000000002,"15min":44.990000000000002},"last":0.93300000000000005}]},{"osd":7,"last update":"Fri Jul 7 04:01:27 2023","interfaces":[{"interface":"back","average":{"1min":3.7360000000000002,"5min":2.3799999999999999,"15min":2.363},"min":{"1min":0.47699999999999998,"5min":0.45700000000000002,"15min":0.39600000000000002},"max":{"1min":23.149999999999999,"5min":23.149999999999999,"15min":23.149999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":3.6480000000000001,"5min":3.0489999999999999,"15min":2.4049999999999998},"min":{"1min":0.51200000000000001,"5min":0.49299999999999999,"15min":0.42699999999999999},"max":{"1min":12.448,"5min":44.228999999999999,"15min":44.228999999999999},"last":0.97799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834580607,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1847004,"kb_used_data":532,"kb_used_omap":11342,"kb_used_meta":1835121,"kb_avail":92524836,"statfs":{"total":96636764160,"available":94745432064,"internally_reserved":0,"allocated":544768,"data_stored":246126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11614252,"internal_metadata":1879164884},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:01:29 2023","interfaces":[{"interface":"back","average":{"1min":2.6240000000000001,"5min":1.548,"15min":1.347},"min":{"1min":0.254,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":17.013999999999999,"5min":17.013999999999999,"15min":17.013999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":2.6779999999999999,"5min":1.762,"15min":1.484},"min":{"1min":0.36099999999999999,"5min":0.26700000000000002,"15min":0.25},"max":{"1min":8.6720000000000006,"5min":24.515000000000001,"15min":24.515000000000001},"last":0.58799999999999997}]},{"osd":1,"last update":"Fri Jul 7 04:01:33 2023","interfaces":[{"interface":"back","average":{"1min":7.6890000000000001,"5min":2.6659999999999999,"15min":1.7869999999999999},"min":{"1min":0.38100000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":71.899000000000001,"5min":71.899000000000001,"15min":71.899000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":2.6539999999999999,"5min":1.865,"15min":1.6000000000000001},"min":{"1min":0.35599999999999998,"5min":0.29499999999999998,"15min":0.27800000000000002},"max":{"1min":7.8650000000000002,"5min":16.858000000000001,"15min":16.858000000000001},"last":0.53800000000000003}]},{"osd":3,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":7.9550000000000001,"5min":3.1200000000000001,"15min":1.9930000000000001},"min":{"1min":0.28799999999999998,"5min":0.28599999999999998,"15min":0.252},"max":{"1min":96.594999999999999,"5min":96.594999999999999,"15min":96.594999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":3.4649999999999999,"5min":1.752,"15min":1.472},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.29599999999999999},"max":{"1min":22.445,"5min":22.445,"15min":22.445},"last":0.50600000000000001}]},{"osd":4,"last update":"Fri Jul 7 04:01:29 2023","interfaces":[{"interface":"back","average":{"1min":2.3980000000000001,"5min":1.4359999999999999,"15min":1.3320000000000001},"min":{"1min":0.38300000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":14.528,"5min":14.528,"15min":14.528},"last":0.90100000000000002},{"interface":"front","average":{"1min":2.6299999999999999,"5min":1.649,"15min":1.679},"min":{"1min":0.40100000000000002,"5min":0.38700000000000001,"15min":0.34999999999999998},"max":{"1min":7.8049999999999997,"5min":10.791,"15min":10.791},"last":0.80900000000000005}]},{"osd":5,"last update":"Fri Jul 7 04:01:29 2023","interfaces":[{"interface":"back","average":{"1min":3.5230000000000001,"5min":2.4279999999999999,"15min":1.9910000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":20.228999999999999,"5min":20.228999999999999,"15min":20.228999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":2.3620000000000001,"5min":1.877,"15min":1.7},"min":{"1min":0.47099999999999997,"5min":0.39500000000000002,"15min":0.39300000000000002},"max":{"1min":14.444000000000001,"5min":14.444000000000001,"15min":14.444000000000001},"last":0.84299999999999997}]},{"osd":6,"last update":"Fri Jul 7 04:01:29 2023","interfaces":[{"interface":"back","average":{"1min":3.0379999999999998,"5min":2.036,"15min":1.873},"min":{"1min":0.443,"5min":0.40999999999999998,"15min":0.39100000000000001},"max":{"1min":8.6020000000000003,"5min":10.855,"15min":11.019},"last":0.92300000000000004},{"interface":"front","average":{"1min":4.1989999999999998,"5min":2.7240000000000002,"15min":2.2080000000000002},"min":{"1min":0.42799999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":20.376999999999999,"5min":20.376999999999999,"15min":20.376999999999999},"last":0.77600000000000002}]},{"osd":7,"last update":"Fri Jul 7 04:01:29 2023","interfaces":[{"interface":"back","average":{"1min":3.9750000000000001,"5min":2.2789999999999999,"15min":1.978},"min":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.42599999999999999},"max":{"1min":17.274999999999999,"5min":17.274999999999999,"15min":17.274999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":4.117,"5min":2.6739999999999999,"15min":2.327},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45300000000000001},"max":{"1min":22.824000000000002,"5min":22.824000000000002,"15min":22.824000000000002},"last":0.86199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834580594,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1699036,"kb_used_data":532,"kb_used_omap":20609,"kb_used_meta":1677886,"kb_avail":92672804,"statfs":{"total":96636764160,"available":94896951296,"internally_reserved":0,"allocated":544768,"data_stored":246126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21104547,"internal_metadata":1718155357},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:01:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.4259999999999999,"15min":1.208},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":8.2029999999999994,"5min":18.285,"15min":18.285},"last":0.441},{"interface":"front","average":{"1min":9.2100000000000009,"5min":3.0939999999999999,"15min":2.1970000000000001},"min":{"1min":0.26000000000000001,"5min":0.247,"15min":0.247},"max":{"1min":169.74100000000001,"5min":169.74100000000001,"15min":169.74100000000001},"last":0.46500000000000002}]},{"osd":1,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":2.258,"5min":2.3860000000000001,"15min":1.758},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.23699999999999999},"max":{"1min":15.093,"5min":61.411000000000001,"15min":61.411000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":2.9620000000000002,"5min":1.706,"15min":1.575},"min":{"1min":0.314,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":18.222000000000001,"5min":18.222000000000001,"15min":18.222000000000001},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":2.9500000000000002,"5min":2.4900000000000002,"15min":1.978},"min":{"1min":0.317,"5min":0.312,"15min":0.28299999999999997},"max":{"1min":14.986000000000001,"5min":61.511000000000003,"15min":61.511000000000003},"last":0.51300000000000001},{"interface":"front","average":{"1min":4.6500000000000004,"5min":2.4660000000000002,"15min":1.9339999999999999},"min":{"1min":0.45600000000000002,"5min":0.314,"15min":0.314},"max":{"1min":20.542000000000002,"5min":61.707000000000001,"15min":61.707000000000001},"last":0.65500000000000003}]},{"osd":4,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":4.5419999999999998,"5min":2.8090000000000002,"15min":2.2120000000000002},"min":{"1min":0.38,"5min":0.33000000000000002,"15min":0.32300000000000001},"max":{"1min":21.120000000000001,"5min":61.453000000000003,"15min":61.453000000000003},"last":0.878},{"interface":"front","average":{"1min":2.5750000000000002,"5min":2.3010000000000002,"15min":1.843},"min":{"1min":0.377,"5min":0.377,"15min":0.35699999999999998},"max":{"1min":15.122,"5min":61.558,"15min":61.558},"last":0.84399999999999997}]},{"osd":5,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":3.8490000000000002,"5min":1.921,"15min":1.659},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":21.388999999999999,"5min":21.388999999999999,"15min":21.388999999999999},"last":0.745},{"interface":"front","average":{"1min":5.0069999999999997,"5min":2.4740000000000002,"15min":2.2080000000000002},"min":{"1min":0.46000000000000002,"5min":0.39100000000000001,"15min":0.375},"max":{"1min":32.100999999999999,"5min":32.100999999999999,"15min":32.100999999999999},"last":0.72399999999999998}]},{"osd":6,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":4.2039999999999997,"5min":2.5790000000000002,"15min":2.1389999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":27.613,"5min":61.667000000000002,"15min":61.667000000000002},"last":0.76600000000000001},{"interface":"front","average":{"1min":7.2060000000000004,"5min":2.7999999999999998,"15min":2.0680000000000001},"min":{"1min":0.45800000000000002,"5min":0.44400000000000001,"15min":0.442},"max":{"1min":83.242000000000004,"5min":83.242000000000004,"15min":83.242000000000004},"last":0.81399999999999995}]},{"osd":7,"last update":"Fri Jul 7 04:00:52 2023","interfaces":[{"interface":"back","average":{"1min":4.516,"5min":2.5310000000000001,"15min":2.3620000000000001},"min":{"1min":0.49299999999999999,"5min":0.42299999999999999,"15min":0.40100000000000002},"max":{"1min":19.928000000000001,"5min":19.928000000000001,"15min":19.928000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":3.0960000000000001,"5min":2.7189999999999999,"15min":2.3130000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":15.063000000000001,"5min":61.621000000000002,"15min":61.621000000000002},"last":0.90100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834580637,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1293020,"kb_used_data":532,"kb_used_omap":11728,"kb_used_meta":1280751,"kb_avail":93078820,"statfs":{"total":96636764160,"available":95312711680,"internally_reserved":0,"allocated":544768,"data_stored":246126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12010156,"internal_metadata":1311489364},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:01:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":2.3929999999999998,"15min":1.4910000000000001},"min":{"1min":0.27600000000000002,"5min":0.252,"15min":0.252},"max":{"1min":4.5199999999999996,"5min":97.753,"15min":97.753},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.7070000000000001,"5min":1.8640000000000001,"15min":1.603},"min":{"1min":0.29299999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":17.577000000000002,"5min":30.262,"15min":30.262},"last":0.77900000000000003}]},{"osd":1,"last update":"Fri Jul 7 04:01:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.8240000000000001,"15min":1.6739999999999999},"min":{"1min":0.30199999999999999,"5min":0.28999999999999998,"15min":0.27800000000000002},"max":{"1min":4.4279999999999999,"5min":25.344999999999999,"15min":25.344999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.2410000000000001,"5min":2.1099999999999999,"15min":1.7110000000000001},"min":{"1min":0.307,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":4.3120000000000003,"5min":66.322000000000003,"15min":66.322000000000003},"last":0.875}]},{"osd":2,"last update":"Fri Jul 7 04:01:31 2023","interfaces":[{"interface":"back","average":{"1min":2.6080000000000001,"5min":2.1680000000000001,"15min":1.8340000000000001},"min":{"1min":0.48699999999999999,"5min":0.34200000000000003,"15min":0.308},"max":{"1min":9.4130000000000003,"5min":9.4130000000000003,"15min":13.151999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":2.5129999999999999,"5min":2.1349999999999998,"15min":1.9339999999999999},"min":{"1min":0.52000000000000002,"5min":0.34300000000000003,"15min":0.33300000000000002},"max":{"1min":10.051,"5min":10.395,"15min":10.395},"last":0.92800000000000005}]},{"osd":3,"last update":"Fri Jul 7 04:01:31 2023","interfaces":[{"interface":"back","average":{"1min":1.802,"5min":2.2509999999999999,"15min":2.077},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":8.0440000000000005,"5min":21.390999999999998,"15min":21.390999999999998},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.6359999999999999,"5min":2.222,"15min":2.0649999999999999},"min":{"1min":0.40000000000000002,"5min":0.39500000000000002,"15min":0.34999999999999998},"max":{"1min":9.032,"5min":11.641999999999999,"15min":11.641999999999999},"last":0.90900000000000003}]},{"osd":5,"last update":"Fri Jul 7 04:01:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":1.667,"15min":1.262},"min":{"1min":0.34899999999999998,"5min":0.317,"15min":0.30499999999999999},"max":{"1min":3.2389999999999999,"5min":51.551000000000002,"15min":51.551000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.252,"15min":1.3600000000000001},"min":{"1min":0.38100000000000001,"5min":0.33100000000000002,"15min":0.317},"max":{"1min":7.0389999999999997,"5min":22.038,"15min":22.038},"last":0.88900000000000001}]},{"osd":6,"last update":"Fri Jul 7 04:01:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.1699999999999999,"15min":1.395},"min":{"1min":0.39800000000000002,"5min":0.33700000000000002,"15min":0.29699999999999999},"max":{"1min":4.0640000000000001,"5min":7.9189999999999996,"15min":8.0760000000000005},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.173,"5min":1.7330000000000001,"15min":1.542},"min":{"1min":0.38600000000000001,"5min":0.38500000000000001,"15min":0.371},"max":{"1min":7.3780000000000001,"5min":66.373999999999995,"15min":66.373999999999995},"last":0.751}]},{"osd":7,"last update":"Fri Jul 7 04:01:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.282,"15min":1.4750000000000001},"min":{"1min":0.46500000000000002,"5min":0.37,"15min":0.36599999999999999},"max":{"1min":4.1980000000000004,"5min":8.0399999999999991,"15min":11.585000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.90600000000000003,"5min":1.141,"15min":1.383},"min":{"1min":0.44700000000000001,"5min":0.375,"15min":0.34100000000000003},"max":{"1min":3.3900000000000001,"5min":7.1449999999999996,"15min":12.414},"last":0.95699999999999996}]}]},{"osd":5,"up_from":13,"seq":55834580643,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1601052,"kb_used_data":532,"kb_used_omap":19606,"kb_used_meta":1580905,"kb_avail":92770788,"statfs":{"total":96636764160,"available":94997286912,"internally_reserved":0,"allocated":544768,"data_stored":246126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":20076954,"internal_metadata":1618847334},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":4.0099999999999998,"5min":1.6100000000000001,"15min":1.4730000000000001},"min":{"1min":0.29199999999999998,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":46.174999999999997,"5min":46.174999999999997,"15min":46.174999999999997},"last":0.79100000000000004},{"interface":"front","average":{"1min":2.0579999999999998,"5min":1.675,"15min":1.804},"min":{"1min":0.28799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":11.06,"5min":13.792999999999999,"15min":38.530999999999999},"last":0.68700000000000006}]},{"osd":1,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":2.8319999999999999,"5min":1.6539999999999999,"15min":1.6439999999999999},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.28299999999999997},"max":{"1min":15.209,"5min":15.209,"15min":15.343},"last":0.82899999999999996},{"interface":"front","average":{"1min":4.2779999999999996,"5min":2.0379999999999998,"15min":1.746},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.29599999999999999},"max":{"1min":33.927999999999997,"5min":33.927999999999997,"15min":33.927999999999997},"last":0.84699999999999998}]},{"osd":2,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":2.319,"5min":1.7070000000000001,"15min":2.097},"min":{"1min":0.39200000000000002,"5min":0.29799999999999999,"15min":0.28699999999999998},"max":{"1min":9.5609999999999999,"5min":9.5609999999999999,"15min":10.222},"last":0.61799999999999999},{"interface":"front","average":{"1min":2.4300000000000002,"5min":1.893,"15min":1.6639999999999999},"min":{"1min":0.41299999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":13.628,"5min":13.628,"15min":15.398},"last":0.69999999999999996}]},{"osd":3,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":3.8929999999999998,"5min":2.141,"15min":1.9930000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":33.828000000000003,"5min":33.828000000000003,"15min":33.828000000000003},"last":0.72399999999999998},{"interface":"front","average":{"1min":2.476,"5min":2.069,"15min":2.1070000000000002},"min":{"1min":0.443,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":13.595000000000001,"5min":13.595000000000001,"15min":15.43},"last":0.77400000000000002}]},{"osd":4,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":3.306,"5min":1.752,"15min":1.373},"min":{"1min":0.32400000000000001,"5min":0.308,"15min":0.27800000000000002},"max":{"1min":28.396999999999998,"5min":28.396999999999998,"15min":28.396999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":2.7639999999999998,"5min":2.012,"15min":1.696},"min":{"1min":0.33000000000000002,"5min":0.32600000000000001,"15min":0.29199999999999998},"max":{"1min":23.481999999999999,"5min":23.481999999999999,"15min":23.481999999999999},"last":0.745}]},{"osd":6,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":3.8210000000000002,"5min":1.913,"15min":1.667},"min":{"1min":0.36499999999999999,"5min":0.311,"15min":0.29599999999999999},"max":{"1min":55.161000000000001,"5min":55.161000000000001,"15min":55.161000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":4.1879999999999997,"5min":1.8899999999999999,"15min":1.669},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.32900000000000001},"max":{"1min":62.456000000000003,"5min":62.456000000000003,"15min":62.456000000000003},"last":0.89800000000000002}]},{"osd":7,"last update":"Fri Jul 7 04:00:58 2023","interfaces":[{"interface":"back","average":{"1min":1.839,"5min":1.629,"15min":1.78},"min":{"1min":0.41099999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":7.1710000000000003,"5min":24.16,"15min":24.16},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.92800000000000005,"5min":1.327,"15min":1.468},"min":{"1min":0.42999999999999999,"5min":0.37,"15min":0.37},"max":{"1min":3.3980000000000001,"5min":17.751000000000001,"15min":17.751000000000001},"last":0.93100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-07T04:01:45.232 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-07-07T04:01:45.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.367+0000 7f94d0996700 1 Processor -- start 2023-07-07T04:01:45.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.367+0000 7f94d0996700 1 -- start start 2023-07-07T04:01:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.368+0000 7f94d0996700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94cc160e00 0x7f94cc06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.368+0000 7f94d0996700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94cc15d910 0x7f94cc06c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:45.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.368+0000 7f94d0996700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94cc15d480 con 0x7f94cc0b1f10 2023-07-07T04:01:45.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.368+0000 7f94d0996700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94cc15cc60 con 0x7f94cc160e00 2023-07-07T04:01:45.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.368+0000 7f94d0996700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc15ce70 con 0x7f94cc15d910 2023-07-07T04:01:45.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.368+0000 7f94c9d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94cc160e00 0x7f94cc06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:45.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.368+0000 7f94c9d9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f94cc160e00 0x7f94cc06bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48528/0 (socket says 172.21.15.6:48528) 2023-07-07T04:01:45.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.368+0000 7f94c9d9b700 1 -- 172.21.15.6:0/3937889786 learned_addr learned my addr 172.21.15.6:0/3937889786 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:45.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.368+0000 7f94cad9d700 1 --2- 172.21.15.6:0/3937889786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94cc15d910 0x7f94cc06c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:45.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.369+0000 7f94c9d9b700 1 -- 172.21.15.6:0/3937889786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94cc15d910 msgr2=0x7f94cc06c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:45.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.369+0000 7f94c9d9b700 1 --2- 172.21.15.6:0/3937889786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94cc15d910 0x7f94cc06c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.369+0000 7f94c9d9b700 1 -- 172.21.15.6:0/3937889786 >> v1:172.21.15.40:6789/0 conn(0x7f94cc0b1f10 legacy=0x7f94cc0cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.369+0000 7f94c9d9b700 1 -- 172.21.15.6:0/3937889786 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94cc0cddd0 con 0x7f94cc160e00 2023-07-07T04:01:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.369+0000 7f94c9d9b700 1 --2- 172.21.15.6:0/3937889786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94cc160e00 0x7f94cc06bdb0 secure :-1 s=READY pgs=3399 cs=0 l=1 rev1=1 crypto rx=0x7f94c00098f0 tx=0x7f94c0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb672f8df969c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.369+0000 7f94c959a700 1 -- 172.21.15.6:0/3937889786 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c000b8a0 con 0x7f94cc160e00 2023-07-07T04:01:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.369+0000 7f94c959a700 1 -- 172.21.15.6:0/3937889786 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c000ba00 con 0x7f94cc160e00 2023-07-07T04:01:45.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.369+0000 7f94c959a700 1 -- 172.21.15.6:0/3937889786 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c000bd90 con 0x7f94cc160e00 2023-07-07T04:01:45.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.370+0000 7f94d0996700 1 -- 172.21.15.6:0/3937889786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94cc160e00 msgr2=0x7f94cc06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:45.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.370+0000 7f94d0996700 1 --2- 172.21.15.6:0/3937889786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94cc160e00 0x7f94cc06bdb0 secure :-1 s=READY pgs=3399 cs=0 l=1 rev1=1 crypto rx=0x7f94c00098f0 tx=0x7f94c0009c00 comp rx=0 tx=0).stop 2023-07-07T04:01:45.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.370+0000 7f94d0996700 1 -- 172.21.15.6:0/3937889786 shutdown_connections 2023-07-07T04:01:45.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.370+0000 7f94d0996700 1 --2- 172.21.15.6:0/3937889786 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94cc15d910 0x7f94cc06c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:45.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.370+0000 7f94d0996700 1 --2- 172.21.15.6:0/3937889786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94cc160e00 0x7f94cc06bdb0 unknown :-1 s=CLOSED pgs=3399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:45.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.370+0000 7f94d0996700 1 -- 172.21.15.6:0/3937889786 >> 172.21.15.6:0/3937889786 conn(0x7f94cc0d2c70 msgr2=0x7f94cc0d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:45.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.370+0000 7f94d0996700 1 -- 172.21.15.6:0/3937889786 shutdown_connections 2023-07-07T04:01:45.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.370+0000 7f94d0996700 1 -- 172.21.15.6:0/3937889786 wait complete. 2023-07-07T04:01:45.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.371+0000 7f94d0996700 1 Processor -- start 2023-07-07T04:01:45.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.371+0000 7f94d0996700 1 -- start start 2023-07-07T04:01:45.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.372+0000 7f94d0996700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94cc0b1f10 0x7f94cc153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:45.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.372+0000 7f94d0996700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94cc15d910 0x7f94cc159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:45.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.372+0000 7f94d0996700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94cc160e00 0x7f94cc0c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:45.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.372+0000 7f94d0996700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc159670 con 0x7f94cc0b1f10 2023-07-07T04:01:45.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.372+0000 7f94d0996700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc1f2270 con 0x7f94cc160e00 2023-07-07T04:01:45.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.372+0000 7f94d0996700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc159910 con 0x7f94cc15d910 2023-07-07T04:01:45.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.372+0000 7f94ca59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94cc0b1f10 0x7f94cc153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:45.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.372+0000 7f94ca59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94cc0b1f10 0x7f94cc153aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48530/0 (socket says 172.21.15.6:48530) 2023-07-07T04:01:45.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.372+0000 7f94ca59c700 1 -- 172.21.15.6:0/2641025197 learned_addr learned my addr 172.21.15.6:0/2641025197 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:45.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.372+0000 7f94c9d9b700 1 --2- 172.21.15.6:0/2641025197 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94cc15d910 0x7f94cc159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:45.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.372+0000 7f94cad9d700 1 --2- 172.21.15.6:0/2641025197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94cc160e00 0x7f94cc0c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:45.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.373+0000 7f94ca59c700 1 -- 172.21.15.6:0/2641025197 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94cc15d910 msgr2=0x7f94cc159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:45.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.373+0000 7f94ca59c700 1 --2- 172.21.15.6:0/2641025197 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94cc15d910 0x7f94cc159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:45.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.373+0000 7f94ca59c700 1 -- 172.21.15.6:0/2641025197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94cc160e00 msgr2=0x7f94cc0c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:45.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.373+0000 7f94ca59c700 1 --2- 172.21.15.6:0/2641025197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94cc160e00 0x7f94cc0c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:45.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.373+0000 7f94ca59c700 1 -- 172.21.15.6:0/2641025197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c0009550 con 0x7f94cc0b1f10 2023-07-07T04:01:45.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.373+0000 7f94ca59c700 1 --2- 172.21.15.6:0/2641025197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94cc0b1f10 0x7f94cc153aa0 secure :-1 s=READY pgs=3400 cs=0 l=1 rev1=1 crypto rx=0x7f94bc00c4e0 tx=0x7f94bc00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:45.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.373+0000 7f94baffd700 1 -- 172.21.15.6:0/2641025197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc0052d0 con 0x7f94cc0b1f10 2023-07-07T04:01:45.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.373+0000 7f94baffd700 1 -- 172.21.15.6:0/2641025197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94bc005430 con 0x7f94cc0b1f10 2023-07-07T04:01:45.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.373+0000 7f94d0996700 1 -- 172.21.15.6:0/2641025197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94cc159bf0 con 0x7f94cc0b1f10 2023-07-07T04:01:45.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.373+0000 7f94baffd700 1 -- 172.21.15.6:0/2641025197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc0038c0 con 0x7f94cc0b1f10 2023-07-07T04:01:45.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.373+0000 7f94d0996700 1 -- 172.21.15.6:0/2641025197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94cc0b5d80 con 0x7f94cc0b1f10 2023-07-07T04:01:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.374+0000 7f94d0996700 1 -- 172.21.15.6:0/2641025197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94cc072f20 con 0x7f94cc0b1f10 2023-07-07T04:01:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.375+0000 7f94baffd700 1 -- 172.21.15.6:0/2641025197 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f94bc003a20 con 0x7f94cc0b1f10 2023-07-07T04:01:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.375+0000 7f94baffd700 1 --2- 172.21.15.6:0/2641025197 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f94ac06ace0 0x7f94ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.375+0000 7f94baffd700 1 -- 172.21.15.6:0/2641025197 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f94bc0886a0 con 0x7f94cc0b1f10 2023-07-07T04:01:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.375+0000 7f94c9d9b700 1 --2- 172.21.15.6:0/2641025197 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f94ac06ace0 0x7f94ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.376+0000 7f94c9d9b700 1 --2- 172.21.15.6:0/2641025197 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f94ac06ace0 0x7f94ac06d190 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f94cc161240 tx=0x7f94c0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.380+0000 7f94baffd700 1 -- 172.21.15.6:0/2641025197 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f94bc053910 con 0x7f94cc0b1f10 2023-07-07T04:01:45.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.588+0000 7f94d0996700 1 -- 172.21.15.6:0/2641025197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f94cc04eb90 con 0x7f94cc0b1f10 2023-07-07T04:01:45.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.592+0000 7f94baffd700 1 -- 172.21.15.6:0/2641025197 <== mon.0 v2:172.21.15.6:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f94bc001240 con 0x7f94cc0b1f10 2023-07-07T04:01:45.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.592+0000 7f94baffd700 1 -- 172.21.15.6:0/2641025197 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f94bc056f30 con 0x7f94cc0b1f10 2023-07-07T04:01:45.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.596+0000 7f94d0996700 1 -- 172.21.15.6:0/2641025197 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f94ac06ace0 msgr2=0x7f94ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:45.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.596+0000 7f94d0996700 1 --2- 172.21.15.6:0/2641025197 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f94ac06ace0 0x7f94ac06d190 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f94cc161240 tx=0x7f94c0008030 comp rx=0 tx=0).stop 2023-07-07T04:01:45.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.596+0000 7f94d0996700 1 -- 172.21.15.6:0/2641025197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94cc0b1f10 msgr2=0x7f94cc153aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:45.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.596+0000 7f94d0996700 1 --2- 172.21.15.6:0/2641025197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94cc0b1f10 0x7f94cc153aa0 secure :-1 s=READY pgs=3400 cs=0 l=1 rev1=1 crypto rx=0x7f94bc00c4e0 tx=0x7f94bc00c7f0 comp rx=0 tx=0).stop 2023-07-07T04:01:45.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.596+0000 7f94d0996700 1 -- 172.21.15.6:0/2641025197 shutdown_connections 2023-07-07T04:01:45.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.596+0000 7f94d0996700 1 --2- 172.21.15.6:0/2641025197 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f94ac06ace0 0x7f94ac06d190 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:45.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.596+0000 7f94d0996700 1 --2- 172.21.15.6:0/2641025197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94cc0b1f10 0x7f94cc153aa0 unknown :-1 s=CLOSED pgs=3400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:45.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.596+0000 7f94d0996700 1 --2- 172.21.15.6:0/2641025197 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f94cc160e00 0x7f94cc0c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:45.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.596+0000 7f94d0996700 1 --2- 172.21.15.6:0/2641025197 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f94cc15d910 0x7f94cc159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:45.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.596+0000 7f94d0996700 1 -- 172.21.15.6:0/2641025197 >> 172.21.15.6:0/2641025197 conn(0x7f94cc0d2c70 msgr2=0x7f94cc0d3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:45.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.596+0000 7f94d0996700 1 -- 172.21.15.6:0/2641025197 shutdown_connections 2023-07-07T04:01:45.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.596+0000 7f94d0996700 1 -- 172.21.15.6:0/2641025197 wait complete. 2023-07-07T04:01:45.612 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-07T04:01:45.612 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-07T04:01:45.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.746+0000 7f091092a700 1 Processor -- start 2023-07-07T04:01:45.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.746+0000 7f091092a700 1 -- start start 2023-07-07T04:01:45.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.747+0000 7f091092a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f090c0b47e0 0x7f090c06e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:45.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.747+0000 7f091092a700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f090c06a060 0x7f090c0caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:45.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.747+0000 7f091092a700 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f090c15ebd0 con 0x7f090c06a4d0 2023-07-07T04:01:45.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.747+0000 7f091092a700 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090c15dfc0 con 0x7f090c06a060 2023-07-07T04:01:45.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.747+0000 7f091092a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090c15e2a0 con 0x7f090c0b47e0 2023-07-07T04:01:45.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.748+0000 7f090a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f090c0b47e0 0x7f090c06e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:45.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.748+0000 7f0909d9b700 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f090c06a060 0x7f090c0caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:45.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.748+0000 7f090a59c700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f090c0b47e0 0x7f090c06e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3301/0 says I am v2:172.21.15.6:41182/0 (socket says 172.21.15.6:41182) 2023-07-07T04:01:45.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.748+0000 7f090a59c700 1 -- 172.21.15.6:0/656718560 learned_addr learned my addr 172.21.15.6:0/656718560 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:45.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.748+0000 7f090ad9d700 1 --1- 172.21.15.6:0/656718560 >> v1:172.21.15.40:6789/0 conn(0x7f090c06a4d0 0x7f090c15aa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.6:39622/0 (socket says 172.21.15.6:39622) 2023-07-07T04:01:45.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.748+0000 7f090a59c700 1 -- 172.21.15.6:0/656718560 >> v2:172.21.15.40:3300/0 conn(0x7f090c06a060 msgr2=0x7f090c0caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-07T04:01:45.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.748+0000 7f090a59c700 1 --2- 172.21.15.6:0/656718560 >> v2:172.21.15.40:3300/0 conn(0x7f090c06a060 0x7f090c0caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:45.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.748+0000 7f090a59c700 1 -- 172.21.15.6:0/656718560 >> v1:172.21.15.40:6789/0 conn(0x7f090c06a4d0 legacy=0x7f090c15aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:45.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.748+0000 7f090a59c700 1 -- 172.21.15.6:0/656718560 --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c15e580 con 0x7f090c0b47e0 2023-07-07T04:01:45.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.748+0000 7f0909d9b700 1 --2- 172.21.15.6:0/656718560 >> v2:172.21.15.40:3300/0 conn(0x7f090c06a060 0x7f090c0caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-07T04:01:45.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.748+0000 7f090a59c700 1 --2- 172.21.15.6:0/656718560 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f090c0b47e0 0x7f090c06e170 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0098f0 tx=0x7f08fc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=757d9b333cbbf826 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:45.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.749+0000 7f090959a700 1 -- 172.21.15.6:0/656718560 <== mon.2 v2:172.21.15.40:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc011830 con 0x7f090c0b47e0 2023-07-07T04:01:45.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.749+0000 7f090959a700 1 -- 172.21.15.6:0/656718560 <== mon.2 v2:172.21.15.40:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f08fc011990 con 0x7f090c0b47e0 2023-07-07T04:01:45.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.749+0000 7f090959a700 1 -- 172.21.15.6:0/656718560 <== mon.2 v2:172.21.15.40:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc011d40 con 0x7f090c0b47e0 2023-07-07T04:01:45.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.749+0000 7f091092a700 1 -- 172.21.15.6:0/656718560 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f090c0b47e0 msgr2=0x7f090c06e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:45.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.749+0000 7f091092a700 1 --2- 172.21.15.6:0/656718560 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f090c0b47e0 0x7f090c06e170 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0098f0 tx=0x7f08fc009c00 comp rx=0 tx=0).stop 2023-07-07T04:01:45.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.749+0000 7f091092a700 1 -- 172.21.15.6:0/656718560 shutdown_connections 2023-07-07T04:01:45.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.749+0000 7f091092a700 1 --2- 172.21.15.6:0/656718560 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f090c0b47e0 0x7f090c06e170 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:45.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.749+0000 7f091092a700 1 --2- 172.21.15.6:0/656718560 >> v2:172.21.15.40:3300/0 conn(0x7f090c06a060 0x7f090c0caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:45.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.749+0000 7f091092a700 1 -- 172.21.15.6:0/656718560 >> 172.21.15.6:0/656718560 conn(0x7f090c0cf0f0 msgr2=0x7f090c0cf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:45.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.749+0000 7f091092a700 1 -- 172.21.15.6:0/656718560 shutdown_connections 2023-07-07T04:01:45.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.749+0000 7f091092a700 1 -- 172.21.15.6:0/656718560 wait complete. 2023-07-07T04:01:45.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.751+0000 7f091092a700 1 Processor -- start 2023-07-07T04:01:45.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.751+0000 7f091092a700 1 -- start start 2023-07-07T04:01:45.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.752+0000 7f091092a700 1 --2- >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f090c06a060 0x7f090c0c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:45.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.752+0000 7f091092a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f090c06a4d0 0x7f090c153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:45.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.752+0000 7f091092a700 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f090c0b47e0 0x7f090c154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.752+0000 7f091092a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c14f860 con 0x7f090c06a4d0 2023-07-07T04:01:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.752+0000 7f091092a700 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090c14fab0 con 0x7f090c0b47e0 2023-07-07T04:01:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.752+0000 7f091092a700 1 -- --> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090c14fd90 con 0x7f090c06a060 2023-07-07T04:01:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.752+0000 7f0909d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f090c06a4d0 0x7f090c153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.752+0000 7f0909d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f090c06a4d0 0x7f090c153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48546/0 (socket says 172.21.15.6:48546) 2023-07-07T04:01:45.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.752+0000 7f0909d9b700 1 -- 172.21.15.6:0/1939099190 learned_addr learned my addr 172.21.15.6:0/1939099190 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-07-07T04:01:45.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.752+0000 7f090a59c700 1 --2- 172.21.15.6:0/1939099190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f090c06a060 0x7f090c0c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:45.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.752+0000 7f090ad9d700 1 --2- 172.21.15.6:0/1939099190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f090c0b47e0 0x7f090c154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:45.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.752+0000 7f0909d9b700 1 -- 172.21.15.6:0/1939099190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f090c06a060 msgr2=0x7f090c0c1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:45.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.752+0000 7f0909d9b700 1 --2- 172.21.15.6:0/1939099190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f090c06a060 0x7f090c0c1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:45.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.752+0000 7f0909d9b700 1 -- 172.21.15.6:0/1939099190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f090c0b47e0 msgr2=0x7f090c154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:45.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.752+0000 7f0909d9b700 1 --2- 172.21.15.6:0/1939099190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f090c0b47e0 0x7f090c154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:45.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.752+0000 7f0909d9b700 1 -- 172.21.15.6:0/1939099190 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09000094a0 con 0x7f090c06a4d0 2023-07-07T04:01:45.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.752+0000 7f0909d9b700 1 --2- 172.21.15.6:0/1939099190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f090c06a4d0 0x7f090c153e30 secure :-1 s=READY pgs=3401 cs=0 l=1 rev1=1 crypto rx=0x7f090000ebe0 tx=0x7f090000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:45.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.753+0000 7f08faffd700 1 -- 172.21.15.6:0/1939099190 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0900009760 con 0x7f090c06a4d0 2023-07-07T04:01:45.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.753+0000 7f08faffd700 1 -- 172.21.15.6:0/1939099190 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f090000c850 con 0x7f090c06a4d0 2023-07-07T04:01:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.753+0000 7f08faffd700 1 -- 172.21.15.6:0/1939099190 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090000cc00 con 0x7f090c06a4d0 2023-07-07T04:01:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.753+0000 7f091092a700 1 -- 172.21.15.6:0/1939099190 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08fc009550 con 0x7f090c06a4d0 2023-07-07T04:01:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.753+0000 7f091092a700 1 -- 172.21.15.6:0/1939099190 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090c150350 con 0x7f090c06a4d0 2023-07-07T04:01:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.754+0000 7f091092a700 1 -- 172.21.15.6:0/1939099190 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090c06bf50 con 0x7f090c06a4d0 2023-07-07T04:01:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.754+0000 7f08faffd700 1 -- 172.21.15.6:0/1939099190 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f090000cd60 con 0x7f090c06a4d0 2023-07-07T04:01:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.755+0000 7f08faffd700 1 --2- 172.21.15.6:0/1939099190 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f08ec06ace0 0x7f08ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-07T04:01:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.755+0000 7f08faffd700 1 -- 172.21.15.6:0/1939099190 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f09000893e0 con 0x7f090c06a4d0 2023-07-07T04:01:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.755+0000 7f090a59c700 1 --2- 172.21.15.6:0/1939099190 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f08ec06ace0 0x7f08ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-07T04:01:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.755+0000 7f090a59c700 1 --2- 172.21.15.6:0/1939099190 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f08ec06ace0 0x7f08ec06d190 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f08fc009c40 tx=0x7f08fc01d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-07T04:01:45.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:45.759+0000 7f08faffd700 1 -- 172.21.15.6:0/1939099190 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f090c06bf50 con 0x7f090c06a4d0 2023-07-07T04:01:46.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:46.016+0000 7f091092a700 1 -- 172.21.15.6:0/1939099190 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f090c06bf50 con 0x7f090c06a4d0 2023-07-07T04:01:46.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:46.017+0000 7f08faffd700 1 -- 172.21.15.6:0/1939099190 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3520 (secure 0 0 0) 0x7f0900017dd0 con 0x7f090c06a4d0 2023-07-07T04:01:46.019 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-07-07T04:01:46.020 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4868,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/554562026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":554562026},{"type":"v1","addr":"172.21.15.40:6834","nonce":554562026}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5379,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1231939681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1231939681},{"type":"v1","addr":"172.21.15.6:6835","nonce":1231939681}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5382,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/2836488850","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":2836488850},{"type":"v1","addr":"172.21.15.6:6837","nonce":2836488850}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5392,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1347888891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1347888891},{"type":"v1","addr":"172.21.15.40:6835","nonce":1347888891}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[]} 2023-07-07T04:01:46.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:46.019+0000 7f091092a700 1 -- 172.21.15.6:0/1939099190 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f08ec06ace0 msgr2=0x7f08ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:46.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:46.019+0000 7f091092a700 1 --2- 172.21.15.6:0/1939099190 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f08ec06ace0 0x7f08ec06d190 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f08fc009c40 tx=0x7f08fc01d040 comp rx=0 tx=0).stop 2023-07-07T04:01:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:46.019+0000 7f091092a700 1 -- 172.21.15.6:0/1939099190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f090c06a4d0 msgr2=0x7f090c153e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-07T04:01:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:46.019+0000 7f091092a700 1 --2- 172.21.15.6:0/1939099190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f090c06a4d0 0x7f090c153e30 secure :-1 s=READY pgs=3401 cs=0 l=1 rev1=1 crypto rx=0x7f090000ebe0 tx=0x7f090000eef0 comp rx=0 tx=0).stop 2023-07-07T04:01:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:46.019+0000 7f091092a700 1 -- 172.21.15.6:0/1939099190 shutdown_connections 2023-07-07T04:01:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:46.019+0000 7f091092a700 1 --2- 172.21.15.6:0/1939099190 >> [v2:172.21.15.6:6832/201543369,v1:172.21.15.6:6833/201543369] conn(0x7f08ec06ace0 0x7f08ec06d190 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:46.019+0000 7f091092a700 1 --2- 172.21.15.6:0/1939099190 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f090c0b47e0 0x7f090c154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:46.019+0000 7f091092a700 1 --2- 172.21.15.6:0/1939099190 >> [v2:172.21.15.40:3301/0,v1:172.21.15.40:6790/0] conn(0x7f090c06a060 0x7f090c0c1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:46.019+0000 7f091092a700 1 --2- 172.21.15.6:0/1939099190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f090c06a4d0 0x7f090c153e30 unknown :-1 s=CLOSED pgs=3401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-07T04:01:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:46.019+0000 7f091092a700 1 -- 172.21.15.6:0/1939099190 >> 172.21.15.6:0/1939099190 conn(0x7f090c0cf0f0 msgr2=0x7f090c0b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-07T04:01:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:46.019+0000 7f091092a700 1 -- 172.21.15.6:0/1939099190 shutdown_connections 2023-07-07T04:01:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-07-07T04:01:46.019+0000 7f091092a700 1 -- 172.21.15.6:0/1939099190 wait complete. 2023-07-07T04:01:46.024 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 20 2023-07-07T04:01:46.035 DEBUG:tasks.cephfs.filesystem:already dead... 2023-07-07T04:01:46.036 INFO:teuthology.misc:Shutting down mds daemons... 2023-07-07T04:01:46.036 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-07T04:01:46.036 INFO:teuthology.orchestra.run:waiting for 300 2023-07-07T04:01:46.046 INFO:tasks.ceph.mds.a:Stopped 2023-07-07T04:01:46.046 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-07T04:01:46.047 INFO:teuthology.orchestra.run:waiting for 300 2023-07-07T04:01:46.097 INFO:tasks.ceph.mds.c:Stopped 2023-07-07T04:01:46.097 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-07T04:01:46.097 INFO:teuthology.orchestra.run:waiting for 300 2023-07-07T04:01:46.109 INFO:tasks.ceph.mds.b:Stopped 2023-07-07T04:01:46.109 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-07T04:01:46.110 INFO:teuthology.orchestra.run:waiting for 300 2023-07-07T04:01:46.160 INFO:tasks.ceph.mds.d:Stopped 2023-07-07T04:01:46.161 INFO:teuthology.misc:Shutting down osd daemons... 2023-07-07T04:01:46.161 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-07-07T04:01:46.161 INFO:teuthology.orchestra.run:waiting for 300 2023-07-07T04:01:49.761 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-07-07T04:01:51.855 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T04:01:51.857 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T04:01:52.263 INFO:tasks.ceph.osd.0:Stopped 2023-07-07T04:01:52.264 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-07-07T04:01:52.265 INFO:teuthology.orchestra.run:waiting for 300 2023-07-07T04:01:52.347 INFO:tasks.ceph.osd.1:Stopped 2023-07-07T04:01:52.348 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-07-07T04:01:52.349 INFO:teuthology.orchestra.run:waiting for 300 2023-07-07T04:01:55.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-07-07T04:01:55.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-07-07T04:01:58.450 INFO:tasks.ceph.osd.2:Stopped 2023-07-07T04:01:58.451 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-07-07T04:01:58.451 INFO:teuthology.orchestra.run:waiting for 300 2023-07-07T04:02:01.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-07-07T04:02:01.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-07-07T04:02:04.552 INFO:tasks.ceph.osd.3:Stopped 2023-07-07T04:02:04.553 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-07-07T04:02:04.553 INFO:teuthology.orchestra.run:waiting for 300 2023-07-07T04:02:07.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-07-07T04:02:07.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-07-07T04:02:10.655 INFO:tasks.ceph.osd.4:Stopped 2023-07-07T04:02:10.656 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-07-07T04:02:10.656 INFO:teuthology.orchestra.run:waiting for 300 2023-07-07T04:02:13.183 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-07-07T04:02:13.184 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-07-07T04:02:16.758 INFO:tasks.ceph.osd.5:Stopped 2023-07-07T04:02:16.759 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-07-07T04:02:16.759 INFO:teuthology.orchestra.run:waiting for 300 2023-07-07T04:02:18.788 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-07-07T04:02:18.789 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-07-07T04:02:21.920 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T04:02:21.923 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T04:02:22.861 INFO:tasks.ceph.osd.6:Stopped 2023-07-07T04:02:22.862 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-07-07T04:02:22.862 INFO:teuthology.orchestra.run:waiting for 300 2023-07-07T04:02:24.292 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-07-07T04:02:24.292 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-07-07T04:02:28.963 INFO:tasks.ceph.osd.7:Stopped 2023-07-07T04:02:28.964 INFO:teuthology.misc:Shutting down mgr daemons... 2023-07-07T04:02:28.964 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-07-07T04:02:28.965 INFO:teuthology.orchestra.run:waiting for 300 2023-07-07T04:02:29.000 INFO:tasks.ceph.mgr.y:Stopped 2023-07-07T04:02:29.001 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-07-07T04:02:29.001 INFO:teuthology.orchestra.run:waiting for 300 2023-07-07T04:02:29.027 INFO:tasks.ceph.mgr.x:Stopped 2023-07-07T04:02:29.027 INFO:teuthology.misc:Shutting down mon daemons... 2023-07-07T04:02:29.028 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-07-07T04:02:29.028 INFO:teuthology.orchestra.run:waiting for 300 2023-07-07T04:02:29.077 INFO:tasks.ceph.mon.a:Stopped 2023-07-07T04:02:29.077 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-07-07T04:02:29.077 INFO:teuthology.orchestra.run:waiting for 300 2023-07-07T04:02:29.101 INFO:tasks.ceph.mon.b:Stopped 2023-07-07T04:02:29.101 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-07-07T04:02:29.101 INFO:teuthology.orchestra.run:waiting for 300 2023-07-07T04:02:29.163 INFO:tasks.ceph.mon.c:Stopped 2023-07-07T04:02:29.163 INFO:tasks.ceph:Checking cluster log for badness... 2023-07-07T04:02:29.164 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-07T04:02:29.268 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi006.front.sepia.ceph.com 2023-07-07T04:02:29.268 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-07-07T04:02:29.293 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-07-07T04:02:29.545 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi006.front.sepia.ceph.com 2023-07-07T04:02:29.545 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-07-07T04:02:29.816 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi006.front.sepia.ceph.com 2023-07-07T04:02:29.816 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-07-07T04:02:29.992 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi006.front.sepia.ceph.com 2023-07-07T04:02:29.993 DEBUG:teuthology.orchestra.run.smithi006:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-07-07T04:02:30.182 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi040.front.sepia.ceph.com 2023-07-07T04:02:30.183 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-07-07T04:02:30.461 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi040.front.sepia.ceph.com 2023-07-07T04:02:30.461 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-07-07T04:02:30.619 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi040.front.sepia.ceph.com 2023-07-07T04:02:30.620 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-07-07T04:02:30.768 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi040.front.sepia.ceph.com 2023-07-07T04:02:30.768 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-07-07T04:02:30.929 INFO:tasks.ceph:Archiving mon data... 2023-07-07T04:02:30.931 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-07-06_19:33:28-fs-wip-rishabh-2023Jul5-testing-default-smithi/7328165/data/mon.a.tgz 2023-07-07T04:02:30.931 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2023-07-07T04:02:30.954 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.wNReAHkB3X 2023-07-07T04:02:30.955 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.wNReAHkB3X 2023-07-07T04:02:31.199 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.wNReAHkB3X 2023-07-07T04:02:31.322 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.wNReAHkB3X is 614KB 2023-07-07T04:02:31.395 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.wNReAHkB3X 2023-07-07T04:02:31.416 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-07-06_19:33:28-fs-wip-rishabh-2023Jul5-testing-default-smithi/7328165/data/mon.b.tgz 2023-07-07T04:02:31.417 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2023-07-07T04:02:31.450 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.d6cDMDg9X2 2023-07-07T04:02:31.450 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.d6cDMDg9X2 2023-07-07T04:02:31.638 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.d6cDMDg9X2 2023-07-07T04:02:31.753 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.d6cDMDg9X2 is 615KB 2023-07-07T04:02:31.822 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.d6cDMDg9X2 2023-07-07T04:02:31.848 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-07-06_19:33:28-fs-wip-rishabh-2023Jul5-testing-default-smithi/7328165/data/mon.c.tgz 2023-07-07T04:02:31.849 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2023-07-07T04:02:31.904 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.ZVRfAigMJf 2023-07-07T04:02:31.904 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ZVRfAigMJf 2023-07-07T04:02:32.062 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.ZVRfAigMJf 2023-07-07T04:02:32.147 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.ZVRfAigMJf is 615KB 2023-07-07T04:02:32.216 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.ZVRfAigMJf 2023-07-07T04:02:32.233 INFO:tasks.ceph:Cleaning ceph cluster... 2023-07-07T04:02:32.234 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-07T04:02:32.236 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-07T04:02:32.338 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-07-07T04:02:32.338 DEBUG:teuthology.orchestra.run.smithi006:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-07T04:02:32.341 DEBUG:teuthology.orchestra.run.smithi040:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-07T04:02:32.374 INFO:teuthology.orchestra.run.smithi006.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-07T04:02:32.379 INFO:teuthology.orchestra.run.smithi040.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-07T04:02:32.385 INFO:tasks.ceph:Archiving crash dumps... 2023-07-07T04:02:32.387 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-06_19:33:28-fs-wip-rishabh-2023Jul5-testing-default-smithi/7328165/remote/smithi006/crash 2023-07-07T04:02:32.388 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-07T04:02:32.455 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-06_19:33:28-fs-wip-rishabh-2023Jul5-testing-default-smithi/7328165/remote/smithi040/crash 2023-07-07T04:02:32.456 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-07T04:02:32.483 INFO:tasks.ceph:Shutting down logrotate 2023-07-07T04:02:32.484 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T04:02:32.500 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-07T04:02:32.583 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-07T04:02:32.638 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-07T04:02:32.671 INFO:tasks.ceph:Compressing logs... 2023-07-07T04:02:32.672 DEBUG:teuthology.orchestra.run.smithi006:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-07T04:02:32.674 DEBUG:teuthology.orchestra.run.smithi040:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-07T04:02:32.712 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173488.log 2023-07-07T04:02:32.713 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287240.log 2023-07-07T04:02:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.173488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346301.log 2023-07-07T04:02:32.714 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173488.log.gz 2023-07-07T04:02:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118016.log 2023-07-07T04:02:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118526.log 2023-07-07T04:02:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108132.log 2023-07-07T04:02:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.643907.log 2023-07-07T04:02:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.698757.log 2023-07-07T04:02:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201010.log 2023-07-07T04:02:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193435.log 2023-07-07T04:02:32.717 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206461.log 2023-07-07T04:02:32.717 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689548.log 2023-07-07T04:02:32.718 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.809507.log 2023-07-07T04:02:32.718 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.622318.log 2023-07-07T04:02:32.718 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693633.log 2023-07-07T04:02:32.718 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647473.log 2023-07-07T04:02:32.718 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116754.log 2023-07-07T04:02:32.719 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290649.log 2023-07-07T04:02:32.720 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107162.log 2023-07-07T04:02:32.720 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116342.log 2023-07-07T04:02:32.720 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194141.log 2023-07-07T04:02:32.720 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198066.log 2023-07-07T04:02:32.720 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.758707.log 2023-07-07T04:02:32.721 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117830.log 2023-07-07T04:02:32.721 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297161.log 2023-07-07T04:02:32.722 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165854.log 2023-07-07T04:02:32.722 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380072.log 2023-07-07T04:02:32.722 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636318.log 2023-07-07T04:02:32.722 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107886.log 2023-07-07T04:02:32.722 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115461.log 2023-07-07T04:02:32.723 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315845.log 2023-07-07T04:02:32.723 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394432.log 2023-07-07T04:02:32.724 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199513.log 2023-07-07T04:02:32.724 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343087.log 2023-07-07T04:02:32.724 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118292.log 2023-07-07T04:02:32.724 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634696.log 2023-07-07T04:02:32.724 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346502.log 2023-07-07T04:02:32.725 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627536.log 2023-07-07T04:02:32.725 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265709.log 2023-07-07T04:02:32.726 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773694.log 2023-07-07T04:02:32.726 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224439.log 2023-07-07T04:02:32.726 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111079.log 2023-07-07T04:02:32.726 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.942117.log 2023-07-07T04:02:32.726 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339108.log 2023-07-07T04:02:32.728 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310624.log 2023-07-07T04:02:32.728 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312080.log 2023-07-07T04:02:32.728 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.817855.log 2023-07-07T04:02:32.728 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334950.log 2023-07-07T04:02:32.728 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206475.log 2023-07-07T04:02:32.729 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118016.log: /var/log/ceph/ceph-client.admin.346301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423013.log 2023-07-07T04:02:32.737 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.297161.log: /var/log/ceph/ceph-client.admin.643907.log: /var/log/ceph/ceph-client.admin.698757.log: gzip /var/log/ceph/ceph-client.admin.346502.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.201481.log 2023-07-07T04:02:32.738 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.290649.log: /var/log/ceph/ceph-client.admin.199513.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.297161.log.gz -- replaced with /var/log/ceph/ceph-client.admin.643907.log.gz 2023-07-07T04:02:32.738 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:32.738 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.698757.log.gz 2023-07-07T04:02:32.738 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346502.log.gz 2023-07-07T04:02:32.738 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290649.log.gz 2023-07-07T04:02:32.739 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199513.log.gz 2023-07-07T04:02:32.739 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.689548.log: /var/log/ceph/ceph-client.admin.809507.log: /var/log/ceph/ceph-client.admin.423013.log: /var/log/ceph/ceph-client.admin.693633.log: /var/log/ceph/ceph-client.admin.647473.log: /var/log/ceph/ceph-client.admin.758707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689548.log.gz 2023-07-07T04:02:32.739 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.636318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.809507.log.gz 2023-07-07T04:02:32.739 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.423013.log.gz 2023-07-07T04:02:32.739 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.647473.log.gz 2023-07-07T04:02:32.739 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.758707.log.gz 2023-07-07T04:02:32.740 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636318.log.gz 2023-07-07T04:02:32.740 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.634696.log: /var/log/ceph/ceph-client.admin.627536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773694.log: /var/log/ceph/ceph-client.admin.287254.log 2023-07-07T04:02:32.740 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.942117.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634696.log.gz 2023-07-07T04:02:32.740 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.287240.log: /var/log/ceph/ceph-client.admin.817855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627536.log.gz 2023-07-07T04:02:32.740 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773694.log.gz 2023-07-07T04:02:32.741 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.817855.log.gz 0.0% 2023-07-07T04:02:32.741 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.287240.log.gz 2023-07-07T04:02:32.741 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118526.log: /var/log/ceph/ceph-client.admin.201010.log: /var/log/ceph/ceph-client.admin.117830.log: /var/log/ceph/ceph-client.admin.312080.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.942117.log.gz 2023-07-07T04:02:32.741 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.201481.log: /var/log/ceph/ceph-client.admin.334950.log: /var/log/ceph/ceph-client.admin.206475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201010.log.gz 2023-07-07T04:02:32.741 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312080.log.gz 2023-07-07T04:02:32.742 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.334950.log.gz -- replaced with /var/log/ceph/ceph-client.admin.201481.log.gz--verbose 2023-07-07T04:02:32.742 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:32.742 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.286230.log 2023-07-07T04:02:32.742 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346301.log.gz 2023-07-07T04:02:32.742 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206475.log.gz 2023-07-07T04:02:32.743 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.193435.log: /var/log/ceph/ceph-client.admin.107886.log: /var/log/ceph/ceph-client.admin.111079.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193435.log.gz 2023-07-07T04:02:32.743 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.287254.log: /var/log/ceph/ceph-client.admin.339108.log: /var/log/ceph/ceph-client.admin.622318.log: /var/log/ceph/ceph-client.admin.315845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287254.log.gz 2023-07-07T04:02:32.743 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211482.log 2023-07-07T04:02:32.743 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.380072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339108.log.gz 2023-07-07T04:02:32.743 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622318.log.gz 2023-07-07T04:02:32.743 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315845.log.gz 2023-07-07T04:02:32.744 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.380072.log.gz 2023-07-07T04:02:32.744 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.165854.log: /var/log/ceph/ceph-client.admin.343087.log: /var/log/ceph/ceph-client.admin.310624.log: /var/log/ceph/ceph-client.admin.107162.log: /var/log/ceph/ceph-client.admin.116754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165854.log.gz 2023-07-07T04:02:32.744 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.224439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343087.log.gz 2023-07-07T04:02:32.744 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310624.log.gz 2023-07-07T04:02:32.744 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773075.log 2023-07-07T04:02:32.745 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224439.log.gz 2023-07-07T04:02:32.745 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.198066.log: /var/log/ceph/ceph-client.admin.394432.log: /var/log/ceph/ceph-client.admin.194141.log: /var/log/ceph/ceph-client.admin.206461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198066.log.gz 2023-07-07T04:02:32.745 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394432.log.gz 2023-07-07T04:02:32.745 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194141.log.gz 2023-07-07T04:02:32.745 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206461.log.gz 2023-07-07T04:02:32.745 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.211482.log: /var/log/ceph/ceph-client.admin.265709.log: /var/log/ceph/ceph-client.admin.115461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211482.log.gz 2023-07-07T04:02:32.746 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709864.log 2023-07-07T04:02:32.746 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265709.log.gz 2023-07-07T04:02:32.746 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.286230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286230.log.gz 2023-07-07T04:02:32.746 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.773075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.669806.log 2023-07-07T04:02:32.746 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773075.log.gz 2023-07-07T04:02:32.747 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.709864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366364.log 2023-07-07T04:02:32.747 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709864.log.gz 2023-07-07T04:02:32.747 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.669806.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.669806.log.gz--verbose 2023-07-07T04:02:32.747 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.286448.log 2023-07-07T04:02:32.747 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.118016.log.gz 2023-07-07T04:02:32.748 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.366364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628978.log 2023-07-07T04:02:32.748 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366364.log.gz 2023-07-07T04:02:32.748 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693633.log.gz 2023-07-07T04:02:32.748 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.286448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107982.log 2023-07-07T04:02:32.748 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286448.log.gz 2023-07-07T04:02:32.748 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.628978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387272.log 2023-07-07T04:02:32.749 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628978.log.gz 2023-07-07T04:02:32.749 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263760.log 2023-07-07T04:02:32.749 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118526.log.gz 2023-07-07T04:02:32.749 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107982.log: /var/log/ceph/ceph-client.admin.387272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270679.log 2023-07-07T04:02:32.749 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387272.log.gz 2023-07-07T04:02:32.750 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.263760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459510.log 2023-07-07T04:02:32.750 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263760.log.gz 2023-07-07T04:02:32.750 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.270679.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.166595.log 2023-07-07T04:02:32.750 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270679.log.gz 2023-07-07T04:02:32.750 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.459510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191016.log 2023-07-07T04:02:32.751 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.459510.log.gz 2023-07-07T04:02:32.751 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.166595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654569.log 2023-07-07T04:02:32.751 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166595.log.gz 2023-07-07T04:02:32.751 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.191016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342783.log 2023-07-07T04:02:32.751 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.115461.log.gz 2023-07-07T04:02:32.751 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191016.log.gz 2023-07-07T04:02:32.752 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.654569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355444.log 2023-07-07T04:02:32.752 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.342783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351450.log 2023-07-07T04:02:32.752 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342783.log.gz 2023-07-07T04:02:32.752 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.355444.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.355444.log.gz--verbose 2023-07-07T04:02:32.752 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.394136.log 2023-07-07T04:02:32.753 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.351450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159415.log 2023-07-07T04:02:32.753 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351450.log.gz 2023-07-07T04:02:32.753 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.394136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647018.log 2023-07-07T04:02:32.753 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394136.log.gz 2023-07-07T04:02:32.753 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116342.log.gz 2023-07-07T04:02:32.754 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.159415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400606.log 2023-07-07T04:02:32.754 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159415.log.gz 2023-07-07T04:02:32.754 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.647018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291140.log 2023-07-07T04:02:32.754 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.647018.log.gz 2023-07-07T04:02:32.761 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-07-07T04:02:32.762 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101105.log 2023-07-07T04:02:32.762 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-07T04:02:32.762 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.admin.101105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101015.log 2023-07-07T04:02:32.762 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-07-07T04:02:32.763 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph.log: gzip /var/log/ceph/ceph-client.admin.101015.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.101060.log 2023-07-07T04:02:32.763 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-07-07T04:02:32.763 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.101060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101158.log 2023-07-07T04:02:32.763 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-07T04:02:32.763 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.101158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100969.log 2023-07-07T04:02:32.763 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-07-07T04:02:32.764 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.100969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.108440.log 2023-07-07T04:02:32.764 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.107833.log 2023-07-07T04:02:32.764 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.3.108440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.108444.log 2023-07-07T04:02:32.764 INFO:teuthology.orchestra.run.smithi040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.108440.log.gz 2023-07-07T04:02:32.764 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.1.107833.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-07-07T04:02:32.765 INFO:teuthology.orchestra.run.smithi040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.107833.log.gz 2023-07-07T04:02:32.765 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.3.108444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.107825.log 2023-07-07T04:02:32.765 INFO:teuthology.orchestra.run.smithi040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.108444.log.gz 2023-07-07T04:02:32.765 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101203.log 2023-07-07T04:02:32.765 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.1.107825.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-07-07T04:02:32.766 INFO:teuthology.orchestra.run.smithi040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.107825.log.gz 2023-07-07T04:02:32.766 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.101203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100876.log 2023-07-07T04:02:32.766 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-07-07T04:02:32.766 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.100876.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-07-07T04:02:32.766 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-07-07T04:02:32.766 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100922.log 2023-07-07T04:02:32.804 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-client.admin.100922.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.100876.log.gz 2023-07-07T04:02:32.804 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100922.log.gz 2023-07-07T04:02:32.805 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.100969.log.gz 2023-07-07T04:02:32.805 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% 86.9% -- replaced with /var/log/ceph/ceph-client.admin.101015.log.gz -- replaced with /var/log/ceph/ceph-client.admin.101060.log.gz 2023-07-07T04:02:32.805 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-07-07T04:02:32.805 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101105.log.gz 2023-07-07T04:02:32.806 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101158.log.gz 2023-07-07T04:02:32.806 INFO:teuthology.orchestra.run.smithi040.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101203.log.gz 2023-07-07T04:02:32.816 INFO:teuthology.orchestra.run.smithi040.stderr: 93.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-07T04:02:32.824 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317705.log 2023-07-07T04:02:32.824 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.400606.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116754.log.gz 2023-07-07T04:02:32.825 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.400606.log.gz 2023-07-07T04:02:32.825 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.291140.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.625852.log 2023-07-07T04:02:32.825 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.291140.log.gz 2023-07-07T04:02:32.825 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.317705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479938.log 88.9% 2023-07-07T04:02:32.825 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.117830.log.gz 2023-07-07T04:02:32.826 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317705.log.gz 2023-07-07T04:02:32.826 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.625852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427390.log 2023-07-07T04:02:32.826 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625852.log.gz 2023-07-07T04:02:32.826 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.479938.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.479938.log.gz--verbose 2023-07-07T04:02:32.826 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.203505.log 2023-07-07T04:02:32.826 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.427390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207963.log 2023-07-07T04:02:32.827 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654569.log.gz 2023-07-07T04:02:32.827 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.427390.log.gz 2023-07-07T04:02:32.827 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703184.log 2023-07-07T04:02:32.827 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.203505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.203505.log.gz 2023-07-07T04:02:32.827 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.207963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.826607.log 2023-07-07T04:02:32.828 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207963.log.gz 2023-07-07T04:02:32.828 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.703184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301500.log 2023-07-07T04:02:32.828 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703184.log.gz 2023-07-07T04:02:32.828 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.826607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.805083.log 2023-07-07T04:02:32.828 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.826607.log.gz 2023-07-07T04:02:32.829 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.301500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312094.log 2023-07-07T04:02:32.829 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118292.log.gz 2023-07-07T04:02:32.829 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301500.log.gz 2023-07-07T04:02:32.829 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.805083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405819.log 2023-07-07T04:02:32.829 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.805083.log.gz 2023-07-07T04:02:32.830 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.312094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656867.log 2023-07-07T04:02:32.830 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312094.log.gz 2023-07-07T04:02:32.830 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.779726.log 2023-07-07T04:02:32.830 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.405819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405819.log.gz 2023-07-07T04:02:32.830 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.656867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350114.log 2023-07-07T04:02:32.830 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656867.log.gz 2023-07-07T04:02:32.831 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.779726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349051.log 2023-07-07T04:02:32.831 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.779726.log.gz 2023-07-07T04:02:32.831 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.350114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694495.log 2023-07-07T04:02:32.831 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350114.log.gz 2023-07-07T04:02:32.831 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.349051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109612.log 2023-07-07T04:02:32.832 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349051.log.gz 2023-07-07T04:02:32.832 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.694495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.706693.log 2023-07-07T04:02:32.832 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694495.log.gz 2023-07-07T04:02:32.832 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349266.log 2023-07-07T04:02:32.832 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.107162.log.gz 2023-07-07T04:02:32.832 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.706693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.706693.log.gz 2023-07-07T04:02:32.833 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301032.log 2023-07-07T04:02:32.833 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.349266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.805391.log 2023-07-07T04:02:32.833 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349266.log.gz 2023-07-07T04:02:32.833 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.301032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.803333.log 2023-07-07T04:02:32.833 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301032.log.gz 2023-07-07T04:02:32.834 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.805391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.938598.log 2023-07-07T04:02:32.834 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.805391.log.gz 2023-07-07T04:02:32.834 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107886.log.gz 2023-07-07T04:02:32.834 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.803333.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.107982.log.gz 2023-07-07T04:02:32.834 INFO:teuthology.orchestra.run.smithi006.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.805888.log 2023-07-07T04:02:32.835 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.803333.log.gz 2023-07-07T04:02:32.835 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108132.log.gz 2023-07-07T04:02:32.835 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.938598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330182.log 2023-07-07T04:02:32.835 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.938598.log.gz 2023-07-07T04:02:32.835 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.805888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671353.log 2023-07-07T04:02:32.835 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.805888.log.gz 2023-07-07T04:02:32.836 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.330182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375995.log 2023-07-07T04:02:32.836 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330182.log.gz 2023-07-07T04:02:32.836 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.671353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680865.log 2023-07-07T04:02:32.836 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671353.log.gz 2023-07-07T04:02:32.836 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.375995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390012.log 2023-07-07T04:02:32.837 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.375995.log.gz 2023-07-07T04:02:32.837 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.680865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318716.log 2023-07-07T04:02:32.837 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680865.log.gz 2023-07-07T04:02:32.837 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.390012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449651.log 2023-07-07T04:02:32.837 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.390012.log.gz 2023-07-07T04:02:32.838 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.318716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330917.log 2023-07-07T04:02:32.838 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318716.log.gz 2023-07-07T04:02:32.838 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.449651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369072.log 2023-07-07T04:02:32.838 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.449651.log.gz 2023-07-07T04:02:32.838 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.330917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377078.log 2023-07-07T04:02:32.838 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330917.log.gz 2023-07-07T04:02:32.839 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.369072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371448.log 2023-07-07T04:02:32.839 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.369072.log.gz 2023-07-07T04:02:32.839 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.377078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387794.log 2023-07-07T04:02:32.839 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.377078.log.gz 2023-07-07T04:02:32.839 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.371448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682643.log 2023-07-07T04:02:32.840 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.371448.log.gz 2023-07-07T04:02:32.840 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.387794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189992.log 2023-07-07T04:02:32.840 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387794.log.gz 2023-07-07T04:02:32.840 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.682643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157861.log 2023-07-07T04:02:32.840 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682643.log.gz 2023-07-07T04:02:32.841 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.189992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115963.log 2023-07-07T04:02:32.841 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189992.log.gz 2023-07-07T04:02:32.841 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.157861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283574.log 2023-07-07T04:02:32.841 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% 87.8% -- replaced with /var/log/ceph/ceph-client.admin.157861.log.gz -- replaced with /var/log/ceph/ceph-client.admin.109612.log.gz 2023-07-07T04:02:32.841 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:32.841 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633206.log 2023-07-07T04:02:32.842 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.283574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.711742.log 2023-07-07T04:02:32.842 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283574.log.gz 2023-07-07T04:02:32.842 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.633206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703570.log 2023-07-07T04:02:32.842 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633206.log.gz 2023-07-07T04:02:32.842 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.711742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119099.log 2023-07-07T04:02:32.843 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.711742.log.gz 2023-07-07T04:02:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.703570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303039.log 2023-07-07T04:02:32.843 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703570.log.gz 2023-07-07T04:02:32.843 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.119099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.701367.log 2023-07-07T04:02:32.843 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.115963.log.gz 2023-07-07T04:02:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.303039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429359.log 2023-07-07T04:02:32.844 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303039.log.gz 2023-07-07T04:02:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.701367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638637.log 2023-07-07T04:02:32.844 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701367.log.gz 2023-07-07T04:02:32.844 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.429359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201887.log 2023-07-07T04:02:32.845 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.429359.log.gz 2023-07-07T04:02:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.638637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249543.log 2023-07-07T04:02:32.845 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638637.log.gz 2023-07-07T04:02:32.845 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.111079.log.gz 2023-07-07T04:02:32.845 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.201887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.939620.log 2023-07-07T04:02:32.845 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201887.log.gz 2023-07-07T04:02:32.846 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.249543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449982.log 2023-07-07T04:02:32.846 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249543.log.gz 2023-07-07T04:02:32.846 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.939620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334964.log 2023-07-07T04:02:32.846 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.939620.log.gz 2023-07-07T04:02:32.846 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.449982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166130.log 2023-07-07T04:02:32.847 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.449982.log.gz 2023-07-07T04:02:32.847 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.334964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693325.log 2023-07-07T04:02:32.847 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334964.log.gz 2023-07-07T04:02:32.847 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.166130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214376.log 2023-07-07T04:02:32.847 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166130.log.gz 2023-07-07T04:02:32.848 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.693325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.761746.log 2023-07-07T04:02:32.848 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693325.log.gz 2023-07-07T04:02:32.848 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.214376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657382.log 2023-07-07T04:02:32.848 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214376.log.gz 2023-07-07T04:02:32.848 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.761746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416909.log 2023-07-07T04:02:32.848 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.761746.log.gz 2023-07-07T04:02:32.849 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.657382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.818228.log 2023-07-07T04:02:32.849 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.657382.log.gz 2023-07-07T04:02:32.849 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.416909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117970.log 2023-07-07T04:02:32.849 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.416909.log.gz 2023-07-07T04:02:32.849 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.818228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659064.log 2023-07-07T04:02:32.850 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.818228.log.gz 2023-07-07T04:02:32.850 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310330.log 2023-07-07T04:02:32.850 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117970.log: /var/log/ceph/ceph-client.admin.659064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117314.log 2023-07-07T04:02:32.850 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659064.log.gz 2023-07-07T04:02:32.850 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.310330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.775783.log 2023-07-07T04:02:32.851 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310330.log.gz 2023-07-07T04:02:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.779526.log 2023-07-07T04:02:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.775783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382440.log 2023-07-07T04:02:32.851 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.775783.log.gz 2023-07-07T04:02:32.851 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117970.log.gz 2023-07-07T04:02:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.779526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672594.log 2023-07-07T04:02:32.852 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.779526.log.gz 2023-07-07T04:02:32.852 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.117314.log.gz 2023-07-07T04:02:32.852 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.382440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382440.log.gzgzip 2023-07-07T04:02:32.852 INFO:teuthology.orchestra.run.smithi006.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.296447.log 2023-07-07T04:02:32.852 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.672594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335466.log 2023-07-07T04:02:32.853 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672594.log.gz 2023-07-07T04:02:32.853 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.119099.log.gz 2023-07-07T04:02:32.853 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.296447.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.296447.log.gz--verbose 2023-07-07T04:02:32.853 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.374106.log 2023-07-07T04:02:32.853 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.335466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108316.log 2023-07-07T04:02:32.854 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335466.log.gz 2023-07-07T04:02:32.854 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.374106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376999.log 2023-07-07T04:02:32.854 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.374106.log.gz 2023-07-07T04:02:32.854 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710965.log 2023-07-07T04:02:32.854 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.376999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633771.log 2023-07-07T04:02:32.854 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.376999.log.gz 2023-07-07T04:02:32.855 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.710965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114485.log 2023-07-07T04:02:32.855 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.108316.log.gz 2023-07-07T04:02:32.855 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710965.log.gz 2023-07-07T04:02:32.855 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.633771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417578.log 2023-07-07T04:02:32.855 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633771.log.gz 2023-07-07T04:02:32.856 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295936.log 2023-07-07T04:02:32.856 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.417578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174664.log 2023-07-07T04:02:32.856 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.417578.log.gz 2023-07-07T04:02:32.856 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.295936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364632.log 2023-07-07T04:02:32.856 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.295936.log.gz 2023-07-07T04:02:32.857 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.174664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366888.log 2023-07-07T04:02:32.857 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174664.log.gz 2023-07-07T04:02:32.857 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.364632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308829.log 2023-07-07T04:02:32.857 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.364632.log.gz 2023-07-07T04:02:32.857 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.366888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.938037.log 2023-07-07T04:02:32.857 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366888.log.gz 2023-07-07T04:02:32.858 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.308829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478514.log 2023-07-07T04:02:32.858 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308829.log.gz 2023-07-07T04:02:32.858 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.938037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275019.log 2023-07-07T04:02:32.858 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.938037.log.gz 2023-07-07T04:02:32.858 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.478514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.478514.log.gz 2023-07-07T04:02:32.859 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213426.log 2023-07-07T04:02:32.859 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.275019.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.371029.log 2023-07-07T04:02:32.859 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275019.log.gz 2023-07-07T04:02:32.859 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.213426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697027.log 2023-07-07T04:02:32.859 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213426.log.gz 2023-07-07T04:02:32.860 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.371029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204069.log 2023-07-07T04:02:32.860 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.371029.log.gz 2023-07-07T04:02:32.860 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.697027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387258.log 2023-07-07T04:02:32.860 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697027.log.gz 2023-07-07T04:02:32.860 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416385.log 2023-07-07T04:02:32.861 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.204069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204069.log.gz 2023-07-07T04:02:32.861 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.387258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401763.log 2023-07-07T04:02:32.861 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387258.log.gz 2023-07-07T04:02:32.861 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.416385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688129.log 2023-07-07T04:02:32.861 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.416385.log.gz 2023-07-07T04:02:32.861 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.114485.log.gz 2023-07-07T04:02:32.862 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.401763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285703.log 2023-07-07T04:02:32.862 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.401763.log.gz 2023-07-07T04:02:32.862 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.688129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645942.log 2023-07-07T04:02:32.862 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688129.log.gz 2023-07-07T04:02:32.862 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.285703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248539.log 2023-07-07T04:02:32.863 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285703.log.gz 2023-07-07T04:02:32.863 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.645942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198749.log 2023-07-07T04:02:32.863 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645942.log.gz 2023-07-07T04:02:32.863 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.248539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.799807.log 2023-07-07T04:02:32.863 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248539.log.gz 2023-07-07T04:02:32.863 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.198749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223184.log 2023-07-07T04:02:32.864 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198749.log.gz 2023-07-07T04:02:32.864 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.799807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660606.log 2023-07-07T04:02:32.864 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.799807.log.gz 2023-07-07T04:02:32.864 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.223184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.819089.log 2023-07-07T04:02:32.864 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223184.log.gz 2023-07-07T04:02:32.865 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.660606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411895.log 2023-07-07T04:02:32.865 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.660606.log.gz 2023-07-07T04:02:32.865 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.819089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427858.log 2023-07-07T04:02:32.865 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.819089.log.gz 2023-07-07T04:02:32.865 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.411895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331910.log 2023-07-07T04:02:32.866 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411895.log.gz 2023-07-07T04:02:32.866 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.427858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681236.log 2023-07-07T04:02:32.866 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.427858.log.gz 2023-07-07T04:02:32.866 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.331910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283020.log 2023-07-07T04:02:32.866 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331910.log.gz 2023-07-07T04:02:32.866 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.681236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118480.log 2023-07-07T04:02:32.867 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681236.log.gz 2023-07-07T04:02:32.867 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.283020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697326.log 2023-07-07T04:02:32.867 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283020.log.gz 2023-07-07T04:02:32.867 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448746.log 2023-07-07T04:02:32.867 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118480.log: /var/log/ceph/ceph-client.admin.697326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.759246.log 2023-07-07T04:02:32.868 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697326.log.gz 2023-07-07T04:02:32.868 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.448746.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.118480.log.gz 2023-07-07T04:02:32.868 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.765355.log 2023-07-07T04:02:32.868 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.448746.log.gz 2023-07-07T04:02:32.868 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.759246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174370.log 2023-07-07T04:02:32.869 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.759246.log.gz 2023-07-07T04:02:32.869 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.765355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.758901.log 2023-07-07T04:02:32.869 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.765355.log.gz 2023-07-07T04:02:32.869 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.174370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415042.log 2023-07-07T04:02:32.869 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174370.log.gz 2023-07-07T04:02:32.869 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.758901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200996.log 2023-07-07T04:02:32.870 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.758901.log.gz 2023-07-07T04:02:32.870 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.415042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276080.log 2023-07-07T04:02:32.870 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.415042.log.gz 2023-07-07T04:02:32.870 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.200996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257693.log 2023-07-07T04:02:32.870 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200996.log.gz 2023-07-07T04:02:32.871 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.276080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386008.log 2023-07-07T04:02:32.871 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276080.log.gz 2023-07-07T04:02:32.871 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.257693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226205.log 2023-07-07T04:02:32.871 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257693.log.gz 2023-07-07T04:02:32.871 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.386008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654862.log 2023-07-07T04:02:32.872 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386008.log.gz 2023-07-07T04:02:32.872 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.226205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308843.log 2023-07-07T04:02:32.872 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226205.log.gz 2023-07-07T04:02:32.872 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.654862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673645.log 2023-07-07T04:02:32.872 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654862.log.gz 2023-07-07T04:02:32.872 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.308843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660392.log 2023-07-07T04:02:32.873 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308843.log.gz 2023-07-07T04:02:32.873 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.776950.log 2023-07-07T04:02:32.873 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.673645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673645.log.gz 2023-07-07T04:02:32.873 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.660392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932814.log 2023-07-07T04:02:32.873 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.660392.log.gz 2023-07-07T04:02:32.874 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.776950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222078.log 2023-07-07T04:02:32.874 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.776950.log.gz 2023-07-07T04:02:32.874 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357482.log 2023-07-07T04:02:32.874 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.932814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.932814.log.gz 2023-07-07T04:02:32.874 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.222078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190937.log 2023-07-07T04:02:32.874 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222078.log.gz 2023-07-07T04:02:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.357482.log: -- /var/log/ceph/ceph-client.admin.658825.log 2023-07-07T04:02:32.875 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357482.log.gz 2023-07-07T04:02:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114761.log 2023-07-07T04:02:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.190937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190937.log.gz 2023-07-07T04:02:32.875 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.658825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374524.log 2023-07-07T04:02:32.876 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.658825.log.gz 2023-07-07T04:02:32.876 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391786.log 2023-07-07T04:02:32.876 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.374524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367353.log 2023-07-07T04:02:32.876 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.374524.log.gz 2023-07-07T04:02:32.876 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114761.log.gz 2023-07-07T04:02:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.391786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.933800.log 2023-07-07T04:02:32.877 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.391786.log.gz 2023-07-07T04:02:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.367353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419436.log 2023-07-07T04:02:32.877 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.367353.log.gz 2023-07-07T04:02:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.933800.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.933800.log.gz--verbose 2023-07-07T04:02:32.877 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.781512.log 2023-07-07T04:02:32.878 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.419436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426807.log 2023-07-07T04:02:32.878 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.419436.log.gz 2023-07-07T04:02:32.878 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.781512.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.821093.log 2023-07-07T04:02:32.878 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.781512.log.gz 2023-07-07T04:02:32.878 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.426807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279740.log 2023-07-07T04:02:32.879 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.426807.log.gz 2023-07-07T04:02:32.879 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.821093.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.821093.log.gz/var/log/ceph/ceph-client.admin.346794.log 2023-07-07T04:02:32.879 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:32.879 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.279740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194908.log 2023-07-07T04:02:32.879 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279740.log.gz 2023-07-07T04:02:32.880 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.346794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292161.log 2023-07-07T04:02:32.880 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346794.log.gz 2023-07-07T04:02:32.880 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.194908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635808.log 2023-07-07T04:02:32.880 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194908.log.gz 2023-07-07T04:02:32.880 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.292161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292254.log 2023-07-07T04:02:32.880 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292161.log.gz 2023-07-07T04:02:32.881 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.635808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446736.log 2023-07-07T04:02:32.881 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635808.log.gz 2023-07-07T04:02:32.881 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.292254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479230.log 2023-07-07T04:02:32.881 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292254.log.gz 2023-07-07T04:02:32.881 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.446736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326212.log 2023-07-07T04:02:32.882 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.446736.log.gz 2023-07-07T04:02:32.882 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.479230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416615.log 2023-07-07T04:02:32.882 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.479230.log.gz 2023-07-07T04:02:32.882 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.326212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389549.log 2023-07-07T04:02:32.882 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326212.log.gz 2023-07-07T04:02:32.883 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330931.log 2023-07-07T04:02:32.883 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.416615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.416615.log.gz 2023-07-07T04:02:32.883 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.389549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629911.log 2023-07-07T04:02:32.883 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.389549.log.gz 2023-07-07T04:02:32.883 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.330931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200447.log 2023-07-07T04:02:32.883 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330931.log.gz 2023-07-07T04:02:32.884 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.629911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.775977.log 2023-07-07T04:02:32.884 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629911.log.gz 2023-07-07T04:02:32.884 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.200447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268204.log 2023-07-07T04:02:32.884 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200447.log.gz 2023-07-07T04:02:32.884 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.775977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625897.log 2023-07-07T04:02:32.885 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.775977.log.gz 2023-07-07T04:02:32.885 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.268204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314483.log 2023-07-07T04:02:32.885 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268204.log.gz 2023-07-07T04:02:32.885 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.625897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164648.log 2023-07-07T04:02:32.885 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625897.log.gz 2023-07-07T04:02:32.885 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.314483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.821386.log 2023-07-07T04:02:32.886 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314483.log.gz 2023-07-07T04:02:32.886 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.164648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.822304.log 2023-07-07T04:02:32.886 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164648.log.gz 2023-07-07T04:02:32.886 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.821386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118062.log 2023-07-07T04:02:32.886 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.821386.log.gz 2023-07-07T04:02:32.887 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.822304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.805377.log 2023-07-07T04:02:32.887 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.822304.log.gz 2023-07-07T04:02:32.887 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623311.log 2023-07-07T04:02:32.887 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.805377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807421.log 2023-07-07T04:02:32.887 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.805377.log.gz 2023-07-07T04:02:32.888 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118062.log.gz 2023-07-07T04:02:32.888 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.623311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346007.log 2023-07-07T04:02:32.888 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623311.log.gz 2023-07-07T04:02:32.888 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.807421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323723.log 2023-07-07T04:02:32.888 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807421.log.gz 2023-07-07T04:02:32.888 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.346007.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-07-07T04:02:32.889 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346007.log.gz 2023-07-07T04:02:32.889 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.323723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339575.log 2023-07-07T04:02:32.889 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323723.log.gz 2023-07-07T04:02:32.889 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699356.log 2023-07-07T04:02:32.889 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.339575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297887.log 2023-07-07T04:02:32.890 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339575.log.gz 2023-07-07T04:02:32.890 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.699356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191962.log 2023-07-07T04:02:32.890 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699356.log.gz 2023-07-07T04:02:32.890 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.297887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196104.log 2023-07-07T04:02:32.890 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.297887.log.gz 2023-07-07T04:02:32.890 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.191962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174689.log 2023-07-07T04:02:32.891 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191962.log.gz 2023-07-07T04:02:32.891 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.196104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658839.log 2023-07-07T04:02:32.891 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196104.log.gz 2023-07-07T04:02:32.891 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.174689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349911.log 2023-07-07T04:02:32.891 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174689.log.gz 2023-07-07T04:02:32.892 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.658839.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.658839.log.gz--verbose 2023-07-07T04:02:32.892 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.522246.log 2023-07-07T04:02:32.892 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.349911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110226.log 2023-07-07T04:02:32.892 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349911.log.gz 2023-07-07T04:02:32.892 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.522246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173874.log 2023-07-07T04:02:32.893 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.522246.log.gz 2023-07-07T04:02:32.893 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196090.log 2023-07-07T04:02:32.893 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.173874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399670.log 2023-07-07T04:02:32.893 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173874.log.gz 2023-07-07T04:02:32.893 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.196090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284598.log 2023-07-07T04:02:32.893 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196090.log.gz 2023-07-07T04:02:32.894 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690999.log 2023-07-07T04:02:32.894 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.399670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399670.log.gz 2023-07-07T04:02:32.894 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.284598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680280.log 2023-07-07T04:02:32.894 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284598.log.gz 2023-07-07T04:02:32.894 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.690999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317798.log 2023-07-07T04:02:32.895 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690999.log.gz 2023-07-07T04:02:32.895 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.680280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280756.log 2023-07-07T04:02:32.895 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680280.log.gz 2023-07-07T04:02:32.895 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.317798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671339.log 2023-07-07T04:02:32.895 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317798.log.gz 2023-07-07T04:02:32.896 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.280756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.801289.log 2023-07-07T04:02:32.896 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280756.log.gz 2023-07-07T04:02:32.896 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.671339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371758.log 2023-07-07T04:02:32.896 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671339.log.gz 2023-07-07T04:02:32.896 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.801289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364248.log 2023-07-07T04:02:32.896 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.801289.log.gz 2023-07-07T04:02:32.897 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.371758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704405.log 2023-07-07T04:02:32.897 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.371758.log.gz 2023-07-07T04:02:32.897 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.364248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.364248.log.gz 2023-07-07T04:02:32.897 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342473.log 2023-07-07T04:02:32.897 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.704405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704405.log.gz 2023-07-07T04:02:32.898 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.678860.log 2023-07-07T04:02:32.898 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.342473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.806105.log 2023-07-07T04:02:32.898 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342473.log.gz 2023-07-07T04:02:32.898 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.678860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291730.log 2023-07-07T04:02:32.898 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.678860.log.gz 2023-07-07T04:02:32.899 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644728.log 2023-07-07T04:02:32.899 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.806105.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.806105.log.gz 2023-07-07T04:02:32.899 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.291730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244762.log 2023-07-07T04:02:32.899 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291730.log.gz 2023-07-07T04:02:32.899 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.644728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.642057.log 2023-07-07T04:02:32.899 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644728.log.gz 2023-07-07T04:02:32.900 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.244762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280553.log 2023-07-07T04:02:32.900 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244762.log.gz 2023-07-07T04:02:32.900 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.642057.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.400620.log 2023-07-07T04:02:32.900 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.642057.log.gz 2023-07-07T04:02:32.900 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.280553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299494.log 2023-07-07T04:02:32.901 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280553.log.gz 2023-07-07T04:02:32.901 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478715.log 2023-07-07T04:02:32.901 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.400620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.400620.log.gz 2023-07-07T04:02:32.901 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.299494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207584.log 2023-07-07T04:02:32.901 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299494.log.gz 2023-07-07T04:02:32.902 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.478715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.817380.log 2023-07-07T04:02:32.902 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.478715.log.gz 2023-07-07T04:02:32.902 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.207584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416306.log 2023-07-07T04:02:32.902 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207584.log.gz 2023-07-07T04:02:32.902 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.817380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458998.log 2023-07-07T04:02:32.902 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.817380.log.gz 2023-07-07T04:02:32.903 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.416306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700897.log 2023-07-07T04:02:32.903 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.416306.log.gz 2023-07-07T04:02:32.903 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.458998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.798192.log 2023-07-07T04:02:32.903 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.458998.log.gz 2023-07-07T04:02:32.903 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.700897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333131.log 2023-07-07T04:02:32.904 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700897.log.gz 2023-07-07T04:02:32.904 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.798192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.779512.log 2023-07-07T04:02:32.904 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.798192.log.gz 2023-07-07T04:02:32.904 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.333131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211108.log 2023-07-07T04:02:32.904 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333131.log.gz 2023-07-07T04:02:32.904 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.779512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374309.log 2023-07-07T04:02:32.905 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.779512.log.gz 2023-07-07T04:02:32.905 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.211108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271675.log 2023-07-07T04:02:32.905 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211108.log.gz 2023-07-07T04:02:32.905 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.374309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691881.log 2023-07-07T04:02:32.905 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.374309.log.gz 2023-07-07T04:02:32.906 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.271675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396668.log 2023-07-07T04:02:32.906 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271675.log.gz 2023-07-07T04:02:32.906 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.691881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269697.log 2023-07-07T04:02:32.906 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691881.log.gz 2023-07-07T04:02:32.906 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.396668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476531.log 2023-07-07T04:02:32.907 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396668.log.gz 2023-07-07T04:02:32.907 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.269697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114070.log 2023-07-07T04:02:32.907 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269697.log.gz 2023-07-07T04:02:32.907 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.476531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165158.log 2023-07-07T04:02:32.907 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.476531.log.gz 2023-07-07T04:02:32.907 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109474.log 2023-07-07T04:02:32.908 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.165158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114945.log 2023-07-07T04:02:32.908 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165158.log.gz 2023-07-07T04:02:32.908 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260297.log 2023-07-07T04:02:32.908 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811662.log 2023-07-07T04:02:32.908 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.260297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.940322.log 2023-07-07T04:02:32.909 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260297.log.gz 2023-07-07T04:02:32.909 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.811662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349591.log 2023-07-07T04:02:32.909 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811662.log.gz 2023-07-07T04:02:32.909 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.940322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459202.log 2023-07-07T04:02:32.909 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.349591.log: gzip -5 --verbose 88.4%-- -- replaced with /var/log/ceph/ceph-client.admin.940322.log.gz/var/log/ceph/ceph-client.admin.318795.log 2023-07-07T04:02:32.909 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:32.910 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349591.log.gz 2023-07-07T04:02:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.459202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343589.log 2023-07-07T04:02:32.910 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.459202.log.gz 2023-07-07T04:02:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.318795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700695.log 2023-07-07T04:02:32.910 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318795.log.gz 2023-07-07T04:02:32.911 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 /var/log/ceph/ceph-client.admin.343589.log: --verbose -- /var/log/ceph/ceph-client.admin.814076.log 2023-07-07T04:02:32.911 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343589.log.gz 2023-07-07T04:02:32.911 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.700695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.799015.log 2023-07-07T04:02:32.911 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700695.log.gz 2023-07-07T04:02:32.911 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.814076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253398.log 2023-07-07T04:02:32.912 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.814076.log.gz 2023-07-07T04:02:32.912 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.799015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811188.log 2023-07-07T04:02:32.912 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.799015.log.gz 2023-07-07T04:02:32.912 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.253398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409132.log 2023-07-07T04:02:32.912 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253398.log.gz 2023-07-07T04:02:32.913 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369443.log 2023-07-07T04:02:32.913 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.811188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811188.log.gz 2023-07-07T04:02:32.913 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.409132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160800.log 2023-07-07T04:02:32.913 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409132.log.gz 2023-07-07T04:02:32.913 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.369443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686649.log 2023-07-07T04:02:32.913 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.369443.log.gz 2023-07-07T04:02:32.914 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275098.log 2023-07-07T04:02:32.914 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.160800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160800.log.gz 2023-07-07T04:02:32.914 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.686649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672981.log 2023-07-07T04:02:32.914 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686649.log.gz 2023-07-07T04:02:32.914 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.275098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193847.log 2023-07-07T04:02:32.915 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275098.log.gz 2023-07-07T04:02:32.915 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409458.log 2023-07-07T04:02:32.915 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.672981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672981.log.gz 2023-07-07T04:02:32.915 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.193847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.934764.log 2023-07-07T04:02:32.915 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193847.log.gz 2023-07-07T04:02:32.916 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.409458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692350.log 2023-07-07T04:02:32.916 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409458.log.gz 2023-07-07T04:02:32.916 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672580.log 2023-07-07T04:02:32.916 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.934764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.934764.log.gz 2023-07-07T04:02:32.916 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.692350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263558.log 2023-07-07T04:02:32.916 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692350.log.gz 2023-07-07T04:02:32.917 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.672580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277590.log 2023-07-07T04:02:32.917 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672580.log.gz 2023-07-07T04:02:32.917 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.799513.log 2023-07-07T04:02:32.917 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.263558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263558.log.gz 2023-07-07T04:02:32.917 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.277590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682176.log 2023-07-07T04:02:32.918 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277590.log.gz 2023-07-07T04:02:32.918 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.799513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656308.log 2023-07-07T04:02:32.918 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.799513.log.gz 2023-07-07T04:02:32.918 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.682176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479044.log 2023-07-07T04:02:32.918 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682176.log.gz 2023-07-07T04:02:32.919 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.656308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190071.log 2023-07-07T04:02:32.919 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656308.log.gz 2023-07-07T04:02:32.919 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.479044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623522.log 2023-07-07T04:02:32.919 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.479044.log.gz 2023-07-07T04:02:32.919 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313414.log 2023-07-07T04:02:32.919 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.190071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190071.log.gz 2023-07-07T04:02:32.920 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.623522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227221.log 2023-07-07T04:02:32.920 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623522.log.gz 2023-07-07T04:02:32.920 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704419.log 2023-07-07T04:02:32.920 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.313414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313414.log.gz 2023-07-07T04:02:32.920 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227221.log: /var/log/ceph/ceph-client.admin.653324.log 2023-07-07T04:02:32.921 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227221.log.gz 2023-07-07T04:02:32.921 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.704419.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109474.log.gz 2023-07-07T04:02:32.921 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704419.log.gz 2023-07-07T04:02:32.921 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636778.log 2023-07-07T04:02:32.921 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.653324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448259.log 2023-07-07T04:02:32.921 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.653324.log.gz 2023-07-07T04:02:32.922 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.636778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284164.log 2023-07-07T04:02:32.922 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636778.log.gz 2023-07-07T04:02:32.922 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114945.log.gz 2023-07-07T04:02:32.922 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.448259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396198.log 2023-07-07T04:02:32.922 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.448259.log.gz 2023-07-07T04:02:32.923 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.284164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300507.log 2023-07-07T04:02:32.923 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284164.log.gz 2023-07-07T04:02:32.923 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.396198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196886.log 2023-07-07T04:02:32.923 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396198.log.gz 2023-07-07T04:02:32.923 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.300507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.801210.log 2023-07-07T04:02:32.923 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300507.log.gz 2023-07-07T04:02:32.924 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.196886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687117.log 2023-07-07T04:02:32.924 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196886.log.gz 2023-07-07T04:02:32.924 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.801210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693339.log 2023-07-07T04:02:32.924 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.801210.log.gz 2023-07-07T04:02:32.924 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.687117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.942071.log 2023-07-07T04:02:32.925 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687117.log.gz 2023-07-07T04:02:32.925 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.693339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693339.log.gzgzip 2023-07-07T04:02:32.925 INFO:teuthology.orchestra.run.smithi006.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.803347.log 2023-07-07T04:02:32.925 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.942071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707390.log 2023-07-07T04:02:32.925 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.803347.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.942071.log.gz 2023-07-07T04:02:32.926 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370209.log 2023-07-07T04:02:32.926 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.803347.log.gz 2023-07-07T04:02:32.926 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.707390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315008.log 2023-07-07T04:02:32.926 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707390.log.gz 2023-07-07T04:02:32.926 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.370209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297672.log 2023-07-07T04:02:32.926 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.370209.log.gz 2023-07-07T04:02:32.927 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223742.log /var/log/ceph/ceph-client.admin.315008.log: 2023-07-07T04:02:32.927 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315008.log.gz 2023-07-07T04:02:32.927 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.297672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258266.log 2023-07-07T04:02:32.927 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.297672.log.gz 2023-07-07T04:02:32.927 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.223742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351948.log 2023-07-07T04:02:32.928 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223742.log.gz 2023-07-07T04:02:32.928 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.258266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176102.log 2023-07-07T04:02:32.928 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258266.log.gz 2023-07-07T04:02:32.928 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.351948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692443.log 2023-07-07T04:02:32.928 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351948.log.gz 2023-07-07T04:02:32.929 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.176102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.800267.log 2023-07-07T04:02:32.929 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176102.log.gz 2023-07-07T04:02:32.929 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.692443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709627.log 2023-07-07T04:02:32.929 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692443.log.gz 2023-07-07T04:02:32.929 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.800267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.679840.log 2023-07-07T04:02:32.929 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.800267.log.gz 2023-07-07T04:02:32.930 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.709627.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.709627.log.gz--verbose 2023-07-07T04:02:32.930 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.934750.log 2023-07-07T04:02:32.930 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.679840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170713.log 2023-07-07T04:02:32.930 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.679840.log.gz 2023-07-07T04:02:32.930 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.934750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331399.log 2023-07-07T04:02:32.931 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.934750.log.gz 2023-07-07T04:02:32.931 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.170713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686434.log 2023-07-07T04:02:32.931 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170713.log.gz 2023-07-07T04:02:32.931 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.331399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193636.log 2023-07-07T04:02:32.931 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331399.log.gz 2023-07-07T04:02:32.931 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.686434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.801814.log 2023-07-07T04:02:32.932 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686434.log.gz 2023-07-07T04:02:32.932 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.193636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689922.log 2023-07-07T04:02:32.932 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193636.log.gz 2023-07-07T04:02:32.932 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.801814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.801814.log.gz 2023-07-07T04:02:32.932 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198960.log 2023-07-07T04:02:32.933 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.689922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321844.log 2023-07-07T04:02:32.933 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689922.log.gz 2023-07-07T04:02:32.933 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.198960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246243.log 2023-07-07T04:02:32.933 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198960.log.gz 2023-07-07T04:02:32.933 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.321844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634470.log 2023-07-07T04:02:32.934 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321844.log.gz 2023-07-07T04:02:32.934 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291219.log 2023-07-07T04:02:32.934 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.246243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246243.log.gz 2023-07-07T04:02:32.934 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.634470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203584.log 2023-07-07T04:02:32.934 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634470.log.gz 2023-07-07T04:02:32.934 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245147.log 2023-07-07T04:02:32.935 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.291219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291219.log.gz 2023-07-07T04:02:32.935 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114070.log.gz 2023-07-07T04:02:32.935 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.203584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402907.log 2023-07-07T04:02:32.935 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.203584.log.gz 2023-07-07T04:02:32.935 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.245147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118961.log 2023-07-07T04:02:32.936 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245147.log.gz 2023-07-07T04:02:33.187 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.402907.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.390026.log 2023-07-07T04:02:33.187 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.402907.log.gz 2023-07-07T04:02:33.188 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406416.log 2023-07-07T04:02:33.188 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.390026.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-07T04:02:33.188 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.390026.log.gz 2023-07-07T04:02:33.188 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.406416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276571.log 2023-07-07T04:02:33.188 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406416.log.gz 2023-07-07T04:02:33.189 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641117.log 2023-07-07T04:02:33.189 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.276571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709849.log 2023-07-07T04:02:33.189 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276571.log.gz 2023-07-07T04:02:33.189 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.641117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161784.log 2023-07-07T04:02:33.189 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.641117.log.gz 2023-07-07T04:02:33.189 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.709849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376074.log 2023-07-07T04:02:33.190 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709849.log.gz 2023-07-07T04:02:33.190 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110226.log.gz 2023-07-07T04:02:33.190 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.161784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645723.log 2023-07-07T04:02:33.190 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161784.log.gz 2023-07-07T04:02:33.190 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.376074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.376074.log.gzgzip 2023-07-07T04:02:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.108036.log 2023-07-07T04:02:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.645723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335997.log 2023-07-07T04:02:33.191 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645723.log.gz 2023-07-07T04:02:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625654.log 2023-07-07T04:02:33.191 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.335997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932735.log 2023-07-07T04:02:33.192 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335997.log.gz 2023-07-07T04:02:33.192 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108036.log.gz 2023-07-07T04:02:33.192 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.625654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655848.log 0.0% 2023-07-07T04:02:33.192 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.625654.log.gz 2023-07-07T04:02:33.192 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.932735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.799296.log 2023-07-07T04:02:33.193 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.932735.log.gz 2023-07-07T04:02:33.193 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.655848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112501.log 2023-07-07T04:02:33.193 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655848.log.gz 2023-07-07T04:02:33.193 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.799296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.809958.log 2023-07-07T04:02:33.193 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.799296.log.gz 2023-07-07T04:02:33.193 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163474.log 2023-07-07T04:02:33.194 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.809958.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.809958.log.gz--verbose 2023-07-07T04:02:33.194 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.940532.log 2023-07-07T04:02:33.194 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.163474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225677.log 2023-07-07T04:02:33.194 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163474.log.gz 2023-07-07T04:02:33.194 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112501.log.gz 2023-07-07T04:02:33.195 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.940532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225419.log 2023-07-07T04:02:33.195 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.225677.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.940532.log.gz 2023-07-07T04:02:33.195 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.939527.log 2023-07-07T04:02:33.195 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225677.log.gz 2023-07-07T04:02:33.195 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.225419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304582.log 2023-07-07T04:02:33.195 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225419.log.gz 2023-07-07T04:02:33.196 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.939527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165539.log 2023-07-07T04:02:33.196 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.939527.log.gz 2023-07-07T04:02:33.196 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.304582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630596.log 2023-07-07T04:02:33.196 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304582.log.gz 2023-07-07T04:02:33.196 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.165539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.824218.log 2023-07-07T04:02:33.197 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165539.log.gz 2023-07-07T04:02:33.197 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.630596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.933786.log 2023-07-07T04:02:33.197 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630596.log.gz 2023-07-07T04:02:33.197 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.824218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446441.log 2023-07-07T04:02:33.197 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.824218.log.gz 2023-07-07T04:02:33.198 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.933786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296354.log 2023-07-07T04:02:33.198 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.933786.log.gz 2023-07-07T04:02:33.198 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.446441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446750.log 2023-07-07T04:02:33.198 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.446441.log.gz 2023-07-07T04:02:33.198 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.296354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.800699.log 2023-07-07T04:02:33.198 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.296354.log.gz 2023-07-07T04:02:33.199 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.446750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688143.log 2023-07-07T04:02:33.199 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.446750.log.gz 2023-07-07T04:02:33.199 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118961.log.gz 2023-07-07T04:02:33.199 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.800699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.802031.log 2023-07-07T04:02:33.199 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.800699.log.gz 2023-07-07T04:02:33.200 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.688143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253384.log 2023-07-07T04:02:33.200 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688143.log.gz 2023-07-07T04:02:33.200 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.802031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.763643.log 2023-07-07T04:02:33.200 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.802031.log.gz 2023-07-07T04:02:33.200 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.253384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246257.log 2023-07-07T04:02:33.201 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253384.log.gz 2023-07-07T04:02:33.201 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.763643.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.763643.log.gz/var/log/ceph/ceph-client.admin.643475.log 2023-07-07T04:02:33.201 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:33.201 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.246257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424543.log 2023-07-07T04:02:33.201 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246257.log.gz 2023-07-07T04:02:33.201 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.643475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.679240.log 2023-07-07T04:02:33.202 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.643475.log.gz 2023-07-07T04:02:33.202 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.424543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329734.log 2023-07-07T04:02:33.202 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.424543.log.gz 2023-07-07T04:02:33.202 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.679240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381978.log 2023-07-07T04:02:33.202 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.679240.log.gz 2023-07-07T04:02:33.203 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.329734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116480.log 2023-07-07T04:02:33.203 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329734.log.gz 2023-07-07T04:02:33.203 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.381978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646021.log 2023-07-07T04:02:33.203 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381978.log.gz 2023-07-07T04:02:33.203 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226004.log 2023-07-07T04:02:33.203 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.646021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108362.log 2023-07-07T04:02:33.204 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646021.log.gz 2023-07-07T04:02:33.204 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.226004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343510.log 2023-07-07T04:02:33.204 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226004.log.gz 2023-07-07T04:02:33.204 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397807.log 2023-07-07T04:02:33.204 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.343510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641596.log 2023-07-07T04:02:33.205 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343510.log.gz 2023-07-07T04:02:33.205 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.397807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621618.log 2023-07-07T04:02:33.205 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.397807.log.gz 2023-07-07T04:02:33.205 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.641596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295285.log 2023-07-07T04:02:33.205 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.641596.log.gz 2023-07-07T04:02:33.206 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.621618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108178.log 2023-07-07T04:02:33.206 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621618.log.gz 2023-07-07T04:02:33.206 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.295285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.810621.log 2023-07-07T04:02:33.206 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.295285.log.gz 2023-07-07T04:02:33.206 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619135.log 2023-07-07T04:02:33.207 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.810621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337498.log 2023-07-07T04:02:33.207 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.810621.log.gz 2023-07-07T04:02:33.207 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.619135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396955.log 2023-07-07T04:02:33.207 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619135.log.gz 2023-07-07T04:02:33.207 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.337498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621071.log 2023-07-07T04:02:33.207 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337498.log.gz 2023-07-07T04:02:33.208 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.396955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111811.log 2023-07-07T04:02:33.208 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396955.log.gz 2023-07-07T04:02:33.208 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.621071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638163.log 2023-07-07T04:02:33.208 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621071.log.gz 2023-07-07T04:02:33.208 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300738.log 2023-07-07T04:02:33.209 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.638163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294500.log 2023-07-07T04:02:33.209 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638163.log.gz 2023-07-07T04:02:33.209 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.300738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.670331.log 2023-07-07T04:02:33.209 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300738.log.gz 2023-07-07T04:02:33.209 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.294500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365430.log 2023-07-07T04:02:33.210 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294500.log.gz 2023-07-07T04:02:33.210 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.670331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334139.log 2023-07-07T04:02:33.210 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.670331.log.gz 2023-07-07T04:02:33.210 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.365430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421883.log 2023-07-07T04:02:33.210 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365430.log.gz 2023-07-07T04:02:33.210 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.334139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699342.log 2023-07-07T04:02:33.211 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334139.log.gz 2023-07-07T04:02:33.211 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.421883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644497.log 2023-07-07T04:02:33.211 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.421883.log.gz 2023-07-07T04:02:33.211 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.699342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322075.log 2023-07-07T04:02:33.211 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699342.log.gz 2023-07-07T04:02:33.212 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.644497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252349.log 2023-07-07T04:02:33.212 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644497.log.gz 2023-07-07T04:02:33.212 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.322075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.759232.log 2023-07-07T04:02:33.212 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322075.log.gz 2023-07-07T04:02:33.212 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.252349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325804.log 2023-07-07T04:02:33.213 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252349.log.gz 2023-07-07T04:02:33.213 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.759232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628010.log 2023-07-07T04:02:33.213 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.759232.log.gz 2023-07-07T04:02:33.213 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.325804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327253.log 2023-07-07T04:02:33.213 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325804.log.gz 2023-07-07T04:02:33.213 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.628010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115175.log 2023-07-07T04:02:33.214 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628010.log.gz 2023-07-07T04:02:33.214 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.327253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.929804.log 2023-07-07T04:02:33.214 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327253.log.gz 2023-07-07T04:02:33.214 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.642998.log 2023-07-07T04:02:33.214 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.929804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.776271.log 2023-07-07T04:02:33.215 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.929804.log.gz 2023-07-07T04:02:33.215 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.642998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418630.log 2023-07-07T04:02:33.215 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.642998.log.gz 2023-07-07T04:02:33.215 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.776271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.705369.log 2023-07-07T04:02:33.215 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.776271.log.gz 2023-07-07T04:02:33.215 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.418630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260392.log 2023-07-07T04:02:33.216 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.418630.log.gz 2023-07-07T04:02:33.216 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.705369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477545.log 2023-07-07T04:02:33.216 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.705369.log.gz 2023-07-07T04:02:33.216 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459417.log 2023-07-07T04:02:33.216 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.260392.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260392.log.gz 2023-07-07T04:02:33.217 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682255.log 2023-07-07T04:02:33.217 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.477545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.477545.log.gz 2023-07-07T04:02:33.217 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.459417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.459417.log.gz 2023-07-07T04:02:33.217 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302228.log 2023-07-07T04:02:33.217 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386466.log 2023-07-07T04:02:33.218 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.682255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682255.log.gz 2023-07-07T04:02:33.218 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.802542.log 2023-07-07T04:02:33.218 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.302228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302228.log.gz 2023-07-07T04:02:33.218 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.386466.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.386466.log.gz--verbose 2023-07-07T04:02:33.218 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.217689.log 2023-07-07T04:02:33.218 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298890.log 2023-07-07T04:02:33.219 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.802542.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.802542.log.gz 2023-07-07T04:02:33.219 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.217689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493334.log 2023-07-07T04:02:33.219 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217689.log.gz 2023-07-07T04:02:33.219 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.298890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411881.log 2023-07-07T04:02:33.219 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298890.log.gz 2023-07-07T04:02:33.220 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.493334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.493334.log.gz 2023-07-07T04:02:33.220 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295192.log 2023-07-07T04:02:33.220 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.411881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.763550.log 2023-07-07T04:02:33.220 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411881.log.gz 2023-07-07T04:02:33.220 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.295192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376088.log 2023-07-07T04:02:33.220 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.295192.log.gz 2023-07-07T04:02:33.221 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.763550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.938116.log 2023-07-07T04:02:33.221 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.763550.log.gz 2023-07-07T04:02:33.221 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.376088.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.245700.log 2023-07-07T04:02:33.221 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.376088.log.gz 2023-07-07T04:02:33.221 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.804276.log 2023-07-07T04:02:33.222 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.938116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.938116.log.gz 2023-07-07T04:02:33.222 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.245700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196793.log 2023-07-07T04:02:33.222 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245700.log.gz 2023-07-07T04:02:33.222 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.804276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276001.log 2023-07-07T04:02:33.222 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.804276.log.gz 2023-07-07T04:02:33.223 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.196793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371964.log 2023-07-07T04:02:33.223 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196793.log.gz 2023-07-07T04:02:33.223 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.276001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656229.log 2023-07-07T04:02:33.223 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276001.log.gz 2023-07-07T04:02:33.223 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.371964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.371964.log.gz 2023-07-07T04:02:33.223 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283667.log 2023-07-07T04:02:33.224 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.656229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629832.log 2023-07-07T04:02:33.224 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656229.log.gz 2023-07-07T04:02:33.224 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.283667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277084.log 2023-07-07T04:02:33.224 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283667.log.gz 2023-07-07T04:02:33.224 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.629832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244203.log 2023-07-07T04:02:33.225 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629832.log.gz 2023-07-07T04:02:33.225 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.277084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339093.log 2023-07-07T04:02:33.225 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277084.log.gz 2023-07-07T04:02:33.225 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.244203.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244203.log.gz 2023-07-07T04:02:33.225 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404436.log 2023-07-07T04:02:33.226 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.339093.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.116480.log.gz 2023-07-07T04:02:33.226 INFO:teuthology.orchestra.run.smithi006.stderr:gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.339093.log.gz--verbose 2023-07-07T04:02:33.226 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.315380.log 2023-07-07T04:02:33.226 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.404436.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.392796.log 2023-07-07T04:02:33.226 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.404436.log.gz 2023-07-07T04:02:33.226 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108362.log.gz 2023-07-07T04:02:33.227 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.315380.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.108178.log.gz 2023-07-07T04:02:33.227 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384948.log 2023-07-07T04:02:33.227 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315380.log.gz 2023-07-07T04:02:33.227 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.111811.log.gz 2023-07-07T04:02:33.227 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.392796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446171.log 2023-07-07T04:02:33.228 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115175.log.gz 2023-07-07T04:02:33.228 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392796.log.gz 2023-07-07T04:02:33.228 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.384948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174650.log 2023-07-07T04:02:33.228 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384948.log.gz 2023-07-07T04:02:33.228 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.446171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.446171.log.gz 2023-07-07T04:02:33.229 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118777.log 2023-07-07T04:02:33.229 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.174650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109769.log 2023-07-07T04:02:33.229 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174650.log.gz 2023-07-07T04:02:33.229 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.780414.log 2023-07-07T04:02:33.229 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807435.log 2023-07-07T04:02:33.230 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.780414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.825656.log 2023-07-07T04:02:33.230 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.780414.log.gz 2023-07-07T04:02:33.230 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.807435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.622304.log 2023-07-07T04:02:33.230 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807435.log.gz 2023-07-07T04:02:33.230 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.825656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407587.log 2023-07-07T04:02:33.230 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.825656.log.gz 2023-07-07T04:02:33.231 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.622304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328448.log 2023-07-07T04:02:33.231 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622304.log.gz 2023-07-07T04:02:33.231 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.407587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418341.log 2023-07-07T04:02:33.231 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407587.log.gz 2023-07-07T04:02:33.231 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.328448.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.304675.log 2023-07-07T04:02:33.232 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.328448.log.gz 2023-07-07T04:02:33.232 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.418341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116892.log 2023-07-07T04:02:33.232 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.418341.log.gz 2023-07-07T04:02:33.232 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.304675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304675.log.gzgzip 2023-07-07T04:02:33.232 INFO:teuthology.orchestra.run.smithi006.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.809743.log 2023-07-07T04:02:33.233 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175256.log 2023-07-07T04:02:33.233 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.809743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.113191.log 2023-07-07T04:02:33.233 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.809743.log.gz 2023-07-07T04:02:33.233 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.175256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292967.log 2023-07-07T04:02:33.233 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175256.log.gz 2023-07-07T04:02:33.233 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.113191.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.113191.log.gz 2023-07-07T04:02:33.234 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657568.log 2023-07-07T04:02:33.234 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-07T04:02:33.234 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.292967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288640.log 2023-07-07T04:02:33.234 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292967.log.gz 2023-07-07T04:02:33.234 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.657568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425642.log 2023-07-07T04:02:33.235 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.657568.log.gz 2023-07-07T04:02:33.235 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.288640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193449.log 2023-07-07T04:02:33.235 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288640.log.gz 2023-07-07T04:02:33.235 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.425642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630309.log 2023-07-07T04:02:33.235 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.425642.log.gz 2023-07-07T04:02:33.235 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.193449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366045.log 2023-07-07T04:02:33.236 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193449.log.gz 2023-07-07T04:02:33.236 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.630309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356986.log 2023-07-07T04:02:33.236 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630309.log.gz 2023-07-07T04:02:33.236 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.366045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285922.log 2023-07-07T04:02:33.236 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366045.log.gz 2023-07-07T04:02:33.237 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.356986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687585.log 2023-07-07T04:02:33.237 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356986.log.gz 2023-07-07T04:02:33.237 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.285922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.758234.log 2023-07-07T04:02:33.237 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285922.log.gz 2023-07-07T04:02:33.237 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.687585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637647.log 2023-07-07T04:02:33.238 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687585.log.gz 2023-07-07T04:02:33.238 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.758234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427297.log 2023-07-07T04:02:33.238 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.758234.log.gz 2023-07-07T04:02:33.238 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.637647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688614.log 2023-07-07T04:02:33.238 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637647.log.gz 2023-07-07T04:02:33.238 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.427297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.701446.log 2023-07-07T04:02:33.239 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.427297.log.gz 2023-07-07T04:02:33.239 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.688614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114162.log 2023-07-07T04:02:33.239 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688614.log.gz 2023-07-07T04:02:33.239 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.701446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419422.log 2023-07-07T04:02:33.239 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701446.log.gz 2023-07-07T04:02:33.240 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198763.log 2023-07-07T04:02:33.240 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.419422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263465.log 2023-07-07T04:02:33.240 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.419422.log.gz 2023-07-07T04:02:33.240 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.198763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318200.log 2023-07-07T04:02:33.240 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198763.log.gz 2023-07-07T04:02:33.241 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.263465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.765145.log 2023-07-07T04:02:33.241 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263465.log.gz 2023-07-07T04:02:33.241 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.318200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.819290.log 2023-07-07T04:02:33.241 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318200.log.gz 2023-07-07T04:02:33.241 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.765145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773275.log 2023-07-07T04:02:33.242 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.765145.log.gz 2023-07-07T04:02:33.242 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.819290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309123.log 2023-07-07T04:02:33.242 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.819290.log.gz 2023-07-07T04:02:33.242 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.773275.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.773275.log.gz/var/log/ceph/ceph-client.admin.164195.log 2023-07-07T04:02:33.242 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:33.242 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.309123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680851.log 2023-07-07T04:02:33.243 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309123.log.gz 2023-07-07T04:02:33.243 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.164195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.774680.log 2023-07-07T04:02:33.243 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164195.log.gz 2023-07-07T04:02:33.243 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.680851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680851.log.gz 2023-07-07T04:02:33.243 INFO:teuthology.orchestra.run.smithi006.stderr:gzip 87.8%-5 --verbose -- /var/log/ceph/ceph-client.admin.699846.log -- replaced with /var/log/ceph/ceph-client.admin.118777.log.gz 2023-07-07T04:02:33.244 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:33.244 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109769.log.gz 2023-07-07T04:02:33.244 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.774680.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.116892.log.gz 2023-07-07T04:02:33.244 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172995.log 2023-07-07T04:02:33.244 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.774680.log.gz 2023-07-07T04:02:33.245 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114162.log.gz 2023-07-07T04:02:33.245 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.699846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247112.log 2023-07-07T04:02:33.245 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699846.log.gz 2023-07-07T04:02:33.245 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.172995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115691.log 2023-07-07T04:02:33.245 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172995.log.gz 2023-07-07T04:02:33.245 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.247112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689081.log 2023-07-07T04:02:33.246 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247112.log.gz 2023-07-07T04:02:33.246 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297455.log 2023-07-07T04:02:33.246 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.689081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208470.log 2023-07-07T04:02:33.246 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689081.log.gz 2023-07-07T04:02:33.246 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.297455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161260.log 2023-07-07T04:02:33.247 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.297455.log.gz 2023-07-07T04:02:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.208470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296650.log 2023-07-07T04:02:33.247 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208470.log.gz 2023-07-07T04:02:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.161260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279430.log 2023-07-07T04:02:33.247 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161260.log.gz 2023-07-07T04:02:33.247 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.296650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277005.log 2023-07-07T04:02:33.248 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.296650.log.gz 2023-07-07T04:02:33.248 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.279430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389002.log 2023-07-07T04:02:33.248 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279430.log.gz 2023-07-07T04:02:33.248 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.277005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412822.log 2023-07-07T04:02:33.248 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277005.log.gz 2023-07-07T04:02:33.249 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.389002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683874.log 2023-07-07T04:02:33.249 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.389002.log.gz 2023-07-07T04:02:33.249 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.412822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478435.log 2023-07-07T04:02:33.249 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412822.log.gz 2023-07-07T04:02:33.249 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.683874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384358.log 2023-07-07T04:02:33.250 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683874.log.gz 2023-07-07T04:02:33.250 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.478435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.763860.log 2023-07-07T04:02:33.250 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.478435.log.gz 2023-07-07T04:02:33.250 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.384358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177655.log 2023-07-07T04:02:33.250 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384358.log.gz 2023-07-07T04:02:33.250 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.763860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384437.log 2023-07-07T04:02:33.251 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.763860.log.gz 2023-07-07T04:02:33.251 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.177655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644418.log 2023-07-07T04:02:33.251 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177655.log.gz 2023-07-07T04:02:33.251 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.384437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406402.log 2023-07-07T04:02:33.251 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384437.log.gz 2023-07-07T04:02:33.252 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.644418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644418.log.gz 2023-07-07T04:02:33.252 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400993.log 2023-07-07T04:02:33.252 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.406402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.822397.log 2023-07-07T04:02:33.252 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406402.log.gz 2023-07-07T04:02:33.252 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.400993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408450.log 2023-07-07T04:02:33.253 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.400993.log.gz 2023-07-07T04:02:33.253 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.822397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200526.log 2023-07-07T04:02:33.253 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.822397.log.gz 2023-07-07T04:02:33.253 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.408450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.810716.log 2023-07-07T04:02:33.253 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408450.log.gz 2023-07-07T04:02:33.253 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.200526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.823364.log 2023-07-07T04:02:33.254 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200526.log.gz 2023-07-07T04:02:33.254 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.810716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177172.log 2023-07-07T04:02:33.254 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.810716.log.gz 2023-07-07T04:02:33.254 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.823364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.823364.log.gz 2023-07-07T04:02:33.254 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479244.log 2023-07-07T04:02:33.255 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.177172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116009.log 2023-07-07T04:02:33.255 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177172.log.gz 2023-07-07T04:02:33.255 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.479244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702908.log 2023-07-07T04:02:33.255 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.479244.log.gz 2023-07-07T04:02:33.255 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449968.log 2023-07-07T04:02:33.255 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.702908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416399.log 2023-07-07T04:02:33.256 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702908.log.gz 2023-07-07T04:02:33.256 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.449968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267222.log 2023-07-07T04:02:33.256 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.449968.log.gz 2023-07-07T04:02:33.256 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.416399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772558.log 2023-07-07T04:02:33.256 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.416399.log.gz 2023-07-07T04:02:33.257 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.267222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703105.log 2023-07-07T04:02:33.257 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267222.log.gz 2023-07-07T04:02:33.257 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.772558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695094.log 2023-07-07T04:02:33.257 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.772558.log.gz 2023-07-07T04:02:33.257 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.703105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196581.log 2023-07-07T04:02:33.258 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703105.log.gz 2023-07-07T04:02:33.258 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.695094.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.345308.log 2023-07-07T04:02:33.258 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.695094.log.gz 2023-07-07T04:02:33.258 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.196581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364155.log 2023-07-07T04:02:33.258 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196581.log.gz 2023-07-07T04:02:33.259 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.345308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708157.log 2023-07-07T04:02:33.259 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345308.log.gz 2023-07-07T04:02:33.259 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.364155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344336.log 2023-07-07T04:02:33.259 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.364155.log.gz 2023-07-07T04:02:33.259 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.708157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700681.log 2023-07-07T04:02:33.259 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708157.log.gz 2023-07-07T04:02:33.260 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350639.log 2023-07-07T04:02:33.260 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.344336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344336.log.gz 2023-07-07T04:02:33.260 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.700681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.780724.log 2023-07-07T04:02:33.260 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700681.log.gz 2023-07-07T04:02:33.260 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.350639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932828.log 2023-07-07T04:02:33.261 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350639.log.gz 2023-07-07T04:02:33.261 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.780724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.775690.log 2023-07-07T04:02:33.261 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.780724.log.gz 2023-07-07T04:02:33.261 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.932828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655063.log 2023-07-07T04:02:33.261 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.932828.log.gz 2023-07-07T04:02:33.261 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.775690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370503.log 2023-07-07T04:02:33.262 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.775690.log.gz 2023-07-07T04:02:33.262 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.655063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654279.log 2023-07-07T04:02:33.262 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655063.log.gz 2023-07-07T04:02:33.262 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.370503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251383.log 2023-07-07T04:02:33.262 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.370503.log.gz 2023-07-07T04:02:33.263 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.654279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244296.log 2023-07-07T04:02:33.263 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654279.log.gz 2023-07-07T04:02:33.263 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.251383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338014.log 2023-07-07T04:02:33.263 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251383.log.gz 2023-07-07T04:02:33.263 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.244296.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.244296.log.gz/var/log/ceph/xfstests-dev-results/results/check.log 2023-07-07T04:02:33.264 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:33.264 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.338014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291436.log 2023-07-07T04:02:33.264 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338014.log.gz 2023-07-07T04:02:33.264 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/xfstests-dev-results/results/check.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218693.log 2023-07-07T04:02:33.264 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.291436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291436.log.gz 2023-07-07T04:02:33.264 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375562.log 2023-07-07T04:02:33.265 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.218693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249052.log 2023-07-07T04:02:33.265 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218693.log.gz 2023-07-07T04:02:33.265 INFO:teuthology.orchestra.run.smithi006.stderr: 89.6% -- replaced with /var/log/ceph/xfstests-dev-results/results/check.log.gz 2023-07-07T04:02:33.265 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.375562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254838.log 2023-07-07T04:02:33.265 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.375562.log.gz 2023-07-07T04:02:33.266 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.249052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424069.log 2023-07-07T04:02:33.266 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249052.log.gz 2023-07-07T04:02:33.266 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.254838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340055.log 2023-07-07T04:02:33.266 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254838.log.gz 2023-07-07T04:02:33.266 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.424069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243733.log 2023-07-07T04:02:33.266 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.424069.log.gz 2023-07-07T04:02:33.267 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.340055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301717.log 2023-07-07T04:02:33.267 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340055.log.gz 2023-07-07T04:02:33.267 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.243733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248959.log 2023-07-07T04:02:33.267 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243733.log.gz 2023-07-07T04:02:33.267 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.301717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619506.log 2023-07-07T04:02:33.268 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301717.log.gz 2023-07-07T04:02:33.268 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.248959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335904.log 2023-07-07T04:02:33.268 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248959.log.gz 2023-07-07T04:02:33.268 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.619506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245621.log 2023-07-07T04:02:33.268 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619506.log.gz 2023-07-07T04:02:33.269 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.335904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111098.log 2023-07-07T04:02:33.269 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335904.log.gz 2023-07-07T04:02:33.269 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.245621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.812666.log 2023-07-07T04:02:33.269 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245621.log.gz 2023-07-07T04:02:33.269 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350408.log 2023-07-07T04:02:33.269 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.812666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680373.log 2023-07-07T04:02:33.270 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.812666.log.gz 2023-07-07T04:02:33.270 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.350408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273148.log 2023-07-07T04:02:33.270 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350408.log.gz 2023-07-07T04:02:33.270 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.680373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689067.log 2023-07-07T04:02:33.270 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680373.log.gz 2023-07-07T04:02:33.271 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.273148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262570.log 2023-07-07T04:02:33.271 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273148.log.gz 2023-07-07T04:02:33.271 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.689067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364711.log 2023-07-07T04:02:33.271 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689067.log.gz 2023-07-07T04:02:33.271 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.262570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199527.log 2023-07-07T04:02:33.271 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262570.log.gz 2023-07-07T04:02:33.272 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.364711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424622.log 2023-07-07T04:02:33.272 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.364711.log.gz 2023-07-07T04:02:33.272 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.199527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.823743.log 2023-07-07T04:02:33.272 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199527.log.gz 2023-07-07T04:02:33.272 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.424622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367807.log 2023-07-07T04:02:33.273 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.424622.log.gz 2023-07-07T04:02:33.273 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.823743.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.823743.log.gz/var/log/ceph/ceph-client.admin.367260.log 2023-07-07T04:02:33.273 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:33.273 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.367807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673936.log 2023-07-07T04:02:33.273 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.367807.log.gz 2023-07-07T04:02:33.274 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.367260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.817841.log 2023-07-07T04:02:33.274 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.367260.log.gz 2023-07-07T04:02:33.274 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.673936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305570.log 2023-07-07T04:02:33.274 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673936.log.gz 2023-07-07T04:02:33.274 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.817841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109907.log 2023-07-07T04:02:33.275 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.817841.log.gz 2023-07-07T04:02:33.275 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.305570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275589.log 2023-07-07T04:02:33.275 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305570.log.gz 2023-07-07T04:02:33.275 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.777176.log 2023-07-07T04:02:33.275 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.275589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342994.log 2023-07-07T04:02:33.276 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275589.log.gz 2023-07-07T04:02:33.276 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.777176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644929.log 2023-07-07T04:02:33.276 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.777176.log.gz 2023-07-07T04:02:33.276 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.342994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159401.log 2023-07-07T04:02:33.276 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342994.log.gz 2023-07-07T04:02:33.276 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.644929.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.644929.log.gz-- 2023-07-07T04:02:33.277 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.212930.log 2023-07-07T04:02:33.277 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.159401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429266.log 2023-07-07T04:02:33.277 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159401.log.gz 2023-07-07T04:02:33.277 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.212930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345697.log 2023-07-07T04:02:33.277 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212930.log.gz 2023-07-07T04:02:33.278 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.429266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403000.log 2023-07-07T04:02:33.278 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.429266.log.gz 2023-07-07T04:02:33.278 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.345697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654065.log 2023-07-07T04:02:33.278 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345697.log.gz 2023-07-07T04:02:33.278 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.403000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107457.log 2023-07-07T04:02:33.279 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.403000.log.gz 2023-07-07T04:02:33.279 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.654065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333425.log 2023-07-07T04:02:33.279 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654065.log.gz 2023-07-07T04:02:33.279 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204557.log 2023-07-07T04:02:33.279 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.333425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299401.log 2023-07-07T04:02:33.279 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333425.log.gz 2023-07-07T04:02:33.280 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.204557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164568.log 2023-07-07T04:02:33.280 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204557.log.gz 2023-07-07T04:02:33.280 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.299401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.940230.log 2023-07-07T04:02:33.280 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299401.log.gz 2023-07-07T04:02:33.280 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.164568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263745.log 2023-07-07T04:02:33.281 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164568.log.gz 2023-07-07T04:02:33.281 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.940230.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-07-07T04:02:33.281 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.940230.log.gz 2023-07-07T04:02:33.281 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.263745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621150.log 2023-07-07T04:02:33.281 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263745.log.gz 2023-07-07T04:02:33.281 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107934.log 2023-07-07T04:02:33.282 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.621150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112179.log 2023-07-07T04:02:33.282 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621150.log.gz 2023-07-07T04:02:33.282 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638242.log 2023-07-07T04:02:33.282 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.801303.log 2023-07-07T04:02:33.282 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.638242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637957.log 2023-07-07T04:02:33.283 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638242.log.gz 2023-07-07T04:02:33.283 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.801303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356573.log 2023-07-07T04:02:33.283 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.801303.log.gz 2023-07-07T04:02:33.283 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.637957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191030.log 2023-07-07T04:02:33.283 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637957.log.gz 2023-07-07T04:02:33.284 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.356573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224836.log 2023-07-07T04:02:33.284 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356573.log.gz 2023-07-07T04:02:33.284 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.191030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694125.log 2023-07-07T04:02:33.284 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191030.log.gz 2023-07-07T04:02:33.284 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.224836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177186.log 2023-07-07T04:02:33.284 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224836.log.gz 2023-07-07T04:02:33.285 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.694125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341261.log 2023-07-07T04:02:33.285 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694125.log.gz 2023-07-07T04:02:33.285 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.177186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379384.log 2023-07-07T04:02:33.285 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177186.log.gz 2023-07-07T04:02:33.285 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.341261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.669287.log 2023-07-07T04:02:33.286 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341261.log.gz 2023-07-07T04:02:33.286 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.379384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.379384.log.gz 2023-07-07T04:02:33.286 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388585.log 2023-07-07T04:02:33.286 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.669287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.669287.log.gz 2023-07-07T04:02:33.286 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116250.log 2023-07-07T04:02:33.287 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.388585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394215.log 2023-07-07T04:02:33.287 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.388585.log.gz 2023-07-07T04:02:33.287 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.711245.log 2023-07-07T04:02:33.287 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.394215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691480.log 2023-07-07T04:02:33.287 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394215.log.gz 2023-07-07T04:02:33.287 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.711245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641038.log 2023-07-07T04:02:33.288 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.711245.log.gz 2023-07-07T04:02:33.288 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.691480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341247.log 2023-07-07T04:02:33.288 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691480.log.gz 2023-07-07T04:02:33.288 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.641038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.930377.log 2023-07-07T04:02:33.288 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.641038.log.gz 2023-07-07T04:02:33.289 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.341247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202196.log 2023-07-07T04:02:33.289 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341247.log.gz 2023-07-07T04:02:33.289 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.930377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.670532.log 2023-07-07T04:02:33.289 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.930377.log.gz 2023-07-07T04:02:33.289 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.202196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420922.log 2023-07-07T04:02:33.289 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202196.log.gz 2023-07-07T04:02:33.290 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.670532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374603.log 2023-07-07T04:02:33.290 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.670532.log.gz 2023-07-07T04:02:33.290 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.420922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632729.log 2023-07-07T04:02:33.290 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.420922.log.gz 2023-07-07T04:02:33.290 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.374603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392342.log 2023-07-07T04:02:33.291 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.374603.log.gz 2023-07-07T04:02:33.291 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.632729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365222.log 2023-07-07T04:02:33.291 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632729.log.gz 2023-07-07T04:02:33.291 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.392342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695295.log 2023-07-07T04:02:33.291 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392342.log.gz 2023-07-07T04:02:33.292 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.365222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321347.log 2023-07-07T04:02:33.292 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365222.log.gz 2023-07-07T04:02:33.292 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.695295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811648.log 2023-07-07T04:02:33.292 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695295.log.gz 2023-07-07T04:02:33.292 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.321347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245226.log 2023-07-07T04:02:33.292 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321347.log.gz 2023-07-07T04:02:33.293 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.811648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.808699.log 2023-07-07T04:02:33.293 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811648.log.gz 2023-07-07T04:02:33.293 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.245226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156738.log 2023-07-07T04:02:33.293 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245226.log.gz 2023-07-07T04:02:33.293 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.808699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253889.log 2023-07-07T04:02:33.294 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.808699.log.gz 2023-07-07T04:02:33.294 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.156738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246638.log 2023-07-07T04:02:33.294 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156738.log.gz 2023-07-07T04:02:33.294 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.253889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660313.log 2023-07-07T04:02:33.294 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253889.log.gz 2023-07-07T04:02:33.295 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.246638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275112.log 2023-07-07T04:02:33.295 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246638.log.gz 2023-07-07T04:02:33.295 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.660313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639907.log 2023-07-07T04:02:33.295 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.660313.log.gz 2023-07-07T04:02:33.295 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.275112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345294.log 2023-07-07T04:02:33.295 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275112.log.gz 2023-07-07T04:02:33.296 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.639907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309634.log 2023-07-07T04:02:33.296 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639907.log.gz 2023-07-07T04:02:33.296 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.345294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190557.log 2023-07-07T04:02:33.296 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345294.log.gz 2023-07-07T04:02:33.296 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.309634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694710.log 2023-07-07T04:02:33.297 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309634.log.gz 2023-07-07T04:02:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.190557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119007.log 2023-07-07T04:02:33.297 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190557.log.gz 2023-07-07T04:02:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.694710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.812042.log 2023-07-07T04:02:33.297 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694710.log.gz 2023-07-07T04:02:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.119007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272152.log 2023-07-07T04:02:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.812042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378458.log 2023-07-07T04:02:33.298 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.812042.log.gz 2023-07-07T04:02:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.272152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.802017.log 2023-07-07T04:02:33.298 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272152.log.gz 2023-07-07T04:02:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.378458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293492.log 2023-07-07T04:02:33.299 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.378458.log.gz 2023-07-07T04:02:33.299 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.802017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.802017.log.gz 2023-07-07T04:02:33.299 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370936.log 2023-07-07T04:02:33.299 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.293492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.824297.log 2023-07-07T04:02:33.299 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293492.log.gz 2023-07-07T04:02:33.300 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.370936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385165.log 2023-07-07T04:02:33.300 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.370936.log.gz 2023-07-07T04:02:33.300 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.824297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166516.log 2023-07-07T04:02:33.300 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.824297.log.gz 2023-07-07T04:02:33.300 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.385165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638256.log 2023-07-07T04:02:33.300 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385165.log.gz 2023-07-07T04:02:33.301 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.166516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296139.log 2023-07-07T04:02:33.301 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166516.log.gz 2023-07-07T04:02:33.301 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.638256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298472.log 2023-07-07T04:02:33.301 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638256.log.gz 2023-07-07T04:02:33.301 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.296139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310113.log 2023-07-07T04:02:33.302 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.296139.log.gz 2023-07-07T04:02:33.302 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.298472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427779.log 2023-07-07T04:02:33.302 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298472.log.gz 2023-07-07T04:02:33.302 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.310113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692933.log 2023-07-07T04:02:33.302 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310113.log.gz 2023-07-07T04:02:33.303 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.427779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404651.log 2023-07-07T04:02:33.303 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.427779.log.gz 2023-07-07T04:02:33.303 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.692933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.760467.log 2023-07-07T04:02:33.303 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692933.log.gz 2023-07-07T04:02:33.303 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.404651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.801721.log 2023-07-07T04:02:33.303 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.404651.log.gz 2023-07-07T04:02:33.304 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.760467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258301.log 2023-07-07T04:02:33.304 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.760467.log.gz 2023-07-07T04:02:33.304 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.801721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392328.log 2023-07-07T04:02:33.304 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.801721.log.gz 2023-07-07T04:02:33.304 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.258301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373287.log 2023-07-07T04:02:33.305 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258301.log.gz 2023-07-07T04:02:33.305 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.392328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348024.log 2023-07-07T04:02:33.305 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392328.log.gz 2023-07-07T04:02:33.305 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.373287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379779.log 2023-07-07T04:02:33.305 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.373287.log.gz 2023-07-07T04:02:33.305 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.348024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.670317.log 2023-07-07T04:02:33.306 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348024.log.gz 2023-07-07T04:02:33.306 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.379779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.812135.log 2023-07-07T04:02:33.306 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.379779.log.gz 2023-07-07T04:02:33.306 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.670317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623615.log 2023-07-07T04:02:33.306 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.670317.log.gz 2023-07-07T04:02:33.307 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.812135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659466.log 2023-07-07T04:02:33.307 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.812135.log.gz 2023-07-07T04:02:33.307 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.623615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.669581.log 2023-07-07T04:02:33.307 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623615.log.gz 2023-07-07T04:02:33.307 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.659466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.653518.log 2023-07-07T04:02:33.308 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659466.log.gz 2023-07-07T04:02:33.308 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.669581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311111.log 2023-07-07T04:02:33.308 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.669581.log.gz 2023-07-07T04:02:33.308 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.653518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245240.log 2023-07-07T04:02:33.308 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.653518.log.gz 2023-07-07T04:02:33.309 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.311111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624086.log 2023-07-07T04:02:33.309 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311111.log.gz 2023-07-07T04:02:33.309 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.245240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205985.log 2023-07-07T04:02:33.309 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245240.log.gz 2023-07-07T04:02:33.309 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.624086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647487.log 2023-07-07T04:02:33.309 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624086.log.gz 2023-07-07T04:02:33.310 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.205985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255333.log 2023-07-07T04:02:33.310 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205985.log.gz 2023-07-07T04:02:33.310 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.647487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365129.log 2023-07-07T04:02:33.310 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.647487.log.gz 2023-07-07T04:02:33.310 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.255333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328742.log 2023-07-07T04:02:33.311 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255333.log.gz 2023-07-07T04:02:33.311 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115691.log.gz 2023-07-07T04:02:33.311 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.365129.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116009.log.gz 2023-07-07T04:02:33.311 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365129.log.gz 2023-07-07T04:02:33.311 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.822881.log 2023-07-07T04:02:33.311 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111098.log.gz 2023-07-07T04:02:33.312 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109907.log.gz 2023-07-07T04:02:33.312 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.328742.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107457.log.gz 2023-07-07T04:02:33.312 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631393.log 2023-07-07T04:02:33.312 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.107934.log.gz 2023-07-07T04:02:33.312 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328742.log.gz 2023-07-07T04:02:33.313 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.822881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.822881.log.gz 2023-07-07T04:02:33.313 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645025.log 2023-07-07T04:02:33.313 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.631393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807932.log 2023-07-07T04:02:33.313 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.631393.log.gz 2023-07-07T04:02:33.313 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.645025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383310.log 2023-07-07T04:02:33.314 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645025.log.gz 2023-07-07T04:02:33.314 INFO:teuthology.orchestra.run.smithi006.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.112179.log.gz 2023-07-07T04:02:33.314 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.807932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.640648.log 2023-07-07T04:02:33.314 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807932.log.gz 2023-07-07T04:02:33.314 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.383310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383310.log.gz 2023-07-07T04:02:33.314 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384668.log 2023-07-07T04:02:33.315 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116250.log.gz 2023-07-07T04:02:33.315 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.640648.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.119007.log.gz 2023-07-07T04:02:33.315 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270693.log 2023-07-07T04:02:33.315 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.640648.log.gz 2023-07-07T04:02:33.315 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.384668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313493.log 2023-07-07T04:02:33.316 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384668.log.gz 2023-07-07T04:02:33.316 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.270693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270693.log.gz 2023-07-07T04:02:33.316 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163148.log 2023-07-07T04:02:33.316 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.313493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282072.log 2023-07-07T04:02:33.316 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313493.log.gz 2023-07-07T04:02:33.317 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.163148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626250.log 2023-07-07T04:02:33.317 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163148.log.gz 2023-07-07T04:02:33.317 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.282072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351137.log 2023-07-07T04:02:33.317 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282072.log.gz 2023-07-07T04:02:33.317 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660406.log 2023-07-07T04:02:33.317 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.626250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626250.log.gz 2023-07-07T04:02:33.318 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.351137.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.351137.log.gz-- 2023-07-07T04:02:33.318 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.476042.log 2023-07-07T04:02:33.318 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.660406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.817366.log 2023-07-07T04:02:33.318 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.660406.log.gz 2023-07-07T04:02:33.318 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.476042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654440.log 2023-07-07T04:02:33.319 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.476042.log.gz 2023-07-07T04:02:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.817366.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.817366.log.gz--verbose 2023-07-07T04:02:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.195600.log 2023-07-07T04:02:33.319 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.654440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252747.log 2023-07-07T04:02:33.319 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654440.log.gz 2023-07-07T04:02:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.195600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270600.log 2023-07-07T04:02:33.320 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195600.log.gz 2023-07-07T04:02:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.252747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350840.log 2023-07-07T04:02:33.320 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252747.log.gz 2023-07-07T04:02:33.320 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.270600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271582.log 2023-07-07T04:02:33.320 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270600.log.gz 2023-07-07T04:02:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.350840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631858.log 2023-07-07T04:02:33.321 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350840.log.gz 2023-07-07T04:02:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.271582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117452.log 2023-07-07T04:02:33.321 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271582.log.gz 2023-07-07T04:02:33.321 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.631858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.764160.log 2023-07-07T04:02:33.322 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.631858.log.gz 2023-07-07T04:02:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.806630.log 2023-07-07T04:02:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.764160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395673.log 2023-07-07T04:02:33.322 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.764160.log.gz 2023-07-07T04:02:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.806630.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117452.log.gz 2023-07-07T04:02:33.322 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373502.log 2023-07-07T04:02:33.323 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.806630.log.gz 2023-07-07T04:02:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.395673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222171.log 2023-07-07T04:02:33.323 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395673.log.gz 2023-07-07T04:02:33.323 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.373502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295843.log 2023-07-07T04:02:33.323 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.373502.log.gz 2023-07-07T04:02:33.324 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.222171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637726.log 2023-07-07T04:02:33.324 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222171.log.gz 2023-07-07T04:02:33.324 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.295843.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.295843.log.gz 2023-07-07T04:02:33.324 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.827589.log 2023-07-07T04:02:33.324 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.637726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417284.log 2023-07-07T04:02:33.325 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637726.log.gz 2023-07-07T04:02:33.325 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.827589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336614.log 2023-07-07T04:02:33.325 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.827589.log.gz 2023-07-07T04:02:33.325 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116296.log 2023-07-07T04:02:33.325 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.417284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.417284.log.gz 2023-07-07T04:02:33.326 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.336614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336614.log.gz 2023-07-07T04:02:33.326 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117745.log 2023-07-07T04:02:33.326 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400149.log 2023-07-07T04:02:33.326 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.777458.log 2023-07-07T04:02:33.326 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.400149.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.400149.log.gz 2023-07-07T04:02:33.326 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.800792.log 2023-07-07T04:02:33.327 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116296.log.gz 2023-07-07T04:02:33.327 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117745.log.gz 2023-07-07T04:02:33.327 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.814779.log 2023-07-07T04:02:33.327 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.777458.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.777458.log.gz 2023-07-07T04:02:33.327 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.800792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205031.log 2023-07-07T04:02:33.328 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.800792.log.gz 2023-07-07T04:02:33.328 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.814779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.816896.log 2023-07-07T04:02:33.328 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.814779.log.gz 2023-07-07T04:02:33.328 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.205031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323802.log 2023-07-07T04:02:33.328 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205031.log.gz 2023-07-07T04:02:33.328 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.816896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319026.log 2023-07-07T04:02:33.329 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.816896.log.gz 2023-07-07T04:02:33.329 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.323802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366001.log 2023-07-07T04:02:33.329 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323802.log.gz 2023-07-07T04:02:33.329 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.319026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319026.log.gz 2023-07-07T04:02:33.329 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630911.log 2023-07-07T04:02:33.330 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.366001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251765.log 2023-07-07T04:02:33.330 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366001.log.gz 2023-07-07T04:02:33.330 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.630911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.797989.log 2023-07-07T04:02:33.330 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630911.log.gz 2023-07-07T04:02:33.330 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.251765.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-07-07T04:02:33.331 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251765.log.gz 2023-07-07T04:02:33.331 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.797989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477762.log 2023-07-07T04:02:33.331 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.797989.log.gz 2023-07-07T04:02:33.331 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632809.log 2023-07-07T04:02:33.331 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.477762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.706916.log 2023-07-07T04:02:33.331 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.477762.log.gz 2023-07-07T04:02:33.332 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.632809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.819075.log 2023-07-07T04:02:33.332 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632809.log.gz 2023-07-07T04:02:33.332 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.706916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280460.log 2023-07-07T04:02:33.332 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.706916.log.gz 2023-07-07T04:02:33.332 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.819075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.935728.log 2023-07-07T04:02:33.333 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.819075.log.gz 2023-07-07T04:02:33.333 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.280460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.759718.log 2023-07-07T04:02:33.333 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280460.log.gz 2023-07-07T04:02:33.333 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.935728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635502.log 2023-07-07T04:02:33.333 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.935728.log.gz 2023-07-07T04:02:33.334 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.759718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410159.log 2023-07-07T04:02:33.334 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.759718.log.gz 2023-07-07T04:02:33.334 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.635502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279229.log 2023-07-07T04:02:33.334 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635502.log.gz 2023-07-07T04:02:33.334 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.410159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191976.log 2023-07-07T04:02:33.334 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410159.log.gz 2023-07-07T04:02:33.335 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.279229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384869.log 2023-07-07T04:02:33.335 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279229.log.gz 2023-07-07T04:02:33.335 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.191976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366271.log 2023-07-07T04:02:33.335 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191976.log.gz 2023-07-07T04:02:33.335 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.384869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110088.log 2023-07-07T04:02:33.336 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384869.log.gz 2023-07-07T04:02:33.336 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.366271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245924.log 2023-07-07T04:02:33.336 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366271.log.gz 2023-07-07T04:02:33.336 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374323.log 2023-07-07T04:02:33.336 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.245924.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.315473.log 2023-07-07T04:02:33.336 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245924.log.gz 2023-07-07T04:02:33.337 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.374323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116938.log 2023-07-07T04:02:33.337 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.374323.log.gz 2023-07-07T04:02:33.337 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.315473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.778512.log 2023-07-07T04:02:33.337 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315473.log.gz 2023-07-07T04:02:33.337 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631765.log 2023-07-07T04:02:33.338 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.778512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352441.log 2023-07-07T04:02:33.338 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.778512.log.gz 2023-07-07T04:02:33.338 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.631765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.930391.log 2023-07-07T04:02:33.338 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.631765.log.gz 2023-07-07T04:02:33.338 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.352441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253305.log 2023-07-07T04:02:33.339 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352441.log.gz 2023-07-07T04:02:33.339 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.930391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246164.log 2023-07-07T04:02:33.339 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.930391.log.gz 2023-07-07T04:02:33.339 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.253305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317784.log 2023-07-07T04:02:33.339 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253305.log.gz 2023-07-07T04:02:33.339 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.246164.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.671647.log 2023-07-07T04:02:33.340 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246164.log.gz 2023-07-07T04:02:33.340 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.317784.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110088.log.gz 2023-07-07T04:02:33.340 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.317784.log.gz-5 2023-07-07T04:02:33.340 INFO:teuthology.orchestra.run.smithi006.stderr:--verbose -- /var/log/ceph/ceph-client.admin.808979.log 2023-07-07T04:02:33.340 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116938.log.gz 2023-07-07T04:02:33.341 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253796.log 2023-07-07T04:02:33.341 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.671647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671647.log.gz 2023-07-07T04:02:33.341 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.808979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196380.log 2023-07-07T04:02:33.341 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.808979.log.gz 2023-07-07T04:02:33.341 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.253796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178882.log 2023-07-07T04:02:33.342 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253796.log.gz 2023-07-07T04:02:33.342 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.196380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196380.log.gz 2023-07-07T04:02:33.342 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.797771.log 2023-07-07T04:02:33.342 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.178882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335387.log 2023-07-07T04:02:33.342 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178882.log.gz 2023-07-07T04:02:33.342 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.797771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370005.log 2023-07-07T04:02:33.343 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.797771.log.gz 2023-07-07T04:02:33.343 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.335387.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.940578.log 2023-07-07T04:02:33.343 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335387.log.gz 2023-07-07T04:02:33.343 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.370005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356587.log 2023-07-07T04:02:33.343 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.370005.log.gz 2023-07-07T04:02:33.344 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.940578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282597.log 2023-07-07T04:02:33.344 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.940578.log.gz 2023-07-07T04:02:33.344 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.356587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562107.log 2023-07-07T04:02:33.344 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356587.log.gz 2023-07-07T04:02:33.344 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.282597.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.365773.log 2023-07-07T04:02:33.345 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282597.log.gz 2023-07-07T04:02:33.345 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.562107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108270.log 2023-07-07T04:02:33.345 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.562107.log.gz 2023-07-07T04:02:33.345 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.365773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637263.log 2023-07-07T04:02:33.345 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365773.log.gz 2023-07-07T04:02:33.345 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.805809.log 2023-07-07T04:02:33.346 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.637263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388088.log 2023-07-07T04:02:33.346 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637263.log.gz 2023-07-07T04:02:33.346 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.805809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398196.log 2023-07-07T04:02:33.346 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.805809.log.gz 2023-07-07T04:02:33.346 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.388088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380793.log 2023-07-07T04:02:33.347 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.388088.log.gz 2023-07-07T04:02:33.347 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.398196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119145.log 2023-07-07T04:02:33.347 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.398196.log.gz 2023-07-07T04:02:33.347 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.380793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410173.log 2023-07-07T04:02:33.347 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.380793.log.gz 2023-07-07T04:02:33.348 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.119145.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.108270.log.gz 2023-07-07T04:02:33.348 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153927.log 2023-07-07T04:02:33.348 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.410173.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.683657.log -- replaced with /var/log/ceph/ceph-client.admin.410173.log.gz 2023-07-07T04:02:33.348 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:33.348 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.153927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403940.log 2023-07-07T04:02:33.349 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153927.log.gz 2023-07-07T04:02:33.349 INFO:teuthology.orchestra.run.smithi006.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.119145.log.gz 2023-07-07T04:02:33.349 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.683657.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.683657.log.gz--verbose 2023-07-07T04:02:33.349 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.329655.log 2023-07-07T04:02:33.349 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.403940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251369.log 2023-07-07T04:02:33.349 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.403940.log.gz 2023-07-07T04:02:33.350 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.329655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302450.log 2023-07-07T04:02:33.350 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329655.log.gz 2023-07-07T04:02:33.350 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.251369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328945.log 2023-07-07T04:02:33.350 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251369.log.gz 2023-07-07T04:02:33.350 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.302450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415888.log 2023-07-07T04:02:33.351 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302450.log.gz 2023-07-07T04:02:33.351 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.328945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.826821.log 2023-07-07T04:02:33.351 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328945.log.gz 2023-07-07T04:02:33.351 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.415888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381885.log 2023-07-07T04:02:33.351 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.415888.log.gz 2023-07-07T04:02:33.351 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.826821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686402.log 2023-07-07T04:02:33.352 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.826821.log.gz 2023-07-07T04:02:33.352 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.381885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288149.log 2023-07-07T04:02:33.352 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381885.log.gz 2023-07-07T04:02:33.352 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216756.log 2023-07-07T04:02:33.352 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.686402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686402.log.gz 2023-07-07T04:02:33.353 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.288149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654051.log 2023-07-07T04:02:33.353 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288149.log.gz 2023-07-07T04:02:33.353 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.216756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296944.log 2023-07-07T04:02:33.353 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216756.log.gz 2023-07-07T04:02:33.353 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.654051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408464.log 2023-07-07T04:02:33.354 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654051.log.gz 2023-07-07T04:02:33.354 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.296944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396747.log 2023-07-07T04:02:33.354 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.296944.log.gz 2023-07-07T04:02:33.354 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.408464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637740.log 2023-07-07T04:02:33.354 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408464.log.gz 2023-07-07T04:02:33.354 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.396747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372991.log 2023-07-07T04:02:33.355 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396747.log.gz 2023-07-07T04:02:33.355 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.637740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327747.log 2023-07-07T04:02:33.355 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637740.log.gz 2023-07-07T04:02:33.355 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.372991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193940.log 2023-07-07T04:02:33.355 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372991.log.gz 2023-07-07T04:02:33.356 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.327747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389081.log 2023-07-07T04:02:33.356 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327747.log.gz 2023-07-07T04:02:33.356 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.193940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375756.log 2023-07-07T04:02:33.356 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193940.log.gz 2023-07-07T04:02:33.356 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.389081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390396.log 2023-07-07T04:02:33.357 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.389081.log.gz 2023-07-07T04:02:33.357 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.375756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.778591.log 2023-07-07T04:02:33.357 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.375756.log.gz 2023-07-07T04:02:33.357 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.390396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344542.log 2023-07-07T04:02:33.357 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.390396.log.gz 2023-07-07T04:02:33.357 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.778591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.942530.log 2023-07-07T04:02:33.358 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.778591.log.gz 2023-07-07T04:02:33.358 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.344542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348038.log 2023-07-07T04:02:33.358 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344542.log.gz 2023-07-07T04:02:33.358 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.942530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412320.log 2023-07-07T04:02:33.358 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.942530.log.gz 2023-07-07T04:02:33.359 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.348038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.764538.log 2023-07-07T04:02:33.359 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348038.log.gz 2023-07-07T04:02:33.359 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 /var/log/ceph/ceph-client.admin.412320.log: --verbose -- /var/log/ceph/ceph-client.admin.655755.log 2023-07-07T04:02:33.359 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412320.log.gz 2023-07-07T04:02:33.359 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.764538.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.764538.log.gz-5 2023-07-07T04:02:33.360 INFO:teuthology.orchestra.run.smithi006.stderr:--verbose -- /var/log/ceph/ceph-client.admin.110719.log 2023-07-07T04:02:33.360 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.655755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260377.log 2023-07-07T04:02:33.360 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655755.log.gz 2023-07-07T04:02:33.360 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.642527.log 2023-07-07T04:02:33.360 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.260377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.761270.log 2023-07-07T04:02:33.360 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260377.log.gz 2023-07-07T04:02:33.361 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.642527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377279.log 2023-07-07T04:02:33.361 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.642527.log.gz 2023-07-07T04:02:33.361 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110719.log.gz 2023-07-07T04:02:33.361 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.761270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.933707.log 2023-07-07T04:02:33.361 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.761270.log.gz 2023-07-07T04:02:33.362 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.377279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.762227.log 2023-07-07T04:02:33.362 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.377279.log.gz 2023-07-07T04:02:33.362 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.933707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637943.log 2023-07-07T04:02:33.362 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.933707.log.gz 2023-07-07T04:02:33.362 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.762227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.822895.log 2023-07-07T04:02:33.363 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.762227.log.gz 2023-07-07T04:02:33.363 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.637943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.812652.log 2023-07-07T04:02:33.363 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637943.log.gz 2023-07-07T04:02:33.363 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.822895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349065.log 2023-07-07T04:02:33.363 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.822895.log.gz 2023-07-07T04:02:33.363 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.812652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198545.log 2023-07-07T04:02:33.364 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.812652.log.gz 2023-07-07T04:02:33.364 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.349065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474577.log 2023-07-07T04:02:33.364 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349065.log.gz 2023-07-07T04:02:33.364 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.198545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355164.log 2023-07-07T04:02:33.364 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198545.log.gz 2023-07-07T04:02:33.365 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.474577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218211.log 2023-07-07T04:02:33.365 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.474577.log.gz 2023-07-07T04:02:33.365 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.355164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.669070.log 2023-07-07T04:02:33.365 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355164.log.gz 2023-07-07T04:02:33.365 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.218211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172064.log 2023-07-07T04:02:33.366 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218211.log.gz 2023-07-07T04:02:33.366 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.669070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389933.log 2023-07-07T04:02:33.366 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.669070.log.gz 2023-07-07T04:02:33.366 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.172064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.825145.log 2023-07-07T04:02:33.366 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172064.log.gz 2023-07-07T04:02:33.366 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.389933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421962.log 2023-07-07T04:02:33.367 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.389933.log.gz 2023-07-07T04:02:33.367 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.825145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.670100.log 2023-07-07T04:02:33.367 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.825145.log.gz 2023-07-07T04:02:33.367 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.421962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373798.log 2023-07-07T04:02:33.367 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.421962.log.gz 2023-07-07T04:02:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.670100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656774.log 2023-07-07T04:02:33.368 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.670100.log.gz 2023-07-07T04:02:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.373798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342566.log 2023-07-07T04:02:33.368 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.373798.log.gz 2023-07-07T04:02:33.368 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.656774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626979.log 2023-07-07T04:02:33.369 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656774.log.gz 2023-07-07T04:02:33.369 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.342566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118572.log 2023-07-07T04:02:33.369 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342566.log.gz 2023-07-07T04:02:33.369 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.626979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280255.log 2023-07-07T04:02:33.369 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626979.log.gz 2023-07-07T04:02:33.369 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109520.log 2023-07-07T04:02:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.280255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693924.log 2023-07-07T04:02:33.370 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280255.log.gz 2023-07-07T04:02:33.370 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118572.log.gz 2023-07-07T04:02:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206986.log 2023-07-07T04:02:33.370 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.693924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.936211.log 2023-07-07T04:02:33.371 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693924.log.gz 2023-07-07T04:02:33.371 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.206986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.817287.log 2023-07-07T04:02:33.371 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109520.log.gz 2023-07-07T04:02:33.371 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206986.log.gz 2023-07-07T04:02:33.371 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.936211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476994.log 2023-07-07T04:02:33.372 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.936211.log.gz 2023-07-07T04:02:33.372 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.817287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112225.log 2023-07-07T04:02:33.372 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.817287.log.gz 2023-07-07T04:02:33.372 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.476994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478951.log 2023-07-07T04:02:33.372 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.476994.log.gz 2023-07-07T04:02:33.372 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.940808.log 2023-07-07T04:02:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.478951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381355.log 2023-07-07T04:02:33.373 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.478951.log.gz 2023-07-07T04:02:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.940808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114392.log 2023-07-07T04:02:33.373 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.940808.log.gz 2023-07-07T04:02:33.373 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.381355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334433.log 2023-07-07T04:02:33.374 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381355.log.gz 2023-07-07T04:02:33.374 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420408.log 2023-07-07T04:02:33.374 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773345.log 2023-07-07T04:02:33.374 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.334433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334433.log.gz 2023-07-07T04:02:33.374 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.420408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280770.log 2023-07-07T04:02:33.374 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.420408.log.gz 2023-07-07T04:02:33.375 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.773345.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.112225.log.gz 2023-07-07T04:02:33.375 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.939119.log 2023-07-07T04:02:33.375 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773345.log.gz 2023-07-07T04:02:33.375 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114392.log.gz 2023-07-07T04:02:33.375 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218707.log 2023-07-07T04:02:33.376 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.280770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280770.log.gz 2023-07-07T04:02:33.376 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.939119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111857.log 2023-07-07T04:02:33.376 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.939119.log.gz 2023-07-07T04:02:33.376 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.218707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.775200.log 2023-07-07T04:02:33.376 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218707.log.gz 2023-07-07T04:02:33.377 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175270.log 2023-07-07T04:02:33.377 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.775200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633299.log 2023-07-07T04:02:33.377 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.775200.log.gz 2023-07-07T04:02:33.377 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.175270.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.175270.log.gz-5 2023-07-07T04:02:33.377 INFO:teuthology.orchestra.run.smithi006.stderr:--verbose -- /var/log/ceph/ceph-client.admin.659452.log 2023-07-07T04:02:33.378 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.633299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380993.log 2023-07-07T04:02:33.378 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633299.log.gz 2023-07-07T04:02:33.378 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.659452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659452.log.gz 2023-07-07T04:02:33.378 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681315.log 2023-07-07T04:02:33.378 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.380993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.816424.log 2023-07-07T04:02:33.378 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.380993.log.gz 2023-07-07T04:02:33.379 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.681315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115737.log 2023-07-07T04:02:33.379 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681315.log.gz 2023-07-07T04:02:33.379 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.816424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292671.log 2023-07-07T04:02:33.379 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.816424.log.gz 2023-07-07T04:02:33.379 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109428.log 2023-07-07T04:02:33.380 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.292671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.938519.log 2023-07-07T04:02:33.380 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292671.log.gz 2023-07-07T04:02:33.380 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300939.log 2023-07-07T04:02:33.380 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.938519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247871.log 2023-07-07T04:02:33.380 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.938519.log.gz 2023-07-07T04:02:33.380 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.300939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321333.log 2023-07-07T04:02:33.381 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300939.log.gz 2023-07-07T04:02:33.381 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.247871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697789.log 2023-07-07T04:02:33.381 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247871.log.gz 2023-07-07T04:02:33.381 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.321333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195614.log 2023-07-07T04:02:33.381 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321333.log.gz 2023-07-07T04:02:33.382 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.697789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263544.log 2023-07-07T04:02:33.382 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697789.log.gz 2023-07-07T04:02:33.382 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.195614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224140.log 2023-07-07T04:02:33.382 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195614.log.gz 2023-07-07T04:02:33.382 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.263544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278535.log 2023-07-07T04:02:33.383 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263544.log.gz 2023-07-07T04:02:33.383 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.224140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332606.log 2023-07-07T04:02:33.383 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224140.log.gz 2023-07-07T04:02:33.383 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.278535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.806320.log 2023-07-07T04:02:33.383 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278535.log.gz 2023-07-07T04:02:33.383 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.332606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.643012.log 2023-07-07T04:02:33.384 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332606.log.gz 2023-07-07T04:02:33.384 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.806320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480749.log 2023-07-07T04:02:33.384 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.806320.log.gz 2023-07-07T04:02:33.384 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.643012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.941038.log 2023-07-07T04:02:33.384 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.643012.log.gz 2023-07-07T04:02:33.385 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.480749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.711166.log 2023-07-07T04:02:33.385 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.480749.log.gz 2023-07-07T04:02:33.385 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.941038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426259.log 2023-07-07T04:02:33.385 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.941038.log.gz 2023-07-07T04:02:33.385 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.711166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700392.log 2023-07-07T04:02:33.385 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.711166.log.gz 2023-07-07T04:02:33.386 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.426259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.711756.log 2023-07-07T04:02:33.386 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.426259.log.gz 2023-07-07T04:02:33.386 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.700392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.776285.log 2023-07-07T04:02:33.386 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700392.log.gz 2023-07-07T04:02:33.386 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.711756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639706.log 2023-07-07T04:02:33.387 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.711756.log.gz 2023-07-07T04:02:33.387 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.776285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165632.log 2023-07-07T04:02:33.387 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.776285.log.gz 2023-07-07T04:02:33.387 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.639706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479746.log 2023-07-07T04:02:33.387 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639706.log.gz 2023-07-07T04:02:33.388 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.165632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108454.log 2023-07-07T04:02:33.388 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165632.log.gz 2023-07-07T04:02:33.388 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.479746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396277.log 2023-07-07T04:02:33.388 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.479746.log.gz 2023-07-07T04:02:33.388 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.763629.log 2023-07-07T04:02:33.388 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.396277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.760980.log 2023-07-07T04:02:33.389 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396277.log.gz 2023-07-07T04:02:33.389 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.763629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266727.log 2023-07-07T04:02:33.389 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.763629.log.gz 2023-07-07T04:02:33.389 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309648.log 2023-07-07T04:02:33.389 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.760980.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.760980.log.gz 2023-07-07T04:02:33.390 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.266727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378444.log 2023-07-07T04:02:33.390 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266727.log.gz 2023-07-07T04:02:33.390 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.309648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177093.log 2023-07-07T04:02:33.390 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309648.log.gz 2023-07-07T04:02:33.390 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.378444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247885.log 2023-07-07T04:02:33.390 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.378444.log.gz 2023-07-07T04:02:33.391 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.177093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170204.log 2023-07-07T04:02:33.391 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177093.log.gz 2023-07-07T04:02:33.391 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.247885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356248.log 2023-07-07T04:02:33.391 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247885.log.gz 2023-07-07T04:02:33.391 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.170204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673950.log 2023-07-07T04:02:33.392 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170204.log.gz 2023-07-07T04:02:33.392 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.356248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368979.log 2023-07-07T04:02:33.392 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356248.log.gz 2023-07-07T04:02:33.392 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.673950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635715.log 2023-07-07T04:02:33.392 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673950.log.gz 2023-07-07T04:02:33.393 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.368979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675034.log 2023-07-07T04:02:33.393 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.368979.log.gz 2023-07-07T04:02:33.393 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.635715.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.635715.log.gz-- 2023-07-07T04:02:33.393 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.221604.log 2023-07-07T04:02:33.393 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.675034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394957.log 2023-07-07T04:02:33.394 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675034.log.gz 2023-07-07T04:02:33.394 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.221604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294003.log 2023-07-07T04:02:33.394 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221604.log.gz 2023-07-07T04:02:33.394 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.394957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212467.log 2023-07-07T04:02:33.394 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394957.log.gz 2023-07-07T04:02:33.394 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297980.log 2023-07-07T04:02:33.395 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.294003.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294003.log.gz 2023-07-07T04:02:33.395 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.212467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476438.log 2023-07-07T04:02:33.395 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212467.log.gz 2023-07-07T04:02:33.395 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.297980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690389.log 2023-07-07T04:02:33.395 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.297980.log.gz 2023-07-07T04:02:33.396 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.476438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332403.log 2023-07-07T04:02:33.396 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.476438.log.gz 2023-07-07T04:02:33.396 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.690389.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-07-07T04:02:33.396 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690389.log.gz 2023-07-07T04:02:33.396 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.332403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.780932.log 2023-07-07T04:02:33.397 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332403.log.gz 2023-07-07T04:02:33.397 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628480.log 2023-07-07T04:02:33.397 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.780932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289622.log 2023-07-07T04:02:33.397 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.780932.log.gz 2023-07-07T04:02:33.397 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.628480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160424.log 2023-07-07T04:02:33.397 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628480.log.gz 2023-07-07T04:02:33.398 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417363.log 2023-07-07T04:02:33.398 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.289622.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289622.log.gz 2023-07-07T04:02:33.398 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.160424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289210.log 2023-07-07T04:02:33.398 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160424.log.gz 2023-07-07T04:02:33.398 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.417363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112731.log 2023-07-07T04:02:33.399 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.417363.log.gz 2023-07-07T04:02:33.399 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158243.log 2023-07-07T04:02:33.399 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.289210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289210.log.gz 2023-07-07T04:02:33.399 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.826145.log 2023-07-07T04:02:33.399 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.158243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192865.log 2023-07-07T04:02:33.399 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158243.log.gz 2023-07-07T04:02:33.400 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.826145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.803844.log 2023-07-07T04:02:33.400 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.826145.log.gz 2023-07-07T04:02:33.400 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290199.log 2023-07-07T04:02:33.400 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.192865.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192865.log.gz 2023-07-07T04:02:33.400 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.803844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685719.log 2023-07-07T04:02:33.401 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.803844.log.gz 2023-07-07T04:02:33.401 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.290199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394229.log 2023-07-07T04:02:33.401 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290199.log.gz 2023-07-07T04:02:33.401 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 /var/log/ceph/ceph-client.admin.685719.log: --verbose -- /var/log/ceph/ceph-client.admin.300213.log 2023-07-07T04:02:33.401 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685719.log.gz 2023-07-07T04:02:33.402 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.394229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.806924.log 2023-07-07T04:02:33.402 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394229.log.gz 2023-07-07T04:02:33.402 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.300213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277497.log 2023-07-07T04:02:33.402 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300213.log.gz 2023-07-07T04:02:33.402 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.806924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.809521.log 2023-07-07T04:02:33.402 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.806924.log.gz 2023-07-07T04:02:33.403 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.277497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.826052.log 2023-07-07T04:02:33.403 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277497.log.gz 2023-07-07T04:02:33.403 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.809521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163460.log 2023-07-07T04:02:33.403 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.809521.log.gz 2023-07-07T04:02:33.403 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.826052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338100.log 2023-07-07T04:02:33.404 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.826052.log.gz 2023-07-07T04:02:33.404 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.163460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161878.log 2023-07-07T04:02:33.404 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163460.log.gz 2023-07-07T04:02:33.404 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.338100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409118.log 2023-07-07T04:02:33.404 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338100.log.gz 2023-07-07T04:02:33.405 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.161878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278072.log 2023-07-07T04:02:33.405 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161878.log.gz 2023-07-07T04:02:33.405 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.409118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217610.log 2023-07-07T04:02:33.405 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409118.log.gz 2023-07-07T04:02:33.405 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.278072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.803254.log 2023-07-07T04:02:33.405 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278072.log.gz 2023-07-07T04:02:33.406 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.217610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.711946.log 2023-07-07T04:02:33.406 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217610.log.gz 2023-07-07T04:02:33.406 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.803254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109382.log 2023-07-07T04:02:33.406 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.803254.log.gz 2023-07-07T04:02:33.406 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.711946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399684.log 2023-07-07T04:02:33.407 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.711946.log.gz 2023-07-07T04:02:33.407 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109815.log 2023-07-07T04:02:33.407 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.399684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380714.log 2023-07-07T04:02:33.407 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399684.log.gz 2023-07-07T04:02:33.407 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206907.log 2023-07-07T04:02:33.407 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109815.log: /var/log/ceph/ceph-client.admin.380714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628494.log 2023-07-07T04:02:33.408 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.380714.log.gz 2023-07-07T04:02:33.408 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.206907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206907.log.gz 2023-07-07T04:02:33.408 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327469.log 2023-07-07T04:02:33.408 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.628494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347821.log 2023-07-07T04:02:33.408 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628494.log.gz 2023-07-07T04:02:33.409 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.327469.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.265695.log 2023-07-07T04:02:33.409 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327469.log.gz 2023-07-07T04:02:33.409 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.347821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426714.log 2023-07-07T04:02:33.409 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347821.log.gz 2023-07-07T04:02:33.409 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.265695.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.265695.log.gz-5 2023-07-07T04:02:33.410 INFO:teuthology.orchestra.run.smithi006.stderr:--verbose -- /var/log/ceph/ceph-client.admin.804880.log 2023-07-07T04:02:33.410 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217212.log /var/log/ceph/ceph-client.admin.426714.log: 2023-07-07T04:02:33.410 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.426714.log.gz 2023-07-07T04:02:33.410 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.804880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685640.log 2023-07-07T04:02:33.410 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.804880.log.gz 2023-07-07T04:02:33.411 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.217212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.711259.log 2023-07-07T04:02:33.411 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217212.log.gz 2023-07-07T04:02:33.411 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.685640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655281.log 2023-07-07T04:02:33.411 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685640.log.gz 2023-07-07T04:02:33.411 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.711259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.764067.log 2023-07-07T04:02:33.411 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.711259.log.gz 2023-07-07T04:02:33.412 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.655281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114577.log 2023-07-07T04:02:33.412 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655281.log.gz 2023-07-07T04:02:33.412 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.764067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273546.log 2023-07-07T04:02:33.412 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.764067.log.gz 2023-07-07T04:02:33.412 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.940762.log 2023-07-07T04:02:33.413 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.273546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.670842.log 2023-07-07T04:02:33.413 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273546.log.gz 2023-07-07T04:02:33.413 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.940762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447789.log 2023-07-07T04:02:33.413 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.670842.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.940762.log.gz 2023-07-07T04:02:33.413 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336200.log 2023-07-07T04:02:33.414 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.670842.log.gz 2023-07-07T04:02:33.414 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.447789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.643706.log 2023-07-07T04:02:33.414 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.447789.log.gz 2023-07-07T04:02:33.414 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.336200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683110.log 2023-07-07T04:02:33.414 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336200.log.gz 2023-07-07T04:02:33.414 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.643706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262380.log 2023-07-07T04:02:33.415 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.643706.log.gz 2023-07-07T04:02:33.415 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.683110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403954.log 2023-07-07T04:02:33.415 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683110.log.gz 2023-07-07T04:02:33.415 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.262380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.803765.log 2023-07-07T04:02:33.415 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262380.log.gz 2023-07-07T04:02:33.416 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.403954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289131.log 2023-07-07T04:02:33.416 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.403954.log.gz 2023-07-07T04:02:33.416 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.803765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382454.log 2023-07-07T04:02:33.416 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.803765.log.gz 2023-07-07T04:02:33.416 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.289131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267236.log 2023-07-07T04:02:33.416 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289131.log.gz 2023-07-07T04:02:33.417 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.382454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476028.log 2023-07-07T04:02:33.417 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382454.log.gz 2023-07-07T04:02:33.417 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.267236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.780508.log 2023-07-07T04:02:33.417 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267236.log.gz 2023-07-07T04:02:33.417 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.476028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362259.log 2023-07-07T04:02:33.418 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.476028.log.gz 2023-07-07T04:02:33.418 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.780508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.797678.log 2023-07-07T04:02:33.418 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.780508.log.gz 2023-07-07T04:02:33.418 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.362259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.931829.log 2023-07-07T04:02:33.418 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362259.log.gz 2023-07-07T04:02:33.419 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.797678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.774389.log 2023-07-07T04:02:33.419 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.797678.log.gz 2023-07-07T04:02:33.419 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.931829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375074.log 2023-07-07T04:02:33.419 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.931829.log.gz 2023-07-07T04:02:33.419 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.774389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.941582.log 2023-07-07T04:02:33.419 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.774389.log.gz 2023-07-07T04:02:33.420 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.375074.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111857.log.gz 2023-07-07T04:02:33.420 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111080.log 2023-07-07T04:02:33.420 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.375074.log.gz 2023-07-07T04:02:33.420 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.115737.log.gz 2023-07-07T04:02:33.420 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.941582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478528.log 2023-07-07T04:02:33.421 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109428.log.gz 2023-07-07T04:02:33.421 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111080.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.941582.log.gz 2023-07-07T04:02:33.421 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475572.log 2023-07-07T04:02:33.421 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.478528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178158.log 2023-07-07T04:02:33.421 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.478528.log.gz 2023-07-07T04:02:33.421 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.475572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647004.log 2023-07-07T04:02:33.422 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.475572.log.gz 2023-07-07T04:02:33.422 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.178158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693012.log 2023-07-07T04:02:33.422 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178158.log.gz 2023-07-07T04:02:33.422 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.647004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.778973.log 2023-07-07T04:02:33.422 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.647004.log.gz 2023-07-07T04:02:33.423 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.693012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331616.log 2023-07-07T04:02:33.423 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693012.log.gz 2023-07-07T04:02:33.423 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.778973.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.653229.log 2023-07-07T04:02:33.423 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.778973.log.gz 2023-07-07T04:02:33.423 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.331616.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.331616.log.gz--verbose 2023-07-07T04:02:33.424 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.376464.log 2023-07-07T04:02:33.424 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.653229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209019.log 2023-07-07T04:02:33.424 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.653229.log.gz 2023-07-07T04:02:33.424 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.376464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222707.log 2023-07-07T04:02:33.424 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.376464.log.gz 2023-07-07T04:02:33.424 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.209019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412413.log 2023-07-07T04:02:33.425 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.209019.log.gz 2023-07-07T04:02:33.425 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.222707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.781433.log 2023-07-07T04:02:33.425 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222707.log.gz 2023-07-07T04:02:33.425 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.412413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194338.log 2023-07-07T04:02:33.425 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412413.log.gz 2023-07-07T04:02:33.426 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.781433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377293.log 2023-07-07T04:02:33.426 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.781433.log.gz 2023-07-07T04:02:33.426 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.194338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.813126.log 2023-07-07T04:02:33.426 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194338.log.gz 2023-07-07T04:02:33.426 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.377293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700976.log 2023-07-07T04:02:33.427 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.377293.log.gz 2023-07-07T04:02:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.813126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111095.log 2023-07-07T04:02:33.427 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.813126.log.gz 2023-07-07T04:02:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.700976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.797260.log 2023-07-07T04:02:33.427 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700976.log.gz 2023-07-07T04:02:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.934282.log 2023-07-07T04:02:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.797260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294808.log 2023-07-07T04:02:33.428 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.797260.log.gz 2023-07-07T04:02:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.934282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.934282.log.gz 2023-07-07T04:02:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307112.log 2023-07-07T04:02:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.294808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401072.log 2023-07-07T04:02:33.429 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294808.log.gz 2023-07-07T04:02:33.429 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.307112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385459.log 2023-07-07T04:02:33.429 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307112.log.gz 2023-07-07T04:02:33.429 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.401072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348554.log 2023-07-07T04:02:33.429 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.401072.log.gz 2023-07-07T04:02:33.430 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.385459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397290.log 2023-07-07T04:02:33.430 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385459.log.gz 2023-07-07T04:02:33.430 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.348554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671043.log 2023-07-07T04:02:33.430 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348554.log.gz 2023-07-07T04:02:33.430 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.397290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627073.log 2023-07-07T04:02:33.430 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.397290.log.gz 2023-07-07T04:02:33.431 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.671043.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.448760.log 2023-07-07T04:02:33.431 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671043.log.gz 2023-07-07T04:02:33.431 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.627073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329160.log 2023-07-07T04:02:33.431 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627073.log.gz 2023-07-07T04:02:33.431 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.448760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.678767.log 2023-07-07T04:02:33.432 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.448760.log.gz 2023-07-07T04:02:33.432 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.329160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403476.log 2023-07-07T04:02:33.432 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329160.log.gz 2023-07-07T04:02:33.432 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.678767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686742.log 2023-07-07T04:02:33.432 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.678767.log.gz 2023-07-07T04:02:33.433 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.403476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374013.log 2023-07-07T04:02:33.433 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.403476.log.gz 2023-07-07T04:02:33.433 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.686742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480031.log 2023-07-07T04:02:33.433 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686742.log.gz 2023-07-07T04:02:33.433 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.374013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773880.log 2023-07-07T04:02:33.433 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.374013.log.gz 2023-07-07T04:02:33.434 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.480031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348239.log 2023-07-07T04:02:33.434 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.480031.log.gz 2023-07-07T04:02:33.434 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.773880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.827789.log 2023-07-07T04:02:33.434 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773880.log.gz 2023-07-07T04:02:33.434 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.348239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620397.log 2023-07-07T04:02:33.435 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348239.log.gz 2023-07-07T04:02:33.435 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.827789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223756.log 2023-07-07T04:02:33.435 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.827789.log.gz 2023-07-07T04:02:33.435 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.620397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.940368.log 2023-07-07T04:02:33.435 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620397.log.gz 2023-07-07T04:02:33.436 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.223756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629925.log 2023-07-07T04:02:33.436 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223756.log.gz 2023-07-07T04:02:33.436 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.940368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108408.log 2023-07-07T04:02:33.436 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.629925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407205.log 2023-07-07T04:02:33.436 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.940368.log.gz 2023-07-07T04:02:33.436 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629925.log.gz 2023-07-07T04:02:33.437 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.826807.log 2023-07-07T04:02:33.437 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.407205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301703.log 2023-07-07T04:02:33.437 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407205.log.gz 2023-07-07T04:02:33.437 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.826807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.808149.log 2023-07-07T04:02:33.437 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.826807.log.gz 2023-07-07T04:02:33.438 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.301703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692718.log 2023-07-07T04:02:33.438 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301703.log.gz 2023-07-07T04:02:33.438 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.808149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.805298.log 2023-07-07T04:02:33.438 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.808149.log.gz 2023-07-07T04:02:33.438 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.692718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692718.log.gz 2023-07-07T04:02:33.438 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335683.log 2023-07-07T04:02:33.439 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.805298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309555.log 0.0% 2023-07-07T04:02:33.439 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.805298.log.gz 2023-07-07T04:02:33.439 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.335683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549213.log 2023-07-07T04:02:33.439 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335683.log.gz 2023-07-07T04:02:33.439 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.309555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772572.log 2023-07-07T04:02:33.440 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309555.log.gz 2023-07-07T04:02:33.440 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.549213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.763846.log 2023-07-07T04:02:33.440 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.549213.log.gz 2023-07-07T04:02:33.440 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.772572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264296.log 2023-07-07T04:02:33.440 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.772572.log.gz 2023-07-07T04:02:33.441 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.763846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448273.log 2023-07-07T04:02:33.441 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.763846.log.gz 2023-07-07T04:02:33.441 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.264296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205510.log 2023-07-07T04:02:33.441 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264296.log.gz 2023-07-07T04:02:33.441 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.448273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710082.log 2023-07-07T04:02:33.441 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.448273.log.gz 2023-07-07T04:02:33.442 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.205510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333117.log 2023-07-07T04:02:33.442 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205510.log.gz 2023-07-07T04:02:33.442 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.710082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162374.log 2023-07-07T04:02:33.442 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710082.log.gz 2023-07-07T04:02:33.442 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.333117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210501.log 2023-07-07T04:02:33.443 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333117.log.gz 2023-07-07T04:02:33.443 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.162374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294297.log 2023-07-07T04:02:33.443 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162374.log.gz 2023-07-07T04:02:33.443 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.210501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421481.log 2023-07-07T04:02:33.443 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210501.log.gz 2023-07-07T04:02:33.444 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.294297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474772.log 2023-07-07T04:02:33.444 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294297.log.gz 2023-07-07T04:02:33.444 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290117.log 2023-07-07T04:02:33.444 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.421481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.421481.log.gz 2023-07-07T04:02:33.444 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.474772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.798271.log 2023-07-07T04:02:33.444 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.474772.log.gz 2023-07-07T04:02:33.445 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.290117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197973.log 2023-07-07T04:02:33.445 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290117.log.gz 2023-07-07T04:02:33.445 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.798271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214469.log 2023-07-07T04:02:33.445 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.798271.log.gz 2023-07-07T04:02:33.445 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.197973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292240.log 2023-07-07T04:02:33.446 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197973.log.gz 2023-07-07T04:02:33.446 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.214469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.798488.log 2023-07-07T04:02:33.446 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214469.log.gz 2023-07-07T04:02:33.446 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.292240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373301.log 2023-07-07T04:02:33.446 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292240.log.gz 2023-07-07T04:02:33.447 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.798488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401749.log 2023-07-07T04:02:33.447 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.798488.log.gz 2023-07-07T04:02:33.447 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.373301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374995.log 2023-07-07T04:02:33.447 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.373301.log.gz 2023-07-07T04:02:33.447 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.401749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159941.log 2023-07-07T04:02:33.447 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.401749.log.gz 2023-07-07T04:02:33.448 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.374995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373070.log 2023-07-07T04:02:33.448 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.374995.log.gz 2023-07-07T04:02:33.448 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.159941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.675020.log 2023-07-07T04:02:33.448 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159941.log.gz 2023-07-07T04:02:33.448 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112731.log.gz 2023-07-07T04:02:33.449 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.373070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704699.log 2023-07-07T04:02:33.449 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.373070.log.gz 2023-07-07T04:02:33.449 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.109382.log.gz 2023-07-07T04:02:33.449 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.675020.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.109815.log.gz 2023-07-07T04:02:33.449 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285423.log 2023-07-07T04:02:33.450 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.675020.log.gz 2023-07-07T04:02:33.450 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.114577.log.gz 2023-07-07T04:02:33.450 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111080.log.gz 2023-07-07T04:02:33.450 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.108408.log.gz 2023-07-07T04:02:33.450 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111095.log.gz 2023-07-07T04:02:33.450 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.704699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357561.log 2023-07-07T04:02:33.451 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704699.log.gz 2023-07-07T04:02:33.451 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.285423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811569.log 2023-07-07T04:02:33.451 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285423.log.gz 2023-07-07T04:02:33.451 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.357561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408371.log 2023-07-07T04:02:33.451 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357561.log.gz 2023-07-07T04:02:33.452 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.811569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413884.log 2023-07-07T04:02:33.452 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811569.log.gz 2023-07-07T04:02:33.452 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.408371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165840.log 2023-07-07T04:02:33.452 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408371.log.gz 2023-07-07T04:02:33.452 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.413884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413884.log.gz 2023-07-07T04:02:33.452 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807638.log 2023-07-07T04:02:33.453 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.165840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.640183.log 2023-07-07T04:02:33.453 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165840.log.gz 2023-07-07T04:02:33.453 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.807638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479442.log 2023-07-07T04:02:33.453 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807638.log.gz 2023-07-07T04:02:33.453 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.640183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.640183.log.gz 2023-07-07T04:02:33.454 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.803039.log 2023-07-07T04:02:33.454 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.479442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619042.log 2023-07-07T04:02:33.454 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.479442.log.gz 2023-07-07T04:02:33.454 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.803039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322830.log 2023-07-07T04:02:33.454 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.803039.log.gz 2023-07-07T04:02:33.455 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.619042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415378.log 2023-07-07T04:02:33.455 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619042.log.gz 2023-07-07T04:02:33.455 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.322830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.640662.log 2023-07-07T04:02:33.455 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322830.log.gz 2023-07-07T04:02:33.455 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.415378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337067.log 2023-07-07T04:02:33.455 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.415378.log.gz 2023-07-07T04:02:33.456 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.640662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197591.log 2023-07-07T04:02:33.456 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.640662.log.gz 2023-07-07T04:02:33.456 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.337067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111673.log 2023-07-07T04:02:33.456 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337067.log.gz 2023-07-07T04:02:33.456 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.197591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340946.log 2023-07-07T04:02:33.457 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197591.log.gz 2023-07-07T04:02:33.457 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397276.log 2023-07-07T04:02:33.457 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.340946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646238.log 2023-07-07T04:02:33.457 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340946.log.gz 2023-07-07T04:02:33.457 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.397276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.760683.log 2023-07-07T04:02:33.457 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.397276.log.gz 2023-07-07T04:02:33.458 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.646238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634266.log 2023-07-07T04:02:33.458 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646238.log.gz 2023-07-07T04:02:33.458 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.760683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266648.log 2023-07-07T04:02:33.458 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.760683.log.gz 2023-07-07T04:02:33.458 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.634266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111995.log 2023-07-07T04:02:33.459 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634266.log.gz 2023-07-07T04:02:33.459 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.266648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.760966.log 2023-07-07T04:02:33.459 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266648.log.gz 2023-07-07T04:02:33.459 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335167.log 2023-07-07T04:02:33.459 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111995.log: /var/log/ceph/ceph-client.admin.760966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.942440.log 2023-07-07T04:02:33.460 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.760966.log.gz 2023-07-07T04:02:33.460 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.335167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197380.log 2023-07-07T04:02:33.460 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335167.log.gz 2023-07-07T04:02:33.460 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.942440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.809223.log 2023-07-07T04:02:33.460 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.197380.log: 87.8% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.942440.log.gz -- replaced with /var/log/ceph/ceph-client.admin.197380.log.gz 2023-07-07T04:02:33.460 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:33.461 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281064.log 2023-07-07T04:02:33.461 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.809223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681706.log 2023-07-07T04:02:33.461 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.809223.log.gz 2023-07-07T04:02:33.461 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.281064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420019.log 2023-07-07T04:02:33.461 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281064.log.gz 2023-07-07T04:02:33.462 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.681706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657858.log 2023-07-07T04:02:33.462 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681706.log.gz 2023-07-07T04:02:33.462 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.420019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.711449.log 2023-07-07T04:02:33.462 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.420019.log.gz 2023-07-07T04:02:33.462 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.657858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163381.log 2023-07-07T04:02:33.463 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.657858.log.gz 2023-07-07T04:02:33.463 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.711449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320753.log 2023-07-07T04:02:33.463 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.711449.log.gz 2023-07-07T04:02:33.463 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.163381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163381.log.gz 2023-07-07T04:02:33.463 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634484.log 2023-07-07T04:02:33.463 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.320753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190543.log 2023-07-07T04:02:33.464 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320753.log.gz 2023-07-07T04:02:33.464 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.634484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273625.log 2023-07-07T04:02:33.464 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634484.log.gz 2023-07-07T04:02:33.464 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.190543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.800995.log 2023-07-07T04:02:33.464 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190543.log.gz 2023-07-07T04:02:33.465 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.273625.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.273625.log.gz-- 2023-07-07T04:02:33.465 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.698678.log 2023-07-07T04:02:33.465 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.800995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362273.log 2023-07-07T04:02:33.465 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.800995.log.gz 2023-07-07T04:02:33.465 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353865.log 2023-07-07T04:02:33.466 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.698678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.698678.log.gz 2023-07-07T04:02:33.466 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.362273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362273.log.gz 2023-07-07T04:02:33.466 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376758.log 2023-07-07T04:02:33.466 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111673.log.gz 2023-07-07T04:02:33.466 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111995.log.gz 2023-07-07T04:02:33.466 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.937072.log 2023-07-07T04:02:33.467 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.353865.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353865.log.gz 2023-07-07T04:02:33.467 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.376758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674151.log 2023-07-07T04:02:33.467 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.376758.log.gz 2023-07-07T04:02:33.467 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.937072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107794.log 2023-07-07T04:02:33.467 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.937072.log.gz 2023-07-07T04:02:33.468 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.674151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400135.log 2023-07-07T04:02:33.468 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674151.log.gz 2023-07-07T04:02:33.468 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341025.log 2023-07-07T04:02:33.468 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.400135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332389.log 2023-07-07T04:02:33.468 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.400135.log.gz 2023-07-07T04:02:33.468 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.341025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253035.log 2023-07-07T04:02:33.469 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341025.log.gz 2023-07-07T04:02:33.469 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.332389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446386.log 2023-07-07T04:02:33.469 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332389.log.gz 2023-07-07T04:02:33.469 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.253035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.827603.log 2023-07-07T04:02:33.469 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253035.log.gz 2023-07-07T04:02:33.470 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.446386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310531.log 2023-07-07T04:02:33.470 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.446386.log.gz 2023-07-07T04:02:33.470 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.827603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270202.log 2023-07-07T04:02:33.470 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.827603.log.gz 2023-07-07T04:02:33.470 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.310531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331817.log 2023-07-07T04:02:33.471 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310531.log.gz 2023-07-07T04:02:33.471 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.270202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708171.log 2023-07-07T04:02:33.471 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270202.log.gz 2023-07-07T04:02:33.471 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.331817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.640197.log 2023-07-07T04:02:33.471 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331817.log.gz 2023-07-07T04:02:33.471 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.708171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295922.log 2023-07-07T04:02:33.472 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708171.log.gz 2023-07-07T04:02:33.472 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.640197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118386.log 2023-07-07T04:02:33.472 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.640197.log.gz 2023-07-07T04:02:33.472 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.295922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697710.log 2023-07-07T04:02:33.472 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.295922.log.gz 2023-07-07T04:02:33.473 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447333.log 2023-07-07T04:02:33.473 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.697710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205017.log 2023-07-07T04:02:33.473 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697710.log.gz 2023-07-07T04:02:33.473 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.447333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266741.log 2023-07-07T04:02:33.473 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.447333.log.gz 2023-07-07T04:02:33.473 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.205017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389470.log 2023-07-07T04:02:33.474 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205017.log.gz 2023-07-07T04:02:33.474 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.266741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710583.log 2023-07-07T04:02:33.474 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266741.log.gz 2023-07-07T04:02:33.474 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.389470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474484.log 2023-07-07T04:02:33.474 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.389470.log.gz 2023-07-07T04:02:33.475 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.710583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.942484.log 2023-07-07T04:02:33.475 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710583.log.gz 2023-07-07T04:02:33.475 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.474484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.930297.log 2023-07-07T04:02:33.475 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.474484.log.gz 2023-07-07T04:02:33.475 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.942484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115507.log 2023-07-07T04:02:33.476 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.942484.log.gz 2023-07-07T04:02:33.476 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.930297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288719.log 2023-07-07T04:02:33.476 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.930297.log.gz 2023-07-07T04:02:33.476 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118823.log 2023-07-07T04:02:33.476 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.288719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.775279.log 2023-07-07T04:02:33.476 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288719.log.gz 2023-07-07T04:02:33.477 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707689.log 2023-07-07T04:02:33.477 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.775279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641978.log 2023-07-07T04:02:33.477 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.775279.log.gz 2023-07-07T04:02:33.477 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.707689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314004.log 2023-07-07T04:02:33.477 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707689.log.gz 2023-07-07T04:02:33.478 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.641978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328217.log 2023-07-07T04:02:33.478 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.641978.log.gz 2023-07-07T04:02:33.478 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.314004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.940992.log 2023-07-07T04:02:33.478 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314004.log.gz 2023-07-07T04:02:33.479 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.328217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.942255.log 2023-07-07T04:02:33.479 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328217.log.gz 2023-07-07T04:02:33.479 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.940992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320832.log 2023-07-07T04:02:33.479 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.940992.log.gz 2023-07-07T04:02:33.479 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.942255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350422.log 2023-07-07T04:02:33.480 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.320832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374617.log 2023-07-07T04:02:33.480 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.942255.log.gz 2023-07-07T04:02:33.480 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320832.log.gz 2023-07-07T04:02:33.480 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.350422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370424.log 2023-07-07T04:02:33.480 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350422.log.gz 2023-07-07T04:02:33.480 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.374617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294283.log 2023-07-07T04:02:33.481 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.374617.log.gz 2023-07-07T04:02:33.481 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.370424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207491.log 2023-07-07T04:02:33.481 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.370424.log.gz 2023-07-07T04:02:33.481 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.294283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632236.log 2023-07-07T04:02:33.481 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294283.log.gz 2023-07-07T04:02:33.482 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307605.log 2023-07-07T04:02:33.482 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.207491.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207491.log.gz 2023-07-07T04:02:33.482 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.632236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170727.log 2023-07-07T04:02:33.482 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632236.log.gz 2023-07-07T04:02:33.482 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.307605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316775.log 2023-07-07T04:02:33.483 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307605.log.gz 2023-07-07T04:02:33.483 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.170727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193650.log 2023-07-07T04:02:33.483 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170727.log.gz 2023-07-07T04:02:33.483 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.316775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110477.log 2023-07-07T04:02:33.483 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316775.log.gz 2023-07-07T04:02:33.483 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.193650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.640569.log 2023-07-07T04:02:33.484 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193650.log.gz 2023-07-07T04:02:33.484 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404450.log 2023-07-07T04:02:33.484 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.640569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.931361.log 2023-07-07T04:02:33.484 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.640569.log.gz 2023-07-07T04:02:33.484 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.404450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654463.log 2023-07-07T04:02:33.485 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.404450.log.gz 2023-07-07T04:02:33.485 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.931361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402510.log 2023-07-07T04:02:33.485 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.931361.log.gz 2023-07-07T04:02:33.485 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.654463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272564.log 2023-07-07T04:02:33.485 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654463.log.gz 2023-07-07T04:02:33.486 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.402510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422999.log 2023-07-07T04:02:33.486 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.402510.log.gz 2023-07-07T04:02:33.486 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.272564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633678.log 2023-07-07T04:02:33.486 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272564.log.gz 2023-07-07T04:02:33.486 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.422999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480519.log 2023-07-07T04:02:33.486 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.422999.log.gz 2023-07-07T04:02:33.487 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.633678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174449.log 2023-07-07T04:02:33.487 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633678.log.gz 2023-07-07T04:02:33.487 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.480519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.119452.log 2023-07-07T04:02:33.487 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.480519.log.gz 2023-07-07T04:02:33.487 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.174449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384962.log 2023-07-07T04:02:33.488 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174449.log.gz 2023-07-07T04:02:33.488 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.119452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258837.log 2023-07-07T04:02:33.488 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.119452.log.gz 2023-07-07T04:02:33.488 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.384962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688050.log 2023-07-07T04:02:33.488 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384962.log.gz 2023-07-07T04:02:33.489 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.258837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685394.log 2023-07-07T04:02:33.489 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258837.log.gz 2023-07-07T04:02:33.489 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.688050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.705182.log 2023-07-07T04:02:33.489 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688050.log.gz 2023-07-07T04:02:33.489 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.685394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399205.log 2023-07-07T04:02:33.489 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685394.log.gz 2023-07-07T04:02:33.490 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.705182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.936589.log 2023-07-07T04:02:33.490 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.705182.log.gz 2023-07-07T04:02:33.490 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.399205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109677.log 2023-07-07T04:02:33.490 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399205.log.gz 2023-07-07T04:02:33.490 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.936589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255347.log 2023-07-07T04:02:33.491 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.936589.log.gz 2023-07-07T04:02:33.491 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249038.log 2023-07-07T04:02:33.491 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.255347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404741.log 2023-07-07T04:02:33.491 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255347.log.gz 2023-07-07T04:02:33.491 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.249038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.797757.log 2023-07-07T04:02:33.491 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249038.log.gz 2023-07-07T04:02:33.492 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.404741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292471.log 2023-07-07T04:02:33.492 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.404741.log.gz 2023-07-07T04:02:33.492 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.797757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114669.log 2023-07-07T04:02:33.492 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.797757.log.gz 2023-07-07T04:02:33.492 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.292471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348540.log 2023-07-07T04:02:33.493 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292471.log.gz 2023-07-07T04:02:33.493 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.941176.log 2023-07-07T04:02:33.493 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.348540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383965.log 2023-07-07T04:02:33.493 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348540.log.gz 2023-07-07T04:02:33.493 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.941176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347016.log 2023-07-07T04:02:33.494 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.941176.log.gz 2023-07-07T04:02:33.494 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.383965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692732.log 2023-07-07T04:02:33.494 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383965.log.gz 2023-07-07T04:02:33.494 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.347016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337794.log 2023-07-07T04:02:33.494 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347016.log.gz 2023-07-07T04:02:33.494 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.692732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387563.log 2023-07-07T04:02:33.495 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692732.log.gz 2023-07-07T04:02:33.495 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.337794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474563.log 2023-07-07T04:02:33.495 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337794.log.gz 2023-07-07T04:02:33.495 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.387563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654176.log 2023-07-07T04:02:33.495 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387563.log.gz 2023-07-07T04:02:33.496 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.474563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.941130.log 2023-07-07T04:02:33.496 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.474563.log.gz 2023-07-07T04:02:33.496 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.654176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704128.log 2023-07-07T04:02:33.496 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654176.log.gz 2023-07-07T04:02:33.496 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.941130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343603.log 2023-07-07T04:02:33.497 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.941130.log.gz 2023-07-07T04:02:33.497 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.704128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311529.log 2023-07-07T04:02:33.497 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704128.log.gz 2023-07-07T04:02:33.497 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.343603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339496.log 2023-07-07T04:02:33.497 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343603.log.gz 2023-07-07T04:02:33.497 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.311529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.808900.log 2023-07-07T04:02:33.498 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311529.log.gz 2023-07-07T04:02:33.498 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.339496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683578.log 2023-07-07T04:02:33.498 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339496.log.gz 2023-07-07T04:02:33.498 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.808900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709167.log 2023-07-07T04:02:33.498 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.808900.log.gz 2023-07-07T04:02:33.499 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.683578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475949.log 2023-07-07T04:02:33.499 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683578.log.gz 2023-07-07T04:02:33.499 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.709167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111090.log 2023-07-07T04:02:33.499 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709167.log.gz 2023-07-07T04:02:33.499 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.475949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310020.log 2023-07-07T04:02:33.500 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.475949.log.gz 2023-07-07T04:02:33.500 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349359.log 2023-07-07T04:02:33.500 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.310020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635998.log 2023-07-07T04:02:33.500 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310020.log.gz 2023-07-07T04:02:33.500 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.107794.log.gz 2023-07-07T04:02:33.500 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.349359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195320.log 2023-07-07T04:02:33.501 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349359.log.gz 2023-07-07T04:02:33.501 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.635998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112409.log 2023-07-07T04:02:33.501 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635998.log.gz 2023-07-07T04:02:33.501 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.195320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321564.log 2023-07-07T04:02:33.501 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118386.log.gz 2023-07-07T04:02:33.502 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195320.log.gz 2023-07-07T04:02:33.502 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112409.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-07-07T04:02:33.502 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.321564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343820.log 2023-07-07T04:02:33.502 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321564.log.gz 2023-07-07T04:02:33.502 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423407.log 2023-07-07T04:02:33.502 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.343820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.939606.log 2023-07-07T04:02:33.503 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343820.log.gz 2023-07-07T04:02:33.503 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.423407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.780494.log 2023-07-07T04:02:33.503 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.423407.log.gz 2023-07-07T04:02:33.503 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.939606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446400.log 2023-07-07T04:02:33.503 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.939606.log.gz 2023-07-07T04:02:33.504 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.780494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278456.log 2023-07-07T04:02:33.504 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.780494.log.gz 2023-07-07T04:02:33.504 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.446400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292981.log 2023-07-07T04:02:33.504 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.446400.log.gz 2023-07-07T04:02:33.504 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.278456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.797246.log 2023-07-07T04:02:33.505 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278456.log.gz 2023-07-07T04:02:33.505 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.292981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218118.log 2023-07-07T04:02:33.505 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292981.log.gz 2023-07-07T04:02:33.505 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.797246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689534.log 2023-07-07T04:02:33.505 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.797246.log.gz 2023-07-07T04:02:33.505 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.218118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627931.log 2023-07-07T04:02:33.506 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218118.log.gz 2023-07-07T04:02:33.506 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.689534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.780002.log 2023-07-07T04:02:33.506 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689534.log.gz 2023-07-07T04:02:33.506 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.627931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.821400.log 2023-07-07T04:02:33.506 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627931.log.gz 2023-07-07T04:02:33.507 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.780002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158877.log 2023-07-07T04:02:33.507 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.780002.log.gz 2023-07-07T04:02:33.507 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.821400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672029.log 2023-07-07T04:02:33.507 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.821400.log.gz 2023-07-07T04:02:33.507 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.158877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120441.log 2023-07-07T04:02:33.507 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158877.log.gz 2023-07-07T04:02:33.508 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.672029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.781025.log 2023-07-07T04:02:33.508 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672029.log.gz 2023-07-07T04:02:33.508 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.120441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318293.log 2023-07-07T04:02:33.508 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.781025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.774375.log 2023-07-07T04:02:33.508 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.781025.log.gz 2023-07-07T04:02:33.509 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.318293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314700.log 2023-07-07T04:02:33.509 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318293.log.gz 2023-07-07T04:02:33.509 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199434.log 2023-07-07T04:02:33.509 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.774375.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.774375.log.gz 2023-07-07T04:02:33.509 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.314700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414838.log 2023-07-07T04:02:33.510 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314700.log.gz 2023-07-07T04:02:33.510 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.199434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199434.log.gz 2023-07-07T04:02:33.510 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.939026.log 2023-07-07T04:02:33.510 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.414838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.936668.log 2023-07-07T04:02:33.510 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.414838.log.gz 2023-07-07T04:02:33.510 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.939026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.575921.log 2023-07-07T04:02:33.511 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.939026.log.gz 2023-07-07T04:02:33.511 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.936668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654394.log 2023-07-07T04:02:33.511 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.936668.log.gz 2023-07-07T04:02:33.511 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.575921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208056.log 2023-07-07T04:02:33.511 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.575921.log.gz 2023-07-07T04:02:33.512 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.654394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402986.log 2023-07-07T04:02:33.512 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654394.log.gz 2023-07-07T04:02:33.512 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.208056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218197.log 2023-07-07T04:02:33.512 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208056.log.gz 2023-07-07T04:02:33.512 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.402986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.776741.log 2023-07-07T04:02:33.513 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.402986.log.gz 2023-07-07T04:02:33.513 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.218197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218197.log.gz 2023-07-07T04:02:33.513 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248561.log 2023-07-07T04:02:33.513 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.776741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272073.log 2023-07-07T04:02:33.513 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.776741.log.gz 2023-07-07T04:02:33.513 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.248561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248561.log.gz 2023-07-07T04:02:33.514 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369991.log 2023-07-07T04:02:33.514 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.272073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327668.log 2023-07-07T04:02:33.514 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272073.log.gz 2023-07-07T04:02:33.514 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.369991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.369991.log.gz 2023-07-07T04:02:33.514 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702693.log 2023-07-07T04:02:33.515 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.327668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275510.log 2023-07-07T04:02:33.515 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327668.log.gz 2023-07-07T04:02:33.515 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.702693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.813983.log 2023-07-07T04:02:33.515 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702693.log.gz 2023-07-07T04:02:33.515 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.275510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321858.log 2023-07-07T04:02:33.515 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275510.log.gz 2023-07-07T04:02:33.516 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.813983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.759153.log 2023-07-07T04:02:33.516 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.813983.log.gz 2023-07-07T04:02:33.516 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.321858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348848.log 2023-07-07T04:02:33.516 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321858.log.gz 2023-07-07T04:02:33.516 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.759153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680054.log 0.0% 2023-07-07T04:02:33.517 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.759153.log.gz 2023-07-07T04:02:33.517 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115507.log.gz 2023-07-07T04:02:33.517 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.348848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348848.log.gz 2023-07-07T04:02:33.517 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421976.log 2023-07-07T04:02:33.517 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.680054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672501.log 2023-07-07T04:02:33.518 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680054.log.gz 2023-07-07T04:02:33.518 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.421976.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.421976.log.gz 2023-07-07T04:02:33.518 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251290.log 2023-07-07T04:02:33.518 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.672501.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.672501.log.gz--verbose 2023-07-07T04:02:33.518 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.380807.log 2023-07-07T04:02:33.518 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118823.log.gz 2023-07-07T04:02:33.519 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.251290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247680.log 2023-07-07T04:02:33.519 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251290.log.gz 2023-07-07T04:02:33.519 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.380807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674244.log 2023-07-07T04:02:33.519 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.380807.log.gz 2023-07-07T04:02:33.519 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.247680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110042.log 2023-07-07T04:02:33.520 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247680.log.gz 2023-07-07T04:02:33.520 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110477.log.gz 2023-07-07T04:02:33.520 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.674244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364725.log 2023-07-07T04:02:33.520 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674244.log.gz 2023-07-07T04:02:33.520 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354946.log 2023-07-07T04:02:33.521 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.364725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695080.log 2023-07-07T04:02:33.521 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.364725.log.gz 2023-07-07T04:02:33.521 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.354946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.808364.log 2023-07-07T04:02:33.521 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354946.log.gz 2023-07-07T04:02:33.521 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.695080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695080.log.gz 2023-07-07T04:02:33.521 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292457.log 2023-07-07T04:02:33.522 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.808364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338122.log 2023-07-07T04:02:33.522 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.808364.log.gz 2023-07-07T04:02:33.522 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.292457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365787.log 2023-07-07T04:02:33.522 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292457.log.gz 2023-07-07T04:02:33.522 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.338122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372568.log 2023-07-07T04:02:33.523 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338122.log.gz 2023-07-07T04:02:33.523 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.365787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365787.log.gz 2023-07-07T04:02:33.523 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694803.log 2023-07-07T04:02:33.523 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.372568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192467.log 2023-07-07T04:02:33.523 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372568.log.gz 2023-07-07T04:02:33.523 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.694803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694803.log.gz 2023-07-07T04:02:33.524 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403861.log 2023-07-07T04:02:33.524 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.192467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193356.log 2023-07-07T04:02:33.524 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192467.log.gz 2023-07-07T04:02:33.524 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.403861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.403861.log.gz 2023-07-07T04:02:33.524 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.941766.log 2023-07-07T04:02:33.525 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.193356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315924.log 2023-07-07T04:02:33.525 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193356.log.gz 2023-07-07T04:02:33.525 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.941766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.929883.log 2023-07-07T04:02:33.525 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.941766.log.gz 2023-07-07T04:02:33.525 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.315924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386559.log 2023-07-07T04:02:33.526 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315924.log.gz 2023-07-07T04:02:33.526 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.929883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.929883.log.gz 2023-07-07T04:02:33.526 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301018.log 2023-07-07T04:02:33.526 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.386559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415056.log 2023-07-07T04:02:33.526 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386559.log.gz 2023-07-07T04:02:33.526 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.301018.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301018.log.gz 2023-07-07T04:02:33.527 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.643692.log 2023-07-07T04:02:33.527 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.415056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280038.log 2023-07-07T04:02:33.527 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.415056.log.gz 2023-07-07T04:02:33.527 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.643692.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.643692.log.gz 2023-07-07T04:02:33.527 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407004.log 2023-07-07T04:02:33.528 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.280038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293182.log 2023-07-07T04:02:33.528 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280038.log.gz 2023-07-07T04:02:33.528 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.407004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407004.log.gz 2023-07-07T04:02:33.528 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372554.log 2023-07-07T04:02:33.528 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.293182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.661388.log 2023-07-07T04:02:33.529 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293182.log.gz 2023-07-07T04:02:33.529 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.372554.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372554.log.gz 2023-07-07T04:02:33.529 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112133.log 2023-07-07T04:02:33.529 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.661388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285717.log 2023-07-07T04:02:33.529 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.661388.log.gz 2023-07-07T04:02:33.529 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322061.log 2023-07-07T04:02:33.530 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.285717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212073.log 2023-07-07T04:02:33.530 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285717.log.gz 2023-07-07T04:02:33.530 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.322061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673659.log 2023-07-07T04:02:33.530 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322061.log.gz 2023-07-07T04:02:33.530 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.212073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388506.log 2023-07-07T04:02:33.531 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212073.log.gz 2023-07-07T04:02:33.531 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.673659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673659.log.gz 2023-07-07T04:02:33.531 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.669301.log 2023-07-07T04:02:33.531 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.388506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306556.log 2023-07-07T04:02:33.531 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.388506.log.gz 2023-07-07T04:02:33.532 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.669301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278086.log 2023-07-07T04:02:33.532 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.669301.log.gz 2023-07-07T04:02:33.532 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.306556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624289.log 2023-07-07T04:02:33.532 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306556.log.gz 2023-07-07T04:02:33.532 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.278086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211575.log 2023-07-07T04:02:33.532 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278086.log.gz 2023-07-07T04:02:33.533 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.624289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111719.log 2023-07-07T04:02:33.533 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624289.log.gz 2023-07-07T04:02:33.533 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.211575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211575.log.gz 2023-07-07T04:02:33.533 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.653754.log 2023-07-07T04:02:33.533 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260593.log 2023-07-07T04:02:33.534 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.653754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117084.log 2023-07-07T04:02:33.534 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.653754.log.gz 2023-07-07T04:02:33.534 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.260593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216663.log 2023-07-07T04:02:33.534 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260593.log.gz 2023-07-07T04:02:33.534 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.642919.log 2023-07-07T04:02:33.535 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.216663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263044.log 2023-07-07T04:02:33.535 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216663.log.gz 2023-07-07T04:02:33.535 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.642919.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.642919.log.gz 2023-07-07T04:02:33.535 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415589.log 2023-07-07T04:02:33.535 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.263044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.804369.log 2023-07-07T04:02:33.535 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263044.log.gz 2023-07-07T04:02:33.536 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.415589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.415589.log.gz 2023-07-07T04:02:33.536 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262584.log 2023-07-07T04:02:33.536 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.804369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402431.log 2023-07-07T04:02:33.536 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.804369.log.gz 2023-07-07T04:02:33.536 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.262584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262584.log.gz 2023-07-07T04:02:33.537 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336988.log 2023-07-07T04:02:33.537 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.402431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170190.log 2023-07-07T04:02:33.537 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.402431.log.gz 2023-07-07T04:02:33.537 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.336988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680359.log 2023-07-07T04:02:33.537 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336988.log.gz 2023-07-07T04:02:33.537 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.170190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314497.log 2023-07-07T04:02:33.538 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170190.log.gz 2023-07-07T04:02:33.538 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.680359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680359.log.gz 2023-07-07T04:02:33.538 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190464.log 2023-07-07T04:02:33.538 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.314497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421015.log 2023-07-07T04:02:33.538 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314497.log.gz 2023-07-07T04:02:33.539 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.190464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410897.log 2023-07-07T04:02:33.539 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190464.log.gz 2023-07-07T04:02:33.539 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.421015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.421015.log.gz 2023-07-07T04:02:33.539 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.797975.log 2023-07-07T04:02:33.539 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.410897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291651.log 2023-07-07T04:02:33.539 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410897.log.gz 2023-07-07T04:02:33.540 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.797975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.797975.log.gz 2023-07-07T04:02:33.540 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314404.log 2023-07-07T04:02:33.540 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.291651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336214.log 2023-07-07T04:02:33.540 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291651.log.gz 2023-07-07T04:02:33.540 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.314404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314404.log.gz 2023-07-07T04:02:33.541 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191410.log 2023-07-07T04:02:33.541 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.336214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.761470.log 2023-07-07T04:02:33.541 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336214.log.gz 2023-07-07T04:02:33.541 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.191410.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191410.log.gz 2023-07-07T04:02:33.541 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311097.log 2023-07-07T04:02:33.542 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.761470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657582.log 2023-07-07T04:02:33.542 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.761470.log.gz 2023-07-07T04:02:33.542 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.311097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311097.log.gz 2023-07-07T04:02:33.542 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398661.log 2023-07-07T04:02:33.542 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.657582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116614.log 2023-07-07T04:02:33.542 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.657582.log.gz 2023-07-07T04:02:33.543 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.398661.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.398661.log.gz 2023-07-07T04:02:33.543 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412399.log 2023-07-07T04:02:33.543 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395752.log 2023-07-07T04:02:33.543 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.412399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683203.log 2023-07-07T04:02:33.543 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412399.log.gz 2023-07-07T04:02:33.544 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.395752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259803.log 2023-07-07T04:02:33.544 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395752.log.gz 2023-07-07T04:02:33.544 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.683203.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683203.log.gz 2023-07-07T04:02:33.544 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372260.log 2023-07-07T04:02:33.544 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.259803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196872.log 2023-07-07T04:02:33.545 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259803.log.gz 2023-07-07T04:02:33.545 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.372260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372260.log.gz 2023-07-07T04:02:33.545 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281993.log 2023-07-07T04:02:33.545 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.196872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.800188.log 2023-07-07T04:02:33.545 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196872.log.gz 2023-07-07T04:02:33.545 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.281993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281993.log.gz 2023-07-07T04:02:33.546 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474786.log 2023-07-07T04:02:33.546 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.800188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115334.log 2023-07-07T04:02:33.546 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.800188.log.gz 2023-07-07T04:02:33.546 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.474786.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.474786.log.gz 2023-07-07T04:02:33.546 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341560.log 2023-07-07T04:02:33.547 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293261.log 2023-07-07T04:02:33.547 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.341560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.669084.log 2023-07-07T04:02:33.547 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341560.log.gz 2023-07-07T04:02:33.547 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.293261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316310.log 2023-07-07T04:02:33.547 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293261.log.gz 2023-07-07T04:02:33.547 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.669084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.669084.log.gz 2023-07-07T04:02:33.548 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710161.log 2023-07-07T04:02:33.548 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.316310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344026.log 2023-07-07T04:02:33.548 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316310.log.gz 2023-07-07T04:02:33.548 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.710161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710161.log.gz 2023-07-07T04:02:33.548 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631379.log 2023-07-07T04:02:33.549 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.344026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208042.log 2023-07-07T04:02:33.549 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344026.log.gz 2023-07-07T04:02:33.549 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.631379.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109677.log.gz 2023-07-07T04:02:33.549 INFO:teuthology.orchestra.run.smithi006.stderr:gzip 88.1%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.112409.log.gz-- 2023-07-07T04:02:33.549 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.412915.log 2023-07-07T04:02:33.550 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114669.log.gz 2023-07-07T04:02:33.550 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.631379.log.gz 87.9% 2023-07-07T04:02:33.550 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.111090.log.gz 2023-07-07T04:02:33.550 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.208042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208042.log.gz 2023-07-07T04:02:33.550 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.117084.log.gz 2023-07-07T04:02:33.550 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112133.log.gz 2023-07-07T04:02:33.551 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110042.log.gz 2023-07-07T04:02:33.551 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111719.log.gz 2023-07-07T04:02:33.551 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.412915.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412915.log.gz 2023-07-07T04:02:33.551 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120441.log.gz 2023-07-07T04:02:33.551 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345215.log 2023-07-07T04:02:33.552 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341467.log 2023-07-07T04:02:33.552 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.345215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.805608.log 2023-07-07T04:02:33.552 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345215.log.gz 2023-07-07T04:02:33.552 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.341467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274607.log 2023-07-07T04:02:33.552 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341467.log.gz 2023-07-07T04:02:33.553 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.805608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110723.log 2023-07-07T04:02:33.553 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.805608.log.gz 2023-07-07T04:02:33.553 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.274607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197076.log 2023-07-07T04:02:33.553 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274607.log.gz 2023-07-07T04:02:33.553 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646035.log 2023-07-07T04:02:33.553 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.197076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696810.log 2023-07-07T04:02:33.554 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197076.log.gz 2023-07-07T04:02:33.554 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.646035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480440.log 2023-07-07T04:02:33.554 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646035.log.gz 2023-07-07T04:02:33.554 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.696810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254759.log 2023-07-07T04:02:33.554 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696810.log.gz 2023-07-07T04:02:33.555 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.480440.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.480440.log.gz-- 2023-07-07T04:02:33.555 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.252335.log 2023-07-07T04:02:33.555 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.254759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343290.log 2023-07-07T04:02:33.555 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254759.log.gz 2023-07-07T04:02:33.555 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.252335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460490.log 2023-07-07T04:02:33.555 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252335.log.gz 2023-07-07T04:02:33.556 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.343290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620196.log 2023-07-07T04:02:33.556 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343290.log.gz 2023-07-07T04:02:33.556 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.460490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175384.log 2023-07-07T04:02:33.556 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.460490.log.gz 2023-07-07T04:02:33.556 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477963.log 2023-07-07T04:02:33.557 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.620196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620196.log.gz 2023-07-07T04:02:33.557 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299200.log 2023-07-07T04:02:33.557 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.175384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175384.log.gz 2023-07-07T04:02:33.557 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.477963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.477963.log.gz 2023-07-07T04:02:33.557 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408910.log 2023-07-07T04:02:33.558 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.299200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195399.log 2023-07-07T04:02:33.558 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299200.log.gz 2023-07-07T04:02:33.558 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.408910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283884.log 2023-07-07T04:02:33.558 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408910.log.gz 2023-07-07T04:02:33.558 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.195399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195399.log.gz 2023-07-07T04:02:33.558 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655077.log 2023-07-07T04:02:33.559 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116614.log.gz 2023-07-07T04:02:33.559 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406710.log 2023-07-07T04:02:33.559 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.283884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283884.log.gz 2023-07-07T04:02:33.559 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.655077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.706899.log 2023-07-07T04:02:33.559 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655077.log.gz 2023-07-07T04:02:33.560 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.406710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461026.log 2023-07-07T04:02:33.560 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406710.log.gz 2023-07-07T04:02:33.560 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.706899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.706899.log.gz 2023-07-07T04:02:33.560 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.801506.log 2023-07-07T04:02:33.560 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.461026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340571.log 2023-07-07T04:02:33.560 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.461026.log.gz 2023-07-07T04:02:33.561 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.801506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328728.log 2023-07-07T04:02:33.561 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.801506.log.gz 2023-07-07T04:02:33.561 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.340571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408924.log 2023-07-07T04:02:33.561 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340571.log.gz 2023-07-07T04:02:33.561 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.328728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708358.log 2023-07-07T04:02:33.562 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328728.log.gz 2023-07-07T04:02:33.562 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.408924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707110.log 2023-07-07T04:02:33.562 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408924.log.gz 2023-07-07T04:02:33.562 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.708358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372057.log 2023-07-07T04:02:33.562 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708358.log.gz 2023-07-07T04:02:33.562 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.707110.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.707110.log.gz 2023-07-07T04:02:33.563 INFO:teuthology.orchestra.run.smithi006.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.802325.log 2023-07-07T04:02:33.563 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.372057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197287.log 2023-07-07T04:02:33.563 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372057.log.gz 2023-07-07T04:02:33.563 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.802325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375469.log 2023-07-07T04:02:33.563 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.802325.log.gz 2023-07-07T04:02:33.564 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.197287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271661.log 2023-07-07T04:02:33.564 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197287.log.gz 2023-07-07T04:02:33.564 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.375469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117360.log 2023-07-07T04:02:33.564 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.375469.log.gz 2023-07-07T04:02:33.564 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.271661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222628.log 2023-07-07T04:02:33.565 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271661.log.gz 2023-07-07T04:02:33.565 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371541.log 2023-07-07T04:02:33.565 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.222628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178660.log 2023-07-07T04:02:33.565 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222628.log.gz 2023-07-07T04:02:33.565 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.371541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332914.log 2023-07-07T04:02:33.566 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.371541.log.gz 2023-07-07T04:02:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.178660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.941444.log 2023-07-07T04:02:33.566 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178660.log.gz 2023-07-07T04:02:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.332914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385673.log 2023-07-07T04:02:33.566 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332914.log.gz 2023-07-07T04:02:33.566 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.941444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411397.log 2023-07-07T04:02:33.567 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.941444.log.gz 2023-07-07T04:02:33.567 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.385673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.763071.log 2023-07-07T04:02:33.567 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385673.log.gz 2023-07-07T04:02:33.567 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.411397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672108.log 2023-07-07T04:02:33.567 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411397.log.gz 2023-07-07T04:02:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.763071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.809757.log 2023-07-07T04:02:33.568 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.763071.log.gz 2023-07-07T04:02:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.672108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356494.log 2023-07-07T04:02:33.568 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672108.log.gz 2023-07-07T04:02:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.809757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694204.log 2023-07-07T04:02:33.569 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.809757.log.gz 2023-07-07T04:02:33.569 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.356494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297686.log 2023-07-07T04:02:33.569 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356494.log.gz 2023-07-07T04:02:33.569 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.694204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281281.log 2023-07-07T04:02:33.569 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694204.log.gz 2023-07-07T04:02:33.569 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.297686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282583.log 2023-07-07T04:02:33.570 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.297686.log.gz 2023-07-07T04:02:33.570 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.281281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378365.log 2023-07-07T04:02:33.570 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281281.log.gz 2023-07-07T04:02:33.570 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.282583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620687.log 2023-07-07T04:02:33.570 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282583.log.gz 2023-07-07T04:02:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.378365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274116.log 2023-07-07T04:02:33.571 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.378365.log.gz 2023-07-07T04:02:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.620687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393259.log 2023-07-07T04:02:33.571 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620687.log.gz 2023-07-07T04:02:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.274116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.643489.log 2023-07-07T04:02:33.572 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274116.log.gz 2023-07-07T04:02:33.572 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.393259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175039.log 2023-07-07T04:02:33.572 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393259.log.gz 2023-07-07T04:02:33.572 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.643489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273639.log 2023-07-07T04:02:33.572 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.643489.log.gz 2023-07-07T04:02:33.572 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.175039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281792.log 2023-07-07T04:02:33.573 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175039.log.gz 2023-07-07T04:02:33.573 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.273639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686183.log 2023-07-07T04:02:33.573 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273639.log.gz 2023-07-07T04:02:33.573 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.281792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.937166.log 2023-07-07T04:02:33.573 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281792.log.gz 2023-07-07T04:02:33.574 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.686183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624275.log 2023-07-07T04:02:33.574 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686183.log.gz 2023-07-07T04:02:33.574 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.937166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117923.log 2023-07-07T04:02:33.574 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.937166.log.gz 2023-07-07T04:02:33.574 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.624275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807141.log 2023-07-07T04:02:33.574 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624275.log.gz 2023-07-07T04:02:33.575 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114715.log 2023-07-07T04:02:33.575 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.807141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331385.log 2023-07-07T04:02:33.575 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807141.log.gz 2023-07-07T04:02:33.575 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171230.log 2023-07-07T04:02:33.575 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.331385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243812.log 2023-07-07T04:02:33.576 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331385.log.gz 2023-07-07T04:02:33.576 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.171230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224233.log 2023-07-07T04:02:33.576 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171230.log.gz 2023-07-07T04:02:33.576 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.243812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370517.log 2023-07-07T04:02:33.576 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243812.log.gz 2023-07-07T04:02:33.577 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.224233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175599.log 2023-07-07T04:02:33.577 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224233.log.gz 2023-07-07T04:02:33.577 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.370517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427376.log 2023-07-07T04:02:33.577 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.370517.log.gz 2023-07-07T04:02:33.577 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.175599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295271.log 2023-07-07T04:02:33.577 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175599.log.gz 2023-07-07T04:02:33.578 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.427376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202182.log 2023-07-07T04:02:33.578 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.427376.log.gz 2023-07-07T04:02:33.578 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.295271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.295271.log.gz 2023-07-07T04:02:33.578 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.642448.log 2023-07-07T04:02:33.578 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.202182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355676.log 2023-07-07T04:02:33.579 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202182.log.gz 2023-07-07T04:02:33.579 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.642448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206677.log 2023-07-07T04:02:33.579 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.642448.log.gz 2023-07-07T04:02:33.579 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.355676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115871.log 2023-07-07T04:02:33.579 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355676.log.gz 2023-07-07T04:02:33.579 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.206677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.802836.log 2023-07-07T04:02:33.580 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206677.log.gz 2023-07-07T04:02:33.580 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312945.log 2023-07-07T04:02:33.580 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.802836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111463.log 2023-07-07T04:02:33.580 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.802836.log.gz 2023-07-07T04:02:33.580 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.312945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696244.log 2023-07-07T04:02:33.581 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312945.log.gz 2023-07-07T04:02:33.581 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.761667.log 2023-07-07T04:02:33.581 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.696244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166050.log 2023-07-07T04:02:33.581 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696244.log.gz 2023-07-07T04:02:33.581 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.761667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293693.log 2023-07-07T04:02:33.582 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.761667.log.gz 2023-07-07T04:02:33.582 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.166050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365694.log 2023-07-07T04:02:33.582 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166050.log.gz 2023-07-07T04:02:33.582 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.293693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293693.log.gz 2023-07-07T04:02:33.582 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446078.log 2023-07-07T04:02:33.583 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694509.log 2023-07-07T04:02:33.583 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.365694.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365694.log.gz 2023-07-07T04:02:33.583 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.446078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368196.log 2023-07-07T04:02:33.583 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.446078.log.gz 2023-07-07T04:02:33.583 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.694509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298675.log 2023-07-07T04:02:33.583 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694509.log.gz 2023-07-07T04:02:33.584 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.368196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256388.log 2023-07-07T04:02:33.584 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.368196.log.gz 2023-07-07T04:02:33.584 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.298675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.806831.log 2023-07-07T04:02:33.584 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298675.log.gz 2023-07-07T04:02:33.584 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.256388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158798.log 2023-07-07T04:02:33.585 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256388.log.gz 2023-07-07T04:02:33.585 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.806831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380058.log 2023-07-07T04:02:33.585 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.806831.log.gz 2023-07-07T04:02:33.585 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.158798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383979.log 2023-07-07T04:02:33.585 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158798.log.gz 2023-07-07T04:02:33.586 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.380058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401546.log 2023-07-07T04:02:33.586 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.380058.log.gz 2023-07-07T04:02:33.586 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.383979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623124.log 2023-07-07T04:02:33.586 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383979.log.gz 2023-07-07T04:02:33.586 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.401546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633285.log 2023-07-07T04:02:33.586 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.401546.log.gz 2023-07-07T04:02:33.587 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.623124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700313.log 2023-07-07T04:02:33.587 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623124.log.gz 2023-07-07T04:02:33.587 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.633285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245714.log 2023-07-07T04:02:33.587 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633285.log.gz 2023-07-07T04:02:33.587 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.700313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700313.log.gzgzip 2023-07-07T04:02:33.588 INFO:teuthology.orchestra.run.smithi006.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.392249.log 2023-07-07T04:02:33.588 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.245714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291744.log 2023-07-07T04:02:33.588 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245714.log.gz 2023-07-07T04:02:33.588 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.392249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223198.log 2023-07-07T04:02:33.588 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392249.log.gz 2023-07-07T04:02:33.589 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.291744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.798784.log 2023-07-07T04:02:33.589 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291744.log.gz 2023-07-07T04:02:33.589 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.223198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366350.log 2023-07-07T04:02:33.589 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223198.log.gz 2023-07-07T04:02:33.589 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.798784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.669820.log 2023-07-07T04:02:33.589 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.798784.log.gz 2023-07-07T04:02:33.590 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.366350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294794.log 2023-07-07T04:02:33.590 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366350.log.gz 2023-07-07T04:02:33.590 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.669820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690015.log 2023-07-07T04:02:33.590 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.669820.log.gz 2023-07-07T04:02:33.590 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.294794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332111.log 2023-07-07T04:02:33.591 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294794.log.gz 2023-07-07T04:02:33.591 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.690015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247587.log 2023-07-07T04:02:33.591 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690015.log.gz 2023-07-07T04:02:33.591 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.332111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285624.log 2023-07-07T04:02:33.591 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332111.log.gz 2023-07-07T04:02:33.591 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.247587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.816331.log 2023-07-07T04:02:33.592 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247587.log.gz 2023-07-07T04:02:33.592 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.285624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.815918.log 2023-07-07T04:02:33.592 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285624.log.gz 2023-07-07T04:02:33.592 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.816331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368275.log 2023-07-07T04:02:33.592 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.816331.log.gz 2023-07-07T04:02:33.593 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.815918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175322.log 2023-07-07T04:02:33.593 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.815918.log.gz 2023-07-07T04:02:33.593 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.368275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.368275.log.gzgzip 2023-07-07T04:02:33.593 INFO:teuthology.orchestra.run.smithi006.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.298689.log 2023-07-07T04:02:33.593 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.175322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401086.log 2023-07-07T04:02:33.593 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175322.log.gz 2023-07-07T04:02:33.594 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.298689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409662.log 2023-07-07T04:02:33.594 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298689.log.gz 2023-07-07T04:02:33.594 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.401086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347513.log 2023-07-07T04:02:33.594 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.401086.log.gz 2023-07-07T04:02:33.594 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.409662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702707.log 2023-07-07T04:02:33.595 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409662.log.gz 2023-07-07T04:02:33.595 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.347513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343073.log 2023-07-07T04:02:33.595 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347513.log.gz 2023-07-07T04:02:33.595 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.702707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114853.log 2023-07-07T04:02:33.595 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702707.log.gz 2023-07-07T04:02:33.596 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.343073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111461.log 2023-07-07T04:02:33.596 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343073.log.gz 2023-07-07T04:02:33.596 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291947.log 2023-07-07T04:02:33.596 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687196.log 2023-07-07T04:02:33.596 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.291947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708564.log 2023-07-07T04:02:33.596 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291947.log.gz 2023-07-07T04:02:33.597 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.687196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200022.log 2023-07-07T04:02:33.597 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687196.log.gz 2023-07-07T04:02:33.597 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.708564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671136.log 2023-07-07T04:02:33.597 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708564.log.gz 2023-07-07T04:02:33.597 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.200022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191489.log 2023-07-07T04:02:33.598 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200022.log.gz 2023-07-07T04:02:33.598 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.671136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317319.log 2023-07-07T04:02:33.598 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671136.log.gz 2023-07-07T04:02:33.598 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.191489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.764631.log 2023-07-07T04:02:33.598 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191489.log.gz 2023-07-07T04:02:33.599 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.317319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477235.log 2023-07-07T04:02:33.599 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317319.log.gz 2023-07-07T04:02:33.599 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.764631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298969.log 2023-07-07T04:02:33.599 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.764631.log.gz 2023-07-07T04:02:33.599 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.477235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333936.log 2023-07-07T04:02:33.599 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.477235.log.gz 2023-07-07T04:02:33.600 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.298969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298969.log.gz 2023-07-07T04:02:33.600 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.797166.log 2023-07-07T04:02:33.600 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.333936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323313.log 2023-07-07T04:02:33.600 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333936.log.gz 2023-07-07T04:02:33.600 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.797166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224453.log 2023-07-07T04:02:33.601 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.797166.log.gz 2023-07-07T04:02:33.601 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.323313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687678.log 2023-07-07T04:02:33.601 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323313.log.gz 2023-07-07T04:02:33.601 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.224453.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.247191.log -- replaced with /var/log/ceph/ceph-client.admin.224453.log.gz 2023-07-07T04:02:33.601 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:33.602 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.687678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222157.log 2023-07-07T04:02:33.602 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687678.log.gz 2023-07-07T04:02:33.602 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.247191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.815333.log 2023-07-07T04:02:33.602 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247191.log.gz 2023-07-07T04:02:33.602 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.222157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707203.log 2023-07-07T04:02:33.602 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222157.log.gz 2023-07-07T04:02:33.603 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.815333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404141.log 2023-07-07T04:02:33.603 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.815333.log.gz 2023-07-07T04:02:33.603 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.707203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382836.log 2023-07-07T04:02:33.603 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707203.log.gz 2023-07-07T04:02:33.603 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.404141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.802232.log 2023-07-07T04:02:33.604 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.404141.log.gz 2023-07-07T04:02:33.604 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.382836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353629.log 2023-07-07T04:02:33.604 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382836.log.gz 2023-07-07T04:02:33.604 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.802232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.661083.log 2023-07-07T04:02:33.604 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.802232.log.gz 2023-07-07T04:02:33.605 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.353629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293478.log 2023-07-07T04:02:33.605 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353629.log.gz 2023-07-07T04:02:33.605 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.661083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646252.log 2023-07-07T04:02:33.605 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.661083.log.gz 2023-07-07T04:02:33.605 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.293478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109953.log 2023-07-07T04:02:33.605 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293478.log.gz 2023-07-07T04:02:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.646252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310099.log 2023-07-07T04:02:33.606 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646252.log.gz 2023-07-07T04:02:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.800498.log 2023-07-07T04:02:33.606 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.310099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418327.log 2023-07-07T04:02:33.606 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310099.log.gz 2023-07-07T04:02:33.607 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.800498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204083.log 2023-07-07T04:02:33.607 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.800498.log.gz 2023-07-07T04:02:33.607 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.418327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416895.log 2023-07-07T04:02:33.607 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.418327.log.gz 2023-07-07T04:02:33.607 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.204083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479030.log 2023-07-07T04:02:33.608 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204083.log.gz 2023-07-07T04:02:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.416895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354932.log 2023-07-07T04:02:33.608 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.416895.log.gz 2023-07-07T04:02:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.479030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.650368.log 2023-07-07T04:02:33.608 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.479030.log.gz 2023-07-07T04:02:33.608 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.354932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319227.log 2023-07-07T04:02:33.609 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354932.log.gz 2023-07-07T04:02:33.609 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.650368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352348.log 2023-07-07T04:02:33.609 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115334.log.gz 2023-07-07T04:02:33.609 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.650368.log.gz 2023-07-07T04:02:33.609 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.319227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.653834.log 2023-07-07T04:02:33.610 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319227.log.gz 2023-07-07T04:02:33.610 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.352348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710676.log 2023-07-07T04:02:33.610 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352348.log.gz 2023-07-07T04:02:33.610 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.653834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409444.log 2023-07-07T04:02:33.610 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.653834.log.gz 2023-07-07T04:02:33.611 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110723.log.gz 2023-07-07T04:02:33.611 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.710676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378914.log 2023-07-07T04:02:33.611 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114715.log.gz 2023-07-07T04:02:33.611 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710676.log.gz 2023-07-07T04:02:33.611 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.409444.log: gzip -5 --verbose -- 88.2%/var/log/ceph/ceph-client.admin.160879.log 2023-07-07T04:02:33.611 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.115871.log.gz 2023-07-07T04:02:33.612 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409444.log.gz 2023-07-07T04:02:33.612 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.378914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390489.log 2023-07-07T04:02:33.612 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.378914.log.gz 2023-07-07T04:02:33.612 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.117360.log.gz 2023-07-07T04:02:33.612 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.117923.log.gz 2023-07-07T04:02:33.613 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.160879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478056.log 2023-07-07T04:02:33.613 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160879.log.gz 2023-07-07T04:02:33.613 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.390489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.941490.log 2023-07-07T04:02:33.613 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.390489.log.gz 2023-07-07T04:02:33.613 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.478056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398289.log 2023-07-07T04:02:33.614 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.478056.log.gz 2023-07-07T04:02:33.614 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.941490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252840.log 2023-07-07T04:02:33.614 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.398289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447039.log 2023-07-07T04:02:33.614 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.941490.log.gz 2023-07-07T04:02:33.614 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.398289.log.gz 2023-07-07T04:02:33.614 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.252840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.821856.log 2023-07-07T04:02:33.615 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252840.log.gz 2023-07-07T04:02:33.615 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.447039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153913.log 2023-07-07T04:02:33.615 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.447039.log.gz 2023-07-07T04:02:33.615 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.821856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773894.log 2023-07-07T04:02:33.615 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.821856.log.gz 2023-07-07T04:02:33.616 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.153913.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.172522.log 2023-07-07T04:02:33.616 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153913.log.gz 2023-07-07T04:02:33.616 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.773894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773894.log.gz 2023-07-07T04:02:33.616 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355662.log 2023-07-07T04:02:33.616 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.172522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.822802.log 2023-07-07T04:02:33.617 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172522.log.gz 2023-07-07T04:02:33.617 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.355662.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-07T04:02:33.617 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355662.log.gz 2023-07-07T04:02:33.617 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.822802.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.822802.log.gz--verbose 2023-07-07T04:02:33.617 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.702614.log 2023-07-07T04:02:33.617 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108524.log 2023-07-07T04:02:33.618 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.702614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296664.log 2023-07-07T04:02:33.618 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702614.log.gz 2023-07-07T04:02:33.618 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113413.log 2023-07-07T04:02:33.618 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.296664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709835.log 2023-07-07T04:02:33.618 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.296664.log.gz 2023-07-07T04:02:33.619 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.113413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421001.log 2023-07-07T04:02:33.619 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.709835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115917.log 2023-07-07T04:02:33.619 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709835.log.gz 2023-07-07T04:02:33.619 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.421001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193926.log 2023-07-07T04:02:33.619 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.421001.log.gz 2023-07-07T04:02:33.619 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405451.log 2023-07-07T04:02:33.620 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.193926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288733.log 2023-07-07T04:02:33.620 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193926.log.gz 2023-07-07T04:02:33.620 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.405451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347527.log 2023-07-07T04:02:33.620 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405451.log.gz 2023-07-07T04:02:33.620 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.288733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311328.log 2023-07-07T04:02:33.621 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288733.log.gz 2023-07-07T04:02:33.621 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.347527.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.347527.log.gz--verbose 2023-07-07T04:02:33.621 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.684190.log 2023-07-07T04:02:33.621 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.311328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278998.log 2023-07-07T04:02:33.621 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311328.log.gz 2023-07-07T04:02:33.622 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.684190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632315.log 2023-07-07T04:02:33.622 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684190.log.gz 2023-07-07T04:02:33.622 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.278998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278998.log.gz 2023-07-07T04:02:33.622 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300428.log 2023-07-07T04:02:33.622 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.632315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.778286.log 2023-07-07T04:02:33.622 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632315.log.gz 2023-07-07T04:02:33.623 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.300428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.777950.log 2023-07-07T04:02:33.623 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300428.log.gz 2023-07-07T04:02:33.623 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.778286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.813493.log 2023-07-07T04:02:33.623 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.778286.log.gz 2023-07-07T04:02:33.623 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.777950.log: 88.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.111463.log.gz--verbose 0.0%-- 2023-07-07T04:02:33.624 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.200008.log -- replaced with /var/log/ceph/ceph-client.admin.777950.log.gz 2023-07-07T04:02:33.624 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:33.624 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111461.log.gz 2023-07-07T04:02:33.624 INFO:teuthology.orchestra.run.smithi006.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.108454.log.gz 2023-07-07T04:02:33.624 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.813493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425181.log 2023-07-07T04:02:33.625 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.813493.log.gz 2023-07-07T04:02:33.625 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.200008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340041.log 2023-07-07T04:02:33.625 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200008.log.gz 2023-07-07T04:02:33.625 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.425181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.827111.log 2023-07-07T04:02:33.625 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.425181.log.gz 2023-07-07T04:02:33.625 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.113413.log.gz 2023-07-07T04:02:33.626 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328138.log 2023-07-07T04:02:33.626 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.340041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340041.log.gz 2023-07-07T04:02:33.626 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.827111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.827111.log.gz 2023-07-07T04:02:33.626 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173967.log 2023-07-07T04:02:33.626 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.328138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346488.log 2023-07-07T04:02:33.627 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328138.log.gz 2023-07-07T04:02:33.627 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.173967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107681.log 2023-07-07T04:02:33.627 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173967.log.gz 2023-07-07T04:02:33.627 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.346488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374092.log 2023-07-07T04:02:33.627 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346488.log.gz 2023-07-07T04:02:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107258.log 2023-07-07T04:02:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.374092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.940138.log 2023-07-07T04:02:33.628 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.374092.log.gz 2023-07-07T04:02:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507276.log 2023-07-07T04:02:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.940138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307033.log 2023-07-07T04:02:33.628 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.507276.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.940138.log.gz 2023-07-07T04:02:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.760481.log 2023-07-07T04:02:33.629 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.507276.log.gz 2023-07-07T04:02:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.307033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364234.log 2023-07-07T04:02:33.629 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307033.log.gz 2023-07-07T04:02:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.760481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633975.log 2023-07-07T04:02:33.630 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.760481.log.gz 2023-07-07T04:02:33.630 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.364234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.364234.log.gz 2023-07-07T04:02:33.630 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620182.log 2023-07-07T04:02:33.630 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.633975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357065.log 2023-07-07T04:02:33.630 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633975.log.gz 2023-07-07T04:02:33.631 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.620182.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.620182.log.gz--verbose 2023-07-07T04:02:33.631 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.111454.log 2023-07-07T04:02:33.631 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.357065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172916.log 2023-07-07T04:02:33.631 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357065.log.gz 2023-07-07T04:02:33.631 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699263.log 2023-07-07T04:02:33.631 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.172916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656853.log 2023-07-07T04:02:33.632 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172916.log.gz 2023-07-07T04:02:33.632 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.699263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212560.log 2023-07-07T04:02:33.632 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699263.log.gz 2023-07-07T04:02:33.632 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.656853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629442.log 2023-07-07T04:02:33.632 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656853.log.gz 2023-07-07T04:02:33.633 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.212560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260051.log 2023-07-07T04:02:33.633 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212560.log.gz 2023-07-07T04:02:33.633 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.629442.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629442.log.gz 2023-07-07T04:02:33.633 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632329.log 2023-07-07T04:02:33.633 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.260051.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.934189.log 2023-07-07T04:02:33.634 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260051.log.gz 2023-07-07T04:02:33.634 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.632329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.705383.log 2023-07-07T04:02:33.634 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632329.log.gz 2023-07-07T04:02:33.634 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.934189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198052.log 2023-07-07T04:02:33.634 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.934189.log.gz 2023-07-07T04:02:33.634 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.705383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397197.log 2023-07-07T04:02:33.635 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.705383.log.gz 2023-07-07T04:02:33.635 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.198052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349553.log 2023-07-07T04:02:33.635 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198052.log.gz 2023-07-07T04:02:33.635 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.397197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323327.log 2023-07-07T04:02:33.635 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.397197.log.gz 2023-07-07T04:02:33.636 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.349553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256585.log 2023-07-07T04:02:33.636 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349553.log.gz 2023-07-07T04:02:33.636 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.323327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252826.log 2023-07-07T04:02:33.636 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323327.log.gz 2023-07-07T04:02:33.636 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.256585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.705089.log 2023-07-07T04:02:33.637 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256585.log.gz 2023-07-07T04:02:33.637 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.252826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354853.log 2023-07-07T04:02:33.637 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252826.log.gz 2023-07-07T04:02:33.637 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.705089.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.705089.log.gz 2023-07-07T04:02:33.637 INFO:teuthology.orchestra.run.smithi006.stderr:--verbose -- /var/log/ceph/ceph-client.admin.622021.log 2023-07-07T04:02:33.637 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.354853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.763164.log 2023-07-07T04:02:33.638 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354853.log.gz 2023-07-07T04:02:33.638 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.622021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622021.log.gz 2023-07-07T04:02:33.638 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.761456.log 2023-07-07T04:02:33.638 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.763164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178868.log 2023-07-07T04:02:33.638 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.763164.log.gz 2023-07-07T04:02:33.639 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.761456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191503.log 2023-07-07T04:02:33.639 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.761456.log.gz 2023-07-07T04:02:33.639 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.178868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630610.log 2023-07-07T04:02:33.639 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178868.log.gz 2023-07-07T04:02:33.639 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.191503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217226.log 2023-07-07T04:02:33.639 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191503.log.gz 2023-07-07T04:02:33.640 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.630610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414852.log 2023-07-07T04:02:33.640 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630610.log.gz 2023-07-07T04:02:33.640 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.217226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636304.log 2023-07-07T04:02:33.640 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217226.log.gz 2023-07-07T04:02:33.640 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.414852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.414852.log.gz 2023-07-07T04:02:33.641 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371527.log 2023-07-07T04:02:33.641 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.636304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697803.log 2023-07-07T04:02:33.641 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636304.log.gz 2023-07-07T04:02:33.641 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.371527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371233.log 2023-07-07T04:02:33.641 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.371527.log.gz 2023-07-07T04:02:33.642 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.697803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623110.log 2023-07-07T04:02:33.642 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697803.log.gz 2023-07-07T04:02:33.642 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.371233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300724.log 2023-07-07T04:02:33.642 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.371233.log.gz 2023-07-07T04:02:33.642 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.623110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.622531.log 2023-07-07T04:02:33.642 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623110.log.gz 2023-07-07T04:02:33.643 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.300724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300724.log.gz 2023-07-07T04:02:33.643 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.622531.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.114853.log.gz 2023-07-07T04:02:33.643 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622531.log.gzgzip 2023-07-07T04:02:33.643 INFO:teuthology.orchestra.run.smithi006.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.356040.log 2023-07-07T04:02:33.643 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116846.log 2023-07-07T04:02:33.644 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.356040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335697.log 2023-07-07T04:02:33.644 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356040.log.gz 2023-07-07T04:02:33.644 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.937555.log 2023-07-07T04:02:33.644 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116846.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115917.log.gz 2023-07-07T04:02:33.644 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.335697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278919.log 2023-07-07T04:02:33.645 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335697.log.gz 2023-07-07T04:02:33.645 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.937555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372475.log 2023-07-07T04:02:33.645 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.937555.log.gz 2023-07-07T04:02:33.645 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.278919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108084.log 2023-07-07T04:02:33.645 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278919.log.gz 2023-07-07T04:02:33.645 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.372475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326305.log 2023-07-07T04:02:33.646 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372475.log.gz 2023-07-07T04:02:33.646 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164101.log 2023-07-07T04:02:33.646 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.326305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298458.log 2023-07-07T04:02:33.646 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326305.log.gz 2023-07-07T04:02:33.646 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.164101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315938.log 2023-07-07T04:02:33.647 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164101.log.gz 2023-07-07T04:02:33.647 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.298458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.679319.log 2023-07-07T04:02:33.647 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298458.log.gz 2023-07-07T04:02:33.647 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.315938.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.813586.log 2023-07-07T04:02:33.647 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.315938.log.gz 2023-07-07T04:02:33.648 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.679319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351668.log 2023-07-07T04:02:33.648 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.679319.log.gz 2023-07-07T04:02:33.648 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.813586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207000.log 2023-07-07T04:02:33.648 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.813586.log.gz 2023-07-07T04:02:33.648 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.351668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351668.log.gz 2023-07-07T04:02:33.648 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173409.log 2023-07-07T04:02:33.649 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.207000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373595.log 2023-07-07T04:02:33.649 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207000.log.gz 2023-07-07T04:02:33.649 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.173409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196301.log 2023-07-07T04:02:33.649 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173409.log.gz 2023-07-07T04:02:33.649 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.373595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208940.log 2023-07-07T04:02:33.650 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.373595.log.gz 2023-07-07T04:02:33.650 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.196301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.668991.log 2023-07-07T04:02:33.650 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196301.log.gz 2023-07-07T04:02:33.650 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.208940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415603.log 2023-07-07T04:02:33.650 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208940.log.gz 2023-07-07T04:02:33.651 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.668991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110134.log 2023-07-07T04:02:33.651 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.668991.log.gz 2023-07-07T04:02:33.651 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.415603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674815.log 2023-07-07T04:02:33.651 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.415603.log.gz 2023-07-07T04:02:33.651 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475016.log 2023-07-07T04:02:33.651 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.674815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.799821.log 2023-07-07T04:02:33.652 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674815.log.gz 2023-07-07T04:02:33.653 INFO:teuthology.orchestra.run.smithi040.stderr: 94.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-07T04:02:33.653 INFO:teuthology.orchestra.run.smithi040.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-07-07T04:02:33.855 INFO:teuthology.orchestra.run.smithi040.stderr: 95.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-07-07T04:02:33.943 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.475016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116800.log 2023-07-07T04:02:33.943 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.475016.log.gz 2023-07-07T04:02:33.943 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.799821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427096.log 2023-07-07T04:02:33.943 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.799821.log.gz 2023-07-07T04:02:33.944 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114208.log 2023-07-07T04:02:33.944 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.427096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109723.log 2023-07-07T04:02:33.944 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.427096.log.gz 2023-07-07T04:02:33.944 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323816.log 2023-07-07T04:02:33.944 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.758933.log 2023-07-07T04:02:33.945 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.323816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354436.log 2023-07-07T04:02:33.945 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323816.log.gz 2023-07-07T04:02:33.945 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.758933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421495.log 2023-07-07T04:02:33.945 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.758933.log.gz 2023-07-07T04:02:33.945 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.354436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691013.log 2023-07-07T04:02:33.945 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354436.log.gz 2023-07-07T04:02:33.946 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.421495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685085.log 2023-07-07T04:02:33.946 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.421495.log.gz 2023-07-07T04:02:33.946 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.691013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629360.log 2023-07-07T04:02:33.946 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691013.log.gz 2023-07-07T04:02:33.946 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.685085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773261.log 2023-07-07T04:02:33.947 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685085.log.gz 2023-07-07T04:02:33.947 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.629360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807946.log 2023-07-07T04:02:33.947 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629360.log.gz 2023-07-07T04:02:33.947 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.773261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427082.log 2023-07-07T04:02:33.947 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773261.log.gz 2023-07-07T04:02:33.947 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.807946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294715.log 2023-07-07T04:02:33.948 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807946.log.gz 2023-07-07T04:02:33.948 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.427082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772021.log 2023-07-07T04:02:33.948 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.427082.log.gz 2023-07-07T04:02:33.948 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.294715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404637.log 2023-07-07T04:02:33.948 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294715.log.gz 2023-07-07T04:02:33.949 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.772021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635284.log 2023-07-07T04:02:33.949 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.772021.log.gz 2023-07-07T04:02:33.949 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.404637.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.404637.log.gz--verbose 2023-07-07T04:02:33.949 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.165065.log 2023-07-07T04:02:33.949 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.635284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635284.log.gz 2023-07-07T04:02:33.950 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.762213.log 2023-07-07T04:02:33.950 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.165065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116204.log 2023-07-07T04:02:33.950 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165065.log.gz 2023-07-07T04:02:33.950 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.762213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213023.log 2023-07-07T04:02:33.950 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.762213.log.gz 2023-07-07T04:02:33.951 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217703.log 2023-07-07T04:02:33.951 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.213023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.799728.log 2023-07-07T04:02:33.951 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213023.log.gz 2023-07-07T04:02:33.951 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.217703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280024.log 2023-07-07T04:02:33.951 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217703.log.gz 2023-07-07T04:02:33.951 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.799728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.670625.log 2023-07-07T04:02:33.952 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.799728.log.gz 2023-07-07T04:02:33.952 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.280024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339014.log 2023-07-07T04:02:33.952 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280024.log.gz 2023-07-07T04:02:33.952 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.670625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.670625.log.gzgzip 2023-07-07T04:02:33.952 INFO:teuthology.orchestra.run.smithi006.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.379305.log 2023-07-07T04:02:33.953 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.339014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308093.log 2023-07-07T04:02:33.953 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339014.log.gz 2023-07-07T04:02:33.953 INFO:teuthology.orchestra.run.smithi006.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-07-07T04:02:33.953 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.379305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337081.log 2023-07-07T04:02:33.953 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.379305.log.gz 2023-07-07T04:02:33.954 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.308093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.822067.log 2023-07-07T04:02:33.954 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308093.log.gz 2023-07-07T04:02:33.954 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.337081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212087.log 2023-07-07T04:02:33.954 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337081.log.gz 2023-07-07T04:02:33.954 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.822067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708657.log 2023-07-07T04:02:33.954 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.822067.log.gz 2023-07-07T04:02:33.955 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.212087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284397.log 2023-07-07T04:02:33.955 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212087.log.gz 2023-07-07T04:02:33.955 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.708657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696796.log 2023-07-07T04:02:33.955 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708657.log.gz 2023-07-07T04:02:33.955 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.284397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356279.log 2023-07-07T04:02:33.956 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284397.log.gz 2023-07-07T04:02:33.956 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309137.log 2023-07-07T04:02:33.956 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.696796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696796.log.gz 2023-07-07T04:02:33.956 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.356279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385659.log 2023-07-07T04:02:33.956 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356279.log.gz 2023-07-07T04:02:33.956 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.309137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340557.log 2023-07-07T04:02:33.957 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309137.log.gz 2023-07-07T04:02:33.957 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448667.log 2023-07-07T04:02:33.957 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.385659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385659.log.gz 2023-07-07T04:02:33.957 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.340557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458905.log 2023-07-07T04:02:33.957 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340557.log.gz 2023-07-07T04:02:33.958 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.448667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417854.log 2023-07-07T04:02:33.958 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.448667.log.gz 2023-07-07T04:02:33.958 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208563.log 2023-07-07T04:02:33.958 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.458905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.458905.log.gz 2023-07-07T04:02:33.958 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.417854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423789.log 2023-07-07T04:02:33.959 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.417854.log.gz 2023-07-07T04:02:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215139.log 2023-07-07T04:02:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.208563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208563.log.gz 2023-07-07T04:02:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.423789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288242.log 2023-07-07T04:02:33.959 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.423789.log.gz 2023-07-07T04:02:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.215139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109861.log 2023-07-07T04:02:33.960 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215139.log.gz 2023-07-07T04:02:33.960 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.288242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685164.log 2023-07-07T04:02:33.960 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288242.log.gz 2023-07-07T04:02:33.960 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633757.log 2023-07-07T04:02:33.960 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109861.log: /var/log/ceph/ceph-client.admin.685164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305649.log 2023-07-07T04:02:33.961 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685164.log.gz 2023-07-07T04:02:33.961 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.633757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476915.log 2023-07-07T04:02:33.961 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633757.log.gz 2023-07-07T04:02:33.961 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269186.log 2023-07-07T04:02:33.961 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.305649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305649.log.gz 2023-07-07T04:02:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.476915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659373.log 2023-07-07T04:02:33.962 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.476915.log.gz 2023-07-07T04:02:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.269186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306142.log 2023-07-07T04:02:33.962 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269186.log.gz 2023-07-07T04:02:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381448.log 2023-07-07T04:02:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.659373.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659373.log.gz 2023-07-07T04:02:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.306142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807127.log 2023-07-07T04:02:33.963 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306142.log.gz 2023-07-07T04:02:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.381448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367821.log 2023-07-07T04:02:33.963 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381448.log.gz 2023-07-07T04:02:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.807127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690920.log 2023-07-07T04:02:33.964 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807127.log.gz 2023-07-07T04:02:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.367821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285111.log 2023-07-07T04:02:33.964 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.367821.log.gz 2023-07-07T04:02:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.690920.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690920.log.gz 2023-07-07T04:02:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659922.log 2023-07-07T04:02:33.965 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.285111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.670114.log 2023-07-07T04:02:33.965 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285111.log.gz 2023-07-07T04:02:33.965 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.659922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.113844.log 2023-07-07T04:02:33.965 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659922.log.gz 2023-07-07T04:02:33.965 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.670114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394740.log 2023-07-07T04:02:33.966 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.670114.log.gz 2023-07-07T04:02:33.966 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.2.113844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300521.log 2023-07-07T04:02:33.966 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.113844.log.gz 2023-07-07T04:02:33.966 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.394740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625558.log 2023-07-07T04:02:33.966 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394740.log.gz 2023-07-07T04:02:33.966 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.300521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204464.log 2023-07-07T04:02:33.967 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300521.log.gz 2023-07-07T04:02:33.967 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.625558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225433.log 2023-07-07T04:02:33.967 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625558.log.gz 2023-07-07T04:02:33.967 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.204464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674829.log 2023-07-07T04:02:33.967 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204464.log.gz 2023-07-07T04:02:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.225433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.778300.log 2023-07-07T04:02:33.968 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225433.log.gz 2023-07-07T04:02:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.674829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309340.log 2023-07-07T04:02:33.968 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674829.log.gz 2023-07-07T04:02:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.778300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.642071.log 2023-07-07T04:02:33.969 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.778300.log.gz 2023-07-07T04:02:33.969 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.309340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.698771.log 2023-07-07T04:02:33.969 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309340.log.gz 2023-07-07T04:02:33.969 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.642071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686728.log 2023-07-07T04:02:33.969 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.642071.log.gz 2023-07-07T04:02:33.969 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.698771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.698771.log.gz 2023-07-07T04:02:33.970 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305663.log 2023-07-07T04:02:33.970 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.686728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686728.log.gz 2023-07-07T04:02:33.970 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414375.log 2023-07-07T04:02:33.970 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.305663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.937152.log 2023-07-07T04:02:33.970 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305663.log.gz 2023-07-07T04:02:33.971 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.414375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401453.log 2023-07-07T04:02:33.971 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.414375.log.gz 2023-07-07T04:02:33.971 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.937152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282289.log 2023-07-07T04:02:33.971 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.937152.log.gz 2023-07-07T04:02:33.971 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.401453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.401453.log.gz 2023-07-07T04:02:33.971 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225340.log 2023-07-07T04:02:33.972 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.282289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413898.log 2023-07-07T04:02:33.972 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282289.log.gz 2023-07-07T04:02:33.972 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.225340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807652.log 2023-07-07T04:02:33.972 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225340.log.gz 2023-07-07T04:02:33.972 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.413898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.764847.log 0.0% 2023-07-07T04:02:33.973 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.413898.log.gz 2023-07-07T04:02:33.973 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.807652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195904.log 2023-07-07T04:02:33.973 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807652.log.gz 2023-07-07T04:02:33.973 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.764847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279945.log 2023-07-07T04:02:33.973 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.764847.log.gz 2023-07-07T04:02:33.974 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.195904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195811.log 2023-07-07T04:02:33.974 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195904.log.gz 2023-07-07T04:02:33.974 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.279945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459988.log 2023-07-07T04:02:33.974 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279945.log.gz 2023-07-07T04:02:33.974 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.195811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313710.log 2023-07-07T04:02:33.974 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195811.log.gz 2023-07-07T04:02:33.975 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.459988.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.459988.log.gz 2023-07-07T04:02:33.975 INFO:teuthology.orchestra.run.smithi006.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.345790.log 2023-07-07T04:02:33.975 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.313710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391865.log 2023-07-07T04:02:33.975 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313710.log.gz 2023-07-07T04:02:33.975 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.345790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112547.log 2023-07-07T04:02:33.976 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345790.log.gz 2023-07-07T04:02:33.976 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.391865.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.391865.log.gz--verbose 2023-07-07T04:02:33.976 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.337808.log 2023-07-07T04:02:33.976 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338640.log 2023-07-07T04:02:33.976 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.337808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370721.log 2023-07-07T04:02:33.977 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337808.log.gz 2023-07-07T04:02:33.977 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.338640.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.338640.log.gz--verbose 2023-07-07T04:02:33.977 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.932325.log 2023-07-07T04:02:33.977 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.370721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107727.log 2023-07-07T04:02:33.977 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.370721.log.gz 2023-07-07T04:02:33.977 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.932325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.815825.log 2023-07-07T04:02:33.978 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.932325.log.gz 2023-07-07T04:02:33.978 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699939.log 2023-07-07T04:02:33.978 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.815825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334870.log 2023-07-07T04:02:33.978 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.815825.log.gz 2023-07-07T04:02:33.978 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.699939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.942209.log 2023-07-07T04:02:33.979 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699939.log.gz 2023-07-07T04:02:33.979 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.334870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.821870.log 2023-07-07T04:02:33.979 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334870.log.gz 2023-07-07T04:02:33.979 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.942209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.679826.log 2023-07-07T04:02:33.979 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.821870.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.942209.log.gz-5 2023-07-07T04:02:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:--verbose -- /var/log/ceph/ceph-client.admin.291961.log 2023-07-07T04:02:33.980 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.821870.log.gz 2023-07-07T04:02:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.679826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693540.log 2023-07-07T04:02:33.980 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.679826.log.gz 2023-07-07T04:02:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.291961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686197.log 2023-07-07T04:02:33.981 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291961.log.gz 2023-07-07T04:02:33.981 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.693540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311314.log 2023-07-07T04:02:33.981 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693540.log.gz 2023-07-07T04:02:33.981 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.686197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.936682.log 2023-07-07T04:02:33.981 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686197.log.gz 2023-07-07T04:02:33.981 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.311314.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.311314.log.gz--verbose 2023-07-07T04:02:33.982 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.274130.log 2023-07-07T04:02:33.982 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.936682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173953.log 2023-07-07T04:02:33.982 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.936682.log.gz 2023-07-07T04:02:33.982 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.274130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.940900.log 2023-07-07T04:02:33.982 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274130.log.gz 2023-07-07T04:02:33.983 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.173953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244748.log 2023-07-07T04:02:33.983 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173953.log.gz 2023-07-07T04:02:33.983 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.940900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192944.log 2023-07-07T04:02:33.983 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.244748.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.940900.log.gz 2023-07-07T04:02:33.983 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287751.log 2023-07-07T04:02:33.983 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244748.log.gz 2023-07-07T04:02:33.984 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.192944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347002.log 2023-07-07T04:02:33.984 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192944.log.gz 2023-07-07T04:02:33.984 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.287751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349567.log 2023-07-07T04:02:33.984 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287751.log.gz 2023-07-07T04:02:33.984 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.347002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.942163.log 2023-07-07T04:02:33.985 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347002.log.gz 2023-07-07T04:02:33.985 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115129.log 2023-07-07T04:02:33.985 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.349567.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349567.log.gz 2023-07-07T04:02:33.985 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.942163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305077.log 2023-07-07T04:02:33.985 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.942163.log.gz 2023-07-07T04:02:33.986 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197609.log 2023-07-07T04:02:33.986 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.305077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658746.log 2023-07-07T04:02:33.986 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305077.log.gz 2023-07-07T04:02:33.986 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.197609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165144.log 2023-07-07T04:02:33.986 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197609.log.gz 2023-07-07T04:02:33.986 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.658746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288228.log 2023-07-07T04:02:33.987 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.658746.log.gz 2023-07-07T04:02:33.987 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.165144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254380.log 2023-07-07T04:02:33.987 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165144.log.gz 2023-07-07T04:02:33.987 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.288228.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.288228.log.gz--verbose 2023-07-07T04:02:33.987 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.221697.log 2023-07-07T04:02:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.254380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479521.log 2023-07-07T04:02:33.988 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254380.log.gz 2023-07-07T04:02:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.221697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326291.log 2023-07-07T04:02:33.988 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221697.log.gz 2023-07-07T04:02:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.479521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.816817.log 2023-07-07T04:02:33.988 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.479521.log.gz 2023-07-07T04:02:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.326291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393273.log 2023-07-07T04:02:33.989 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326291.log.gz 2023-07-07T04:02:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.816817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.779433.log 2023-07-07T04:02:33.989 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.816817.log.gz 2023-07-07T04:02:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.393273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618357.log 2023-07-07T04:02:33.990 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393273.log.gz 2023-07-07T04:02:33.990 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.779433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284910.log 2023-07-07T04:02:33.990 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.779433.log.gz 2023-07-07T04:02:33.990 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.618357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631844.log 2023-07-07T04:02:33.990 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618357.log.gz 2023-07-07T04:02:33.991 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.284910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353958.log 2023-07-07T04:02:33.991 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284910.log.gz 2023-07-07T04:02:33.991 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.631844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633961.log 2023-07-07T04:02:33.991 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.631844.log.gz 2023-07-07T04:02:33.991 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.353958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.808993.log 2023-07-07T04:02:33.991 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353958.log.gz 2023-07-07T04:02:33.992 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.633961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426180.log 2023-07-07T04:02:33.992 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633961.log.gz 2023-07-07T04:02:33.992 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.808993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376557.log 2023-07-07T04:02:33.992 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.808993.log.gz 2023-07-07T04:02:33.992 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.426180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386975.log 2023-07-07T04:02:33.993 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.426180.log.gz 2023-07-07T04:02:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.376557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.758220.log 2023-07-07T04:02:33.993 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.376557.log.gz 2023-07-07T04:02:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.386975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393757.log 2023-07-07T04:02:33.993 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386975.log.gz 2023-07-07T04:02:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.758220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644714.log 2023-07-07T04:02:33.994 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.758220.log.gz 2023-07-07T04:02:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.393757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101227.log 2023-07-07T04:02:33.994 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393757.log.gz 2023-07-07T04:02:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.644714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345776.log 2023-07-07T04:02:33.994 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644714.log.gz 2023-07-07T04:02:33.995 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.101227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688600.log 2023-07-07T04:02:33.995 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.345776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460933.log 2023-07-07T04:02:33.995 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345776.log.gz 2023-07-07T04:02:33.995 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.688600.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.688600.log.gz/var/log/ceph/ceph-client.admin.116568.log 2023-07-07T04:02:33.995 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:33.996 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.460933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271091.log 2023-07-07T04:02:33.996 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.460933.log.gz 2023-07-07T04:02:33.996 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 /var/log/ceph/ceph-client.admin.116568.log: --verbose -- /var/log/ceph/ceph-client.admin.639212.log 2023-07-07T04:02:33.996 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.271091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195123.log 2023-07-07T04:02:33.996 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271091.log.gz 2023-07-07T04:02:33.997 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.639212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685733.log 2023-07-07T04:02:33.997 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639212.log.gz 2023-07-07T04:02:33.997 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.195123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172050.log 2023-07-07T04:02:33.997 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195123.log.gz 2023-07-07T04:02:33.997 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.685733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685733.log.gz 2023-07-07T04:02:33.998 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290742.log 2023-07-07T04:02:33.998 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421402.log 2023-07-07T04:02:33.998 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.172050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172050.log.gz 2023-07-07T04:02:33.998 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.290742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657289.log 2023-07-07T04:02:33.998 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290742.log.gz 2023-07-07T04:02:33.998 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.421402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.762680.log 2023-07-07T04:02:33.999 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.421402.log.gz 2023-07-07T04:02:33.999 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.657289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351962.log 2023-07-07T04:02:33.999 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.657289.log.gz 2023-07-07T04:02:33.999 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.762680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412901.log 2023-07-07T04:02:33.999 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.762680.log.gz 2023-07-07T04:02:34.000 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.351962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315459.log 2023-07-07T04:02:34.000 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351962.log.gz 2023-07-07T04:02:34.000 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.412901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690468.log 2023-07-07T04:02:34.000 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412901.log.gz 2023-07-07T04:02:34.000 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.315459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347296.log 2023-07-07T04:02:34.000 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315459.log.gz 2023-07-07T04:02:34.001 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.690468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313925.log 2023-07-07T04:02:34.001 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690468.log.gz 2023-07-07T04:02:34.001 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.347296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418616.log 2023-07-07T04:02:34.001 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347296.log.gz 2023-07-07T04:02:34.001 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.313925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375548.log 2023-07-07T04:02:34.002 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313925.log.gz 2023-07-07T04:02:34.002 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.418616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673365.log 2023-07-07T04:02:34.002 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.418616.log.gz 2023-07-07T04:02:34.002 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.375548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213980.log 2023-07-07T04:02:34.002 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.375548.log.gz 2023-07-07T04:02:34.003 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.673365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160893.log 2023-07-07T04:02:34.003 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673365.log.gz 2023-07-07T04:02:34.003 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.213980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620383.log 2023-07-07T04:02:34.003 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213980.log.gz 2023-07-07T04:02:34.003 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.160893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296865.log 2023-07-07T04:02:34.003 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160893.log.gz 2023-07-07T04:02:34.004 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.620383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214937.log 2023-07-07T04:02:34.004 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620383.log.gz 2023-07-07T04:02:34.004 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.296865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618392.log 2023-07-07T04:02:34.004 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.296865.log.gz 2023-07-07T04:02:34.004 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.214937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214937.log.gz 2023-07-07T04:02:34.005 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535415.log 2023-07-07T04:02:34.005 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.618392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370223.log 2023-07-07T04:02:34.005 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618392.log.gz 2023-07-07T04:02:34.005 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.535415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117222.log 2023-07-07T04:02:34.005 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.535415.log.gz 2023-07-07T04:02:34.006 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.370223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287737.log 2023-07-07T04:02:34.006 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.370223.log.gz 2023-07-07T04:02:34.006 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691974.log 2023-07-07T04:02:34.006 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.287737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282303.log 2023-07-07T04:02:34.006 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287737.log.gz 2023-07-07T04:02:34.006 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.691974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673566.log 2023-07-07T04:02:34.007 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691974.log.gz 2023-07-07T04:02:34.007 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.282303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696323.log 2023-07-07T04:02:34.007 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282303.log.gz 2023-07-07T04:02:34.007 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.673566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342552.log 2023-07-07T04:02:34.007 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673566.log.gz 2023-07-07T04:02:34.008 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.696323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.650461.log 2023-07-07T04:02:34.008 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696323.log.gz 2023-07-07T04:02:34.008 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.342552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674736.log 2023-07-07T04:02:34.008 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342552.log.gz 2023-07-07T04:02:34.008 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.650461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697312.log 2023-07-07T04:02:34.008 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.650461.log.gz 2023-07-07T04:02:34.009 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.674736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192453.log 2023-07-07T04:02:34.009 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674736.log.gz 2023-07-07T04:02:34.009 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.697312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416816.log 2023-07-07T04:02:34.009 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697312.log.gz 2023-07-07T04:02:34.009 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.192453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.758614.log 2023-07-07T04:02:34.010 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192453.log.gz 2023-07-07T04:02:34.010 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.416816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.825159.log 2023-07-07T04:02:34.010 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.416816.log.gz 2023-07-07T04:02:34.010 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.758614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353426.log 2023-07-07T04:02:34.010 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.758614.log.gz 2023-07-07T04:02:34.011 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.825159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478729.log 2023-07-07T04:02:34.011 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.825159.log.gz 2023-07-07T04:02:34.011 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.353426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193159.log 2023-07-07T04:02:34.011 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353426.log.gz 2023-07-07T04:02:34.011 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.478729.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.704035.log 2023-07-07T04:02:34.011 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.478729.log.gz 2023-07-07T04:02:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.193159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299917.log 2023-07-07T04:02:34.012 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193159.log.gz 2023-07-07T04:02:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.704035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287658.log 2023-07-07T04:02:34.012 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704035.log.gz 2023-07-07T04:02:34.012 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.299917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362651.log 2023-07-07T04:02:34.013 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299917.log.gz 2023-07-07T04:02:34.013 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.287658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110364.log 2023-07-07T04:02:34.013 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287658.log.gz 2023-07-07T04:02:34.013 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.362651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.622114.log 2023-07-07T04:02:34.013 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362651.log.gz 2023-07-07T04:02:34.014 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322369.log 2023-07-07T04:02:34.014 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.622114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308604.log 2023-07-07T04:02:34.014 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622114.log.gz 2023-07-07T04:02:34.014 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.322369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290231.log 2023-07-07T04:02:34.014 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322369.log.gz 2023-07-07T04:02:34.014 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.308604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316854.log 2023-07-07T04:02:34.015 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308604.log.gz 2023-07-07T04:02:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.290231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461012.log 2023-07-07T04:02:34.015 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290231.log.gz 2023-07-07T04:02:34.015 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.316854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.812573.log 2023-07-07T04:02:34.015 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316854.log.gz 2023-07-07T04:02:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.461012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932311.log 2023-07-07T04:02:34.016 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.461012.log.gz 2023-07-07T04:02:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.812573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204543.log 2023-07-07T04:02:34.016 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.812573.log.gz 2023-07-07T04:02:34.016 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.932311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773601.log 2023-07-07T04:02:34.017 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.932311.log.gz 2023-07-07T04:02:34.017 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.107258.log.gz 2023-07-07T04:02:34.017 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.107681.log.gz 2023-07-07T04:02:34.017 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.204543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422920.log 2023-07-07T04:02:34.017 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108524.log.gz 2023-07-07T04:02:34.017 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204543.log.gz 2023-07-07T04:02:34.018 INFO:teuthology.orchestra.run.smithi006.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.109953.log.gz 2023-07-07T04:02:34.018 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.773601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352910.log 2023-07-07T04:02:34.018 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111454.log.gz 2023-07-07T04:02:34.018 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773601.log.gz 2023-07-07T04:02:34.018 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.422920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198269.log 2023-07-07T04:02:34.019 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114208.log.gz 2023-07-07T04:02:34.019 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.422920.log.gz 2023-07-07T04:02:34.019 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.352910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352910.log.gz 2023-07-07T04:02:34.019 INFO:teuthology.orchestra.run.smithi006.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.115129.log.gz 2023-07-07T04:02:34.019 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310610.log 90.8% 2023-07-07T04:02:34.020 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.112547.log.gz 2023-07-07T04:02:34.020 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116204.log.gz 2023-07-07T04:02:34.020 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.198269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328649.log 2023-07-07T04:02:34.020 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198269.log.gz 2023-07-07T04:02:34.020 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.310610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636225.log 2023-07-07T04:02:34.020 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310610.log.gz 2023-07-07T04:02:34.021 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116568.log.gz 2023-07-07T04:02:34.021 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.328649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.803564.log 2023-07-07T04:02:34.021 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328649.log.gz 2023-07-07T04:02:34.021 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.636225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114531.log 2023-07-07T04:02:34.021 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636225.log.gz 2023-07-07T04:02:34.022 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.803564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.803564.log.gz 2023-07-07T04:02:34.022 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376744.log 2023-07-07T04:02:34.022 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114531.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.116800.log.gz 2023-07-07T04:02:34.022 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623993.log 2023-07-07T04:02:34.022 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116846.log.gz 2023-07-07T04:02:34.023 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.376744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281778.log 2023-07-07T04:02:34.023 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.376744.log.gz 2023-07-07T04:02:34.023 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.623993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625940.log 2023-07-07T04:02:34.023 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623993.log.gz 2023-07-07T04:02:34.023 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.281778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697233.log 2023-07-07T04:02:34.023 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281778.log.gz 2023-07-07T04:02:34.024 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.625940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408831.log 2023-07-07T04:02:34.024 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625940.log.gz 2023-07-07T04:02:34.024 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.697233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620594.log 2023-07-07T04:02:34.024 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697233.log.gz 2023-07-07T04:02:34.024 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.408831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347807.log 2023-07-07T04:02:34.025 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408831.log.gz 2023-07-07T04:02:34.025 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.620594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346287.log 2023-07-07T04:02:34.025 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620594.log.gz 2023-07-07T04:02:34.025 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.347807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347807.log.gz 2023-07-07T04:02:34.025 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.816910.log 2023-07-07T04:02:34.025 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.117222.log.gz 2023-07-07T04:02:34.026 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644000.log 2023-07-07T04:02:34.026 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.346287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346287.log.gz 2023-07-07T04:02:34.026 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.816910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.679747.log 2023-07-07T04:02:34.026 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.816910.log.gz 2023-07-07T04:02:34.026 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.101227.log.gz 2023-07-07T04:02:34.027 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.644000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644000.log.gz 2023-07-07T04:02:34.027 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271170.log 2023-07-07T04:02:34.027 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366795.log 2023-07-07T04:02:34.027 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.679747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.679747.log.gz 2023-07-07T04:02:34.027 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405050.log 2023-07-07T04:02:34.028 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.271170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271170.log.gz 2023-07-07T04:02:34.028 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107727.log.gz 2023-07-07T04:02:34.028 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.366795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286434.log 2023-07-07T04:02:34.028 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366795.log.gz 2023-07-07T04:02:34.028 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.405050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405050.log.gz 2023-07-07T04:02:34.029 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685178.log 2023-07-07T04:02:34.029 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.286434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257614.log 2023-07-07T04:02:34.029 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286434.log.gz 2023-07-07T04:02:34.029 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.685178.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.685178.log.gz-5 2023-07-07T04:02:34.029 INFO:teuthology.orchestra.run.smithi006.stderr:--verbose -- /var/log/ceph/ceph-client.admin.354357.log 2023-07-07T04:02:34.029 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.257614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401964.log 2023-07-07T04:02:34.030 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257614.log.gz 2023-07-07T04:02:34.030 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.354357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279726.log 2023-07-07T04:02:34.030 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354357.log.gz 2023-07-07T04:02:34.030 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.401964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382361.log 2023-07-07T04:02:34.030 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.401964.log.gz 2023-07-07T04:02:34.031 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.279726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.806616.log 2023-07-07T04:02:34.031 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279726.log.gz 2023-07-07T04:02:34.031 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.382361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369912.log 2023-07-07T04:02:34.031 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382361.log.gz 2023-07-07T04:02:34.031 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.806616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407867.log 2023-07-07T04:02:34.032 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.806616.log.gz 2023-07-07T04:02:34.032 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.369912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.640104.log 2023-07-07T04:02:34.032 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.369912.log.gz 2023-07-07T04:02:34.032 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.407867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355458.log 2023-07-07T04:02:34.033 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407867.log.gz 2023-07-07T04:02:34.033 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.640104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.827018.log 2023-07-07T04:02:34.033 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.640104.log.gz 2023-07-07T04:02:34.033 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.355458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390939.log 2023-07-07T04:02:34.033 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355458.log.gz 2023-07-07T04:02:34.033 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.827018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404695.log 2023-07-07T04:02:34.034 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.827018.log.gz 2023-07-07T04:02:34.034 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.390939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638716.log 2023-07-07T04:02:34.034 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.390939.log.gz 2023-07-07T04:02:34.034 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.404695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.940276.log 2023-07-07T04:02:34.034 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.404695.log.gz 2023-07-07T04:02:34.035 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.638716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625479.log 2023-07-07T04:02:34.035 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638716.log.gz 2023-07-07T04:02:34.035 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.940276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348322.log 2023-07-07T04:02:34.035 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.940276.log.gz 2023-07-07T04:02:34.035 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.625479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406113.log 2023-07-07T04:02:34.036 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625479.log.gz 2023-07-07T04:02:34.036 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.348322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310316.log 2023-07-07T04:02:34.036 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348322.log.gz 2023-07-07T04:02:34.036 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.406113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395237.log 2023-07-07T04:02:34.036 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406113.log.gz 2023-07-07T04:02:34.037 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.310316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.815904.log 2023-07-07T04:02:34.037 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310316.log.gz 2023-07-07T04:02:34.037 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.395237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256295.log 2023-07-07T04:02:34.037 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395237.log.gz 2023-07-07T04:02:34.037 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.815904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334664.log 2023-07-07T04:02:34.038 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.815904.log.gz 2023-07-07T04:02:34.038 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.256295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686416.log 2023-07-07T04:02:34.038 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256295.log.gz 2023-07-07T04:02:34.038 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.334664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.930863.log 2023-07-07T04:02:34.038 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334664.log.gz 2023-07-07T04:02:34.038 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.686416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417775.log 2023-07-07T04:02:34.039 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686416.log.gz 2023-07-07T04:02:34.039 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.930863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412085.log 2023-07-07T04:02:34.039 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.930863.log.gz 2023-07-07T04:02:34.039 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.417775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286728.log 2023-07-07T04:02:34.039 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.417775.log.gz 2023-07-07T04:02:34.040 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.412085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409873.log 2023-07-07T04:02:34.040 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412085.log.gz 2023-07-07T04:02:34.040 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.286728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415082.log 2023-07-07T04:02:34.040 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286728.log.gz 2023-07-07T04:02:34.040 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.409873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356234.log 2023-07-07T04:02:34.041 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409873.log.gz 2023-07-07T04:02:34.041 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.415082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685408.log 2023-07-07T04:02:34.041 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.415082.log.gz 2023-07-07T04:02:34.041 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.356234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684660.log 2023-07-07T04:02:34.041 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356234.log.gz 2023-07-07T04:02:34.042 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.685408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205999.log 2023-07-07T04:02:34.042 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685408.log.gz 2023-07-07T04:02:34.042 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.684660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299697.log 2023-07-07T04:02:34.042 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684660.log.gz 2023-07-07T04:02:34.042 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.205999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674230.log 2023-07-07T04:02:34.042 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205999.log.gz 2023-07-07T04:02:34.043 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.299697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654348.log 2023-07-07T04:02:34.043 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299697.log.gz 2023-07-07T04:02:34.043 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.674230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.692429.log 2023-07-07T04:02:34.043 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674230.log.gz 2023-07-07T04:02:34.043 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.654348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116434.log 2023-07-07T04:02:34.044 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654348.log.gz 2023-07-07T04:02:34.044 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.692429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226018.log 2023-07-07T04:02:34.044 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.692429.log.gz 2023-07-07T04:02:34.044 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390475.log 2023-07-07T04:02:34.044 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.226018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396761.log 2023-07-07T04:02:34.045 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226018.log.gz 2023-07-07T04:02:34.045 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.390475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337577.log 2023-07-07T04:02:34.045 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.390475.log.gz 2023-07-07T04:02:34.045 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.396761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.805594.log 2023-07-07T04:02:34.045 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396761.log.gz 2023-07-07T04:02:34.045 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.337577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376543.log 2023-07-07T04:02:34.046 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337577.log.gz 2023-07-07T04:02:34.046 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.805594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111094.log 2023-07-07T04:02:34.046 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.805594.log.gz 2023-07-07T04:02:34.046 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.376543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707596.log 2023-07-07T04:02:34.046 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.376543.log.gz 2023-07-07T04:02:34.047 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459496.log 2023-07-07T04:02:34.047 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.707596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164662.log 2023-07-07T04:02:34.047 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707596.log.gz 2023-07-07T04:02:34.047 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.459496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255254.log 2023-07-07T04:02:34.047 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.459496.log.gz 2023-07-07T04:02:34.048 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.164662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.661098.log 2023-07-07T04:02:34.048 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164662.log.gz 2023-07-07T04:02:34.048 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.255254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708643.log 2023-07-07T04:02:34.048 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255254.log.gz 2023-07-07T04:02:34.048 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.661098.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.661098.log.gz--verbose 2023-07-07T04:02:34.049 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.253875.log 2023-07-07T04:02:34.049 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108084.log.gz 2023-07-07T04:02:34.049 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.708643.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.109723.log.gz 2023-07-07T04:02:34.049 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110134.log.gz 2023-07-07T04:02:34.049 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708643.log.gz 2023-07-07T04:02:34.049 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.110364.log.gz 2023-07-07T04:02:34.050 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299186.log 2023-07-07T04:02:34.050 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.253875.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.253875.log.gz 2023-07-07T04:02:34.050 INFO:teuthology.orchestra.run.smithi006.stderr:--verbose -- /var/log/ceph/ceph-client.admin.283116.log 2023-07-07T04:02:34.050 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.299186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.622624.log 2023-07-07T04:02:34.050 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299186.log.gz 2023-07-07T04:02:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.283116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699062.log 2023-07-07T04:02:34.051 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283116.log.gz 2023-07-07T04:02:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.622624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203990.log 2023-07-07T04:02:34.051 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622624.log.gz 2023-07-07T04:02:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.699062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699062.log.gz 2023-07-07T04:02:34.052 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.933225.log 2023-07-07T04:02:34.052 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.203990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406127.log 2023-07-07T04:02:34.052 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.203990.log.gz 2023-07-07T04:02:34.052 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.933225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107635.log 2023-07-07T04:02:34.052 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.933225.log.gz 2023-07-07T04:02:34.053 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.406127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115267.log 2023-07-07T04:02:34.053 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406127.log.gz 2023-07-07T04:02:34.053 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338339.log 2023-07-07T04:02:34.053 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157296.log 2023-07-07T04:02:34.053 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.338339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446157.log 2023-07-07T04:02:34.053 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338339.log.gz 2023-07-07T04:02:34.054 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.157296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.804586.log 2023-07-07T04:02:34.054 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157296.log.gz 2023-07-07T04:02:34.054 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.446157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.446157.log.gz 2023-07-07T04:02:34.054 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205409.log 2023-07-07T04:02:34.054 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.804586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343304.log 2023-07-07T04:02:34.055 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.804586.log.gz 2023-07-07T04:02:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.205409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205409.log.gz 2023-07-07T04:02:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426273.log 2023-07-07T04:02:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.343304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118154.log 2023-07-07T04:02:34.055 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343304.log.gz 2023-07-07T04:02:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.426273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.426273.log.gz 2023-07-07T04:02:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684646.log 2023-07-07T04:02:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691466.log 2023-07-07T04:02:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.684646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119215.log 2023-07-07T04:02:34.056 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684646.log.gz 2023-07-07T04:02:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.691466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639119.log 2023-07-07T04:02:34.057 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691466.log.gz 2023-07-07T04:02:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.119215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117268.log 2023-07-07T04:02:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.639119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209033.log 2023-07-07T04:02:34.057 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639119.log.gz 2023-07-07T04:02:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117655.log 2023-07-07T04:02:34.058 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.209033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.778096.log 2023-07-07T04:02:34.058 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.209033.log.gz 2023-07-07T04:02:34.058 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641503.log 2023-07-07T04:02:34.058 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.778096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684176.log 2023-07-07T04:02:34.058 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.778096.log.gz 2023-07-07T04:02:34.058 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.641503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.641503.log.gz 2023-07-07T04:02:34.059 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111078.log 2023-07-07T04:02:34.059 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.684176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.814872.log 2023-07-07T04:02:34.059 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684176.log.gz 2023-07-07T04:02:34.059 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305156.log 2023-07-07T04:02:34.059 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.814872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262365.log 2023-07-07T04:02:34.060 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.814872.log.gz 2023-07-07T04:02:34.060 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.305156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305156.log.gz 2023-07-07T04:02:34.060 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446657.log 2023-07-07T04:02:34.060 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.262365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628885.log 2023-07-07T04:02:34.060 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262365.log.gz 2023-07-07T04:02:34.061 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.446657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.446657.log.gz 2023-07-07T04:02:34.061 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392717.log 2023-07-07T04:02:34.061 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.628885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321550.log 2023-07-07T04:02:34.061 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628885.log.gz 2023-07-07T04:02:34.061 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.392717.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392717.log.gz 2023-07-07T04:02:34.061 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353944.log 2023-07-07T04:02:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.321550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691387.log 2023-07-07T04:02:34.062 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321550.log.gz 2023-07-07T04:02:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.353944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353944.log.gz 2023-07-07T04:02:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331306.log 2023-07-07T04:02:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.691387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657060.log 2023-07-07T04:02:34.063 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691387.log.gz 2023-07-07T04:02:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.331306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331306.log.gz 2023-07-07T04:02:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405833.log 2023-07-07T04:02:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.657060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.931843.log 2023-07-07T04:02:34.063 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.657060.log.gz 2023-07-07T04:02:34.064 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.405833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405833.log.gz 2023-07-07T04:02:34.064 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192668.log 2023-07-07T04:02:34.064 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.931843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.774601.log 2023-07-07T04:02:34.064 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.931843.log.gz 2023-07-07T04:02:34.064 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.192668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192668.log.gz 2023-07-07T04:02:34.065 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198255.log 2023-07-07T04:02:34.065 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.774601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304661.log 2023-07-07T04:02:34.065 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.774601.log.gz 2023-07-07T04:02:34.065 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.198255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198255.log.gz 2023-07-07T04:02:34.065 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460476.log 2023-07-07T04:02:34.065 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.304661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379398.log 2023-07-07T04:02:34.066 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304661.log.gz 2023-07-07T04:02:34.066 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.460476.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.460476.log.gz 2023-07-07T04:02:34.066 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.763150.log 2023-07-07T04:02:34.066 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.379398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172536.log 2023-07-07T04:02:34.066 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.379398.log.gz 2023-07-07T04:02:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.763150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.763150.log.gz 2023-07-07T04:02:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674535.log 2023-07-07T04:02:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.172536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.780016.log 2023-07-07T04:02:34.067 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172536.log.gz 2023-07-07T04:02:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.674535.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674535.log.gz 2023-07-07T04:02:34.068 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110318.log 2023-07-07T04:02:34.068 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.780016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266186.log 2023-07-07T04:02:34.068 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.780016.log.gz 2023-07-07T04:02:34.068 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351654.log 2023-07-07T04:02:34.068 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.266186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621632.log 2023-07-07T04:02:34.068 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266186.log.gz 2023-07-07T04:02:34.069 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.351654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351654.log.gzgzip 2023-07-07T04:02:34.069 INFO:teuthology.orchestra.run.smithi006.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.366558.log 2023-07-07T04:02:34.069 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.621632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190085.log 2023-07-07T04:02:34.069 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621632.log.gz 2023-07-07T04:02:34.069 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.366558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366558.log.gz 2023-07-07T04:02:34.070 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115037.log 2023-07-07T04:02:34.070 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.190085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267634.log 2023-07-07T04:02:34.070 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190085.log.gz 2023-07-07T04:02:34.070 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115553.log 2023-07-07T04:02:34.070 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.267634.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.298983.log 2023-07-07T04:02:34.071 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267634.log.gz 2023-07-07T04:02:34.071 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307126.log 2023-07-07T04:02:34.071 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.298983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.806399.log 2023-07-07T04:02:34.071 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298983.log.gz 2023-07-07T04:02:34.071 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.307126.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.307126.log.gz 2023-07-07T04:02:34.071 INFO:teuthology.orchestra.run.smithi006.stderr:--verbose -- /var/log/ceph/ceph-client.admin.226243.log 2023-07-07T04:02:34.072 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.806399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175692.log 2023-07-07T04:02:34.072 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.806399.log.gz 2023-07-07T04:02:34.072 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.226243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226243.log.gz 2023-07-07T04:02:34.072 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205496.log 2023-07-07T04:02:34.072 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.175692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210580.log 2023-07-07T04:02:34.073 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175692.log.gz 2023-07-07T04:02:34.073 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.205496.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205496.log.gz 2023-07-07T04:02:34.073 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.759704.log 2023-07-07T04:02:34.073 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.210580.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-07-07T04:02:34.073 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210580.log.gz 2023-07-07T04:02:34.074 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.759704.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.759704.log.gz 2023-07-07T04:02:34.074 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.698275.log 2023-07-07T04:02:34.074 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405036.log 2023-07-07T04:02:34.074 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.698275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710175.log 2023-07-07T04:02:34.074 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.698275.log.gz 2023-07-07T04:02:34.075 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.405036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402524.log 2023-07-07T04:02:34.075 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405036.log.gz 2023-07-07T04:02:34.075 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.710175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.774091.log 2023-07-07T04:02:34.075 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710175.log.gz 2023-07-07T04:02:34.075 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.402524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114439.log 2023-07-07T04:02:34.075 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.402524.log.gz 2023-07-07T04:02:34.076 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.774091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.823350.log 2023-07-07T04:02:34.076 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.774091.log.gz 2023-07-07T04:02:34.076 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191883.log 2023-07-07T04:02:34.076 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.823350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.765052.log 2023-07-07T04:02:34.076 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.823350.log.gz 2023-07-07T04:02:34.077 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.191883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695388.log 2023-07-07T04:02:34.077 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191883.log.gz 2023-07-07T04:02:34.077 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.765052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111765.log 2023-07-07T04:02:34.077 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.765052.log.gz 2023-07-07T04:02:34.077 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.114531.log.gz 2023-07-07T04:02:34.078 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.695388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267727.log 2023-07-07T04:02:34.078 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695388.log.gz 2023-07-07T04:02:34.078 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.115267.log.gz 2023-07-07T04:02:34.078 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636012.log 2023-07-07T04:02:34.078 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.116434.log.gz 2023-07-07T04:02:34.078 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117268.log.gz 2023-07-07T04:02:34.079 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.267727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251858.log 2023-07-07T04:02:34.079 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.267727.log.gz -- replaced with /var/log/ceph/ceph-client.admin.117655.log.gz 2023-07-07T04:02:34.079 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:34.079 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.636012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636012.log.gz 2023-07-07T04:02:34.079 INFO:teuthology.orchestra.run.smithi006.stderr:gzip 88.7%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.118154.log.gz-- 2023-07-07T04:02:34.080 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.940946.log 2023-07-07T04:02:34.080 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.119215.log.gz 2023-07-07T04:02:34.080 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.251858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162281.log 2023-07-07T04:02:34.080 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251858.log.gz 2023-07-07T04:02:34.080 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107635.log.gz 2023-07-07T04:02:34.081 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.940946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417564.log 2023-07-07T04:02:34.081 INFO:teuthology.orchestra.run.smithi006.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110318.log.gz 2023-07-07T04:02:34.081 INFO:teuthology.orchestra.run.smithi006.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.940946.log.gz 2023-07-07T04:02:34.081 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.162281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479535.log 2023-07-07T04:02:34.081 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162281.log.gz 2023-07-07T04:02:34.082 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.417564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.802822.log 2023-07-07T04:02:34.082 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.417564.log.gz 2023-07-07T04:02:34.082 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.479535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634993.log 2023-07-07T04:02:34.082 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.479535.log.gz 2023-07-07T04:02:34.082 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.802822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.776755.log 2023-07-07T04:02:34.082 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.802822.log.gz 2023-07-07T04:02:34.083 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404352.log 2023-07-07T04:02:34.083 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.634993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634993.log.gz 2023-07-07T04:02:34.083 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.776755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177562.log 2023-07-07T04:02:34.083 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.776755.log.gz 2023-07-07T04:02:34.084 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.404352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255828.log 2023-07-07T04:02:34.084 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.404352.log.gz 2023-07-07T04:02:34.084 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286137.log 2023-07-07T04:02:34.084 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.177562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177562.log.gz 2023-07-07T04:02:34.084 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.255828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111903.log 2023-07-07T04:02:34.085 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255828.log.gz 2023-07-07T04:02:34.085 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.286137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300227.log 2023-07-07T04:02:34.085 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286137.log.gz 2023-07-07T04:02:34.085 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213009.log 2023-07-07T04:02:34.085 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630832.log 2023-07-07T04:02:34.085 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.300227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300227.log.gz 2023-07-07T04:02:34.086 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.213009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117516.log 2023-07-07T04:02:34.086 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213009.log.gz 2023-07-07T04:02:34.086 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.630832.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.773680.log 2023-07-07T04:02:34.086 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630832.log.gz 2023-07-07T04:02:34.086 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395158.log 2023-07-07T04:02:34.087 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.773680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285409.log 2023-07-07T04:02:34.087 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773680.log.gz 2023-07-07T04:02:34.087 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.395158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114300.log 2023-07-07T04:02:34.087 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395158.log.gz 2023-07-07T04:02:34.087 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378928.log 2023-07-07T04:02:34.087 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.285409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285409.log.gz 2023-07-07T04:02:34.088 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284677.log 2023-07-07T04:02:34.088 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.378928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419343.log 2023-07-07T04:02:34.088 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.378928.log.gz 2023-07-07T04:02:34.088 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.284677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408156.log 2023-07-07T04:02:34.089 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284677.log.gz 2023-07-07T04:02:34.089 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394726.log 2023-07-07T04:02:34.089 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.419343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.419343.log.gz 2023-07-07T04:02:34.089 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.408156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477531.log 2023-07-07T04:02:34.089 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408156.log.gz 2023-07-07T04:02:34.090 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.394726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107588.log 2023-07-07T04:02:34.090 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394726.log.gz 2023-07-07T04:02:34.090 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708372.log 2023-07-07T04:02:34.090 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.477531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.477531.log.gz 2023-07-07T04:02:34.090 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629456.log 2023-07-07T04:02:34.091 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.708372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257707.log 2023-07-07T04:02:34.091 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708372.log.gz 2023-07-07T04:02:34.091 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.629456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.802743.log 2023-07-07T04:02:34.091 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629456.log.gz 2023-07-07T04:02:34.091 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682722.log 2023-07-07T04:02:34.091 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.257707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257707.log.gz 2023-07-07T04:02:34.092 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.802743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162360.log 2023-07-07T04:02:34.092 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.802743.log.gz 2023-07-07T04:02:34.092 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.682722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347310.log 2023-07-07T04:02:34.092 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682722.log.gz 2023-07-07T04:02:34.092 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161353.log 2023-07-07T04:02:34.093 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.162360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162360.log.gz 2023-07-07T04:02:34.093 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.347310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306635.log 2023-07-07T04:02:34.093 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347310.log.gz 2023-07-07T04:02:34.093 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.161353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.940184.log 2023-07-07T04:02:34.093 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161353.log.gz 2023-07-07T04:02:34.094 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114254.log 2023-07-07T04:02:34.094 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.306635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306635.log.gz 2023-07-07T04:02:34.094 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.940184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327455.log 2023-07-07T04:02:34.094 INFO:teuthology.orchestra.run.smithi006.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.940184.log.gz 2023-07-07T04:02:34.094 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.706707.log 2023-07-07T04:02:34.095 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352817.log 2023-07-07T04:02:34.095 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.327455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327455.log.gz 2023-07-07T04:02:34.095 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.706707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.813033.log 2023-07-07T04:02:34.095 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.706707.log.gz 2023-07-07T04:02:34.095 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.352817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410818.log 2023-07-07T04:02:34.095 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352817.log.gz 2023-07-07T04:02:34.096 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.813033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.936118.log 2023-07-07T04:02:34.096 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.813033.log.gz 2023-07-07T04:02:34.096 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.410818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280539.log 2023-07-07T04:02:34.096 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410818.log.gz 2023-07-07T04:02:34.096 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.936118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394446.log 2023-07-07T04:02:34.097 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.936118.log.gz 2023-07-07T04:02:34.097 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283653.log 2023-07-07T04:02:34.097 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.280539.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280539.log.gz 2023-07-07T04:02:34.097 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.394446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351436.log 2023-07-07T04:02:34.097 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394446.log.gz 2023-07-07T04:02:34.098 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.283653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372043.log 2023-07-07T04:02:34.098 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283653.log.gz 2023-07-07T04:02:34.098 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194431.log 2023-07-07T04:02:34.098 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.351436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351436.log.gz 2023-07-07T04:02:34.098 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.372043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283335.log 2023-07-07T04:02:34.099 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372043.log.gz 2023-07-07T04:02:34.099 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.194431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425167.log 2023-07-07T04:02:34.099 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194431.log.gz 2023-07-07T04:02:34.099 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.799310.log 2023-07-07T04:02:34.099 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.283335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283335.log.gz 2023-07-07T04:02:34.099 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.425167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268695.log 2023-07-07T04:02:34.100 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.425167.log.gz 2023-07-07T04:02:34.100 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.799310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396969.log 2023-07-07T04:02:34.100 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.799310.log.gz 2023-07-07T04:02:34.100 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398275.log 2023-07-07T04:02:34.100 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.268695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268695.log.gz 2023-07-07T04:02:34.101 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.396969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.827510.log 2023-07-07T04:02:34.101 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396969.log.gz 2023-07-07T04:02:34.101 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.398275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626235.log 2023-07-07T04:02:34.101 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.398275.log.gz 2023-07-07T04:02:34.101 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.827510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174718.log 2023-07-07T04:02:34.102 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.827510.log.gz 2023-07-07T04:02:34.102 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.626235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.779066.log 2023-07-07T04:02:34.102 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626235.log.gz 2023-07-07T04:02:34.102 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.174718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477008.log 2023-07-07T04:02:34.102 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174718.log.gz 2023-07-07T04:02:34.102 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.779066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110727.log 2023-07-07T04:02:34.103 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.779066.log.gz 2023-07-07T04:02:34.103 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.477008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683896.log 2023-07-07T04:02:34.103 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.477008.log.gz 2023-07-07T04:02:34.103 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272643.log 2023-07-07T04:02:34.103 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.683896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250079.log 2023-07-07T04:02:34.104 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683896.log.gz 2023-07-07T04:02:34.104 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.272643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260579.log 2023-07-07T04:02:34.104 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272643.log.gz 2023-07-07T04:02:34.104 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.250079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654302.log 2023-07-07T04:02:34.104 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250079.log.gz 2023-07-07T04:02:34.105 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.260579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256599.log 2023-07-07T04:02:34.105 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260579.log.gz 2023-07-07T04:02:34.105 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.654302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330838.log 2023-07-07T04:02:34.105 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654302.log.gz 2023-07-07T04:02:34.105 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.256599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.935153.log 2023-07-07T04:02:34.105 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256599.log.gz 2023-07-07T04:02:34.106 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.330838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341039.log 2023-07-07T04:02:34.106 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330838.log.gz 2023-07-07T04:02:34.106 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.935153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618065.log 2023-07-07T04:02:34.106 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.935153.log.gz 2023-07-07T04:02:34.106 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.341039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381648.log 2023-07-07T04:02:34.107 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341039.log.gz 2023-07-07T04:02:34.107 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.618065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638730.log 2023-07-07T04:02:34.107 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618065.log.gz 2023-07-07T04:02:34.107 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.381648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272166.log 2023-07-07T04:02:34.107 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381648.log.gz 2023-07-07T04:02:34.107 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.638730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405530.log 2023-07-07T04:02:34.108 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638730.log.gz 2023-07-07T04:02:34.108 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.272166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326783.log 2023-07-07T04:02:34.108 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272166.log.gz 2023-07-07T04:02:34.108 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.405530.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.405530.log.gz--verbose 2023-07-07T04:02:34.108 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.205906.log 2023-07-07T04:02:34.109 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.326783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312001.log 2023-07-07T04:02:34.109 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326783.log.gz 2023-07-07T04:02:34.109 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.205906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.818307.log 2023-07-07T04:02:34.109 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205906.log.gz 2023-07-07T04:02:34.109 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.312001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299714.log 2023-07-07T04:02:34.110 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312001.log.gz 2023-07-07T04:02:34.110 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.818307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.941720.log 2023-07-07T04:02:34.110 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.818307.log.gz 2023-07-07T04:02:34.110 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.299714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634280.log 2023-07-07T04:02:34.111 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299714.log.gz 2023-07-07T04:02:34.111 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.941720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387995.log 2023-07-07T04:02:34.111 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.941720.log.gz 2023-07-07T04:02:34.111 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.634280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.940486.log 2023-07-07T04:02:34.111 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634280.log.gz 2023-07-07T04:02:34.111 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.387995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286216.log 2023-07-07T04:02:34.112 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387995.log.gz 2023-07-07T04:02:34.112 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.940486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170111.log 2023-07-07T04:02:34.112 INFO:teuthology.orchestra.run.smithi006.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.940486.log.gz 2023-07-07T04:02:34.112 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.286216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.804355.log 2023-07-07T04:02:34.112 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286216.log.gz 2023-07-07T04:02:34.113 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.170111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312561.log 2023-07-07T04:02:34.113 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170111.log.gz 2023-07-07T04:02:34.113 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.804355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112041.log 2023-07-07T04:02:34.113 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.804355.log.gz 2023-07-07T04:02:34.113 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.312561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173502.log 2023-07-07T04:02:34.114 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312561.log.gz 2023-07-07T04:02:34.114 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118869.log 2023-07-07T04:02:34.114 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.173502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.706614.log 2023-07-07T04:02:34.114 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173502.log.gz 2023-07-07T04:02:34.114 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268616.log 2023-07-07T04:02:34.115 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.706614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656322.log 2023-07-07T04:02:34.115 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.706614.log.gz 2023-07-07T04:02:34.115 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.268616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332620.log 2023-07-07T04:02:34.115 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268616.log.gz 2023-07-07T04:02:34.115 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.656322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349818.log 2023-07-07T04:02:34.115 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656322.log.gz 2023-07-07T04:02:34.116 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.332620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332620.log.gz 2023-07-07T04:02:34.116 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212546.log 2023-07-07T04:02:34.116 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.349818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159862.log 2023-07-07T04:02:34.116 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349818.log.gz 2023-07-07T04:02:34.116 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.212546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350128.log 2023-07-07T04:02:34.117 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212546.log.gz 2023-07-07T04:02:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.159862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334447.log 2023-07-07T04:02:34.117 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159862.log.gz 2023-07-07T04:02:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.350128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635488.log 2023-07-07T04:02:34.117 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350128.log.gz 2023-07-07T04:02:34.118 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.334447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709641.log 2023-07-07T04:02:34.118 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334447.log.gz 2023-07-07T04:02:34.118 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.635488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312547.log 2023-07-07T04:02:34.118 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635488.log.gz 2023-07-07T04:02:34.118 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.709641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301486.log 2023-07-07T04:02:34.119 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709641.log.gz 2023-07-07T04:02:34.119 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.312547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176666.log 2023-07-07T04:02:34.119 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312547.log.gz 2023-07-07T04:02:34.119 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.301486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292764.log 2023-07-07T04:02:34.119 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301486.log.gz 2023-07-07T04:02:34.119 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.176666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201495.log 2023-07-07T04:02:34.120 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176666.log.gz 2023-07-07T04:02:34.120 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.292764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280241.log 2023-07-07T04:02:34.120 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292764.log.gz 2023-07-07T04:02:34.120 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.201495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306063.log 2023-07-07T04:02:34.120 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201495.log.gz 2023-07-07T04:02:34.121 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.280241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277576.log 2023-07-07T04:02:34.121 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280241.log.gz 2023-07-07T04:02:34.121 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.306063.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.339962.log -- replaced with /var/log/ceph/ceph-client.admin.306063.log.gz 2023-07-07T04:02:34.121 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:34.121 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.277576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352427.log 2023-07-07T04:02:34.122 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277576.log.gz 2023-07-07T04:02:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.339962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201980.log 2023-07-07T04:02:34.122 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339962.log.gz 2023-07-07T04:02:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.352427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.653849.log 2023-07-07T04:02:34.122 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352427.log.gz 2023-07-07T04:02:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.201980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625878.log 2023-07-07T04:02:34.123 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201980.log.gz 2023-07-07T04:02:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.653849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114899.log 2023-07-07T04:02:34.123 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.653849.log.gz 2023-07-07T04:02:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.625878.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.266429.log 2023-07-07T04:02:34.123 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625878.log.gz 2023-07-07T04:02:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399219.log 2023-07-07T04:02:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.266429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673351.log 2023-07-07T04:02:34.124 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266429.log.gz 2023-07-07T04:02:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.399219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157375.log 2023-07-07T04:02:34.124 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399219.log.gz 2023-07-07T04:02:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.673351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348834.log 2023-07-07T04:02:34.125 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673351.log.gz 2023-07-07T04:02:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.157375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.711463.log 2023-07-07T04:02:34.125 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157375.log.gz 2023-07-07T04:02:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.348834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682736.log 2023-07-07T04:02:34.125 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348834.log.gz 2023-07-07T04:02:34.126 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174745.log 2023-07-07T04:02:34.126 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.711463.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.711463.log.gz 2023-07-07T04:02:34.126 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.682736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.764146.log 2023-07-07T04:02:34.126 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682736.log.gz 2023-07-07T04:02:34.126 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.174745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110726.log 2023-07-07T04:02:34.127 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174745.log.gz 2023-07-07T04:02:34.127 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.764146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.764146.log.gz 2023-07-07T04:02:34.127 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702042.log 2023-07-07T04:02:34.127 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699048.log 2023-07-07T04:02:34.127 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.702042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.679333.log 2023-07-07T04:02:34.127 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702042.log.gz 2023-07-07T04:02:34.128 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.699048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302543.log 2023-07-07T04:02:34.128 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699048.log.gz 2023-07-07T04:02:34.128 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.679333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.825362.log 2023-07-07T04:02:34.128 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.679333.log.gz 2023-07-07T04:02:34.129 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.302543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458984.log 2023-07-07T04:02:34.129 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302543.log.gz 2023-07-07T04:02:34.129 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.825362.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.825362.log.gz-- 2023-07-07T04:02:34.129 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.678846.log 2023-07-07T04:02:34.129 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.458984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194922.log 2023-07-07T04:02:34.129 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.458984.log.gz 2023-07-07T04:02:34.130 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.678846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346780.log 2023-07-07T04:02:34.130 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.678846.log.gz 2023-07-07T04:02:34.130 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.194922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681329.log 2023-07-07T04:02:34.130 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194922.log.gz 2023-07-07T04:02:34.130 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.346780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411802.log 2023-07-07T04:02:34.131 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346780.log.gz 2023-07-07T04:02:34.131 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.681329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681329.log.gz 2023-07-07T04:02:34.131 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165618.log 2023-07-07T04:02:34.131 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.411802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420501.log 2023-07-07T04:02:34.131 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411802.log.gz 2023-07-07T04:02:34.132 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.165618.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.165618.log.gz--verbose 2023-07-07T04:02:34.132 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.226484.log 2023-07-07T04:02:34.132 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.420501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400056.log 2023-07-07T04:02:34.132 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.420501.log.gz 2023-07-07T04:02:34.132 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.226484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111089.log 2023-07-07T04:02:34.132 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226484.log.gz 2023-07-07T04:02:34.133 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.400056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178674.log 2023-07-07T04:02:34.133 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.400056.log.gz 2023-07-07T04:02:34.133 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424636.log 2023-07-07T04:02:34.133 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111089.log: /var/log/ceph/ceph-client.admin.178674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424083.log 2023-07-07T04:02:34.133 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178674.log.gz 2023-07-07T04:02:34.134 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.424636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449169.log 2023-07-07T04:02:34.134 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.424636.log.gz 2023-07-07T04:02:34.134 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.424083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341763.log 2023-07-07T04:02:34.134 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.424083.log.gz 2023-07-07T04:02:34.134 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.449169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.449169.log.gz 2023-07-07T04:02:34.135 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709548.log 2023-07-07T04:02:34.135 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.341763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.804787.log 2023-07-07T04:02:34.135 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341763.log.gz 2023-07-07T04:02:34.135 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.709548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709548.log.gz 2023-07-07T04:02:34.135 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117130.log 2023-07-07T04:02:34.136 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.804787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273134.log 2023-07-07T04:02:34.136 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.804787.log.gz 2023-07-07T04:02:34.136 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704713.log 2023-07-07T04:02:34.136 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.273134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314915.log 2023-07-07T04:02:34.136 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273134.log.gz 2023-07-07T04:02:34.136 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.704713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107321.log 2023-07-07T04:02:34.137 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704713.log.gz 2023-07-07T04:02:34.137 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.314915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211994.log 2023-07-07T04:02:34.137 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314915.log.gz 2023-07-07T04:02:34.137 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639613.log 2023-07-07T04:02:34.137 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.211994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111466.log 2023-07-07T04:02:34.138 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211994.log.gz 2023-07-07T04:02:34.138 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.639613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639613.log.gz 2023-07-07T04:02:34.138 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423500.log 2023-07-07T04:02:34.138 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213994.log 2023-07-07T04:02:34.138 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.423500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660882.log 2023-07-07T04:02:34.139 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.423500.log.gz 2023-07-07T04:02:34.139 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.213994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111949.log 2023-07-07T04:02:34.139 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213994.log.gz 2023-07-07T04:02:34.139 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.660882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.660882.log.gz 2023-07-07T04:02:34.139 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409966.log 2023-07-07T04:02:34.139 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196595.log 2023-07-07T04:02:34.140 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.409966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246717.log 2023-07-07T04:02:34.140 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409966.log.gz 2023-07-07T04:02:34.140 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.196595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.689455.log 2023-07-07T04:02:34.140 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196595.log.gz 2023-07-07T04:02:34.140 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.246717.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246717.log.gz 2023-07-07T04:02:34.141 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372771.log 2023-07-07T04:02:34.141 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.689455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425721.log 2023-07-07T04:02:34.141 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.689455.log.gz 2023-07-07T04:02:34.141 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.372771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372771.log.gz 2023-07-07T04:02:34.141 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658341.log 2023-07-07T04:02:34.142 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.425721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208549.log 2023-07-07T04:02:34.142 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.425721.log.gz 2023-07-07T04:02:34.142 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.658341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.658341.log.gz 2023-07-07T04:02:34.142 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.622610.log 2023-07-07T04:02:34.142 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.208549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707189.log 2023-07-07T04:02:34.142 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208549.log.gz 2023-07-07T04:02:34.143 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.622610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622610.log.gz 2023-07-07T04:02:34.143 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111464.log 2023-07-07T04:02:34.143 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.707189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418910.log 2023-07-07T04:02:34.143 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707189.log.gz 2023-07-07T04:02:34.143 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373812.log 2023-07-07T04:02:34.144 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.418910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.804572.log 2023-07-07T04:02:34.144 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.418910.log.gz 2023-07-07T04:02:34.144 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.373812.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.373812.log.gz 2023-07-07T04:02:34.144 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333411.log 2023-07-07T04:02:34.144 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.804572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297469.log 2023-07-07T04:02:34.144 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.804572.log.gz 2023-07-07T04:02:34.145 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.333411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333411.log.gz 2023-07-07T04:02:34.145 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.814062.log 2023-07-07T04:02:34.145 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.297469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398754.log 2023-07-07T04:02:34.145 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.297469.log.gz 2023-07-07T04:02:34.145 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.814062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.814062.log.gz 2023-07-07T04:02:34.146 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273055.log 2023-07-07T04:02:34.146 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.398754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.781011.log 2023-07-07T04:02:34.146 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.398754.log.gz 2023-07-07T04:02:34.146 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.273055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273055.log.gz 2023-07-07T04:02:34.146 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.762601.log 2023-07-07T04:02:34.147 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.781011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322355.log 2023-07-07T04:02:34.147 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.781011.log.gz 2023-07-07T04:02:34.147 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.762601.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.762601.log.gz--verbose 2023-07-07T04:02:34.147 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.765131.log 2023-07-07T04:02:34.147 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.322355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684097.log 2023-07-07T04:02:34.147 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322355.log.gz 2023-07-07T04:02:34.148 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.765131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683189.log 2023-07-07T04:02:34.148 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.765131.log.gz 2023-07-07T04:02:34.148 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.684097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.802311.log 2023-07-07T04:02:34.148 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684097.log.gz 2023-07-07T04:02:34.148 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.683189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297376.log 2023-07-07T04:02:34.149 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683189.log.gz 2023-07-07T04:02:34.149 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.802311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175365.log 2023-07-07T04:02:34.149 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.802311.log.gz 2023-07-07T04:02:34.149 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.297376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402043.log 2023-07-07T04:02:34.149 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.297376.log.gz 2023-07-07T04:02:34.150 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.175365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371744.log 2023-07-07T04:02:34.150 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175365.log.gz 2023-07-07T04:02:34.150 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.402043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429345.log 2023-07-07T04:02:34.150 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.402043.log.gz 2023-07-07T04:02:34.150 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.371744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.371744.log.gz 2023-07-07T04:02:34.150 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.765341.log 2023-07-07T04:02:34.151 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.429345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477748.log 2023-07-07T04:02:34.151 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.429345.log.gz 2023-07-07T04:02:34.151 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.765341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206663.log 2023-07-07T04:02:34.151 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.765341.log.gz 2023-07-07T04:02:34.151 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.477748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293786.log 2023-07-07T04:02:34.152 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.477748.log.gz 2023-07-07T04:02:34.152 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.206663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407881.log 2023-07-07T04:02:34.152 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206663.log.gz 2023-07-07T04:02:34.152 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.293786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176573.log 2023-07-07T04:02:34.152 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293786.log.gz 2023-07-07T04:02:34.153 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.407881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254366.log 2023-07-07T04:02:34.153 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407881.log.gz 2023-07-07T04:02:34.153 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.176573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272657.log 2023-07-07T04:02:34.153 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176573.log.gz 2023-07-07T04:02:34.153 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.254366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343806.log 2023-07-07T04:02:34.153 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254366.log.gz 2023-07-07T04:02:34.154 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403462.log 2023-07-07T04:02:34.154 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.272657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272657.log.gz 2023-07-07T04:02:34.154 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.343806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659843.log 2023-07-07T04:02:34.154 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343806.log.gz 2023-07-07T04:02:34.154 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.403462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.776192.log 2023-07-07T04:02:34.155 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.403462.log.gz 2023-07-07T04:02:34.155 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.659843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.824311.log 2023-07-07T04:02:34.155 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659843.log.gz 2023-07-07T04:02:34.155 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.776192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335181.log 2023-07-07T04:02:34.155 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.776192.log.gz 2023-07-07T04:02:34.156 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.824311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645506.log 2023-07-07T04:02:34.156 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.824311.log.gz 2023-07-07T04:02:34.156 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.335181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365208.log 2023-07-07T04:02:34.156 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335181.log.gz 2023-07-07T04:02:34.156 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.645506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.113183.log 2023-07-07T04:02:34.156 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645506.log.gz 2023-07-07T04:02:34.157 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.365208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369522.log 2023-07-07T04:02:34.157 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365208.log.gz 2023-07-07T04:02:34.157 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.113183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381634.log 2023-07-07T04:02:34.157 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.113183.log.gz 2023-07-07T04:02:34.157 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.369522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296958.log 2023-07-07T04:02:34.158 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.369522.log.gz 2023-07-07T04:02:34.158 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.381634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459216.log 2023-07-07T04:02:34.158 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381634.log.gz 2023-07-07T04:02:34.158 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.296958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.762134.log 2023-07-07T04:02:34.158 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.296958.log.gz 2023-07-07T04:02:34.158 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.459216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213901.log 2023-07-07T04:02:34.159 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.459216.log.gz 2023-07-07T04:02:34.159 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.762134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352896.log 2023-07-07T04:02:34.159 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.762134.log.gz 2023-07-07T04:02:34.159 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.213901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281482.log 2023-07-07T04:02:34.159 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213901.log.gz 2023-07-07T04:02:34.160 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.352896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243826.log 2023-07-07T04:02:34.160 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352896.log.gz 2023-07-07T04:02:34.160 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423990.log 2023-07-07T04:02:34.160 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.281482.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281482.log.gz 2023-07-07T04:02:34.160 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.243826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.827097.log 2023-07-07T04:02:34.161 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243826.log.gz 2023-07-07T04:02:34.161 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.423990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207570.log 2023-07-07T04:02:34.161 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.423990.log.gz 2023-07-07T04:02:34.161 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.827097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192163.log 2023-07-07T04:02:34.161 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.827097.log.gz 2023-07-07T04:02:34.161 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.207570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158336.log 2023-07-07T04:02:34.162 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207570.log.gz 2023-07-07T04:02:34.162 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.192163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.818321.log 2023-07-07T04:02:34.162 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192163.log.gz 2023-07-07T04:02:34.162 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.760099.log 2023-07-07T04:02:34.162 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.158336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158336.log.gz 2023-07-07T04:02:34.163 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.818321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356026.log 2023-07-07T04:02:34.163 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.818321.log.gz 2023-07-07T04:02:34.163 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.760099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244668.log 2023-07-07T04:02:34.163 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.760099.log.gz 2023-07-07T04:02:34.163 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308626.log 2023-07-07T04:02:34.163 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.356026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356026.log.gz 2023-07-07T04:02:34.164 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.244668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344635.log 2023-07-07T04:02:34.164 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244668.log.gz 2023-07-07T04:02:34.164 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.308626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333843.log 2023-07-07T04:02:34.164 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308626.log.gz 2023-07-07T04:02:34.164 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.779052.log 2023-07-07T04:02:34.165 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.344635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344635.log.gz 2023-07-07T04:02:34.165 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.333843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.804866.log 2023-07-07T04:02:34.165 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333843.log.gz 2023-07-07T04:02:34.165 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.779052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114807.log 2023-07-07T04:02:34.165 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.779052.log.gz 2023-07-07T04:02:34.166 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.804866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.808457.log 2023-07-07T04:02:34.166 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.804866.log.gz 2023-07-07T04:02:34.166 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407298.log 2023-07-07T04:02:34.166 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.808457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480533.log 2023-07-07T04:02:34.166 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.808457.log.gz 2023-07-07T04:02:34.166 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.407298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171971.log 2023-07-07T04:02:34.167 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407298.log.gz 2023-07-07T04:02:34.167 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195413.log 2023-07-07T04:02:34.167 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.480533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.480533.log.gz 2023-07-07T04:02:34.167 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.171971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200917.log 2023-07-07T04:02:34.167 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171971.log.gz 2023-07-07T04:02:34.168 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.195413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333332.log 2023-07-07T04:02:34.168 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195413.log.gz 2023-07-07T04:02:34.168 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214923.log 2023-07-07T04:02:34.168 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.200917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200917.log.gz 2023-07-07T04:02:34.168 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153833.log 2023-07-07T04:02:34.169 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.333332.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333332.log.gz 2023-07-07T04:02:34.169 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.214923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195109.log 2023-07-07T04:02:34.169 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214923.log.gz 2023-07-07T04:02:34.169 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.153833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284896.log 2023-07-07T04:02:34.169 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153833.log.gz 2023-07-07T04:02:34.170 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.195109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460397.log 2023-07-07T04:02:34.170 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195109.log.gz 2023-07-07T04:02:34.170 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.284896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226577.log 2023-07-07T04:02:34.170 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284896.log.gz 2023-07-07T04:02:34.170 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217133.log 2023-07-07T04:02:34.170 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.460397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.460397.log.gz 2023-07-07T04:02:34.171 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.226577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.672122.log 2023-07-07T04:02:34.171 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226577.log.gz 2023-07-07T04:02:34.171 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.217133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396291.log 2023-07-07T04:02:34.171 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217133.log.gz 2023-07-07T04:02:34.171 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 /var/log/ceph/ceph-client.admin.672122.log: --verbose -- /var/log/ceph/ceph-client.admin.623601.log 2023-07-07T04:02:34.172 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.672122.log.gz 2023-07-07T04:02:34.172 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.396291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.816410.log 2023-07-07T04:02:34.172 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396291.log.gz 2023-07-07T04:02:34.172 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.623601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266390.log 2023-07-07T04:02:34.172 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623601.log.gz 2023-07-07T04:02:34.173 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.816410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.797477.log 2023-07-07T04:02:34.173 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.816410.log.gz 2023-07-07T04:02:34.173 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.266390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247205.log 2023-07-07T04:02:34.173 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266390.log.gz 2023-07-07T04:02:34.173 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.797477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686104.log 2023-07-07T04:02:34.173 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.797477.log.gz 2023-07-07T04:02:34.174 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.773061.log 2023-07-07T04:02:34.174 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.247205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247205.log.gz 2023-07-07T04:02:34.174 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.686104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284178.log 2023-07-07T04:02:34.174 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686104.log.gz 2023-07-07T04:02:34.174 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.773061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415874.log 2023-07-07T04:02:34.175 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.773061.log.gz 2023-07-07T04:02:34.175 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.284178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283356.log 2023-07-07T04:02:34.175 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284178.log.gz 2023-07-07T04:02:34.175 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.415874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398740.log 2023-07-07T04:02:34.175 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.415874.log.gz 2023-07-07T04:02:34.175 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.283356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479732.log 2023-07-07T04:02:34.176 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283356.log.gz 2023-07-07T04:02:34.176 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398740.log: /var/log/ceph/ceph-client.admin.194618.log 2023-07-07T04:02:34.176 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.398740.log.gz 2023-07-07T04:02:34.176 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.479732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673060.log 2023-07-07T04:02:34.176 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.479732.log.gz 2023-07-07T04:02:34.177 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.194618.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.111094.log.gz 2023-07-07T04:02:34.177 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621164.log 2023-07-07T04:02:34.177 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194618.log.gz 2023-07-07T04:02:34.177 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.673060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.642541.log 2023-07-07T04:02:34.177 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673060.log.gz 2023-07-07T04:02:34.178 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.621164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291450.log 2023-07-07T04:02:34.178 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621164.log.gz 2023-07-07T04:02:34.178 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.642541.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111464.log.gz 2023-07-07T04:02:34.178 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695857.log 2023-07-07T04:02:34.178 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.642541.log.gz 2023-07-07T04:02:34.178 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407284.log 2023-07-07T04:02:34.179 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.291450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291450.log.gz 2023-07-07T04:02:34.179 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.695857.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.695857.log.gz--verbose 2023-07-07T04:02:34.179 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.399126.log 2023-07-07T04:02:34.179 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.407284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353643.log 2023-07-07T04:02:34.179 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407284.log.gz 2023-07-07T04:02:34.180 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.399126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.940854.log 2023-07-07T04:02:34.180 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399126.log.gz 2023-07-07T04:02:34.180 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416601.log 2023-07-07T04:02:34.180 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.353643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353643.log.gz 2023-07-07T04:02:34.180 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.940854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654783.log 2023-07-07T04:02:34.181 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.940854.log.gz 2023-07-07T04:02:34.181 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.416601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112455.log 2023-07-07T04:02:34.181 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.416601.log.gz 2023-07-07T04:02:34.181 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.654783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197366.log 2023-07-07T04:02:34.181 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654783.log.gz 2023-07-07T04:02:34.181 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.775293.log 2023-07-07T04:02:34.182 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.197366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302011.log 2023-07-07T04:02:34.182 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197366.log.gz 2023-07-07T04:02:34.182 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.775293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.653310.log 2023-07-07T04:02:34.182 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.775293.log.gz 2023-07-07T04:02:34.182 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.302011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290728.log 2023-07-07T04:02:34.183 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302011.log.gz 2023-07-07T04:02:34.183 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.653310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654210.log 2023-07-07T04:02:34.183 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.653310.log.gz 2023-07-07T04:02:34.183 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.290728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392810.log 2023-07-07T04:02:34.183 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290728.log.gz 2023-07-07T04:02:34.184 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.654210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378835.log 2023-07-07T04:02:34.184 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654210.log.gz 2023-07-07T04:02:34.184 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.392810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282504.log 2023-07-07T04:02:34.184 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392810.log.gz 2023-07-07T04:02:34.184 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.378835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632823.log 2023-07-07T04:02:34.185 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.378835.log.gz 2023-07-07T04:02:34.185 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224219.log 2023-07-07T04:02:34.185 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.282504.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282504.log.gz 2023-07-07T04:02:34.185 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.632823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319306.log 2023-07-07T04:02:34.185 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632823.log.gz 2023-07-07T04:02:34.186 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.224219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375770.log 2023-07-07T04:02:34.186 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224219.log.gz 2023-07-07T04:02:34.186 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317333.log 2023-07-07T04:02:34.186 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.319306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319306.log.gz 2023-07-07T04:02:34.186 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.375770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395251.log 2023-07-07T04:02:34.187 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.375770.log.gz 2023-07-07T04:02:34.187 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.317333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459909.log 2023-07-07T04:02:34.187 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317333.log.gz 2023-07-07T04:02:34.187 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258187.log 2023-07-07T04:02:34.187 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.395251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395251.log.gz 2023-07-07T04:02:34.187 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.459909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313724.log 2023-07-07T04:02:34.188 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.459909.log.gz 2023-07-07T04:02:34.188 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.258187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216742.log 2023-07-07T04:02:34.188 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258187.log.gz 2023-07-07T04:02:34.188 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.711960.log 2023-07-07T04:02:34.188 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.313724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313724.log.gz 2023-07-07T04:02:34.189 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.216742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170634.log 2023-07-07T04:02:34.189 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216742.log.gz 2023-07-07T04:02:34.189 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.711960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385473.log 2023-07-07T04:02:34.189 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.711960.log.gz 2023-07-07T04:02:34.190 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 /var/log/ceph/ceph-client.admin.170634.log: --verbose -- /var/log/ceph/ceph-client.admin.806119.log 2023-07-07T04:02:34.190 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170634.log.gz 2023-07-07T04:02:34.190 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.385473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319012.log 2023-07-07T04:02:34.190 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385473.log.gz 2023-07-07T04:02:34.190 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.806119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639893.log 2023-07-07T04:02:34.191 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.806119.log.gz 2023-07-07T04:02:34.191 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351357.log /var/log/ceph/ceph-client.admin.319012.log: 2023-07-07T04:02:34.191 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319012.log.gz 2023-07-07T04:02:34.191 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.639893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.929897.log 2023-07-07T04:02:34.191 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639893.log.gz 2023-07-07T04:02:34.191 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.351357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249986.log 2023-07-07T04:02:34.192 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351357.log.gz 2023-07-07T04:02:34.192 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.929897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.932232.log 2023-07-07T04:02:34.192 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.929897.log.gz 2023-07-07T04:02:34.192 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249986.log: /var/log/ceph/ceph-client.admin.669502.log 2023-07-07T04:02:34.192 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249986.log.gz 2023-07-07T04:02:34.193 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.932232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393180.log 2023-07-07T04:02:34.193 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.932232.log.gz 2023-07-07T04:02:34.193 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.669502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271184.log 2023-07-07T04:02:34.193 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.669502.log.gz 2023-07-07T04:02:34.193 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.393180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227300.log 2023-07-07T04:02:34.194 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393180.log.gz 2023-07-07T04:02:34.194 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.271184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621539.log 2023-07-07T04:02:34.194 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271184.log.gz 2023-07-07T04:02:34.194 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355693.log 2023-07-07T04:02:34.194 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.227300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227300.log.gz 2023-07-07T04:02:34.194 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.621539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353412.log 2023-07-07T04:02:34.195 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621539.log.gz 2023-07-07T04:02:34.195 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.355693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285190.log 2023-07-07T04:02:34.195 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355693.log.gz 2023-07-07T04:02:34.195 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.353412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215125.log 2023-07-07T04:02:34.195 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353412.log.gz 2023-07-07T04:02:34.196 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.285190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657368.log 2023-07-07T04:02:34.196 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285190.log.gz 2023-07-07T04:02:34.196 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.215125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.757764.log 2023-07-07T04:02:34.196 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215125.log.gz 2023-07-07T04:02:34.196 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397728.log 2023-07-07T04:02:34.197 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.657368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.657368.log.gz 2023-07-07T04:02:34.197 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.757764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.760762.log 2023-07-07T04:02:34.197 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.757764.log.gz 2023-07-07T04:02:34.197 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.397728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447803.log 2023-07-07T04:02:34.197 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.397728.log.gz 2023-07-07T04:02:34.197 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.760762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477452.log 2023-07-07T04:02:34.198 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.760762.log.gz 2023-07-07T04:02:34.198 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.447803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.935232.log 2023-07-07T04:02:34.198 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.447803.log.gz 2023-07-07T04:02:34.198 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.477452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413328.log 2023-07-07T04:02:34.198 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.477452.log.gz 2023-07-07T04:02:34.199 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.935232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413421.log 2023-07-07T04:02:34.199 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.935232.log.gz 2023-07-07T04:02:34.199 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.413328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110718.log 2023-07-07T04:02:34.199 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413328.log.gz 2023-07-07T04:02:34.199 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.413421.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.413421.log.gz-- 2023-07-07T04:02:34.199 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.381007.log 2023-07-07T04:02:34.200 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683671.log 2023-07-07T04:02:34.200 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.800484.log 2023-07-07T04:02:34.200 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.381007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381007.log.gz 2023-07-07T04:02:34.200 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.683671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386545.log 2023-07-07T04:02:34.200 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683671.log.gz 2023-07-07T04:02:34.201 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.800484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694218.log 2023-07-07T04:02:34.201 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.800484.log.gz 2023-07-07T04:02:34.201 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.386545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373084.log 2023-07-07T04:02:34.201 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386545.log.gz 2023-07-07T04:02:34.201 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268125.log 2023-07-07T04:02:34.202 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.694218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694218.log.gz 2023-07-07T04:02:34.202 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.373084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654256.log 2023-07-07T04:02:34.202 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.373084.log.gz 2023-07-07T04:02:34.202 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.268125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425735.log 2023-07-07T04:02:34.202 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268125.log.gz 2023-07-07T04:02:34.203 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.654256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394943.log 2023-07-07T04:02:34.203 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654256.log.gz 2023-07-07T04:02:34.203 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.425735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381964.log 2023-07-07T04:02:34.203 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.425735.log.gz 2023-07-07T04:02:34.203 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.394943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659156.log 2023-07-07T04:02:34.203 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394943.log.gz 2023-07-07T04:02:34.204 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116055.log 2023-07-07T04:02:34.204 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.381964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381964.log.gz 2023-07-07T04:02:34.204 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.659156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.777269.log 2023-07-07T04:02:34.204 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659156.log.gz 2023-07-07T04:02:34.204 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194417.log 2023-07-07T04:02:34.205 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294514.log 2023-07-07T04:02:34.205 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.777269.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.777269.log.gz 2023-07-07T04:02:34.205 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.194417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.643986.log 2023-07-07T04:02:34.205 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194417.log.gz 2023-07-07T04:02:34.205 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.294514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.804075.log 2023-07-07T04:02:34.206 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294514.log.gz 2023-07-07T04:02:34.206 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.643986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.941222.log 2023-07-07T04:02:34.206 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.643986.log.gz 2023-07-07T04:02:34.206 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.804075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.810037.log 2023-07-07T04:02:34.206 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.804075.log.gz 2023-07-07T04:02:34.206 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.941222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327174.log 2023-07-07T04:02:34.207 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.941222.log.gz 2023-07-07T04:02:34.207 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.810037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391416.log 2023-07-07T04:02:34.207 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.810037.log.gz 2023-07-07T04:02:34.207 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.327174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369058.log 2023-07-07T04:02:34.207 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327174.log.gz 2023-07-07T04:02:34.208 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.391416.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.391416.log.gz--verbose 2023-07-07T04:02:34.208 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.449730.log 2023-07-07T04:02:34.208 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.369058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418924.log 2023-07-07T04:02:34.208 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.369058.log.gz 2023-07-07T04:02:34.208 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.449730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.670021.log 2023-07-07T04:02:34.209 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.449730.log.gz 2023-07-07T04:02:34.209 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.418924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120395.log 2023-07-07T04:02:34.209 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.418924.log.gz 2023-07-07T04:02:34.209 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.670021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671633.log 2023-07-07T04:02:34.209 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.670021.log.gz 2023-07-07T04:02:34.209 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.120395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413805.log 2023-07-07T04:02:34.210 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.671633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214455.log 2023-07-07T04:02:34.210 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671633.log.gz 2023-07-07T04:02:34.210 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.413805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274528.log 2023-07-07T04:02:34.210 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413805.log.gz 2023-07-07T04:02:34.210 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.214455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158891.log 2023-07-07T04:02:34.211 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214455.log.gz 2023-07-07T04:02:34.211 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.274528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293275.log 2023-07-07T04:02:34.211 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274528.log.gz 2023-07-07T04:02:34.211 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.158891.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.158891.log.gz-5 2023-07-07T04:02:34.212 INFO:teuthology.orchestra.run.smithi006.stderr:--verbose -- /var/log/ceph/ceph-client.admin.112363.log 2023-07-07T04:02:34.212 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.293275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.808443.log 2023-07-07T04:02:34.212 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293275.log.gz 2023-07-07T04:02:34.212 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.815412.log 2023-07-07T04:02:34.212 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.808443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301997.log 2023-07-07T04:02:34.213 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.808443.log.gz 2023-07-07T04:02:34.213 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.815412.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.815412.log.gz--verbose 2023-07-07T04:02:34.213 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.761256.log 2023-07-07T04:02:34.213 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.301997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384654.log 2023-07-07T04:02:34.213 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301997.log.gz 2023-07-07T04:02:34.213 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.761256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110728.log 2023-07-07T04:02:34.214 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.761256.log.gz 2023-07-07T04:02:34.214 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.384654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.817762.log 2023-07-07T04:02:34.214 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384654.log.gz 2023-07-07T04:02:34.214 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363211.log 2023-07-07T04:02:34.214 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.817762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118434.log 2023-07-07T04:02:34.215 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.817762.log.gz 2023-07-07T04:02:34.215 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.363211.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.211094.log 2023-07-07T04:02:34.215 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363211.log.gz 2023-07-07T04:02:34.215 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192374.log 2023-07-07T04:02:34.215 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.211094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281575.log 2023-07-07T04:02:34.216 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211094.log.gz 2023-07-07T04:02:34.216 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.192374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336600.log 2023-07-07T04:02:34.216 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192374.log.gz 2023-07-07T04:02:34.216 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.281575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270109.log 2023-07-07T04:02:34.216 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281575.log.gz 2023-07-07T04:02:34.216 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.336600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336600.log.gz 2023-07-07T04:02:34.217 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287161.log 2023-07-07T04:02:34.217 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.270109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.673074.log 2023-07-07T04:02:34.217 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270109.log.gz 2023-07-07T04:02:34.217 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.287161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335480.log 2023-07-07T04:02:34.217 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287161.log.gz 2023-07-07T04:02:34.218 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.673074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693026.log 2023-07-07T04:02:34.218 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.673074.log.gz 2023-07-07T04:02:34.218 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.335480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635205.log 2023-07-07T04:02:34.218 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335480.log.gz 2023-07-07T04:02:34.218 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.693026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118731.log 2023-07-07T04:02:34.219 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693026.log.gz 2023-07-07T04:02:34.219 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.635205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345993.log 2023-07-07T04:02:34.219 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635205.log.gz 2023-07-07T04:02:34.219 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709074.log 2023-07-07T04:02:34.219 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.345993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.941628.log 2023-07-07T04:02:34.220 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345993.log.gz 2023-07-07T04:02:34.220 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.709074.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.111462.log 2023-07-07T04:02:34.220 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709074.log.gz 2023-07-07T04:02:34.220 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.941628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387484.log 2023-07-07T04:02:34.220 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700406.log 2023-07-07T04:02:34.221 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.941628.log.gz 2023-07-07T04:02:34.221 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.387484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251844.log 2023-07-07T04:02:34.221 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387484.log.gz 2023-07-07T04:02:34.221 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.700406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117176.log 2023-07-07T04:02:34.221 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700406.log.gz 2023-07-07T04:02:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.251844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.113848.log 2023-07-07T04:02:34.222 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251844.log.gz 2023-07-07T04:02:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206382.log 2023-07-07T04:02:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.2.113848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397821.log 2023-07-07T04:02:34.222 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.113848.log.gz 2023-07-07T04:02:34.223 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410911.log 2023-07-07T04:02:34.223 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.206382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206382.log.gz 2023-07-07T04:02:34.223 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.397821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328434.log 2023-07-07T04:02:34.223 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.397821.log.gz 2023-07-07T04:02:34.223 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.410911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410911.log.gz 2023-07-07T04:02:34.223 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118108.log 2023-07-07T04:02:34.224 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.328434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250065.log 2023-07-07T04:02:34.224 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328434.log.gz 2023-07-07T04:02:34.224 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332097.log 2023-07-07T04:02:34.224 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.250065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227315.log 2023-07-07T04:02:34.224 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250065.log.gz 2023-07-07T04:02:34.225 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.332097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699631.log 2023-07-07T04:02:34.225 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332097.log.gz 2023-07-07T04:02:34.225 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.227315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635298.log 2023-07-07T04:02:34.225 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227315.log.gz 2023-07-07T04:02:34.225 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.699631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.931347.log 2023-07-07T04:02:34.226 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699631.log.gz 2023-07-07T04:02:34.226 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.635298.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.635298.log.gz--verbose 2023-07-07T04:02:34.226 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.218614.log 2023-07-07T04:02:34.226 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.931347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114346.log 2023-07-07T04:02:34.226 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.931347.log.gz 2023-07-07T04:02:34.227 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.218614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157847.log 2023-07-07T04:02:34.227 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218614.log.gz 2023-07-07T04:02:34.227 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265616.log 2023-07-07T04:02:34.227 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.157847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.941536.log 2023-07-07T04:02:34.227 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157847.log.gz 2023-07-07T04:02:34.227 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.265616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.808685.log 2023-07-07T04:02:34.228 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265616.log.gz 2023-07-07T04:02:34.228 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.941536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.670828.log 2023-07-07T04:02:34.228 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.808685.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.941536.log.gz 2023-07-07T04:02:34.228 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385179.log 2023-07-07T04:02:34.228 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.808685.log.gz 2023-07-07T04:02:34.229 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.670828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417377.log 2023-07-07T04:02:34.229 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.670828.log.gz 2023-07-07T04:02:34.229 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.385179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203598.log 2023-07-07T04:02:34.229 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385179.log.gz 2023-07-07T04:02:34.229 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.417377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.417377.log.gz 2023-07-07T04:02:34.230 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415392.log 2023-07-07T04:02:34.230 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.203598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375088.log 2023-07-07T04:02:34.230 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.203598.log.gz 2023-07-07T04:02:34.230 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.415392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.758915.log 2023-07-07T04:02:34.230 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.415392.log.gz 2023-07-07T04:02:34.231 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.375088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266107.log 2023-07-07T04:02:34.231 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.375088.log.gz 2023-07-07T04:02:34.231 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.758915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.931750.log 2023-07-07T04:02:34.231 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.758915.log.gz 2023-07-07T04:02:34.231 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.266107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.798503.log 2023-07-07T04:02:34.231 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266107.log.gz 2023-07-07T04:02:34.232 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.931750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318809.log 2023-07-07T04:02:34.232 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.931750.log.gz 2023-07-07T04:02:34.232 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.798503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.764617.log 2023-07-07T04:02:34.232 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.798503.log.gz 2023-07-07T04:02:34.232 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.318809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.810702.log 2023-07-07T04:02:34.233 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318809.log.gz 2023-07-07T04:02:34.233 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.764617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299480.log 2023-07-07T04:02:34.233 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.764617.log.gz 2023-07-07T04:02:34.233 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.810702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627457.log 2023-07-07T04:02:34.233 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.810702.log.gz 2023-07-07T04:02:34.233 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.299480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.758141.log 2023-07-07T04:02:34.234 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299480.log.gz 2023-07-07T04:02:34.234 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.627457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269401.log 2023-07-07T04:02:34.234 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627457.log.gz 2023-07-07T04:02:34.234 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.758141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703663.log 2023-07-07T04:02:34.234 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.758141.log.gz 2023-07-07T04:02:34.235 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.269401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.930877.log 2023-07-07T04:02:34.235 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269401.log.gz 2023-07-07T04:02:34.235 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.703663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294204.log 2023-07-07T04:02:34.235 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703663.log.gz 2023-07-07T04:02:34.235 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.930877.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.930877.log.gz 2023-07-07T04:02:34.236 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634979.log 2023-07-07T04:02:34.236 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.294204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112271.log 2023-07-07T04:02:34.236 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294204.log.gz 2023-07-07T04:02:34.236 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.634979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682269.log 2023-07-07T04:02:34.236 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634979.log.gz 2023-07-07T04:02:34.237 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108224.log 2023-07-07T04:02:34.237 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.682269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.938612.log 2023-07-07T04:02:34.237 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682269.log.gz 2023-07-07T04:02:34.237 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.108224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279523.log 2023-07-07T04:02:34.237 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.938612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353127.log 2023-07-07T04:02:34.237 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.938612.log.gz 2023-07-07T04:02:34.238 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.279523.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.279523.log.gz--verbose 2023-07-07T04:02:34.238 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.159955.log 2023-07-07T04:02:34.238 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.353127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475095.log 2023-07-07T04:02:34.238 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353127.log.gz 2023-07-07T04:02:34.238 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.159955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630388.log 2023-07-07T04:02:34.239 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159955.log.gz 2023-07-07T04:02:34.239 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.475095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.475095.log.gz 2023-07-07T04:02:34.239 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654153.log 2023-07-07T04:02:34.239 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.630388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.808163.log 2023-07-07T04:02:34.239 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630388.log.gz 2023-07-07T04:02:34.239 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.654153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328231.log 2023-07-07T04:02:34.240 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654153.log.gz 2023-07-07T04:02:34.240 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.808163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.939105.log 2023-07-07T04:02:34.240 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.808163.log.gz 2023-07-07T04:02:34.240 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.328231.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.192654.log 2023-07-07T04:02:34.241 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328231.log.gz 2023-07-07T04:02:34.241 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.939105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117609.log 2023-07-07T04:02:34.241 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.939105.log.gz 2023-07-07T04:02:34.241 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.192654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258851.log 2023-07-07T04:02:34.241 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192654.log.gz 2023-07-07T04:02:34.241 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657779.log 2023-07-07T04:02:34.242 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.258851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115221.log 2023-07-07T04:02:34.242 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258851.log.gz 2023-07-07T04:02:34.242 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.657779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447025.log 2023-07-07T04:02:34.242 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.657779.log.gz 2023-07-07T04:02:34.242 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477221.log 2023-07-07T04:02:34.243 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.447025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704620.log 2023-07-07T04:02:34.243 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.447025.log.gz 2023-07-07T04:02:34.243 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.477221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275603.log 2023-07-07T04:02:34.243 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.477221.log.gz 2023-07-07T04:02:34.243 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.704620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.801009.log 2023-07-07T04:02:34.243 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704620.log.gz 2023-07-07T04:02:34.244 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.275603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275603.log.gz 2023-07-07T04:02:34.244 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320336.log 2023-07-07T04:02:34.244 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.801009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344105.log 2023-07-07T04:02:34.244 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.801009.log.gz 2023-07-07T04:02:34.244 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.320336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390860.log 2023-07-07T04:02:34.245 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320336.log.gz 2023-07-07T04:02:34.245 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.344105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475479.log 2023-07-07T04:02:34.245 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344105.log.gz 2023-07-07T04:02:34.245 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.390860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423486.log 2023-07-07T04:02:34.245 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.390860.log.gz 2023-07-07T04:02:34.246 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.475479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312468.log 2023-07-07T04:02:34.246 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.475479.log.gz 2023-07-07T04:02:34.246 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.423486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.823836.log 2023-07-07T04:02:34.246 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.423486.log.gz 2023-07-07T04:02:34.246 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.312468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308525.log 2023-07-07T04:02:34.246 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312468.log.gz 2023-07-07T04:02:34.247 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.823836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116708.log 2023-07-07T04:02:34.247 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.823836.log.gz 2023-07-07T04:02:34.247 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.308525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680068.log 2023-07-07T04:02:34.247 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308525.log.gz 2023-07-07T04:02:34.247 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628024.log 2023-07-07T04:02:34.248 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.680068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680068.log.gz 2023-07-07T04:02:34.248 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.622100.log 2023-07-07T04:02:34.248 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.628024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307512.log 2023-07-07T04:02:34.248 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628024.log.gz 2023-07-07T04:02:34.248 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.622100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379858.log 2023-07-07T04:02:34.249 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622100.log.gz 2023-07-07T04:02:34.249 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.307512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176652.log 2023-07-07T04:02:34.249 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307512.log.gz 2023-07-07T04:02:34.249 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.379858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290448.log 2023-07-07T04:02:34.249 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.379858.log.gz 2023-07-07T04:02:34.249 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.176652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367339.log 2023-07-07T04:02:34.250 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176652.log.gz 2023-07-07T04:02:34.250 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.290448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264282.log 2023-07-07T04:02:34.250 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290448.log.gz 2023-07-07T04:02:34.250 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.367339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.776964.log 2023-07-07T04:02:34.250 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.367339.log.gz 2023-07-07T04:02:34.251 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.264282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350329.log 2023-07-07T04:02:34.251 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264282.log.gz 2023-07-07T04:02:34.251 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.776964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286742.log 2023-07-07T04:02:34.251 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.776964.log.gz 2023-07-07T04:02:34.251 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.350329.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.942025.log 2023-07-07T04:02:34.252 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350329.log.gz 2023-07-07T04:02:34.252 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.286742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646532.log 2023-07-07T04:02:34.252 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286742.log.gz 2023-07-07T04:02:34.252 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.942025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.669595.log 2023-07-07T04:02:34.252 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.646532.log: 89.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.942025.log.gz--verbose 2023-07-07T04:02:34.252 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.701460.log 2023-07-07T04:02:34.253 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646532.log.gz 2023-07-07T04:02:34.253 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.669595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116984.log 2023-07-07T04:02:34.253 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.669595.log.gz 2023-07-07T04:02:34.253 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.701460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117406.log 2023-07-07T04:02:34.253 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701460.log.gz 2023-07-07T04:02:34.254 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262285.log 2023-07-07T04:02:34.254 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328959.log 2023-07-07T04:02:34.254 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.262285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308310.log 2023-07-07T04:02:34.254 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262285.log.gz 2023-07-07T04:02:34.254 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111466.log.gz 2023-07-07T04:02:34.255 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.328959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355150.log 2023-07-07T04:02:34.255 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328959.log.gz 2023-07-07T04:02:34.255 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.308310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308310.log.gz 2023-07-07T04:02:34.255 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115825.log 2023-07-07T04:02:34.255 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111765.log.gz 2023-07-07T04:02:34.255 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.355150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249450.log 2023-07-07T04:02:34.256 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355150.log.gz 2023-07-07T04:02:34.256 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308324.log 2023-07-07T04:02:34.256 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.249450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.810051.log 2023-07-07T04:02:34.256 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249450.log.gz 2023-07-07T04:02:34.256 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.308324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.933304.log 2023-07-07T04:02:34.257 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308324.log.gz 2023-07-07T04:02:34.257 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.810051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199039.log 2023-07-07T04:02:34.257 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.810051.log.gz 2023-07-07T04:02:34.257 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.933304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366874.log 2023-07-07T04:02:34.257 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.933304.log.gz 2023-07-07T04:02:34.258 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.199039.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.199039.log.gz--verbose 2023-07-07T04:02:34.258 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.172443.log 2023-07-07T04:02:34.258 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.366874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114116.log 2023-07-07T04:02:34.258 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366874.log.gz 2023-07-07T04:02:34.258 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.172443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268218.log 2023-07-07T04:02:34.258 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172443.log.gz 2023-07-07T04:02:34.259 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226563.log 2023-07-07T04:02:34.259 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.268218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204938.log 2023-07-07T04:02:34.259 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268218.log.gz 2023-07-07T04:02:34.259 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.226563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699645.log 2023-07-07T04:02:34.259 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226563.log.gz 2023-07-07T04:02:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290434.log 2023-07-07T04:02:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.204938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204938.log.gz 2023-07-07T04:02:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.699645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274037.log 2023-07-07T04:02:34.260 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699645.log.gz 2023-07-07T04:02:34.260 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.290434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285936.log 2023-07-07T04:02:34.260 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290434.log.gz 2023-07-07T04:02:34.261 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224850.log 2023-07-07T04:02:34.261 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.274037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274037.log.gz 2023-07-07T04:02:34.261 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.285936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.801800.log 2023-07-07T04:02:34.261 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285936.log.gz 2023-07-07T04:02:34.261 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.224850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387054.log 2023-07-07T04:02:34.262 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224850.log.gz 2023-07-07T04:02:34.262 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.801800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280971.log 2023-07-07T04:02:34.262 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.801800.log.gz 2023-07-07T04:02:34.262 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.387054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223663.log 2023-07-07T04:02:34.262 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387054.log.gz 2023-07-07T04:02:34.263 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.280971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634775.log 2023-07-07T04:02:34.263 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280971.log.gz 2023-07-07T04:02:34.263 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109336.log 2023-07-07T04:02:34.263 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.223663.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223663.log.gz 2023-07-07T04:02:34.263 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.634775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313024.log 2023-07-07T04:02:34.263 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634775.log.gz 2023-07-07T04:02:34.264 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330275.log 2023-07-07T04:02:34.264 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330261.log 2023-07-07T04:02:34.264 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.313024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313024.log.gz 2023-07-07T04:02:34.264 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.330275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213519.log 2023-07-07T04:02:34.264 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330275.log.gz 2023-07-07T04:02:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.330261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101148.log 2023-07-07T04:02:34.265 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330261.log.gz 2023-07-07T04:02:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327267.log 2023-07-07T04:02:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.213519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213519.log.gz 2023-07-07T04:02:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.101148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306649.log 2023-07-07T04:02:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.327267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.774171.log 2023-07-07T04:02:34.266 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327267.log.gz 2023-07-07T04:02:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.306649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702056.log 2023-07-07T04:02:34.266 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306649.log.gz 2023-07-07T04:02:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.774171.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.826528.log 2023-07-07T04:02:34.266 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.774171.log.gz 2023-07-07T04:02:34.267 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.702056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118685.log 2023-07-07T04:02:34.267 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702056.log.gz 2023-07-07T04:02:34.267 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.826528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.819369.log 2023-07-07T04:02:34.267 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.826528.log.gz 2023-07-07T04:02:34.267 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211015.log 2023-07-07T04:02:34.268 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118685.log: /var/log/ceph/ceph-client.admin.819369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.827803.log 2023-07-07T04:02:34.268 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.819369.log.gz 2023-07-07T04:02:34.268 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.211015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111305.log 2023-07-07T04:02:34.268 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211015.log.gz 2023-07-07T04:02:34.268 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319320.log 2023-07-07T04:02:34.269 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.827803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.827803.log.gz 2023-07-07T04:02:34.269 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.111305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654371.log 2023-07-07T04:02:34.269 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.319320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654325.log 2023-07-07T04:02:34.269 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319320.log.gz 2023-07-07T04:02:34.269 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.654371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.760178.log 2023-07-07T04:02:34.269 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654371.log.gz 2023-07-07T04:02:34.270 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.668574.log 2023-07-07T04:02:34.270 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.654325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654325.log.gz 2023-07-07T04:02:34.270 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.760178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655360.log 2023-07-07T04:02:34.270 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.760178.log.gz 2023-07-07T04:02:34.270 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.668574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350625.log 2023-07-07T04:02:34.271 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.668574.log.gz 2023-07-07T04:02:34.271 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655834.log 2023-07-07T04:02:34.271 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.655360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655360.log.gz 2023-07-07T04:02:34.271 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.350625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340478.log 2023-07-07T04:02:34.271 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350625.log.gz 2023-07-07T04:02:34.272 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.655834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299996.log 2023-07-07T04:02:34.272 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655834.log.gz 2023-07-07T04:02:34.272 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.340478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772982.log 2023-07-07T04:02:34.272 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340478.log.gz 2023-07-07T04:02:34.272 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.299996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.800281.log 2023-07-07T04:02:34.272 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299996.log.gz 2023-07-07T04:02:34.273 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.772982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.813112.log 2023-07-07T04:02:34.273 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.772982.log.gz 2023-07-07T04:02:34.273 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.800281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423775.log 2023-07-07T04:02:34.273 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.800281.log.gz 2023-07-07T04:02:34.273 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.813112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107840.log 2023-07-07T04:02:34.274 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.813112.log.gz 2023-07-07T04:02:34.274 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.423775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416105.log 2023-07-07T04:02:34.274 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.423775.log.gz 2023-07-07T04:02:34.274 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.934671.log 2023-07-07T04:02:34.274 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.416105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654233.log 2023-07-07T04:02:34.275 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.416105.log.gz 2023-07-07T04:02:34.275 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.934671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346208.log 2023-07-07T04:02:34.275 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.934671.log.gz 2023-07-07T04:02:34.275 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.654233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266404.log 2023-07-07T04:02:34.275 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654233.log.gz 2023-07-07T04:02:34.275 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.346208.log: -- /var/log/ceph/ceph-client.admin.254287.log 2023-07-07T04:02:34.276 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346208.log.gz 2023-07-07T04:02:34.276 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.266404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118915.log 2023-07-07T04:02:34.276 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266404.log.gz 2023-07-07T04:02:34.276 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.254287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660896.log 2023-07-07T04:02:34.276 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254287.log.gz 2023-07-07T04:02:34.277 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.938130.log 2023-07-07T04:02:34.277 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118915.log: /var/log/ceph/ceph-client.admin.660896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646925.log 2023-07-07T04:02:34.277 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.660896.log.gz 2023-07-07T04:02:34.277 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.938130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281561.log 2023-07-07T04:02:34.277 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.938130.log.gz 2023-07-07T04:02:34.278 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.646925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363118.log 2023-07-07T04:02:34.278 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646925.log.gz 2023-07-07T04:02:34.278 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.281561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393664.log 2023-07-07T04:02:34.278 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281561.log.gz 2023-07-07T04:02:34.278 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.363118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.674521.log 2023-07-07T04:02:34.278 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363118.log.gz 2023-07-07T04:02:34.279 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708078.log 2023-07-07T04:02:34.279 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.393664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393664.log.gz 2023-07-07T04:02:34.279 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.674521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425088.log 2023-07-07T04:02:34.279 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.674521.log.gz 2023-07-07T04:02:34.279 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.708078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322816.log 2023-07-07T04:02:34.280 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708078.log.gz 2023-07-07T04:02:34.280 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334153.log 2023-07-07T04:02:34.280 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.425088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.425088.log.gz 2023-07-07T04:02:34.280 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.322816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322816.log.gz 2023-07-07T04:02:34.280 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697013.log 2023-07-07T04:02:34.281 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.334153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334153.log.gz 2023-07-07T04:02:34.281 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289715.log 2023-07-07T04:02:34.281 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.697013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320257.log 2023-07-07T04:02:34.281 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697013.log.gz 2023-07-07T04:02:34.281 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.289715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316389.log 2023-07-07T04:02:34.281 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289715.log.gz 2023-07-07T04:02:34.282 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.320257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297966.log 2023-07-07T04:02:34.282 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320257.log.gz 2023-07-07T04:02:34.282 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.691960.log 2023-07-07T04:02:34.282 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.316389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316389.log.gz 2023-07-07T04:02:34.282 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.297966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630925.log 2023-07-07T04:02:34.283 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.297966.log.gz 2023-07-07T04:02:34.283 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.691960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286960.log 2023-07-07T04:02:34.283 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.691960.log.gz 2023-07-07T04:02:34.283 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.630925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418248.log 2023-07-07T04:02:34.283 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630925.log.gz 2023-07-07T04:02:34.283 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.286960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772035.log 2023-07-07T04:02:34.284 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286960.log.gz 2023-07-07T04:02:34.284 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.418248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314714.log 2023-07-07T04:02:34.284 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.418248.log.gz 2023-07-07T04:02:34.284 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282814.log 2023-07-07T04:02:34.285 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.772035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.772035.log.gz 2023-07-07T04:02:34.285 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.314714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635794.log 2023-07-07T04:02:34.285 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314714.log.gz 2023-07-07T04:02:34.285 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.282814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475558.log 2023-07-07T04:02:34.285 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282814.log.gz 2023-07-07T04:02:34.285 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.635794.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.349897.log 2023-07-07T04:02:34.286 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635794.log.gz 2023-07-07T04:02:34.286 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.475558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269618.log 2023-07-07T04:02:34.286 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.475558.log.gz 2023-07-07T04:02:34.286 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.349897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192958.log 2023-07-07T04:02:34.286 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349897.log.gz 2023-07-07T04:02:34.287 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.826621.log 2023-07-07T04:02:34.287 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.269618.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269618.log.gz 2023-07-07T04:02:34.287 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.192958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639198.log 2023-07-07T04:02:34.287 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192958.log.gz 2023-07-07T04:02:34.287 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.826621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707675.log 2023-07-07T04:02:34.288 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.826621.log.gz 2023-07-07T04:02:34.288 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.639198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259721.log 2023-07-07T04:02:34.288 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639198.log.gz 2023-07-07T04:02:34.288 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.707675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.823271.log 2023-07-07T04:02:34.288 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707675.log.gz 2023-07-07T04:02:34.289 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.259721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.661374.log 2023-07-07T04:02:34.289 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259721.log.gz 2023-07-07T04:02:34.289 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.823271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199053.log 2023-07-07T04:02:34.289 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.823271.log.gz 2023-07-07T04:02:34.290 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.661374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201966.log 2023-07-07T04:02:34.290 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.661374.log.gz 2023-07-07T04:02:34.290 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.199053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118246.log 2023-07-07T04:02:34.290 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199053.log.gz 2023-07-07T04:02:34.290 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.201966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413407.log 2023-07-07T04:02:34.290 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201966.log.gz 2023-07-07T04:02:34.291 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.118246.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.255749.log 2023-07-07T04:02:34.291 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.413407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157768.log 2023-07-07T04:02:34.291 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413407.log.gz 2023-07-07T04:02:34.291 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.255749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385380.log 2023-07-07T04:02:34.291 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255749.log.gz 2023-07-07T04:02:34.292 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.157768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.776662.log 2023-07-07T04:02:34.292 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157768.log.gz 2023-07-07T04:02:34.292 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.385380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.698182.log 2023-07-07T04:02:34.292 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385380.log.gz 2023-07-07T04:02:34.292 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.776662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639692.log 2023-07-07T04:02:34.293 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.776662.log.gz 2023-07-07T04:02:34.293 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335983.log 2023-07-07T04:02:34.293 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.698182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.698182.log.gz 2023-07-07T04:02:34.293 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.639692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681799.log 2023-07-07T04:02:34.293 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639692.log.gz 2023-07-07T04:02:34.294 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.335983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.826131.log 2023-07-07T04:02:34.294 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335983.log.gz 2023-07-07T04:02:34.294 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.681799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411304.log 2023-07-07T04:02:34.294 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681799.log.gz 2023-07-07T04:02:34.294 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.826131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.826131.log.gz 2023-07-07T04:02:34.294 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116388.log 2023-07-07T04:02:34.295 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.411304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110272.log 2023-07-07T04:02:34.295 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411304.log.gz 2023-07-07T04:02:34.295 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.111903.log.gz 2023-07-07T04:02:34.295 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.759625.log 2023-07-07T04:02:34.295 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.111949.log.gz 2023-07-07T04:02:34.296 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447319.log 2023-07-07T04:02:34.296 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.759625.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112041.log.gz 2023-07-07T04:02:34.296 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696337.log 2023-07-07T04:02:34.296 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.759625.log.gz 2023-07-07T04:02:34.296 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.447319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644203.log 2023-07-07T04:02:34.297 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.447319.log.gz 2023-07-07T04:02:34.297 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.696337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696337.log.gz 2023-07-07T04:02:34.297 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325725.log 2023-07-07T04:02:34.297 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.644203.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644203.log.gz 2023-07-07T04:02:34.297 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.706399.log 2023-07-07T04:02:34.298 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.325725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383389.log 2023-07-07T04:02:34.298 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325725.log.gz 2023-07-07T04:02:34.298 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391879.log 2023-07-07T04:02:34.298 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.706399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.706399.log.gz 2023-07-07T04:02:34.298 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.383389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291233.log 2023-07-07T04:02:34.298 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383389.log.gz 2023-07-07T04:02:34.299 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.391879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.391879.log.gzgzip 2023-07-07T04:02:34.299 INFO:teuthology.orchestra.run.smithi006.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.311608.log 2023-07-07T04:02:34.299 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.291233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.797463.log 2023-07-07T04:02:34.299 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291233.log.gz 2023-07-07T04:02:34.299 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.311608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366572.log 2023-07-07T04:02:34.300 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311608.log.gz 2023-07-07T04:02:34.300 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.797463.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.797463.log.gz 2023-07-07T04:02:34.300 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.940670.log 2023-07-07T04:02:34.300 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.366572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365470.log 2023-07-07T04:02:34.300 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366572.log.gz 2023-07-07T04:02:34.301 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.940670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342769.log 2023-07-07T04:02:34.301 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.940670.log.gz 2023-07-07T04:02:34.301 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.365470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.668481.log 2023-07-07T04:02:34.301 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.365470.log.gz 2023-07-07T04:02:34.301 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.342769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699925.log 2023-07-07T04:02:34.301 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342769.log.gz 2023-07-07T04:02:34.302 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.668481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174960.log 2023-07-07T04:02:34.302 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.668481.log.gz 2023-07-07T04:02:34.302 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.699925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.711663.log 2023-07-07T04:02:34.302 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699925.log.gz 2023-07-07T04:02:34.302 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.174960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322276.log 2023-07-07T04:02:34.303 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174960.log.gz 2023-07-07T04:02:34.303 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.711663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.757750.log 2023-07-07T04:02:34.303 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.711663.log.gz 2023-07-07T04:02:34.303 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.322276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110730.log 2023-07-07T04:02:34.303 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322276.log.gz 2023-07-07T04:02:34.304 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.757750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406617.log 2023-07-07T04:02:34.304 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.757750.log.gz 2023-07-07T04:02:34.304 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422530.log 2023-07-07T04:02:34.304 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.406617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198466.log 2023-07-07T04:02:34.304 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406617.log.gz 2023-07-07T04:02:34.304 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.422530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703198.log 2023-07-07T04:02:34.305 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.422530.log.gz 2023-07-07T04:02:34.305 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.198466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342083.log 2023-07-07T04:02:34.305 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198466.log.gz 2023-07-07T04:02:34.305 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.703198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.942347.log 2023-07-07T04:02:34.305 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703198.log.gz 2023-07-07T04:02:34.306 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.342083.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.342083.log.gz/var/log/ceph/ceph-client.admin.449248.log 2023-07-07T04:02:34.306 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:34.306 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.942347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118200.log 2023-07-07T04:02:34.306 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.942347.log.gz 2023-07-07T04:02:34.306 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.449248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695843.log 2023-07-07T04:02:34.307 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.449248.log.gz 2023-07-07T04:02:34.307 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118338.log 2023-07-07T04:02:34.307 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.695843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175678.log 2023-07-07T04:02:34.307 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695843.log.gz 2023-07-07T04:02:34.307 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305170.log 2023-07-07T04:02:34.308 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248460.log 2023-07-07T04:02:34.308 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.175678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175678.log.gz 2023-07-07T04:02:34.308 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.305170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.825066.log 2023-07-07T04:02:34.308 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305170.log.gz 2023-07-07T04:02:34.308 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.248460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309044.log 2023-07-07T04:02:34.308 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248460.log.gz 2023-07-07T04:02:34.309 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.825066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.758693.log 2023-07-07T04:02:34.309 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.825066.log.gz 2023-07-07T04:02:34.309 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.309044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.798285.log 2023-07-07T04:02:34.309 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309044.log.gz 2023-07-07T04:02:34.309 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.758693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100803.log 2023-07-07T04:02:34.310 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.758693.log.gz 2023-07-07T04:02:34.310 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.798285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.778030.log 2023-07-07T04:02:34.310 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.798285.log.gz 2023-07-07T04:02:34.310 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.100803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680772.log 2023-07-07T04:02:34.310 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.778030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262964.log 2023-07-07T04:02:34.311 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.778030.log.gz 2023-07-07T04:02:34.311 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.680772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158322.log 2023-07-07T04:02:34.311 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680772.log.gz 2023-07-07T04:02:34.311 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.262964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308014.log 2023-07-07T04:02:34.311 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262964.log.gz 2023-07-07T04:02:34.312 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.158322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355365.log 2023-07-07T04:02:34.312 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158322.log.gz 2023-07-07T04:02:34.312 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.308014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269711.log 2023-07-07T04:02:34.312 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308014.log.gz 2023-07-07T04:02:34.312 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.355365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314018.log 2023-07-07T04:02:34.313 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355365.log.gz 2023-07-07T04:02:34.313 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.269711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382929.log 2023-07-07T04:02:34.313 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269711.log.gz 2023-07-07T04:02:34.313 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.314018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301918.log 2023-07-07T04:02:34.313 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314018.log.gz 2023-07-07T04:02:34.314 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.382929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654417.log 2023-07-07T04:02:34.314 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382929.log.gz 2023-07-07T04:02:34.314 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690001.log 2023-07-07T04:02:34.314 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.301918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301918.log.gz 2023-07-07T04:02:34.314 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.654417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388599.log 2023-07-07T04:02:34.315 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654417.log.gz 2023-07-07T04:02:34.315 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.690001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116660.log 2023-07-07T04:02:34.315 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690001.log.gz 2023-07-07T04:02:34.315 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.388599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.940624.log 2023-07-07T04:02:34.315 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.388599.log.gz 2023-07-07T04:02:34.315 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.937634.log 2023-07-07T04:02:34.316 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.940624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807853.log 2023-07-07T04:02:34.316 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.940624.log.gz 2023-07-07T04:02:34.316 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.937634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.940716.log 2023-07-07T04:02:34.316 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.937634.log.gz 2023-07-07T04:02:34.316 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.807853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807853.log.gzgzip 2023-07-07T04:02:34.317 INFO:teuthology.orchestra.run.smithi006.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.387780.log 2023-07-07T04:02:34.317 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.940716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.771942.log 2023-07-07T04:02:34.317 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.387780.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.940716.log.gz 2023-07-07T04:02:34.317 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623031.log 2023-07-07T04:02:34.317 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387780.log.gz 2023-07-07T04:02:34.318 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.771942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333922.log 2023-07-07T04:02:34.318 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771942.log.gz 2023-07-07T04:02:34.318 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.623031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338626.log 2023-07-07T04:02:34.318 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623031.log.gz 2023-07-07T04:02:34.318 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.333922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171216.log 2023-07-07T04:02:34.318 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333922.log.gz 2023-07-07T04:02:34.319 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.338626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710662.log 2023-07-07T04:02:34.319 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338626.log.gz 2023-07-07T04:02:34.319 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.171216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117563.log 2023-07-07T04:02:34.319 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171216.log.gz 2023-07-07T04:02:34.319 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.710662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.930783.log 2023-07-07T04:02:34.320 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710662.log.gz 2023-07-07T04:02:34.320 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.653532.log 2023-07-07T04:02:34.320 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.823822.log 2023-07-07T04:02:34.320 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.930783.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.930783.log.gz 2023-07-07T04:02:34.320 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.653532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118639.log 2023-07-07T04:02:34.321 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.653532.log.gz 2023-07-07T04:02:34.321 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.823822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402057.log 2023-07-07T04:02:34.321 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.823822.log.gz 2023-07-07T04:02:34.321 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.118639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362744.log 2023-07-07T04:02:34.321 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.402057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476517.log 2023-07-07T04:02:34.321 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.402057.log.gz 2023-07-07T04:02:34.322 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.362744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362730.log 2023-07-07T04:02:34.322 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362744.log.gz 2023-07-07T04:02:34.322 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.760192.log 2023-07-07T04:02:34.322 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.476517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.476517.log.gz 2023-07-07T04:02:34.322 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.362730.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.362730.log.gz-5 2023-07-07T04:02:34.323 INFO:teuthology.orchestra.run.smithi006.stderr:--verbose -- /var/log/ceph/ceph-client.admin.161339.log 2023-07-07T04:02:34.323 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.760192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620103.log 2023-07-07T04:02:34.323 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.760192.log.gz 2023-07-07T04:02:34.323 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.161339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214844.log 2023-07-07T04:02:34.323 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161339.log.gz 2023-07-07T04:02:34.324 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.620103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110725.log 2023-07-07T04:02:34.324 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620103.log.gz 2023-07-07T04:02:34.324 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.214844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340258.log 2023-07-07T04:02:34.324 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214844.log.gz 2023-07-07T04:02:34.324 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624072.log 2023-07-07T04:02:34.324 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.340258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.670611.log 2023-07-07T04:02:34.325 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340258.log.gz 2023-07-07T04:02:34.325 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.624072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409365.log 2023-07-07T04:02:34.325 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624072.log.gz 2023-07-07T04:02:34.325 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.670611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350919.log 2023-07-07T04:02:34.325 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.670611.log.gz 2023-07-07T04:02:34.326 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194127.log 2023-07-07T04:02:34.326 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.409365.log: 0.0% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.409365.log.gz -- replaced with /var/log/ceph/ceph-client.admin.114254.log.gz 2023-07-07T04:02:34.326 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:34.326 INFO:teuthology.orchestra.run.smithi006.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.114300.log.gz 2023-07-07T04:02:34.326 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.350919.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114439.log.gz 2023-07-07T04:02:34.327 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383886.log 2023-07-07T04:02:34.327 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350919.log.gz 2023-07-07T04:02:34.327 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114807.log.gz 2023-07-07T04:02:34.327 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114899.log.gz 2023-07-07T04:02:34.327 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.194127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406990.log 2023-07-07T04:02:34.328 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194127.log.gz 2023-07-07T04:02:34.328 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115037.log.gz 2023-07-07T04:02:34.328 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.383886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.805097.log 2023-07-07T04:02:34.328 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383886.log.gz 2023-07-07T04:02:34.328 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.406990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.825670.log 2023-07-07T04:02:34.328 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406990.log.gz 2023-07-07T04:02:34.329 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.805097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.705168.log 2023-07-07T04:02:34.329 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.805097.log.gz 2023-07-07T04:02:34.329 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115553.log.gz 2023-07-07T04:02:34.329 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.825670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194829.log 2023-07-07T04:02:34.329 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.825670.log.gz 2023-07-07T04:02:34.330 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.705168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260037.log 2023-07-07T04:02:34.330 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.705168.log.gz 2023-07-07T04:02:34.330 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.194829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166144.log 2023-07-07T04:02:34.330 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194829.log.gz 2023-07-07T04:02:34.330 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.116055.log.gz 2023-07-07T04:02:34.331 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.260037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256374.log 2023-07-07T04:02:34.331 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260037.log.gz 2023-07-07T04:02:34.331 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.117130.log.gz 2023-07-07T04:02:34.331 INFO:teuthology.orchestra.run.smithi006.stderr: 87.4%/var/log/ceph/ceph-client.admin.166144.log: -- replaced with /var/log/ceph/ceph-client.admin.117516.log.gz 2023-07-07T04:02:34.331 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.118731.log.gz 2023-07-07T04:02:34.331 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.166144.log.gz--verbose 2023-07-07T04:02:34.332 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.285204.log 2023-07-07T04:02:34.332 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.118869.log.gz 2023-07-07T04:02:34.332 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120395.log.gz 2023-07-07T04:02:34.332 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.256374.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107588.log.gz 2023-07-07T04:02:34.332 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256374.log.gz 2023-07-07T04:02:34.333 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.107321.log.gz 2023-07-07T04:02:34.333 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108224.log.gz 2023-07-07T04:02:34.333 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.285204.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110728.log.gz 2023-07-07T04:02:34.333 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285204.log.gz 2023-07-07T04:02:34.333 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110726.log.gz 2023-07-07T04:02:34.334 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.933318.log 2023-07-07T04:02:34.334 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111078.log.gz 2023-07-07T04:02:34.334 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111089.log.gz 2023-07-07T04:02:34.334 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.112271.log.gz 2023-07-07T04:02:34.334 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176195.log 2023-07-07T04:02:34.334 INFO:teuthology.orchestra.run.smithi006.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.112363.log.gz 2023-07-07T04:02:34.335 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.112455.log.gz 2023-07-07T04:02:34.335 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114346.log.gz 2023-07-07T04:02:34.335 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.933318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115645.log 2023-07-07T04:02:34.335 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.933318.log.gz 2023-07-07T04:02:34.335 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.115221.log.gz 2023-07-07T04:02:34.336 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115825.log.gz 2023-07-07T04:02:34.336 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.176195.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116388.log.gz 2023-07-07T04:02:34.336 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334650.log 2023-07-07T04:02:34.336 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176195.log.gz 2023-07-07T04:02:34.336 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116660.log.gz 2023-07-07T04:02:34.337 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115645.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.116984.log.gz 2023-07-07T04:02:34.337 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116708.log.gz 2023-07-07T04:02:34.337 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.117406.log.gz 2023-07-07T04:02:34.337 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.117563.log.gz 2023-07-07T04:02:34.337 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.334650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334650.log.gz 2023-07-07T04:02:34.337 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118200.log.gz -- replaced with /var/log/ceph/ceph-client.admin.118246.log.gz 2023-07-07T04:02:34.338 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:34.338 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174463.log 2023-07-07T04:02:34.338 INFO:teuthology.orchestra.run.smithi006.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.117176.log.gz 2023-07-07T04:02:34.338 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.935246.log 2023-07-07T04:02:34.338 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.174463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381434.log 2023-07-07T04:02:34.339 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.118338.log.gz 2023-07-07T04:02:34.339 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174463.log.gz 2023-07-07T04:02:34.339 INFO:teuthology.orchestra.run.smithi006.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.118434.log.gz 2023-07-07T04:02:34.339 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.935246.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.935246.log.gz 2023-07-07T04:02:34.339 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118915.log.gz 2023-07-07T04:02:34.340 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.100803.log.gz 2023-07-07T04:02:34.340 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107840.log.gz 2023-07-07T04:02:34.340 INFO:teuthology.orchestra.run.smithi006.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.109336.log.gz 2023-07-07T04:02:34.340 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110272.log.gz 2023-07-07T04:02:34.340 INFO:teuthology.orchestra.run.smithi006.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110725.log.gz 2023-07-07T04:02:34.341 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645011.log 2023-07-07T04:02:34.341 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.381434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381434.log.gz 2023-07-07T04:02:34.341 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276585.log 2023-07-07T04:02:34.342 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448180.log 2023-07-07T04:02:34.342 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.645011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645011.log.gz 2023-07-07T04:02:34.343 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.276585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302214.log 2023-07-07T04:02:34.343 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276585.log.gz 2023-07-07T04:02:34.343 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.448180.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.448180.log.gz 2023-07-07T04:02:34.343 INFO:teuthology.orchestra.run.smithi006.stderr:--verbose -- /var/log/ceph/ceph-client.admin.309354.log 2023-07-07T04:02:34.344 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284383.log 2023-07-07T04:02:34.344 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.302214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302214.log.gz 2023-07-07T04:02:34.344 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.309354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309354.log.gz 2023-07-07T04:02:34.345 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.814858.log 2023-07-07T04:02:34.345 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474802.log 2023-07-07T04:02:34.345 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.284383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284383.log.gz 2023-07-07T04:02:34.345 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.814858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117877.log 2023-07-07T04:02:34.346 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.814858.log.gz 2023-07-07T04:02:34.346 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.474802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.760776.log 2023-07-07T04:02:34.346 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.474802.log.gz 2023-07-07T04:02:34.347 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254852.log 2023-07-07T04:02:34.347 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.760776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.760776.log.gz 2023-07-07T04:02:34.348 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.931268.log 2023-07-07T04:02:34.348 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266200.log 2023-07-07T04:02:34.348 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.254852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254852.log.gz 2023-07-07T04:02:34.349 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.931268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.931268.log.gz 2023-07-07T04:02:34.349 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400527.log 2023-07-07T04:02:34.350 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156724.log 2023-07-07T04:02:34.350 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.266200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266200.log.gz 2023-07-07T04:02:34.351 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.400527.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.400527.log.gz--verbose 2023-07-07T04:02:34.351 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.762694.log 2023-07-07T04:02:34.351 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.156724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369536.log 2023-07-07T04:02:34.351 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156724.log.gz 2023-07-07T04:02:34.351 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.762694.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.762694.log.gz--verbose 2023-07-07T04:02:34.352 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.247666.log 2023-07-07T04:02:34.352 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.369536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347217.log 2023-07-07T04:02:34.352 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.369536.log.gz 2023-07-07T04:02:34.353 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.247666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363719.log 2023-07-07T04:02:34.353 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247666.log.gz 2023-07-07T04:02:34.353 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.347217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313038.log 2023-07-07T04:02:34.353 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347217.log.gz 2023-07-07T04:02:34.354 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.363719.log: 88.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-07T04:02:34.354 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383403.log 2023-07-07T04:02:34.354 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363719.log.gz 2023-07-07T04:02:34.354 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.313038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590708.log 2023-07-07T04:02:34.354 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313038.log.gz 2023-07-07T04:02:34.355 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.383403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695764.log 2023-07-07T04:02:34.355 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383403.log.gz 2023-07-07T04:02:34.355 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.590708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409676.log 2023-07-07T04:02:34.355 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.590708.log.gz 2023-07-07T04:02:34.356 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.695764.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.695764.log.gz-- 2023-07-07T04:02:34.356 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.806413.log 2023-07-07T04:02:34.356 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658248.log 2023-07-07T04:02:34.356 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.409676.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409676.log.gz 2023-07-07T04:02:34.356 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.806413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412099.log 2023-07-07T04:02:34.357 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.806413.log.gz 2023-07-07T04:02:34.357 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.658248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357575.log 2023-07-07T04:02:34.357 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.658248.log.gz 2023-07-07T04:02:34.357 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687664.log 2023-07-07T04:02:34.357 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.412099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412099.log.gz 2023-07-07T04:02:34.358 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.357575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357575.log.gz 2023-07-07T04:02:34.358 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.809209.log 2023-07-07T04:02:34.358 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619585.log 2023-07-07T04:02:34.358 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.687664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687664.log.gz 2023-07-07T04:02:34.358 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.809209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112317.log 2023-07-07T04:02:34.359 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.809209.log.gz 2023-07-07T04:02:34.359 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.619585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111455.log 2023-07-07T04:02:34.359 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619585.log.gz 2023-07-07T04:02:34.359 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.821307.log 2023-07-07T04:02:34.359 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112317.log: /var/log/ceph/ceph-client.admin.111455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223105.log 2023-07-07T04:02:34.360 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.821307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.805902.log 2023-07-07T04:02:34.360 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.821307.log.gz 2023-07-07T04:02:34.360 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.223105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702894.log 2023-07-07T04:02:34.360 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223105.log.gz 2023-07-07T04:02:34.360 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.805902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371247.log 2023-07-07T04:02:34.361 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.805902.log.gz 2023-07-07T04:02:34.361 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.702894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.803858.log 2023-07-07T04:02:34.361 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702894.log.gz 2023-07-07T04:02:34.361 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.371247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332900.log 2023-07-07T04:02:34.361 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.371247.log.gz 2023-07-07T04:02:34.361 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.803858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296153.log 2023-07-07T04:02:34.362 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.803858.log.gz 2023-07-07T04:02:34.362 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.332900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302945.log 2023-07-07T04:02:34.362 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332900.log.gz 2023-07-07T04:02:34.362 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.296153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628401.log 2023-07-07T04:02:34.362 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.296153.log.gz 2023-07-07T04:02:34.363 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704114.log 2023-07-07T04:02:34.363 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.302945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302945.log.gz 2023-07-07T04:02:34.363 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.628401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628401.log.gz 2023-07-07T04:02:34.363 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283303.log 2023-07-07T04:02:34.363 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377092.log 2023-07-07T04:02:34.364 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.704114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704114.log.gz 2023-07-07T04:02:34.364 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.283303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811173.log 2023-07-07T04:02:34.364 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283303.log.gz 2023-07-07T04:02:34.364 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.377092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623325.log 2023-07-07T04:02:34.364 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.377092.log.gz 2023-07-07T04:02:34.365 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.811173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372785.log 2023-07-07T04:02:34.365 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811173.log.gz 2023-07-07T04:02:34.365 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.623325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284691.log 2023-07-07T04:02:34.365 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623325.log.gz 2023-07-07T04:02:34.365 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.372785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313507.log 2023-07-07T04:02:34.366 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372785.log.gz 2023-07-07T04:02:34.366 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658327.log 2023-07-07T04:02:34.366 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.284691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284691.log.gz 2023-07-07T04:02:34.366 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.313507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313507.log.gz 2023-07-07T04:02:34.366 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382915.log 2023-07-07T04:02:34.366 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368289.log 2023-07-07T04:02:34.367 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.658327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.658327.log.gz 2023-07-07T04:02:34.367 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.382915.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.382915.log.gz--verbose 2023-07-07T04:02:34.367 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.671122.log 2023-07-07T04:02:34.367 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.368289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447240.log 2023-07-07T04:02:34.367 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.368289.log.gz 2023-07-07T04:02:34.368 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.671122.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.671122.log.gz--verbose 2023-07-07T04:02:34.368 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.659936.log 2023-07-07T04:02:34.368 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.447240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.779923.log 2023-07-07T04:02:34.368 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.447240.log.gz 2023-07-07T04:02:34.368 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.659936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160410.log 2023-07-07T04:02:34.369 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659936.log.gz 2023-07-07T04:02:34.369 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.779923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644217.log 2023-07-07T04:02:34.369 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.779923.log.gz 2023-07-07T04:02:34.369 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.160410.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.160410.log.gz-- 2023-07-07T04:02:34.369 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.620673.log 2023-07-07T04:02:34.370 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.644217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293989.log 2023-07-07T04:02:34.370 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644217.log.gz 2023-07-07T04:02:34.370 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.620673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620673.log.gz 2023-07-07T04:02:34.370 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350933.log 2023-07-07T04:02:34.370 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.293989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390953.log 2023-07-07T04:02:34.370 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293989.log.gz 2023-07-07T04:02:34.371 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.350933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.761177.log 2023-07-07T04:02:34.371 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350933.log.gz 2023-07-07T04:02:34.371 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420487.log 2023-07-07T04:02:34.371 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.390953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.390953.log.gz 2023-07-07T04:02:34.371 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.761177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.806910.log 2023-07-07T04:02:34.372 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.761177.log.gz 2023-07-07T04:02:34.372 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.420487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404672.log 2023-07-07T04:02:34.372 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.420487.log.gz 2023-07-07T04:02:34.372 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342004.log 2023-07-07T04:02:34.372 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.806910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.806910.log.gz 2023-07-07T04:02:34.373 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.404672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.404672.log.gz 2023-07-07T04:02:34.373 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391323.log 2023-07-07T04:02:34.373 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688988.log 2023-07-07T04:02:34.373 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.342004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342004.log.gz 2023-07-07T04:02:34.373 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.391323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.604550.log 2023-07-07T04:02:34.374 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.391323.log.gz 2023-07-07T04:02:34.374 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178144.log 2023-07-07T04:02:34.374 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.688988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688988.log.gz 2023-07-07T04:02:34.374 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.604550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604550.log.gz 2023-07-07T04:02:34.374 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362180.log 2023-07-07T04:02:34.375 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268709.log 2023-07-07T04:02:34.375 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.178144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178144.log.gz 2023-07-07T04:02:34.375 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.362180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693910.log 2023-07-07T04:02:34.375 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362180.log.gz 2023-07-07T04:02:34.375 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.268709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.821777.log 2023-07-07T04:02:34.375 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268709.log.gz 2023-07-07T04:02:34.376 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344322.log 2023-07-07T04:02:34.376 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.693910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693910.log.gz 2023-07-07T04:02:34.376 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.821777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363705.log 2023-07-07T04:02:34.376 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.821777.log.gz 2023-07-07T04:02:34.376 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.344322.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.344322.log.gz/var/log/ceph/ceph-client.admin.370735.log 2023-07-07T04:02:34.377 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:34.377 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618278.log 2023-07-07T04:02:34.377 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.363705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363705.log.gz 2023-07-07T04:02:34.377 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.370735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480735.log 2023-07-07T04:02:34.377 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.370735.log.gz 2023-07-07T04:02:34.378 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.618278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.818798.log 2023-07-07T04:02:34.378 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618278.log.gz 2023-07-07T04:02:34.378 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386749.log 2023-07-07T04:02:34.378 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.480735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.480735.log.gz 2023-07-07T04:02:34.378 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.818798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210594.log 2023-07-07T04:02:34.379 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.818798.log.gz 2023-07-07T04:02:34.379 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.386749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404957.log 2023-07-07T04:02:34.379 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386749.log.gz 2023-07-07T04:02:34.379 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.941674.log 2023-07-07T04:02:34.379 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.210594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210594.log.gz 2023-07-07T04:02:34.380 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.404957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409952.log 2023-07-07T04:02:34.380 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.404957.log.gz 2023-07-07T04:02:34.380 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.941674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406034.log 2023-07-07T04:02:34.380 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.941674.log.gz 2023-07-07T04:02:34.380 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.409952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326797.log 2023-07-07T04:02:34.381 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409952.log.gz 2023-07-07T04:02:34.381 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282086.log 2023-07-07T04:02:34.381 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.406034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406034.log.gz 2023-07-07T04:02:34.381 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.326797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.761760.log 2023-07-07T04:02:34.381 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326797.log.gz 2023-07-07T04:02:34.381 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.282086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419926.log 2023-07-07T04:02:34.382 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282086.log.gz 2023-07-07T04:02:34.382 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.761760.log: -- /var/log/ceph/ceph-client.admin.416091.log 2023-07-07T04:02:34.382 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.761760.log.gz 2023-07-07T04:02:34.382 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.419926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.419926.log.gz 2023-07-07T04:02:34.382 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279012.log 2023-07-07T04:02:34.383 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.416091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.671554.log 2023-07-07T04:02:34.383 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.416091.log.gz 2023-07-07T04:02:34.383 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.279012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279012.log.gz 2023-07-07T04:02:34.383 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289224.log 2023-07-07T04:02:34.383 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334354.log 2023-07-07T04:02:34.384 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.671554.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.671554.log.gz 2023-07-07T04:02:34.384 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.289224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411383.log 2023-07-07T04:02:34.384 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289224.log.gz 2023-07-07T04:02:34.384 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.334354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460002.log 2023-07-07T04:02:34.385 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334354.log.gz 2023-07-07T04:02:34.385 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.811093.log 2023-07-07T04:02:34.385 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.411383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411383.log.gz 2023-07-07T04:02:34.385 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.460002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267143.log 2023-07-07T04:02:34.385 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.460002.log.gz 2023-07-07T04:02:34.386 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.811093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394647.log 2023-07-07T04:02:34.386 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.811093.log.gz 2023-07-07T04:02:34.386 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.94549.log 2023-07-07T04:02:34.386 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.267143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267143.log.gz 2023-07-07T04:02:34.386 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.394647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371015.log 2023-07-07T04:02:34.387 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394647.log.gz 2023-07-07T04:02:34.387 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph.tmp-client.admin.94549.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph.tmp-client.admin.94549.log.gz 2023-07-07T04:02:34.387 INFO:teuthology.orchestra.run.smithi006.stderr:--verbose -- /var/log/ceph/ceph-client.admin.316403.log 2023-07-07T04:02:34.387 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353113.log 2023-07-07T04:02:34.387 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.371015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.371015.log.gz 2023-07-07T04:02:34.387 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.316403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.941812.log 2023-07-07T04:02:34.388 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316403.log.gz 2023-07-07T04:02:34.388 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.353113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283102.log 2023-07-07T04:02:34.388 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353113.log.gz 2023-07-07T04:02:34.388 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641131.log 2023-07-07T04:02:34.388 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.941812.log: /var/log/ceph/ceph-client.admin.283102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419711.log 2023-07-07T04:02:34.389 INFO:teuthology.orchestra.run.smithi006.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.941812.log.gz 2023-07-07T04:02:34.389 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283102.log.gz 2023-07-07T04:02:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.641131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320350.log 2023-07-07T04:02:34.389 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.641131.log.gz 2023-07-07T04:02:34.389 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.419711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395454.log 2023-07-07T04:02:34.390 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.419711.log.gz 2023-07-07T04:02:34.390 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.320350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263058.log 2023-07-07T04:02:34.390 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320350.log.gz 2023-07-07T04:02:34.390 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.395454.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395454.log.gz 2023-07-07T04:02:34.391 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636699.log 2023-07-07T04:02:34.391 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176181.log 2023-07-07T04:02:34.391 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.263058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263058.log.gz 2023-07-07T04:02:34.391 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.636699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627059.log 2023-07-07T04:02:34.391 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636699.log.gz 2023-07-07T04:02:34.391 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.176181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349345.log 2023-07-07T04:02:34.392 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114116.log.gz 2023-07-07T04:02:34.392 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.176181.log.gz 2023-07-07T04:02:34.392 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 /var/log/ceph/ceph-client.admin.627059.log: --verbose -- /var/log/ceph/ceph-client.admin.322737.log 2023-07-07T04:02:34.392 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627059.log.gz 2023-07-07T04:02:34.393 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.349345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253049.log 2023-07-07T04:02:34.393 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349345.log.gz 2023-07-07T04:02:34.393 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.780710.log 2023-07-07T04:02:34.393 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.322737.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.110727.log.gz 2023-07-07T04:02:34.393 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322737.log.gz 2023-07-07T04:02:34.393 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.253049.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.111455.log.gz 2023-07-07T04:02:34.394 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253049.log.gz 2023-07-07T04:02:34.394 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112317.log.gz 2023-07-07T04:02:34.394 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.780710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.780710.log.gz 2023-07-07T04:02:34.394 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.115645.log.gz 2023-07-07T04:02:34.394 INFO:teuthology.orchestra.run.smithi006.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117609.log.gz 2023-07-07T04:02:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:gzip 87.4%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.111462.log.gz-- 2023-07-07T04:02:34.395 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.630402.log 2023-07-07T04:02:34.395 INFO:teuthology.orchestra.run.smithi006.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.117877.log.gz 2023-07-07T04:02:34.395 INFO:teuthology.orchestra.run.smithi006.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.118108.log.gz 2023-07-07T04:02:34.395 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.118685.log.gz 88.8% 2023-07-07T04:02:34.396 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.118639.log.gz 2023-07-07T04:02:34.396 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.110718.log.gz 2023-07-07T04:02:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.630402.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.101148.log.gz 2023-07-07T04:02:34.396 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630402.log.gz 2023-07-07T04:02:34.396 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225925.log 2023-07-07T04:02:34.396 INFO:teuthology.orchestra.run.smithi006.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.111305.log.gz 2023-07-07T04:02:34.397 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700990.log 2023-07-07T04:02:34.397 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.225925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225925.log.gz 2023-07-07T04:02:34.397 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160331.log 2023-07-07T04:02:34.397 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684567.log 2023-07-07T04:02:34.397 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.700990.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110730.log.gz 2023-07-07T04:02:34.398 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700990.log.gz 2023-07-07T04:02:34.398 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.160331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164181.log 2023-07-07T04:02:34.398 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160331.log.gz 2023-07-07T04:02:34.398 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.684567.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.417868.log 2023-07-07T04:02:34.398 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.684567.log.gz 2023-07-07T04:02:34.399 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249529.log 2023-07-07T04:02:34.399 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.164181.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164181.log.gz 2023-07-07T04:02:34.399 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.417868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.822383.log 2023-07-07T04:02:34.399 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.417868.log.gz 2023-07-07T04:02:34.399 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.249529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348337.log 2023-07-07T04:02:34.399 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249529.log.gz 2023-07-07T04:02:34.400 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.822383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.822383.log.gz 2023-07-07T04:02:34.400 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342097.log 2023-07-07T04:02:34.400 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.348337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646453.log 2023-07-07T04:02:34.400 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348337.log.gz 2023-07-07T04:02:34.401 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.342097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654486.log 2023-07-07T04:02:34.401 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342097.log.gz 2023-07-07T04:02:34.401 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.646453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414759.log 2023-07-07T04:02:34.401 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646453.log.gz 2023-07-07T04:02:34.401 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.654486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269387.log 2023-07-07T04:02:34.401 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654486.log.gz 2023-07-07T04:02:34.402 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.414759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289701.log 2023-07-07T04:02:34.402 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.414759.log.gz 2023-07-07T04:02:34.402 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.269387.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.117038.log -- replaced with /var/log/ceph/ceph-client.admin.269387.log.gz 2023-07-07T04:02:34.402 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:34.402 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.289701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.937648.log 2023-07-07T04:02:34.403 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289701.log.gz 2023-07-07T04:02:34.403 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.117038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.941084.log 2023-07-07T04:02:34.403 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.937648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418831.log 2023-07-07T04:02:34.404 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.937648.log.gz 2023-07-07T04:02:34.404 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.941084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246731.log 2023-07-07T04:02:34.404 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.418831.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.941084.log.gz 2023-07-07T04:02:34.404 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.418831.log.gz 2023-07-07T04:02:34.404 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.822085.log 2023-07-07T04:02:34.405 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372274.log 2023-07-07T04:02:34.405 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.246731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246731.log.gz 2023-07-07T04:02:34.405 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.822085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.819383.log 2023-07-07T04:02:34.405 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.822085.log.gz 2023-07-07T04:02:34.405 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109861.log.gz 2023-07-07T04:02:34.406 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.372274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.942393.log 2023-07-07T04:02:34.406 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.372274.log.gz 2023-07-07T04:02:34.406 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.819383.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.351151.log -- replaced with /var/log/ceph/ceph-client.admin.819383.log.gz 2023-07-07T04:02:34.406 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:34.406 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.942393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.825376.log 2023-07-07T04:02:34.407 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.942393.log.gz 2023-07-07T04:02:34.407 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.351151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293772.log 2023-07-07T04:02:34.407 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351151.log.gz 2023-07-07T04:02:34.407 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.825376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660592.log 2023-07-07T04:02:34.407 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.825376.log.gz 2023-07-07T04:02:34.408 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.293772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329239.log 2023-07-07T04:02:34.408 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293772.log.gz 2023-07-07T04:02:34.408 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.660592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298379.log 2023-07-07T04:02:34.408 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.660592.log.gz 2023-07-07T04:02:34.408 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.329239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.934268.log 2023-07-07T04:02:34.409 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329239.log.gz 2023-07-07T04:02:34.409 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.298379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270188.log 2023-07-07T04:02:34.409 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298379.log.gz 2023-07-07T04:02:34.409 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.934268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.825577.log 2023-07-07T04:02:34.409 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.934268.log.gz 2023-07-07T04:02:34.410 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.270188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420005.log 2023-07-07T04:02:34.410 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270188.log.gz 2023-07-07T04:02:34.410 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.825577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286649.log 2023-07-07T04:02:34.410 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.825577.log.gz 2023-07-07T04:02:34.410 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.420005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325818.log 2023-07-07T04:02:34.410 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.420005.log.gz 2023-07-07T04:02:34.411 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.286649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.690482.log 2023-07-07T04:02:34.411 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286649.log.gz 2023-07-07T04:02:34.411 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.325818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283870.log 2023-07-07T04:02:34.411 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325818.log.gz 2023-07-07T04:02:34.411 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.690482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.812121.log 2023-07-07T04:02:34.412 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.690482.log.gz 2023-07-07T04:02:34.412 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.283870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386763.log 2023-07-07T04:02:34.412 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283870.log.gz 2023-07-07T04:02:34.412 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.812121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114623.log 2023-07-07T04:02:34.412 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.812121.log.gz 2023-07-07T04:02:34.413 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.386763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660803.log 2023-07-07T04:02:34.413 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386763.log.gz 2023-07-07T04:02:34.413 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224757.log 2023-07-07T04:02:34.413 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.660803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634789.log 2023-07-07T04:02:34.413 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.660803.log.gz 2023-07-07T04:02:34.414 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.224757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645520.log 2023-07-07T04:02:34.414 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224757.log.gz 2023-07-07T04:02:34.414 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.634789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252256.log 2023-07-07T04:02:34.414 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634789.log.gz 2023-07-07T04:02:34.414 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.645520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.935635.log 2023-07-07T04:02:34.414 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645520.log.gz 2023-07-07T04:02:34.415 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.252256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109101.log 2023-07-07T04:02:34.415 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252256.log.gz 2023-07-07T04:02:34.415 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.935635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387577.log 2023-07-07T04:02:34.415 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.935635.log.gz 2023-07-07T04:02:34.415 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175053.log 2023-07-07T04:02:34.416 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.387577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385915.log 2023-07-07T04:02:34.416 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387577.log.gz 2023-07-07T04:02:34.416 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.175053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344119.log 2023-07-07T04:02:34.416 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175053.log.gz 2023-07-07T04:02:34.416 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.385915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119053.log 2023-07-07T04:02:34.417 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385915.log.gz 2023-07-07T04:02:34.417 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.344119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449744.log 2023-07-07T04:02:34.417 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344119.log.gz 2023-07-07T04:02:34.417 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.119053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321765.log 2023-07-07T04:02:34.417 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.449744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.809428.log 2023-07-07T04:02:34.418 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.449744.log.gz 2023-07-07T04:02:34.418 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.321765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327761.log 2023-07-07T04:02:34.418 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321765.log.gz 2023-07-07T04:02:34.418 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.809428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.777255.log 2023-07-07T04:02:34.418 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.809428.log.gz 2023-07-07T04:02:34.419 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.327761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.701963.log 2023-07-07T04:02:34.419 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327761.log.gz 2023-07-07T04:02:34.419 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.777255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221683.log 2023-07-07T04:02:34.419 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.777255.log.gz 2023-07-07T04:02:34.419 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.701963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.807342.log 2023-07-07T04:02:34.419 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701963.log.gz 2023-07-07T04:02:34.420 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.221683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657872.log 2023-07-07T04:02:34.420 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221683.log.gz 2023-07-07T04:02:34.420 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.807342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.941858.log 2023-07-07T04:02:34.420 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.807342.log.gz 2023-07-07T04:02:34.420 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.657872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194632.log 2023-07-07T04:02:34.421 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.657872.log.gz 2023-07-07T04:02:34.421 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.941858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389095.log 2023-07-07T04:02:34.421 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.194632.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.941858.log.gz 2023-07-07T04:02:34.421 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422544.log 2023-07-07T04:02:34.421 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194632.log.gz 2023-07-07T04:02:34.422 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.389095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351869.log 2023-07-07T04:02:34.422 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.389095.log.gz 2023-07-07T04:02:34.422 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.422544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772478.log 2023-07-07T04:02:34.422 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.422544.log.gz 2023-07-07T04:02:34.422 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.351869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344621.log 2023-07-07T04:02:34.423 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351869.log.gz 2023-07-07T04:02:34.423 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.772478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196394.log 2023-07-07T04:02:34.423 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.772478.log.gz 2023-07-07T04:02:34.423 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.344621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449262.log 2023-07-07T04:02:34.423 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344621.log.gz 2023-07-07T04:02:34.423 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.196394.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-07-07T04:02:34.424 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196394.log.gz 2023-07-07T04:02:34.424 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.449262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226269.log 2023-07-07T04:02:34.424 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.449262.log.gz 2023-07-07T04:02:34.424 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387068.log 2023-07-07T04:02:34.424 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.226269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637249.log 2023-07-07T04:02:34.425 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226269.log.gz 2023-07-07T04:02:34.425 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.387068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296433.log 2023-07-07T04:02:34.425 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387068.log.gz 2023-07-07T04:02:34.425 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.637249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193145.log 2023-07-07T04:02:34.425 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637249.log.gz 2023-07-07T04:02:34.426 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.296433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.775769.log 2023-07-07T04:02:34.426 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.296433.log.gz 2023-07-07T04:02:34.426 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.193145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478042.log 2023-07-07T04:02:34.426 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193145.log.gz 2023-07-07T04:02:34.426 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.775769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.941925.log 2023-07-07T04:02:34.427 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.775769.log.gz 2023-07-07T04:02:34.427 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.478042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195890.log 2023-07-07T04:02:34.427 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.478042.log.gz 2023-07-07T04:02:34.427 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.941925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406696.log 2023-07-07T04:02:34.427 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.941925.log.gz 2023-07-07T04:02:34.427 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.195890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276492.log 2023-07-07T04:02:34.428 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195890.log.gz 2023-07-07T04:02:34.428 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.406696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286946.log 2023-07-07T04:02:34.428 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406696.log.gz 2023-07-07T04:02:34.428 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.276492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644511.log 2023-07-07T04:02:34.428 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276492.log.gz 2023-07-07T04:02:34.429 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.286946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213505.log 2023-07-07T04:02:34.429 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286946.log.gz 2023-07-07T04:02:34.429 INFO:teuthology.orchestra.run.smithi006.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-07-07T04:02:34.429 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.644511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.800778.log 2023-07-07T04:02:34.429 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644511.log.gz 2023-07-07T04:02:34.430 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.213505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.643396.log 0.0% 2023-07-07T04:02:34.430 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.213505.log.gz 2023-07-07T04:02:34.430 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.800778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.942301.log 2023-07-07T04:02:34.430 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.800778.log.gz 2023-07-07T04:02:34.430 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.643396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320846.log 2023-07-07T04:02:34.430 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.643396.log.gz 2023-07-07T04:02:34.431 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.942301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.694789.log 2023-07-07T04:02:34.431 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.320846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331602.log 2023-07-07T04:02:34.431 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.942301.log.gz 2023-07-07T04:02:34.431 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320846.log.gz 2023-07-07T04:02:34.431 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.694789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695374.log 2023-07-07T04:02:34.432 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.694789.log.gz 2023-07-07T04:02:34.432 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.331602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226219.log 2023-07-07T04:02:34.432 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331602.log.gz 2023-07-07T04:02:34.432 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.695374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307591.log 2023-07-07T04:02:34.432 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695374.log.gz 2023-07-07T04:02:34.433 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.226219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.781526.log 2023-07-07T04:02:34.433 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226219.log.gz 2023-07-07T04:02:34.433 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.307591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244282.log 2023-07-07T04:02:34.433 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307591.log.gz 2023-07-07T04:02:34.433 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.781526.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.657074.log -- replaced with /var/log/ceph/ceph-client.admin.781526.log.gz 2023-07-07T04:02:34.433 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:34.434 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.244282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317240.log 2023-07-07T04:02:34.434 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244282.log.gz 2023-07-07T04:02:34.434 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.657074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297175.log 2023-07-07T04:02:34.434 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.657074.log.gz 2023-07-07T04:02:34.434 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.317240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201402.log 2023-07-07T04:02:34.435 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317240.log.gz 2023-07-07T04:02:34.435 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321254.log 2023-07-07T04:02:34.435 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.297175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.297175.log.gz 2023-07-07T04:02:34.435 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.201402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277993.log 2023-07-07T04:02:34.435 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201402.log.gz 2023-07-07T04:02:34.436 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.321254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696717.log 2023-07-07T04:02:34.436 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321254.log.gz 2023-07-07T04:02:34.436 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.277993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399591.log 2023-07-07T04:02:34.436 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277993.log.gz 2023-07-07T04:02:34.436 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.696717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200540.log 2023-07-07T04:02:34.437 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696717.log.gz 2023-07-07T04:02:34.437 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.399591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619599.log 2023-07-07T04:02:34.437 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.399591.log.gz 2023-07-07T04:02:34.437 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.200540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264203.log 2023-07-07T04:02:34.437 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200540.log.gz 2023-07-07T04:02:34.437 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.619599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.803550.log 2023-07-07T04:02:34.438 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619599.log.gz 2023-07-07T04:02:34.438 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.264203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336521.log 2023-07-07T04:02:34.438 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264203.log.gz 2023-07-07T04:02:34.438 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.803550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347728.log 2023-07-07T04:02:34.438 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.803550.log.gz 2023-07-07T04:02:34.439 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.336521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267713.log 2023-07-07T04:02:34.439 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336521.log.gz 2023-07-07T04:02:34.439 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.347728.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.347728.log.gz-5 2023-07-07T04:02:34.439 INFO:teuthology.orchestra.run.smithi006.stderr:--verbose -- /var/log/ceph/ceph-client.0.119448.log 2023-07-07T04:02:34.439 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.267713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.802528.log 2023-07-07T04:02:34.440 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267713.log.gz 2023-07-07T04:02:34.440 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.0.119448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318279.log 2023-07-07T04:02:34.440 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.119448.log.gz 2023-07-07T04:02:34.440 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.802528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279215.log 2023-07-07T04:02:34.440 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.802528.log.gz 2023-07-07T04:02:34.440 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.318279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.941971.log 2023-07-07T04:02:34.441 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318279.log.gz 2023-07-07T04:02:34.441 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.279215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357079.log 2023-07-07T04:02:34.441 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279215.log.gz 2023-07-07T04:02:34.441 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.941971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388074.log 2023-07-07T04:02:34.441 INFO:teuthology.orchestra.run.smithi006.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.941971.log.gz 2023-07-07T04:02:34.442 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.357079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281050.log 2023-07-07T04:02:34.442 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357079.log.gz 2023-07-07T04:02:34.442 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.388074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.774694.log 2023-07-07T04:02:34.442 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.388074.log.gz 2023-07-07T04:02:34.442 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.281050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314994.log 2023-07-07T04:02:34.443 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281050.log.gz 2023-07-07T04:02:34.443 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.774694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.798798.log 2023-07-07T04:02:34.443 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.774694.log.gz 2023-07-07T04:02:34.443 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.314994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340272.log 2023-07-07T04:02:34.443 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314994.log.gz 2023-07-07T04:02:34.443 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.798798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157389.log 2023-07-07T04:02:34.444 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.798798.log.gz 2023-07-07T04:02:34.444 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.340272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107542.log 2023-07-07T04:02:34.444 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340272.log.gz 2023-07-07T04:02:34.444 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.157389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.799001.log 2023-07-07T04:02:34.444 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157389.log.gz 2023-07-07T04:02:34.445 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.803053.log 2023-07-07T04:02:34.445 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171137.log 2023-07-07T04:02:34.445 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.799001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.799001.log.gz 2023-07-07T04:02:34.445 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.803053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.798705.log 2023-07-07T04:02:34.445 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.803053.log.gz 2023-07-07T04:02:34.446 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.171137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171137.log.gz 2023-07-07T04:02:34.446 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.777472.log 2023-07-07T04:02:34.446 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.798705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292750.log 2023-07-07T04:02:34.446 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.798705.log.gz 2023-07-07T04:02:34.446 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.777472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.777472.log.gz 2023-07-07T04:02:34.446 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.688521.log 2023-07-07T04:02:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.292750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393743.log 2023-07-07T04:02:34.447 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292750.log.gz 2023-07-07T04:02:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.688521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354450.log 2023-07-07T04:02:34.447 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.688521.log.gz 2023-07-07T04:02:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.393743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339589.log 0.0% 2023-07-07T04:02:34.448 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.393743.log.gz 2023-07-07T04:02:34.448 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.354450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301407.log 2023-07-07T04:02:34.448 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354450.log.gz 2023-07-07T04:02:34.448 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.339589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323234.log 2023-07-07T04:02:34.448 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339589.log.gz 2023-07-07T04:02:34.449 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.301407.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.757671.log -- replaced with /var/log/ceph/ceph-client.admin.301407.log.gz 2023-07-07T04:02:34.449 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:34.449 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.323234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414282.log 2023-07-07T04:02:34.449 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323234.log.gz 2023-07-07T04:02:34.449 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.757671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626156.log 2023-07-07T04:02:34.449 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.757671.log.gz 2023-07-07T04:02:34.450 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.414282.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.363197.log 2023-07-07T04:02:34.450 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.414282.log.gz 2023-07-07T04:02:34.450 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.626156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159322.log 2023-07-07T04:02:34.450 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626156.log.gz 2023-07-07T04:02:34.450 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.363197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681785.log 2023-07-07T04:02:34.451 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363197.log.gz 2023-07-07T04:02:34.451 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.159322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.813572.log 2023-07-07T04:02:34.451 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159322.log.gz 2023-07-07T04:02:34.451 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.681785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300010.log 2023-07-07T04:02:34.451 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681785.log.gz 2023-07-07T04:02:34.451 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.813572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311622.log 2023-07-07T04:02:34.452 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.813572.log.gz 2023-07-07T04:02:34.452 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.300010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403383.log 2023-07-07T04:02:34.452 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300010.log.gz 2023-07-07T04:02:34.452 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.311622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636792.log 2023-07-07T04:02:34.452 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311622.log.gz 2023-07-07T04:02:34.453 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.403383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641582.log 2023-07-07T04:02:34.453 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.403383.log.gz 2023-07-07T04:02:34.453 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.636792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.801520.log 2023-07-07T04:02:34.453 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636792.log.gz 2023-07-07T04:02:34.453 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.641582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348755.log 2023-07-07T04:02:34.454 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.641582.log.gz 2023-07-07T04:02:34.454 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.801520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408170.log 2023-07-07T04:02:34.454 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.801520.log.gz 2023-07-07T04:02:34.454 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.348755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114991.log 2023-07-07T04:02:34.454 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348755.log.gz 2023-07-07T04:02:34.455 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.408170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.764833.log 2023-07-07T04:02:34.455 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408170.log.gz 2023-07-07T04:02:34.455 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.114991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.650447.log 2023-07-07T04:02:34.455 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.764833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367728.log 2023-07-07T04:02:34.455 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.764833.log.gz 2023-07-07T04:02:34.455 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.650447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178065.log 2023-07-07T04:02:34.456 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.650447.log.gz 2023-07-07T04:02:34.456 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.367728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.779712.log 2023-07-07T04:02:34.456 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.367728.log.gz 2023-07-07T04:02:34.456 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.178065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222721.log 2023-07-07T04:02:34.456 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178065.log.gz 2023-07-07T04:02:34.457 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.779712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405544.log 2023-07-07T04:02:34.457 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.779712.log.gz 2023-07-07T04:02:34.457 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.222721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447710.log 2023-07-07T04:02:34.457 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222721.log.gz 2023-07-07T04:02:34.457 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.405544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619121.log 2023-07-07T04:02:34.458 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405544.log.gz 2023-07-07T04:02:34.458 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.447710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283317.log 2023-07-07T04:02:34.458 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.447710.log.gz 2023-07-07T04:02:34.458 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.619121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422430.log 2023-07-07T04:02:34.458 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619121.log.gz 2023-07-07T04:02:34.458 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.283317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.668560.log 2023-07-07T04:02:34.459 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283317.log.gz 2023-07-07T04:02:34.459 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.422430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326704.log 2023-07-07T04:02:34.459 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.422430.log.gz 2023-07-07T04:02:34.459 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.668560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427872.log 2023-07-07T04:02:34.459 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.668560.log.gz 2023-07-07T04:02:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.326704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634187.log 2023-07-07T04:02:34.460 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326704.log.gz 2023-07-07T04:02:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.427872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156645.log 2023-07-07T04:02:34.460 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.427872.log.gz 2023-07-07T04:02:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.634187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401532.log 2023-07-07T04:02:34.461 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634187.log.gz 2023-07-07T04:02:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.156645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277098.log 2023-07-07T04:02:34.461 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156645.log.gz 2023-07-07T04:02:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.401532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109566.log 2023-07-07T04:02:34.461 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.401532.log.gz 2023-07-07T04:02:34.462 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.277098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112087.log 2023-07-07T04:02:34.462 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277098.log.gz 2023-07-07T04:02:34.462 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.109566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687210.log 2023-07-07T04:02:34.462 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.112087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389563.log 2023-07-07T04:02:34.462 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.687210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282800.log 2023-07-07T04:02:34.462 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687210.log.gz 2023-07-07T04:02:34.463 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.389563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211561.log 2023-07-07T04:02:34.463 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.389563.log.gz 2023-07-07T04:02:34.463 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.282800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426793.log 2023-07-07T04:02:34.463 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282800.log.gz 2023-07-07T04:02:34.463 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.211561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475109.log 2023-07-07T04:02:34.464 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211561.log.gz 2023-07-07T04:02:34.464 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.426793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278549.log 2023-07-07T04:02:34.464 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.426793.log.gz 2023-07-07T04:02:34.464 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.475109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414361.log 2023-07-07T04:02:34.464 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.475109.log.gz 2023-07-07T04:02:34.465 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.278549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709153.log 2023-07-07T04:02:34.465 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278549.log.gz 2023-07-07T04:02:34.465 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.414361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379872.log 2023-07-07T04:02:34.465 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.414361.log.gz 2023-07-07T04:02:34.465 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.709153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395766.log 2023-07-07T04:02:34.465 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709153.log.gz 2023-07-07T04:02:34.466 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.379872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166610.log 2023-07-07T04:02:34.466 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.379872.log.gz 2023-07-07T04:02:34.466 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.395766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338547.log 2023-07-07T04:02:34.466 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395766.log.gz 2023-07-07T04:02:34.466 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.166610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.818705.log 2023-07-07T04:02:34.467 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166610.log.gz 2023-07-07T04:02:34.467 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.338547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407573.log 2023-07-07T04:02:34.467 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338547.log.gz 2023-07-07T04:02:34.467 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.818705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710951.log 2023-07-07T04:02:34.467 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.818705.log.gz 2023-07-07T04:02:34.467 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.407573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.935714.log 2023-07-07T04:02:34.468 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407573.log.gz 2023-07-07T04:02:34.468 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.710951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355947.log 2023-07-07T04:02:34.468 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710951.log.gz 2023-07-07T04:02:34.468 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.935714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.818784.log 2023-07-07T04:02:34.468 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.935714.log.gz 2023-07-07T04:02:34.469 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.355947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385994.log 2023-07-07T04:02:34.469 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355947.log.gz 2023-07-07T04:02:34.469 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.818784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.799217.log 2023-07-07T04:02:34.469 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.818784.log.gz 2023-07-07T04:02:34.469 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.385994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404718.log 2023-07-07T04:02:34.470 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385994.log.gz 2023-07-07T04:02:34.470 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.799217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110180.log 2023-07-07T04:02:34.470 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.799217.log.gz 2023-07-07T04:02:34.470 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.404718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407788.log 2023-07-07T04:02:34.470 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.404718.log.gz 2023-07-07T04:02:34.471 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281267.log 2023-07-07T04:02:34.471 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.407788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276094.log 2023-07-07T04:02:34.471 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407788.log.gz 2023-07-07T04:02:34.471 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.281267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245938.log 2023-07-07T04:02:34.471 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281267.log.gz 2023-07-07T04:02:34.471 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.276094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178581.log 2023-07-07T04:02:34.472 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276094.log.gz 2023-07-07T04:02:34.472 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.245938.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-07-07T04:02:34.472 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245938.log.gz 2023-07-07T04:02:34.472 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.178581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338325.log 2023-07-07T04:02:34.472 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178581.log.gz 2023-07-07T04:02:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173009.log 2023-07-07T04:02:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.338325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303025.log 2023-07-07T04:02:34.473 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338325.log.gz 2023-07-07T04:02:34.473 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.173009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269200.log 2023-07-07T04:02:34.473 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173009.log.gz 2023-07-07T04:02:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.303025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391402.log 2023-07-07T04:02:34.474 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303025.log.gz 2023-07-07T04:02:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.269200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.778605.log 2023-07-07T04:02:34.474 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269200.log.gz 2023-07-07T04:02:34.474 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.391402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.804061.log 2023-07-07T04:02:34.474 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.391402.log.gz 2023-07-07T04:02:34.475 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.778605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384451.log 2023-07-07T04:02:34.475 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.778605.log.gz 2023-07-07T04:02:34.475 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.804061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269107.log 2023-07-07T04:02:34.475 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.804061.log.gz 2023-07-07T04:02:34.475 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.384451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115083.log 2023-07-07T04:02:34.476 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384451.log.gz 2023-07-07T04:02:34.476 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.269107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197090.log 2023-07-07T04:02:34.476 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269107.log.gz 2023-07-07T04:02:34.476 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341777.log 2023-07-07T04:02:34.476 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.197090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116101.log 2023-07-07T04:02:34.477 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197090.log.gz 2023-07-07T04:02:34.477 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.341777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308107.log 2023-07-07T04:02:34.477 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341777.log.gz 2023-07-07T04:02:34.477 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.116101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284085.log 2023-07-07T04:02:34.477 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.308107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107367.log 2023-07-07T04:02:34.477 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308107.log.gz 2023-07-07T04:02:34.478 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.284085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161864.log 2023-07-07T04:02:34.478 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284085.log.gz 2023-07-07T04:02:34.478 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.107367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395468.log 2023-07-07T04:02:34.478 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.161864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332310.log 2023-07-07T04:02:34.478 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161864.log.gz 2023-07-07T04:02:34.479 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.395468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279509.log 2023-07-07T04:02:34.479 INFO:teuthology.orchestra.run.smithi006.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117038.log.gz 2023-07-07T04:02:34.479 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395468.log.gz 2023-07-07T04:02:34.479 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.332310.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.332310.log.gz--verbose 2023-07-07T04:02:34.479 INFO:teuthology.orchestra.run.smithi006.stderr:-- /var/log/ceph/ceph-client.admin.274621.log 2023-07-07T04:02:34.480 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.279509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.707404.log 2023-07-07T04:02:34.480 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279509.log.gz 2023-07-07T04:02:34.480 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.274621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419725.log 2023-07-07T04:02:34.480 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274621.log.gz 2023-07-07T04:02:34.480 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.707404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627550.log 2023-07-07T04:02:34.481 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707404.log.gz 2023-07-07T04:02:34.481 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.419725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356262.log 2023-07-07T04:02:34.481 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.419725.log.gz 2023-07-07T04:02:34.481 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.627550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199908.log 2023-07-07T04:02:34.481 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627550.log.gz 2023-07-07T04:02:34.481 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.356262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259817.log 2023-07-07T04:02:34.482 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356262.log.gz 2023-07-07T04:02:34.482 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.199908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.936197.log 2023-07-07T04:02:34.482 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199908.log.gz 2023-07-07T04:02:34.482 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.259817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255842.log 2023-07-07T04:02:34.482 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259817.log.gz 2023-07-07T04:02:34.483 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.936197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306156.log 2023-07-07T04:02:34.483 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.936197.log.gz 2023-07-07T04:02:34.483 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.255842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637170.log 2023-07-07T04:02:34.483 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255842.log.gz 2023-07-07T04:02:34.483 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.306156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332821.log 2023-07-07T04:02:34.483 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306156.log.gz 2023-07-07T04:02:34.484 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.637170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346701.log 2023-07-07T04:02:34.484 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637170.log.gz 2023-07-07T04:02:34.484 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.332821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415795.log 2023-07-07T04:02:34.484 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332821.log.gz 2023-07-07T04:02:34.484 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.346701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302529.log 2023-07-07T04:02:34.485 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346701.log.gz 2023-07-07T04:02:34.485 INFO:teuthology.orchestra.run.smithi006.stderr:gzip /var/log/ceph/ceph-client.admin.415795.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.645427.log 2023-07-07T04:02:34.485 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.415795.log.gz 2023-07-07T04:02:34.485 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.302529.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.388291.log 2023-07-07T04:02:34.485 INFO:teuthology.orchestra.run.smithi006.stderr: -- replaced with /var/log/ceph/ceph-client.admin.302529.log.gz 2023-07-07T04:02:34.486 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.645427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192177.log 2023-07-07T04:02:34.486 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645427.log.gz 2023-07-07T04:02:34.486 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.388291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311018.log 2023-07-07T04:02:34.486 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.388291.log.gz 2023-07-07T04:02:34.486 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.192177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110523.log 2023-07-07T04:02:34.486 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192177.log.gz 2023-07-07T04:02:34.487 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.311018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341546.log 2023-07-07T04:02:34.487 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311018.log.gz 2023-07-07T04:02:34.487 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.698261.log 2023-07-07T04:02:34.487 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.341546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.661295.log 2023-07-07T04:02:34.487 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341546.log.gz 2023-07-07T04:02:34.488 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.698261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337591.log 2023-07-07T04:02:34.488 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.698261.log.gz 2023-07-07T04:02:34.488 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.661295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628964.log 2023-07-07T04:02:34.488 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.661295.log.gz 2023-07-07T04:02:34.488 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.337591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647394.log 2023-07-07T04:02:34.489 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337591.log.gz 2023-07-07T04:02:34.489 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.628964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.693619.log 2023-07-07T04:02:34.489 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628964.log.gz 2023-07-07T04:02:34.489 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.647394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654876.log 2023-07-07T04:02:34.489 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.647394.log.gz 2023-07-07T04:02:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.693619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631300.log 2023-07-07T04:02:34.490 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.693619.log.gz 2023-07-07T04:02:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.654876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646546.log 2023-07-07T04:02:34.490 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654876.log.gz 2023-07-07T04:02:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.631300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331896.log 2023-07-07T04:02:34.490 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.631300.log.gz 2023-07-07T04:02:34.491 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.646546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363626.log 2023-07-07T04:02:34.491 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646546.log.gz 2023-07-07T04:02:34.491 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.331896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331896.log.gz 2023-07-07T04:02:34.491 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366015.log 2023-07-07T04:02:34.491 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.363626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.363626.log.gz 2023-07-07T04:02:34.492 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404155.log 2023-07-07T04:02:34.492 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.366015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353333.log 2023-07-07T04:02:34.492 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.366015.log.gz 2023-07-07T04:02:34.492 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.404155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645737.log 2023-07-07T04:02:34.492 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.404155.log.gz 2023-07-07T04:02:34.493 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.353333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198559.log 2023-07-07T04:02:34.493 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353333.log.gz 2023-07-07T04:02:34.493 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.645737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655374.log 2023-07-07T04:02:34.493 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645737.log.gz 2023-07-07T04:02:34.493 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.198559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415299.log 2023-07-07T04:02:34.493 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198559.log.gz 2023-07-07T04:02:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.655374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388305.log 2023-07-07T04:02:34.494 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655374.log.gz 2023-07-07T04:02:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.415299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329748.log 2023-07-07T04:02:34.494 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.415299.log.gz 2023-07-07T04:02:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.388305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.774185.log 2023-07-07T04:02:34.495 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.388305.log.gz 2023-07-07T04:02:34.495 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.329748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115599.log 2023-07-07T04:02:34.495 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329748.log.gz 2023-07-07T04:02:34.495 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.774185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258758.log 2023-07-07T04:02:34.495 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.774185.log.gz 2023-07-07T04:02:34.495 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.115599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.799527.log 2023-07-07T04:02:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.258758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329253.log 2023-07-07T04:02:34.496 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258758.log.gz 2023-07-07T04:02:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.799527.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.799527.log.gz-5 2023-07-07T04:02:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:--verbose -- /var/log/ceph/ceph-client.admin.703649.log 2023-07-07T04:02:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.329253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177641.log 2023-07-07T04:02:34.497 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329253.log.gz 2023-07-07T04:02:34.497 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.703649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365444.log 2023-07-07T04:02:34.497 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703649.log.gz 2023-07-07T04:02:34.497 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.177641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373581.log 2023-07-07T04:02:34.497 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177641.log.gz 2023-07-07T04:02:34.498 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.365444.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.815426.log -- replaced with /var/log/ceph/ceph-client.admin.365444.log.gz 2023-07-07T04:02:34.498 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:02:34.498 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.373581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316868.log 2023-07-07T04:02:34.498 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.373581.log.gz 2023-07-07T04:02:34.498 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.815426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480017.log 2023-07-07T04:02:34.499 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.815426.log.gz 2023-07-07T04:02:34.499 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.316868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110410.log 2023-07-07T04:02:34.499 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316868.log.gz 2023-07-07T04:02:34.499 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.480017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376773.log 2023-07-07T04:02:34.499 INFO:teuthology.orchestra.run.smithi006.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.480017.log.gz 2023-07-07T04:02:34.499 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/ceph-client.admin.110410.log: /var/log/ceph/ceph-client.admin.376773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.376773.log.gz 2023-07-07T04:02:34.500 INFO:teuthology.orchestra.run.smithi006.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.119053.log.gz 2023-07-07T04:02:34.500 INFO:teuthology.orchestra.run.smithi006.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107367.log.gz 2023-07-07T04:02:34.500 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107542.log.gz 2023-07-07T04:02:34.500 INFO:teuthology.orchestra.run.smithi006.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.109101.log.gz 2023-07-07T04:02:34.500 INFO:teuthology.orchestra.run.smithi006.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109566.log.gz 2023-07-07T04:02:34.501 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110180.log.gz 2023-07-07T04:02:34.501 INFO:teuthology.orchestra.run.smithi006.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110410.log.gz 2023-07-07T04:02:34.501 INFO:teuthology.orchestra.run.smithi006.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110523.log.gz 2023-07-07T04:02:34.501 INFO:teuthology.orchestra.run.smithi006.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.112087.log.gz 2023-07-07T04:02:35.209 INFO:teuthology.orchestra.run.smithi006.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114623.log.gz 2023-07-07T04:02:35.210 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114991.log.gz 2023-07-07T04:02:35.210 INFO:teuthology.orchestra.run.smithi006.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115083.log.gz 2023-07-07T04:02:35.210 INFO:teuthology.orchestra.run.smithi006.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.115599.log.gz 2023-07-07T04:02:35.211 INFO:teuthology.orchestra.run.smithi006.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116101.log.gz 2023-07-07T04:02:57.934 INFO:teuthology.orchestra.run.smithi006.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-07-07T04:02:59.013 INFO:teuthology.orchestra.run.smithi040.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-07-07T04:03:01.592 INFO:teuthology.orchestra.run.smithi040.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-07-07T04:04:14.027 INFO:teuthology.orchestra.run.smithi040.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-07-07T04:04:17.087 INFO:teuthology.orchestra.run.smithi040.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-07-07T04:04:21.419 INFO:teuthology.orchestra.run.smithi040.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-07-07T04:04:28.378 INFO:teuthology.orchestra.run.smithi040.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-07-07T04:04:38.714 INFO:teuthology.orchestra.run.smithi006.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-07-07T04:05:07.599 INFO:teuthology.orchestra.run.smithi006.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-07-07T04:05:07.701 INFO:teuthology.orchestra.run.smithi006.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-07-07T04:05:26.384 INFO:teuthology.orchestra.run.smithi040.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-07-07T04:05:26.388 INFO:teuthology.orchestra.run.smithi040.stderr: 2023-07-07T04:05:26.388 INFO:teuthology.orchestra.run.smithi040.stderr:real 2m53.658s 2023-07-07T04:05:26.389 INFO:teuthology.orchestra.run.smithi040.stderr:user 6m5.833s 2023-07-07T04:05:26.389 INFO:teuthology.orchestra.run.smithi040.stderr:sys 0m13.080s 2023-07-07T04:05:43.075 INFO:teuthology.orchestra.run.smithi006.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-07-07T04:05:54.341 INFO:teuthology.orchestra.run.smithi006.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-07-07T04:05:54.343 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-07-07T04:05:54.344 INFO:teuthology.orchestra.run.smithi006.stderr:real 3m21.652s 2023-07-07T04:05:54.344 INFO:teuthology.orchestra.run.smithi006.stderr:user 6m9.804s 2023-07-07T04:05:54.344 INFO:teuthology.orchestra.run.smithi006.stderr:sys 0m15.437s 2023-07-07T04:05:54.345 INFO:tasks.ceph:Archiving logs... 2023-07-07T04:05:54.345 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-06_19:33:28-fs-wip-rishabh-2023Jul5-testing-default-smithi/7328165/remote/smithi006/log 2023-07-07T04:05:54.347 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-07T04:16:02.998 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-06_19:33:28-fs-wip-rishabh-2023Jul5-testing-default-smithi/7328165/remote/smithi040/log 2023-07-07T04:16:03.016 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-07T04:30:09.217 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-07-07T04:30:09.363 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-07-07T04:30:09.364 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-07T04:30:09.367 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-07T04:30:09.569 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-07-07T04:30:09.579 INFO:teuthology.task.clock:Checking final clock skew... 2023-07-07T04:30:09.579 DEBUG:teuthology.orchestra.run.smithi006:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-07T04:30:09.582 DEBUG:teuthology.orchestra.run.smithi040:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-07T04:30:09.599 INFO:teuthology.orchestra.run.smithi006.stderr:bash: ntpq: command not found 2023-07-07T04:30:09.601 INFO:teuthology.orchestra.run.smithi040.stderr:bash: ntpq: command not found 2023-07-07T04:30:09.646 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-07T04:30:09.646 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2023-07-07T04:30:09.646 INFO:teuthology.orchestra.run.smithi040.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 0 +289us[ +289us] +/- 96ms 2023-07-07T04:30:09.647 INFO:teuthology.orchestra.run.smithi040.stdout:^* hv02.front.sepia.ceph.com 3 6 377 49 -272us[ -282us] +/- 71ms 2023-07-07T04:30:09.647 INFO:teuthology.orchestra.run.smithi040.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 48 +29us[ +29us] +/- 68ms 2023-07-07T04:30:09.647 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-07-07T04:30:09.709 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-07T04:30:09.710 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2023-07-07T04:30:09.710 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 41 +278us[ +279us] +/- 95ms 2023-07-07T04:30:09.710 INFO:teuthology.orchestra.run.smithi006.stdout:^* hv02.front.sepia.ceph.com 3 6 377 40 -256us[ -255us] +/- 71ms 2023-07-07T04:30:09.710 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 +53us[ +54us] +/- 69ms 2023-07-07T04:30:09.711 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-07-07T04:30:09.711 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-07-07T04:30:09.721 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-07-07T04:30:09.721 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-07-07T04:30:09.740 DEBUG:teuthology.orchestra.run.smithi006:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-07T04:30:09.858 DEBUG:teuthology.orchestra.run.smithi040:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-07T04:30:10.050 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-07T04:30:10.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-07T04:30:10.086 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-07T04:30:10.120 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-07T04:30:10.121 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-07-07T04:30:10.130 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-07-07T04:30:10.173 INFO:teuthology.task.internal:Duration was 31446.302830 seconds 2023-07-07T04:30:10.173 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-07-07T04:30:10.206 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-07-07T04:30:10.207 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-07T04:30:10.210 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-07T04:30:10.285 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-07T04:30:10.303 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-07T04:30:10.719 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-07-07T04:30:10.719 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi006.front.sepia.ceph.com 2023-07-07T04:30:10.719 DEBUG:teuthology.orchestra.run.smithi006:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-07T04:30:10.804 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi040.front.sepia.ceph.com 2023-07-07T04:30:10.804 DEBUG:teuthology.orchestra.run.smithi040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-07T04:30:10.848 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-07-07T04:30:10.848 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-07T04:30:10.851 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-07T04:30:11.010 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-07-07T04:30:11.010 DEBUG:teuthology.orchestra.run.smithi006:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-07T04:30:11.012 DEBUG:teuthology.orchestra.run.smithi040:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-07T04:30:11.251 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-07-07T04:30:11.262 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-07-07T04:30:11.262 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-07T04:30:11.297 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-07T04:30:11.330 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-07-07T04:30:11.340 DEBUG:teuthology.orchestra.run.smithi006:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-07T04:30:11.342 DEBUG:teuthology.orchestra.run.smithi040:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-07T04:30:11.396 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = core 2023-07-07T04:30:11.411 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = core 2023-07-07T04:30:11.456 DEBUG:teuthology.orchestra.run.smithi006:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-07T04:30:11.476 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-07T04:30:11.477 DEBUG:teuthology.orchestra.run.smithi040:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-07T04:30:11.512 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-07T04:30:11.512 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-07-07T04:30:11.522 INFO:teuthology.task.internal:Transferring archived files... 2023-07-07T04:30:11.523 DEBUG:teuthology.misc:Transferring archived files from smithi006:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-06_19:33:28-fs-wip-rishabh-2023Jul5-testing-default-smithi/7328165/remote/smithi006 2023-07-07T04:30:11.524 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-07T04:30:11.585 DEBUG:teuthology.misc:Transferring archived files from smithi040:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-06_19:33:28-fs-wip-rishabh-2023Jul5-testing-default-smithi/7328165/remote/smithi040 2023-07-07T04:30:11.585 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-07T04:30:11.640 INFO:teuthology.task.internal:Removing archive directory... 2023-07-07T04:30:11.640 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-07T04:30:11.642 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-07T04:30:11.661 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-07-07T04:30:11.671 INFO:teuthology.task.internal:Not uploading archives. 2023-07-07T04:30:11.672 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-07-07T04:30:11.690 INFO:teuthology.task.internal:Tidying up after the test... 2023-07-07T04:30:11.690 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-07T04:30:11.704 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-07T04:30:11.720 INFO:teuthology.orchestra.run.smithi040.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 7 04:30 /home/ubuntu/cephtest 2023-07-07T04:30:11.722 INFO:teuthology.orchestra.run.smithi006.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 7 04:30 /home/ubuntu/cephtest 2023-07-07T04:30:11.724 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-07-07T04:30:11.734 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-07-07T04:30:11.791 INFO:teuthology.nuke:Checking targets against current locks 2023-07-07T04:30:11.820 DEBUG:teuthology.nuke:shortname: smithi006 2023-07-07T04:30:11.821 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-07T04:30:11.846 DEBUG:teuthology.nuke:shortname: smithi040 2023-07-07T04:30:11.847 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-07T04:30:11.849 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-06_19:33:28-fs-wip-rishabh-2023Jul5-testing-default-smithi/7328165', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 19:34:45.220970', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-07T04:30:11.869 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-06_19:33:28-fs-wip-rishabh-2023Jul5-testing-default-smithi/7328165', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-06 19:34:45.219863', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-07T04:30:11.904 INFO:teuthology.orchestra.console:Power off smithi006 2023-07-07T04:30:11.905 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-07T04:30:11.925 INFO:teuthology.orchestra.console:Power off smithi040 2023-07-07T04:30:11.926 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-07T04:30:11.936 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T04:30:11.948 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T04:30:15.962 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T04:30:15.975 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T04:30:20.082 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T04:30:20.093 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T04:30:20.305 INFO:teuthology.orchestra.console:Power off for smithi040 completed 2023-07-07T04:30:24.199 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-07T04:30:24.411 INFO:teuthology.orchestra.console:Power off for smithi006 completed 2023-07-07T04:30:24.517 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} duration: 31446.302830457687 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=dcf48721361549959f52956ab70b7641 status: fail success: false 2023-07-07T04:30:24.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-07T04:30:24.610 INFO:teuthology.run:FAIL